2024-09-15T22:31:37.781 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:31:37.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:31:37.887 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270 branch: squid description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906270' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu6o57LZKh/KWMr9MZLgiNLXGjU2KC2H5pp+PMSmU+vUahvbGDXsFlbkeQvuUVSNbLvK2aNoIOnbwRBTysHcZY= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSGDJCPrNMxXbNb3skW8hanvqt3xkTbRikuMUSRyOCWVS5Qd2pc8rgv/xyftrBIVcKBURLQ6rzMsktMicw0pSs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:31:37.887 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:31:37.888 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:31:37.888 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:31:37.890 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:31:37.911 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:31:37.911 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:31:37.911 INFO:teuthology.packaging:ref: None 2024-09-15T22:31:37.911 INFO:teuthology.packaging:tag: None 2024-09-15T22:31:37.912 INFO:teuthology.packaging:branch: squid 2024-09-15T22:31:37.912 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:31:37.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T22:31:38.123 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T22:31:38.125 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:31:38.132 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:31:38.132 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:31:38.140 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:31:38.157 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:31:38.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:31:38.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:26:40.166083', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu6o57LZKh/KWMr9MZLgiNLXGjU2KC2H5pp+PMSmU+vUahvbGDXsFlbkeQvuUVSNbLvK2aNoIOnbwRBTysHcZY='} 2024-09-15T22:31:38.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:26:40.164528', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSGDJCPrNMxXbNb3skW8hanvqt3xkTbRikuMUSRyOCWVS5Qd2pc8rgv/xyftrBIVcKBURLQ6rzMsktMicw0pSs='} 2024-09-15T22:31:38.212 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:31:38.219 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-15T22:31:38.219 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-15T22:31:38.219 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:31:38.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3af7d0fbe0>, signals=[15]) 2024-09-15T22:31:38.277 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:31:38.283 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:31:38.283 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:31:38.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:31:38.401 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:31:38.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:31:38.476 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:31:38.483 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-15T22:31:38.501 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-15T22:31:38.501 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-15T22:31:38.559 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-15T22:31:38.559 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-15T22:31:38.559 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-15T22:31:38.559 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:31:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:31:38.561 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-15T22:31:38.585 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-09-15T22:31:38.603 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-09-15T22:31:38.603 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-09-15T22:31:38.662 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-09-15T22:31:38.662 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-09-15T22:31:38.662 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-09-15T22:31:38.662 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:31:38.663 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:31:38.663 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-09-15T22:31:38.684 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:31:38.694 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:31:38.700 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:31:38.700 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:31:38.703 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:31:38.719 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:31:38.726 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:31:38.726 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:31:38.760 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:31:38.879 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:31:38.928 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:31:38.944 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:31:38.944 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-15T22:31:38.944 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-15T22:31:38.944 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:31:38.945 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:31:38.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:38.962 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-15T22:31:38.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:38.963 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-15T22:31:39.020 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:31:39.021 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-15T22:31:39.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-15T22:31:39.022 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:31:39.022 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.14.0-503.el9.x86_64 2024-09-15T22:31:39.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-09-15T22:31:41.354 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-15T22:31:41.519 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-15T22:31:44.836 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-15T22:31:47.004 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-15T22:31:51.255 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-15T22:31:51.261 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-15T22:31:52.737 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-15T22:31:52.789 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-15T22:31:54.299 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-15T22:31:54.685 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-15T22:31:59.672 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-15T22:32:00.107 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-15T22:32:01.687 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:32:01.687 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:32:01.774 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:32:01.783 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout:Install 4 Packages 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 79 M 2024-09-15T22:32:01.784 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 126 M 2024-09-15T22:32:01.785 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-15T22:32:01.898 INFO:teuthology.orchestra.run.smithi177.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 248 kB/s | 23 kB 00:00 2024-09-15T22:32:02.088 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:32:02.089 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:32:02.191 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-15T22:32:02.195 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-15T22:32:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-15T22:32:02.195 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-15T22:32:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:32:02.197 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-15T22:32:02.197 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-15T22:32:02.197 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-15T22:32:02.257 INFO:teuthology.orchestra.run.smithi177.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-15T22:32:02.383 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 264 kB/s | 23 kB 00:00 2024-09-15T22:32:02.665 INFO:teuthology.orchestra.run.smithi177.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-15T22:32:03.107 INFO:teuthology.orchestra.run.smithi177.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-15T22:32:03.107 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:32:03.108 INFO:teuthology.orchestra.run.smithi177.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-15T22:32:03.784 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-15T22:32:04.131 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-15T22:32:04.131 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-15T22:32:05.097 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-15T22:32:05.097 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-15T22:32:06.425 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-15T22:32:07.540 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-15T22:32:08.218 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:32:08.291 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:32:09.725 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-15T22:32:11.097 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:32:11.236 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:32:11.600 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-15T22:32:11.600 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:32:11.600 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.4 MB/s | 79 MB 00:09 2024-09-15T22:32:12.288 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-15T22:32:12.624 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-15T22:32:12.625 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-15T22:32:13.592 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-15T22:32:13.592 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-15T22:32:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-15T22:32:16.082 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:32:16.186 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:16.692 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:32:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:32:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:32:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:32:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:24.547 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:32:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:29.478 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:59.554 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:59.598 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:32:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:32:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:32:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:33:00.770 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-15T22:33:01.138 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:33:01.228 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:01.229 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:33:01.229 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:33:01.229 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:33:01.229 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:33:01.229 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-15T22:33:01.229 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:33:01.229 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:33:01.288 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:01.288 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:33:01.288 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-09-15T22:33:01.320 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 82.el9 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8274670 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-09-15T22:33:01.321 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:33:01.322 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:33:01.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:33:01.323 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:33:01.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:33:01.960 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-09-15T22:33:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:33:03.376 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-09-15T22:33:03.378 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-15T22:33:03.393 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.AoN7ha9f3k 2024-09-15T22:33:03.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AoN7ha9f3k 2024-09-15T22:33:03.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.AoN7ha9f3k 2024-09-15T22:33:03.604 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.AoN7ha9f3k is 6KB 2024-09-15T22:33:03.651 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.AoN7ha9f3k 2024-09-15T22:33:03.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:33:03.742 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:33:03.742 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:33:03.742 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:33:03.742 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:33:03.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:33:03.895 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-09-15T22:33:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:33:07.434 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:33:07.798 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:33:07.798 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:33:07.798 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:33:07.798 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:33:08.658 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:33:08.658 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:33:08.658 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-15T22:33:08.658 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:08.658 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:33:08.659 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:33:08.659 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:33:08.659 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:33:08.659 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-15T22:33:09.026 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:33:09.112 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:09.112 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:33:09.112 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:33:09.113 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:33:09.113 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:33:09.113 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-15T22:33:09.113 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:33:09.113 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:33:09.171 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:33:09.171 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:33:09.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-15T22:33:09.211 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-15T22:33:09.211 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-15T22:33:09.211 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:33:09.212 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:33:09.213 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:33:09.214 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:33:09.214 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:33:09.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:33:09.828 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-15T22:33:11.264 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:33:11.299 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-15T22:33:11.301 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-15T22:33:11.317 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.gBV5PDdG1D 2024-09-15T22:33:11.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gBV5PDdG1D 2024-09-15T22:33:11.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.gBV5PDdG1D 2024-09-15T22:33:11.526 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.gBV5PDdG1D is 6KB 2024-09-15T22:33:11.575 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.gBV5PDdG1D 2024-09-15T22:33:11.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:33:11.652 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:33:11.652 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:33:11.652 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:33:11.652 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:33:11.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:33:11.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-15T22:33:33.917 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-15T22:33:33.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:33:33.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:33:41.819 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T22:33:41.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:33:41.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:33:52.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-09-15T22:34:00.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-15T22:34:01.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:34:01.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:34:04.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-09-15T22:34:09.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:34:09.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:34:12.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-15T22:34:16.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:34:16.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:34:24.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:34:24.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:34:42.881 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-15T22:34:48.386 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-15T22:34:48.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:34:48.776 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:34:48.777 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-15T22:34:48.791 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:34:48.792 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:34:48.792 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:34:48.792 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:34:49.792 DEBUG:teuthology.parallel:result is None 2024-09-15T22:34:57.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:34:57.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:34:58.214 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-15T22:34:58.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:34:58.552 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:34:58.552 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-15T22:34:58.567 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:34:58.567 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:34:58.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:34:58.567 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:34:59.568 DEBUG:teuthology.parallel:result is None 2024-09-15T22:34:59.569 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:34:59.577 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:34:59.578 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:34:59.580 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:34:59.600 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:34:59.607 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:34:59.620 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:34:59.620 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:34:59.631 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:34:59.678 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:34:59.686 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:34:59.686 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:34:59.690 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:34:59.770 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:34:59.798 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:34:59.807 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:34:59.824 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:34:59.826 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:34:59.833 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:34:59.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:34:59.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:34:59.868 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:34:59.881 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:34:59.881 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:34:59.908 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:34:59.925 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:34:59.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:35:00.050 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:35:00.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:35:00.165 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:35:00.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:35:00.226 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:35:00.270 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:35:00.322 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:35:00.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:35:00.450 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:35:00.450 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:35:00.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-15T22:35:00.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-09-15T22:35:00.627 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:35:00.639 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:35:01.125 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:35:01.133 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:35:01.133 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:35:01.145 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:35:01.158 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:35:01.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-15T22:35:01.253 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-15T22:35:01.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-09-15T22:35:01.311 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-09-15T22:35:01.313 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:35:01.313 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-15T22:35:01.359 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-15T22:35:01.359 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-09-15T22:35:01.383 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-09-15T22:35:01.383 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:35:01.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:35:01.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:35:01.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:35:01.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:35:01.457 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:35:01.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:35:01.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:35:01.781 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:35:01.790 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T22:35:01.793 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T22:35:01.904 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:35:01.914 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:35:01.915 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:38:43.268 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-09-15T22:38:43.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:38:43.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:38:43.345 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-15T22:38:43.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-15T22:38:43.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:38:43.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:38:43.499 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-15T22:38:43.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-15T22:38:43.576 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:38:43.587 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:38:43.587 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:38:43.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:38:43.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:38:43.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:38:43.616 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:38:43.630 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:38:43.645 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:38:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-15T22:38:43.659 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:38:43.665 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-15T22:38:43.679 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:38:43.684 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-09-15T22:38:43.693 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:38:43.695 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-09-15T22:38:43.709 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:38:43.723 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:38:43.746 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:38:43.750 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:38:43.750 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-15T22:38:43.750 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.750 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.751 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.751 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:38:43.786 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:38:43.786 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-15T22:38:43.786 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.787 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.787 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.787 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:38:43.787 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:38:43.795 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:38:43.795 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:38:43.795 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:38:43.796 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:38:43.801 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:38:43.801 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:38:43.802 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:38:43.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:38:43.804 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:38:43.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:38:43.944 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:38:43.944 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:38:43.948 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:38:43.948 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:38:44.052 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:38:44.053 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:38:44.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:38:44.065 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:38:44.065 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:38:44.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:38:44.079 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:38:44.079 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:38:44.091 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:38:44.091 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:38:44.145 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:38:44.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:38:44.221 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:38:44.235 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:38:44.285 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-15T22:38:44.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-15T22:38:44.298 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-09-15T22:38:44.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-09-15T22:38:44.511 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-15T22:38:44.533 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-09-15T22:38:44.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:38:44.560 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:38:45.089 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 314 kB/s | 83 kB 00:00 2024-09-15T22:38:45.114 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 310 kB/s | 83 kB 00:00 2024-09-15T22:38:45.365 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-15T22:38:45.389 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-15T22:38:45.640 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-15T22:38:45.648 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-15T22:38:46.082 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-15T22:38:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-15T22:38:49.383 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-15T22:38:51.624 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-15T22:38:54.101 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 6.5 MB 00:00 2024-09-15T22:38:55.501 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-15T22:38:56.414 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-15T22:38:58.017 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-15T22:38:59.500 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-15T22:39:00.579 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-15T22:39:01.845 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-15T22:39:04.155 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:39:04.156 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:39:04.166 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:39:04.167 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:39:04.168 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:39:04.169 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:39:04.170 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:39:04.172 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:39:04.173 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:39:04.235 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-15T22:39:04.256 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:39:04.257 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:39:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:39:04.259 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:39:04.260 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:39:04.261 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:39:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:39:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:39:04.264 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:39:04.265 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:39:04.266 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:39:04.267 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:39:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:04.269 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 226 M 2024-09-15T22:39:04.270 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-15T22:39:05.196 INFO:teuthology.orchestra.run.smithi134.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 57 kB/s | 6.5 kB 00:00 2024-09-15T22:39:05.380 INFO:teuthology.orchestra.run.smithi134.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-15T22:39:05.439 INFO:teuthology.orchestra.run.smithi134.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T22:39:05.630 INFO:teuthology.orchestra.run.smithi134.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.8 MB/s | 5.4 MB 00:00 2024-09-15T22:39:05.681 INFO:teuthology.orchestra.run.smithi134.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-15T22:39:05.781 INFO:teuthology.orchestra.run.smithi134.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-15T22:39:06.010 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-15T22:39:06.073 INFO:teuthology.orchestra.run.smithi134.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T22:39:06.531 INFO:teuthology.orchestra.run.smithi134.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T22:39:06.582 INFO:teuthology.orchestra.run.smithi134.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 505 kB/s | 25 kB 00:00 2024-09-15T22:39:06.791 INFO:teuthology.orchestra.run.smithi134.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 17 MB/s | 17 MB 00:01 2024-09-15T22:39:06.978 INFO:teuthology.orchestra.run.smithi134.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 12 MB/s | 11 MB 00:00 2024-09-15T22:39:07.016 INFO:teuthology.orchestra.run.smithi134.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.0 MB/s | 228 kB 00:00 2024-09-15T22:39:07.041 INFO:teuthology.orchestra.run.smithi134.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 431 kB/s | 27 kB 00:00 2024-09-15T22:39:07.066 INFO:teuthology.orchestra.run.smithi134.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 634 kB/s | 32 kB 00:00 2024-09-15T22:39:07.117 INFO:teuthology.orchestra.run.smithi134.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-15T22:39:07.142 INFO:teuthology.orchestra.run.smithi134.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.1 MB/s | 163 kB 00:00 2024-09-15T22:39:07.175 INFO:teuthology.orchestra.run.smithi134.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T22:39:07.201 INFO:teuthology.orchestra.run.smithi134.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.4 MB/s | 506 kB 00:00 2024-09-15T22:39:07.276 INFO:teuthology.orchestra.run.smithi134.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 601 kB/s | 45 kB 00:00 2024-09-15T22:39:07.360 INFO:teuthology.orchestra.run.smithi134.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T22:39:07.443 INFO:teuthology.orchestra.run.smithi134.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-15T22:39:07.519 INFO:teuthology.orchestra.run.smithi134.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-15T22:39:07.544 INFO:teuthology.orchestra.run.smithi134.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 3.1 MB/s | 320 kB 00:00 2024-09-15T22:39:07.569 INFO:teuthology.orchestra.run.smithi134.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.9 MB/s | 300 kB 00:00 2024-09-15T22:39:07.595 INFO:teuthology.orchestra.run.smithi134.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:39:07.620 INFO:teuthology.orchestra.run.smithi134.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:39:07.687 INFO:teuthology.orchestra.run.smithi134.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-15T22:39:07.754 INFO:teuthology.orchestra.run.smithi134.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-15T22:39:07.779 INFO:teuthology.orchestra.run.smithi134.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 346 kB/s | 32 kB 00:00 2024-09-15T22:39:07.804 INFO:teuthology.orchestra.run.smithi134.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.8 MB/s | 146 kB 00:00 2024-09-15T22:39:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:39:08.171 INFO:teuthology.orchestra.run.smithi134.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.3 MB/s | 249 kB 00:00 2024-09-15T22:39:08.263 INFO:teuthology.orchestra.run.smithi134.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-15T22:39:08.280 INFO:teuthology.orchestra.run.smithi134.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 454 kB/s | 49 kB 00:00 2024-09-15T22:39:08.297 INFO:teuthology.orchestra.run.smithi134.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 491 kB/s | 16 kB 00:00 2024-09-15T22:39:08.339 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:39:08.340 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:39:08.353 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:39:08.354 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:39:08.355 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:39:08.356 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:39:08.358 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:39:08.360 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:39:08.361 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:39:08.364 INFO:teuthology.orchestra.run.smithi134.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 3.3 MB/s | 285 kB 00:00 2024-09-15T22:39:08.398 INFO:teuthology.orchestra.run.smithi134.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-15T22:39:08.423 INFO:teuthology.orchestra.run.smithi134.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 312 kB/s | 18 kB 00:00 2024-09-15T22:39:08.424 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:39:08.451 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:39:08.452 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:39:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-09-15T22:39:08.454 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:39:08.455 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:39:08.456 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:39:08.457 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:39:08.458 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:39:08.459 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:39:08.460 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:39:08.461 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:39:08.462 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:08.463 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout:Install 148 Packages 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 8 Packages 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 226 M 2024-09-15T22:39:08.464 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-15T22:39:08.899 INFO:teuthology.orchestra.run.smithi134.stdout:(39/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 21 MB/s | 49 MB 00:02 2024-09-15T22:39:08.924 INFO:teuthology.orchestra.run.smithi134.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 152 kB/s | 80 kB 00:00 2024-09-15T22:39:09.066 INFO:teuthology.orchestra.run.smithi134.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-15T22:39:09.133 INFO:teuthology.orchestra.run.smithi134.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-15T22:39:09.199 INFO:teuthology.orchestra.run.smithi134.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-09-15T22:39:09.225 INFO:teuthology.orchestra.run.smithi134.stdout:(44/156): libquadmath-11.5.0-2.el9.x86_64.rpm 587 kB/s | 191 kB 00:00 2024-09-15T22:39:09.250 INFO:teuthology.orchestra.run.smithi134.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 909 kB/s | 106 kB 00:00 2024-09-15T22:39:09.275 INFO:teuthology.orchestra.run.smithi134.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-15T22:39:09.301 INFO:teuthology.orchestra.run.smithi134.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-15T22:39:09.334 INFO:teuthology.orchestra.run.smithi134.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-15T22:39:09.353 INFO:teuthology.orchestra.run.smithi177.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-15T22:39:09.376 INFO:teuthology.orchestra.run.smithi134.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-15T22:39:09.401 INFO:teuthology.orchestra.run.smithi134.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-15T22:39:09.427 INFO:teuthology.orchestra.run.smithi134.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-15T22:39:09.469 INFO:teuthology.orchestra.run.smithi134.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-15T22:39:09.494 INFO:teuthology.orchestra.run.smithi134.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-15T22:39:09.511 INFO:teuthology.orchestra.run.smithi177.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 5.5 MB/s | 896 kB 00:00 2024-09-15T22:39:09.529 INFO:teuthology.orchestra.run.smithi134.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-15T22:39:09.553 INFO:teuthology.orchestra.run.smithi134.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-15T22:39:09.570 INFO:teuthology.orchestra.run.smithi177.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T22:39:09.594 INFO:teuthology.orchestra.run.smithi134.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-15T22:39:09.637 INFO:teuthology.orchestra.run.smithi134.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-15T22:39:09.662 INFO:teuthology.orchestra.run.smithi134.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-09-15T22:39:09.696 INFO:teuthology.orchestra.run.smithi134.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-15T22:39:09.746 INFO:teuthology.orchestra.run.smithi177.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-15T22:39:09.746 INFO:teuthology.orchestra.run.smithi134.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-15T22:39:09.771 INFO:teuthology.orchestra.run.smithi134.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-15T22:39:09.804 INFO:teuthology.orchestra.run.smithi177.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-15T22:39:09.805 INFO:teuthology.orchestra.run.smithi134.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-15T22:39:09.830 INFO:teuthology.orchestra.run.smithi134.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-15T22:39:09.855 INFO:teuthology.orchestra.run.smithi134.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-15T22:39:09.881 INFO:teuthology.orchestra.run.smithi134.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-15T22:39:09.904 INFO:teuthology.orchestra.run.smithi177.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-15T22:39:09.906 INFO:teuthology.orchestra.run.smithi134.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-15T22:39:10.031 INFO:teuthology.orchestra.run.smithi134.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T22:39:10.131 INFO:teuthology.orchestra.run.smithi134.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-15T22:39:10.165 INFO:teuthology.orchestra.run.smithi134.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 6.6 MB/s | 910 kB 00:00 2024-09-15T22:39:10.188 INFO:teuthology.orchestra.run.smithi177.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T22:39:10.190 INFO:teuthology.orchestra.run.smithi134.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T22:39:10.265 INFO:teuthology.orchestra.run.smithi134.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-15T22:39:10.316 INFO:teuthology.orchestra.run.smithi134.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-15T22:39:10.349 INFO:teuthology.orchestra.run.smithi134.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-15T22:39:10.416 INFO:teuthology.orchestra.run.smithi134.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-15T22:39:10.483 INFO:teuthology.orchestra.run.smithi134.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-15T22:39:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-15T22:39:10.580 INFO:teuthology.orchestra.run.smithi177.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 16 MB/s | 21 MB 00:01 2024-09-15T22:39:10.592 INFO:teuthology.orchestra.run.smithi134.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-15T22:39:10.630 INFO:teuthology.orchestra.run.smithi177.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 507 kB/s | 25 kB 00:00 2024-09-15T22:39:10.667 INFO:teuthology.orchestra.run.smithi134.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-15T22:39:10.692 INFO:teuthology.orchestra.run.smithi134.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 204 kB/s | 26 kB 00:00 2024-09-15T22:39:10.717 INFO:teuthology.orchestra.run.smithi134.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-15T22:39:10.743 INFO:teuthology.orchestra.run.smithi134.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-15T22:39:10.785 INFO:teuthology.orchestra.run.smithi134.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-15T22:39:10.818 INFO:teuthology.orchestra.run.smithi134.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-15T22:39:10.852 INFO:teuthology.orchestra.run.smithi134.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-15T22:39:10.878 INFO:teuthology.orchestra.run.smithi134.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-15T22:39:10.905 INFO:teuthology.orchestra.run.smithi177.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 17 MB/s | 17 MB 00:01 2024-09-15T22:39:10.919 INFO:teuthology.orchestra.run.smithi134.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-09-15T22:39:10.944 INFO:teuthology.orchestra.run.smithi134.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-15T22:39:10.987 INFO:teuthology.orchestra.run.smithi134.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-15T22:39:11.012 INFO:teuthology.orchestra.run.smithi134.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-09-15T22:39:11.022 INFO:teuthology.orchestra.run.smithi177.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:39:11.048 INFO:teuthology.orchestra.run.smithi177.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.6 MB/s | 228 kB 00:00 2024-09-15T22:39:11.073 INFO:teuthology.orchestra.run.smithi177.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 540 kB/s | 27 kB 00:00 2024-09-15T22:39:11.096 INFO:teuthology.orchestra.run.smithi134.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-15T22:39:11.098 INFO:teuthology.orchestra.run.smithi177.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 632 kB/s | 32 kB 00:00 2024-09-15T22:39:11.122 INFO:teuthology.orchestra.run.smithi134.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 381 kB/s | 51 kB 00:00 2024-09-15T22:39:11.140 INFO:teuthology.orchestra.run.smithi177.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-15T22:39:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 401 kB/s | 54 kB 00:00 2024-09-15T22:39:11.165 INFO:teuthology.orchestra.run.smithi177.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T22:39:11.190 INFO:teuthology.orchestra.run.smithi177.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:39:11.216 INFO:teuthology.orchestra.run.smithi177.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 9.8 MB/s | 506 kB 00:00 2024-09-15T22:39:11.218 INFO:teuthology.orchestra.run.smithi134.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 586 kB/s | 42 kB 00:00 2024-09-15T22:39:11.247 INFO:teuthology.orchestra.run.smithi134.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-15T22:39:11.266 INFO:teuthology.orchestra.run.smithi177.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 903 kB/s | 45 kB 00:00 2024-09-15T22:39:11.272 INFO:teuthology.orchestra.run.smithi134.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.0 MB/s | 221 kB 00:00 2024-09-15T22:39:11.314 INFO:teuthology.orchestra.run.smithi134.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-15T22:39:11.339 INFO:teuthology.orchestra.run.smithi134.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-15T22:39:11.368 INFO:teuthology.orchestra.run.smithi177.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.3 MB/s | 136 kB 00:00 2024-09-15T22:39:11.381 INFO:teuthology.orchestra.run.smithi134.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-15T22:39:11.406 INFO:teuthology.orchestra.run.smithi134.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-15T22:39:11.448 INFO:teuthology.orchestra.run.smithi134.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-15T22:39:11.458 INFO:teuthology.orchestra.run.smithi177.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-15T22:39:11.473 INFO:teuthology.orchestra.run.smithi134.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-15T22:39:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.4 MB/s | 161 kB 00:00 2024-09-15T22:39:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 6.3 MB/s | 320 kB 00:00 2024-09-15T22:39:11.515 INFO:teuthology.orchestra.run.smithi134.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-15T22:39:11.534 INFO:teuthology.orchestra.run.smithi177.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.8 MB/s | 300 kB 00:00 2024-09-15T22:39:11.560 INFO:teuthology.orchestra.run.smithi177.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:39:11.585 INFO:teuthology.orchestra.run.smithi177.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:39:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:39:11.702 INFO:teuthology.orchestra.run.smithi177.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-15T22:39:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 381 kB/s | 32 kB 00:00 2024-09-15T22:39:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.8 MB/s | 146 kB 00:00 2024-09-15T22:39:11.799 INFO:teuthology.orchestra.run.smithi134.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-15T22:39:11.866 INFO:teuthology.orchestra.run.smithi134.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.1 MB/s | 548 kB 00:00 2024-09-15T22:39:11.908 INFO:teuthology.orchestra.run.smithi134.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T22:39:11.933 INFO:teuthology.orchestra.run.smithi134.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-15T22:39:11.972 INFO:teuthology.orchestra.run.smithi177.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 15 MB/s | 3.6 MB 00:00 2024-09-15T22:39:12.047 INFO:teuthology.orchestra.run.smithi177.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.3 MB/s | 249 kB 00:00 2024-09-15T22:39:12.139 INFO:teuthology.orchestra.run.smithi177.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-15T22:39:12.141 INFO:teuthology.orchestra.run.smithi134.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-15T22:39:12.164 INFO:teuthology.orchestra.run.smithi177.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 422 kB/s | 49 kB 00:00 2024-09-15T22:39:12.189 INFO:teuthology.orchestra.run.smithi177.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T22:39:12.215 INFO:teuthology.orchestra.run.smithi177.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:39:12.225 INFO:teuthology.orchestra.run.smithi134.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-15T22:39:12.250 INFO:teuthology.orchestra.run.smithi134.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-15T22:39:12.257 INFO:teuthology.orchestra.run.smithi177.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 11 MB/s | 765 kB 00:00 2024-09-15T22:39:12.276 INFO:teuthology.orchestra.run.smithi134.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-09-15T22:39:12.282 INFO:teuthology.orchestra.run.smithi177.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 273 kB/s | 18 kB 00:00 2024-09-15T22:39:12.309 INFO:teuthology.orchestra.run.smithi134.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-15T22:39:12.334 INFO:teuthology.orchestra.run.smithi134.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-15T22:39:12.376 INFO:teuthology.orchestra.run.smithi134.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-15T22:39:12.402 INFO:teuthology.orchestra.run.smithi134.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:39:12.427 INFO:teuthology.orchestra.run.smithi134.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-15T22:39:12.444 INFO:teuthology.orchestra.run.smithi134.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 772 kB/s | 32 kB 00:00 2024-09-15T22:39:12.461 INFO:teuthology.orchestra.run.smithi134.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-15T22:39:12.482 INFO:teuthology.orchestra.run.smithi177.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-15T22:39:12.536 INFO:teuthology.orchestra.run.smithi134.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-15T22:39:12.570 INFO:teuthology.orchestra.run.smithi134.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-15T22:39:12.604 INFO:teuthology.orchestra.run.smithi134.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T22:39:12.616 INFO:teuthology.orchestra.run.smithi177.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-15T22:39:12.646 INFO:teuthology.orchestra.run.smithi134.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 764 kB/s | 863 kB 00:01 2024-09-15T22:39:12.649 INFO:teuthology.orchestra.run.smithi177.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-15T22:39:12.671 INFO:teuthology.orchestra.run.smithi134.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-15T22:39:12.704 INFO:teuthology.orchestra.run.smithi134.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 423 kB/s | 11 kB 00:00 2024-09-15T22:39:12.738 INFO:teuthology.orchestra.run.smithi134.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 564 kB/s | 18 kB 00:00 2024-09-15T22:39:12.763 INFO:teuthology.orchestra.run.smithi134.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-15T22:39:12.788 INFO:teuthology.orchestra.run.smithi134.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-09-15T22:39:12.814 INFO:teuthology.orchestra.run.smithi134.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-15T22:39:12.839 INFO:teuthology.orchestra.run.smithi134.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-15T22:39:12.873 INFO:teuthology.orchestra.run.smithi134.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T22:39:12.898 INFO:teuthology.orchestra.run.smithi134.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:39:12.948 INFO:teuthology.orchestra.run.smithi134.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-15T22:39:12.973 INFO:teuthology.orchestra.run.smithi134.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-15T22:39:12.999 INFO:teuthology.orchestra.run.smithi134.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-15T22:39:13.032 INFO:teuthology.orchestra.run.smithi134.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-15T22:39:13.058 INFO:teuthology.orchestra.run.smithi134.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-15T22:39:13.083 INFO:teuthology.orchestra.run.smithi134.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-15T22:39:13.100 INFO:teuthology.orchestra.run.smithi177.stdout:(42/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 20 MB/s | 49 MB 00:02 2024-09-15T22:39:13.108 INFO:teuthology.orchestra.run.smithi134.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-15T22:39:13.133 INFO:teuthology.orchestra.run.smithi134.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-15T22:39:13.134 INFO:teuthology.orchestra.run.smithi177.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 490 kB/s | 253 kB 00:00 2024-09-15T22:39:13.159 INFO:teuthology.orchestra.run.smithi134.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T22:39:13.184 INFO:teuthology.orchestra.run.smithi134.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-15T22:39:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-15T22:39:13.208 INFO:teuthology.orchestra.run.smithi134.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:39:13.233 INFO:teuthology.orchestra.run.smithi134.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-15T22:39:13.258 INFO:teuthology.orchestra.run.smithi134.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-15T22:39:13.259 INFO:teuthology.orchestra.run.smithi177.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.0 MB/s | 1.2 MB 00:00 2024-09-15T22:39:13.283 INFO:teuthology.orchestra.run.smithi134.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-15T22:39:13.284 INFO:teuthology.orchestra.run.smithi177.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-15T22:39:13.309 INFO:teuthology.orchestra.run.smithi134.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T22:39:13.310 INFO:teuthology.orchestra.run.smithi177.stdout:(47/156): python3-ply-3.11-14.el9.noarch.rpm 509 kB/s | 106 kB 00:00 2024-09-15T22:39:13.334 INFO:teuthology.orchestra.run.smithi134.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:39:13.359 INFO:teuthology.orchestra.run.smithi134.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:39:13.368 INFO:teuthology.orchestra.run.smithi177.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-15T22:39:13.426 INFO:teuthology.orchestra.run.smithi134.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T22:39:13.477 INFO:teuthology.orchestra.run.smithi177.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-15T22:39:13.527 INFO:teuthology.orchestra.run.smithi177.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-15T22:39:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 581 kB/s | 107 kB 00:00 2024-09-15T22:39:13.578 INFO:teuthology.orchestra.run.smithi177.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-09-15T22:39:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-15T22:39:13.635 INFO:teuthology.orchestra.run.smithi134.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-15T22:39:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-15T22:39:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-15T22:39:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-15T22:39:13.743 INFO:teuthology.orchestra.run.smithi134.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-15T22:39:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:(57/156): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 18 kB 00:00 2024-09-15T22:39:13.794 INFO:teuthology.orchestra.run.smithi134.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 816 kB/s | 41 kB 00:00 2024-09-15T22:39:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-15T22:39:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 490 kB/s | 45 kB 00:00 2024-09-15T22:39:13.852 INFO:teuthology.orchestra.run.smithi134.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-15T22:39:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-15T22:39:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-15T22:39:13.936 INFO:teuthology.orchestra.run.smithi134.stdout:(153/156): librados2-19.1.1-326.g8921c8ef.el9.x 5.7 MB/s | 3.4 MB 00:00 2024-09-15T22:39:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-15T22:39:13.964 INFO:teuthology.orchestra.run.smithi177.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-15T22:39:13.986 INFO:teuthology.orchestra.run.smithi134.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-15T22:39:13.998 INFO:teuthology.orchestra.run.smithi177.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-15T22:39:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-15T22:39:14.049 INFO:teuthology.orchestra.run.smithi177.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-15T22:39:14.070 INFO:teuthology.orchestra.run.smithi134.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-15T22:39:14.140 INFO:teuthology.orchestra.run.smithi177.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-15T22:39:14.224 INFO:teuthology.orchestra.run.smithi177.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-15T22:39:14.258 INFO:teuthology.orchestra.run.smithi177.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-15T22:39:14.312 INFO:teuthology.orchestra.run.smithi134.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.4 MB/s | 2.4 MB 00:00 2024-09-15T22:39:14.317 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:39:14.317 INFO:teuthology.orchestra.run.smithi134.stdout:Total 23 MB/s | 226 MB 00:10 2024-09-15T22:39:14.325 INFO:teuthology.orchestra.run.smithi177.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-15T22:39:14.350 INFO:teuthology.orchestra.run.smithi177.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-15T22:39:14.442 INFO:teuthology.orchestra.run.smithi177.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-15T22:39:14.467 INFO:teuthology.orchestra.run.smithi177.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-15T22:39:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-15T22:39:14.551 INFO:teuthology.orchestra.run.smithi177.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 732 kB/s | 61 kB 00:00 2024-09-15T22:39:14.636 INFO:teuthology.orchestra.run.smithi177.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-15T22:39:14.660 INFO:teuthology.orchestra.run.smithi177.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-15T22:39:14.685 INFO:teuthology.orchestra.run.smithi177.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-15T22:39:14.710 INFO:teuthology.orchestra.run.smithi177.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-15T22:39:14.752 INFO:teuthology.orchestra.run.smithi177.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-09-15T22:39:14.777 INFO:teuthology.orchestra.run.smithi177.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 518 kB/s | 35 kB 00:00 2024-09-15T22:39:14.803 INFO:teuthology.orchestra.run.smithi177.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-15T22:39:14.845 INFO:teuthology.orchestra.run.smithi177.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-15T22:39:14.870 INFO:teuthology.orchestra.run.smithi177.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-15T22:39:14.957 INFO:teuthology.orchestra.run.smithi177.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-15T22:39:14.987 INFO:teuthology.orchestra.run.smithi177.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-15T22:39:15.013 INFO:teuthology.orchestra.run.smithi177.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 461 kB/s | 77 kB 00:00 2024-09-15T22:39:15.038 INFO:teuthology.orchestra.run.smithi177.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.3 MB/s | 269 kB 00:00 2024-09-15T22:39:15.072 INFO:teuthology.orchestra.run.smithi177.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-15T22:39:15.097 INFO:teuthology.orchestra.run.smithi177.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-15T22:39:15.130 INFO:teuthology.orchestra.run.smithi177.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 551 kB/s | 51 kB 00:00 2024-09-15T22:39:15.164 INFO:teuthology.orchestra.run.smithi177.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 583 kB/s | 54 kB 00:00 2024-09-15T22:39:15.206 INFO:teuthology.orchestra.run.smithi177.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-15T22:39:15.240 INFO:teuthology.orchestra.run.smithi177.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-09-15T22:39:15.273 INFO:teuthology.orchestra.run.smithi177.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-15T22:39:15.315 INFO:teuthology.orchestra.run.smithi177.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-15T22:39:15.341 INFO:teuthology.orchestra.run.smithi177.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-15T22:39:15.500 INFO:teuthology.orchestra.run.smithi177.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-15T22:39:15.525 INFO:teuthology.orchestra.run.smithi177.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 315 kB/s | 58 kB 00:00 2024-09-15T22:39:15.555 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-15T22:39:15.558 INFO:teuthology.orchestra.run.smithi177.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-15T22:39:15.583 INFO:teuthology.orchestra.run.smithi177.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-15T22:39:15.609 INFO:teuthology.orchestra.run.smithi177.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 760 kB/s | 64 kB 00:00 2024-09-15T22:39:15.634 INFO:teuthology.orchestra.run.smithi177.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-15T22:39:15.701 INFO:teuthology.orchestra.run.smithi177.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-15T22:39:15.709 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-15T22:39:15.709 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-15T22:39:15.726 INFO:teuthology.orchestra.run.smithi177.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 156 kB/s | 22 kB 00:00 2024-09-15T22:39:15.760 INFO:teuthology.orchestra.run.smithi177.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-15T22:39:15.785 INFO:teuthology.orchestra.run.smithi177.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-15T22:39:15.810 INFO:teuthology.orchestra.run.smithi177.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:39:15.844 INFO:teuthology.orchestra.run.smithi177.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-15T22:39:15.873 INFO:teuthology.orchestra.run.smithi177.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-09-15T22:39:15.911 INFO:teuthology.orchestra.run.smithi177.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-15T22:39:15.937 INFO:teuthology.orchestra.run.smithi177.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-09-15T22:39:16.003 INFO:teuthology.orchestra.run.smithi177.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-09-15T22:39:16.029 INFO:teuthology.orchestra.run.smithi177.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:39:16.054 INFO:teuthology.orchestra.run.smithi177.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-15T22:39:16.079 INFO:teuthology.orchestra.run.smithi177.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-15T22:39:16.105 INFO:teuthology.orchestra.run.smithi177.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-15T22:39:16.138 INFO:teuthology.orchestra.run.smithi177.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-09-15T22:39:16.172 INFO:teuthology.orchestra.run.smithi177.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-15T22:39:16.239 INFO:teuthology.orchestra.run.smithi177.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-15T22:39:16.273 INFO:teuthology.orchestra.run.smithi177.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-15T22:39:16.298 INFO:teuthology.orchestra.run.smithi177.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-15T22:39:16.323 INFO:teuthology.orchestra.run.smithi177.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-15T22:39:16.348 INFO:teuthology.orchestra.run.smithi177.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-15T22:39:16.374 INFO:teuthology.orchestra.run.smithi177.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T22:39:16.399 INFO:teuthology.orchestra.run.smithi177.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-15T22:39:16.425 INFO:teuthology.orchestra.run.smithi177.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-15T22:39:16.450 INFO:teuthology.orchestra.run.smithi177.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-15T22:39:16.475 INFO:teuthology.orchestra.run.smithi177.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:39:16.500 INFO:teuthology.orchestra.run.smithi177.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:39:16.526 INFO:teuthology.orchestra.run.smithi177.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:39:16.559 INFO:teuthology.orchestra.run.smithi177.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-15T22:39:16.593 INFO:teuthology.orchestra.run.smithi177.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-15T22:39:16.618 INFO:teuthology.orchestra.run.smithi177.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-15T22:39:16.643 INFO:teuthology.orchestra.run.smithi177.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T22:39:16.669 INFO:teuthology.orchestra.run.smithi177.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-15T22:39:16.711 INFO:teuthology.orchestra.run.smithi177.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-15T22:39:16.736 INFO:teuthology.orchestra.run.smithi177.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-15T22:39:16.761 INFO:teuthology.orchestra.run.smithi177.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-15T22:39:16.787 INFO:teuthology.orchestra.run.smithi177.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-15T22:39:16.812 INFO:teuthology.orchestra.run.smithi177.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:39:16.866 INFO:teuthology.orchestra.run.smithi177.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-15T22:39:16.871 INFO:teuthology.orchestra.run.smithi177.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-15T22:39:16.896 INFO:teuthology.orchestra.run.smithi177.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-15T22:39:16.921 INFO:teuthology.orchestra.run.smithi177.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-15T22:39:16.947 INFO:teuthology.orchestra.run.smithi177.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:39:16.972 INFO:teuthology.orchestra.run.smithi177.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:39:17.023 INFO:teuthology.orchestra.run.smithi177.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T22:39:17.181 INFO:teuthology.orchestra.run.smithi177.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 3.4 MB 00:00 2024-09-15T22:39:17.315 INFO:teuthology.orchestra.run.smithi177.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-09-15T22:39:17.390 INFO:teuthology.orchestra.run.smithi177.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-15T22:39:17.416 INFO:teuthology.orchestra.run.smithi177.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 407 kB/s | 41 kB 00:00 2024-09-15T22:39:17.466 INFO:teuthology.orchestra.run.smithi177.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 6.4 MB/s | 1.8 MB 00:00 2024-09-15T22:39:17.583 INFO:teuthology.orchestra.run.smithi177.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-15T22:39:17.633 INFO:teuthology.orchestra.run.smithi177.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-15T22:39:17.691 INFO:teuthology.orchestra.run.smithi177.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 827 kB/s | 249 kB 00:00 2024-09-15T22:39:17.698 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:39:17.698 INFO:teuthology.orchestra.run.smithi177.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-15T22:39:17.955 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-15T22:39:17.955 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-15T22:39:18.915 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-15T22:39:19.063 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-15T22:39:19.064 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-15T22:39:21.334 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-15T22:39:21.334 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-15T22:39:24.401 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-15T22:39:24.524 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:39:24.568 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:39:24.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:39:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:39:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:39:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:39:25.075 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:39:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:39:25.298 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:39:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:39:25.418 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:39:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:39:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:39:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:39:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:39:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:39:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:39:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:39:25.908 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:39:25.929 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:39:26.126 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:39:26.296 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:39:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:39:26.543 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:26.616 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:39:27.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:39:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:39:27.122 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:39:27.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:39:27.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:39:27.305 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:39:27.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:39:27.381 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:39:27.409 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:39:27.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:39:27.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:39:27.563 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:39:27.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:39:27.655 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-15T22:39:27.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:39:27.733 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:39:27.737 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:39:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:39:27.778 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:39:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:39:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:39:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:39:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:39:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:39:27.929 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:39:27.988 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:39:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:39:28.132 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:39:28.187 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:39:28.478 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:39:28.597 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:39:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:39:28.718 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:39:28.748 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:39:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:39:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:39:28.839 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:39:28.864 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:39:28.876 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:39:28.902 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:39:28.948 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:39:29.052 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:39:29.112 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:39:29.113 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:39:29.144 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:39:29.180 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:39:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:39:29.247 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:39:29.270 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:39:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:39:29.324 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:39:29.346 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:39:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:39:29.372 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:39:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:39:29.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:39:29.466 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:39:29.509 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:39:29.551 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:39:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:39:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:39:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:39:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:39:29.908 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:39:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:39:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:39:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:39:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:39:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:39:30.357 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:39:30.421 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:30.488 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:39:30.617 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:39:30.637 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:39:30.654 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:39:30.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:39:30.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:39:30.746 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:39:30.771 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:39:30.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:39:30.838 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:39:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:39:30.868 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:39:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:39:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:39:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:39:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:39:30.974 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:39:30.994 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:39:31.019 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:39:31.052 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:39:31.079 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:39:31.095 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:39:31.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:39:31.128 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:39:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:39:31.164 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:39:31.232 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:39:31.257 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:39:31.294 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:39:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:39:31.326 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:39:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:39:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:39:31.488 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:39:31.532 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:39:31.560 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:39:31.629 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:39:31.675 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:39:31.757 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:39:31.897 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:39:31.961 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:39:32.026 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:39:32.077 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:39:32.110 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:39:32.210 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:39:32.265 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:39:32.310 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:39:32.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:39:32.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:39:32.478 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:39:32.564 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:39:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:39:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:39:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:39:32.644 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:39:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:39:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:39:32.729 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:39:32.867 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:39:32.927 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:39:32.982 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:39:33.063 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:39:33.103 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:39:33.139 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:39:33.186 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:39:33.222 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:39:33.283 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:39:33.324 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:39:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:39:33.458 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:39:33.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:39:33.501 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:39:33.551 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:39:33.660 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:39:33.701 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:39:33.751 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:39:33.783 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:39:33.808 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:39:33.899 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:39:34.028 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:39:34.060 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:39:34.095 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:39:34.136 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:39:34.178 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:39:34.212 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:39:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:39:34.274 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:39:34.307 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:39:34.357 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:39:34.391 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:39:34.479 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:39:34.530 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:39:34.562 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:39:34.664 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:39:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:39:34.712 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:39:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:39:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:39:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:39:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:39:35.206 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:39:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:39:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:39:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:39:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:39:35.476 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:39:35.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:39:35.617 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:39:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:39:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:39:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:39:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:39:35.871 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:39:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:39:35.946 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:39:35.969 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:39:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:39:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:39:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:39:36.816 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:39:36.933 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:39:38.175 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:39:38.264 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:39:38.269 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:38.292 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:39:38.325 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:39:38.431 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:38.635 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:39:38.738 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:39:38.821 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:39:38.859 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:39:38.896 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:39:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:39:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:39:39.136 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:39:39.136 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:39:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:39:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:39:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:39:39.479 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:39:39.509 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:39:41.768 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:41.797 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:42.343 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:39:42.392 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:39:42.483 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:39:42.484 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:39:42.484 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:39:42.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:42.518 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-15T22:39:50.924 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:39:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:39:51.120 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:51.120 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:39:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:39:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:52.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:39:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:39:52.848 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:52.848 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:39:52.848 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:39:52.848 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:39:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:39:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:39:53.306 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:53.306 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:39:53.307 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:39:53.307 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:39:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:39:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:39:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:39:53.742 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:39:53.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:39:53.877 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:39:53.966 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:39:54.105 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:39:54.155 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:39:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:39:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-09-15T22:39:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-09-15T22:39:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-09-15T22:39:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:39:54.674 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:39:54.674 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:54.674 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:39:54.674 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:54.696 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:39:54.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:39:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:39:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:39:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:39:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:39:55.941 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:39:56.143 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:39:56.169 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:39:56.169 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:56.169 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:39:56.170 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:39:56.170 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:39:56.170 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:56.393 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:39:56.417 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:56.852 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:39:56.876 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:39:56.913 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:39:56.941 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:39:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:39:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:39:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:39:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:39:57.216 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:39:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:39:57.267 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:39:57.268 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:57.268 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:39:57.268 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:39:57.268 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:39:57.268 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:57.287 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:39:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:39:57.328 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:39:57.331 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:39:57.405 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:39:57.429 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:39:57.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:39:57.502 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:39:57.640 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:39:57.692 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:39:57.726 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:39:57.754 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:39:58.209 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:39:58.236 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:39:58.268 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:39:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:39:58.359 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:39:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:39:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:39:58.462 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:39:58.462 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:58.462 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:39:58.462 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:39:58.462 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:39:58.463 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:58.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:39:58.528 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:39:58.528 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:58.528 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:39:58.528 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:58.581 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:39:58.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:58.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:39:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:39:58.930 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:39:58.930 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:39:58.930 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:39:58.931 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:39:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:39:59.402 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:39:59.445 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:40:00.403 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:40:00.436 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:40:00.552 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:40:00.724 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:40:00.755 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:40:00.780 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:40:00.780 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:40:00.780 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:40:00.780 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:40:00.781 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:40:00.781 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:00.831 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:40:00.843 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:40:00.940 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:40:00.996 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:40:01.918 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:40:01.950 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:40:01.974 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:40:01.974 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:40:01.974 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:40:01.974 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:40:01.975 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:40:01.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:02.026 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:40:02.049 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:40:02.049 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:40:02.049 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:40:02.050 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:02.102 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:40:02.125 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:40:02.125 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:40:02.125 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:40:02.125 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:40:02.126 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:40:02.126 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:02.436 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:40:02.459 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:40:02.459 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:40:02.460 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:40:02.460 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:40:02.460 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:40:02.460 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:40:03.526 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:40:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:40:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:40:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:40:03.827 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:40:03.873 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:40:03.903 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:40:03.933 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:40:03.979 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:40:04.577 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:04.618 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:04.640 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:05.474 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:40:05.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:40:05.603 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:40:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:40:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:40:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:40:05.785 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:40:05.785 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:40:05.852 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:40:05.852 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:40:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:40:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:40:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:06.163 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:06.163 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:40:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:40:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:07.039 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:40:07.080 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:40:07.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:40:07.153 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:40:07.180 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:40:07.377 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:40:07.418 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:40:07.450 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:40:07.478 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:40:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:40:08.148 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:08.189 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:08.210 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:40:09.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:40:09.136 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:40:09.185 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:40:09.288 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:40:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:40:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:40:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:40:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:40:09.465 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:40:09.466 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:40:09.549 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:40:09.583 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:40:09.589 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:09.589 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:09.785 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:40:09.785 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:40:09.870 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:40:09.934 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:40:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:40:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:40:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:40:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:40:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:40:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:40:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:40:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:40:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:40:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:40:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:40:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:40:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:40:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:14.490 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:40:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:40:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:40:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:40:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:40:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:40:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:40:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:14.503 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-15T22:40:14.908 DEBUG:teuthology.parallel:result is None 2024-09-15T22:40:15.586 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:15.586 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:40:15.586 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:40:15.586 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:40:15.587 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:40:15.588 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:40:15.600 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:40:15.601 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:40:15.602 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:40:15.603 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:40:15.604 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:40:15.605 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:40:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:40:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:40:15.608 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:40:15.609 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:40:15.610 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:40:18.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:18.433 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.434 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.435 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:40:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:40:18.437 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:40:18.438 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:40:18.439 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:40:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:40:18.441 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:40:18.442 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:40:18.443 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:40:18.444 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:40:18.445 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:40:18.445 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:40:18.445 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:18.445 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-15T22:40:18.861 DEBUG:teuthology.parallel:result is None 2024-09-15T22:40:18.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:40:19.004 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:40:19.030 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:40:19.031 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:40:19.031 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:40:19.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:40:19.171 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:40:19.193 INFO:teuthology.orchestra.run.smithi177.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:40:19.193 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:40:19.194 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:40:19.195 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:40:19.196 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:19.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:40:19.229 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:19.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:40:19.261 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:40:19.261 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:19.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:40:19.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:40:19.366 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:19.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:40:19.391 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:40:19.456 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:40:19.457 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:19.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:40:19.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:40:19.551 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:19.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:40:19.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:40:19.641 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:40:19.641 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:19.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:40:19.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:40:19.734 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:19.734 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:40:19.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:40:19.823 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T22:40:19.900 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T22:40:19.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-15T22:40:19.903 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-09-15T22:40:19.927 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T22:40:19.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:40:19.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:40:19.994 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T22:40:19.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:40:20.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:40:20.066 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T22:40:20.066 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T22:40:20.066 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T22:40:20.066 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:20.066 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:40:20.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:20.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:20.253 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:20.253 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:40:20.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:20.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:20.408 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T22:40:20.408 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T22:40:20.409 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270', 'branch': 'squid', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906270', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu6o57LZKh/KWMr9MZLgiNLXGjU2KC2H5pp+PMSmU+vUahvbGDXsFlbkeQvuUVSNbLvK2aNoIOnbwRBTysHcZY=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSGDJCPrNMxXbNb3skW8hanvqt3xkTbRikuMUSRyOCWVS5Qd2pc8rgv/xyftrBIVcKBURLQ6rzMsktMicw0pSs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T22:40:20.409 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:40:20.412 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:40:20.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:40:20.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:40:20.523 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:20.523 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:40:20.546 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:40:20.547 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-15T22:40:20.602 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:40:20.602 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:20.602 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T22:40:20.602 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:20.603 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:20.603 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-15 22:40:06.689174769 +0000 2024-09-15T22:40:20.603 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-15 22:38:24.164400116 +0000 2024-09-15T22:40:20.603 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-15 22:38:24.164400116 +0000 2024-09-15T22:40:20.603 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-15 22:38:24.164400116 +0000 2024-09-15T22:40:20.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:40:20.665 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:40:20.665 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:40:20.665 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000265858 s, 1.9 MB/s 2024-09-15T22:40:20.666 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:40:20.723 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-15T22:40:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:40:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:20.778 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T22:40:20.778 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:20.779 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:20.779 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-15 22:40:06.690174746 +0000 2024-09-15T22:40:20.779 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-15 22:38:24.484392704 +0000 2024-09-15T22:40:20.779 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-15 22:38:24.484392704 +0000 2024-09-15T22:40:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-15 22:38:24.484392704 +0000 2024-09-15T22:40:20.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:40:20.841 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:40:20.841 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:40:20.841 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000180056 s, 2.8 MB/s 2024-09-15T22:40:20.842 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:40:20.898 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-15 22:40:06.690174746 +0000 2024-09-15T22:40:20.954 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-15 22:38:24.814385061 +0000 2024-09-15T22:40:20.954 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-15 22:38:24.814385061 +0000 2024-09-15T22:40:20.954 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-15 22:38:24.814385061 +0000 2024-09-15T22:40:20.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:40:21.016 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:40:21.016 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:40:21.016 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000201987 s, 2.5 MB/s 2024-09-15T22:40:21.018 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:40:21.074 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-15 22:40:06.690174746 +0000 2024-09-15T22:40:21.129 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-15 22:38:25.132377695 +0000 2024-09-15T22:40:21.130 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-15 22:38:25.132377695 +0000 2024-09-15T22:40:21.130 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-15 22:38:25.132377695 +0000 2024-09-15T22:40:21.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:40:21.192 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:40:21.192 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:40:21.192 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000180869 s, 2.8 MB/s 2024-09-15T22:40:21.193 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:40:21.250 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:21.250 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:21.250 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:40:21.268 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:40:21.268 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-09-15T22:40:21.324 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:40:21.324 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-15 22:40:10.278171127 +0000 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-15 22:38:23.122327114 +0000 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-15 22:38:23.122327114 +0000 2024-09-15T22:40:21.325 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-15 22:38:23.122327114 +0000 2024-09-15T22:40:21.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:40:21.389 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-15T22:40:21.389 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-15T22:40:21.390 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000215945 s, 2.4 MB/s 2024-09-15T22:40:21.391 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:40:21.448 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-15 22:40:10.279171099 +0000 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-15 22:38:23.468317264 +0000 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-15 22:38:23.468317264 +0000 2024-09-15T22:40:21.504 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-15 22:38:23.468317264 +0000 2024-09-15T22:40:21.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:40:21.567 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-15T22:40:21.567 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-15T22:40:21.567 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000196578 s, 2.6 MB/s 2024-09-15T22:40:21.568 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:40:21.625 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-09-15T22:40:21.680 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:40:21.680 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:21.680 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:40:21.680 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:21.680 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:21.681 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-15 22:40:10.279171099 +0000 2024-09-15T22:40:21.681 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-15 22:38:23.801307784 +0000 2024-09-15T22:40:21.681 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-15 22:38:23.801307784 +0000 2024-09-15T22:40:21.681 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-15 22:38:23.801307784 +0000 2024-09-15T22:40:21.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:40:21.743 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-15T22:40:21.743 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-15T22:40:21.743 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000209744 s, 2.4 MB/s 2024-09-15T22:40:21.744 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:40:21.800 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-09-15T22:40:21.855 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:40:21.855 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:40:21.855 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:40:21.855 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:40:21.855 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:40:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-15 22:40:10.279171099 +0000 2024-09-15T22:40:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-15 22:38:24.116298816 +0000 2024-09-15T22:40:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-15 22:38:24.116298816 +0000 2024-09-15T22:40:21.856 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-15 22:38:24.116298816 +0000 2024-09-15T22:40:21.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:40:21.918 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-15T22:40:21.918 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-15T22:40:21.918 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000197886 s, 2.6 MB/s 2024-09-15T22:40:21.919 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:40:21.975 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:21.975 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:40:21.975 INFO:tasks.ceph:Generating config... 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] pid file = 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T22:40:21.976 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T22:40:21.977 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T22:40:21.977 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T22:40:21.978 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-15T22:40:21.978 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T22:40:21.979 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T22:40:21.979 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T22:40:21.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T22:40:22.035 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T22:40:22.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T22:40:22.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:40:22.109 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134'), ('mon.b', '172.21.15.177'), ('mon.c', '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]')] 2024-09-15T22:40:22.109 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T22:40:22.110 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:22.110 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:40:22.165 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --add b 172.21.15.177 --addv c '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid 5af37fce-f477-417d-bd72-01ffdf727d70 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = quincy 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:fsid 5af37fce-f477-417d-bd72-01ffdf727d70 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2024-09-15T22:40:22.251702+0000 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-09-15T22:40:22.251702+0000 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 17 (quincy) 2024-09-15T22:40:22.252 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2024-09-15T22:40:22.253 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2024-09-15T22:40:22.253 INFO:teuthology.orchestra.run.smithi134.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-09-15T22:40:22.253 INFO:teuthology.orchestra.run.smithi134.stdout:2: [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] mon.c 2024-09-15T22:40:22.253 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T22:40:22.254 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:40:22.268 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5af37fce-f477-417d-bd72-01ffdf727d70... 2024-09-15T22:40:22.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:40:22.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-15T22:40:22.352 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:40:22.353 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.354 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.134,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 5af37fce-f477-417d-bd72-01ffdf727d70 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-15T22:40:22.355 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.356 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-09-15T22:40:22.357 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:40:22.358 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: debug finisher = 20 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.359 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:40:22.360 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon down mkfs grace = 300 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:40:22.361 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-15T22:40:22.362 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-15T22:40:22.363 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-15T22:40:22.364 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-09-15T22:40:22.365 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:40:22.366 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-09-15T22:40:22.367 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.134,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 5af37fce-f477-417d-bd72-01ffdf727d70 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-09-15T22:40:22.368 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-09-15T22:40:22.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-09-15T22:40:22.370 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:40:22.371 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug finisher = 20 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-09-15T22:40:22.372 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.373 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: mon down mkfs grace = 300 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on pool no app = False 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-09-15T22:40:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-15T22:40:22.375 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-09-15T22:40:22.376 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-09-15T22:40:22.377 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T22:40:22.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T22:40:22.471 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T22:40:22.472 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:22.472 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T22:40:22.487 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:22.487 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T22:40:22.542 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:40:22.542 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:22.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:40:22.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:40:22.616 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:22.616 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:22.671 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:40:22.671 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:22.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:40:22.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:40:22.706 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:40:22.706 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:22.762 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T22:40:22.763 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T22:40:22.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:40:22.814 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:40:22.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:40:22.876 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:40:22.878 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T22:40:22.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:40:22.929 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:40:22.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T22:40:22.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:40:23.046 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:40:23.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-15T22:40:23.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:40:23.124 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:40:23.127 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T22:40:23.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:40:23.242 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:40:23.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-15T22:40:23.270 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T22:40:23.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:40:23.313 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T22:40:23.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-15T22:40:23.405 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-15T22:40:23.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T22:40:23.459 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T22:40:23.472 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-15T22:40:23.552 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-15T22:40:23.565 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T22:40:23.565 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:40:23.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T22:40:23.590 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:23.590 INFO:tasks.ceph:role: osd.0 2024-09-15T22:40:23.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:40:23.591 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:23.663 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:24.169 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-15T22:40:24.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-15T22:40:24.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T22:40:24.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T22:40:24.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T22:40:24.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:24.388 INFO:tasks.ceph:role: osd.1 2024-09-15T22:40:24.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:40:24.388 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:24.462 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:24.463 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:24.463 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:24.463 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:24.921 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-15T22:40:24.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-15T22:40:24.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T22:40:25.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T22:40:25.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T22:40:25.141 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:25.141 INFO:tasks.ceph:role: osd.2 2024-09-15T22:40:25.141 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:40:25.141 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:40:25.213 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:25.213 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:25.213 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:25.213 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:25.214 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-15T22:40:25.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-15T22:40:25.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T22:40:25.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T22:40:25.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T22:40:25.943 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:25.944 INFO:tasks.ceph:role: osd.3 2024-09-15T22:40:25.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:40:25.944 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:40:26.015 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:26.016 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:26.526 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-15T22:40:26.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-15T22:40:26.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T22:40:26.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T22:40:26.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:26.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:26.805+0000 7f37f9614640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T22:40:26.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:26.806+0000 7f37f9614640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T22:40:26.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:26.806+0000 7f37f9614640 -1 bdev(0x55a983e29800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:26.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:26.806+0000 7f37f9614640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T22:40:29.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T22:40:29.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:30.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:30.091+0000 7fcc4280e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T22:40:30.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:30.091+0000 7fcc4280e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T22:40:30.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:30.091+0000 7fcc4280e640 -1 bdev(0x56094ce4f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:30.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:30.091+0000 7fcc4280e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T22:40:33.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T22:40:34.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:34.109+0000 7efc0c14f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T22:40:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:34.109+0000 7efc0c14f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T22:40:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:34.109+0000 7efc0c14f640 -1 bdev(0x56499ca09800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:34.109+0000 7efc0c14f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T22:40:38.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T22:40:38.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:38.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:38.143+0000 7f7370626640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T22:40:38.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:38.144+0000 7f7370626640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T22:40:38.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:38.144+0000 7f7370626640 -1 bdev(0x55a6e3087800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:38.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:40:38.144+0000 7f7370626640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T22:40:41.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T22:40:41.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T22:40:41.604 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:41.604 INFO:tasks.ceph:role: osd.4 2024-09-15T22:40:41.604 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:40:41.604 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:40:41.680 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:41.680 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:41.680 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:41.681 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:41.681 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:41.681 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:41.681 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:41.681 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:41.682 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:41.682 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:42.181 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-15T22:40:42.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-15T22:40:42.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T22:40:42.299 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T22:40:42.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T22:40:42.397 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:42.397 INFO:tasks.ceph:role: osd.5 2024-09-15T22:40:42.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:40:42.398 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:40:42.471 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:42.471 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:42.471 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:42.471 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:42.472 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:42.927 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-15T22:40:42.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-15T22:40:42.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T22:40:43.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T22:40:43.047 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T22:40:43.112 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:43.112 INFO:tasks.ceph:role: osd.6 2024-09-15T22:40:43.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:40:43.112 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:40:43.183 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:43.183 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:43.184 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:43.665 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-15T22:40:43.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-15T22:40:43.668 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T22:40:43.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T22:40:43.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T22:40:43.880 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:40:43.880 INFO:tasks.ceph:role: osd.7 2024-09-15T22:40:43.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:40:43.880 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:40:43.954 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:40:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:40:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:40:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:40:43.954 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:40:43.955 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:40:43.955 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:40:43.955 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:40:43.955 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:40:43.955 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:40:44.456 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-15T22:40:44.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-15T22:40:44.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T22:40:44.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T22:40:44.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:44.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:44.713+0000 7f6fefe1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T22:40:44.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:44.713+0000 7f6fefe1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T22:40:44.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:44.713+0000 7f6fefe1c640 -1 bdev(0x557d6ca73800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:44.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:44.713+0000 7f6fefe1c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T22:40:48.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T22:40:48.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:48.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:48.499+0000 7f4215e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T22:40:48.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:48.499+0000 7f4215e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T22:40:48.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:48.500+0000 7f4215e11640 -1 bdev(0x557ffeb8d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:48.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:48.500+0000 7f4215e11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T22:40:50.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:50.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:40:52.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T22:40:52.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:52.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:52.528+0000 7fe8f7017640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T22:40:52.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:52.528+0000 7fe8f7017640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T22:40:52.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:52.529+0000 7fe8f7017640 -1 bdev(0x559332779800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:52.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:52.529+0000 7fe8f7017640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T22:40:56.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T22:40:56.457 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:40:56.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:56.547+0000 7f34576b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T22:40:56.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:56.547+0000 7f34576b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T22:40:56.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:56.547+0000 7f34576b2640 -1 bdev(0x562ad81a1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T22:40:56.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:40:56.548+0000 7f34576b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T22:40:59.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T22:40:59.980 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T22:40:59.980 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:40:59.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T22:41:00.011 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T22:41:00.080 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-15T22:41:00.147 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T22:41:00.214 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T22:41:00.280 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T22:41:00.345 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T22:41:00.411 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T22:41:00.441 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T22:41:00.512 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-15T22:41:00.582 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T22:41:00.651 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.651 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T22:41:00.719 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.719 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T22:41:00.786 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T22:41:00.853 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.853 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T22:41:00.869 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:00.869 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-15T22:41:00.925 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.925 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T22:41:00.941 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:00.941 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-15T22:41:00.997 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T22:41:00.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:41:01.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw== 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g== 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg== 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw== 2024-09-15T22:41:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA== 2024-09-15T22:41:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg== 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw== 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ== 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg== 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout:[client.2] 2024-09-15T22:41:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg== 2024-09-15T22:41:01.044 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-15T22:41:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog== 2024-09-15T22:41:01.044 INFO:teuthology.orchestra.run.smithi134.stdout:[client.3] 2024-09-15T22:41:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ== 2024-09-15T22:41:01.061 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-09-15T22:41:01.061 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw== 2024-09-15T22:41:01.061 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg== 2024-09-15T22:41:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ== 2024-09-15T22:41:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg== 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg== 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog== 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2024-09-15T22:41:01.064 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ== 2024-09-15T22:41:01.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:41:01.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:41:01.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:41:01.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:41:01.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.534 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:41:01.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.698 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.802 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:41:01.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:01.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:01.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:01.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:01.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:01.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:02.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:02.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:41:02.080 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T22:41:02.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T22:41:02.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:41:02.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T22:41:02.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T22:41:02.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:41:02.346 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T22:41:02.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T22:41:02.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:41:02.532 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T22:41:02.556 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:41:02.559 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:41:02.611 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T22:41:02.611 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T22:41:02.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T22:41:02.614 INFO:tasks.ceph.mon.a:Started 2024-09-15T22:41:02.614 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T22:41:02.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T22:41:02.653 INFO:tasks.ceph.mon.b:Started 2024-09-15T22:41:02.654 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T22:41:02.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T22:41:02.656 INFO:tasks.ceph.mon.c:Started 2024-09-15T22:41:02.656 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T22:41:02.656 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T22:41:02.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T22:41:02.658 INFO:tasks.ceph.mgr.y:Started 2024-09-15T22:41:02.658 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T22:41:02.659 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T22:41:02.661 INFO:tasks.ceph.mgr.x:Started 2024-09-15T22:41:02.661 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T22:41:02.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T22:41:02.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.758+0000 7f794ad4b640 1 Processor -- start 2024-09-15T22:41:02.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.758+0000 7f794ad4b640 1 -- start start 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f794ad4b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f794ad4b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794415c800 con 0x7f794415c370 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f794ad4b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79440b43f0 con 0x7f794406f130 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f794ad4b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f79440b3630 con 0x7f7944158e50 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7943fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f794415c370 0x7f794406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56664/0 (socket says 172.21.15.134:56664) 2024-09-15T22:41:02.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56496/0 (socket says 172.21.15.134:56496) 2024-09-15T22:41:02.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7943fff640 1 -- 172.21.15.134:0/1889880516 learned_addr learned my addr 172.21.15.134:0/1889880516 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:02.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 -- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 msgr2=0x7f79440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T22:41:02.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 -- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 msgr2=0x7f79440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:41:02.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:41:02.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.759+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:41:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.926+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807794843 0 0) 0x7f794415c800 con 0x7f794415c370 2024-09-15T22:41:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.926+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7934003520 con 0x7f794415c370 2024-09-15T22:41:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2224181346 0 0) 0x7f7934003520 con 0x7f794415c370 2024-09-15T22:41:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 msgr2=0x7f79440b5050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 --2- 172.21.15.134:0/1889880516 >> v2:172.21.15.134:3300/0 conn(0x7f7944158e50 0x7f79440b5050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 >> v1:172.21.15.177:6789/0 conn(0x7f794406f130 legacy=0x7f79440ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79440b3910 con 0x7f794415c370 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7930001810 con 0x7f794415c370 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 >> v1:172.21.15.134:6789/0 conn(0x7f794415c370 legacy=0x7f794406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 0x7f7934003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934004800 0x7f7934004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79340052e0 0x7f793400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79440b3630 con 0x7f7934003a00 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f793400c200 con 0x7f7934004800 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f793400c400 con 0x7f79340052e0 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 0x7f7934003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7943fff640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934004800 0x7f7934004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f79492e8640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79340052e0 0x7f793400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 -- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79340052e0 msgr2=0x7f793400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79340052e0 0x7f793400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 -- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934004800 msgr2=0x7f7934004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934004800 0x7f7934004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.927+0000 7f7948ae7640 1 -- 172.21.15.134:0/1889880516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7934003520 con 0x7f7934003a00 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.928+0000 7f79492e8640 1 -- 172.21.15.134:0/1889880516 reap_dead start 2024-09-15T22:41:02.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.928+0000 7f7948ae7640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 0x7f7934003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f793800b9e0 tx=0x7f7934005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755ac8bc60f83c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.929+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938030070 con 0x7f7934003a00 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.929+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793802ada0 con 0x7f7934003a00 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.929+0000 7f79437fe640 1 -- 172.21.15.134:0/1889880516 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793800b5e0 con 0x7f7934003a00 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 -- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 msgr2=0x7f7934003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 0x7f7934003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f793800b9e0 tx=0x7f7934005830 comp rx=0 tx=0).stop 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 -- 172.21.15.134:0/1889880516 shutdown_connections 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 --2- 172.21.15.134:0/1889880516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934003a00 0x7f7934003e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 -- 172.21.15.134:0/1889880516 >> 172.21.15.134:0/1889880516 conn(0x7f794406bba0 msgr2=0x7f794406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:02.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 -- 172.21.15.134:0/1889880516 shutdown_connections 2024-09-15T22:41:02.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.930+0000 7f794ad4b640 1 -- 172.21.15.134:0/1889880516 wait complete. 2024-09-15T22:41:02.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.931+0000 7f794ad4b640 1 Processor -- start 2024-09-15T22:41:02.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.931+0000 7f794ad4b640 1 -- start start 2024-09-15T22:41:02.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934003a00 0x7f7944144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 0x7f794415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7944159230 con 0x7f7944159990 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79440b3ed0 con 0x7f7934003a00 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.932+0000 7f794ad4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f79440b5050 con 0x7f79440b0520 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56540/0 (socket says 172.21.15.134:56540) 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 -- 172.21.15.134:0/3631577398 learned_addr learned my addr 172.21.15.134:0/3631577398 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7948ae7640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934003a00 0x7f7944144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79492e8640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 0x7f794415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 -- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 msgr2=0x7f794415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 0x7f794415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 -- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934003a00 msgr2=0x7f7944144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934003a00 0x7f7944144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 -- 172.21.15.134:0/3631577398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79441453e0 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79492e8640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 0x7f794415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f7943fff640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79300082f0 tx=0x7f79300087b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793001f070 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793000ed10 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79440b09c0 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793001a680 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79440b0f80 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7930022070 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.933+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7930024bb0 con 0x7f7944159990 2024-09-15T22:41:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.934+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79440b5380 con 0x7f7944159990 2024-09-15T22:41:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.936+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f793001a820 con 0x7f7944159990 2024-09-15T22:41:02.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.998+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7944157890 con 0x7f7944159990 2024-09-15T22:41:03.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:02.999+0000 7f79417fa640 1 -- 172.21.15.134:0/3631577398 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f793001aa00 con 0x7f7944159990 2024-09-15T22:41:03.001 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 msgr2=0x7f79440affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79300082f0 tx=0x7f79300087b0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 shutdown_connections 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79440b0520 0x7f794415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944159990 0x7f79440affe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 --2- 172.21.15.134:0/3631577398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7934003a00 0x7f7944144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 >> 172.21.15.134:0/3631577398 conn(0x7f794406bba0 msgr2=0x7f7944158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 shutdown_connections 2024-09-15T22:41:03.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:03.000+0000 7f794ad4b640 1 -- 172.21.15.134:0/3631577398 wait complete. 2024-09-15T22:41:03.013 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T22:41:03.013 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T22:41:03.013 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:03.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T22:41:03.031 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.030+0000 7f460ae2d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:41:03.032 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.031+0000 7facac430040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:41:03.038 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:03.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T22:41:03.071 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.070+0000 7f460ae2d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:41:03.075 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.073+0000 7facac430040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:41:03.099 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:03.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T22:41:03.165 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:03.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T22:41:03.207 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.205+0000 7f460ae2d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:41:03.224 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.223+0000 7facac430040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:41:03.231 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:03.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T22:41:03.256 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:03.256 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T22:41:03.258 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.257+0000 7f460ae2d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:41:03.276 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.275+0000 7facac430040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:41:03.281 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:03.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T22:41:03.347 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:03.347 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T22:41:03.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ea3ff215-e49e-4025-89fb-7bc1e8254e35 0 2024-09-15T22:41:03.424 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.423+0000 7f460ae2d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:41:03.438 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.437+0000 7facac430040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:41:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.520+0000 7f41e7b2c640 1 Processor -- start 2024-09-15T22:41:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.521+0000 7f41e7b2c640 1 -- start start 2024-09-15T22:41:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.521+0000 7f41e7b2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41e006f760 0x7f41e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.521+0000 7f41e7b2c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e006fd70 con 0x7f41e015e700 2024-09-15T22:41:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.521+0000 7f41e7b2c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e0070050 con 0x7f41e00b5770 2024-09-15T22:41:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.521+0000 7f41e7b2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f41e015eae0 con 0x7f41e006f760 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e50c7640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f41e00b5770 0x7f41e00722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:35754/0 (socket says 172.21.15.177:35754) 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e50c7640 1 -- 172.21.15.177:0/634248848 learned_addr learned my addr 172.21.15.177:0/634248848 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e60c9640 1 --2- 172.21.15.177:0/634248848 >> v2:172.21.15.134:3300/0 conn(0x7f41e006f760 0x7f41e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222958283 0 0) 0x7f41e0070050 con 0x7f41e00b5770 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003520 con 0x7f41e00b5770 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457936496 0 0) 0x7f41e006fd70 con 0x7f41e015e700 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e0070050 con 0x7f41e015e700 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e60c9640 1 -- 172.21.15.177:0/634248848 >> v1:172.21.15.177:6789/0 conn(0x7f41e00b5770 legacy=0x7f41e00722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e60c9640 1 -- 172.21.15.177:0/634248848 >> v1:172.21.15.134:6789/0 conn(0x7f41e015e700 legacy=0x7f41e00b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.522+0000 7f41e60c9640 1 -- 172.21.15.177:0/634248848 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e0071ab0 con 0x7f41e006f760 2024-09-15T22:41:03.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.523+0000 7f41e60c9640 1 --2- 172.21.15.177:0/634248848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e006f760 0x7f41e006e770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009d90 tx=0x7f41d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a96cd649ae0316 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.523+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007740 con 0x7f41e006f760 2024-09-15T22:41:03.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.523+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d80078e0 con 0x7f41e006f760 2024-09-15T22:41:03.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.523+0000 7f41e48c6640 1 -- 172.21.15.177:0/634248848 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007cb0 con 0x7f41e006f760 2024-09-15T22:41:03.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 -- 172.21.15.177:0/634248848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e006f760 msgr2=0x7f41e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/634248848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e006f760 0x7f41e006e770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009d90 tx=0x7f41d802a660 comp rx=0 tx=0).stop 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 -- 172.21.15.177:0/634248848 shutdown_connections 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/634248848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e006f760 0x7f41e006e770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 -- 172.21.15.177:0/634248848 >> 172.21.15.177:0/634248848 conn(0x7f41e006cae0 msgr2=0x7f41e006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 -- 172.21.15.177:0/634248848 shutdown_connections 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.524+0000 7f41e7b2c640 1 -- 172.21.15.177:0/634248848 wait complete. 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.525+0000 7f41e7b2c640 1 Processor -- start 2024-09-15T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.525+0000 7f41e7b2c640 1 -- start start 2024-09-15T22:41:03.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e00b5770 0x7f41e01f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e015e700 0x7f41e01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00729c0 con 0x7f41e015e700 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f41e0062930 con 0x7f41e006f760 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f41e0072b40 con 0x7f41e00b5770 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54328/0 (socket says 172.21.15.177:54328) 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 -- 172.21.15.177:0/1312620869 learned_addr learned my addr 172.21.15.177:0/1312620869 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e50c7640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e00b5770 0x7f41e01f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e60c9640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e015e700 0x7f41e01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 -- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e00b5770 msgr2=0x7f41e01f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e00b5770 0x7f41e01f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 -- 172.21.15.177:0/1312620869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e015e700 msgr2=0x7f41e01507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e015e700 0x7f41e01507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 -- 172.21.15.177:0/1312620869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e015ac00 con 0x7f41e006f760 2024-09-15T22:41:03.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e58c8640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c430 tx=0x7f41dc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc017070 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0052f0 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc003830 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e0156380 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.526+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e0156940 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.527+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41dc01a070 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.527+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f41dc01c780 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.528+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e006e770 con 0x7f41e006f760 2024-09-15T22:41:03.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.530+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f41dc021020 con 0x7f41e006f760 2024-09-15T22:41:03.546 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.545+0000 7facac430040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:41:03.550 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.549+0000 7f460ae2d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:41:03.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.613+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea3ff215-e49e-4025-89fb-7bc1e8254e35", "id": 0} v 0) -- 0x7f41e015cf50 con 0x7f41e006f760 2024-09-15T22:41:03.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.619+0000 7f41d67fc640 1 -- 172.21.15.177:0/1312620869 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea3ff215-e49e-4025-89fb-7bc1e8254e35", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f41dc011cb0 con 0x7f41e006f760 2024-09-15T22:41:03.620 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-09-15T22:41:03.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 msgr2=0x7f41e015a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c430 tx=0x7f41dc00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 shutdown_connections 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e015e700 0x7f41e01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e00b5770 0x7f41e01f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 --2- 172.21.15.177:0/1312620869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e006f760 0x7f41e015a5f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 >> 172.21.15.177:0/1312620869 conn(0x7f41e006cae0 msgr2=0x7f41e015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 shutdown_connections 2024-09-15T22:41:03.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.620+0000 7f41e7b2c640 1 -- 172.21.15.177:0/1312620869 wait complete. 2024-09-15T22:41:03.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 2a624764-e23a-4f07-bcee-f74a5323bc1a 1 2024-09-15T22:41:03.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.728+0000 7f0e2cfd6640 1 Processor -- start 2024-09-15T22:41:03.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.728+0000 7f0e2cfd6640 1 -- start start 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2cfd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2cfd6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0e2806eab0 0x7f0e280d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2cfd6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e280d03b0 con 0x7f0e28071060 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2cfd6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0e280d2c60 con 0x7f0e2806eab0 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2cfd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e28070df0 con 0x7f0e280d2340 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e25d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0e2806eab0 0x7f0e280d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45698/0 (socket says 172.21.15.177:45698) 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e25d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0e2806eab0 0x7f0e280d2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54330/0 (socket says 172.21.15.177:54330) 2024-09-15T22:41:03.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.729+0000 7f0e2659c640 1 -- 172.21.15.177:0/2606597099 learned_addr learned my addr 172.21.15.177:0/2606597099 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:03.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e25d9b640 1 -- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 msgr2=0x7f0e280d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:03.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e25d9b640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e25d9b640 1 -- 172.21.15.177:0/2606597099 >> v1:172.21.15.134:6789/0 conn(0x7f0e28071060 legacy=0x7f0e2806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e25d9b640 1 -- 172.21.15.177:0/2606597099 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e28070b10 con 0x7f0e2806eab0 2024-09-15T22:41:03.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e2659c640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e25d9b640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280d2720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097a0 tx=0x7f0e1002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3437ab8414dcd904 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e2559a640 1 -- 172.21.15.177:0/2606597099 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10037070 con 0x7f0e2806eab0 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e2559a640 1 -- 172.21.15.177:0/2606597099 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10032440 con 0x7f0e2806eab0 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.730+0000 7f0e2559a640 1 -- 172.21.15.177:0/2606597099 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10032810 con 0x7f0e2806eab0 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 msgr2=0x7f0e280d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280d2720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097a0 tx=0x7f0e1002a210 comp rx=0 tx=0).stop 2024-09-15T22:41:03.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/2606597099 shutdown_connections 2024-09-15T22:41:03.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280d2720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/2606597099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e280d2340 0x7f0e280d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/2606597099 >> 172.21.15.177:0/2606597099 conn(0x7f0e280cf010 msgr2=0x7f0e280cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/2606597099 shutdown_connections 2024-09-15T22:41:03.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.731+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/2606597099 wait complete. 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.732+0000 7f0e2cfd6640 1 Processor -- start 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 -- start start 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280d2340 0x7f0e2806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280b55c0 con 0x7f0e280d2340 2024-09-15T22:41:03.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280cfe80 con 0x7f0e2806eab0 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2cfd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280b5740 con 0x7f0e28071060 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e25d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54334/0 (socket says 172.21.15.177:54334) 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e2659c640 1 -- 172.21.15.177:0/3721264402 learned_addr learned my addr 172.21.15.177:0/3721264402 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e25d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45714/0 (socket says 172.21.15.177:45714) 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.733+0000 7f0e26d9d640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280d2340 0x7f0e2806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 -- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 msgr2=0x7f0e280b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 -- 172.21.15.177:0/3721264402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280d2340 msgr2=0x7f0e2806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280d2340 0x7f0e2806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 -- 172.21.15.177:0/3721264402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e280b40e0 con 0x7f0e2806eab0 2024-09-15T22:41:03.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e25d9b640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2659c640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800e9d0 tx=0x7f0e1800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18017070 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1800ca60 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e280aaa20 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800ce10 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e280aafe0 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e1801a070 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.734+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0e18013470 con 0x7f0e2806eab0 2024-09-15T22:41:03.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.735+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2815cbd0 con 0x7f0e2806eab0 2024-09-15T22:41:03.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.739+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0e18006020 con 0x7f0e2806eab0 2024-09-15T22:41:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.808+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a624764-e23a-4f07-bcee-f74a5323bc1a", "id": 1} v 0) -- 0x7f0e280d0d70 con 0x7f0e2806eab0 2024-09-15T22:41:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.813+0000 7f0e1effd640 1 -- 172.21.15.177:0/3721264402 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a624764-e23a-4f07-bcee-f74a5323bc1a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0e18005990 con 0x7f0e2806eab0 2024-09-15T22:41:03.815 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 msgr2=0x7f0e280add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800e9d0 tx=0x7f0e1800ee90 comp rx=0 tx=0).stop 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 shutdown_connections 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280d2340 0x7f0e2806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e28071060 0x7f0e280b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 --2- 172.21.15.177:0/3721264402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2806eab0 0x7f0e280add50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 >> 172.21.15.177:0/3721264402 conn(0x7f0e280cf010 msgr2=0x7f0e2815b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 shutdown_connections 2024-09-15T22:41:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.814+0000 7f0e2cfd6640 1 -- 172.21.15.177:0/3721264402 wait complete. 2024-09-15T22:41:03.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 06741699-5cc6-457a-b545-3bb993eedf42 2 2024-09-15T22:41:03.870 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.869+0000 7facac430040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:41:03.895 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.894+0000 7f460ae2d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:41:03.921 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:03.919+0000 7facac430040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:41:03.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.924+0000 7facbb05e640 1 Processor -- start 2024-09-15T22:41:03.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.924+0000 7facbb05e640 1 -- start start 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facbb05e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facb40d1170 0x7facb40b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facbb05e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 0x7facb40d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facbb05e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb40d0500 con 0x7facb40b3de0 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facbb05e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7facb40d45a0 con 0x7facb415f030 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facbb05e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7facb40d1a90 con 0x7facb40d1170 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facb8dfa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facb40d1170 0x7facb40b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facb95fb640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7facb40b3de0 0x7facb40b7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:35756/0 (socket says 172.21.15.177:35756) 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facb95fb640 1 -- 172.21.15.177:0/4077559904 learned_addr learned my addr 172.21.15.177:0/4077559904 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.925+0000 7facb3fff640 1 --2- 172.21.15.177:0/4077559904 >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 0x7facb40d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb8dfa640 1 -- 172.21.15.177:0/4077559904 >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 msgr2=0x7facb40d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:03.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb8dfa640 1 --2- 172.21.15.177:0/4077559904 >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 0x7facb40d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb8dfa640 1 -- 172.21.15.177:0/4077559904 >> v1:172.21.15.177:6789/0 conn(0x7facb40b3de0 legacy=0x7facb40b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb8dfa640 1 -- 172.21.15.177:0/4077559904 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb40b3620 con 0x7facb40d1170 2024-09-15T22:41:03.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb3fff640 1 --2- 172.21.15.177:0/4077559904 >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 0x7facb40d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb8dfa640 1 --2- 172.21.15.177:0/4077559904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40b3870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7facb408d020 tx=0x7faca802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01530103dbbdd06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb37fe640 1 -- 172.21.15.177:0/4077559904 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8037070 con 0x7facb40d1170 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb37fe640 1 -- 172.21.15.177:0/4077559904 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca8032440 con 0x7facb40d1170 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.926+0000 7facb37fe640 1 -- 172.21.15.177:0/4077559904 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca802ae60 con 0x7facb40d1170 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 -- 172.21.15.177:0/4077559904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 msgr2=0x7facb40b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 --2- 172.21.15.177:0/4077559904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40b3870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7facb408d020 tx=0x7faca802a110 comp rx=0 tx=0).stop 2024-09-15T22:41:03.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 -- 172.21.15.177:0/4077559904 shutdown_connections 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 --2- 172.21.15.177:0/4077559904 >> v2:172.21.15.134:3300/0 conn(0x7facb415f030 0x7facb40d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 --2- 172.21.15.177:0/4077559904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40b3870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 -- 172.21.15.177:0/4077559904 >> 172.21.15.177:0/4077559904 conn(0x7facb40b6330 msgr2=0x7facb40b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 -- 172.21.15.177:0/4077559904 shutdown_connections 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.927+0000 7facbb05e640 1 -- 172.21.15.177:0/4077559904 wait complete. 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.929+0000 7facbb05e640 1 Processor -- start 2024-09-15T22:41:03.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.929+0000 7facbb05e640 1 -- start start 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 0x7facb415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7facb40d2460 con 0x7facb40b3de0 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7facb40d42c0 con 0x7facb40d1170 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facbb05e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7facb40d2740 con 0x7facb415f030 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54342/0 (socket says 172.21.15.177:54342) 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45730/0 (socket says 172.21.15.177:45730) 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb3fff640 1 -- 172.21.15.177:0/3789563009 learned_addr learned my addr 172.21.15.177:0/3789563009 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:03.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb8dfa640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 0x7facb415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 -- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 msgr2=0x7facb40cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 -- 172.21.15.177:0/3789563009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 msgr2=0x7facb415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 0x7facb415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb95fb640 1 -- 172.21.15.177:0/3789563009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb41e4d90 con 0x7facb415f030 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.930+0000 7facb8dfa640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 0x7facb415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb3fff640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb95fb640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7facac00caa0 tx=0x7facac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac017070 con 0x7facb415f030 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac00ab40 con 0x7facb415f030 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb41e5070 con 0x7facb415f030 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac012400 con 0x7facb415f030 2024-09-15T22:41:03.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facb41e5630 con 0x7facb415f030 2024-09-15T22:41:03.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7facac01a070 con 0x7facb415f030 2024-09-15T22:41:03.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.931+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7facac01cae0 con 0x7facb415f030 2024-09-15T22:41:03.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.932+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb40d1550 con 0x7facb415f030 2024-09-15T22:41:03.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:03.934+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7facac01ce00 con 0x7facb415f030 2024-09-15T22:41:03.954 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:03.953+0000 7f460ae2d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:41:04.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.004+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06741699-5cc6-457a-b545-3bb993eedf42", "id": 2} v 0) -- 0x7facb415bc20 con 0x7facb415f030 2024-09-15T22:41:04.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.009+0000 7facb17fa640 1 -- 172.21.15.177:0/3789563009 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06741699-5cc6-457a-b545-3bb993eedf42", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7facac01c810 con 0x7facb415f030 2024-09-15T22:41:04.010 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-09-15T22:41:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 msgr2=0x7facb40cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7facac00caa0 tx=0x7facac00cf60 comp rx=0 tx=0).stop 2024-09-15T22:41:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 shutdown_connections 2024-09-15T22:41:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facb415f030 0x7facb40cf140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facb40d1170 0x7facb40cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 --2- 172.21.15.177:0/3789563009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb40b3de0 0x7facb415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 >> 172.21.15.177:0/3789563009 conn(0x7facb40b6330 msgr2=0x7facb40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 shutdown_connections 2024-09-15T22:41:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.010+0000 7facbb05e640 1 -- 172.21.15.177:0/3789563009 wait complete. 2024-09-15T22:41:04.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 2eb21386-8584-4c34-8254-bdadf09b6bb7 3 2024-09-15T22:41:04.070 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:04.069+0000 7facac430040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:41:04.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:04.112+0000 7f460ae2d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:41:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.119+0000 7f30b19e8640 1 Processor -- start 2024-09-15T22:41:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.119+0000 7f30b19e8640 1 -- start start 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30b19e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f30ac15e700 0x7f30ac06f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30b19e8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f30ac0b5770 0x7f30ac0722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30b19e8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac06fd70 con 0x7f30ac06e770 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30b19e8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac06ebb0 con 0x7f30ac15e700 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30b19e8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac15eae0 con 0x7f30ac0b5770 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30ab7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f30ac0b5770 0x7f30ac0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30ab7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f30ac0b5770 0x7f30ac0722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54344/0 (socket says 172.21.15.177:54344) 2024-09-15T22:41:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30ab7fe640 1 -- 172.21.15.177:0/30163865 learned_addr learned my addr 172.21.15.177:0/30163865 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.120+0000 7f30aaffd640 1 --2- 172.21.15.177:0/30163865 >> v2:172.21.15.134:3300/0 conn(0x7f30ac15e700 0x7f30ac06f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.121+0000 7f30ab7fe640 1 -- 172.21.15.177:0/30163865 >> v2:172.21.15.134:3300/0 conn(0x7f30ac15e700 msgr2=0x7f30ac06f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.121+0000 7f30ab7fe640 1 --2- 172.21.15.177:0/30163865 >> v2:172.21.15.134:3300/0 conn(0x7f30ac15e700 0x7f30ac06f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.121+0000 7f30ab7fe640 1 -- 172.21.15.177:0/30163865 >> v1:172.21.15.134:6789/0 conn(0x7f30ac06e770 legacy=0x7f30ac0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.121+0000 7f30ab7fe640 1 -- 172.21.15.177:0/30163865 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac070050 con 0x7f30ac0b5770 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.121+0000 7f30ab7fe640 1 --2- 172.21.15.177:0/30163865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac0722b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0695d0 tx=0x7f30a402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6ea963b6add3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30a9ffb640 1 -- 172.21.15.177:0/30163865 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4036070 con 0x7f30ac0b5770 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30a9ffb640 1 -- 172.21.15.177:0/30163865 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4031600 con 0x7f30ac0b5770 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30a9ffb640 1 -- 172.21.15.177:0/30163865 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40319d0 con 0x7f30ac0b5770 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 -- 172.21.15.177:0/30163865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 msgr2=0x7f30ac0722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 --2- 172.21.15.177:0/30163865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac0722b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0695d0 tx=0x7f30a402a6a0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 -- 172.21.15.177:0/30163865 shutdown_connections 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 --2- 172.21.15.177:0/30163865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac0722b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 --2- 172.21.15.177:0/30163865 >> v2:172.21.15.134:3300/0 conn(0x7f30ac15e700 0x7f30ac06f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 -- 172.21.15.177:0/30163865 >> 172.21.15.177:0/30163865 conn(0x7f30ac06cae0 msgr2=0x7f30ac06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 -- 172.21.15.177:0/30163865 shutdown_connections 2024-09-15T22:41:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.122+0000 7f30b19e8640 1 -- 172.21.15.177:0/30163865 wait complete. 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.123+0000 7f30b19e8640 1 Processor -- start 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 -- start start 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30ac06e770 0x7f30ac14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 0x7f30ac154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac062930 con 0x7f30ac06e770 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac071d90 con 0x7f30ac0b5770 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30b19e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac0727f0 con 0x7f30ac15e700 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30aa7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 0x7f30ac154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30aa7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54348/0 (socket says 172.21.15.177:54348) 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30aa7fc640 1 -- 172.21.15.177:0/2108881365 learned_addr learned my addr 172.21.15.177:0/2108881365 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.124+0000 7f30aaffd640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30ac06e770 0x7f30ac14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 -- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 msgr2=0x7f30ac153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 -- 172.21.15.177:0/2108881365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30ac06e770 msgr2=0x7f30ac14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30ac06e770 0x7f30ac14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 -- 172.21.15.177:0/2108881365 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac15ed30 con 0x7f30ac15e700 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30ab7fe640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 0x7f30ac154320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0afdd0 tx=0x7f30a4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a403f020 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4037040 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac15f010 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4036070 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac15f5d0 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30a4042020 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.125+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f30a4044a70 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.126+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0722b0 con 0x7f30ac15e700 2024-09-15T22:41:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.128+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f30a4049030 con 0x7f30ac15e700 2024-09-15T22:41:04.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.197+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2eb21386-8584-4c34-8254-bdadf09b6bb7", "id": 3} v 0) -- 0x7f30ac15dcb0 con 0x7f30ac15e700 2024-09-15T22:41:04.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30a3fff640 1 -- 172.21.15.177:0/2108881365 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2eb21386-8584-4c34-8254-bdadf09b6bb7", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f30a4044d10 con 0x7f30ac15e700 2024-09-15T22:41:04.204 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 msgr2=0x7f30ac154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 0x7f30ac154320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0afdd0 tx=0x7f30a4004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 shutdown_connections 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30ac15e700 0x7f30ac154320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac0b5770 0x7f30ac153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 --2- 172.21.15.177:0/2108881365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30ac06e770 0x7f30ac14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.203+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 >> 172.21.15.177:0/2108881365 conn(0x7f30ac06cae0 msgr2=0x7f30ac0ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.204+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 shutdown_connections 2024-09-15T22:41:04.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.204+0000 7f30b19e8640 1 -- 172.21.15.177:0/2108881365 wait complete. 2024-09-15T22:41:04.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 72fccc24-877e-4aa3-93a4-8648ebfb0cf0 4 2024-09-15T22:41:04.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.312+0000 7feeb78c0640 1 Processor -- start 2024-09-15T22:41:04.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.312+0000 7feeb78c0640 1 -- start start 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb78c0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feeb00704b0 0x7feeb015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb78c0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb78c0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb015c7b0 con 0x7feeb0155bb0 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb78c0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7feeb00cf770 con 0x7feeb00704b0 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb78c0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feeb00cfa50 con 0x7feeb015ba80 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45742/0 (socket says 172.21.15.177:45742) 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 -- 172.21.15.177:0/1266181647 learned_addr learned my addr 172.21.15.177:0/1266181647 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb4e5b640 1 --2- 172.21.15.177:0/1266181647 >> v2:172.21.15.134:3300/0 conn(0x7feeb00704b0 0x7feeb015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 -- 172.21.15.177:0/1266181647 >> v2:172.21.15.134:3300/0 conn(0x7feeb00704b0 msgr2=0x7feeb015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 --2- 172.21.15.177:0/1266181647 >> v2:172.21.15.134:3300/0 conn(0x7feeb00704b0 0x7feeb015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 -- 172.21.15.177:0/1266181647 >> v1:172.21.15.134:6789/0 conn(0x7feeb0155bb0 legacy=0x7feeb006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.313+0000 7feeb5e5d640 1 -- 172.21.15.177:0/1266181647 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb00cfd30 con 0x7feeb015ba80 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.314+0000 7feeb5e5d640 1 --2- 172.21.15.177:0/1266181647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feea8009e50 tx=0x7feea802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c236776802f5355 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.314+0000 7feea7fff640 1 -- 172.21.15.177:0/1266181647 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8036070 con 0x7feeb015ba80 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.314+0000 7feea7fff640 1 -- 172.21.15.177:0/1266181647 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8031600 con 0x7feeb015ba80 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.314+0000 7feea7fff640 1 -- 172.21.15.177:0/1266181647 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea80319d0 con 0x7feeb015ba80 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 -- 172.21.15.177:0/1266181647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 msgr2=0x7feeb015bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 --2- 172.21.15.177:0/1266181647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feea8009e50 tx=0x7feea802a710 comp rx=0 tx=0).stop 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 -- 172.21.15.177:0/1266181647 shutdown_connections 2024-09-15T22:41:04.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 --2- 172.21.15.177:0/1266181647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb015bf10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 --2- 172.21.15.177:0/1266181647 >> v2:172.21.15.134:3300/0 conn(0x7feeb00704b0 0x7feeb015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 -- 172.21.15.177:0/1266181647 >> 172.21.15.177:0/1266181647 conn(0x7feeb00b3380 msgr2=0x7feeb00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 -- 172.21.15.177:0/1266181647 shutdown_connections 2024-09-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.315+0000 7feeb78c0640 1 -- 172.21.15.177:0/1266181647 wait complete. 2024-09-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.317+0000 7feeb78c0640 1 Processor -- start 2024-09-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.317+0000 7feeb78c0640 1 -- start start 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 0x7feeb014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb0155bb0 0x7feeb006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feeb015e030 con 0x7feeb0155bb0 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feeb015c450 con 0x7feeb00704b0 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb78c0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feeb015e1b0 con 0x7feeb015ba80 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb5e5d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb565c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 0x7feeb014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb5e5d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45744/0 (socket says 172.21.15.177:45744) 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb5e5d640 1 -- 172.21.15.177:0/58442240 learned_addr learned my addr 172.21.15.177:0/58442240 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.318+0000 7feeb4e5b640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb0155bb0 0x7feeb006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 -- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 msgr2=0x7feeb014c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 0x7feeb014c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 -- 172.21.15.177:0/58442240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb0155bb0 msgr2=0x7feeb006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb0155bb0 0x7feeb006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 -- 172.21.15.177:0/58442240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb00af990 con 0x7feeb015ba80 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb565c640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 0x7feeb014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb5e5d640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feea8009f70 tx=0x7feea8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8041020 con 0x7feeb015ba80 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8007780 con 0x7feeb015ba80 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8036040 con 0x7feeb015ba80 2024-09-15T22:41:04.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb00afc70 con 0x7feeb015ba80 2024-09-15T22:41:04.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb00b0230 con 0x7feeb015ba80 2024-09-15T22:41:04.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feea8044020 con 0x7feeb015ba80 2024-09-15T22:41:04.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.319+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7feea803cb60 con 0x7feeb015ba80 2024-09-15T22:41:04.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.320+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb0070a60 con 0x7feeb015ba80 2024-09-15T22:41:04.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.324+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7feeb0070a60 con 0x7feeb015ba80 2024-09-15T22:41:04.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.393+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "72fccc24-877e-4aa3-93a4-8648ebfb0cf0", "id": 4} v 0) -- 0x7feeb015ca90 con 0x7feeb015ba80 2024-09-15T22:41:04.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.398+0000 7feea5ffb640 1 -- 172.21.15.177:0/58442240 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72fccc24-877e-4aa3-93a4-8648ebfb0cf0", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7feea804b030 con 0x7feeb015ba80 2024-09-15T22:41:04.400 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 msgr2=0x7feeb006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feea8009f70 tx=0x7feea8004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 shutdown_connections 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feeb015ba80 0x7feeb006c0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb0155bb0 0x7feeb006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 --2- 172.21.15.177:0/58442240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb00704b0 0x7feeb014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 >> 172.21.15.177:0/58442240 conn(0x7feeb00b3380 msgr2=0x7feeb00cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 shutdown_connections 2024-09-15T22:41:04.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.399+0000 7feeb78c0640 1 -- 172.21.15.177:0/58442240 wait complete. 2024-09-15T22:41:04.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new eda966ae-16e2-43fe-af94-3c8f51d1242b 5 2024-09-15T22:41:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.517+0000 7f2c44d86640 1 Processor -- start 2024-09-15T22:41:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.517+0000 7f2c44d86640 1 -- start start 2024-09-15T22:41:04.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.518+0000 7f2c44d86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c400b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.518+0000 7f2c44d86640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c400b77f0 0x7f2c400d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.518+0000 7f2c44d86640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c400ceef0 con 0x7f2c40070d80 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.518+0000 7f2c44d86640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2c400b5a80 con 0x7f2c400b77f0 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.518+0000 7f2c44d86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2c400b5d60 con 0x7f2c4015c840 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c400b77f0 0x7f2c400d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c400b77f0 0x7f2c400d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54366/0 (socket says 172.21.15.177:54366) 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 -- 172.21.15.177:0/3118388153 learned_addr learned my addr 172.21.15.177:0/3118388153 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3e59c640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c400b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 -- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 msgr2=0x7f2c400b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c400b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 -- 172.21.15.177:0/3118388153 >> v1:172.21.15.177:6789/0 conn(0x7f2c40070d80 legacy=0x7f2c400b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3d59a640 1 -- 172.21.15.177:0/3118388153 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3177024329 0 0) 0x7f2c400ceef0 con 0x7f2c40070d80 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3ed9d640 1 -- 172.21.15.177:0/3118388153 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c400b6040 con 0x7f2c400b77f0 2024-09-15T22:41:04.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.519+0000 7f2c3e59c640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c400b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.520+0000 7f2c3ed9d640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c400b77f0 0x7f2c400d05c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009e50 tx=0x7f2c3802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678c16b49e1ea022 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.520+0000 7f2c3d59a640 1 -- 172.21.15.177:0/3118388153 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38036070 con 0x7f2c400b77f0 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.520+0000 7f2c3d59a640 1 -- 172.21.15.177:0/3118388153 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c38031600 con 0x7f2c400b77f0 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.520+0000 7f2c3d59a640 1 -- 172.21.15.177:0/3118388153 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380319d0 con 0x7f2c400b77f0 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 -- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c400b77f0 msgr2=0x7f2c400d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c400b77f0 0x7f2c400d05c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009e50 tx=0x7f2c3802a710 comp rx=0 tx=0).stop 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 -- 172.21.15.177:0/3118388153 shutdown_connections 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c400b77f0 0x7f2c400d05c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3118388153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c400b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 -- 172.21.15.177:0/3118388153 >> 172.21.15.177:0/3118388153 conn(0x7f2c4006f370 msgr2=0x7f2c4006f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 -- 172.21.15.177:0/3118388153 shutdown_connections 2024-09-15T22:41:04.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.521+0000 7f2c44d86640 1 -- 172.21.15.177:0/3118388153 wait complete. 2024-09-15T22:41:04.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.522+0000 7f2c44d86640 1 Processor -- start 2024-09-15T22:41:04.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.522+0000 7f2c44d86640 1 -- start start 2024-09-15T22:41:04.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c400b77f0 0x7f2c40158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c40156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c400711c0 con 0x7f2c400b77f0 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2c400b6600 con 0x7f2c40070d80 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c44d86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2c400ce6f0 con 0x7f2c4015c840 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54372/0 (socket says 172.21.15.177:54372) 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 -- 172.21.15.177:0/3742333301 learned_addr learned my addr 172.21.15.177:0/3742333301 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3ed9d640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c40156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3dd9b640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c400b77f0 0x7f2c40158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 -- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 msgr2=0x7f2c40156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c40156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 -- 172.21.15.177:0/3742333301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c400b77f0 msgr2=0x7f2c40158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c400b77f0 0x7f2c40158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.523+0000 7f2c3e59c640 1 -- 172.21.15.177:0/3742333301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c400cd3d0 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c3e59c640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000e960 tx=0x7f2c3000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30017070 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3000ca00 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c400cd650 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000cdd0 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c400cdc10 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c3001a070 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.524+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2c3001c9d0 con 0x7f2c40070d80 2024-09-15T22:41:04.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.525+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c400b56a0 con 0x7f2c40070d80 2024-09-15T22:41:04.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.527+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2c400cd3d0 con 0x7f2c40070d80 2024-09-15T22:41:04.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.596+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eda966ae-16e2-43fe-af94-3c8f51d1242b", "id": 5} v 0) -- 0x7f2c401576c0 con 0x7f2c40070d80 2024-09-15T22:41:04.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.601+0000 7f2c36ffd640 1 -- 172.21.15.177:0/3742333301 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eda966ae-16e2-43fe-af94-3c8f51d1242b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2c3001c450 con 0x7f2c40070d80 2024-09-15T22:41:04.602 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-09-15T22:41:04.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 msgr2=0x7f2c401526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000e960 tx=0x7f2c3000ee20 comp rx=0 tx=0).stop 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 shutdown_connections 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c4015c840 0x7f2c40156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c400b77f0 0x7f2c40158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 --2- 172.21.15.177:0/3742333301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c40070d80 0x7f2c401526c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 >> 172.21.15.177:0/3742333301 conn(0x7f2c4006f370 msgr2=0x7f2c40152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 shutdown_connections 2024-09-15T22:41:04.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.602+0000 7f2c44d86640 1 -- 172.21.15.177:0/3742333301 wait complete. 2024-09-15T22:41:04.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new d86be5c2-49aa-4bbd-9066-f3655ac9576b 6 2024-09-15T22:41:04.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.752+0000 7f99af027640 1 Processor -- start 2024-09-15T22:41:04.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.752+0000 7f99af027640 1 -- start start 2024-09-15T22:41:04.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99af027640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99af027640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99a815c190 0x7f99a8070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99af027640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99a815c7b0 con 0x7f99a806fda0 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99af027640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f99a8070740 con 0x7f99a815c190 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99af027640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99a80cf770 con 0x7f99a8155bb0 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99acdc3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99a7fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f99a806fda0 0x7f99a815ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:35772/0 (socket says 172.21.15.177:35772) 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99a7fff640 1 -- 172.21.15.177:0/2826587633 learned_addr learned my addr 172.21.15.177:0/2826587633 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99ad5c4640 1 --2- 172.21.15.177:0/2826587633 >> v2:172.21.15.134:3300/0 conn(0x7f99a815c190 0x7f99a8070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99acdc3640 1 -- 172.21.15.177:0/2826587633 >> v2:172.21.15.134:3300/0 conn(0x7f99a815c190 msgr2=0x7f99a8070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99acdc3640 1 --2- 172.21.15.177:0/2826587633 >> v2:172.21.15.134:3300/0 conn(0x7f99a815c190 0x7f99a8070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99acdc3640 1 -- 172.21.15.177:0/2826587633 >> v1:172.21.15.177:6789/0 conn(0x7f99a806fda0 legacy=0x7f99a815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99a77fe640 1 -- 172.21.15.177:0/2826587633 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826893384 0 0) 0x7f99a815c7b0 con 0x7f99a806fda0 2024-09-15T22:41:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.753+0000 7f99acdc3640 1 -- 172.21.15.177:0/2826587633 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a80cfa50 con 0x7f99a8155bb0 2024-09-15T22:41:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.754+0000 7f99acdc3640 1 --2- 172.21.15.177:0/2826587633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a815ca90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097a0 tx=0x7f999c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b32c2641638106 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.754+0000 7f99a77fe640 1 -- 172.21.15.177:0/2826587633 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c037070 con 0x7f99a8155bb0 2024-09-15T22:41:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.754+0000 7f99a77fe640 1 -- 172.21.15.177:0/2826587633 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c032440 con 0x7f99a8155bb0 2024-09-15T22:41:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.754+0000 7f99a77fe640 1 -- 172.21.15.177:0/2826587633 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c032810 con 0x7f99a8155bb0 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 -- 172.21.15.177:0/2826587633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 msgr2=0x7f99a815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 --2- 172.21.15.177:0/2826587633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a815ca90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097a0 tx=0x7f999c02a180 comp rx=0 tx=0).stop 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 -- 172.21.15.177:0/2826587633 shutdown_connections 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 --2- 172.21.15.177:0/2826587633 >> v2:172.21.15.134:3300/0 conn(0x7f99a815c190 0x7f99a8070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 --2- 172.21.15.177:0/2826587633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a815ca90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 -- 172.21.15.177:0/2826587633 >> 172.21.15.177:0/2826587633 conn(0x7f99a80b3380 msgr2=0x7f99a80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 -- 172.21.15.177:0/2826587633 shutdown_connections 2024-09-15T22:41:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.755+0000 7f99af027640 1 -- 172.21.15.177:0/2826587633 wait complete. 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.756+0000 7f99af027640 1 Processor -- start 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.756+0000 7f99af027640 1 -- start start 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a806fda0 0x7f99a8155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 0x7f99a81e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99a815e030 con 0x7f99a806fda0 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80cf480 con 0x7f99a815c190 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99af027640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99a815e1b0 con 0x7f99a8155bb0 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99ad5c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 0x7f99a81e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45764/0 (socket says 172.21.15.177:45764) 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99acdc3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a806fda0 0x7f99a8155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 -- 172.21.15.177:0/1790577862 learned_addr learned my addr 172.21.15.177:0/1790577862 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99ad5c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 0x7f99a81e7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54382/0 (socket says 172.21.15.177:54382) 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 -- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 msgr2=0x7f99a81e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 0x7f99a81e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 -- 172.21.15.177:0/1790577862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a806fda0 msgr2=0x7f99a8155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a806fda0 0x7f99a8155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 -- 172.21.15.177:0/1790577862 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a81564d0 con 0x7f99a8155bb0 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.757+0000 7f99a7fff640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f999400c4b0 tx=0x7f999400c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994018070 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9994007500 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a81567a0 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994004a20 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a8156d60 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f999401b070 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.758+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f99940129f0 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.759+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a81574a0 con 0x7f99a8155bb0 2024-09-15T22:41:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.761+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9994004c10 con 0x7f99a8155bb0 2024-09-15T22:41:04.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.829+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d86be5c2-49aa-4bbd-9066-f3655ac9576b", "id": 6} v 0) -- 0x7f99a8157100 con 0x7f99a8155bb0 2024-09-15T22:41:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.834+0000 7f99a57fa640 1 -- 172.21.15.177:0/1790577862 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d86be5c2-49aa-4bbd-9066-f3655ac9576b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9994012400 con 0x7f99a8155bb0 2024-09-15T22:41:04.836 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 msgr2=0x7f99a8157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f999400c4b0 tx=0x7f999400c970 comp rx=0 tx=0).stop 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 shutdown_connections 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99a815c190 0x7f99a81e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99a8155bb0 0x7f99a8157820 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 --2- 172.21.15.177:0/1790577862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a806fda0 0x7f99a8155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 >> 172.21.15.177:0/1790577862 conn(0x7f99a80b3380 msgr2=0x7f99a80b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 shutdown_connections 2024-09-15T22:41:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.835+0000 7f99af027640 1 -- 172.21.15.177:0/1790577862 wait complete. 2024-09-15T22:41:04.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 242b6098-c5c2-4425-a912-70362fe7ff09 7 2024-09-15T22:41:04.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.945+0000 7fc72940e640 1 Processor -- start 2024-09-15T22:41:04.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.945+0000 7fc72940e640 1 -- start start 2024-09-15T22:41:04.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc724161e30 0x7fc7240d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 0x7fc72406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7240b3290 0x7fc72406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc7240cfcf0 con 0x7fc7240b3290 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc7240cf9a0 con 0x7fc724161e30 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc72940e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc724162210 con 0x7fc7240b3d50 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc724161e30 0x7fc7240d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc7227fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 0x7fc72406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc724161e30 0x7fc7240d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54384/0 (socket says 172.21.15.177:54384) 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 -- 172.21.15.177:0/3815934567 learned_addr learned my addr 172.21.15.177:0/3815934567 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc7237fe640 1 --2- 172.21.15.177:0/3815934567 >> v2:172.21.15.134:3300/0 conn(0x7fc7240b3290 0x7fc72406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 -- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 msgr2=0x7fc72406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 0x7fc72406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 -- 172.21.15.177:0/3815934567 >> v2:172.21.15.134:3300/0 conn(0x7fc7240b3290 msgr2=0x7fc72406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 --2- 172.21.15.177:0/3815934567 >> v2:172.21.15.134:3300/0 conn(0x7fc7240b3290 0x7fc72406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc722ffd640 1 -- 172.21.15.177:0/3815934567 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7240d5210 con 0x7fc724161e30 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.946+0000 7fc7227fc640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 0x7fc72406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.947+0000 7fc722ffd640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc7240d34a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc72408dc90 tx=0x7fc70c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9deb38da8418ac30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.947+0000 7fc721ffb640 1 -- 172.21.15.177:0/3815934567 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c037070 con 0x7fc724161e30 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.947+0000 7fc721ffb640 1 -- 172.21.15.177:0/3815934567 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c032440 con 0x7fc724161e30 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.947+0000 7fc721ffb640 1 -- 172.21.15.177:0/3815934567 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c032810 con 0x7fc724161e30 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 -- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 msgr2=0x7fc7240d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc7240d34a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc72408dc90 tx=0x7fc70c02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 -- 172.21.15.177:0/3815934567 shutdown_connections 2024-09-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 --2- 172.21.15.177:0/3815934567 >> v2:172.21.15.134:3300/0 conn(0x7fc7240b3290 0x7fc72406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3d50 0x7fc72406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 --2- 172.21.15.177:0/3815934567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc7240d34a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 -- 172.21.15.177:0/3815934567 >> 172.21.15.177:0/3815934567 conn(0x7fc7240d1870 msgr2=0x7fc7240d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 -- 172.21.15.177:0/3815934567 shutdown_connections 2024-09-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.948+0000 7fc72940e640 1 -- 172.21.15.177:0/3815934567 wait complete. 2024-09-15T22:41:04.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.949+0000 7fc72940e640 1 Processor -- start 2024-09-15T22:41:04.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.949+0000 7fc72940e640 1 -- start start 2024-09-15T22:41:04.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7240b3d50 0x7fc7241573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc72415be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240d39e0 con 0x7fc7240b3d50 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240b3950 con 0x7fc724161e30 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc72940e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7240b49a0 con 0x7fc7240b3290 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc722ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc72415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc722ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:45774/0 (socket says 172.21.15.177:45774) 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc722ffd640 1 -- 172.21.15.177:0/847665703 learned_addr learned my addr 172.21.15.177:0/847665703 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7227fc640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7240b3d50 0x7fc7241573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 -- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 msgr2=0x7fc72414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 -- 172.21.15.177:0/847665703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7240b3d50 msgr2=0x7fc7241573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7240b3d50 0x7fc7241573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:04.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc7237fe640 1 -- 172.21.15.177:0/847665703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7241578e0 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.950+0000 7fc722ffd640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc7237fe640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc72415be60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00ea90 tx=0x7fc71c00ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c018020 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c00bbc0 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c014400 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72415b060 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7240b4630 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc71c005d10 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.951+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc71c01dd30 con 0x7fc724161e30 2024-09-15T22:41:04.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.952+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7240d0420 con 0x7fc724161e30 2024-09-15T22:41:04.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:04.954+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc7240d0420 con 0x7fc724161e30 2024-09-15T22:41:05.013 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.012+0000 7facac430040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:41:05.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.023+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "242b6098-c5c2-4425-a912-70362fe7ff09", "id": 7} v 0) -- 0x7fc7240d3480 con 0x7fc724161e30 2024-09-15T22:41:05.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.026+0000 7fc71b7fe640 1 -- 172.21.15.177:0/847665703 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "242b6098-c5c2-4425-a912-70362fe7ff09", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc71c022030 con 0x7fc724161e30 2024-09-15T22:41:05.028 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 msgr2=0x7fc72415be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc72415be60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00ea90 tx=0x7fc71c00ef50 comp rx=0 tx=0).stop 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 shutdown_connections 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc724161e30 0x7fc72415be60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7240b3d50 0x7fc7241573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 --2- 172.21.15.177:0/847665703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7240b3290 0x7fc72414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 >> 172.21.15.177:0/847665703 conn(0x7fc7240d1870 msgr2=0x7fc724161080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 shutdown_connections 2024-09-15T22:41:05.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:05.027+0000 7fc72940e640 1 -- 172.21.15.177:0/847665703 wait complete. 2024-09-15T22:41:05.039 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T22:41:05.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T22:41:05.042 INFO:tasks.ceph.osd.0:Started 2024-09-15T22:41:05.042 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T22:41:05.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T22:41:05.044 INFO:tasks.ceph.osd.1:Started 2024-09-15T22:41:05.044 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T22:41:05.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T22:41:05.046 INFO:tasks.ceph.osd.2:Started 2024-09-15T22:41:05.046 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T22:41:05.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T22:41:05.048 INFO:tasks.ceph.osd.3:Started 2024-09-15T22:41:05.048 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T22:41:05.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T22:41:05.051 INFO:tasks.ceph.osd.4:Started 2024-09-15T22:41:05.051 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T22:41:05.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T22:41:05.053 INFO:tasks.ceph.osd.5:Started 2024-09-15T22:41:05.053 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T22:41:05.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T22:41:05.055 INFO:tasks.ceph.osd.6:Started 2024-09-15T22:41:05.055 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T22:41:05.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T22:41:05.057 INFO:tasks.ceph.osd.7:Started 2024-09-15T22:41:05.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:05.077 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.076+0000 7facac430040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:41:05.116 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.115+0000 7f460ae2d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:41:05.184 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.182+0000 7f460ae2d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:41:05.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.186+0000 7fa01b4b7640 1 Processor -- start 2024-09-15T22:41:05.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.186+0000 7fa01b4b7640 1 -- start start 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa01b4b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 0x7fa01406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa01b4b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa01415fbf0 con 0x7fa01415f5d0 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa01b4b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0140b4f80 con 0x7fa01406c0e0 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa01b4b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa01406c520 con 0x7fa014148330 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa019a54640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa01415f5d0 0x7fa0140b5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56702/0 (socket says 172.21.15.134:56702) 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa019a54640 1 -- 172.21.15.134:0/537049715 learned_addr learned my addr 172.21.15.134:0/537049715 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa019253640 1 --2- 172.21.15.134:0/537049715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 0x7fa01406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:05.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534944179 0 0) 0x7fa01415fbf0 con 0x7fa01415f5d0 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.187+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa000003520 con 0x7fa01415f5d0 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347870818 0 0) 0x7fa0140b4f80 con 0x7fa01406c0e0 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa01415fbf0 con 0x7fa01406c0e0 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa019253640 1 -- 172.21.15.134:0/537049715 >> v1:172.21.15.177:6789/0 conn(0x7fa01406c0e0 legacy=0x7fa01415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa019253640 1 -- 172.21.15.134:0/537049715 >> v1:172.21.15.134:6789/0 conn(0x7fa01415f5d0 legacy=0x7fa0140b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa019253640 1 -- 172.21.15.134:0/537049715 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0140b5260 con 0x7fa014148330 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.188+0000 7fa019253640 1 --2- 172.21.15.134:0/537049715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 0x7fa01406bba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa004009800 tx=0x7fa00402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73efb9b7af5654b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004037070 con 0x7fa014148330 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa004032440 con 0x7fa014148330 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa00bfff640 1 -- 172.21.15.134:0/537049715 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004032810 con 0x7fa014148330 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 -- 172.21.15.134:0/537049715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 msgr2=0x7fa01406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/537049715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 0x7fa01406bba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa004009800 tx=0x7fa00402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 -- 172.21.15.134:0/537049715 shutdown_connections 2024-09-15T22:41:05.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/537049715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa014148330 0x7fa01406bba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 -- 172.21.15.134:0/537049715 >> 172.21.15.134:0/537049715 conn(0x7fa014062a80 msgr2=0x7fa01406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:05.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 -- 172.21.15.134:0/537049715 shutdown_connections 2024-09-15T22:41:05.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.189+0000 7fa01b4b7640 1 -- 172.21.15.134:0/537049715 wait complete. 2024-09-15T22:41:05.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.190+0000 7fa01b4b7640 1 Processor -- start 2024-09-15T22:41:05.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 -- start start 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa014148330 0x7fa01415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa01415f5d0 0x7fa0140cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa01415fe50 con 0x7fa01415f5d0 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140b5820 con 0x7fa014148330 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa019253640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa019253640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:58056/0 (socket says 172.21.15.134:58056) 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa018a52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa014148330 0x7fa01415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa019253640 1 -- 172.21.15.134:0/2537725338 learned_addr learned my addr 172.21.15.134:0/2537725338 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa01b4b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa01415ffd0 con 0x7fa01406c0e0 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.191+0000 7fa019a54640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa01415f5d0 0x7fa0140cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 -- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa014148330 msgr2=0x7fa01415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa014148330 0x7fa01415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 -- 172.21.15.134:0/2537725338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa01415f5d0 msgr2=0x7fa0140cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa01415f5d0 0x7fa0140cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 -- 172.21.15.134:0/2537725338 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0140cdfb0 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa019253640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa004035040 tx=0x7fa0040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004041020 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00403d720 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0141f5620 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004037040 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.192+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0141f5060 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.193+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa004044020 con 0x7fa01406c0e0 2024-09-15T22:41:05.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.193+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa004046bd0 con 0x7fa01406c0e0 2024-09-15T22:41:05.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.194+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01406bba0 con 0x7fa01406c0e0 2024-09-15T22:41:05.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.196+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa00404b030 con 0x7fa01406c0e0 2024-09-15T22:41:05.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.252+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0140b6730 con 0x7fa01406c0e0 2024-09-15T22:41:05.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.253+0000 7fa009ffb640 1 -- 172.21.15.134:0/2537725338 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa004046400 con 0x7fa01406c0e0 2024-09-15T22:41:05.254 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:05.254 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:05.025443+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 msgr2=0x7fa0141f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa004035040 tx=0x7fa0040046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 shutdown_connections 2024-09-15T22:41:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa01415f5d0 0x7fa0140cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa014148330 0x7fa01415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 --2- 172.21.15.134:0/2537725338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa01406c0e0 0x7fa0141f46a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:05.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 >> 172.21.15.134:0/2537725338 conn(0x7fa014062a80 msgr2=0x7fa014147180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:05.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 shutdown_connections 2024-09-15T22:41:05.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:05.254+0000 7fa01b4b7640 1 -- 172.21.15.134:0/2537725338 wait complete. 2024-09-15T22:41:05.265 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T22:41:05.266 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T22:41:05.462 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.460+0000 7facac430040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:41:05.546 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.544+0000 7facac430040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:41:05.548 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.547+0000 7f460ae2d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:41:05.631 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.629+0000 7f460ae2d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:41:05.650 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.649+0000 7facac430040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:41:05.697 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.695+0000 7facac430040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:41:05.739 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.737+0000 7f460ae2d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:41:05.788 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.784+0000 7f460ae2d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:41:05.811 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.810+0000 7facac430040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:41:05.863 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.861+0000 7facac430040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:41:05.896 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.895+0000 7f460ae2d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:41:05.906 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:05.905+0000 7facac430040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:41:05.950 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.949+0000 7f460ae2d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:41:05.996 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:05.995+0000 7f460ae2d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:41:06.020 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.019+0000 7facac430040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:41:06.071 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:06.071 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.069+0000 7facac430040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:41:06.107 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.106+0000 7f460ae2d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:41:06.124 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.123+0000 7facac430040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:41:06.156 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.155+0000 7f460ae2d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:41:06.161 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.160+0000 7f5b805cf640 1 Processor -- start 2024-09-15T22:41:06.161 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.160+0000 7f5b805cf640 1 -- start start 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b805cf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b7815e860 0x7f5b7806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b805cf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b7806c1d0 0x7f5b7806cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b805cf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b780b6e30 con 0x7f5b7806d1a0 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b805cf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5b780b7110 con 0x7f5b7806c1d0 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b805cf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5b780b73f0 con 0x7f5b7815e860 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b7806c1d0 0x7f5b7806cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b7806c1d0 0x7f5b7806cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38152/0 (socket says 172.21.15.134:38152) 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 -- 172.21.15.134:0/3793672292 learned_addr learned my addr 172.21.15.134:0/3793672292 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7e36b640 1 --2- 172.21.15.134:0/3793672292 >> v2:172.21.15.177:3300/0 conn(0x7f5b7815e860 0x7f5b7806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 -- 172.21.15.134:0/3793672292 >> v2:172.21.15.177:3300/0 conn(0x7f5b7815e860 msgr2=0x7f5b7806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:06.163 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 --2- 172.21.15.134:0/3793672292 >> v2:172.21.15.177:3300/0 conn(0x7f5b7815e860 0x7f5b7806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.164 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 -- 172.21.15.134:0/3793672292 >> v1:172.21.15.177:6789/0 conn(0x7f5b7806d1a0 legacy=0x7f5b781623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:06.164 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7db6a640 1 -- 172.21.15.134:0/3793672292 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b780b76d0 con 0x7f5b7806c1d0 2024-09-15T22:41:06.164 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.161+0000 7f5b7d369640 1 -- 172.21.15.134:0/3793672292 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774199692 0 0) 0x7f5b780b6e30 con 0x7f5b7806d1a0 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.162+0000 7f5b7db6a640 1 --2- 172.21.15.134:0/3793672292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7806cc60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b51d0 tx=0x7f5b6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6e17e0840d95d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.162+0000 7f5b7d369640 1 -- 172.21.15.134:0/3793672292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68037070 con 0x7f5b7806c1d0 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.162+0000 7f5b7d369640 1 -- 172.21.15.134:0/3793672292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b68032440 con 0x7f5b7806c1d0 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.162+0000 7f5b7d369640 1 -- 172.21.15.134:0/3793672292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68032810 con 0x7f5b7806c1d0 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 -- 172.21.15.134:0/3793672292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 msgr2=0x7f5b7806cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:06.165 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 --2- 172.21.15.134:0/3793672292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7806cc60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b51d0 tx=0x7f5b6802a270 comp rx=0 tx=0).stop 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 -- 172.21.15.134:0/3793672292 shutdown_connections 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 --2- 172.21.15.134:0/3793672292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7806cc60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 --2- 172.21.15.134:0/3793672292 >> v2:172.21.15.177:3300/0 conn(0x7f5b7815e860 0x7f5b7806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 -- 172.21.15.134:0/3793672292 >> 172.21.15.134:0/3793672292 conn(0x7f5b780b7930 msgr2=0x7f5b780b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 -- 172.21.15.134:0/3793672292 shutdown_connections 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.163+0000 7f5b805cf640 1 -- 172.21.15.134:0/3793672292 wait complete. 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.164+0000 7f5b805cf640 1 Processor -- start 2024-09-15T22:41:06.166 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.164+0000 7f5b805cf640 1 -- start start 2024-09-15T22:41:06.168 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:06.168 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7806d1a0 0x7f5b78147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:06.168 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b7815e860 0x7f5b78147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:06.168 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b780b69e0 con 0x7f5b7806c1d0 2024-09-15T22:41:06.168 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7815ec40 con 0x7f5b7806d1a0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b805cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5b780b6b60 con 0x7f5b7815e860 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38164/0 (socket says 172.21.15.134:38164) 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 -- 172.21.15.134:0/4137259311 learned_addr learned my addr 172.21.15.134:0/4137259311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7db6a640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7806d1a0 0x7f5b78147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7eb6c640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b7815e860 0x7f5b78147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 -- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b7815e860 msgr2=0x7f5b78147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b7815e860 0x7f5b78147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 -- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7806d1a0 msgr2=0x7f5b78147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7806d1a0 0x7f5b78147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 -- 172.21.15.134:0/4137259311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7815ee60 con 0x7f5b7806c1d0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b7e36b640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e870 tx=0x7f5b7400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74017070 con 0x7f5b7806c1d0 2024-09-15T22:41:06.169 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.165+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7400c940 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7815f0d0 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400cd30 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7815f690 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b7401a070 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5b74013b40 con 0x7f5b7806c1d0 2024-09-15T22:41:06.170 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.166+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b781f87e0 con 0x7f5b7806c1d0 2024-09-15T22:41:06.171 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.170+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5b74013de0 con 0x7f5b7806c1d0 2024-09-15T22:41:06.197 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.195+0000 7facac430040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:41:06.208 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.207+0000 7f460ae2d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:41:06.228 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.227+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b7806c720 con 0x7f5b7806c1d0 2024-09-15T22:41:06.229 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.228+0000 7f5b6effd640 1 -- 172.21.15.134:0/4137259311 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5b74006520 con 0x7f5b7806c1d0 2024-09-15T22:41:06.229 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-15T22:41:06.229 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":10,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:05.025443+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:06.230 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 msgr2=0x7f5b7815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:06.230 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e870 tx=0x7f5b7400ed30 comp rx=0 tx=0).stop 2024-09-15T22:41:06.230 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 shutdown_connections 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b7815e860 0x7f5b78147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7806d1a0 0x7f5b78147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 --2- 172.21.15.134:0/4137259311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b7806c1d0 0x7f5b7815ad10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 >> 172.21.15.134:0/4137259311 conn(0x7f5b780b7930 msgr2=0x7f5b780b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 shutdown_connections 2024-09-15T22:41:06.231 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:06.229+0000 7f5b805cf640 1 -- 172.21.15.134:0/4137259311 wait complete. 2024-09-15T22:41:06.239 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:41:06.242 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.241+0000 7facac430040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:41:06.277 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.276+0000 7f460ae2d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:41:06.288 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.287+0000 7facac430040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:41:06.322 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.321+0000 7f460ae2d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:41:06.365 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:06.364+0000 7f460ae2d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:41:06.542 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-15T22:41:06.541+0000 7f642621e640 -1 Falling back to public interface 2024-09-15T22:41:06.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-15T22:41:06.546+0000 7ff2d6719640 -1 Falling back to public interface 2024-09-15T22:41:06.752 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-15T22:41:06.751+0000 7f59ec287640 -1 Falling back to public interface 2024-09-15T22:41:06.752 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-15T22:41:06.751+0000 7fb085211640 -1 Falling back to public interface 2024-09-15T22:41:06.753 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-15T22:41:06.751+0000 7f59eb22f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-09-15T22:41:06.753 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-15T22:41:06.751+0000 7fb083b37640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2024-09-15T22:41:06.781 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-15T22:41:06.780+0000 7f432fc14640 -1 Falling back to public interface 2024-09-15T22:41:06.804 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-15T22:41:06.803+0000 7f566d415640 -1 Falling back to public interface 2024-09-15T22:41:06.809 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-15T22:41:06.807+0000 7f5dea6ef640 -1 Falling back to public interface 2024-09-15T22:41:06.939 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:06.937+0000 7facac430040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:41:07.022 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:41:07.021+0000 7f460ae2d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:41:07.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-15T22:41:07.041+0000 7fc546e0e640 -1 Falling back to public interface 2024-09-15T22:41:07.951 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:07.949+0000 7fac4bb6f640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:41:07.953 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:41:07.952+0000 7fac4bb6f640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T22:41:10.831 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-15T22:41:10.830+0000 7f432fc14640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:41:11.017 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-15T22:41:11.016+0000 7fb085211640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:41:11.073 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-15T22:41:11.072+0000 7f642621e640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:41:11.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-15T22:41:11.136+0000 7ff2d6719640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:41:11.187 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-15T22:41:11.186+0000 7f5dea6ef640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:41:11.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-15T22:41:11.287+0000 7fc546e0e640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:41:11.338 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-15T22:41:11.336+0000 7f59ec287640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:41:11.373 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-15T22:41:11.372+0000 7f566d415640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:41:12.778 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-15T22:41:12.777+0000 7f432ae01640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:41:12.790 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-15T22:41:12.789+0000 7f4323433640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:13.046 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:13.146 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.144+0000 7f1e9b80e640 1 Processor -- start 2024-09-15T22:41:13.146 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.144+0000 7f1e9b80e640 1 -- start start 2024-09-15T22:41:13.147 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e9b80e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e9406e860 0x7f1e940b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:13.147 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e9b80e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9415efb0 con 0x7f1e9415b330 2024-09-15T22:41:13.147 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e9b80e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9415f290 con 0x7f1e94072f50 2024-09-15T22:41:13.147 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e9b80e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9415f570 con 0x7f1e9406e860 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e995aa640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1e9415b330 0x7f1e9406e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56302/0 (socket says 172.21.15.134:56302) 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e995aa640 1 -- 172.21.15.134:0/3603642422 learned_addr learned my addr 172.21.15.134:0/3603642422 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.145+0000 7f1e98da9640 1 --2- 172.21.15.134:0/3603642422 >> v2:172.21.15.177:3300/0 conn(0x7f1e9406e860 0x7f1e940b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.146+0000 7f1e8bfff640 1 -- 172.21.15.134:0/3603642422 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479831554 0 0) 0x7f1e9415efb0 con 0x7f1e9415b330 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.146+0000 7f1e8bfff640 1 -- 172.21.15.134:0/3603642422 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e80003520 con 0x7f1e9415b330 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.146+0000 7f1e98da9640 1 -- 172.21.15.134:0/3603642422 >> v1:172.21.15.177:6789/0 conn(0x7f1e94072f50 legacy=0x7f1e94071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.146+0000 7f1e98da9640 1 -- 172.21.15.134:0/3603642422 >> v1:172.21.15.134:6789/0 conn(0x7f1e9415b330 legacy=0x7f1e9406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.148 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.146+0000 7f1e98da9640 1 -- 172.21.15.134:0/3603642422 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9415f850 con 0x7f1e9406e860 2024-09-15T22:41:13.149 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.147+0000 7f1e98da9640 1 --2- 172.21.15.134:0/3603642422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e940b3430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097a0 tx=0x7f1e8402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f1c3445ccf34ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.147+0000 7f1e8bfff640 1 -- 172.21.15.134:0/3603642422 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84037070 con 0x7f1e9406e860 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.147+0000 7f1e8bfff640 1 -- 172.21.15.134:0/3603642422 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e84032440 con 0x7f1e9406e860 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.147+0000 7f1e8bfff640 1 -- 172.21.15.134:0/3603642422 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84032810 con 0x7f1e9406e860 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.147+0000 7f1e9b80e640 1 -- 172.21.15.134:0/3603642422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 msgr2=0x7f1e940b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/3603642422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e940b3430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097a0 tx=0x7f1e8402a230 comp rx=0 tx=0).stop 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 -- 172.21.15.134:0/3603642422 shutdown_connections 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/3603642422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e940b3430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 -- 172.21.15.134:0/3603642422 >> 172.21.15.134:0/3603642422 conn(0x7f1e94075330 msgr2=0x7f1e940678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 -- 172.21.15.134:0/3603642422 shutdown_connections 2024-09-15T22:41:13.150 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.148+0000 7f1e9b80e640 1 -- 172.21.15.134:0/3603642422 wait complete. 2024-09-15T22:41:13.151 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.149+0000 7f1e9b80e640 1 Processor -- start 2024-09-15T22:41:13.151 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.149+0000 7f1e9b80e640 1 -- start start 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e94152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 0x7f1e9415e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9415b890 con 0x7f1e9415b330 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9415b710 con 0x7f1e9406e860 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e9b80e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1e94071a70 con 0x7f1e94072f50 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e995aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e94152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:13.153 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e98da9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 0x7f1e9415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38244/0 (socket says 172.21.15.134:38244) 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 -- 172.21.15.134:0/2280117912 learned_addr learned my addr 172.21.15.134:0/2280117912 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e995aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e94152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:51922/0 (socket says 172.21.15.134:51922) 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 -- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 msgr2=0x7f1e9415e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 0x7f1e9415e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 -- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 msgr2=0x7f1e94152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e94152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e99dab640 1 -- 172.21.15.134:0/2280117912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e94158530 con 0x7f1e9415b330 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.150+0000 7f1e98da9640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 0x7f1e9415e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e99dab640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c7a0 tx=0x7f1e8c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c003b70 con 0x7f1e9415b330 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c003d30 con 0x7f1e9415b330 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9415e870 con 0x7f1e9415b330 2024-09-15T22:41:13.154 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00aa90 con 0x7f1e9415b330 2024-09-15T22:41:13.155 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.151+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e940c9b30 con 0x7f1e9415b330 2024-09-15T22:41:13.155 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.152+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e940b3430 con 0x7f1e9415b330 2024-09-15T22:41:13.155 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.153+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f1e8c00ac30 con 0x7f1e9415b330 2024-09-15T22:41:13.156 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.154+0000 7f1e89ffb640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 0x7f1e7806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:13.156 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.154+0000 7f1e995aa640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 0x7f1e7806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:13.156 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.154+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f1e8c08a440 con 0x7f1e9415b330 2024-09-15T22:41:13.156 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.154+0000 7f1e995aa640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 0x7f1e7806e6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e900011e0 tx=0x7f1e90007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:13.159 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.158+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e8c059350 con 0x7f1e9415b330 2024-09-15T22:41:13.372 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.371+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e94067c00 con 0x7f1e9415b330 2024-09-15T22:41:13.373 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.372+0000 7f1e89ffb640 1 -- 172.21.15.134:0/2280117912 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7f1e8c05d650 con 0x7f1e9415b330 2024-09-15T22:41:13.373 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-15T22:41:13.373 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":13,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:12.960072+0000","last_up_change":"2024-09-15T22:41:12.960072+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:13.375 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 msgr2=0x7f1e7806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.375 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 0x7f1e7806e6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e900011e0 tx=0x7f1e90007d30 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 msgr2=0x7f1e9414be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c7a0 tx=0x7f1e8c00cc60 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 shutdown_connections 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1e7806c220 0x7f1e7806e6e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9415b330 0x7f1e9414be20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e94072f50 0x7f1e9415e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 --2- 172.21.15.134:0/2280117912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e9406e860 0x7f1e94152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 >> 172.21.15.134:0/2280117912 conn(0x7f1e94075330 msgr2=0x7f1e941594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 shutdown_connections 2024-09-15T22:41:13.376 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:13.374+0000 7f1e9b80e640 1 -- 172.21.15.134:0/2280117912 wait complete. 2024-09-15T22:41:13.385 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-15T22:41:14.572 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-15T22:41:14.570+0000 7f59e79f3640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:41:14.588 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-15T22:41:14.584+0000 7f59e0025640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:14.599 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-15T22:41:14.598+0000 7fb0802fb640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:41:14.613 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-15T22:41:14.612+0000 7fb07892d640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:14.628 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-15T22:41:14.626+0000 7f642143b640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:41:14.643 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-15T22:41:14.641+0000 7f6419a6d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:15.009 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-15T22:41:15.006+0000 7f5669615640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:41:15.024 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-15T22:41:15.023+0000 7f5660c10640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:15.027 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-15T22:41:15.026+0000 7f5de5e5b640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:41:15.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-15T22:41:15.026+0000 7fc542f12640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:41:15.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-15T22:41:15.043+0000 7fc53a50d640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:15.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-15T22:41:15.045+0000 7ff2d1e85640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:41:15.048 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-15T22:41:15.047+0000 7f5dde48d640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:15.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-15T22:41:15.064+0000 7ff2ca4b7640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:20.192 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:20.281 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.280+0000 7fc7ecf86640 1 Processor -- start 2024-09-15T22:41:20.282 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.280+0000 7fc7ecf86640 1 -- start start 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 0x7fc7e80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7e80b6ea0 0x7fc7e806c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e8162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e806d370 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e80cb890 con 0x7fc7e815e760 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7ecf86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e80cc130 con 0x7fc7e806cb60 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7e5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7e80b6ea0 0x7fc7e806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.283 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7e5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7e80b6ea0 0x7fc7e806c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41198/0 (socket says 172.21.15.134:41198) 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7e5d9b640 1 -- 172.21.15.134:0/1960831283 learned_addr learned my addr 172.21.15.134:0/1960831283 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7e6d9d640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e8162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.281+0000 7fc7e659c640 1 --2- 172.21.15.134:0/1960831283 >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 0x7fc7e80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 -- 172.21.15.134:0/1960831283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 msgr2=0x7fc7e8162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e8162360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 -- 172.21.15.134:0/1960831283 >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 msgr2=0x7fc7e80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 --2- 172.21.15.134:0/1960831283 >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 0x7fc7e80b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 -- 172.21.15.134:0/1960831283 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e80b76b0 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e659c640 1 --2- 172.21.15.134:0/1960831283 >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 0x7fc7e80b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:20.284 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e6d9d640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e8162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e5d9b640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e806c620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8068a00 tx=0x7fc7dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b97c28c0293ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e559a640 1 -- 172.21.15.134:0/1960831283 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc037070 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e559a640 1 -- 172.21.15.134:0/1960831283 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc032440 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.282+0000 7fc7e559a640 1 -- 172.21.15.134:0/1960831283 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc032810 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 -- 172.21.15.134:0/1960831283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e80b6ea0 msgr2=0x7fc7e806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e806c620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8068a00 tx=0x7fc7dc02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 -- 172.21.15.134:0/1960831283 shutdown_connections 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e8162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/1960831283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e806c620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.286 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/1960831283 >> v2:172.21.15.177:3300/0 conn(0x7fc7e815e760 0x7fc7e80b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.287 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 -- 172.21.15.134:0/1960831283 >> 172.21.15.134:0/1960831283 conn(0x7fc7e80b7a30 msgr2=0x7fc7e80b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:20.287 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 -- 172.21.15.134:0/1960831283 shutdown_connections 2024-09-15T22:41:20.287 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.283+0000 7fc7ecf86640 1 -- 172.21.15.134:0/1960831283 wait complete. 2024-09-15T22:41:20.287 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.284+0000 7fc7ecf86640 1 Processor -- start 2024-09-15T22:41:20.287 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.284+0000 7fc7ecf86640 1 -- start start 2024-09-15T22:41:20.289 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e809e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.289 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e8158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.289 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.289 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e815eb40 con 0x7fc7e815e760 2024-09-15T22:41:20.289 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e80cbdc0 con 0x7fc7e80b6ea0 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7ecf86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e80b7310 con 0x7fc7e806cb60 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41212/0 (socket says 172.21.15.134:41212) 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 -- 172.21.15.134:0/2302270246 learned_addr learned my addr 172.21.15.134:0/2302270246 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e659c640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e809e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e5d9b640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e8158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 -- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 msgr2=0x7fc7e809e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e809e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 -- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7e80b6ea0 msgr2=0x7fc7e8158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e8158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.285+0000 7fc7e6d9d640 1 -- 172.21.15.134:0/2302270246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e8159460 con 0x7fc7e815e760 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7e6d9d640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0007db0 tx=0x7fc7e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e001a070 con 0x7fc7e815e760 2024-09-15T22:41:20.290 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e0003990 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0003d60 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e8159070 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.286+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e809ee30 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.287+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e806bf40 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.288+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7fc7e001d070 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.288+0000 7fc7d6ffd640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 0x7fc7c806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.288+0000 7fc7e659c640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 0x7fc7c806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.288+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fc7e008b140 con 0x7fc7e815e760 2024-09-15T22:41:20.291 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.288+0000 7fc7e659c640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 0x7fc7c806e6e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e809f3d0 tx=0x7fc7d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.294 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.293+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7e0010070 con 0x7fc7e815e760 2024-09-15T22:41:20.460 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.459+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7e80b6770 con 0x7fc7e815e760 2024-09-15T22:41:20.461 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.460+0000 7fc7d6ffd640 1 -- 172.21.15.134:0/2302270246 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7fc7e00596a0 con 0x7fc7e815e760 2024-09-15T22:41:20.462 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-15T22:41:20.462 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":19,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:19.647281+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 msgr2=0x7fc7c806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 0x7fc7c806e6e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e809f3d0 tx=0x7fc7d8008040 comp rx=0 tx=0).stop 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 msgr2=0x7fc7e80b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0007db0 tx=0x7fc7e000d4a0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 shutdown_connections 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc7c806c220 0x7fc7c806e6e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e815e760 0x7fc7e80b1b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.464 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7e80b6ea0 0x7fc7e8158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.465 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 --2- 172.21.15.134:0/2302270246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7e806cb60 0x7fc7e809e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.465 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 >> 172.21.15.134:0/2302270246 conn(0x7fc7e80b7a30 msgr2=0x7fc7e8159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:20.465 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 shutdown_connections 2024-09-15T22:41:20.465 INFO:teuthology.misc.health.smithi134.stderr:2024-09-15T22:41:20.462+0000 7fc7ecf86640 1 -- 172.21.15.134:0/2302270246 wait complete. 2024-09-15T22:41:20.473 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T22:41:20.473 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T22:41:20.474 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:41:20.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:41:20.476 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:41:20.476 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:41:20.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:41:20.478 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:41:20.478 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:41:20.479 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:41:20.481 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:41:20.481 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:41:20.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:41:20.483 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:41:20.483 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T22:41:20.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:20.550 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:41:20.551 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:41:20.557 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:41:20.564 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:41:20.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:41:20.581 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:41:20.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.585+0000 7fa2aa58d640 1 Processor -- start 2024-09-15T22:41:20.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.585+0000 7fa2aa58d640 1 -- start start 2024-09-15T22:41:20.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa2aa58d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a40b4e20 0x7fa2a406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa2a3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a40b4e20 0x7fa2a406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa2a3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a40b4e20 0x7fa2a406e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41258/0 (socket says 172.21.15.134:41258) 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa29bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa2a41440b0 0x7fa2a40b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33512/0 (socket says 172.21.15.134:33512) 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa2a3fff640 1 -- 172.21.15.134:0/3992847456 learned_addr learned my addr 172.21.15.134:0/3992847456 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.586+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a40ce370 0x7fa2a40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a406eb40 con 0x7fa2a41440b0 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a406ee20 con 0x7fa2a40b4e20 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a406f100 con 0x7fa2a40ce370 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a37fe640 1 -- 172.21.15.134:0/3992847456 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381020198 0 0) 0x7fa2a406eb40 con 0x7fa2a41440b0 2024-09-15T22:41:20.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a37fe640 1 -- 172.21.15.134:0/3992847456 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa290003520 con 0x7fa2a41440b0 2024-09-15T22:41:20.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a8b2a640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a40ce370 0x7fa2a40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a3fff640 1 -- 172.21.15.134:0/3992847456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a40ce370 msgr2=0x7fa2a40ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:20.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a3fff640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a40ce370 0x7fa2a40ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a3fff640 1 -- 172.21.15.134:0/3992847456 >> v1:172.21.15.134:6789/0 conn(0x7fa2a41440b0 legacy=0x7fa2a40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.587+0000 7fa2a3fff640 1 -- 172.21.15.134:0/3992847456 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a406f3e0 con 0x7fa2a40b4e20 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.588+0000 7fa2a3fff640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40b4e20 0x7fa2a406e4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa294006dd0 tx=0x7fa29402e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f5f95a57b5d970 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.588+0000 7fa2a37fe640 1 -- 172.21.15.134:0/3992847456 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29403a070 con 0x7fa2a40b4e20 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.588+0000 7fa2a37fe640 1 -- 172.21.15.134:0/3992847456 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294033710 con 0x7fa2a40b4e20 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.588+0000 7fa2a37fe640 1 -- 172.21.15.134:0/3992847456 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294033ae0 con 0x7fa2a40b4e20 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40b4e20 msgr2=0x7fa2a406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40b4e20 0x7fa2a406e4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa294006dd0 tx=0x7fa29402e710 comp rx=0 tx=0).stop 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 shutdown_connections 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a40ce370 0x7fa2a40ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/3992847456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40b4e20 0x7fa2a406e4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 >> 172.21.15.134:0/3992847456 conn(0x7fa2a406cae0 msgr2=0x7fa2a406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 shutdown_connections 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.589+0000 7fa2aa58d640 1 -- 172.21.15.134:0/3992847456 wait complete. 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.590+0000 7fa2aa58d640 1 Processor -- start 2024-09-15T22:41:20.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.590+0000 7fa2aa58d640 1 -- start start 2024-09-15T22:41:20.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a40b4e20 0x7fa2a413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a41440b0 0x7fa2a413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4143e60 con 0x7fa2a40ce370 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4143ce0 con 0x7fa2a40b4e20 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a4062630 con 0x7fa2a41440b0 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41262/0 (socket says 172.21.15.134:41262) 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 -- 172.21.15.134:0/2956684706 learned_addr learned my addr 172.21.15.134:0/2956684706 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2a3fff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a40b4e20 0x7fa2a413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2a8b2a640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a41440b0 0x7fa2a413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 -- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a41440b0 msgr2=0x7fa2a413f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a41440b0 0x7fa2a413f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 -- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a40b4e20 msgr2=0x7fa2a413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a40b4e20 0x7fa2a413d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 -- 172.21.15.134:0/2956684706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a4138440 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa29bfff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c3c0 tx=0x7fa28c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0074e0 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c007680 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c004a20 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.591+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a4138720 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.592+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a4138ce0 con 0x7fa2a40ce370 2024-09-15T22:41:20.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.592+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a40629e0 con 0x7fa2a40ce370 2024-09-15T22:41:20.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.594+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7fa28c01a020 con 0x7fa2a40ce370 2024-09-15T22:41:20.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.594+0000 7fa2a17fa640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 0x7fa28406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:20.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.594+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa28c08adf0 con 0x7fa2a40ce370 2024-09-15T22:41:20.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.594+0000 7fa2a3fff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 0x7fa28406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:20.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.595+0000 7fa2a3fff640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 0x7fa28406e6e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa294037000 tx=0x7fa294008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:20.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.598+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa28c021070 con 0x7fa2a40ce370 2024-09-15T22:41:20.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.801+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2a40d04f0 con 0x7fa2a40ce370 2024-09-15T22:41:20.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.801+0000 7fa2a17fa640 1 -- 172.21.15.134:0/2956684706 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fa28c059450 con 0x7fa2a40ce370 2024-09-15T22:41:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:20.803 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"btime":"2024-09-15T22:41:20:554665+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:41:20.803 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 2 2024-09-15T22:41:20.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 msgr2=0x7fa28406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 0x7fa28406e6e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa294037000 tx=0x7fa294008030 comp rx=0 tx=0).stop 2024-09-15T22:41:20.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 msgr2=0x7fa2a4137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:20.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c3c0 tx=0x7fa28c00c880 comp rx=0 tx=0).stop 2024-09-15T22:41:20.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 shutdown_connections 2024-09-15T22:41:20.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28406c220 0x7fa28406e6e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a41440b0 0x7fa2a413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a40ce370 0x7fa2a4137ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 --2- 172.21.15.134:0/2956684706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a40b4e20 0x7fa2a413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:20.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 >> 172.21.15.134:0/2956684706 conn(0x7fa2a406cae0 msgr2=0x7fa2a40cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:20.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 shutdown_connections 2024-09-15T22:41:20.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:20.803+0000 7fa2aa58d640 1 -- 172.21.15.134:0/2956684706 wait complete. 2024-09-15T22:41:22.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:22.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.925+0000 7f5ed31d6640 1 Processor -- start 2024-09-15T22:41:22.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 -- start start 2024-09-15T22:41:22.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ecc15e940 0x7f5ecc0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5ecc0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc0b7170 con 0x7f5ecc15ed20 2024-09-15T22:41:22.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc0d1ae0 con 0x7f5ecc15e940 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ed31d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc0b7aa0 con 0x7f5ecc0cef90 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.926+0000 7f5ecbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5ecc15ed20 0x7f5ecc0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33518/0 (socket says 172.21.15.134:33518) 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 -- 172.21.15.134:0/1458010353 learned_addr learned my addr 172.21.15.134:0/1458010353 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ed1773640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5ecc0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ed0f72640 1 --2- 172.21.15.134:0/1458010353 >> v2:172.21.15.177:3300/0 conn(0x7f5ecc15e940 0x7f5ecc0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493516553 0 0) 0x7f5ec0001490 con 0x7f5ecc15ed20 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb4003520 con 0x7f5ecc15ed20 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269977286 0 0) 0x7f5eb4003520 con 0x7f5ecc15ed20 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 msgr2=0x7f5ecc0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5ecc0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 >> v2:172.21.15.177:3300/0 conn(0x7f5ecc15e940 msgr2=0x7f5ecc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 --2- 172.21.15.134:0/1458010353 >> v2:172.21.15.177:3300/0 conn(0x7f5ecc15e940 0x7f5ecc0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0d3660 con 0x7f5ecc15ed20 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5ec0001bc0 con 0x7f5ecc15ed20 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 >> v1:172.21.15.134:6789/0 conn(0x7f5ecc15ed20 legacy=0x7f5ecc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb40039b0 0x7f5eb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb4004800 0x7f5eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5eb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0b7aa0 con 0x7f5eb4004800 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb400b9c0 con 0x7f5eb40039b0 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb400bb40 con 0x7f5ecc0cef90 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb4004800 0x7f5eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ed0f72640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb40039b0 0x7f5eb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ed1773640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5eb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 -- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 msgr2=0x7f5eb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:22.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cef90 0x7f5eb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 -- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb40039b0 msgr2=0x7f5eb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb40039b0 0x7f5eb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.927+0000 7f5ecbfff640 1 -- 172.21.15.134:0/1458010353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb4003520 con 0x7f5eb4004800 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.928+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb4004800 0x7f5eb4004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000aa20 tx=0x7f5eb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a686ded3271c2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.928+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000a670 con 0x7f5eb4004800 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.928+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec002f070 con 0x7f5eb4004800 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.928+0000 7f5ecb7fe640 1 -- 172.21.15.134:0/1458010353 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0034470 con 0x7f5eb4004800 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 -- 172.21.15.134:0/1458010353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb4004800 msgr2=0x7f5eb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/1458010353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb4004800 0x7f5eb4004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000aa20 tx=0x7f5eb4005830 comp rx=0 tx=0).stop 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed1773640 1 -- 172.21.15.134:0/1458010353 reap_dead start 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 -- 172.21.15.134:0/1458010353 shutdown_connections 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 -- 172.21.15.134:0/1458010353 >> 172.21.15.134:0/1458010353 conn(0x7f5ecc0b6240 msgr2=0x7f5ecc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:22.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 -- 172.21.15.134:0/1458010353 shutdown_connections 2024-09-15T22:41:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.929+0000 7f5ed31d6640 1 -- 172.21.15.134:0/1458010353 wait complete. 2024-09-15T22:41:22.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.930+0000 7f5ed31d6640 1 Processor -- start 2024-09-15T22:41:22.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.930+0000 7f5ed31d6640 1 -- start start 2024-09-15T22:41:22.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb4004800 0x7f5ecc14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cd940 0x7f5ecc0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0d3f00 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0d3c20 con 0x7f5eb4004800 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed31d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc0d3310 con 0x7f5ecc0cd940 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41284/0 (socket says 172.21.15.134:41284) 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 -- 172.21.15.134:0/2642694641 learned_addr learned my addr 172.21.15.134:0/2642694641 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed0f72640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb4004800 0x7f5ecc14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ed1773640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cd940 0x7f5ecc0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 -- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cd940 msgr2=0x7f5ecc0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cd940 0x7f5ecc0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 -- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb4004800 msgr2=0x7f5ecc14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb4004800 0x7f5ecc14bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.931+0000 7f5ecbfff640 1 -- 172.21.15.134:0/2642694641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0cded0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ecbfff640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000ab10 tx=0x7f5ecc0b79f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000a670 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec002be40 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0034670 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc0ce1b0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.932+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc159450 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.933+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc0d1ef0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.933+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ec0034810 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.934+0000 7f5ec97fa640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.934+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5ec00ab5b0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.934+0000 7f5ed0f72640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:22.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.934+0000 7f5ed0f72640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 0x7f5eb806e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009bc0 tx=0x7f5ebc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:22.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:22.938+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ecc0b7170 con 0x7f5ecc0cd4c0 2024-09-15T22:41:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.140+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ecc0b97b0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.141+0000 7f5ec97fa640 1 -- 172.21.15.134:0/2642694641 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3915 (secure 0 0 0) 0x7f5ec007a0a0 con 0x7f5ecc0cd4c0 2024-09-15T22:41:23.142 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:23.142 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"btime":"2024-09-15T22:41:21:555667+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:41:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 3 2024-09-15T22:41:23.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 msgr2=0x7f5eb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 0x7f5eb806e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009bc0 tx=0x7f5ebc009190 comp rx=0 tx=0).stop 2024-09-15T22:41:23.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 msgr2=0x7f5ecc0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000ab10 tx=0x7f5ecc0b79f0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 shutdown_connections 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ecc0cd940 0x7f5ecc0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ecc0cd4c0 0x7f5ecc0c8260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 --2- 172.21.15.134:0/2642694641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eb4004800 0x7f5ecc14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 >> 172.21.15.134:0/2642694641 conn(0x7f5ecc0b6240 msgr2=0x7f5ecc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 shutdown_connections 2024-09-15T22:41:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.143+0000 7f5ed31d6640 1 -- 172.21.15.134:0/2642694641 wait complete. 2024-09-15T22:41:23.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:41:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.251+0000 7fe5992c9640 1 Processor -- start 2024-09-15T22:41:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.251+0000 7fe5992c9640 1 -- start start 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe5992c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe594148280 0x7fe59406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe5992c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5940b5fa0 con 0x7fe5940b5940 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe5992c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5940b6280 con 0x7fe59406c0e0 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe5992c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe5940b6bb0 con 0x7fe594148280 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe592ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe594148280 0x7fe59406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe592ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe594148280 0x7fe59406bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41286/0 (socket says 172.21.15.134:41286) 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe5937fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe5940b5940 0x7fe59415f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33534/0 (socket says 172.21.15.134:33534) 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe592ffd640 1 -- 172.21.15.134:0/565700774 learned_addr learned my addr 172.21.15.134:0/565700774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe592ffd640 1 -- 172.21.15.134:0/565700774 >> v1:172.21.15.177:6789/0 conn(0x7fe59406c0e0 legacy=0x7fe5940b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.252+0000 7fe592ffd640 1 -- 172.21.15.134:0/565700774 >> v1:172.21.15.134:6789/0 conn(0x7fe5940b5940 legacy=0x7fe59415f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.253+0000 7fe592ffd640 1 -- 172.21.15.134:0/565700774 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5940b6560 con 0x7fe594148280 2024-09-15T22:41:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.253+0000 7fe592ffd640 1 --2- 172.21.15.134:0/565700774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe594148280 0x7fe59406bba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe584009e50 tx=0x7fe58402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5441368b39c483d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.253+0000 7fe591ffb640 1 -- 172.21.15.134:0/565700774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584036070 con 0x7fe594148280 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.253+0000 7fe591ffb640 1 -- 172.21.15.134:0/565700774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584031600 con 0x7fe594148280 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.253+0000 7fe591ffb640 1 -- 172.21.15.134:0/565700774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5840319d0 con 0x7fe594148280 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 -- 172.21.15.134:0/565700774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe594148280 msgr2=0x7fe59406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 --2- 172.21.15.134:0/565700774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe594148280 0x7fe59406bba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe584009e50 tx=0x7fe58402a760 comp rx=0 tx=0).stop 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 -- 172.21.15.134:0/565700774 shutdown_connections 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 --2- 172.21.15.134:0/565700774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe594148280 0x7fe59406bba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 -- 172.21.15.134:0/565700774 >> 172.21.15.134:0/565700774 conn(0x7fe594062a80 msgr2=0x7fe59406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 -- 172.21.15.134:0/565700774 shutdown_connections 2024-09-15T22:41:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.254+0000 7fe5992c9640 1 -- 172.21.15.134:0/565700774 wait complete. 2024-09-15T22:41:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.255+0000 7fe5992c9640 1 Processor -- start 2024-09-15T22:41:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.255+0000 7fe5992c9640 1 -- start start 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 0x7fe5941e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe594148280 0x7fe594144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe59415f740 con 0x7fe5940b5940 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe59406c520 con 0x7fe59406c0e0 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5992c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe59415f8c0 con 0x7fe594148280 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41302/0 (socket says 172.21.15.134:41302) 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 -- 172.21.15.134:0/580185329 learned_addr learned my addr 172.21.15.134:0/580185329 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:23.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe592ffd640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 0x7fe5941e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5937fe640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe594148280 0x7fe594144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 -- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe594148280 msgr2=0x7fe594144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe594148280 0x7fe594144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 -- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 msgr2=0x7fe5941e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 0x7fe5941e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe5927fc640 1 -- 172.21.15.134:0/580185329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5941e8a10 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.256+0000 7fe592ffd640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 0x7fe5941e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe5927fc640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c440 tx=0x7fe57c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c017070 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0035f0 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5941f8030 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0039e0 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.257+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5941f85f0 con 0x7fe5940b5940 2024-09-15T22:41:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.258+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5941f87f0 con 0x7fe5940b5940 2024-09-15T22:41:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.258+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe57c01a070 con 0x7fe5940b5940 2024-09-15T22:41:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.259+0000 7fe58b7fe640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 0x7fe57406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.259+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe57c08a480 con 0x7fe5940b5940 2024-09-15T22:41:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.259+0000 7fe592ffd640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 0x7fe57406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.259+0000 7fe592ffd640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 0x7fe57406e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe584033000 tx=0x7fe584009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.263+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5941f87f0 con 0x7fe5940b5940 2024-09-15T22:41:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.429+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe59406bba0 con 0x7fe5940b5940 2024-09-15T22:41:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.429+0000 7fe58b7fe640 1 -- 172.21.15.134:0/580185329 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fe57c058f40 con 0x7fe5940b5940 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:41:23.431 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 msgr2=0x7fe57406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 0x7fe57406e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe584033000 tx=0x7fe584009000 comp rx=0 tx=0).stop 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 msgr2=0x7fe5941444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c440 tx=0x7fe57c00c900 comp rx=0 tx=0).stop 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 shutdown_connections 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe57406c2b0 0x7fe57406e770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe594148280 0x7fe594144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940b5940 0x7fe5941444d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 --2- 172.21.15.134:0/580185329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe59406c0e0 0x7fe5941e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 >> 172.21.15.134:0/580185329 conn(0x7fe594062a80 msgr2=0x7fe59415f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 shutdown_connections 2024-09-15T22:41:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.431+0000 7fe5992c9640 1 -- 172.21.15.134:0/580185329 wait complete. 2024-09-15T22:41:23.443 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:41:23.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:41:23.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.543+0000 7f52d0dc4640 1 Processor -- start 2024-09-15T22:41:23.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.543+0000 7f52d0dc4640 1 -- start start 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52d0dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52d0dc4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52d0dc4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52cc06ec90 con 0x7f52cc0d1860 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52d0dc4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f52cc0d1dd0 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52d0dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc0b7800 con 0x7f52cc15e5c0 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52ca59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52cad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52ca59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:40456/0 (socket says 172.21.15.134:40456) 2024-09-15T22:41:23.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52cad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:58540/0 (socket says 172.21.15.134:58540) 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52ca59c640 1 -- 172.21.15.134:0/275263276 learned_addr learned my addr 172.21.15.134:0/275263276 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52cad9d640 1 -- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 msgr2=0x7f52cc0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.544+0000 7f52cad9d640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52cad9d640 1 -- 172.21.15.134:0/275263276 >> v1:172.21.15.177:6789/0 conn(0x7f52cc0d1860 legacy=0x7f52cc1622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52cad9d640 1 -- 172.21.15.134:0/275263276 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc073d20 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52ca59c640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52cad9d640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009d90 tx=0x7f52c402a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b47833adae72c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52c9d9b640 1 -- 172.21.15.134:0/275263276 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4007740 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52c9d9b640 1 -- 172.21.15.134:0/275263276 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c40078e0 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.545+0000 7f52c9d9b640 1 -- 172.21.15.134:0/275263276 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4007cb0 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 -- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1fd0 msgr2=0x7f52cc0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009d90 tx=0x7f52c402a530 comp rx=0 tx=0).stop 2024-09-15T22:41:23.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 -- 172.21.15.134:0/275263276 shutdown_connections 2024-09-15T22:41:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1fd0 0x7f52cc0b72c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/275263276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc15e5c0 0x7f52cc0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 -- 172.21.15.134:0/275263276 >> 172.21.15.134:0/275263276 conn(0x7f52cc0d25b0 msgr2=0x7f52cc0d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 -- 172.21.15.134:0/275263276 shutdown_connections 2024-09-15T22:41:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.546+0000 7f52d0dc4640 1 -- 172.21.15.134:0/275263276 wait complete. 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.547+0000 7f52d0dc4640 1 Processor -- start 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.547+0000 7f52d0dc4640 1 -- start start 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1860 0x7f52cc1e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc0d1fd0 0x7f52cc1e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc0719e0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc06e770 con 0x7f52cc0d1860 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52d0dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc0b5710 con 0x7f52cc0d1fd0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52cad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52cad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41304/0 (socket says 172.21.15.134:41304) 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52cad9d640 1 -- 172.21.15.134:0/1229249170 learned_addr learned my addr 172.21.15.134:0/1229249170 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52ca59c640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1860 0x7f52cc1e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.548+0000 7f52c3fff640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc0d1fd0 0x7f52cc1e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 -- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc0d1fd0 msgr2=0x7f52cc1e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc0d1fd0 0x7f52cc1e5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 -- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1860 msgr2=0x7f52cc1e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1860 0x7f52cc1e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 -- 172.21.15.134:0/1229249170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc1e79e0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52cad9d640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009eb0 tx=0x7f52c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c403f070 con 0x7f52cc15e5c0 2024-09-15T22:41:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4031bc0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc1e7cc0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4009450 con 0x7f52cc15e5c0 2024-09-15T22:41:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.549+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc1e8280 con 0x7f52cc15e5c0 2024-09-15T22:41:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.550+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc15c2c0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.550+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f52c4044460 con 0x7f52cc15e5c0 2024-09-15T22:41:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.551+0000 7f52c2ffd640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 0x7f52ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.551+0000 7f52ca59c640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 0x7f52ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.551+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f52c40ac680 con 0x7f52cc15e5c0 2024-09-15T22:41:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.551+0000 7f52ca59c640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 0x7f52ac06e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009630 tx=0x7f52bc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:23.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.555+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52cc15c2c0 con 0x7f52cc15e5c0 2024-09-15T22:41:23.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:23.720+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52cc0d2ec0 con 0x7f52cc15e5c0 2024-09-15T22:41:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.677+0000 7f52c2ffd640 1 -- 172.21.15.134:0/1229249170 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f52cc0d2ec0 con 0x7f52cc15e5c0 2024-09-15T22:41:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:41:24.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 msgr2=0x7f52ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 0x7f52ac06e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009630 tx=0x7f52bc009240 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 msgr2=0x7f52cc152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009eb0 tx=0x7f52c4004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 shutdown_connections 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52ac06c2b0 0x7f52ac06e770 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009630 tx=0x7f52bc009240 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52cc15e5c0 0x7f52cc152f30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52cc0d1fd0 0x7f52cc1e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 --2- 172.21.15.134:0/1229249170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52cc0d1860 0x7f52cc1e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.681+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 >> 172.21.15.134:0/1229249170 conn(0x7f52cc0d25b0 msgr2=0x7f52cc15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:24.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.682+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 shutdown_connections 2024-09-15T22:41:24.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.682+0000 7f52d0dc4640 1 -- 172.21.15.134:0/1229249170 wait complete. 2024-09-15T22:41:24.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:41:24.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.809+0000 7fe7e67c4640 1 Processor -- start 2024-09-15T22:41:24.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 -- start start 2024-09-15T22:41:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7e015b430 0x7fe7e006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe7e00d0d40 0x7fe7e015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e00cf5f0 con 0x7fe7e00b46d0 2024-09-15T22:41:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e006efe0 con 0x7fe7e015b430 2024-09-15T22:41:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7e67c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e00cf870 con 0x7fe7e00d0d40 2024-09-15T22:41:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.810+0000 7fe7dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7e015b430 0x7fe7e006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7e015b430 0x7fe7e006eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41312/0 (socket says 172.21.15.134:41312) 2024-09-15T22:41:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 -- 172.21.15.134:0/1927595507 learned_addr learned my addr 172.21.15.134:0/1927595507 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7e4d61640 1 --2- 172.21.15.134:0/1927595507 >> v2:172.21.15.177:3300/0 conn(0x7fe7e00d0d40 0x7fe7e015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 -- 172.21.15.134:0/1927595507 >> v2:172.21.15.177:3300/0 conn(0x7fe7e00d0d40 msgr2=0x7fe7e015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 --2- 172.21.15.134:0/1927595507 >> v2:172.21.15.177:3300/0 conn(0x7fe7e00d0d40 0x7fe7e015ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 -- 172.21.15.134:0/1927595507 >> v1:172.21.15.134:6789/0 conn(0x7fe7e00b46d0 legacy=0x7fe7e00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7dffff640 1 -- 172.21.15.134:0/1927595507 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e00cfb50 con 0x7fe7e015b430 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.811+0000 7fe7df7fe640 1 -- 172.21.15.134:0/1927595507 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149273316 0 0) 0x7fe7c8001110 con 0x7fe7e00b46d0 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7dffff640 1 --2- 172.21.15.134:0/1927595507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e015b430 0x7fe7e006eaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0073530 tx=0x7fe7d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89911cc685ae3d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7df7fe640 1 -- 172.21.15.134:0/1927595507 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0037070 con 0x7fe7e015b430 2024-09-15T22:41:24.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7df7fe640 1 -- 172.21.15.134:0/1927595507 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d0032440 con 0x7fe7e015b430 2024-09-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7df7fe640 1 -- 172.21.15.134:0/1927595507 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0032810 con 0x7fe7e015b430 2024-09-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 -- 172.21.15.134:0/1927595507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e015b430 msgr2=0x7fe7e006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/1927595507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e015b430 0x7fe7e006eaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0073530 tx=0x7fe7d002a270 comp rx=0 tx=0).stop 2024-09-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 -- 172.21.15.134:0/1927595507 shutdown_connections 2024-09-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/1927595507 >> v2:172.21.15.177:3300/0 conn(0x7fe7e00d0d40 0x7fe7e015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/1927595507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e015b430 0x7fe7e006eaa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 -- 172.21.15.134:0/1927595507 >> 172.21.15.134:0/1927595507 conn(0x7fe7e006ccb0 msgr2=0x7fe7e006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 -- 172.21.15.134:0/1927595507 shutdown_connections 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.812+0000 7fe7e67c4640 1 -- 172.21.15.134:0/1927595507 wait complete. 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.813+0000 7fe7e67c4640 1 Processor -- start 2024-09-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.813+0000 7fe7e67c4640 1 -- start start 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 0x7fe7e00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 0x7fe7e006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e015b810 con 0x7fe7e00d0d40 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e00d0110 con 0x7fe7e00b46d0 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7e67c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e00d11d0 con 0x7fe7e015b430 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41326/0 (socket says 172.21.15.134:41326) 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.814+0000 7fe7d7fff640 1 -- 172.21.15.134:0/2970246999 learned_addr learned my addr 172.21.15.134:0/2970246999 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7dffff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 0x7fe7e00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7e4d61640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 0x7fe7e006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 -- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 msgr2=0x7fe7e006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 0x7fe7e006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 -- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 msgr2=0x7fe7e00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 0x7fe7e00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 -- 172.21.15.134:0/2970246999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e0154870 con 0x7fe7e00d0d40 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7dffff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 0x7fe7e00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7e4d61640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 0x7fe7e006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7d7fff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800c750 tx=0x7fe7c800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8017070 con 0x7fe7e00d0d40 2024-09-15T22:41:24.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c80052b0 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e0154b50 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800a880 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.815+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e015ea80 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.816+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e006eaa0 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.816+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7c801a070 con 0x7fe7e00d0d40 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.817+0000 7fe7dd7fa640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 0x7fe7c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:24.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.817+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fe7c808a4d0 con 0x7fe7e00d0d40 2024-09-15T22:41:24.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.817+0000 7fe7dffff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 0x7fe7c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:24.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.817+0000 7fe7dffff640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 0x7fe7c006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0034000 tx=0x7fe7d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:24.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.821+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7e00cf5f0 con 0x7fe7e00d0d40 2024-09-15T22:41:24.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:24.988+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe7e00aee20 con 0x7fe7e00d0d40 2024-09-15T22:41:25.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.682+0000 7fe7dd7fa640 1 -- 172.21.15.134:0/2970246999 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fe7c8007d30 con 0x7fe7e00d0d40 2024-09-15T22:41:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 msgr2=0x7fe7c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 0x7fe7c006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0034000 tx=0x7fe7d002e000 comp rx=0 tx=0).stop 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 msgr2=0x7fe7e014bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800c750 tx=0x7fe7c800cc10 comp rx=0 tx=0).stop 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 shutdown_connections 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe7c006c2b0 0x7fe7c006e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7e015b430 0x7fe7e006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e00d0d40 0x7fe7e014bf20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 --2- 172.21.15.134:0/2970246999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e00b46d0 0x7fe7e00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 >> 172.21.15.134:0/2970246999 conn(0x7fe7e006ccb0 msgr2=0x7fe7e0074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.684+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 shutdown_connections 2024-09-15T22:41:25.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.685+0000 7fe7e67c4640 1 -- 172.21.15.134:0/2970246999 wait complete. 2024-09-15T22:41:25.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:41:25.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.807+0000 7fec60d98640 1 Processor -- start 2024-09-15T22:41:25.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.807+0000 7fec60d98640 1 -- start start 2024-09-15T22:41:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.808+0000 7fec60d98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec5c0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.808+0000 7fec60d98640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5c06ea60 con 0x7fec5c0b7190 2024-09-15T22:41:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.808+0000 7fec60d98640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5c06ed40 con 0x7fec5c0c7050 2024-09-15T22:41:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.808+0000 7fec60d98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c0c7490 con 0x7fec5c15c470 2024-09-15T22:41:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5ad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fec5c0b7190 0x7fec5c15cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33554/0 (socket says 172.21.15.134:33554) 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5ad9d640 1 -- 172.21.15.134:0/484431836 learned_addr learned my addr 172.21.15.134:0/484431836 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5a59c640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec5c0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258428429 0 0) 0x7fec5c06ea60 con 0x7fec5c0b7190 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec48003520 con 0x7fec5c0b7190 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3002788388 0 0) 0x7fec48003520 con 0x7fec5c0b7190 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 msgr2=0x7fec5c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec5c0c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 >> v1:172.21.15.177:6789/0 conn(0x7fec5c0c7050 legacy=0x7fec5c0b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c06f020 con 0x7fec5c0b7190 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fec54001670 con 0x7fec5c0b7190 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 >> v1:172.21.15.134:6789/0 conn(0x7fec5c0b7190 legacy=0x7fec5c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48003f20 0x7fec48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec48004d40 0x7fec480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c0c7490 con 0x7fec48004d40 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec4800ba20 con 0x7fec48003f20 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fec4800bc20 con 0x7fec5c15c470 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec48004d40 0x7fec480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec5a59c640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.809+0000 7fec59d9b640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48003f20 0x7fec48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 -- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 msgr2=0x7fec480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c15c470 0x7fec480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 -- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48003f20 msgr2=0x7fec48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48003f20 0x7fec48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 -- 172.21.15.134:0/484431836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec48003520 con 0x7fec48004d40 2024-09-15T22:41:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec48004d40 0x7fec480051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec54007fd0 tx=0x7fec48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c023ea1bec7e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54007d50 con 0x7fec48004d40 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540058d0 con 0x7fec48004d40 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.810+0000 7fec5959a640 1 -- 172.21.15.134:0/484431836 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54005d20 con 0x7fec48004d40 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 -- 172.21.15.134:0/484431836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec48004d40 msgr2=0x7fec480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 --2- 172.21.15.134:0/484431836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec48004d40 0x7fec480051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec54007fd0 tx=0x7fec48005830 comp rx=0 tx=0).stop 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec5ad9d640 1 -- 172.21.15.134:0/484431836 reap_dead start 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 -- 172.21.15.134:0/484431836 shutdown_connections 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 -- 172.21.15.134:0/484431836 >> 172.21.15.134:0/484431836 conn(0x7fec5c06ccb0 msgr2=0x7fec5c06d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 -- 172.21.15.134:0/484431836 shutdown_connections 2024-09-15T22:41:25.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.811+0000 7fec60d98640 1 -- 172.21.15.134:0/484431836 wait complete. 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.812+0000 7fec60d98640 1 Processor -- start 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.812+0000 7fec60d98640 1 -- start start 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 0x7fec5c1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 0x7fec5c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c15c850 con 0x7fec5c153400 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c06f5e0 con 0x7fec48004d40 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec60d98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c15c9d0 con 0x7fec5c1421b0 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41346/0 (socket says 172.21.15.134:41346) 2024-09-15T22:41:25.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 -- 172.21.15.134:0/2648006779 learned_addr learned my addr 172.21.15.134:0/2648006779 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec59d9b640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 0x7fec5c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5a59c640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 0x7fec5c1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 -- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 msgr2=0x7fec5c14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 0x7fec5c14e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 -- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 msgr2=0x7fec5c1427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 0x7fec5c1427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5ad9d640 1 -- 172.21.15.134:0/2648006779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c14ed80 con 0x7fec5c153400 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec5a59c640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 0x7fec5c1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.813+0000 7fec59d9b640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 0x7fec5c14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec5ad9d640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c350 tx=0x7fec54001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54042070 con 0x7fec5c153400 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540049f0 con 0x7fec5c153400 2024-09-15T22:41:25.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c14be20 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54007d50 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.814+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c150dd0 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.815+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c0c6ba0 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.815+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec54045070 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.816+0000 7fec52ffd640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 0x7fec3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.816+0000 7fec5a59c640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 0x7fec3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.816+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fec540aa890 con 0x7fec5c153400 2024-09-15T22:41:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.816+0000 7fec5a59c640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 0x7fec3c06e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007440 tx=0x7fec4c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:25.820+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec54078fd0 con 0x7fec5c153400 2024-09-15T22:41:26.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.021+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec5c06e640 con 0x7fec5c153400 2024-09-15T22:41:26.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.683+0000 7fec52ffd640 1 -- 172.21.15.134:0/2648006779 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fec540788d0 con 0x7fec5c153400 2024-09-15T22:41:26.685 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:41:26.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 msgr2=0x7fec3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 0x7fec3c06e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007440 tx=0x7fec4c00b040 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 msgr2=0x7fec5c153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c350 tx=0x7fec54001a40 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 shutdown_connections 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fec3c06c2b0 0x7fec3c06e770 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007440 tx=0x7fec4c00b040 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c153400 0x7fec5c153880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c1421b0 0x7fec5c14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 --2- 172.21.15.134:0/2648006779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec48004d40 0x7fec5c1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.687+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 >> 172.21.15.134:0/2648006779 conn(0x7fec5c06ccb0 msgr2=0x7fec5c156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:26.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.688+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 shutdown_connections 2024-09-15T22:41:26.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.688+0000 7fec60d98640 1 -- 172.21.15.134:0/2648006779 wait complete. 2024-09-15T22:41:26.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:26.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.817+0000 7f2d425e4640 1 Processor -- start 2024-09-15T22:41:26.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.817+0000 7f2d425e4640 1 -- start start 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d425e4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d3c15c300 0x7f2d3c0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d425e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d3c0cd300 0x7f2d3c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d425e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c15ecf0 con 0x7f2d3c06f010 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d425e4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3c06f480 con 0x7f2d3c0cd300 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d425e4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3c15c6e0 con 0x7f2d3c15c300 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d3c0cd300 0x7f2d3c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d3c0cd300 0x7f2d3c06ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37028/0 (socket says 172.21.15.134:37028) 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 -- 172.21.15.134:0/3124527209 learned_addr learned my addr 172.21.15.134:0/3124527209 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3bfff640 1 --2- 172.21.15.134:0/3124527209 >> v2:172.21.15.177:3300/0 conn(0x7f2d3c15c300 0x7f2d3c0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 -- 172.21.15.134:0/3124527209 >> v2:172.21.15.177:3300/0 conn(0x7f2d3c15c300 msgr2=0x7f2d3c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 --2- 172.21.15.134:0/3124527209 >> v2:172.21.15.177:3300/0 conn(0x7f2d3c15c300 0x7f2d3c0affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 -- 172.21.15.134:0/3124527209 >> v1:172.21.15.177:6789/0 conn(0x7f2d3c06f010 legacy=0x7f2d3c1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.818+0000 7f2d3b7fe640 1 -- 172.21.15.134:0/3124527209 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c15efb0 con 0x7f2d3c0cd300 2024-09-15T22:41:26.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.819+0000 7f2d3b7fe640 1 --2- 172.21.15.134:0/3124527209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c06ead0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c069490 tx=0x7f2d3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c3b6df5b29b1b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:26.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.819+0000 7f2d3affd640 1 -- 172.21.15.134:0/3124527209 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30037070 con 0x7f2d3c0cd300 2024-09-15T22:41:26.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.819+0000 7f2d3affd640 1 -- 172.21.15.134:0/3124527209 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d30032440 con 0x7f2d3c0cd300 2024-09-15T22:41:26.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.819+0000 7f2d3affd640 1 -- 172.21.15.134:0/3124527209 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30032810 con 0x7f2d3c0cd300 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 -- 172.21.15.134:0/3124527209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c0cd300 msgr2=0x7f2d3c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 --2- 172.21.15.134:0/3124527209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c06ead0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c069490 tx=0x7f2d3002a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 -- 172.21.15.134:0/3124527209 shutdown_connections 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 --2- 172.21.15.134:0/3124527209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c06ead0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 --2- 172.21.15.134:0/3124527209 >> v2:172.21.15.177:3300/0 conn(0x7f2d3c15c300 0x7f2d3c0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 -- 172.21.15.134:0/3124527209 >> 172.21.15.134:0/3124527209 conn(0x7f2d3c06cae0 msgr2=0x7f2d3c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 -- 172.21.15.134:0/3124527209 shutdown_connections 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.820+0000 7f2d425e4640 1 -- 172.21.15.134:0/3124527209 wait complete. 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.821+0000 7f2d425e4640 1 Processor -- start 2024-09-15T22:41:26.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.821+0000 7f2d425e4640 1 -- start start 2024-09-15T22:41:26.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d3c15c300 0x7f2d3c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c15f850 con 0x7f2d3c06f010 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c15f570 con 0x7f2d3c0cd300 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d425e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c071880 con 0x7f2d3c15c300 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37036/0 (socket says 172.21.15.134:37036) 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 -- 172.21.15.134:0/374425946 learned_addr learned my addr 172.21.15.134:0/374425946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3b7fe640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d40b81640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d3c15c300 0x7f2d3c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 -- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d3c15c300 msgr2=0x7f2d3c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d3c15c300 0x7f2d3c0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 -- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d3c0cd300 msgr2=0x7f2d3c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 -- 172.21.15.134:0/374425946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c161c70 con 0x7f2d3c06f010 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.822+0000 7f2d3bfff640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00e9b0 tx=0x7f2d2c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.823+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c017070 con 0x7f2d3c06f010 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.823+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00c9a0 con 0x7f2d3c06f010 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.823+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c158fc0 con 0x7f2d3c06f010 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.823+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00cd90 con 0x7f2d3c06f010 2024-09-15T22:41:26.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.823+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c157e60 con 0x7f2d3c06f010 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.824+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c1594e0 con 0x7f2d3c06f010 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.824+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2d2c01a070 con 0x7f2d3c06f010 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.824+0000 7f2d38ff9640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 0x7f2d2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.825+0000 7f2d3b7fe640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 0x7f2d2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.825+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2d2c08b720 con 0x7f2d3c06f010 2024-09-15T22:41:26.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.825+0000 7f2d3b7fe640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 0x7f2d2806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d30034000 tx=0x7f2d3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:26.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.829+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d3c161c70 con 0x7f2d3c06f010 2024-09-15T22:41:26.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.998+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d3c06ead0 con 0x7f2d3c06f010 2024-09-15T22:41:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:26.999+0000 7f2d38ff9640 1 -- 172.21.15.134:0/374425946 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16718 (secure 0 0 0) 0x7f2d2c059f20 con 0x7f2d3c06f010 2024-09-15T22:41:27.000 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:27.000 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:26.022325+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 msgr2=0x7f2d2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 0x7f2d2806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d30034000 tx=0x7f2d3002e000 comp rx=0 tx=0).stop 2024-09-15T22:41:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 msgr2=0x7f2d3c14b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00e9b0 tx=0x7f2d2c00ee70 comp rx=0 tx=0).stop 2024-09-15T22:41:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 shutdown_connections 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2d2806c2b0 0x7f2d2806e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d3c15c300 0x7f2d3c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d3c0cd300 0x7f2d3c161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 --2- 172.21.15.134:0/374425946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d3c06f010 0x7f2d3c14b000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 >> 172.21.15.134:0/374425946 conn(0x7f2d3c06cae0 msgr2=0x7f2d3c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 shutdown_connections 2024-09-15T22:41:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.001+0000 7f2d425e4640 1 -- 172.21.15.134:0/374425946 wait complete. 2024-09-15T22:41:27.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.109+0000 7f2a27242640 1 Processor -- start 2024-09-15T22:41:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 -- start start 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a201569f0 0x7f2a200712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 0x7f2a200d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200731d0 con 0x7f2a200b1b50 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2a20074230 con 0x7f2a201569f0 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a27242640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2a20073470 con 0x7f2a201607e0 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.110+0000 7f2a24fde640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a201569f0 0x7f2a200712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a1ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2a200b1b50 0x7f2a201600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41860/0 (socket says 172.21.15.134:41860) 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a24fde640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a201569f0 0x7f2a200712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37050/0 (socket says 172.21.15.134:37050) 2024-09-15T22:41:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a1ffff640 1 -- 172.21.15.134:0/3102769264 learned_addr learned my addr 172.21.15.134:0/3102769264 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a257df640 1 --2- 172.21.15.134:0/3102769264 >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 0x7f2a200d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a24fde640 1 -- 172.21.15.134:0/3102769264 >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 msgr2=0x7f2a200d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a24fde640 1 --2- 172.21.15.134:0/3102769264 >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 0x7f2a200d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a24fde640 1 -- 172.21.15.134:0/3102769264 >> v1:172.21.15.134:6789/0 conn(0x7f2a200b1b50 legacy=0x7f2a201600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a1f7fe640 1 -- 172.21.15.134:0/3102769264 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513515083 0 0) 0x7f2a200731d0 con 0x7f2a200b1b50 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a24fde640 1 -- 172.21.15.134:0/3102769264 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a20073750 con 0x7f2a201569f0 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.111+0000 7f2a257df640 1 --2- 172.21.15.134:0/3102769264 >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 0x7f2a200d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a24fde640 1 --2- 172.21.15.134:0/3102769264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201569f0 0x7f2a200712b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a200b20e0 tx=0x7f2a1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281b72d2a3b194c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a1f7fe640 1 -- 172.21.15.134:0/3102769264 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18037070 con 0x7f2a201569f0 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a1f7fe640 1 -- 172.21.15.134:0/3102769264 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18032440 con 0x7f2a201569f0 2024-09-15T22:41:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a1f7fe640 1 -- 172.21.15.134:0/3102769264 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1802ae60 con 0x7f2a201569f0 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 -- 172.21.15.134:0/3102769264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201569f0 msgr2=0x7f2a200712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 --2- 172.21.15.134:0/3102769264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201569f0 0x7f2a200712b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a200b20e0 tx=0x7f2a1802a110 comp rx=0 tx=0).stop 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 -- 172.21.15.134:0/3102769264 shutdown_connections 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 --2- 172.21.15.134:0/3102769264 >> v2:172.21.15.177:3300/0 conn(0x7f2a201607e0 0x7f2a200d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 --2- 172.21.15.134:0/3102769264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201569f0 0x7f2a200712b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 -- 172.21.15.134:0/3102769264 >> 172.21.15.134:0/3102769264 conn(0x7f2a200b4220 msgr2=0x7f2a200b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 -- 172.21.15.134:0/3102769264 shutdown_connections 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.112+0000 7f2a27242640 1 -- 172.21.15.134:0/3102769264 wait complete. 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 Processor -- start 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 -- start start 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a200b1b50 0x7f2a2014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 0x7f2a2014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200717f0 con 0x7f2a201607e0 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20073d10 con 0x7f2a200b1b50 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a27242640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2a20156dd0 con 0x7f2a201569f0 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.114+0000 7f2a257df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37056/0 (socket says 172.21.15.134:37056) 2024-09-15T22:41:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 -- 172.21.15.134:0/2335359008 learned_addr learned my addr 172.21.15.134:0/2335359008 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a24fde640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a200b1b50 0x7f2a2014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a1ffff640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 0x7f2a2014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 -- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 msgr2=0x7f2a2014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 0x7f2a2014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 -- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a200b1b50 msgr2=0x7f2a2014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a200b1b50 0x7f2a2014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 -- 172.21.15.134:0/2335359008 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2014e350 con 0x7f2a201607e0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a1ffff640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 0x7f2a2014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a257df640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c5e0 tx=0x7f2a0800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08015070 con 0x7f2a201607e0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08004240 con 0x7f2a201607e0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2014e630 con 0x7f2a201607e0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08003610 con 0x7f2a201607e0 2024-09-15T22:41:27.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.115+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2014ebf0 con 0x7f2a201607e0 2024-09-15T22:41:27.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.116+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a200712b0 con 0x7f2a201607e0 2024-09-15T22:41:27.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.117+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a080037b0 con 0x7f2a201607e0 2024-09-15T22:41:27.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.117+0000 7f2a1d7fa640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 0x7f2a0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.117+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2a0808b580 con 0x7f2a201607e0 2024-09-15T22:41:27.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.117+0000 7f2a24fde640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 0x7f2a0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.117+0000 7f2a24fde640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 0x7f2a0006e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a18034000 tx=0x7f2a1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.121+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a08059cf0 con 0x7f2a201607e0 2024-09-15T22:41:27.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.290+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a20071a60 con 0x7f2a201607e0 2024-09-15T22:41:27.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.291+0000 7f2a1d7fa640 1 -- 172.21.15.134:0/2335359008 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16718 (secure 0 0 0) 0x7f2a080595f0 con 0x7f2a201607e0 2024-09-15T22:41:27.292 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:27.292 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:26.022325+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:27.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 msgr2=0x7f2a0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 0x7f2a0006e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a18034000 tx=0x7f2a1802e000 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 msgr2=0x7f2a2014c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c5e0 tx=0x7f2a0800caa0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 shutdown_connections 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a0006c2b0 0x7f2a0006e770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201607e0 0x7f2a2014c190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a201569f0 0x7f2a2014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 --2- 172.21.15.134:0/2335359008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a200b1b50 0x7f2a2014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 >> 172.21.15.134:0/2335359008 conn(0x7f2a200b4220 msgr2=0x7f2a2015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 shutdown_connections 2024-09-15T22:41:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.293+0000 7f2a27242640 1 -- 172.21.15.134:0/2335359008 wait complete. 2024-09-15T22:41:27.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:41:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.404+0000 7f55344c9640 1 Processor -- start 2024-09-15T22:41:27.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.404+0000 7f55344c9640 1 -- start start 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f55344c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f552c158e50 0x7f552c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f55344c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f552c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f55344c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c15c800 con 0x7f552c15c370 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f55344c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f552c0b43f0 con 0x7f552c158e50 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f55344c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f552c0b3630 con 0x7f552c06f130 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f5531a64640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f552c15c370 0x7f552c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41870/0 (socket says 172.21.15.134:41870) 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f5531a64640 1 -- 172.21.15.134:0/1455398203 learned_addr learned my addr 172.21.15.134:0/1455398203 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:27.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.405+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798964564 0 0) 0x7f552c15c800 con 0x7f552c15c370 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> v2:172.21.15.177:3300/0 conn(0x7f552c158e50 0x7f552c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532a66640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f552c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5518003520 con 0x7f552c15c370 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 138142792 0 0) 0x7f5518003520 con 0x7f552c15c370 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 msgr2=0x7f552c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f552c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 >> v2:172.21.15.177:3300/0 conn(0x7f552c158e50 msgr2=0x7f552c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 --2- 172.21.15.134:0/1455398203 >> v2:172.21.15.177:3300/0 conn(0x7f552c158e50 0x7f552c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c0b3910 con 0x7f552c15c370 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f551c0016c0 con 0x7f552c15c370 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> v2:172.21.15.177:3300/0 conn(0x7f552c158e50 0x7f552c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 >> v1:172.21.15.134:6789/0 conn(0x7f552c15c370 legacy=0x7f552c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f5518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f5518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5518004d40 0x7f55180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0b43f0 con 0x7f55180039b0 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0b3630 con 0x7f5518004d40 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f551800b9f0 con 0x7f552c06f130 2024-09-15T22:41:27.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f5518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5531a64640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f5518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532a66640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5518004d40 0x7f55180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 -- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 msgr2=0x7f5518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c06f130 0x7f5518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 -- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5518004d40 msgr2=0x7f55180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5518004d40 0x7f55180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532265640 1 -- 172.21.15.134:0/1455398203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518003520 con 0x7f55180039b0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.406+0000 7f5532a66640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5518004d40 0x7f55180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f5532265640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f5518003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55280098a0 tx=0x7f5518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb3bb75a4e3ac55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552800f040 con 0x7f55180039b0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552802ad20 con 0x7f55180039b0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f5531263640 1 -- 172.21.15.134:0/1455398203 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528004250 con 0x7f55180039b0 2024-09-15T22:41:27.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f55344c9640 1 -- 172.21.15.134:0/1455398203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 msgr2=0x7f5518003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.407+0000 7f55344c9640 1 --2- 172.21.15.134:0/1455398203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f5518003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55280098a0 tx=0x7f5518005830 comp rx=0 tx=0).stop 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.408+0000 7f5532a66640 1 -- 172.21.15.134:0/1455398203 reap_dead start 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.408+0000 7f55344c9640 1 -- 172.21.15.134:0/1455398203 shutdown_connections 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.408+0000 7f55344c9640 1 -- 172.21.15.134:0/1455398203 >> 172.21.15.134:0/1455398203 conn(0x7f552c06bba0 msgr2=0x7f552c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.408+0000 7f55344c9640 1 -- 172.21.15.134:0/1455398203 shutdown_connections 2024-09-15T22:41:27.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.408+0000 7f55344c9640 1 -- 172.21.15.134:0/1455398203 wait complete. 2024-09-15T22:41:27.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 Processor -- start 2024-09-15T22:41:27.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 -- start start 2024-09-15T22:41:27.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 0x7f552c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 0x7f552c0ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.409+0000 7f55344c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f552c159230 con 0x7f55180039b0 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f55344c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0b3ed0 con 0x7f552c0aae40 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f55344c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f552c0ce200 con 0x7f552c155740 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37066/0 (socket says 172.21.15.134:37066) 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 -- 172.21.15.134:0/1216024315 learned_addr learned my addr 172.21.15.134:0/1216024315 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5531a64640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 0x7f552c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532a66640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 0x7f552c0ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 -- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 msgr2=0x7f552c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 0x7f552c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 -- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 msgr2=0x7f552c0ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 0x7f552c0ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 -- 172.21.15.134:0/1216024315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c0abb90 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5531a64640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 0x7f552c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532a66640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 0x7f552c0ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5532265640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5528034040 tx=0x7f5528004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528041070 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552802ab20 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c0abe70 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552803d430 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.410+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c0ac430 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.411+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552c0b1170 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.412+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5528044070 con 0x7f55180039b0 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.412+0000 7f5522ffd640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 0x7f551006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.412+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f55280abb50 con 0x7f55180039b0 2024-09-15T22:41:27.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.412+0000 7f5531a64640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 0x7f551006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.413+0000 7f5531a64640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 0x7f551006e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f552c0af920 tx=0x7f551c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.417+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f552807a2c0 con 0x7f55180039b0 2024-09-15T22:41:27.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.617+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f552c0b0e90 con 0x7f55180039b0 2024-09-15T22:41:27.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.695+0000 7f5522ffd640 1 -- 172.21.15.134:0/1216024315 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f5528079bc0 con 0x7f55180039b0 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 msgr2=0x7f551006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 0x7f551006e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f552c0af920 tx=0x7f551c009040 comp rx=0 tx=0).stop 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 msgr2=0x7f552c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5528034040 tx=0x7f5528004730 comp rx=0 tx=0).stop 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 shutdown_connections 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f551006c2b0 0x7f551006e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0aae40 0x7f552c0ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552c155740 0x7f552c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 --2- 172.21.15.134:0/1216024315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55180039b0 0x7f552c06db80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 >> 172.21.15.134:0/1216024315 conn(0x7f552c06bba0 msgr2=0x7f552c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 shutdown_connections 2024-09-15T22:41:27.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.698+0000 7f55344c9640 1 -- 172.21.15.134:0/1216024315 wait complete. 2024-09-15T22:41:27.710 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:41:27.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:41:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.810+0000 7fd228f86640 1 Processor -- start 2024-09-15T22:41:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.810+0000 7fd228f86640 1 -- start start 2024-09-15T22:41:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.811+0000 7fd228f86640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 0x7fd2240713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.811+0000 7fd228f86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2240b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.811+0000 7fd228f86640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd224071a70 con 0x7fd2240b1ca0 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.811+0000 7fd228f86640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd2240b55c0 con 0x7fd22415c720 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.811+0000 7fd228f86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240b5810 con 0x7fd2240b6da0 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd221d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd2240b1ca0 0x7fd2240b62f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41874/0 (socket says 172.21.15.134:41874) 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd221d9b640 1 -- 172.21.15.134:0/2042122223 learned_addr learned my addr 172.21.15.134:0/2042122223 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd22259c640 1 --2- 172.21.15.134:0/2042122223 >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 0x7fd2240713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2042122223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2240b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd22159a640 1 -- 172.21.15.134:0/2042122223 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415977824 0 0) 0x7fd224071a70 con 0x7fd2240b1ca0 2024-09-15T22:41:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd22159a640 1 -- 172.21.15.134:0/2042122223 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd210003520 con 0x7fd2240b1ca0 2024-09-15T22:41:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd222d9d640 1 -- 172.21.15.134:0/2042122223 >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 msgr2=0x7fd2240713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2042122223 >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 0x7fd2240713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd222d9d640 1 -- 172.21.15.134:0/2042122223 >> v1:172.21.15.134:6789/0 conn(0x7fd2240b1ca0 legacy=0x7fd2240b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd222d9d640 1 -- 172.21.15.134:0/2042122223 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2240b5af0 con 0x7fd2240b6da0 2024-09-15T22:41:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.812+0000 7fd22259c640 1 --2- 172.21.15.134:0/2042122223 >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 0x7fd2240713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2042122223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2240b7230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a9e3c3a0aa29f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd22159a640 1 -- 172.21.15.134:0/2042122223 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214037070 con 0x7fd2240b6da0 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd22159a640 1 -- 172.21.15.134:0/2042122223 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214032440 con 0x7fd2240b6da0 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd22159a640 1 -- 172.21.15.134:0/2042122223 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140327f0 con 0x7fd2240b6da0 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd228f86640 1 -- 172.21.15.134:0/2042122223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 msgr2=0x7fd2240b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.813+0000 7fd228f86640 1 --2- 172.21.15.134:0/2042122223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2240b7230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a180 comp rx=0 tx=0).stop 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 -- 172.21.15.134:0/2042122223 shutdown_connections 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 --2- 172.21.15.134:0/2042122223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2240b7230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 --2- 172.21.15.134:0/2042122223 >> v2:172.21.15.177:3300/0 conn(0x7fd22415c720 0x7fd2240713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 -- 172.21.15.134:0/2042122223 >> 172.21.15.134:0/2042122223 conn(0x7fd2240d2550 msgr2=0x7fd2240d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 -- 172.21.15.134:0/2042122223 shutdown_connections 2024-09-15T22:41:27.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.814+0000 7fd228f86640 1 -- 172.21.15.134:0/2042122223 wait complete. 2024-09-15T22:41:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.815+0000 7fd228f86640 1 Processor -- start 2024-09-15T22:41:27.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.815+0000 7fd228f86640 1 -- start start 2024-09-15T22:41:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2240b1ca0 0x7fd22415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2241f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240b6a00 con 0x7fd22415c720 2024-09-15T22:41:27.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240d2290 con 0x7fd2240b1ca0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240b6b80 con 0x7fd2240b6da0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37070/0 (socket says 172.21.15.134:37070) 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 -- 172.21.15.134:0/2013207223 learned_addr learned my addr 172.21.15.134:0/2013207223 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd22259c640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2240b1ca0 0x7fd22415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd221d9b640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2241f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 -- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 msgr2=0x7fd2241f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2241f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 -- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2240b1ca0 msgr2=0x7fd22415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2240b1ca0 0x7fd22415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 -- 172.21.15.134:0/2013207223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd224158410 con 0x7fd22415c720 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd222d9d640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd214035040 tx=0x7fd2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214037040 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21403b430 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21403b7e0 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241586b0 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.816+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd224155fa0 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.817+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2240713e0 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.818+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd214044020 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.818+0000 7fd21affd640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 0x7fd20406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.818+0000 7fd22259c640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 0x7fd20406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.819+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd2140ab580 con 0x7fd22415c720 2024-09-15T22:41:27.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.819+0000 7fd22259c640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 0x7fd20406e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009bd0 tx=0x7fd21c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:27.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:27.823+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd214079620 con 0x7fd22415c720 2024-09-15T22:41:28.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.025+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd2240d2ad0 con 0x7fd22415c720 2024-09-15T22:41:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.700+0000 7fd21affd640 1 -- 172.21.15.134:0/2013207223 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fd21407d920 con 0x7fd22415c720 2024-09-15T22:41:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 msgr2=0x7fd20406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 0x7fd20406e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009bd0 tx=0x7fd21c00b040 comp rx=0 tx=0).stop 2024-09-15T22:41:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 msgr2=0x7fd2241f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd214035040 tx=0x7fd2140046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 shutdown_connections 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd20406c2b0 0x7fd20406e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd22415c720 0x7fd2241f14f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2240b6da0 0x7fd2241f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 --2- 172.21.15.134:0/2013207223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2240b1ca0 0x7fd22415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 >> 172.21.15.134:0/2013207223 conn(0x7fd2240d2550 msgr2=0x7fd2240731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 shutdown_connections 2024-09-15T22:41:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.703+0000 7fd228f86640 1 -- 172.21.15.134:0/2013207223 wait complete. 2024-09-15T22:41:28.716 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:41:28.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:28.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.815+0000 7f649242e640 1 Processor -- start 2024-09-15T22:41:28.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 -- start start 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f648c140a40 0x7f648c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 0x7f648c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 0x7f648c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f648c072a70 con 0x7f648c140a40 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f648c0b5780 con 0x7f648c0720c0 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f649242e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f648c13ef30 con 0x7f648c13eaf0 2024-09-15T22:41:28.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.816+0000 7f648bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f648c140a40 0x7f648c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f648c140a40 0x7f648c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37086/0 (socket says 172.21.15.134:37086) 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 -- 172.21.15.134:0/420689574 learned_addr learned my addr 172.21.15.134:0/420689574 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 -- 172.21.15.134:0/420689574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 msgr2=0x7f648c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f6483fff640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 0x7f648c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f64909cb640 1 --2- 172.21.15.134:0/420689574 >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 0x7f648c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 0x7f648c0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 -- 172.21.15.134:0/420689574 >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 msgr2=0x7f648c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 --2- 172.21.15.134:0/420689574 >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 0x7f648c072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 -- 172.21.15.134:0/420689574 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c0b4ee0 con 0x7f648c140a40 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f6483fff640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 0x7f648c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:28.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f64909cb640 1 --2- 172.21.15.134:0/420689574 >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 0x7f648c072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:28.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.817+0000 7f648bfff640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c140a40 0x7f648c15c480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f648c0630c0 tx=0x7f647c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91612304bba0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:28.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f648b7fe640 1 -- 172.21.15.134:0/420689574 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c037070 con 0x7f648c140a40 2024-09-15T22:41:28.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f648b7fe640 1 -- 172.21.15.134:0/420689574 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c032440 con 0x7f648c140a40 2024-09-15T22:41:28.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f648b7fe640 1 -- 172.21.15.134:0/420689574 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c032810 con 0x7f648c140a40 2024-09-15T22:41:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 -- 172.21.15.134:0/420689574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c140a40 msgr2=0x7f648c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c140a40 0x7f648c15c480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f648c0630c0 tx=0x7f647c02a140 comp rx=0 tx=0).stop 2024-09-15T22:41:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 -- 172.21.15.134:0/420689574 shutdown_connections 2024-09-15T22:41:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 --2- 172.21.15.134:0/420689574 >> v2:172.21.15.177:3300/0 conn(0x7f648c0720c0 0x7f648c072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c13eaf0 0x7f648c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 --2- 172.21.15.134:0/420689574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c140a40 0x7f648c15c480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 -- 172.21.15.134:0/420689574 >> 172.21.15.134:0/420689574 conn(0x7f648c062a80 msgr2=0x7f648c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 -- 172.21.15.134:0/420689574 shutdown_connections 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.818+0000 7f649242e640 1 -- 172.21.15.134:0/420689574 wait complete. 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.819+0000 7f649242e640 1 Processor -- start 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.819+0000 7f649242e640 1 -- start start 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0720c0 0x7f648c13db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 0x7f648c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0b5ad0 con 0x7f648c13eaf0 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0b54a0 con 0x7f648c0720c0 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f649242e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f648c140e20 con 0x7f648c140a40 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37094/0 (socket says 172.21.15.134:37094) 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 -- 172.21.15.134:0/2900726323 learned_addr learned my addr 172.21.15.134:0/2900726323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f648bfff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0720c0 0x7f648c13db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f64909cb640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 0x7f648c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 -- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 msgr2=0x7f648c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 0x7f648c06bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 -- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0720c0 msgr2=0x7f648c13db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.820+0000 7f6483fff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0720c0 0x7f648c13db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f6483fff640 1 -- 172.21.15.134:0/2900726323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c1f2860 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f64909cb640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 0x7f648c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f6483fff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f647400c7f0 tx=0x7f647400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474015070 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474007a30 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1f2b40 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007e00 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.821+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c1f3100 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.822+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c072530 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.822+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6474018070 con 0x7f648c13eaf0 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.823+0000 7f64897fa640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 0x7f646c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.823+0000 7f648bfff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 0x7f646c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.823+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f647408b320 con 0x7f648c13eaf0 2024-09-15T22:41:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.823+0000 7f648bfff640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 0x7f646c06e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f647c034000 tx=0x7f647c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:28.827+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6474059440 con 0x7f648c13eaf0 2024-09-15T22:41:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.028+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f648c0b4a30 con 0x7f648c13eaf0 2024-09-15T22:41:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.029+0000 7f64897fa640 1 -- 172.21.15.134:0/2900726323 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f647405d740 con 0x7f648c13eaf0 2024-09-15T22:41:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:29.030 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:29.031 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:29.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 msgr2=0x7f646c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 0x7f646c06e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f647c034000 tx=0x7f647c02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 msgr2=0x7f648c1e54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f647400c7f0 tx=0x7f647400cbf0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 shutdown_connections 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f646c06c2b0 0x7f646c06e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c140a40 0x7f648c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c13eaf0 0x7f648c1e54c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 --2- 172.21.15.134:0/2900726323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0720c0 0x7f648c13db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 >> 172.21.15.134:0/2900726323 conn(0x7f648c062a80 msgr2=0x7f648c159900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 shutdown_connections 2024-09-15T22:41:29.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.031+0000 7f649242e640 1 -- 172.21.15.134:0/2900726323 wait complete. 2024-09-15T22:41:29.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.140+0000 7f0971e1e640 1 Processor -- start 2024-09-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.140+0000 7f0971e1e640 1 -- start start 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f0971e1e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f096c0b5600 0x7f096c073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f0971e1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c073ff0 0x7f096c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f0971e1e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c06e8d0 con 0x7f096c15e7b0 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f0971e1e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f096c06e680 con 0x7f096c0b5600 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f0971e1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f096c06ebb0 con 0x7f096c073ff0 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f096c15e7b0 0x7f096c071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41890/0 (socket says 172.21.15.134:41890) 2024-09-15T22:41:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096b7fe640 1 -- 172.21.15.134:0/418352576 learned_addr learned my addr 172.21.15.134:0/418352576 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687158794 0 0) 0x7f096c06e8d0 con 0x7f096c15e7b0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096bfff640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c073ff0 0x7f096c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0954003520 con 0x7f096c15e7b0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096affd640 1 --2- 172.21.15.134:0/418352576 >> v2:172.21.15.177:3300/0 conn(0x7f096c0b5600 0x7f096c073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2170669806 0 0) 0x7f0954003520 con 0x7f096c15e7b0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c073ff0 msgr2=0x7f096c06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c073ff0 0x7f096c06ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 >> v2:172.21.15.177:3300/0 conn(0x7f096c0b5600 msgr2=0x7f096c073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 --2- 172.21.15.134:0/418352576 >> v2:172.21.15.177:3300/0 conn(0x7f096c0b5600 0x7f096c073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0732b0 con 0x7f096c15e7b0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f095c001670 con 0x7f096c15e7b0 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 >> v1:172.21.15.134:6789/0 conn(0x7f096c15e7b0 legacy=0x7f096c071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.141+0000 7f096a7fc640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540039b0 0x7f0954003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096a7fc640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0954004800 0x7f0954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096a7fc640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f095400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06e680 con 0x7f0954005180 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06ebb0 con 0x7f09540039b0 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0954004630 con 0x7f0954004800 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f095400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096b7fe640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540039b0 0x7f0954003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096affd640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0954004800 0x7f0954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 -- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0954004800 msgr2=0x7f0954004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0954004800 0x7f0954004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 -- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540039b0 msgr2=0x7f0954003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540039b0 0x7f0954003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.142+0000 7f096bfff640 1 -- 172.21.15.134:0/418352576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0954003520 con 0x7f0954005180 2024-09-15T22:41:29.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f096bfff640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f095400b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0964009fc0 tx=0x7f0954005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353f44a6446bc58c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964009c10 con 0x7f0954005180 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0964036070 con 0x7f0954005180 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f096a7fc640 1 -- 172.21.15.134:0/418352576 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964031880 con 0x7f0954005180 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 -- 172.21.15.134:0/418352576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 msgr2=0x7f095400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 --2- 172.21.15.134:0/418352576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f095400b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0964009fc0 tx=0x7f0954005830 comp rx=0 tx=0).stop 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f096bfff640 1 -- 172.21.15.134:0/418352576 reap_dead start 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 -- 172.21.15.134:0/418352576 shutdown_connections 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 -- 172.21.15.134:0/418352576 >> 172.21.15.134:0/418352576 conn(0x7f096c0b4300 msgr2=0x7f096c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 -- 172.21.15.134:0/418352576 shutdown_connections 2024-09-15T22:41:29.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.143+0000 7f0971e1e640 1 -- 172.21.15.134:0/418352576 wait complete. 2024-09-15T22:41:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.144+0000 7f0971e1e640 1 Processor -- start 2024-09-15T22:41:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 -- start start 2024-09-15T22:41:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096c153f10 0x7f096c155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c1f4490 0x7f096c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06ce30 con 0x7f0954005180 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06ccb0 con 0x7f096c153f10 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f0971e1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f096c06cfb0 con 0x7f096c1f4490 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f096b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f096b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37106/0 (socket says 172.21.15.134:37106) 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.145+0000 7f096b7fe640 1 -- 172.21.15.134:0/2111365436 learned_addr learned my addr 172.21.15.134:0/2111365436 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 -- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c1f4490 msgr2=0x7f096c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c1f4490 0x7f096c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 -- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096c153f10 msgr2=0x7f096c155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096c153f10 0x7f096c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 -- 172.21.15.134:0/2111365436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c153ce0 con 0x7f0954005180 2024-09-15T22:41:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f096b7fe640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f095c0072c0 tx=0x7f095c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c00f940 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c018070 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c15de60 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c00fd20 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.146+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c15b2e0 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.147+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c06d340 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.147+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f095c01d460 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.148+0000 7f0953fff640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.148+0000 7f096affd640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.148+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f095c08b4d0 con 0x7f0954005180 2024-09-15T22:41:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.148+0000 7f096affd640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 0x7f095806e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0960006e80 tx=0x7f0960006df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.152+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f095c059cd0 con 0x7f0954005180 2024-09-15T22:41:29.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.318+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f096c0b1a90 con 0x7f0954005180 2024-09-15T22:41:29.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.319+0000 7f0953fff640 1 -- 172.21.15.134:0/2111365436 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7f095c089e20 con 0x7f0954005180 2024-09-15T22:41:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:29.321 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:29.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 msgr2=0x7f095806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 0x7f095806e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0960006e80 tx=0x7f0960006df0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 msgr2=0x7f096c15d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f095c0072c0 tx=0x7f095c007780 comp rx=0 tx=0).stop 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 shutdown_connections 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f096c1f4490 0x7f096c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096c153f10 0x7f096c155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 --2- 172.21.15.134:0/2111365436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0954005180 0x7f096c15d880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 >> 172.21.15.134:0/2111365436 conn(0x7f096c0b4300 msgr2=0x7f096c073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 shutdown_connections 2024-09-15T22:41:29.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.322+0000 7f0971e1e640 1 -- 172.21.15.134:0/2111365436 wait complete. 2024-09-15T22:41:29.334 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:41:29.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:29.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.432+0000 7f41ee76d640 1 Processor -- start 2024-09-15T22:41:29.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.432+0000 7f41ee76d640 1 -- start start 2024-09-15T22:41:29.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ee76d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e8162c40 0x7f41e80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ee76d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41e80b3840 0x7f41e806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ee76d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e815f520 con 0x7f41e8162860 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ee76d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f41e81630b0 con 0x7f41e80b3840 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ee76d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f41e815fae0 con 0x7f41e8162c40 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41e80b3840 0x7f41e806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41e80b3840 0x7f41e806bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37112/0 (socket says 172.21.15.134:37112) 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 -- 172.21.15.134:0/2033973025 learned_addr learned my addr 172.21.15.134:0/2033973025 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41e77fe640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e8162c40 0x7f41e80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 -- 172.21.15.134:0/2033973025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e8162c40 msgr2=0x7f41e80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e8162c40 0x7f41e80b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 -- 172.21.15.134:0/2033973025 >> v1:172.21.15.177:6789/0 conn(0x7f41e8162860 legacy=0x7f41e815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.433+0000 7f41ecd0a640 1 -- 172.21.15.134:0/2033973025 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e815f800 con 0x7f41e80b3840 2024-09-15T22:41:29.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ecd0a640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e80b3840 0x7f41e806bba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009e50 tx=0x7f41e002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af22429ca8001792 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41e6ffd640 1 -- 172.21.15.134:0/2033973025 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0036070 con 0x7f41e80b3840 2024-09-15T22:41:29.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41e6ffd640 1 -- 172.21.15.134:0/2033973025 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0031600 con 0x7f41e80b3840 2024-09-15T22:41:29.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41e6ffd640 1 -- 172.21.15.134:0/2033973025 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00319d0 con 0x7f41e80b3840 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 -- 172.21.15.134:0/2033973025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e80b3840 msgr2=0x7f41e806bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e80b3840 0x7f41e806bba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009e50 tx=0x7f41e002a630 comp rx=0 tx=0).stop 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 -- 172.21.15.134:0/2033973025 shutdown_connections 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e80b3840 0x7f41e806bba0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2033973025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e8162c40 0x7f41e80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 -- 172.21.15.134:0/2033973025 >> 172.21.15.134:0/2033973025 conn(0x7f41e806ce90 msgr2=0x7f41e806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 -- 172.21.15.134:0/2033973025 shutdown_connections 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.434+0000 7f41ee76d640 1 -- 172.21.15.134:0/2033973025 wait complete. 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.436+0000 7f41ee76d640 1 Processor -- start 2024-09-15T22:41:29.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.436+0000 7f41ee76d640 1 -- start start 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 0x7f41e814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e8162c40 0x7f41e814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41e80b2de0 con 0x7f41e8162860 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f41e815f2c0 con 0x7f41e8162c40 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f41e806c0e0 con 0x7f41e80b3840 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37124/0 (socket says 172.21.15.134:37124) 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 -- 172.21.15.134:0/2915207855 learned_addr learned my addr 172.21.15.134:0/2915207855 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e7fff640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 0x7f41e814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ecd0a640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e8162c40 0x7f41e814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 -- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 msgr2=0x7f41e814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 0x7f41e814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 -- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e8162c40 msgr2=0x7f41e814fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e8162c40 0x7f41e814fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 -- 172.21.15.134:0/2915207855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e815ee00 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e7fff640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 0x7f41e814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e77fe640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c7f0 tx=0x7f41dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc015070 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc004220 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc007620 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e814f230 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.437+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e814f7f0 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.438+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e806bba0 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.439+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41dc0079d0 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.439+0000 7f41e4ff9640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.439+0000 7f41e7fff640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.439+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f41dc08b770 con 0x7f41e8162860 2024-09-15T22:41:29.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.440+0000 7f41e7fff640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 0x7f41d406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003eb0 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.444+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41dc059f70 con 0x7f41e8162860 2024-09-15T22:41:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.604+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41e815f0e0 con 0x7f41d406c2b0 2024-09-15T22:41:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.610+0000 7f41e4ff9640 1 -- 172.21.15.134:0/2915207855 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245599 (secure 0 0 0) 0x7f41d8053f70 con 0x7f41d406c2b0 2024-09-15T22:41:29.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 msgr2=0x7f41d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 0x7f41d406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003eb0 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 msgr2=0x7f41e815d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c7f0 tx=0x7f41dc00ccb0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 shutdown_connections 2024-09-15T22:41:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41e8162c40 0x7f41e814fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e8162860 0x7f41e815d6e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 --2- 172.21.15.134:0/2915207855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41e80b3840 0x7f41e814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 >> 172.21.15.134:0/2915207855 conn(0x7f41e806ce90 msgr2=0x7f41e8160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 shutdown_connections 2024-09-15T22:41:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.613+0000 7f41ee76d640 1 -- 172.21.15.134:0/2915207855 wait complete. 2024-09-15T22:41:29.625 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:41:28.948326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218940,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755780,"statfs":{"total":773094113280,"available":772869918720,"internally_reserved":0,"allocated":2772992,"data_stored":1682549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699129+0000","last_change":"2024-09-15T22:41:25.699129+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699129+0000","last_undegraded":"2024-09-15T22:41:25.699129+0000","last_fullsized":"2024-09-15T22:41:25.699129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696613+0000","last_change":"2024-09-15T22:41:25.696613+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696613+0000","last_undegraded":"2024-09-15T22:41:25.696613+0000","last_fullsized":"2024-09-15T22:41:25.696613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694311+0000","last_change":"2024-09-15T22:41:25.694311+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694311+0000","last_undegraded":"2024-09-15T22:41:25.694311+0000","last_fullsized":"2024-09-15T22:41:25.694311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700151+0000","last_change":"2024-09-15T22:41:25.700151+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700151+0000","last_undegraded":"2024-09-15T22:41:25.700151+0000","last_fullsized":"2024-09-15T22:41:25.700151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698964+0000","last_change":"2024-09-15T22:41:25.698964+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698964+0000","last_undegraded":"2024-09-15T22:41:25.698964+0000","last_fullsized":"2024-09-15T22:41:25.698964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699680+0000","last_change":"2024-09-15T22:41:25.699680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699680+0000","last_undegraded":"2024-09-15T22:41:25.699680+0000","last_fullsized":"2024-09-15T22:41:25.699680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697022+0000","last_change":"2024-09-15T22:41:25.697022+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697022+0000","last_undegraded":"2024-09-15T22:41:25.697022+0000","last_fullsized":"2024-09-15T22:41:25.697022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697196+0000","last_change":"2024-09-15T22:41:25.697196+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697196+0000","last_undegraded":"2024-09-15T22:41:25.697196+0000","last_fullsized":"2024-09-15T22:41:25.697196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697277+0000","last_change":"2024-09-15T22:41:25.697277+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697277+0000","last_undegraded":"2024-09-15T22:41:25.697277+0000","last_fullsized":"2024-09-15T22:41:25.697277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696465+0000","last_change":"2024-09-15T22:41:25.696465+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696465+0000","last_undegraded":"2024-09-15T22:41:25.696465+0000","last_fullsized":"2024-09-15T22:41:25.696465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698751+0000","last_change":"2024-09-15T22:41:25.698751+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698751+0000","last_undegraded":"2024-09-15T22:41:25.698751+0000","last_fullsized":"2024-09-15T22:41:25.698751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698507+0000","last_change":"2024-09-15T22:41:25.698507+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698507+0000","last_undegraded":"2024-09-15T22:41:25.698507+0000","last_fullsized":"2024-09-15T22:41:25.698507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693619+0000","last_change":"2024-09-15T22:41:25.693619+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693619+0000","last_undegraded":"2024-09-15T22:41:25.693619+0000","last_fullsized":"2024-09-15T22:41:25.693619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700807+0000","last_change":"2024-09-15T22:41:25.700807+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700807+0000","last_undegraded":"2024-09-15T22:41:25.700807+0000","last_fullsized":"2024-09-15T22:41:25.700807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699497+0000","last_change":"2024-09-15T22:41:25.699497+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699497+0000","last_undegraded":"2024-09-15T22:41:25.699497+0000","last_fullsized":"2024-09-15T22:41:25.699497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690757+0000","last_change":"2024-09-15T22:41:25.690757+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690757+0000","last_undegraded":"2024-09-15T22:41:25.690757+0000","last_fullsized":"2024-09-15T22:41:25.690757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700628+0000","last_change":"2024-09-15T22:41:25.700628+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700628+0000","last_undegraded":"2024-09-15T22:41:25.700628+0000","last_fullsized":"2024-09-15T22:41:25.700628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698121+0000","last_change":"2024-09-15T22:41:25.698121+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698121+0000","last_undegraded":"2024-09-15T22:41:25.698121+0000","last_fullsized":"2024-09-15T22:41:25.698121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689992+0000","last_change":"2024-09-15T22:41:25.689992+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689992+0000","last_undegraded":"2024-09-15T22:41:25.689992+0000","last_fullsized":"2024-09-15T22:41:25.689992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697731+0000","last_change":"2024-09-15T22:41:25.697731+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697731+0000","last_undegraded":"2024-09-15T22:41:25.697731+0000","last_fullsized":"2024-09-15T22:41:25.697731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690715+0000","last_change":"2024-09-15T22:41:25.690715+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690715+0000","last_undegraded":"2024-09-15T22:41:25.690715+0000","last_fullsized":"2024-09-15T22:41:25.690715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699348+0000","last_change":"2024-09-15T22:41:25.699348+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699348+0000","last_undegraded":"2024-09-15T22:41:25.699348+0000","last_fullsized":"2024-09-15T22:41:25.699348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694223+0000","last_change":"2024-09-15T22:41:25.694223+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694223+0000","last_undegraded":"2024-09-15T22:41:25.694223+0000","last_fullsized":"2024-09-15T22:41:25.694223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697971+0000","last_change":"2024-09-15T22:41:25.697971+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697971+0000","last_undegraded":"2024-09-15T22:41:25.697971+0000","last_fullsized":"2024-09-15T22:41:25.697971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692847+0000","last_change":"2024-09-15T22:41:25.692847+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692847+0000","last_undegraded":"2024-09-15T22:41:25.692847+0000","last_fullsized":"2024-09-15T22:41:25.692847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698069+0000","last_change":"2024-09-15T22:41:25.698069+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698069+0000","last_undegraded":"2024-09-15T22:41:25.698069+0000","last_fullsized":"2024-09-15T22:41:25.698069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690015+0000","last_change":"2024-09-15T22:41:25.690015+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690015+0000","last_undegraded":"2024-09-15T22:41:25.690015+0000","last_fullsized":"2024-09-15T22:41:25.690015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696397+0000","last_change":"2024-09-15T22:41:25.696397+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696397+0000","last_undegraded":"2024-09-15T22:41:25.696397+0000","last_fullsized":"2024-09-15T22:41:25.696397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697246+0000","last_change":"2024-09-15T22:41:25.697246+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697246+0000","last_undegraded":"2024-09-15T22:41:25.697246+0000","last_fullsized":"2024-09-15T22:41:25.697246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704375+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:25.704375+0000","last_peered":"2024-09-15T22:41:25.704375+0000","last_clean":"2024-09-15T22:41:25.704375+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:25.704375+0000","last_undegraded":"2024-09-15T22:41:25.704375+0000","last_fullsized":"2024-09-15T22:41:25.704375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.687895+0000","last_change":"2024-09-15T22:41:25.687895+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.687895+0000","last_undegraded":"2024-09-15T22:41:25.687895+0000","last_fullsized":"2024-09-15T22:41:25.687895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711960+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:25.711960+0000","last_peered":"2024-09-15T22:41:25.711960+0000","last_clean":"2024-09-15T22:41:25.711960+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:25.711960+0000","last_undegraded":"2024-09-15T22:41:25.711960+0000","last_fullsized":"2024-09-15T22:41:25.711960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695167+0000","last_change":"2024-09-15T22:41:25.695167+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695167+0000","last_undegraded":"2024-09-15T22:41:25.695167+0000","last_fullsized":"2024-09-15T22:41:25.695167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705855+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:25.705855+0000","last_peered":"2024-09-15T22:41:25.705855+0000","last_clean":"2024-09-15T22:41:25.705855+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:25.705855+0000","last_undegraded":"2024-09-15T22:41:25.705855+0000","last_fullsized":"2024-09-15T22:41:25.705855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689694+0000","last_change":"2024-09-15T22:41:25.689694+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689694+0000","last_undegraded":"2024-09-15T22:41:25.689694+0000","last_fullsized":"2024-09-15T22:41:25.689694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699217+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:25.699217+0000","last_peered":"2024-09-15T22:41:25.699217+0000","last_clean":"2024-09-15T22:41:25.699217+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:25.699217+0000","last_undegraded":"2024-09-15T22:41:25.699217+0000","last_fullsized":"2024-09-15T22:41:25.699217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697212+0000","last_change":"2024-09-15T22:41:25.697212+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697212+0000","last_undegraded":"2024-09-15T22:41:25.697212+0000","last_fullsized":"2024-09-15T22:41:25.697212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705593+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:25.705593+0000","last_peered":"2024-09-15T22:41:25.705593+0000","last_clean":"2024-09-15T22:41:25.705593+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:25.705593+0000","last_undegraded":"2024-09-15T22:41:25.705593+0000","last_fullsized":"2024-09-15T22:41:25.705593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692208+0000","last_change":"2024-09-15T22:41:25.692208+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692208+0000","last_undegraded":"2024-09-15T22:41:25.692208+0000","last_fullsized":"2024-09-15T22:41:25.692208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.703712+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:25.703712+0000","last_peered":"2024-09-15T22:41:25.703712+0000","last_clean":"2024-09-15T22:41:25.703712+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:25.703712+0000","last_undegraded":"2024-09-15T22:41:25.703712+0000","last_fullsized":"2024-09-15T22:41:25.703712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:57.173330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698721+0000","last_change":"2024-09-15T22:41:25.698721+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698721+0000","last_undegraded":"2024-09-15T22:41:25.698721+0000","last_fullsized":"2024-09-15T22:41:25.698721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.701757+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:25.701757+0000","last_peered":"2024-09-15T22:41:25.701757+0000","last_clean":"2024-09-15T22:41:25.701757+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:25.701757+0000","last_undegraded":"2024-09-15T22:41:25.701757+0000","last_fullsized":"2024-09-15T22:41:25.701757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695554+0000","last_change":"2024-09-15T22:41:25.695554+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695554+0000","last_undegraded":"2024-09-15T22:41:25.695554+0000","last_fullsized":"2024-09-15T22:41:25.695554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704200+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:25.704200+0000","last_peered":"2024-09-15T22:41:25.704200+0000","last_clean":"2024-09-15T22:41:25.704200+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:25.704200+0000","last_undegraded":"2024-09-15T22:41:25.704200+0000","last_fullsized":"2024-09-15T22:41:25.704200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711886+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:25.711886+0000","last_peered":"2024-09-15T22:41:25.711886+0000","last_clean":"2024-09-15T22:41:25.711886+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:25.711886+0000","last_undegraded":"2024-09-15T22:41:25.711886+0000","last_fullsized":"2024-09-15T22:41:25.711886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697199+0000","last_change":"2024-09-15T22:41:25.697199+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697199+0000","last_undegraded":"2024-09-15T22:41:25.697199+0000","last_fullsized":"2024-09-15T22:41:25.697199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709131+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:25.709131+0000","last_peered":"2024-09-15T22:41:25.709131+0000","last_clean":"2024-09-15T22:41:25.709131+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:25.709131+0000","last_undegraded":"2024-09-15T22:41:25.709131+0000","last_fullsized":"2024-09-15T22:41:25.709131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698179+0000","last_change":"2024-09-15T22:41:25.698179+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698179+0000","last_undegraded":"2024-09-15T22:41:25.698179+0000","last_fullsized":"2024-09-15T22:41:25.698179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699076+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:25.699076+0000","last_peered":"2024-09-15T22:41:25.699076+0000","last_clean":"2024-09-15T22:41:25.699076+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:25.699076+0000","last_undegraded":"2024-09-15T22:41:25.699076+0000","last_fullsized":"2024-09-15T22:41:25.699076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696580+0000","last_change":"2024-09-15T22:41:25.696580+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696580+0000","last_undegraded":"2024-09-15T22:41:25.696580+0000","last_fullsized":"2024-09-15T22:41:25.696580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711954+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:25.711954+0000","last_peered":"2024-09-15T22:41:25.711954+0000","last_clean":"2024-09-15T22:41:25.711954+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:25.711954+0000","last_undegraded":"2024-09-15T22:41:25.711954+0000","last_fullsized":"2024-09-15T22:41:25.711954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695861+0000","last_change":"2024-09-15T22:41:25.695861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695861+0000","last_undegraded":"2024-09-15T22:41:25.695861+0000","last_fullsized":"2024-09-15T22:41:25.695861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706487+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:25.706487+0000","last_peered":"2024-09-15T22:41:25.706487+0000","last_clean":"2024-09-15T22:41:25.706487+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:25.706487+0000","last_undegraded":"2024-09-15T22:41:25.706487+0000","last_fullsized":"2024-09-15T22:41:25.706487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695610+0000","last_change":"2024-09-15T22:41:25.695610+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695610+0000","last_undegraded":"2024-09-15T22:41:25.695610+0000","last_fullsized":"2024-09-15T22:41:25.695610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704618+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:25.704618+0000","last_peered":"2024-09-15T22:41:25.704618+0000","last_clean":"2024-09-15T22:41:25.704618+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:25.704618+0000","last_undegraded":"2024-09-15T22:41:25.704618+0000","last_fullsized":"2024-09-15T22:41:25.704618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695299+0000","last_change":"2024-09-15T22:41:25.695299+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695299+0000","last_undegraded":"2024-09-15T22:41:25.695299+0000","last_fullsized":"2024-09-15T22:41:25.695299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695606+0000","last_change":"2024-09-15T22:41:25.695606+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695606+0000","last_undegraded":"2024-09-15T22:41:25.695606+0000","last_fullsized":"2024-09-15T22:41:25.695606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.689317+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:25.689317+0000","last_peered":"2024-09-15T22:41:25.689317+0000","last_clean":"2024-09-15T22:41:25.689317+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:25.689317+0000","last_undegraded":"2024-09-15T22:41:25.689317+0000","last_fullsized":"2024-09-15T22:41:25.689317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705563+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:25.705563+0000","last_peered":"2024-09-15T22:41:25.705563+0000","last_clean":"2024-09-15T22:41:25.705563+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:25.705563+0000","last_undegraded":"2024-09-15T22:41:25.705563+0000","last_fullsized":"2024-09-15T22:41:25.705563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688860+0000","last_change":"2024-09-15T22:41:25.688860+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688860+0000","last_undegraded":"2024-09-15T22:41:25.688860+0000","last_fullsized":"2024-09-15T22:41:25.688860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705876+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:25.705876+0000","last_peered":"2024-09-15T22:41:25.705876+0000","last_clean":"2024-09-15T22:41:25.705876+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:25.705876+0000","last_undegraded":"2024-09-15T22:41:25.705876+0000","last_fullsized":"2024-09-15T22:41:25.705876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706571+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:25.706571+0000","last_peered":"2024-09-15T22:41:25.706571+0000","last_clean":"2024-09-15T22:41:25.706571+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:25.706571+0000","last_undegraded":"2024-09-15T22:41:25.706571+0000","last_fullsized":"2024-09-15T22:41:25.706571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696861+0000","last_change":"2024-09-15T22:41:25.696861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696861+0000","last_undegraded":"2024-09-15T22:41:25.696861+0000","last_fullsized":"2024-09-15T22:41:25.696861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705823+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:25.705823+0000","last_peered":"2024-09-15T22:41:25.705823+0000","last_clean":"2024-09-15T22:41:25.705823+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:25.705823+0000","last_undegraded":"2024-09-15T22:41:25.705823+0000","last_fullsized":"2024-09-15T22:41:25.705823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695972+0000","last_change":"2024-09-15T22:41:25.695972+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695972+0000","last_undegraded":"2024-09-15T22:41:25.695972+0000","last_fullsized":"2024-09-15T22:41:25.695972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704393+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:25.704393+0000","last_peered":"2024-09-15T22:41:25.704393+0000","last_clean":"2024-09-15T22:41:25.704393+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:25.704393+0000","last_undegraded":"2024-09-15T22:41:25.704393+0000","last_fullsized":"2024-09-15T22:41:25.704393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696098+0000","last_change":"2024-09-15T22:41:25.696098+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696098+0000","last_undegraded":"2024-09-15T22:41:25.696098+0000","last_fullsized":"2024-09-15T22:41:25.696098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705611+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:25.705611+0000","last_peered":"2024-09-15T22:41:25.705611+0000","last_clean":"2024-09-15T22:41:25.705611+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:25.705611+0000","last_undegraded":"2024-09-15T22:41:25.705611+0000","last_fullsized":"2024-09-15T22:41:25.705611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704193+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:25.704193+0000","last_peered":"2024-09-15T22:41:25.704193+0000","last_clean":"2024-09-15T22:41:25.704193+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:25.704193+0000","last_undegraded":"2024-09-15T22:41:25.704193+0000","last_fullsized":"2024-09-15T22:41:25.704193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688085+0000","last_change":"2024-09-15T22:41:25.688085+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688085+0000","last_undegraded":"2024-09-15T22:41:25.688085+0000","last_fullsized":"2024-09-15T22:41:25.688085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.717223+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:25.717223+0000","last_peered":"2024-09-15T22:41:25.717223+0000","last_clean":"2024-09-15T22:41:25.717223+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:25.717223+0000","last_undegraded":"2024-09-15T22:41:25.717223+0000","last_fullsized":"2024-09-15T22:41:25.717223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690406+0000","last_change":"2024-09-15T22:41:25.690406+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690406+0000","last_undegraded":"2024-09-15T22:41:25.690406+0000","last_fullsized":"2024-09-15T22:41:25.690406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709081+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:25.709081+0000","last_peered":"2024-09-15T22:41:25.709081+0000","last_clean":"2024-09-15T22:41:25.709081+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:25.709081+0000","last_undegraded":"2024-09-15T22:41:25.709081+0000","last_fullsized":"2024-09-15T22:41:25.709081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695061+0000","last_change":"2024-09-15T22:41:25.695061+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695061+0000","last_undegraded":"2024-09-15T22:41:25.695061+0000","last_fullsized":"2024-09-15T22:41:25.695061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704379+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:25.704379+0000","last_peered":"2024-09-15T22:41:25.704379+0000","last_clean":"2024-09-15T22:41:25.704379+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:25.704379+0000","last_undegraded":"2024-09-15T22:41:25.704379+0000","last_fullsized":"2024-09-15T22:41:25.704379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688783+0000","last_change":"2024-09-15T22:41:25.688783+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688783+0000","last_undegraded":"2024-09-15T22:41:25.688783+0000","last_fullsized":"2024-09-15T22:41:25.688783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689723+0000","last_change":"2024-09-15T22:41:25.689723+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689723+0000","last_undegraded":"2024-09-15T22:41:25.689723+0000","last_fullsized":"2024-09-15T22:41:25.689723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705586+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:25.705586+0000","last_peered":"2024-09-15T22:41:25.705586+0000","last_clean":"2024-09-15T22:41:25.705586+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:25.705586+0000","last_undegraded":"2024-09-15T22:41:25.705586+0000","last_fullsized":"2024-09-15T22:41:25.705586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696138+0000","last_change":"2024-09-15T22:41:25.696138+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696138+0000","last_undegraded":"2024-09-15T22:41:25.696138+0000","last_fullsized":"2024-09-15T22:41:25.696138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697680+0000","last_change":"2024-09-15T22:41:25.697680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697680+0000","last_undegraded":"2024-09-15T22:41:25.697680+0000","last_fullsized":"2024-09-15T22:41:25.697680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709114+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:25.709114+0000","last_peered":"2024-09-15T22:41:25.709114+0000","last_clean":"2024-09-15T22:41:25.709114+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:25.709114+0000","last_undegraded":"2024-09-15T22:41:25.709114+0000","last_fullsized":"2024-09-15T22:41:25.709114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697661+0000","last_change":"2024-09-15T22:41:25.697661+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697661+0000","last_undegraded":"2024-09-15T22:41:25.697661+0000","last_fullsized":"2024-09-15T22:41:25.697661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705565+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:25.705565+0000","last_peered":"2024-09-15T22:41:25.705565+0000","last_clean":"2024-09-15T22:41:25.705565+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:25.705565+0000","last_undegraded":"2024-09-15T22:41:25.705565+0000","last_fullsized":"2024-09-15T22:41:25.705565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693722+0000","last_change":"2024-09-15T22:41:25.693722+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693722+0000","last_undegraded":"2024-09-15T22:41:25.693722+0000","last_fullsized":"2024-09-15T22:41:25.693722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704387+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:25.704387+0000","last_peered":"2024-09-15T22:41:25.704387+0000","last_clean":"2024-09-15T22:41:25.704387+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:25.704387+0000","last_undegraded":"2024-09-15T22:41:25.704387+0000","last_fullsized":"2024-09-15T22:41:25.704387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694866+0000","last_change":"2024-09-15T22:41:25.694866+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694866+0000","last_undegraded":"2024-09-15T22:41:25.694866+0000","last_fullsized":"2024-09-15T22:41:25.694866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704340+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:25.704340+0000","last_peered":"2024-09-15T22:41:25.704340+0000","last_clean":"2024-09-15T22:41:25.704340+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:25.704340+0000","last_undegraded":"2024-09-15T22:41:25.704340+0000","last_fullsized":"2024-09-15T22:41:25.704340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:29.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:29.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.764+0000 7fcd7861e640 1 Processor -- start 2024-09-15T22:41:29.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.764+0000 7fcd7861e640 1 -- start start 2024-09-15T22:41:29.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd7861e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7015c300 0x7fcd700affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd7861e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd7006f1e0 0x7fcd700ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd7861e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7015ecf0 con 0x7fcd700cd300 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd7861e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7015c6e0 con 0x7fcd7015c300 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd7861e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7015efb0 con 0x7fcd7006f1e0 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7015c300 0x7fcd700affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7015c300 0x7fcd700affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37140/0 (socket says 172.21.15.134:37140) 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 -- 172.21.15.134:0/3748341637 learned_addr learned my addr 172.21.15.134:0/3748341637 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd76bbb640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd7006f1e0 0x7fcd700ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 -- 172.21.15.134:0/3748341637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd7006f1e0 msgr2=0x7fcd700ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd7006f1e0 0x7fcd700ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 -- 172.21.15.134:0/3748341637 >> v1:172.21.15.177:6789/0 conn(0x7fcd700cd300 legacy=0x7fcd7006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:29.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.765+0000 7fcd763ba640 1 -- 172.21.15.134:0/3748341637 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7015f290 con 0x7fcd7015c300 2024-09-15T22:41:29.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd763ba640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7015c300 0x7fcd700affc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f33fddf1ffba66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd753b8640 1 -- 172.21.15.134:0/3748341637 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c037070 con 0x7fcd7015c300 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd753b8640 1 -- 172.21.15.134:0/3748341637 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c032440 con 0x7fcd7015c300 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd753b8640 1 -- 172.21.15.134:0/3748341637 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c032810 con 0x7fcd7015c300 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd7861e640 1 -- 172.21.15.134:0/3748341637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7015c300 msgr2=0x7fcd700affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.766+0000 7fcd7861e640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7015c300 0x7fcd700affc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c02a180 comp rx=0 tx=0).stop 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 -- 172.21.15.134:0/3748341637 shutdown_connections 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd7006f1e0 0x7fcd700ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 --2- 172.21.15.134:0/3748341637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7015c300 0x7fcd700affc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 -- 172.21.15.134:0/3748341637 >> 172.21.15.134:0/3748341637 conn(0x7fcd7006cae0 msgr2=0x7fcd7006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:29.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 -- 172.21.15.134:0/3748341637 shutdown_connections 2024-09-15T22:41:29.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.767+0000 7fcd7861e640 1 -- 172.21.15.134:0/3748341637 wait complete. 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 Processor -- start 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 -- start start 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 0x7fcd700cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 0x7fcd7015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70071880 con 0x7fcd7006f1e0 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7015f850 con 0x7fcd7015c300 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.768+0000 7fcd7861e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcd700b0500 con 0x7fcd700cd300 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37152/0 (socket says 172.21.15.134:37152) 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 -- 172.21.15.134:0/2122494342 learned_addr learned my addr 172.21.15.134:0/2122494342 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd76bbb640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 0x7fcd7015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd75bb9640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 0x7fcd700cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 -- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 msgr2=0x7fcd700cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 0x7fcd700cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 -- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 msgr2=0x7fcd7015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 0x7fcd7015acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 -- 172.21.15.134:0/2122494342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd700cf9c0 con 0x7fcd7006f1e0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd76bbb640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 0x7fcd7015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd75bb9640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 0x7fcd700cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd763ba640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c041070 con 0x7fcd7006f1e0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c03c870 con 0x7fcd7006f1e0 2024-09-15T22:41:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7015a210 con 0x7fcd7006f1e0 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c037040 con 0x7fcd7006f1e0 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.769+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd700ce550 con 0x7fcd7006f1e0 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.770+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd700b41f0 con 0x7fcd7006f1e0 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.771+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd6c044070 con 0x7fcd7006f1e0 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.771+0000 7fcd66ffd640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 0x7fcd5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:29.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.771+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcd6c0abe00 con 0x7fcd7006f1e0 2024-09-15T22:41:29.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.771+0000 7fcd75bb9640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 0x7fcd5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:29.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.771+0000 7fcd75bb9640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 0x7fcd5406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd701516f0 tx=0x7fcd60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.775+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd700b41f0 con 0x7fcd7006f1e0 2024-09-15T22:41:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.936+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd700cfca0 con 0x7fcd5406c2b0 2024-09-15T22:41:30.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.941+0000 7fcd66ffd640 1 -- 172.21.15.134:0/2122494342 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245599 (secure 0 0 0) 0x7fcd60053f70 con 0x7fcd5406c2b0 2024-09-15T22:41:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:30.029 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 msgr2=0x7fcd5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 0x7fcd5406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd701516f0 tx=0x7fcd60009040 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 msgr2=0x7fcd700cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 shutdown_connections 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcd5406c2b0 0x7fcd5406e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7015c300 0x7fcd7015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd700cd300 0x7fcd700cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 --2- 172.21.15.134:0/2122494342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd7006f1e0 0x7fcd700cd860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 >> 172.21.15.134:0/2122494342 conn(0x7fcd7006cae0 msgr2=0x7fcd700b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 shutdown_connections 2024-09-15T22:41:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:29.945+0000 7fcd7861e640 1 -- 172.21.15.134:0/2122494342 wait complete. 2024-09-15T22:41:30.033 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:41:28.948326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218940,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755780,"statfs":{"total":773094113280,"available":772869918720,"internally_reserved":0,"allocated":2772992,"data_stored":1682549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699129+0000","last_change":"2024-09-15T22:41:25.699129+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699129+0000","last_undegraded":"2024-09-15T22:41:25.699129+0000","last_fullsized":"2024-09-15T22:41:25.699129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696613+0000","last_change":"2024-09-15T22:41:25.696613+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696613+0000","last_undegraded":"2024-09-15T22:41:25.696613+0000","last_fullsized":"2024-09-15T22:41:25.696613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694311+0000","last_change":"2024-09-15T22:41:25.694311+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694311+0000","last_undegraded":"2024-09-15T22:41:25.694311+0000","last_fullsized":"2024-09-15T22:41:25.694311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700151+0000","last_change":"2024-09-15T22:41:25.700151+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700151+0000","last_undegraded":"2024-09-15T22:41:25.700151+0000","last_fullsized":"2024-09-15T22:41:25.700151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698964+0000","last_change":"2024-09-15T22:41:25.698964+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698964+0000","last_undegraded":"2024-09-15T22:41:25.698964+0000","last_fullsized":"2024-09-15T22:41:25.698964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699680+0000","last_change":"2024-09-15T22:41:25.699680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699680+0000","last_undegraded":"2024-09-15T22:41:25.699680+0000","last_fullsized":"2024-09-15T22:41:25.699680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697022+0000","last_change":"2024-09-15T22:41:25.697022+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697022+0000","last_undegraded":"2024-09-15T22:41:25.697022+0000","last_fullsized":"2024-09-15T22:41:25.697022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697196+0000","last_change":"2024-09-15T22:41:25.697196+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697196+0000","last_undegraded":"2024-09-15T22:41:25.697196+0000","last_fullsized":"2024-09-15T22:41:25.697196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697277+0000","last_change":"2024-09-15T22:41:25.697277+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697277+0000","last_undegraded":"2024-09-15T22:41:25.697277+0000","last_fullsized":"2024-09-15T22:41:25.697277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696465+0000","last_change":"2024-09-15T22:41:25.696465+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696465+0000","last_undegraded":"2024-09-15T22:41:25.696465+0000","last_fullsized":"2024-09-15T22:41:25.696465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698751+0000","last_change":"2024-09-15T22:41:25.698751+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698751+0000","last_undegraded":"2024-09-15T22:41:25.698751+0000","last_fullsized":"2024-09-15T22:41:25.698751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698507+0000","last_change":"2024-09-15T22:41:25.698507+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698507+0000","last_undegraded":"2024-09-15T22:41:25.698507+0000","last_fullsized":"2024-09-15T22:41:25.698507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693619+0000","last_change":"2024-09-15T22:41:25.693619+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693619+0000","last_undegraded":"2024-09-15T22:41:25.693619+0000","last_fullsized":"2024-09-15T22:41:25.693619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700807+0000","last_change":"2024-09-15T22:41:25.700807+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700807+0000","last_undegraded":"2024-09-15T22:41:25.700807+0000","last_fullsized":"2024-09-15T22:41:25.700807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699497+0000","last_change":"2024-09-15T22:41:25.699497+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699497+0000","last_undegraded":"2024-09-15T22:41:25.699497+0000","last_fullsized":"2024-09-15T22:41:25.699497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690757+0000","last_change":"2024-09-15T22:41:25.690757+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690757+0000","last_undegraded":"2024-09-15T22:41:25.690757+0000","last_fullsized":"2024-09-15T22:41:25.690757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700628+0000","last_change":"2024-09-15T22:41:25.700628+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700628+0000","last_undegraded":"2024-09-15T22:41:25.700628+0000","last_fullsized":"2024-09-15T22:41:25.700628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698121+0000","last_change":"2024-09-15T22:41:25.698121+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698121+0000","last_undegraded":"2024-09-15T22:41:25.698121+0000","last_fullsized":"2024-09-15T22:41:25.698121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689992+0000","last_change":"2024-09-15T22:41:25.689992+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689992+0000","last_undegraded":"2024-09-15T22:41:25.689992+0000","last_fullsized":"2024-09-15T22:41:25.689992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697731+0000","last_change":"2024-09-15T22:41:25.697731+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697731+0000","last_undegraded":"2024-09-15T22:41:25.697731+0000","last_fullsized":"2024-09-15T22:41:25.697731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690715+0000","last_change":"2024-09-15T22:41:25.690715+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690715+0000","last_undegraded":"2024-09-15T22:41:25.690715+0000","last_fullsized":"2024-09-15T22:41:25.690715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699348+0000","last_change":"2024-09-15T22:41:25.699348+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699348+0000","last_undegraded":"2024-09-15T22:41:25.699348+0000","last_fullsized":"2024-09-15T22:41:25.699348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694223+0000","last_change":"2024-09-15T22:41:25.694223+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694223+0000","last_undegraded":"2024-09-15T22:41:25.694223+0000","last_fullsized":"2024-09-15T22:41:25.694223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697971+0000","last_change":"2024-09-15T22:41:25.697971+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697971+0000","last_undegraded":"2024-09-15T22:41:25.697971+0000","last_fullsized":"2024-09-15T22:41:25.697971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692847+0000","last_change":"2024-09-15T22:41:25.692847+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692847+0000","last_undegraded":"2024-09-15T22:41:25.692847+0000","last_fullsized":"2024-09-15T22:41:25.692847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698069+0000","last_change":"2024-09-15T22:41:25.698069+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698069+0000","last_undegraded":"2024-09-15T22:41:25.698069+0000","last_fullsized":"2024-09-15T22:41:25.698069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690015+0000","last_change":"2024-09-15T22:41:25.690015+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690015+0000","last_undegraded":"2024-09-15T22:41:25.690015+0000","last_fullsized":"2024-09-15T22:41:25.690015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696397+0000","last_change":"2024-09-15T22:41:25.696397+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696397+0000","last_undegraded":"2024-09-15T22:41:25.696397+0000","last_fullsized":"2024-09-15T22:41:25.696397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697246+0000","last_change":"2024-09-15T22:41:25.697246+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697246+0000","last_undegraded":"2024-09-15T22:41:25.697246+0000","last_fullsized":"2024-09-15T22:41:25.697246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704375+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:25.704375+0000","last_peered":"2024-09-15T22:41:25.704375+0000","last_clean":"2024-09-15T22:41:25.704375+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:25.704375+0000","last_undegraded":"2024-09-15T22:41:25.704375+0000","last_fullsized":"2024-09-15T22:41:25.704375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.687895+0000","last_change":"2024-09-15T22:41:25.687895+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.687895+0000","last_undegraded":"2024-09-15T22:41:25.687895+0000","last_fullsized":"2024-09-15T22:41:25.687895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711960+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:25.711960+0000","last_peered":"2024-09-15T22:41:25.711960+0000","last_clean":"2024-09-15T22:41:25.711960+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:25.711960+0000","last_undegraded":"2024-09-15T22:41:25.711960+0000","last_fullsized":"2024-09-15T22:41:25.711960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695167+0000","last_change":"2024-09-15T22:41:25.695167+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695167+0000","last_undegraded":"2024-09-15T22:41:25.695167+0000","last_fullsized":"2024-09-15T22:41:25.695167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705855+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:25.705855+0000","last_peered":"2024-09-15T22:41:25.705855+0000","last_clean":"2024-09-15T22:41:25.705855+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:25.705855+0000","last_undegraded":"2024-09-15T22:41:25.705855+0000","last_fullsized":"2024-09-15T22:41:25.705855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689694+0000","last_change":"2024-09-15T22:41:25.689694+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689694+0000","last_undegraded":"2024-09-15T22:41:25.689694+0000","last_fullsized":"2024-09-15T22:41:25.689694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699217+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:25.699217+0000","last_peered":"2024-09-15T22:41:25.699217+0000","last_clean":"2024-09-15T22:41:25.699217+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:25.699217+0000","last_undegraded":"2024-09-15T22:41:25.699217+0000","last_fullsized":"2024-09-15T22:41:25.699217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697212+0000","last_change":"2024-09-15T22:41:25.697212+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697212+0000","last_undegraded":"2024-09-15T22:41:25.697212+0000","last_fullsized":"2024-09-15T22:41:25.697212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705593+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:25.705593+0000","last_peered":"2024-09-15T22:41:25.705593+0000","last_clean":"2024-09-15T22:41:25.705593+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:25.705593+0000","last_undegraded":"2024-09-15T22:41:25.705593+0000","last_fullsized":"2024-09-15T22:41:25.705593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692208+0000","last_change":"2024-09-15T22:41:25.692208+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692208+0000","last_undegraded":"2024-09-15T22:41:25.692208+0000","last_fullsized":"2024-09-15T22:41:25.692208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.703712+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:25.703712+0000","last_peered":"2024-09-15T22:41:25.703712+0000","last_clean":"2024-09-15T22:41:25.703712+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:25.703712+0000","last_undegraded":"2024-09-15T22:41:25.703712+0000","last_fullsized":"2024-09-15T22:41:25.703712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:57.173330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698721+0000","last_change":"2024-09-15T22:41:25.698721+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698721+0000","last_undegraded":"2024-09-15T22:41:25.698721+0000","last_fullsized":"2024-09-15T22:41:25.698721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.701757+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:25.701757+0000","last_peered":"2024-09-15T22:41:25.701757+0000","last_clean":"2024-09-15T22:41:25.701757+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:25.701757+0000","last_undegraded":"2024-09-15T22:41:25.701757+0000","last_fullsized":"2024-09-15T22:41:25.701757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695554+0000","last_change":"2024-09-15T22:41:25.695554+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695554+0000","last_undegraded":"2024-09-15T22:41:25.695554+0000","last_fullsized":"2024-09-15T22:41:25.695554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704200+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:25.704200+0000","last_peered":"2024-09-15T22:41:25.704200+0000","last_clean":"2024-09-15T22:41:25.704200+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:25.704200+0000","last_undegraded":"2024-09-15T22:41:25.704200+0000","last_fullsized":"2024-09-15T22:41:25.704200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711886+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:25.711886+0000","last_peered":"2024-09-15T22:41:25.711886+0000","last_clean":"2024-09-15T22:41:25.711886+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:25.711886+0000","last_undegraded":"2024-09-15T22:41:25.711886+0000","last_fullsized":"2024-09-15T22:41:25.711886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697199+0000","last_change":"2024-09-15T22:41:25.697199+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697199+0000","last_undegraded":"2024-09-15T22:41:25.697199+0000","last_fullsized":"2024-09-15T22:41:25.697199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709131+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:25.709131+0000","last_peered":"2024-09-15T22:41:25.709131+0000","last_clean":"2024-09-15T22:41:25.709131+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:25.709131+0000","last_undegraded":"2024-09-15T22:41:25.709131+0000","last_fullsized":"2024-09-15T22:41:25.709131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698179+0000","last_change":"2024-09-15T22:41:25.698179+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698179+0000","last_undegraded":"2024-09-15T22:41:25.698179+0000","last_fullsized":"2024-09-15T22:41:25.698179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699076+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:25.699076+0000","last_peered":"2024-09-15T22:41:25.699076+0000","last_clean":"2024-09-15T22:41:25.699076+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:25.699076+0000","last_undegraded":"2024-09-15T22:41:25.699076+0000","last_fullsized":"2024-09-15T22:41:25.699076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696580+0000","last_change":"2024-09-15T22:41:25.696580+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696580+0000","last_undegraded":"2024-09-15T22:41:25.696580+0000","last_fullsized":"2024-09-15T22:41:25.696580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711954+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:25.711954+0000","last_peered":"2024-09-15T22:41:25.711954+0000","last_clean":"2024-09-15T22:41:25.711954+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:25.711954+0000","last_undegraded":"2024-09-15T22:41:25.711954+0000","last_fullsized":"2024-09-15T22:41:25.711954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695861+0000","last_change":"2024-09-15T22:41:25.695861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695861+0000","last_undegraded":"2024-09-15T22:41:25.695861+0000","last_fullsized":"2024-09-15T22:41:25.695861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706487+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:25.706487+0000","last_peered":"2024-09-15T22:41:25.706487+0000","last_clean":"2024-09-15T22:41:25.706487+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:25.706487+0000","last_undegraded":"2024-09-15T22:41:25.706487+0000","last_fullsized":"2024-09-15T22:41:25.706487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695610+0000","last_change":"2024-09-15T22:41:25.695610+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695610+0000","last_undegraded":"2024-09-15T22:41:25.695610+0000","last_fullsized":"2024-09-15T22:41:25.695610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704618+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:25.704618+0000","last_peered":"2024-09-15T22:41:25.704618+0000","last_clean":"2024-09-15T22:41:25.704618+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:25.704618+0000","last_undegraded":"2024-09-15T22:41:25.704618+0000","last_fullsized":"2024-09-15T22:41:25.704618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695299+0000","last_change":"2024-09-15T22:41:25.695299+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695299+0000","last_undegraded":"2024-09-15T22:41:25.695299+0000","last_fullsized":"2024-09-15T22:41:25.695299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695606+0000","last_change":"2024-09-15T22:41:25.695606+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695606+0000","last_undegraded":"2024-09-15T22:41:25.695606+0000","last_fullsized":"2024-09-15T22:41:25.695606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.689317+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:25.689317+0000","last_peered":"2024-09-15T22:41:25.689317+0000","last_clean":"2024-09-15T22:41:25.689317+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:25.689317+0000","last_undegraded":"2024-09-15T22:41:25.689317+0000","last_fullsized":"2024-09-15T22:41:25.689317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705563+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:25.705563+0000","last_peered":"2024-09-15T22:41:25.705563+0000","last_clean":"2024-09-15T22:41:25.705563+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:25.705563+0000","last_undegraded":"2024-09-15T22:41:25.705563+0000","last_fullsized":"2024-09-15T22:41:25.705563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688860+0000","last_change":"2024-09-15T22:41:25.688860+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688860+0000","last_undegraded":"2024-09-15T22:41:25.688860+0000","last_fullsized":"2024-09-15T22:41:25.688860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705876+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:25.705876+0000","last_peered":"2024-09-15T22:41:25.705876+0000","last_clean":"2024-09-15T22:41:25.705876+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:25.705876+0000","last_undegraded":"2024-09-15T22:41:25.705876+0000","last_fullsized":"2024-09-15T22:41:25.705876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706571+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:25.706571+0000","last_peered":"2024-09-15T22:41:25.706571+0000","last_clean":"2024-09-15T22:41:25.706571+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:25.706571+0000","last_undegraded":"2024-09-15T22:41:25.706571+0000","last_fullsized":"2024-09-15T22:41:25.706571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696861+0000","last_change":"2024-09-15T22:41:25.696861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696861+0000","last_undegraded":"2024-09-15T22:41:25.696861+0000","last_fullsized":"2024-09-15T22:41:25.696861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705823+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:25.705823+0000","last_peered":"2024-09-15T22:41:25.705823+0000","last_clean":"2024-09-15T22:41:25.705823+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:25.705823+0000","last_undegraded":"2024-09-15T22:41:25.705823+0000","last_fullsized":"2024-09-15T22:41:25.705823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695972+0000","last_change":"2024-09-15T22:41:25.695972+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695972+0000","last_undegraded":"2024-09-15T22:41:25.695972+0000","last_fullsized":"2024-09-15T22:41:25.695972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704393+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:25.704393+0000","last_peered":"2024-09-15T22:41:25.704393+0000","last_clean":"2024-09-15T22:41:25.704393+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:25.704393+0000","last_undegraded":"2024-09-15T22:41:25.704393+0000","last_fullsized":"2024-09-15T22:41:25.704393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696098+0000","last_change":"2024-09-15T22:41:25.696098+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696098+0000","last_undegraded":"2024-09-15T22:41:25.696098+0000","last_fullsized":"2024-09-15T22:41:25.696098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705611+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:25.705611+0000","last_peered":"2024-09-15T22:41:25.705611+0000","last_clean":"2024-09-15T22:41:25.705611+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:25.705611+0000","last_undegraded":"2024-09-15T22:41:25.705611+0000","last_fullsized":"2024-09-15T22:41:25.705611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704193+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:25.704193+0000","last_peered":"2024-09-15T22:41:25.704193+0000","last_clean":"2024-09-15T22:41:25.704193+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:25.704193+0000","last_undegraded":"2024-09-15T22:41:25.704193+0000","last_fullsized":"2024-09-15T22:41:25.704193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688085+0000","last_change":"2024-09-15T22:41:25.688085+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688085+0000","last_undegraded":"2024-09-15T22:41:25.688085+0000","last_fullsized":"2024-09-15T22:41:25.688085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.717223+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:25.717223+0000","last_peered":"2024-09-15T22:41:25.717223+0000","last_clean":"2024-09-15T22:41:25.717223+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:25.717223+0000","last_undegraded":"2024-09-15T22:41:25.717223+0000","last_fullsized":"2024-09-15T22:41:25.717223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690406+0000","last_change":"2024-09-15T22:41:25.690406+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690406+0000","last_undegraded":"2024-09-15T22:41:25.690406+0000","last_fullsized":"2024-09-15T22:41:25.690406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709081+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:25.709081+0000","last_peered":"2024-09-15T22:41:25.709081+0000","last_clean":"2024-09-15T22:41:25.709081+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:25.709081+0000","last_undegraded":"2024-09-15T22:41:25.709081+0000","last_fullsized":"2024-09-15T22:41:25.709081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695061+0000","last_change":"2024-09-15T22:41:25.695061+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695061+0000","last_undegraded":"2024-09-15T22:41:25.695061+0000","last_fullsized":"2024-09-15T22:41:25.695061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704379+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:25.704379+0000","last_peered":"2024-09-15T22:41:25.704379+0000","last_clean":"2024-09-15T22:41:25.704379+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:25.704379+0000","last_undegraded":"2024-09-15T22:41:25.704379+0000","last_fullsized":"2024-09-15T22:41:25.704379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688783+0000","last_change":"2024-09-15T22:41:25.688783+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688783+0000","last_undegraded":"2024-09-15T22:41:25.688783+0000","last_fullsized":"2024-09-15T22:41:25.688783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689723+0000","last_change":"2024-09-15T22:41:25.689723+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689723+0000","last_undegraded":"2024-09-15T22:41:25.689723+0000","last_fullsized":"2024-09-15T22:41:25.689723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705586+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:25.705586+0000","last_peered":"2024-09-15T22:41:25.705586+0000","last_clean":"2024-09-15T22:41:25.705586+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:25.705586+0000","last_undegraded":"2024-09-15T22:41:25.705586+0000","last_fullsized":"2024-09-15T22:41:25.705586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696138+0000","last_change":"2024-09-15T22:41:25.696138+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696138+0000","last_undegraded":"2024-09-15T22:41:25.696138+0000","last_fullsized":"2024-09-15T22:41:25.696138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697680+0000","last_change":"2024-09-15T22:41:25.697680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697680+0000","last_undegraded":"2024-09-15T22:41:25.697680+0000","last_fullsized":"2024-09-15T22:41:25.697680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709114+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:25.709114+0000","last_peered":"2024-09-15T22:41:25.709114+0000","last_clean":"2024-09-15T22:41:25.709114+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:25.709114+0000","last_undegraded":"2024-09-15T22:41:25.709114+0000","last_fullsized":"2024-09-15T22:41:25.709114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697661+0000","last_change":"2024-09-15T22:41:25.697661+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697661+0000","last_undegraded":"2024-09-15T22:41:25.697661+0000","last_fullsized":"2024-09-15T22:41:25.697661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705565+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:25.705565+0000","last_peered":"2024-09-15T22:41:25.705565+0000","last_clean":"2024-09-15T22:41:25.705565+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:25.705565+0000","last_undegraded":"2024-09-15T22:41:25.705565+0000","last_fullsized":"2024-09-15T22:41:25.705565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693722+0000","last_change":"2024-09-15T22:41:25.693722+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693722+0000","last_undegraded":"2024-09-15T22:41:25.693722+0000","last_fullsized":"2024-09-15T22:41:25.693722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704387+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:25.704387+0000","last_peered":"2024-09-15T22:41:25.704387+0000","last_clean":"2024-09-15T22:41:25.704387+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:25.704387+0000","last_undegraded":"2024-09-15T22:41:25.704387+0000","last_fullsized":"2024-09-15T22:41:25.704387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694866+0000","last_change":"2024-09-15T22:41:25.694866+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694866+0000","last_undegraded":"2024-09-15T22:41:25.694866+0000","last_fullsized":"2024-09-15T22:41:25.694866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704340+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:25.704340+0000","last_peered":"2024-09-15T22:41:25.704340+0000","last_clean":"2024-09-15T22:41:25.704340+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:25.704340+0000","last_undegraded":"2024-09-15T22:41:25.704340+0000","last_fullsized":"2024-09-15T22:41:25.704340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:30.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:30.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.140+0000 7efc873b7640 1 Processor -- start 2024-09-15T22:41:30.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 -- start start 2024-09-15T22:41:30.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015e940 0x7efc800d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc800cef90 0x7efc800d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc800b7170 con 0x7efc8015ed20 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efc800d1ae0 con 0x7efc800cef90 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.141+0000 7efc873b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc800b7aa0 con 0x7efc8015e940 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc800cef90 0x7efc800d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc800cef90 0x7efc800d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37168/0 (socket says 172.21.15.134:37168) 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 -- 172.21.15.134:0/3206705278 learned_addr learned my addr 172.21.15.134:0/3206705278 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85153640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015e940 0x7efc800d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 -- 172.21.15.134:0/3206705278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015e940 msgr2=0x7efc800d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015e940 0x7efc800d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 -- 172.21.15.134:0/3206705278 >> v1:172.21.15.177:6789/0 conn(0x7efc8015ed20 legacy=0x7efc800b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.142+0000 7efc85954640 1 -- 172.21.15.134:0/3206705278 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc800d3660 con 0x7efc800cef90 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc85954640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc800d15a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc78009e50 tx=0x7efc7802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431ed61a2e9421d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc77fff640 1 -- 172.21.15.134:0/3206705278 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78036070 con 0x7efc800cef90 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc77fff640 1 -- 172.21.15.134:0/3206705278 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc78031600 con 0x7efc800cef90 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc77fff640 1 -- 172.21.15.134:0/3206705278 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780319d0 con 0x7efc800cef90 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 -- 172.21.15.134:0/3206705278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 msgr2=0x7efc800d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc800d15a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc78009e50 tx=0x7efc7802a7a0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 -- 172.21.15.134:0/3206705278 shutdown_connections 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc800d15a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 --2- 172.21.15.134:0/3206705278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015e940 0x7efc800d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 -- 172.21.15.134:0/3206705278 >> 172.21.15.134:0/3206705278 conn(0x7efc800b6240 msgr2=0x7efc800b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 -- 172.21.15.134:0/3206705278 shutdown_connections 2024-09-15T22:41:30.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.143+0000 7efc873b7640 1 -- 172.21.15.134:0/3206705278 wait complete. 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 Processor -- start 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 -- start start 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc8015e940 0x7efc80159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 0x7efc801597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc800d3f00 con 0x7efc800cef90 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc800d3c20 con 0x7efc8015e940 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc873b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc800d3310 con 0x7efc8015ed20 2024-09-15T22:41:30.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc85153640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc85153640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37182/0 (socket says 172.21.15.134:37182) 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.145+0000 7efc85153640 1 -- 172.21.15.134:0/454515724 learned_addr learned my addr 172.21.15.134:0/454515724 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85954640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 0x7efc801597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc84952640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc8015e940 0x7efc80159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 -- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 msgr2=0x7efc801597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 0x7efc801597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 -- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc8015e940 msgr2=0x7efc80159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc8015e940 0x7efc80159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 -- 172.21.15.134:0/454515724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80159ec0 con 0x7efc800cef90 2024-09-15T22:41:30.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85954640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 0x7efc801597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc85153640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00e9b0 tx=0x7efc7c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c017070 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c00c9a0 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c00cd90 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc800ce200 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.146+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc800cda00 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.147+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc8015a3a0 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.148+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc7c01a070 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.148+0000 7efc75ffb640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 0x7efc6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.148+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc7c08b410 con 0x7efc800cef90 2024-09-15T22:41:30.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.148+0000 7efc84952640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 0x7efc6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.149+0000 7efc84952640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 0x7efc6406e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc80158610 tx=0x7efc70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.152+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc8015a3a0 con 0x7efc800cef90 2024-09-15T22:41:30.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.314+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc800d1f80 con 0x7efc6406c2b0 2024-09-15T22:41:30.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.319+0000 7efc75ffb640 1 -- 172.21.15.134:0/454515724 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245599 (secure 0 0 0) 0x7efc800d1f80 con 0x7efc6406c2b0 2024-09-15T22:41:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:30.324 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 msgr2=0x7efc6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 0x7efc6406e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc80158610 tx=0x7efc70009040 comp rx=0 tx=0).stop 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 msgr2=0x7efc80158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00e9b0 tx=0x7efc7c00ee70 comp rx=0 tx=0).stop 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 shutdown_connections 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2b0 0x7efc6406e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc8015ed20 0x7efc801597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc8015e940 0x7efc80159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 --2- 172.21.15.134:0/454515724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc800cef90 0x7efc80158680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 >> 172.21.15.134:0/454515724 conn(0x7efc800b6240 msgr2=0x7efc800d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 shutdown_connections 2024-09-15T22:41:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.323+0000 7efc873b7640 1 -- 172.21.15.134:0/454515724 wait complete. 2024-09-15T22:41:30.335 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:41:28.948326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218940,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755780,"statfs":{"total":773094113280,"available":772869918720,"internally_reserved":0,"allocated":2772992,"data_stored":1682549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699129+0000","last_change":"2024-09-15T22:41:25.699129+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699129+0000","last_undegraded":"2024-09-15T22:41:25.699129+0000","last_fullsized":"2024-09-15T22:41:25.699129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696613+0000","last_change":"2024-09-15T22:41:25.696613+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696613+0000","last_undegraded":"2024-09-15T22:41:25.696613+0000","last_fullsized":"2024-09-15T22:41:25.696613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694311+0000","last_change":"2024-09-15T22:41:25.694311+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694311+0000","last_undegraded":"2024-09-15T22:41:25.694311+0000","last_fullsized":"2024-09-15T22:41:25.694311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700151+0000","last_change":"2024-09-15T22:41:25.700151+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700151+0000","last_undegraded":"2024-09-15T22:41:25.700151+0000","last_fullsized":"2024-09-15T22:41:25.700151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698964+0000","last_change":"2024-09-15T22:41:25.698964+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698964+0000","last_undegraded":"2024-09-15T22:41:25.698964+0000","last_fullsized":"2024-09-15T22:41:25.698964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699680+0000","last_change":"2024-09-15T22:41:25.699680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699680+0000","last_undegraded":"2024-09-15T22:41:25.699680+0000","last_fullsized":"2024-09-15T22:41:25.699680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697022+0000","last_change":"2024-09-15T22:41:25.697022+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697022+0000","last_undegraded":"2024-09-15T22:41:25.697022+0000","last_fullsized":"2024-09-15T22:41:25.697022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697196+0000","last_change":"2024-09-15T22:41:25.697196+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697196+0000","last_undegraded":"2024-09-15T22:41:25.697196+0000","last_fullsized":"2024-09-15T22:41:25.697196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697277+0000","last_change":"2024-09-15T22:41:25.697277+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697277+0000","last_undegraded":"2024-09-15T22:41:25.697277+0000","last_fullsized":"2024-09-15T22:41:25.697277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696465+0000","last_change":"2024-09-15T22:41:25.696465+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696465+0000","last_undegraded":"2024-09-15T22:41:25.696465+0000","last_fullsized":"2024-09-15T22:41:25.696465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698751+0000","last_change":"2024-09-15T22:41:25.698751+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698751+0000","last_undegraded":"2024-09-15T22:41:25.698751+0000","last_fullsized":"2024-09-15T22:41:25.698751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698507+0000","last_change":"2024-09-15T22:41:25.698507+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698507+0000","last_undegraded":"2024-09-15T22:41:25.698507+0000","last_fullsized":"2024-09-15T22:41:25.698507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693619+0000","last_change":"2024-09-15T22:41:25.693619+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693619+0000","last_undegraded":"2024-09-15T22:41:25.693619+0000","last_fullsized":"2024-09-15T22:41:25.693619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700807+0000","last_change":"2024-09-15T22:41:25.700807+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700807+0000","last_undegraded":"2024-09-15T22:41:25.700807+0000","last_fullsized":"2024-09-15T22:41:25.700807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699497+0000","last_change":"2024-09-15T22:41:25.699497+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699497+0000","last_undegraded":"2024-09-15T22:41:25.699497+0000","last_fullsized":"2024-09-15T22:41:25.699497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690757+0000","last_change":"2024-09-15T22:41:25.690757+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690757+0000","last_undegraded":"2024-09-15T22:41:25.690757+0000","last_fullsized":"2024-09-15T22:41:25.690757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700628+0000","last_change":"2024-09-15T22:41:25.700628+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700628+0000","last_undegraded":"2024-09-15T22:41:25.700628+0000","last_fullsized":"2024-09-15T22:41:25.700628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698121+0000","last_change":"2024-09-15T22:41:25.698121+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698121+0000","last_undegraded":"2024-09-15T22:41:25.698121+0000","last_fullsized":"2024-09-15T22:41:25.698121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689992+0000","last_change":"2024-09-15T22:41:25.689992+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689992+0000","last_undegraded":"2024-09-15T22:41:25.689992+0000","last_fullsized":"2024-09-15T22:41:25.689992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697731+0000","last_change":"2024-09-15T22:41:25.697731+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697731+0000","last_undegraded":"2024-09-15T22:41:25.697731+0000","last_fullsized":"2024-09-15T22:41:25.697731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690715+0000","last_change":"2024-09-15T22:41:25.690715+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690715+0000","last_undegraded":"2024-09-15T22:41:25.690715+0000","last_fullsized":"2024-09-15T22:41:25.690715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699348+0000","last_change":"2024-09-15T22:41:25.699348+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699348+0000","last_undegraded":"2024-09-15T22:41:25.699348+0000","last_fullsized":"2024-09-15T22:41:25.699348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694223+0000","last_change":"2024-09-15T22:41:25.694223+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694223+0000","last_undegraded":"2024-09-15T22:41:25.694223+0000","last_fullsized":"2024-09-15T22:41:25.694223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697971+0000","last_change":"2024-09-15T22:41:25.697971+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697971+0000","last_undegraded":"2024-09-15T22:41:25.697971+0000","last_fullsized":"2024-09-15T22:41:25.697971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692847+0000","last_change":"2024-09-15T22:41:25.692847+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692847+0000","last_undegraded":"2024-09-15T22:41:25.692847+0000","last_fullsized":"2024-09-15T22:41:25.692847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698069+0000","last_change":"2024-09-15T22:41:25.698069+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698069+0000","last_undegraded":"2024-09-15T22:41:25.698069+0000","last_fullsized":"2024-09-15T22:41:25.698069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690015+0000","last_change":"2024-09-15T22:41:25.690015+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690015+0000","last_undegraded":"2024-09-15T22:41:25.690015+0000","last_fullsized":"2024-09-15T22:41:25.690015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696397+0000","last_change":"2024-09-15T22:41:25.696397+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696397+0000","last_undegraded":"2024-09-15T22:41:25.696397+0000","last_fullsized":"2024-09-15T22:41:25.696397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697246+0000","last_change":"2024-09-15T22:41:25.697246+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697246+0000","last_undegraded":"2024-09-15T22:41:25.697246+0000","last_fullsized":"2024-09-15T22:41:25.697246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704375+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:25.704375+0000","last_peered":"2024-09-15T22:41:25.704375+0000","last_clean":"2024-09-15T22:41:25.704375+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:25.704375+0000","last_undegraded":"2024-09-15T22:41:25.704375+0000","last_fullsized":"2024-09-15T22:41:25.704375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.687895+0000","last_change":"2024-09-15T22:41:25.687895+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.687895+0000","last_undegraded":"2024-09-15T22:41:25.687895+0000","last_fullsized":"2024-09-15T22:41:25.687895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711960+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:25.711960+0000","last_peered":"2024-09-15T22:41:25.711960+0000","last_clean":"2024-09-15T22:41:25.711960+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:25.711960+0000","last_undegraded":"2024-09-15T22:41:25.711960+0000","last_fullsized":"2024-09-15T22:41:25.711960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695167+0000","last_change":"2024-09-15T22:41:25.695167+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695167+0000","last_undegraded":"2024-09-15T22:41:25.695167+0000","last_fullsized":"2024-09-15T22:41:25.695167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705855+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:25.705855+0000","last_peered":"2024-09-15T22:41:25.705855+0000","last_clean":"2024-09-15T22:41:25.705855+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:25.705855+0000","last_undegraded":"2024-09-15T22:41:25.705855+0000","last_fullsized":"2024-09-15T22:41:25.705855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689694+0000","last_change":"2024-09-15T22:41:25.689694+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689694+0000","last_undegraded":"2024-09-15T22:41:25.689694+0000","last_fullsized":"2024-09-15T22:41:25.689694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699217+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:25.699217+0000","last_peered":"2024-09-15T22:41:25.699217+0000","last_clean":"2024-09-15T22:41:25.699217+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:25.699217+0000","last_undegraded":"2024-09-15T22:41:25.699217+0000","last_fullsized":"2024-09-15T22:41:25.699217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697212+0000","last_change":"2024-09-15T22:41:25.697212+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697212+0000","last_undegraded":"2024-09-15T22:41:25.697212+0000","last_fullsized":"2024-09-15T22:41:25.697212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705593+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:25.705593+0000","last_peered":"2024-09-15T22:41:25.705593+0000","last_clean":"2024-09-15T22:41:25.705593+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:25.705593+0000","last_undegraded":"2024-09-15T22:41:25.705593+0000","last_fullsized":"2024-09-15T22:41:25.705593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692208+0000","last_change":"2024-09-15T22:41:25.692208+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692208+0000","last_undegraded":"2024-09-15T22:41:25.692208+0000","last_fullsized":"2024-09-15T22:41:25.692208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.703712+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:25.703712+0000","last_peered":"2024-09-15T22:41:25.703712+0000","last_clean":"2024-09-15T22:41:25.703712+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:25.703712+0000","last_undegraded":"2024-09-15T22:41:25.703712+0000","last_fullsized":"2024-09-15T22:41:25.703712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:57.173330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698721+0000","last_change":"2024-09-15T22:41:25.698721+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698721+0000","last_undegraded":"2024-09-15T22:41:25.698721+0000","last_fullsized":"2024-09-15T22:41:25.698721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.701757+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:25.701757+0000","last_peered":"2024-09-15T22:41:25.701757+0000","last_clean":"2024-09-15T22:41:25.701757+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:25.701757+0000","last_undegraded":"2024-09-15T22:41:25.701757+0000","last_fullsized":"2024-09-15T22:41:25.701757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695554+0000","last_change":"2024-09-15T22:41:25.695554+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695554+0000","last_undegraded":"2024-09-15T22:41:25.695554+0000","last_fullsized":"2024-09-15T22:41:25.695554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704200+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:25.704200+0000","last_peered":"2024-09-15T22:41:25.704200+0000","last_clean":"2024-09-15T22:41:25.704200+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:25.704200+0000","last_undegraded":"2024-09-15T22:41:25.704200+0000","last_fullsized":"2024-09-15T22:41:25.704200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711886+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:25.711886+0000","last_peered":"2024-09-15T22:41:25.711886+0000","last_clean":"2024-09-15T22:41:25.711886+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:25.711886+0000","last_undegraded":"2024-09-15T22:41:25.711886+0000","last_fullsized":"2024-09-15T22:41:25.711886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697199+0000","last_change":"2024-09-15T22:41:25.697199+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697199+0000","last_undegraded":"2024-09-15T22:41:25.697199+0000","last_fullsized":"2024-09-15T22:41:25.697199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709131+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:25.709131+0000","last_peered":"2024-09-15T22:41:25.709131+0000","last_clean":"2024-09-15T22:41:25.709131+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:25.709131+0000","last_undegraded":"2024-09-15T22:41:25.709131+0000","last_fullsized":"2024-09-15T22:41:25.709131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698179+0000","last_change":"2024-09-15T22:41:25.698179+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698179+0000","last_undegraded":"2024-09-15T22:41:25.698179+0000","last_fullsized":"2024-09-15T22:41:25.698179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699076+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:25.699076+0000","last_peered":"2024-09-15T22:41:25.699076+0000","last_clean":"2024-09-15T22:41:25.699076+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:25.699076+0000","last_undegraded":"2024-09-15T22:41:25.699076+0000","last_fullsized":"2024-09-15T22:41:25.699076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696580+0000","last_change":"2024-09-15T22:41:25.696580+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696580+0000","last_undegraded":"2024-09-15T22:41:25.696580+0000","last_fullsized":"2024-09-15T22:41:25.696580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711954+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:25.711954+0000","last_peered":"2024-09-15T22:41:25.711954+0000","last_clean":"2024-09-15T22:41:25.711954+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:25.711954+0000","last_undegraded":"2024-09-15T22:41:25.711954+0000","last_fullsized":"2024-09-15T22:41:25.711954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695861+0000","last_change":"2024-09-15T22:41:25.695861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695861+0000","last_undegraded":"2024-09-15T22:41:25.695861+0000","last_fullsized":"2024-09-15T22:41:25.695861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706487+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:25.706487+0000","last_peered":"2024-09-15T22:41:25.706487+0000","last_clean":"2024-09-15T22:41:25.706487+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:25.706487+0000","last_undegraded":"2024-09-15T22:41:25.706487+0000","last_fullsized":"2024-09-15T22:41:25.706487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695610+0000","last_change":"2024-09-15T22:41:25.695610+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695610+0000","last_undegraded":"2024-09-15T22:41:25.695610+0000","last_fullsized":"2024-09-15T22:41:25.695610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704618+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:25.704618+0000","last_peered":"2024-09-15T22:41:25.704618+0000","last_clean":"2024-09-15T22:41:25.704618+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:25.704618+0000","last_undegraded":"2024-09-15T22:41:25.704618+0000","last_fullsized":"2024-09-15T22:41:25.704618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695299+0000","last_change":"2024-09-15T22:41:25.695299+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695299+0000","last_undegraded":"2024-09-15T22:41:25.695299+0000","last_fullsized":"2024-09-15T22:41:25.695299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695606+0000","last_change":"2024-09-15T22:41:25.695606+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695606+0000","last_undegraded":"2024-09-15T22:41:25.695606+0000","last_fullsized":"2024-09-15T22:41:25.695606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.689317+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:25.689317+0000","last_peered":"2024-09-15T22:41:25.689317+0000","last_clean":"2024-09-15T22:41:25.689317+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:25.689317+0000","last_undegraded":"2024-09-15T22:41:25.689317+0000","last_fullsized":"2024-09-15T22:41:25.689317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705563+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:25.705563+0000","last_peered":"2024-09-15T22:41:25.705563+0000","last_clean":"2024-09-15T22:41:25.705563+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:25.705563+0000","last_undegraded":"2024-09-15T22:41:25.705563+0000","last_fullsized":"2024-09-15T22:41:25.705563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688860+0000","last_change":"2024-09-15T22:41:25.688860+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688860+0000","last_undegraded":"2024-09-15T22:41:25.688860+0000","last_fullsized":"2024-09-15T22:41:25.688860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705876+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:25.705876+0000","last_peered":"2024-09-15T22:41:25.705876+0000","last_clean":"2024-09-15T22:41:25.705876+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:25.705876+0000","last_undegraded":"2024-09-15T22:41:25.705876+0000","last_fullsized":"2024-09-15T22:41:25.705876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706571+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:25.706571+0000","last_peered":"2024-09-15T22:41:25.706571+0000","last_clean":"2024-09-15T22:41:25.706571+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:25.706571+0000","last_undegraded":"2024-09-15T22:41:25.706571+0000","last_fullsized":"2024-09-15T22:41:25.706571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696861+0000","last_change":"2024-09-15T22:41:25.696861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696861+0000","last_undegraded":"2024-09-15T22:41:25.696861+0000","last_fullsized":"2024-09-15T22:41:25.696861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705823+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:25.705823+0000","last_peered":"2024-09-15T22:41:25.705823+0000","last_clean":"2024-09-15T22:41:25.705823+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:25.705823+0000","last_undegraded":"2024-09-15T22:41:25.705823+0000","last_fullsized":"2024-09-15T22:41:25.705823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695972+0000","last_change":"2024-09-15T22:41:25.695972+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695972+0000","last_undegraded":"2024-09-15T22:41:25.695972+0000","last_fullsized":"2024-09-15T22:41:25.695972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704393+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:25.704393+0000","last_peered":"2024-09-15T22:41:25.704393+0000","last_clean":"2024-09-15T22:41:25.704393+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:25.704393+0000","last_undegraded":"2024-09-15T22:41:25.704393+0000","last_fullsized":"2024-09-15T22:41:25.704393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696098+0000","last_change":"2024-09-15T22:41:25.696098+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696098+0000","last_undegraded":"2024-09-15T22:41:25.696098+0000","last_fullsized":"2024-09-15T22:41:25.696098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705611+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:25.705611+0000","last_peered":"2024-09-15T22:41:25.705611+0000","last_clean":"2024-09-15T22:41:25.705611+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:25.705611+0000","last_undegraded":"2024-09-15T22:41:25.705611+0000","last_fullsized":"2024-09-15T22:41:25.705611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:25.679081+0000","last_change":"2024-09-15T22:41:25.679081+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.679081+0000","last_undegraded":"2024-09-15T22:41:25.679081+0000","last_fullsized":"2024-09-15T22:41:25.679081+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704193+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:25.704193+0000","last_peered":"2024-09-15T22:41:25.704193+0000","last_clean":"2024-09-15T22:41:25.704193+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:25.704193+0000","last_undegraded":"2024-09-15T22:41:25.704193+0000","last_fullsized":"2024-09-15T22:41:25.704193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688085+0000","last_change":"2024-09-15T22:41:25.688085+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688085+0000","last_undegraded":"2024-09-15T22:41:25.688085+0000","last_fullsized":"2024-09-15T22:41:25.688085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.717223+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:25.717223+0000","last_peered":"2024-09-15T22:41:25.717223+0000","last_clean":"2024-09-15T22:41:25.717223+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:25.717223+0000","last_undegraded":"2024-09-15T22:41:25.717223+0000","last_fullsized":"2024-09-15T22:41:25.717223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690406+0000","last_change":"2024-09-15T22:41:25.690406+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690406+0000","last_undegraded":"2024-09-15T22:41:25.690406+0000","last_fullsized":"2024-09-15T22:41:25.690406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709081+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:25.709081+0000","last_peered":"2024-09-15T22:41:25.709081+0000","last_clean":"2024-09-15T22:41:25.709081+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:25.709081+0000","last_undegraded":"2024-09-15T22:41:25.709081+0000","last_fullsized":"2024-09-15T22:41:25.709081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695061+0000","last_change":"2024-09-15T22:41:25.695061+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695061+0000","last_undegraded":"2024-09-15T22:41:25.695061+0000","last_fullsized":"2024-09-15T22:41:25.695061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704379+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:25.704379+0000","last_peered":"2024-09-15T22:41:25.704379+0000","last_clean":"2024-09-15T22:41:25.704379+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:25.704379+0000","last_undegraded":"2024-09-15T22:41:25.704379+0000","last_fullsized":"2024-09-15T22:41:25.704379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688783+0000","last_change":"2024-09-15T22:41:25.688783+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688783+0000","last_undegraded":"2024-09-15T22:41:25.688783+0000","last_fullsized":"2024-09-15T22:41:25.688783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:41:24.671390+0000","last_change":"2024-09-15T22:41:24.671390+0000","last_active":"2024-09-15T22:41:24.671390+0000","last_peered":"2024-09-15T22:41:24.671390+0000","last_clean":"2024-09-15T22:41:24.671390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:24.671390+0000","last_undegraded":"2024-09-15T22:41:24.671390+0000","last_fullsized":"2024-09-15T22:41:24.671390+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689723+0000","last_change":"2024-09-15T22:41:25.689723+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689723+0000","last_undegraded":"2024-09-15T22:41:25.689723+0000","last_fullsized":"2024-09-15T22:41:25.689723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705586+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:25.705586+0000","last_peered":"2024-09-15T22:41:25.705586+0000","last_clean":"2024-09-15T22:41:25.705586+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:25.705586+0000","last_undegraded":"2024-09-15T22:41:25.705586+0000","last_fullsized":"2024-09-15T22:41:25.705586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696138+0000","last_change":"2024-09-15T22:41:25.696138+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696138+0000","last_undegraded":"2024-09-15T22:41:25.696138+0000","last_fullsized":"2024-09-15T22:41:25.696138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697680+0000","last_change":"2024-09-15T22:41:25.697680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697680+0000","last_undegraded":"2024-09-15T22:41:25.697680+0000","last_fullsized":"2024-09-15T22:41:25.697680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709114+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:25.709114+0000","last_peered":"2024-09-15T22:41:25.709114+0000","last_clean":"2024-09-15T22:41:25.709114+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:25.709114+0000","last_undegraded":"2024-09-15T22:41:25.709114+0000","last_fullsized":"2024-09-15T22:41:25.709114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697661+0000","last_change":"2024-09-15T22:41:25.697661+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697661+0000","last_undegraded":"2024-09-15T22:41:25.697661+0000","last_fullsized":"2024-09-15T22:41:25.697661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705565+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:25.705565+0000","last_peered":"2024-09-15T22:41:25.705565+0000","last_clean":"2024-09-15T22:41:25.705565+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:25.705565+0000","last_undegraded":"2024-09-15T22:41:25.705565+0000","last_fullsized":"2024-09-15T22:41:25.705565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693722+0000","last_change":"2024-09-15T22:41:25.693722+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693722+0000","last_undegraded":"2024-09-15T22:41:25.693722+0000","last_fullsized":"2024-09-15T22:41:25.693722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704387+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:25.704387+0000","last_peered":"2024-09-15T22:41:25.704387+0000","last_clean":"2024-09-15T22:41:25.704387+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:25.704387+0000","last_undegraded":"2024-09-15T22:41:25.704387+0000","last_fullsized":"2024-09-15T22:41:25.704387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694866+0000","last_change":"2024-09-15T22:41:25.694866+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694866+0000","last_undegraded":"2024-09-15T22:41:25.694866+0000","last_fullsized":"2024-09-15T22:41:25.694866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704340+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:25.704340+0000","last_peered":"2024-09-15T22:41:25.704340+0000","last_clean":"2024-09-15T22:41:25.704340+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:25.704340+0000","last_undegraded":"2024-09-15T22:41:25.704340+0000","last_fullsized":"2024-09-15T22:41:25.704340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.699129+0000', 'last_change': '2024-09-15T22:41:25.699129+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.699129+0000', 'last_undegraded': '2024-09-15T22:41:25.699129+0000', 'last_fullsized': '2024-09-15T22:41:25.699129+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696613+0000', 'last_change': '2024-09-15T22:41:25.696613+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696613+0000', 'last_undegraded': '2024-09-15T22:41:25.696613+0000', 'last_fullsized': '2024-09-15T22:41:25.696613+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.694311+0000', 'last_change': '2024-09-15T22:41:25.694311+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.694311+0000', 'last_undegraded': '2024-09-15T22:41:25.694311+0000', 'last_fullsized': '2024-09-15T22:41:25.694311+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.339 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.700151+0000', 'last_change': '2024-09-15T22:41:25.700151+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.700151+0000', 'last_undegraded': '2024-09-15T22:41:25.700151+0000', 'last_fullsized': '2024-09-15T22:41:25.700151+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698964+0000', 'last_change': '2024-09-15T22:41:25.698964+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698964+0000', 'last_undegraded': '2024-09-15T22:41:25.698964+0000', 'last_fullsized': '2024-09-15T22:41:25.698964+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.699680+0000', 'last_change': '2024-09-15T22:41:25.699680+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.699680+0000', 'last_undegraded': '2024-09-15T22:41:25.699680+0000', 'last_fullsized': '2024-09-15T22:41:25.699680+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-15T22:41:30.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697022+0000', 'last_change': '2024-09-15T22:41:25.697022+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697022+0000', 'last_undegraded': '2024-09-15T22:41:25.697022+0000', 'last_fullsized': '2024-09-15T22:41:25.697022+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697196+0000', 'last_change': '2024-09-15T22:41:25.697196+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697196+0000', 'last_undegraded': '2024-09-15T22:41:25.697196+0000', 'last_fullsized': '2024-09-15T22:41:25.697196+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697277+0000', 'last_change': '2024-09-15T22:41:25.697277+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697277+0000', 'last_undegraded': '2024-09-15T22:41:25.697277+0000', 'last_fullsized': '2024-09-15T22:41:25.697277+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696465+0000', 'last_change': '2024-09-15T22:41:25.696465+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696465+0000', 'last_undegraded': '2024-09-15T22:41:25.696465+0000', 'last_fullsized': '2024-09-15T22:41:25.696465+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698751+0000', 'last_change': '2024-09-15T22:41:25.698751+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698751+0000', 'last_undegraded': '2024-09-15T22:41:25.698751+0000', 'last_fullsized': '2024-09-15T22:41:25.698751+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698507+0000', 'last_change': '2024-09-15T22:41:25.698507+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698507+0000', 'last_undegraded': '2024-09-15T22:41:25.698507+0000', 'last_fullsized': '2024-09-15T22:41:25.698507+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-15T22:41:30.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.693619+0000', 'last_change': '2024-09-15T22:41:25.693619+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.693619+0000', 'last_undegraded': '2024-09-15T22:41:25.693619+0000', 'last_fullsized': '2024-09-15T22:41:25.693619+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.700807+0000', 'last_change': '2024-09-15T22:41:25.700807+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.700807+0000', 'last_undegraded': '2024-09-15T22:41:25.700807+0000', 'last_fullsized': '2024-09-15T22:41:25.700807+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.699497+0000', 'last_change': '2024-09-15T22:41:25.699497+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.699497+0000', 'last_undegraded': '2024-09-15T22:41:25.699497+0000', 'last_fullsized': '2024-09-15T22:41:25.699497+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.690757+0000', 'last_change': '2024-09-15T22:41:25.690757+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.690757+0000', 'last_undegraded': '2024-09-15T22:41:25.690757+0000', 'last_fullsized': '2024-09-15T22:41:25.690757+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:41:30.342 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.700628+0000', 'last_change': '2024-09-15T22:41:25.700628+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.700628+0000', 'last_undegraded': '2024-09-15T22:41:25.700628+0000', 'last_fullsized': '2024-09-15T22:41:25.700628+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698121+0000', 'last_change': '2024-09-15T22:41:25.698121+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698121+0000', 'last_undegraded': '2024-09-15T22:41:25.698121+0000', 'last_fullsized': '2024-09-15T22:41:25.698121+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.689992+0000', 'last_change': '2024-09-15T22:41:25.689992+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.689992+0000', 'last_undegraded': '2024-09-15T22:41:25.689992+0000', 'last_fullsized': '2024-09-15T22:41:25.689992+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697731+0000', 'last_change': '2024-09-15T22:41:25.697731+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697731+0000', 'last_undegraded': '2024-09-15T22:41:25.697731+0000', 'last_fullsized': '2024-09-15T22:41:25.697731+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:41:30.343 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.690715+0000', 'last_change': '2024-09-15T22:41:25.690715+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.690715+0000', 'last_undegraded': '2024-09-15T22:41:25.690715+0000', 'last_fullsized': '2024-09-15T22:41:25.690715+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.699348+0000', 'last_change': '2024-09-15T22:41:25.699348+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.699348+0000', 'last_undegraded': '2024-09-15T22:41:25.699348+0000', 'last_fullsized': '2024-09-15T22:41:25.699348+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.694223+0000', 'last_change': '2024-09-15T22:41:25.694223+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.694223+0000', 'last_undegraded': '2024-09-15T22:41:25.694223+0000', 'last_fullsized': '2024-09-15T22:41:25.694223+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697971+0000', 'last_change': '2024-09-15T22:41:25.697971+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697971+0000', 'last_undegraded': '2024-09-15T22:41:25.697971+0000', 'last_fullsized': '2024-09-15T22:41:25.697971+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-15T22:41:30.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.692847+0000', 'last_change': '2024-09-15T22:41:25.692847+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.692847+0000', 'last_undegraded': '2024-09-15T22:41:25.692847+0000', 'last_fullsized': '2024-09-15T22:41:25.692847+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698069+0000', 'last_change': '2024-09-15T22:41:25.698069+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698069+0000', 'last_undegraded': '2024-09-15T22:41:25.698069+0000', 'last_fullsized': '2024-09-15T22:41:25.698069+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.690015+0000', 'last_change': '2024-09-15T22:41:25.690015+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.690015+0000', 'last_undegraded': '2024-09-15T22:41:25.690015+0000', 'last_fullsized': '2024-09-15T22:41:25.690015+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696397+0000', 'last_change': '2024-09-15T22:41:25.696397+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696397+0000', 'last_undegraded': '2024-09-15T22:41:25.696397+0000', 'last_fullsized': '2024-09-15T22:41:25.696397+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697246+0000', 'last_change': '2024-09-15T22:41:25.697246+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697246+0000', 'last_undegraded': '2024-09-15T22:41:25.697246+0000', 'last_fullsized': '2024-09-15T22:41:25.697246+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:41:30.345 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.687895+0000', 'last_change': '2024-09-15T22:41:25.687895+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.687895+0000', 'last_undegraded': '2024-09-15T22:41:25.687895+0000', 'last_fullsized': '2024-09-15T22:41:25.687895+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:24.671390+0000', 'last_change': '2024-09-15T22:41:24.671390+0000', 'last_active': '2024-09-15T22:41:24.671390+0000', 'last_peered': '2024-09-15T22:41:24.671390+0000', 'last_clean': '2024-09-15T22:41:24.671390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:24.671390+0000', 'last_undegraded': '2024-09-15T22:41:24.671390+0000', 'last_fullsized': '2024-09-15T22:41:24.671390+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695167+0000', 'last_change': '2024-09-15T22:41:25.695167+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695167+0000', 'last_undegraded': '2024-09-15T22:41:25.695167+0000', 'last_fullsized': '2024-09-15T22:41:25.695167+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.689694+0000', 'last_change': '2024-09-15T22:41:25.689694+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.689694+0000', 'last_undegraded': '2024-09-15T22:41:25.689694+0000', 'last_fullsized': '2024-09-15T22:41:25.689694+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697212+0000', 'last_change': '2024-09-15T22:41:25.697212+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697212+0000', 'last_undegraded': '2024-09-15T22:41:25.697212+0000', 'last_fullsized': '2024-09-15T22:41:25.697212+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-15T22:41:30.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.692208+0000', 'last_change': '2024-09-15T22:41:25.692208+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.692208+0000', 'last_undegraded': '2024-09-15T22:41:25.692208+0000', 'last_fullsized': '2024-09-15T22:41:25.692208+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698721+0000', 'last_change': '2024-09-15T22:41:25.698721+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698721+0000', 'last_undegraded': '2024-09-15T22:41:25.698721+0000', 'last_fullsized': '2024-09-15T22:41:25.698721+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695554+0000', 'last_change': '2024-09-15T22:41:25.695554+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695554+0000', 'last_undegraded': '2024-09-15T22:41:25.695554+0000', 'last_fullsized': '2024-09-15T22:41:25.695554+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697199+0000', 'last_change': '2024-09-15T22:41:25.697199+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697199+0000', 'last_undegraded': '2024-09-15T22:41:25.697199+0000', 'last_fullsized': '2024-09-15T22:41:25.697199+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.698179+0000', 'last_change': '2024-09-15T22:41:25.698179+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.698179+0000', 'last_undegraded': '2024-09-15T22:41:25.698179+0000', 'last_fullsized': '2024-09-15T22:41:25.698179+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:41:30.347 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-15T22:41:30.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696580+0000', 'last_change': '2024-09-15T22:41:25.696580+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696580+0000', 'last_undegraded': '2024-09-15T22:41:25.696580+0000', 'last_fullsized': '2024-09-15T22:41:25.696580+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695861+0000', 'last_change': '2024-09-15T22:41:25.695861+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695861+0000', 'last_undegraded': '2024-09-15T22:41:25.695861+0000', 'last_fullsized': '2024-09-15T22:41:25.695861+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695610+0000', 'last_change': '2024-09-15T22:41:25.695610+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695610+0000', 'last_undegraded': '2024-09-15T22:41:25.695610+0000', 'last_fullsized': '2024-09-15T22:41:25.695610+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695299+0000', 'last_change': '2024-09-15T22:41:25.695299+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695299+0000', 'last_undegraded': '2024-09-15T22:41:25.695299+0000', 'last_fullsized': '2024-09-15T22:41:25.695299+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:24.671390+0000', 'last_change': '2024-09-15T22:41:24.671390+0000', 'last_active': '2024-09-15T22:41:24.671390+0000', 'last_peered': '2024-09-15T22:41:24.671390+0000', 'last_clean': '2024-09-15T22:41:24.671390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:24.671390+0000', 'last_undegraded': '2024-09-15T22:41:24.671390+0000', 'last_fullsized': '2024-09-15T22:41:24.671390+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-15T22:41:30.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695606+0000', 'last_change': '2024-09-15T22:41:25.695606+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695606+0000', 'last_undegraded': '2024-09-15T22:41:25.695606+0000', 'last_fullsized': '2024-09-15T22:41:25.695606+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.350 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-15T22:41:30.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.688860+0000', 'last_change': '2024-09-15T22:41:25.688860+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.688860+0000', 'last_undegraded': '2024-09-15T22:41:25.688860+0000', 'last_fullsized': '2024-09-15T22:41:25.688860+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.350 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696861+0000', 'last_change': '2024-09-15T22:41:25.696861+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696861+0000', 'last_undegraded': '2024-09-15T22:41:25.696861+0000', 'last_fullsized': '2024-09-15T22:41:25.696861+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695972+0000', 'last_change': '2024-09-15T22:41:25.695972+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695972+0000', 'last_undegraded': '2024-09-15T22:41:25.695972+0000', 'last_fullsized': '2024-09-15T22:41:25.695972+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-15T22:41:30.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696098+0000', 'last_change': '2024-09-15T22:41:25.696098+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696098+0000', 'last_undegraded': '2024-09-15T22:41:25.696098+0000', 'last_fullsized': '2024-09-15T22:41:25.696098+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:41:30.352 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:25.679081+0000', 'last_change': '2024-09-15T22:41:25.679081+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.679081+0000', 'last_undegraded': '2024-09-15T22:41:25.679081+0000', 'last_fullsized': '2024-09-15T22:41:25.679081+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.688085+0000', 'last_change': '2024-09-15T22:41:25.688085+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.688085+0000', 'last_undegraded': '2024-09-15T22:41:25.688085+0000', 'last_fullsized': '2024-09-15T22:41:25.688085+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.690406+0000', 'last_change': '2024-09-15T22:41:25.690406+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.690406+0000', 'last_undegraded': '2024-09-15T22:41:25.690406+0000', 'last_fullsized': '2024-09-15T22:41:25.690406+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.695061+0000', 'last_change': '2024-09-15T22:41:25.695061+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.695061+0000', 'last_undegraded': '2024-09-15T22:41:25.695061+0000', 'last_fullsized': '2024-09-15T22:41:25.695061+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.688783+0000', 'last_change': '2024-09-15T22:41:25.688783+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.688783+0000', 'last_undegraded': '2024-09-15T22:41:25.688783+0000', 'last_fullsized': '2024-09-15T22:41:25.688783+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:41:30.353 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:41:24.671390+0000', 'last_change': '2024-09-15T22:41:24.671390+0000', 'last_active': '2024-09-15T22:41:24.671390+0000', 'last_peered': '2024-09-15T22:41:24.671390+0000', 'last_clean': '2024-09-15T22:41:24.671390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:24.671390+0000', 'last_undegraded': '2024-09-15T22:41:24.671390+0000', 'last_fullsized': '2024-09-15T22:41:24.671390+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:24.671390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.689723+0000', 'last_change': '2024-09-15T22:41:25.689723+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.689723+0000', 'last_undegraded': '2024-09-15T22:41:25.689723+0000', 'last_fullsized': '2024-09-15T22:41:25.689723+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.696138+0000', 'last_change': '2024-09-15T22:41:25.696138+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.696138+0000', 'last_undegraded': '2024-09-15T22:41:25.696138+0000', 'last_fullsized': '2024-09-15T22:41:25.696138+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697680+0000', 'last_change': '2024-09-15T22:41:25.697680+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697680+0000', 'last_undegraded': '2024-09-15T22:41:25.697680+0000', 'last_fullsized': '2024-09-15T22:41:25.697680+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.697661+0000', 'last_change': '2024-09-15T22:41:25.697661+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.697661+0000', 'last_undegraded': '2024-09-15T22:41:25.697661+0000', 'last_fullsized': '2024-09-15T22:41:25.697661+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-15T22:41:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.693722+0000', 'last_change': '2024-09-15T22:41:25.693722+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.693722+0000', 'last_undegraded': '2024-09-15T22:41:25.693722+0000', 'last_fullsized': '2024-09-15T22:41:25.693722+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.355 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-15T22:41:30.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:41:25.694866+0000', 'last_change': '2024-09-15T22:41:25.694866+0000', 'last_active': '2024-09-15T22:41:25.679081+0000', 'last_peered': '2024-09-15T22:41:25.679081+0000', 'last_clean': '2024-09-15T22:41:25.679081+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:41:25.694866+0000', 'last_undegraded': '2024-09-15T22:41:25.694866+0000', 'last_fullsized': '2024-09-15T22:41:25.694866+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'last_clean_scrub_stamp': '2024-09-15T22:41:25.679081+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:41:30.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:41:30.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.471+0000 7f261e9c4640 1 Processor -- start 2024-09-15T22:41:30.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.471+0000 7f261e9c4640 1 -- start start 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f261e9c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 0x7f26180d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f261e9c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f261815ca40 0x7f261815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f261e9c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26180d0bc0 con 0x7f261815ce80 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f261e9c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f261815d390 con 0x7f261815ca40 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f261e9c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f261815d670 con 0x7f26180d02a0 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f26177fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f261815ca40 0x7f261815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f26177fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f261815ca40 0x7f261815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37186/0 (socket says 172.21.15.134:37186) 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.472+0000 7f26177fe640 1 -- 172.21.15.134:0/1526982562 learned_addr learned my addr 172.21.15.134:0/1526982562 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f2617fff640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 0x7f26180d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f26177fe640 1 -- 172.21.15.134:0/1526982562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 msgr2=0x7f26180d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:30.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f26177fe640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 0x7f26180d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f26177fe640 1 -- 172.21.15.134:0/1526982562 >> v1:172.21.15.177:6789/0 conn(0x7f261815ce80 legacy=0x7f26181594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f26177fe640 1 -- 172.21.15.134:0/1526982562 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261815d950 con 0x7f261815ca40 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f2617fff640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 0x7f26180d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f26177fe640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261815ca40 0x7f261815e430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f260c009870 tx=0x7f260c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ab05621b327752 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f2616ffd640 1 -- 172.21.15.134:0/1526982562 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c037070 con 0x7f261815ca40 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f2616ffd640 1 -- 172.21.15.134:0/1526982562 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c032440 con 0x7f261815ca40 2024-09-15T22:41:30.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.473+0000 7f2616ffd640 1 -- 172.21.15.134:0/1526982562 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c032810 con 0x7f261815ca40 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 -- 172.21.15.134:0/1526982562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261815ca40 msgr2=0x7f261815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261815ca40 0x7f261815e430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f260c009870 tx=0x7f260c02a180 comp rx=0 tx=0).stop 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 -- 172.21.15.134:0/1526982562 shutdown_connections 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261815ca40 0x7f261815e430 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 --2- 172.21.15.134:0/1526982562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26180d02a0 0x7f26180d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 -- 172.21.15.134:0/1526982562 >> 172.21.15.134:0/1526982562 conn(0x7f2618062cc0 msgr2=0x7f261806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 -- 172.21.15.134:0/1526982562 shutdown_connections 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.474+0000 7f261e9c4640 1 -- 172.21.15.134:0/1526982562 wait complete. 2024-09-15T22:41:30.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.475+0000 7f261e9c4640 1 Processor -- start 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.475+0000 7f261e9c4640 1 -- start start 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 0x7f261815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261815ce80 0x7f2618158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2618155b90 con 0x7f26180d02a0 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f261815df10 con 0x7f261815ce80 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261e9c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2618155d10 con 0x7f261815ca40 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37192/0 (socket says 172.21.15.134:37192) 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 -- 172.21.15.134:0/304487084 learned_addr learned my addr 172.21.15.134:0/304487084 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f26177fe640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 0x7f261815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f261cf61640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261815ce80 0x7f2618158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 -- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 msgr2=0x7f261815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 0x7f261815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 -- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261815ce80 msgr2=0x7f2618158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261815ce80 0x7f2618158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f2617fff640 1 -- 172.21.15.134:0/304487084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181f4870 con 0x7f26180d02a0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.476+0000 7f26177fe640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 0x7f261815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f2617fff640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f260800c820 tx=0x7f260800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608015070 con 0x7f26180d02a0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2608007a30 con 0x7f26180d02a0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608007de0 con 0x7f26180d02a0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26181f4b50 con 0x7f26180d02a0 2024-09-15T22:41:30.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.477+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26181f5110 con 0x7f26180d02a0 2024-09-15T22:41:30.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.478+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26180b4790 con 0x7f26180d02a0 2024-09-15T22:41:30.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.478+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2608018070 con 0x7f26180d02a0 2024-09-15T22:41:30.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.479+0000 7f2614ff9640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 0x7f260406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.479+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f260808b2c0 con 0x7f26180d02a0 2024-09-15T22:41:30.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.479+0000 7f26177fe640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 0x7f260406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.479+0000 7f26177fe640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 0x7f260406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f260c034000 tx=0x7f260c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.483+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2608059ac0 con 0x7f26180d02a0 2024-09-15T22:41:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.716+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f261806d1f0 con 0x7f26180d02a0 2024-09-15T22:41:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.717+0000 7f2614ff9640 1 -- 172.21.15.134:0/304487084 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1150 (secure 0 0 0) 0x7f26080593c0 con 0x7f26180d02a0 2024-09-15T22:41:30.718 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:30.718 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":30},{"state_name":"unknown","count":10}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224194560,"bytes_avail":772869918720,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.58762884140014648},"fsmap":{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T22:41:02.919869+0000","services":{}},"progress_events":{}} 2024-09-15T22:41:30.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 msgr2=0x7f260406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 0x7f260406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f260c034000 tx=0x7f260c02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:30.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 msgr2=0x7f26181f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f260800c820 tx=0x7f260800cce0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 shutdown_connections 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f260406c2b0 0x7f260406e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261815ce80 0x7f2618158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f261815ca40 0x7f261815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 --2- 172.21.15.134:0/304487084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26180d02a0 0x7f26181f19b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 >> 172.21.15.134:0/304487084 conn(0x7f2618062cc0 msgr2=0x7f26180b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 shutdown_connections 2024-09-15T22:41:30.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.719+0000 7f261e9c4640 1 -- 172.21.15.134:0/304487084 wait complete. 2024-09-15T22:41:30.731 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:41:30.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:30.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.827+0000 7efc7db2c640 1 Processor -- start 2024-09-15T22:41:30.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.827+0000 7efc7db2c640 1 -- start start 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 0x7efc78071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 0x7efc78073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc78073ff0 0x7efc7806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efc7806e680 con 0x7efc78073ff0 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efc78071880 con 0x7efc7815e7b0 2024-09-15T22:41:30.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc7db2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc7806e8d0 con 0x7efc780b5600 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc78073ff0 0x7efc7806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc78073ff0 0x7efc7806ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37202/0 (socket says 172.21.15.134:37202) 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 -- 172.21.15.134:0/3854887365 learned_addr learned my addr 172.21.15.134:0/3854887365 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc76ffd640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 0x7efc78073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 -- 172.21.15.134:0/3854887365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 msgr2=0x7efc78073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc777fe640 1 --2- 172.21.15.134:0/3854887365 >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 0x7efc78071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 0x7efc78073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 -- 172.21.15.134:0/3854887365 >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 msgr2=0x7efc78071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 --2- 172.21.15.134:0/3854887365 >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 0x7efc78071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc77fff640 1 -- 172.21.15.134:0/3854887365 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7806ebb0 con 0x7efc78073ff0 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc76ffd640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 0x7efc78073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:30.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.828+0000 7efc777fe640 1 --2- 172.21.15.134:0/3854887365 >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 0x7efc78071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.829+0000 7efc77fff640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78073ff0 0x7efc7806ccb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc78050260 tx=0x7efc7002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1d151318343153 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.829+0000 7efc767fc640 1 -- 172.21.15.134:0/3854887365 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70036070 con 0x7efc78073ff0 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.829+0000 7efc767fc640 1 -- 172.21.15.134:0/3854887365 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70031600 con 0x7efc78073ff0 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.829+0000 7efc767fc640 1 -- 172.21.15.134:0/3854887365 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700319d0 con 0x7efc78073ff0 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 -- 172.21.15.134:0/3854887365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78073ff0 msgr2=0x7efc7806ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78073ff0 0x7efc7806ccb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc78050260 tx=0x7efc7002a610 comp rx=0 tx=0).stop 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 -- 172.21.15.134:0/3854887365 shutdown_connections 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78073ff0 0x7efc7806ccb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 --2- 172.21.15.134:0/3854887365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc780b5600 0x7efc78073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 --2- 172.21.15.134:0/3854887365 >> v2:172.21.15.177:3300/0 conn(0x7efc7815e7b0 0x7efc78071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 -- 172.21.15.134:0/3854887365 >> 172.21.15.134:0/3854887365 conn(0x7efc780b4300 msgr2=0x7efc780b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 -- 172.21.15.134:0/3854887365 shutdown_connections 2024-09-15T22:41:30.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.830+0000 7efc7db2c640 1 -- 172.21.15.134:0/3854887365 wait complete. 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.831+0000 7efc7db2c640 1 Processor -- start 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.831+0000 7efc7db2c640 1 -- start start 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7815e7b0 0x7efc781f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc781f4860 0x7efc781541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc7806d1f0 con 0x7efc780b5600 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc78073590 con 0x7efc7815e7b0 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc7db2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc7806d370 con 0x7efc781f4860 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37206/0 (socket says 172.21.15.134:37206) 2024-09-15T22:41:30.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 -- 172.21.15.134:0/2554585754 learned_addr learned my addr 172.21.15.134:0/2554585754 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc76ffd640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7815e7b0 0x7efc781f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 -- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc781f4860 msgr2=0x7efc781541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc77fff640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc781f4860 0x7efc781541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc781f4860 0x7efc781541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 -- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7815e7b0 msgr2=0x7efc781f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7815e7b0 0x7efc781f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 -- 172.21.15.134:0/2554585754 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc78154ed0 con 0x7efc780b5600 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.832+0000 7efc777fe640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c7f0 tx=0x7efc6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.833+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68015070 con 0x7efc780b5600 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.833+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68007820 con 0x7efc780b5600 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.833+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68007bd0 con 0x7efc780b5600 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.833+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc781f4d10 con 0x7efc780b5600 2024-09-15T22:41:30.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.833+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc781554b0 con 0x7efc780b5600 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.834+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc78073ab0 con 0x7efc780b5600 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.834+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc68018070 con 0x7efc780b5600 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.835+0000 7efc5ffff640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 0x7efc6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.835+0000 7efc76ffd640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 0x7efc6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.835+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc6808b4f0 con 0x7efc780b5600 2024-09-15T22:41:30.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.835+0000 7efc76ffd640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 0x7efc6406e7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:30.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:30.839+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc781f4d10 con 0x7efc780b5600 2024-09-15T22:41:31.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.004+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc78152d60 con 0x7efc6406c2e0 2024-09-15T22:41:31.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.010+0000 7efc5ffff640 1 -- 172.21.15.134:0/2554585754 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247197 (secure 0 0 0) 0x7efc6c00b510 con 0x7efc6406c2e0 2024-09-15T22:41:31.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:31.015 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 msgr2=0x7efc6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 0x7efc6406e7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 msgr2=0x7efc78160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c7f0 tx=0x7efc6800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 shutdown_connections 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efc6406c2e0 0x7efc6406e7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc781f4860 0x7efc781541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7815e7b0 0x7efc781f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 --2- 172.21.15.134:0/2554585754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc780b5600 0x7efc78160fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 >> 172.21.15.134:0/2554585754 conn(0x7efc780b4300 msgr2=0x7efc780b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:31.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 shutdown_connections 2024-09-15T22:41:31.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:31.013+0000 7efc7db2c640 1 -- 172.21.15.134:0/2554585754 wait complete. 2024-09-15T22:41:31.025 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-15T22:41:30.948618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2822144,"data_stored":1707716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699129+0000","last_change":"2024-09-15T22:41:25.699129+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699129+0000","last_undegraded":"2024-09-15T22:41:25.699129+0000","last_fullsized":"2024-09-15T22:41:25.699129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696613+0000","last_change":"2024-09-15T22:41:25.696613+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696613+0000","last_undegraded":"2024-09-15T22:41:25.696613+0000","last_fullsized":"2024-09-15T22:41:25.696613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694311+0000","last_change":"2024-09-15T22:41:25.694311+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694311+0000","last_undegraded":"2024-09-15T22:41:25.694311+0000","last_fullsized":"2024-09-15T22:41:25.694311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700151+0000","last_change":"2024-09-15T22:41:25.700151+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700151+0000","last_undegraded":"2024-09-15T22:41:25.700151+0000","last_fullsized":"2024-09-15T22:41:25.700151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698964+0000","last_change":"2024-09-15T22:41:25.698964+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698964+0000","last_undegraded":"2024-09-15T22:41:25.698964+0000","last_fullsized":"2024-09-15T22:41:25.698964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699680+0000","last_change":"2024-09-15T22:41:25.699680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699680+0000","last_undegraded":"2024-09-15T22:41:25.699680+0000","last_fullsized":"2024-09-15T22:41:25.699680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697022+0000","last_change":"2024-09-15T22:41:25.697022+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697022+0000","last_undegraded":"2024-09-15T22:41:25.697022+0000","last_fullsized":"2024-09-15T22:41:25.697022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697196+0000","last_change":"2024-09-15T22:41:25.697196+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697196+0000","last_undegraded":"2024-09-15T22:41:25.697196+0000","last_fullsized":"2024-09-15T22:41:25.697196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697277+0000","last_change":"2024-09-15T22:41:25.697277+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697277+0000","last_undegraded":"2024-09-15T22:41:25.697277+0000","last_fullsized":"2024-09-15T22:41:25.697277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696465+0000","last_change":"2024-09-15T22:41:25.696465+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696465+0000","last_undegraded":"2024-09-15T22:41:25.696465+0000","last_fullsized":"2024-09-15T22:41:25.696465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698751+0000","last_change":"2024-09-15T22:41:25.698751+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698751+0000","last_undegraded":"2024-09-15T22:41:25.698751+0000","last_fullsized":"2024-09-15T22:41:25.698751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698507+0000","last_change":"2024-09-15T22:41:25.698507+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698507+0000","last_undegraded":"2024-09-15T22:41:25.698507+0000","last_fullsized":"2024-09-15T22:41:25.698507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701520+0000","last_change":"2024-09-15T22:41:26.707362+0000","last_active":"2024-09-15T22:41:27.701520+0000","last_peered":"2024-09-15T22:41:27.701520+0000","last_clean":"2024-09-15T22:41:27.701520+0000","last_became_active":"2024-09-15T22:41:26.707108+0000","last_became_peered":"2024-09-15T22:41:26.707108+0000","last_unstale":"2024-09-15T22:41:27.701520+0000","last_undegraded":"2024-09-15T22:41:27.701520+0000","last_fullsized":"2024-09-15T22:41:27.701520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:00.028580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701343+0000","last_change":"2024-09-15T22:41:26.701767+0000","last_active":"2024-09-15T22:41:27.701343+0000","last_peered":"2024-09-15T22:41:27.701343+0000","last_clean":"2024-09-15T22:41:27.701343+0000","last_became_active":"2024-09-15T22:41:26.701488+0000","last_became_peered":"2024-09-15T22:41:26.701488+0000","last_unstale":"2024-09-15T22:41:27.701343+0000","last_undegraded":"2024-09-15T22:41:27.701343+0000","last_fullsized":"2024-09-15T22:41:27.701343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:02.532139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693619+0000","last_change":"2024-09-15T22:41:25.693619+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693619+0000","last_undegraded":"2024-09-15T22:41:25.693619+0000","last_fullsized":"2024-09-15T22:41:25.693619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700807+0000","last_change":"2024-09-15T22:41:25.700807+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700807+0000","last_undegraded":"2024-09-15T22:41:25.700807+0000","last_fullsized":"2024-09-15T22:41:25.700807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699497+0000","last_change":"2024-09-15T22:41:25.699497+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699497+0000","last_undegraded":"2024-09-15T22:41:25.699497+0000","last_fullsized":"2024-09-15T22:41:25.699497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690757+0000","last_change":"2024-09-15T22:41:25.690757+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690757+0000","last_undegraded":"2024-09-15T22:41:25.690757+0000","last_fullsized":"2024-09-15T22:41:25.690757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.700628+0000","last_change":"2024-09-15T22:41:25.700628+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.700628+0000","last_undegraded":"2024-09-15T22:41:25.700628+0000","last_fullsized":"2024-09-15T22:41:25.700628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698121+0000","last_change":"2024-09-15T22:41:25.698121+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698121+0000","last_undegraded":"2024-09-15T22:41:25.698121+0000","last_fullsized":"2024-09-15T22:41:25.698121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689992+0000","last_change":"2024-09-15T22:41:25.689992+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689992+0000","last_undegraded":"2024-09-15T22:41:25.689992+0000","last_fullsized":"2024-09-15T22:41:25.689992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697731+0000","last_change":"2024-09-15T22:41:25.697731+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697731+0000","last_undegraded":"2024-09-15T22:41:25.697731+0000","last_fullsized":"2024-09-15T22:41:25.697731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690715+0000","last_change":"2024-09-15T22:41:25.690715+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690715+0000","last_undegraded":"2024-09-15T22:41:25.690715+0000","last_fullsized":"2024-09-15T22:41:25.690715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.699348+0000","last_change":"2024-09-15T22:41:25.699348+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.699348+0000","last_undegraded":"2024-09-15T22:41:25.699348+0000","last_fullsized":"2024-09-15T22:41:25.699348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694223+0000","last_change":"2024-09-15T22:41:25.694223+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694223+0000","last_undegraded":"2024-09-15T22:41:25.694223+0000","last_fullsized":"2024-09-15T22:41:25.694223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697971+0000","last_change":"2024-09-15T22:41:25.697971+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697971+0000","last_undegraded":"2024-09-15T22:41:25.697971+0000","last_fullsized":"2024-09-15T22:41:25.697971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701840+0000","last_change":"2024-09-15T22:41:26.702206+0000","last_active":"2024-09-15T22:41:27.701840+0000","last_peered":"2024-09-15T22:41:27.701840+0000","last_clean":"2024-09-15T22:41:27.701840+0000","last_became_active":"2024-09-15T22:41:26.701499+0000","last_became_peered":"2024-09-15T22:41:26.701499+0000","last_unstale":"2024-09-15T22:41:27.701840+0000","last_undegraded":"2024-09-15T22:41:27.701840+0000","last_fullsized":"2024-09-15T22:41:27.701840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.486966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701565+0000","last_change":"2024-09-15T22:41:26.706783+0000","last_active":"2024-09-15T22:41:27.701565+0000","last_peered":"2024-09-15T22:41:27.701565+0000","last_clean":"2024-09-15T22:41:27.701565+0000","last_became_active":"2024-09-15T22:41:26.706518+0000","last_became_peered":"2024-09-15T22:41:26.706518+0000","last_unstale":"2024-09-15T22:41:27.701565+0000","last_undegraded":"2024-09-15T22:41:27.701565+0000","last_fullsized":"2024-09-15T22:41:27.701565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:11.596810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692847+0000","last_change":"2024-09-15T22:41:25.692847+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692847+0000","last_undegraded":"2024-09-15T22:41:25.692847+0000","last_fullsized":"2024-09-15T22:41:25.692847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698069+0000","last_change":"2024-09-15T22:41:25.698069+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698069+0000","last_undegraded":"2024-09-15T22:41:25.698069+0000","last_fullsized":"2024-09-15T22:41:25.698069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690015+0000","last_change":"2024-09-15T22:41:25.690015+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690015+0000","last_undegraded":"2024-09-15T22:41:25.690015+0000","last_fullsized":"2024-09-15T22:41:25.690015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696397+0000","last_change":"2024-09-15T22:41:25.696397+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696397+0000","last_undegraded":"2024-09-15T22:41:25.696397+0000","last_fullsized":"2024-09-15T22:41:25.696397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697246+0000","last_change":"2024-09-15T22:41:25.697246+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697246+0000","last_undegraded":"2024-09-15T22:41:25.697246+0000","last_fullsized":"2024-09-15T22:41:25.697246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704375+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:25.704375+0000","last_peered":"2024-09-15T22:41:25.704375+0000","last_clean":"2024-09-15T22:41:25.704375+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:25.704375+0000","last_undegraded":"2024-09-15T22:41:25.704375+0000","last_fullsized":"2024-09-15T22:41:25.704375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.687895+0000","last_change":"2024-09-15T22:41:25.687895+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.687895+0000","last_undegraded":"2024-09-15T22:41:25.687895+0000","last_fullsized":"2024-09-15T22:41:25.687895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711960+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:25.711960+0000","last_peered":"2024-09-15T22:41:25.711960+0000","last_clean":"2024-09-15T22:41:25.711960+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:25.711960+0000","last_undegraded":"2024-09-15T22:41:25.711960+0000","last_fullsized":"2024-09-15T22:41:25.711960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701240+0000","last_change":"2024-09-15T22:41:25.702016+0000","last_active":"2024-09-15T22:41:27.701240+0000","last_peered":"2024-09-15T22:41:27.701240+0000","last_clean":"2024-09-15T22:41:27.701240+0000","last_became_active":"2024-09-15T22:41:25.701650+0000","last_became_peered":"2024-09-15T22:41:25.701650+0000","last_unstale":"2024-09-15T22:41:27.701240+0000","last_undegraded":"2024-09-15T22:41:27.701240+0000","last_fullsized":"2024-09-15T22:41:27.701240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:09.408758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695167+0000","last_change":"2024-09-15T22:41:25.695167+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695167+0000","last_undegraded":"2024-09-15T22:41:25.695167+0000","last_fullsized":"2024-09-15T22:41:25.695167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705855+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:25.705855+0000","last_peered":"2024-09-15T22:41:25.705855+0000","last_clean":"2024-09-15T22:41:25.705855+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:25.705855+0000","last_undegraded":"2024-09-15T22:41:25.705855+0000","last_fullsized":"2024-09-15T22:41:25.705855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689694+0000","last_change":"2024-09-15T22:41:25.689694+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689694+0000","last_undegraded":"2024-09-15T22:41:25.689694+0000","last_fullsized":"2024-09-15T22:41:25.689694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699217+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:25.699217+0000","last_peered":"2024-09-15T22:41:25.699217+0000","last_clean":"2024-09-15T22:41:25.699217+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:25.699217+0000","last_undegraded":"2024-09-15T22:41:25.699217+0000","last_fullsized":"2024-09-15T22:41:25.699217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697212+0000","last_change":"2024-09-15T22:41:25.697212+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697212+0000","last_undegraded":"2024-09-15T22:41:25.697212+0000","last_fullsized":"2024-09-15T22:41:25.697212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705593+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:25.705593+0000","last_peered":"2024-09-15T22:41:25.705593+0000","last_clean":"2024-09-15T22:41:25.705593+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:25.705593+0000","last_undegraded":"2024-09-15T22:41:25.705593+0000","last_fullsized":"2024-09-15T22:41:25.705593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.692208+0000","last_change":"2024-09-15T22:41:25.692208+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.692208+0000","last_undegraded":"2024-09-15T22:41:25.692208+0000","last_fullsized":"2024-09-15T22:41:25.692208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.703712+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:25.703712+0000","last_peered":"2024-09-15T22:41:25.703712+0000","last_clean":"2024-09-15T22:41:25.703712+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:25.703712+0000","last_undegraded":"2024-09-15T22:41:25.703712+0000","last_fullsized":"2024-09-15T22:41:25.703712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:57.173330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698721+0000","last_change":"2024-09-15T22:41:25.698721+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698721+0000","last_undegraded":"2024-09-15T22:41:25.698721+0000","last_fullsized":"2024-09-15T22:41:25.698721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.701757+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:25.701757+0000","last_peered":"2024-09-15T22:41:25.701757+0000","last_clean":"2024-09-15T22:41:25.701757+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:25.701757+0000","last_undegraded":"2024-09-15T22:41:25.701757+0000","last_fullsized":"2024-09-15T22:41:25.701757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695554+0000","last_change":"2024-09-15T22:41:25.695554+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695554+0000","last_undegraded":"2024-09-15T22:41:25.695554+0000","last_fullsized":"2024-09-15T22:41:25.695554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704200+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:25.704200+0000","last_peered":"2024-09-15T22:41:25.704200+0000","last_clean":"2024-09-15T22:41:25.704200+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:25.704200+0000","last_undegraded":"2024-09-15T22:41:25.704200+0000","last_fullsized":"2024-09-15T22:41:25.704200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701423+0000","last_change":"2024-09-15T22:41:26.711298+0000","last_active":"2024-09-15T22:41:27.701423+0000","last_peered":"2024-09-15T22:41:27.701423+0000","last_clean":"2024-09-15T22:41:27.701423+0000","last_became_active":"2024-09-15T22:41:26.711029+0000","last_became_peered":"2024-09-15T22:41:26.711029+0000","last_unstale":"2024-09-15T22:41:27.701423+0000","last_undegraded":"2024-09-15T22:41:27.701423+0000","last_fullsized":"2024-09-15T22:41:27.701423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:29.101148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711886+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:25.711886+0000","last_peered":"2024-09-15T22:41:25.711886+0000","last_clean":"2024-09-15T22:41:25.711886+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:25.711886+0000","last_undegraded":"2024-09-15T22:41:25.711886+0000","last_fullsized":"2024-09-15T22:41:25.711886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697199+0000","last_change":"2024-09-15T22:41:25.697199+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697199+0000","last_undegraded":"2024-09-15T22:41:25.697199+0000","last_fullsized":"2024-09-15T22:41:25.697199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709131+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:25.709131+0000","last_peered":"2024-09-15T22:41:25.709131+0000","last_clean":"2024-09-15T22:41:25.709131+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:25.709131+0000","last_undegraded":"2024-09-15T22:41:25.709131+0000","last_fullsized":"2024-09-15T22:41:25.709131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.698179+0000","last_change":"2024-09-15T22:41:25.698179+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.698179+0000","last_undegraded":"2024-09-15T22:41:25.698179+0000","last_fullsized":"2024-09-15T22:41:25.698179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.699076+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:25.699076+0000","last_peered":"2024-09-15T22:41:25.699076+0000","last_clean":"2024-09-15T22:41:25.699076+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:25.699076+0000","last_undegraded":"2024-09-15T22:41:25.699076+0000","last_fullsized":"2024-09-15T22:41:25.699076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696580+0000","last_change":"2024-09-15T22:41:25.696580+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696580+0000","last_undegraded":"2024-09-15T22:41:25.696580+0000","last_fullsized":"2024-09-15T22:41:25.696580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.711954+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:25.711954+0000","last_peered":"2024-09-15T22:41:25.711954+0000","last_clean":"2024-09-15T22:41:25.711954+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:25.711954+0000","last_undegraded":"2024-09-15T22:41:25.711954+0000","last_fullsized":"2024-09-15T22:41:25.711954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695861+0000","last_change":"2024-09-15T22:41:25.695861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695861+0000","last_undegraded":"2024-09-15T22:41:25.695861+0000","last_fullsized":"2024-09-15T22:41:25.695861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706487+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:25.706487+0000","last_peered":"2024-09-15T22:41:25.706487+0000","last_clean":"2024-09-15T22:41:25.706487+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:25.706487+0000","last_undegraded":"2024-09-15T22:41:25.706487+0000","last_fullsized":"2024-09-15T22:41:25.706487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695610+0000","last_change":"2024-09-15T22:41:25.695610+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695610+0000","last_undegraded":"2024-09-15T22:41:25.695610+0000","last_fullsized":"2024-09-15T22:41:25.695610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704618+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:25.704618+0000","last_peered":"2024-09-15T22:41:25.704618+0000","last_clean":"2024-09-15T22:41:25.704618+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:25.704618+0000","last_undegraded":"2024-09-15T22:41:25.704618+0000","last_fullsized":"2024-09-15T22:41:25.704618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695299+0000","last_change":"2024-09-15T22:41:25.695299+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695299+0000","last_undegraded":"2024-09-15T22:41:25.695299+0000","last_fullsized":"2024-09-15T22:41:25.695299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701675+0000","last_change":"2024-09-15T22:41:25.702075+0000","last_active":"2024-09-15T22:41:27.701675+0000","last_peered":"2024-09-15T22:41:27.701675+0000","last_clean":"2024-09-15T22:41:27.701675+0000","last_became_active":"2024-09-15T22:41:25.701608+0000","last_became_peered":"2024-09-15T22:41:25.701608+0000","last_unstale":"2024-09-15T22:41:27.701675+0000","last_undegraded":"2024-09-15T22:41:27.701675+0000","last_fullsized":"2024-09-15T22:41:27.701675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:27.717750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695606+0000","last_change":"2024-09-15T22:41:25.695606+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695606+0000","last_undegraded":"2024-09-15T22:41:25.695606+0000","last_fullsized":"2024-09-15T22:41:25.695606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.689317+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:25.689317+0000","last_peered":"2024-09-15T22:41:25.689317+0000","last_clean":"2024-09-15T22:41:25.689317+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:25.689317+0000","last_undegraded":"2024-09-15T22:41:25.689317+0000","last_fullsized":"2024-09-15T22:41:25.689317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705563+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:25.705563+0000","last_peered":"2024-09-15T22:41:25.705563+0000","last_clean":"2024-09-15T22:41:25.705563+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:25.705563+0000","last_undegraded":"2024-09-15T22:41:25.705563+0000","last_fullsized":"2024-09-15T22:41:25.705563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688860+0000","last_change":"2024-09-15T22:41:25.688860+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688860+0000","last_undegraded":"2024-09-15T22:41:25.688860+0000","last_fullsized":"2024-09-15T22:41:25.688860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705876+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:25.705876+0000","last_peered":"2024-09-15T22:41:25.705876+0000","last_clean":"2024-09-15T22:41:25.705876+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:25.705876+0000","last_undegraded":"2024-09-15T22:41:25.705876+0000","last_fullsized":"2024-09-15T22:41:25.705876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701274+0000","last_change":"2024-09-15T22:41:26.697850+0000","last_active":"2024-09-15T22:41:27.701274+0000","last_peered":"2024-09-15T22:41:27.701274+0000","last_clean":"2024-09-15T22:41:27.701274+0000","last_became_active":"2024-09-15T22:41:26.697079+0000","last_became_peered":"2024-09-15T22:41:26.697079+0000","last_unstale":"2024-09-15T22:41:27.701274+0000","last_undegraded":"2024-09-15T22:41:27.701274+0000","last_fullsized":"2024-09-15T22:41:27.701274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:59.477248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.706571+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:25.706571+0000","last_peered":"2024-09-15T22:41:25.706571+0000","last_clean":"2024-09-15T22:41:25.706571+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:25.706571+0000","last_undegraded":"2024-09-15T22:41:25.706571+0000","last_fullsized":"2024-09-15T22:41:25.706571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696861+0000","last_change":"2024-09-15T22:41:25.696861+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696861+0000","last_undegraded":"2024-09-15T22:41:25.696861+0000","last_fullsized":"2024-09-15T22:41:25.696861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705823+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:25.705823+0000","last_peered":"2024-09-15T22:41:25.705823+0000","last_clean":"2024-09-15T22:41:25.705823+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:25.705823+0000","last_undegraded":"2024-09-15T22:41:25.705823+0000","last_fullsized":"2024-09-15T22:41:25.705823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695972+0000","last_change":"2024-09-15T22:41:25.695972+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695972+0000","last_undegraded":"2024-09-15T22:41:25.695972+0000","last_fullsized":"2024-09-15T22:41:25.695972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704393+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:25.704393+0000","last_peered":"2024-09-15T22:41:25.704393+0000","last_clean":"2024-09-15T22:41:25.704393+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:25.704393+0000","last_undegraded":"2024-09-15T22:41:25.704393+0000","last_fullsized":"2024-09-15T22:41:25.704393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696098+0000","last_change":"2024-09-15T22:41:25.696098+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696098+0000","last_undegraded":"2024-09-15T22:41:25.696098+0000","last_fullsized":"2024-09-15T22:41:25.696098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705611+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:25.705611+0000","last_peered":"2024-09-15T22:41:25.705611+0000","last_clean":"2024-09-15T22:41:25.705611+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:25.705611+0000","last_undegraded":"2024-09-15T22:41:25.705611+0000","last_fullsized":"2024-09-15T22:41:25.705611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701650+0000","last_change":"2024-09-15T22:41:26.698859+0000","last_active":"2024-09-15T22:41:27.701650+0000","last_peered":"2024-09-15T22:41:27.701650+0000","last_clean":"2024-09-15T22:41:27.701650+0000","last_became_active":"2024-09-15T22:41:26.698599+0000","last_became_peered":"2024-09-15T22:41:26.698599+0000","last_unstale":"2024-09-15T22:41:27.701650+0000","last_undegraded":"2024-09-15T22:41:27.701650+0000","last_fullsized":"2024-09-15T22:41:27.701650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:22.754810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704193+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:25.704193+0000","last_peered":"2024-09-15T22:41:25.704193+0000","last_clean":"2024-09-15T22:41:25.704193+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:25.704193+0000","last_undegraded":"2024-09-15T22:41:25.704193+0000","last_fullsized":"2024-09-15T22:41:25.704193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:00.148430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688085+0000","last_change":"2024-09-15T22:41:25.688085+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688085+0000","last_undegraded":"2024-09-15T22:41:25.688085+0000","last_fullsized":"2024-09-15T22:41:25.688085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.717223+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:25.717223+0000","last_peered":"2024-09-15T22:41:25.717223+0000","last_clean":"2024-09-15T22:41:25.717223+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:25.717223+0000","last_undegraded":"2024-09-15T22:41:25.717223+0000","last_fullsized":"2024-09-15T22:41:25.717223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.690406+0000","last_change":"2024-09-15T22:41:25.690406+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.690406+0000","last_undegraded":"2024-09-15T22:41:25.690406+0000","last_fullsized":"2024-09-15T22:41:25.690406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709081+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:25.709081+0000","last_peered":"2024-09-15T22:41:25.709081+0000","last_clean":"2024-09-15T22:41:25.709081+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:25.709081+0000","last_undegraded":"2024-09-15T22:41:25.709081+0000","last_fullsized":"2024-09-15T22:41:25.709081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.695061+0000","last_change":"2024-09-15T22:41:25.695061+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.695061+0000","last_undegraded":"2024-09-15T22:41:25.695061+0000","last_fullsized":"2024-09-15T22:41:25.695061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704379+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:25.704379+0000","last_peered":"2024-09-15T22:41:25.704379+0000","last_clean":"2024-09-15T22:41:25.704379+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:25.704379+0000","last_undegraded":"2024-09-15T22:41:25.704379+0000","last_fullsized":"2024-09-15T22:41:25.704379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.688783+0000","last_change":"2024-09-15T22:41:25.688783+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.688783+0000","last_undegraded":"2024-09-15T22:41:25.688783+0000","last_fullsized":"2024-09-15T22:41:25.688783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701465+0000","last_change":"2024-09-15T22:41:25.702682+0000","last_active":"2024-09-15T22:41:27.701465+0000","last_peered":"2024-09-15T22:41:27.701465+0000","last_clean":"2024-09-15T22:41:27.701465+0000","last_became_active":"2024-09-15T22:41:25.702368+0000","last_became_peered":"2024-09-15T22:41:25.702368+0000","last_unstale":"2024-09-15T22:41:27.701465+0000","last_undegraded":"2024-09-15T22:41:27.701465+0000","last_fullsized":"2024-09-15T22:41:27.701465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.825332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.689723+0000","last_change":"2024-09-15T22:41:25.689723+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.689723+0000","last_undegraded":"2024-09-15T22:41:25.689723+0000","last_fullsized":"2024-09-15T22:41:25.689723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705586+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:25.705586+0000","last_peered":"2024-09-15T22:41:25.705586+0000","last_clean":"2024-09-15T22:41:25.705586+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:25.705586+0000","last_undegraded":"2024-09-15T22:41:25.705586+0000","last_fullsized":"2024-09-15T22:41:25.705586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.696138+0000","last_change":"2024-09-15T22:41:25.696138+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.696138+0000","last_undegraded":"2024-09-15T22:41:25.696138+0000","last_fullsized":"2024-09-15T22:41:25.696138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697680+0000","last_change":"2024-09-15T22:41:25.697680+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697680+0000","last_undegraded":"2024-09-15T22:41:25.697680+0000","last_fullsized":"2024-09-15T22:41:25.697680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.709114+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:25.709114+0000","last_peered":"2024-09-15T22:41:25.709114+0000","last_clean":"2024-09-15T22:41:25.709114+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:25.709114+0000","last_undegraded":"2024-09-15T22:41:25.709114+0000","last_fullsized":"2024-09-15T22:41:25.709114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.697661+0000","last_change":"2024-09-15T22:41:25.697661+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.697661+0000","last_undegraded":"2024-09-15T22:41:25.697661+0000","last_fullsized":"2024-09-15T22:41:25.697661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.705565+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:25.705565+0000","last_peered":"2024-09-15T22:41:25.705565+0000","last_clean":"2024-09-15T22:41:25.705565+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:25.705565+0000","last_undegraded":"2024-09-15T22:41:25.705565+0000","last_fullsized":"2024-09-15T22:41:25.705565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.385833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.693722+0000","last_change":"2024-09-15T22:41:25.693722+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.693722+0000","last_undegraded":"2024-09-15T22:41:25.693722+0000","last_fullsized":"2024-09-15T22:41:25.693722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704387+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:25.704387+0000","last_peered":"2024-09-15T22:41:25.704387+0000","last_clean":"2024-09-15T22:41:25.704387+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:25.704387+0000","last_undegraded":"2024-09-15T22:41:25.704387+0000","last_fullsized":"2024-09-15T22:41:25.704387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-15T22:41:25.694866+0000","last_change":"2024-09-15T22:41:25.694866+0000","last_active":"2024-09-15T22:41:25.679081+0000","last_peered":"2024-09-15T22:41:25.679081+0000","last_clean":"2024-09-15T22:41:25.679081+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:41:25.694866+0000","last_undegraded":"2024-09-15T22:41:25.694866+0000","last_fullsized":"2024-09-15T22:41:25.694866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T22:41:25.704340+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:25.704340+0000","last_peered":"2024-09-15T22:41:25.704340+0000","last_clean":"2024-09-15T22:41:25.704340+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:25.704340+0000","last_undegraded":"2024-09-15T22:41:25.704340+0000","last_fullsized":"2024-09-15T22:41:25.704340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:31.563 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-09-15T22:41:31.562+0000 7f8be629e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:41:34.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:34.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.138+0000 7f0a5444c640 1 Processor -- start 2024-09-15T22:41:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.138+0000 7f0a5444c640 1 -- start start 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a5444c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a4c15e940 0x7f0a4c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a5444c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4c0b7170 con 0x7f0a4c0cef90 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a5444c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4c0b7aa0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a5444c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0a4c0d3660 con 0x7f0a4c15e940 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a521e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a4c15e940 0x7f0a4c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a529e9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0a4c0cef90 0x7f0a4c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41892/0 (socket says 172.21.15.134:41892) 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a521e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a4c15e940 0x7f0a4c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37222/0 (socket says 172.21.15.134:37222) 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a529e9640 1 -- 172.21.15.134:0/1874569808 learned_addr learned my addr 172.21.15.134:0/1874569808 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.139+0000 7f0a521e8640 1 -- 172.21.15.134:0/1874569808 >> v1:172.21.15.177:6789/0 conn(0x7f0a4c15ed20 legacy=0x7f0a4c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a521e8640 1 -- 172.21.15.134:0/1874569808 >> v1:172.21.15.134:6789/0 conn(0x7f0a4c0cef90 legacy=0x7f0a4c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a521e8640 1 -- 172.21.15.134:0/1874569808 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c0d3940 con 0x7f0a4c15e940 2024-09-15T22:41:34.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a511e6640 1 -- 172.21.15.134:0/1874569808 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839046683 0 0) 0x7f0a44001110 con 0x7f0a4c0cef90 2024-09-15T22:41:34.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a521e8640 1 --2- 172.21.15.134:0/1874569808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0d1060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009d90 tx=0x7f0a3c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5858e00704594f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a511e6640 1 -- 172.21.15.134:0/1874569808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c037070 con 0x7f0a4c15e940 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a511e6640 1 -- 172.21.15.134:0/1874569808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c007740 con 0x7f0a4c15e940 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.140+0000 7f0a511e6640 1 -- 172.21.15.134:0/1874569808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c007b10 con 0x7f0a4c15e940 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 -- 172.21.15.134:0/1874569808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15e940 msgr2=0x7f0a4c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 --2- 172.21.15.134:0/1874569808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0d1060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009d90 tx=0x7f0a3c02a780 comp rx=0 tx=0).stop 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 -- 172.21.15.134:0/1874569808 shutdown_connections 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 --2- 172.21.15.134:0/1874569808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0d1060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 -- 172.21.15.134:0/1874569808 >> 172.21.15.134:0/1874569808 conn(0x7f0a4c0b6240 msgr2=0x7f0a4c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 -- 172.21.15.134:0/1874569808 shutdown_connections 2024-09-15T22:41:34.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.141+0000 7f0a5444c640 1 -- 172.21.15.134:0/1874569808 wait complete. 2024-09-15T22:41:34.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.142+0000 7f0a5444c640 1 Processor -- start 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.142+0000 7f0a5444c640 1 -- start start 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 0x7f0a4c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4c0d3310 con 0x7f0a4c15ed20 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4c0d3f00 con 0x7f0a4c15e940 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a5444c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4c0d1ef0 con 0x7f0a4c0cef90 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37238/0 (socket says 172.21.15.134:37238) 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 -- 172.21.15.134:0/3138943182 learned_addr learned my addr 172.21.15.134:0/3138943182 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a521e8640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 0x7f0a4c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a519e7640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 -- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 msgr2=0x7f0a4c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 0x7f0a4c154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 -- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 msgr2=0x7f0a4c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a529e9640 1 -- 172.21.15.134:0/3138943182 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c0cceb0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a521e8640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 0x7f0a4c154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.143+0000 7f0a519e7640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a529e9640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c780 tx=0x7f0a4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a44018070 con 0x7f0a4c15ed20 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a440070d0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4c0cc8f0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440074c0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.144+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4c15b4e0 con 0x7f0a4c15ed20 2024-09-15T22:41:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.145+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4c0d1060 con 0x7f0a4c15ed20 2024-09-15T22:41:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.145+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a4401b070 con 0x7f0a4c15ed20 2024-09-15T22:41:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.146+0000 7f0a4affd640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 0x7f0a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.146+0000 7f0a521e8640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 0x7f0a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.146+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0a4408a660 con 0x7f0a4c15ed20 2024-09-15T22:41:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.146+0000 7f0a521e8640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 0x7f0a3806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c034000 tx=0x7f0a3c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.150+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a4c0b7170 con 0x7f0a4c15ed20 2024-09-15T22:41:34.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.310+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a4c0d1ac0 con 0x7f0a3806c2b0 2024-09-15T22:41:34.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.316+0000 7f0a4affd640 1 -- 172.21.15.134:0/3138943182 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f0a4c0d1ac0 con 0x7f0a3806c2b0 2024-09-15T22:41:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:34.321 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 msgr2=0x7f0a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 0x7f0a3806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c034000 tx=0x7f0a3c02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 msgr2=0x7f0a4c0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c780 tx=0x7f0a4400cc40 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 shutdown_connections 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0a3806c2b0 0x7f0a3806e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a4c15ed20 0x7f0a4c0ca970 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c15e940 0x7f0a4c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 --2- 172.21.15.134:0/3138943182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0cef90 0x7f0a4c154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 >> 172.21.15.134:0/3138943182 conn(0x7f0a4c0b6240 msgr2=0x7f0a4c160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 shutdown_connections 2024-09-15T22:41:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.319+0000 7f0a5444c640 1 -- 172.21.15.134:0/3138943182 wait complete. 2024-09-15T22:41:34.331 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-15T22:41:32.949030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219308,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755412,"statfs":{"total":773094113280,"available":772869541888,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.262849"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993495+0000","last_change":"2024-09-15T22:41:26.715026+0000","last_active":"2024-09-15T22:41:27.993495+0000","last_peered":"2024-09-15T22:41:27.993495+0000","last_clean":"2024-09-15T22:41:27.993495+0000","last_became_active":"2024-09-15T22:41:26.714732+0000","last_became_peered":"2024-09-15T22:41:26.714732+0000","last_unstale":"2024-09-15T22:41:27.993495+0000","last_undegraded":"2024-09-15T22:41:27.993495+0000","last_fullsized":"2024-09-15T22:41:27.993495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743708+0000","last_change":"2024-09-15T22:41:26.708187+0000","last_active":"2024-09-15T22:41:28.743708+0000","last_peered":"2024-09-15T22:41:28.743708+0000","last_clean":"2024-09-15T22:41:28.743708+0000","last_became_active":"2024-09-15T22:41:26.707542+0000","last_became_peered":"2024-09-15T22:41:26.707542+0000","last_unstale":"2024-09-15T22:41:28.743708+0000","last_undegraded":"2024-09-15T22:41:28.743708+0000","last_fullsized":"2024-09-15T22:41:28.743708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743729+0000","last_change":"2024-09-15T22:41:26.702417+0000","last_active":"2024-09-15T22:41:28.743729+0000","last_peered":"2024-09-15T22:41:28.743729+0000","last_clean":"2024-09-15T22:41:28.743729+0000","last_became_active":"2024-09-15T22:41:26.702137+0000","last_became_peered":"2024-09-15T22:41:26.702137+0000","last_unstale":"2024-09-15T22:41:28.743729+0000","last_undegraded":"2024-09-15T22:41:28.743729+0000","last_fullsized":"2024-09-15T22:41:28.743729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743282+0000","last_change":"2024-09-15T22:41:26.705417+0000","last_active":"2024-09-15T22:41:28.743282+0000","last_peered":"2024-09-15T22:41:28.743282+0000","last_clean":"2024-09-15T22:41:28.743282+0000","last_became_active":"2024-09-15T22:41:26.704860+0000","last_became_peered":"2024-09-15T22:41:26.704860+0000","last_unstale":"2024-09-15T22:41:28.743282+0000","last_undegraded":"2024-09-15T22:41:28.743282+0000","last_fullsized":"2024-09-15T22:41:28.743282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:16.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993172+0000","last_change":"2024-09-15T22:41:26.705602+0000","last_active":"2024-09-15T22:41:27.993172+0000","last_peered":"2024-09-15T22:41:27.993172+0000","last_clean":"2024-09-15T22:41:27.993172+0000","last_became_active":"2024-09-15T22:41:26.705349+0000","last_became_peered":"2024-09-15T22:41:26.705349+0000","last_unstale":"2024-09-15T22:41:27.993172+0000","last_undegraded":"2024-09-15T22:41:27.993172+0000","last_fullsized":"2024-09-15T22:41:27.993172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742873+0000","last_change":"2024-09-15T22:41:26.705590+0000","last_active":"2024-09-15T22:41:28.742873+0000","last_peered":"2024-09-15T22:41:28.742873+0000","last_clean":"2024-09-15T22:41:28.742873+0000","last_became_active":"2024-09-15T22:41:26.705121+0000","last_became_peered":"2024-09-15T22:41:26.705121+0000","last_unstale":"2024-09-15T22:41:28.742873+0000","last_undegraded":"2024-09-15T22:41:28.742873+0000","last_fullsized":"2024-09-15T22:41:28.742873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993014+0000","last_change":"2024-09-15T22:41:26.711621+0000","last_active":"2024-09-15T22:41:27.993014+0000","last_peered":"2024-09-15T22:41:27.993014+0000","last_clean":"2024-09-15T22:41:27.993014+0000","last_became_active":"2024-09-15T22:41:26.711350+0000","last_became_peered":"2024-09-15T22:41:26.711350+0000","last_unstale":"2024-09-15T22:41:27.993014+0000","last_undegraded":"2024-09-15T22:41:27.993014+0000","last_fullsized":"2024-09-15T22:41:27.993014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743588+0000","last_change":"2024-09-15T22:41:26.709226+0000","last_active":"2024-09-15T22:41:28.743588+0000","last_peered":"2024-09-15T22:41:28.743588+0000","last_clean":"2024-09-15T22:41:28.743588+0000","last_became_active":"2024-09-15T22:41:26.708822+0000","last_became_peered":"2024-09-15T22:41:26.708822+0000","last_unstale":"2024-09-15T22:41:28.743588+0000","last_undegraded":"2024-09-15T22:41:28.743588+0000","last_fullsized":"2024-09-15T22:41:28.743588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743223+0000","last_change":"2024-09-15T22:41:26.714192+0000","last_active":"2024-09-15T22:41:28.743223+0000","last_peered":"2024-09-15T22:41:28.743223+0000","last_clean":"2024-09-15T22:41:28.743223+0000","last_became_active":"2024-09-15T22:41:26.713880+0000","last_became_peered":"2024-09-15T22:41:26.713880+0000","last_unstale":"2024-09-15T22:41:28.743223+0000","last_undegraded":"2024-09-15T22:41:28.743223+0000","last_fullsized":"2024-09-15T22:41:28.743223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993371+0000","last_change":"2024-09-15T22:41:26.707274+0000","last_active":"2024-09-15T22:41:27.993371+0000","last_peered":"2024-09-15T22:41:27.993371+0000","last_clean":"2024-09-15T22:41:27.993371+0000","last_became_active":"2024-09-15T22:41:26.707019+0000","last_became_peered":"2024-09-15T22:41:26.707019+0000","last_unstale":"2024-09-15T22:41:27.993371+0000","last_undegraded":"2024-09-15T22:41:27.993371+0000","last_fullsized":"2024-09-15T22:41:27.993371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993235+0000","last_change":"2024-09-15T22:41:26.715027+0000","last_active":"2024-09-15T22:41:27.993235+0000","last_peered":"2024-09-15T22:41:27.993235+0000","last_clean":"2024-09-15T22:41:27.993235+0000","last_became_active":"2024-09-15T22:41:26.714742+0000","last_became_peered":"2024-09-15T22:41:26.714742+0000","last_unstale":"2024-09-15T22:41:27.993235+0000","last_undegraded":"2024-09-15T22:41:27.993235+0000","last_fullsized":"2024-09-15T22:41:27.993235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993177+0000","last_change":"2024-09-15T22:41:26.705354+0000","last_active":"2024-09-15T22:41:27.993177+0000","last_peered":"2024-09-15T22:41:27.993177+0000","last_clean":"2024-09-15T22:41:27.993177+0000","last_became_active":"2024-09-15T22:41:26.704817+0000","last_became_peered":"2024-09-15T22:41:26.704817+0000","last_unstale":"2024-09-15T22:41:27.993177+0000","last_undegraded":"2024-09-15T22:41:27.993177+0000","last_fullsized":"2024-09-15T22:41:27.993177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701520+0000","last_change":"2024-09-15T22:41:26.707362+0000","last_active":"2024-09-15T22:41:27.701520+0000","last_peered":"2024-09-15T22:41:27.701520+0000","last_clean":"2024-09-15T22:41:27.701520+0000","last_became_active":"2024-09-15T22:41:26.707108+0000","last_became_peered":"2024-09-15T22:41:26.707108+0000","last_unstale":"2024-09-15T22:41:27.701520+0000","last_undegraded":"2024-09-15T22:41:27.701520+0000","last_fullsized":"2024-09-15T22:41:27.701520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:00.028580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701343+0000","last_change":"2024-09-15T22:41:26.701767+0000","last_active":"2024-09-15T22:41:27.701343+0000","last_peered":"2024-09-15T22:41:27.701343+0000","last_clean":"2024-09-15T22:41:27.701343+0000","last_became_active":"2024-09-15T22:41:26.701488+0000","last_became_peered":"2024-09-15T22:41:26.701488+0000","last_unstale":"2024-09-15T22:41:27.701343+0000","last_undegraded":"2024-09-15T22:41:27.701343+0000","last_fullsized":"2024-09-15T22:41:27.701343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:02.532139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.704769+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.704475+0000","last_became_peered":"2024-09-15T22:41:26.704475+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697745+0000","last_change":"2024-09-15T22:41:26.702125+0000","last_active":"2024-09-15T22:41:27.697745+0000","last_peered":"2024-09-15T22:41:27.697745+0000","last_clean":"2024-09-15T22:41:27.697745+0000","last_became_active":"2024-09-15T22:41:26.701707+0000","last_became_peered":"2024-09-15T22:41:26.701707+0000","last_unstale":"2024-09-15T22:41:27.697745+0000","last_undegraded":"2024-09-15T22:41:27.697745+0000","last_fullsized":"2024-09-15T22:41:27.697745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698334+0000","last_change":"2024-09-15T22:41:26.709603+0000","last_active":"2024-09-15T22:41:27.698334+0000","last_peered":"2024-09-15T22:41:27.698334+0000","last_clean":"2024-09-15T22:41:27.698334+0000","last_became_active":"2024-09-15T22:41:26.709357+0000","last_became_peered":"2024-09-15T22:41:26.709357+0000","last_unstale":"2024-09-15T22:41:27.698334+0000","last_undegraded":"2024-09-15T22:41:27.698334+0000","last_fullsized":"2024-09-15T22:41:27.698334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:59.454273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.700010+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.699679+0000","last_became_peered":"2024-09-15T22:41:26.699679+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698344+0000","last_change":"2024-09-15T22:41:26.707446+0000","last_active":"2024-09-15T22:41:27.698344+0000","last_peered":"2024-09-15T22:41:27.698344+0000","last_clean":"2024-09-15T22:41:27.698344+0000","last_became_active":"2024-09-15T22:41:26.706549+0000","last_became_peered":"2024-09-15T22:41:26.706549+0000","last_unstale":"2024-09-15T22:41:27.698344+0000","last_undegraded":"2024-09-15T22:41:27.698344+0000","last_fullsized":"2024-09-15T22:41:27.698344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:53.685207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993375+0000","last_change":"2024-09-15T22:41:26.707073+0000","last_active":"2024-09-15T22:41:27.993375+0000","last_peered":"2024-09-15T22:41:27.993375+0000","last_clean":"2024-09-15T22:41:27.993375+0000","last_became_active":"2024-09-15T22:41:26.706499+0000","last_became_peered":"2024-09-15T22:41:26.706499+0000","last_unstale":"2024-09-15T22:41:27.993375+0000","last_undegraded":"2024-09-15T22:41:27.993375+0000","last_fullsized":"2024-09-15T22:41:27.993375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702082+0000","last_change":"2024-09-15T22:41:26.701194+0000","last_active":"2024-09-15T22:41:27.702082+0000","last_peered":"2024-09-15T22:41:27.702082+0000","last_clean":"2024-09-15T22:41:27.702082+0000","last_became_active":"2024-09-15T22:41:26.700907+0000","last_became_peered":"2024-09-15T22:41:26.700907+0000","last_unstale":"2024-09-15T22:41:27.702082+0000","last_undegraded":"2024-09-15T22:41:27.702082+0000","last_fullsized":"2024-09-15T22:41:27.702082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742859+0000","last_change":"2024-09-15T22:41:26.708589+0000","last_active":"2024-09-15T22:41:28.742859+0000","last_peered":"2024-09-15T22:41:28.742859+0000","last_clean":"2024-09-15T22:41:28.742859+0000","last_became_active":"2024-09-15T22:41:26.708297+0000","last_became_peered":"2024-09-15T22:41:26.708297+0000","last_unstale":"2024-09-15T22:41:28.742859+0000","last_undegraded":"2024-09-15T22:41:28.742859+0000","last_fullsized":"2024-09-15T22:41:28.742859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:56.536210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744342+0000","last_change":"2024-09-15T22:41:26.705794+0000","last_active":"2024-09-15T22:41:28.744342+0000","last_peered":"2024-09-15T22:41:28.744342+0000","last_clean":"2024-09-15T22:41:28.744342+0000","last_became_active":"2024-09-15T22:41:26.705524+0000","last_became_peered":"2024-09-15T22:41:26.705524+0000","last_unstale":"2024-09-15T22:41:28.744342+0000","last_undegraded":"2024-09-15T22:41:28.744342+0000","last_fullsized":"2024-09-15T22:41:28.744342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697744+0000","last_change":"2024-09-15T22:41:26.710283+0000","last_active":"2024-09-15T22:41:27.697744+0000","last_peered":"2024-09-15T22:41:27.697744+0000","last_clean":"2024-09-15T22:41:27.697744+0000","last_became_active":"2024-09-15T22:41:26.709982+0000","last_became_peered":"2024-09-15T22:41:26.709982+0000","last_unstale":"2024-09-15T22:41:27.697744+0000","last_undegraded":"2024-09-15T22:41:27.697744+0000","last_fullsized":"2024-09-15T22:41:27.697744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744011+0000","last_change":"2024-09-15T22:41:26.705107+0000","last_active":"2024-09-15T22:41:28.744011+0000","last_peered":"2024-09-15T22:41:28.744011+0000","last_clean":"2024-09-15T22:41:28.744011+0000","last_became_active":"2024-09-15T22:41:26.704217+0000","last_became_peered":"2024-09-15T22:41:26.704217+0000","last_unstale":"2024-09-15T22:41:28.744011+0000","last_undegraded":"2024-09-15T22:41:28.744011+0000","last_fullsized":"2024-09-15T22:41:28.744011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743459+0000","last_change":"2024-09-15T22:41:26.712467+0000","last_active":"2024-09-15T22:41:28.743459+0000","last_peered":"2024-09-15T22:41:28.743459+0000","last_clean":"2024-09-15T22:41:28.743459+0000","last_became_active":"2024-09-15T22:41:26.711787+0000","last_became_peered":"2024-09-15T22:41:26.711787+0000","last_unstale":"2024-09-15T22:41:28.743459+0000","last_undegraded":"2024-09-15T22:41:28.743459+0000","last_fullsized":"2024-09-15T22:41:28.743459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:08.624131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701840+0000","last_change":"2024-09-15T22:41:26.702206+0000","last_active":"2024-09-15T22:41:27.701840+0000","last_peered":"2024-09-15T22:41:27.701840+0000","last_clean":"2024-09-15T22:41:27.701840+0000","last_became_active":"2024-09-15T22:41:26.701499+0000","last_became_peered":"2024-09-15T22:41:26.701499+0000","last_unstale":"2024-09-15T22:41:27.701840+0000","last_undegraded":"2024-09-15T22:41:27.701840+0000","last_fullsized":"2024-09-15T22:41:27.701840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.486966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701565+0000","last_change":"2024-09-15T22:41:26.706783+0000","last_active":"2024-09-15T22:41:27.701565+0000","last_peered":"2024-09-15T22:41:27.701565+0000","last_clean":"2024-09-15T22:41:27.701565+0000","last_became_active":"2024-09-15T22:41:26.706518+0000","last_became_peered":"2024-09-15T22:41:26.706518+0000","last_unstale":"2024-09-15T22:41:27.701565+0000","last_undegraded":"2024-09-15T22:41:27.701565+0000","last_fullsized":"2024-09-15T22:41:27.701565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:11.596810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744294+0000","last_change":"2024-09-15T22:41:26.703909+0000","last_active":"2024-09-15T22:41:28.744294+0000","last_peered":"2024-09-15T22:41:28.744294+0000","last_clean":"2024-09-15T22:41:28.744294+0000","last_became_active":"2024-09-15T22:41:26.703596+0000","last_became_peered":"2024-09-15T22:41:26.703596+0000","last_unstale":"2024-09-15T22:41:28.744294+0000","last_undegraded":"2024-09-15T22:41:28.744294+0000","last_fullsized":"2024-09-15T22:41:28.744294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697926+0000","last_change":"2024-09-15T22:41:26.711096+0000","last_active":"2024-09-15T22:41:27.697926+0000","last_peered":"2024-09-15T22:41:27.697926+0000","last_clean":"2024-09-15T22:41:27.697926+0000","last_became_active":"2024-09-15T22:41:26.710825+0000","last_became_peered":"2024-09-15T22:41:26.710825+0000","last_unstale":"2024-09-15T22:41:27.697926+0000","last_undegraded":"2024-09-15T22:41:27.697926+0000","last_fullsized":"2024-09-15T22:41:27.697926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:20.909561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743281+0000","last_change":"2024-09-15T22:41:26.705332+0000","last_active":"2024-09-15T22:41:28.743281+0000","last_peered":"2024-09-15T22:41:28.743281+0000","last_clean":"2024-09-15T22:41:28.743281+0000","last_became_active":"2024-09-15T22:41:26.705041+0000","last_became_peered":"2024-09-15T22:41:26.705041+0000","last_unstale":"2024-09-15T22:41:28.743281+0000","last_undegraded":"2024-09-15T22:41:28.743281+0000","last_fullsized":"2024-09-15T22:41:28.743281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742844+0000","last_change":"2024-09-15T22:41:26.700581+0000","last_active":"2024-09-15T22:41:28.742844+0000","last_peered":"2024-09-15T22:41:28.742844+0000","last_clean":"2024-09-15T22:41:28.742844+0000","last_became_active":"2024-09-15T22:41:26.700298+0000","last_became_peered":"2024-09-15T22:41:26.700298+0000","last_unstale":"2024-09-15T22:41:28.742844+0000","last_undegraded":"2024-09-15T22:41:28.742844+0000","last_fullsized":"2024-09-15T22:41:28.742844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742899+0000","last_change":"2024-09-15T22:41:26.711782+0000","last_active":"2024-09-15T22:41:28.742899+0000","last_peered":"2024-09-15T22:41:28.742899+0000","last_clean":"2024-09-15T22:41:28.742899+0000","last_became_active":"2024-09-15T22:41:26.711523+0000","last_became_peered":"2024-09-15T22:41:26.711523+0000","last_unstale":"2024-09-15T22:41:28.742899+0000","last_undegraded":"2024-09-15T22:41:28.742899+0000","last_fullsized":"2024-09-15T22:41:28.742899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743927+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:28.743927+0000","last_peered":"2024-09-15T22:41:28.743927+0000","last_clean":"2024-09-15T22:41:28.743927+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:28.743927+0000","last_undegraded":"2024-09-15T22:41:28.743927+0000","last_fullsized":"2024-09-15T22:41:28.743927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702315+0000","last_change":"2024-09-15T22:41:26.707739+0000","last_active":"2024-09-15T22:41:27.702315+0000","last_peered":"2024-09-15T22:41:27.702315+0000","last_clean":"2024-09-15T22:41:27.702315+0000","last_became_active":"2024-09-15T22:41:26.707466+0000","last_became_peered":"2024-09-15T22:41:26.707466+0000","last_unstale":"2024-09-15T22:41:27.702315+0000","last_undegraded":"2024-09-15T22:41:27.702315+0000","last_fullsized":"2024-09-15T22:41:27.702315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698149+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:27.698149+0000","last_peered":"2024-09-15T22:41:27.698149+0000","last_clean":"2024-09-15T22:41:27.698149+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:27.698149+0000","last_undegraded":"2024-09-15T22:41:27.698149+0000","last_fullsized":"2024-09-15T22:41:27.698149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:15.504080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701240+0000","last_change":"2024-09-15T22:41:25.702016+0000","last_active":"2024-09-15T22:41:27.701240+0000","last_peered":"2024-09-15T22:41:27.701240+0000","last_clean":"2024-09-15T22:41:27.701240+0000","last_became_active":"2024-09-15T22:41:25.701650+0000","last_became_peered":"2024-09-15T22:41:25.701650+0000","last_unstale":"2024-09-15T22:41:27.701240+0000","last_undegraded":"2024-09-15T22:41:27.701240+0000","last_fullsized":"2024-09-15T22:41:27.701240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:09.408758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744370+0000","last_change":"2024-09-15T22:41:26.709592+0000","last_active":"2024-09-15T22:41:28.744370+0000","last_peered":"2024-09-15T22:41:28.744370+0000","last_clean":"2024-09-15T22:41:28.744370+0000","last_became_active":"2024-09-15T22:41:26.709146+0000","last_became_peered":"2024-09-15T22:41:26.709146+0000","last_unstale":"2024-09-15T22:41:28.744370+0000","last_undegraded":"2024-09-15T22:41:28.744370+0000","last_fullsized":"2024-09-15T22:41:28.744370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697853+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:27.697853+0000","last_peered":"2024-09-15T22:41:27.697853+0000","last_clean":"2024-09-15T22:41:27.697853+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:27.697853+0000","last_undegraded":"2024-09-15T22:41:27.697853+0000","last_fullsized":"2024-09-15T22:41:27.697853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:07.616440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701757+0000","last_change":"2024-09-15T22:41:26.708462+0000","last_active":"2024-09-15T22:41:27.701757+0000","last_peered":"2024-09-15T22:41:27.701757+0000","last_clean":"2024-09-15T22:41:27.701757+0000","last_became_active":"2024-09-15T22:41:26.708159+0000","last_became_peered":"2024-09-15T22:41:26.708159+0000","last_unstale":"2024-09-15T22:41:27.701757+0000","last_undegraded":"2024-09-15T22:41:27.701757+0000","last_fullsized":"2024-09-15T22:41:27.701757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:03.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743325+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:28.743325+0000","last_peered":"2024-09-15T22:41:28.743325+0000","last_clean":"2024-09-15T22:41:28.743325+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:28.743325+0000","last_undegraded":"2024-09-15T22:41:28.743325+0000","last_fullsized":"2024-09-15T22:41:28.743325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743496+0000","last_change":"2024-09-15T22:41:26.712084+0000","last_active":"2024-09-15T22:41:28.743496+0000","last_peered":"2024-09-15T22:41:28.743496+0000","last_clean":"2024-09-15T22:41:28.743496+0000","last_became_active":"2024-09-15T22:41:26.711768+0000","last_became_peered":"2024-09-15T22:41:26.711768+0000","last_unstale":"2024-09-15T22:41:28.743496+0000","last_undegraded":"2024-09-15T22:41:28.743496+0000","last_fullsized":"2024-09-15T22:41:28.743496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:24.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993377+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:27.993377+0000","last_peered":"2024-09-15T22:41:27.993377+0000","last_clean":"2024-09-15T22:41:27.993377+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:27.993377+0000","last_undegraded":"2024-09-15T22:41:27.993377+0000","last_fullsized":"2024-09-15T22:41:27.993377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744355+0000","last_change":"2024-09-15T22:41:26.710472+0000","last_active":"2024-09-15T22:41:28.744355+0000","last_peered":"2024-09-15T22:41:28.744355+0000","last_clean":"2024-09-15T22:41:28.744355+0000","last_became_active":"2024-09-15T22:41:26.710156+0000","last_became_peered":"2024-09-15T22:41:26.710156+0000","last_unstale":"2024-09-15T22:41:28.744355+0000","last_undegraded":"2024-09-15T22:41:28.744355+0000","last_fullsized":"2024-09-15T22:41:28.744355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743487+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:28.743487+0000","last_peered":"2024-09-15T22:41:28.743487+0000","last_clean":"2024-09-15T22:41:28.743487+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:28.743487+0000","last_undegraded":"2024-09-15T22:41:28.743487+0000","last_fullsized":"2024-09-15T22:41:28.743487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698025+0000","last_change":"2024-09-15T22:41:26.705756+0000","last_active":"2024-09-15T22:41:27.698025+0000","last_peered":"2024-09-15T22:41:27.698025+0000","last_clean":"2024-09-15T22:41:27.698025+0000","last_became_active":"2024-09-15T22:41:26.705439+0000","last_became_peered":"2024-09-15T22:41:26.705439+0000","last_unstale":"2024-09-15T22:41:27.698025+0000","last_undegraded":"2024-09-15T22:41:27.698025+0000","last_fullsized":"2024-09-15T22:41:27.698025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:50.176003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743328+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:28.743328+0000","last_peered":"2024-09-15T22:41:28.743328+0000","last_clean":"2024-09-15T22:41:28.743328+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:28.743328+0000","last_undegraded":"2024-09-15T22:41:28.743328+0000","last_fullsized":"2024-09-15T22:41:28.743328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993275+0000","last_change":"2024-09-15T22:41:26.704427+0000","last_active":"2024-09-15T22:41:27.993275+0000","last_peered":"2024-09-15T22:41:27.993275+0000","last_clean":"2024-09-15T22:41:27.993275+0000","last_became_active":"2024-09-15T22:41:26.704031+0000","last_became_peered":"2024-09-15T22:41:26.704031+0000","last_unstale":"2024-09-15T22:41:27.993275+0000","last_undegraded":"2024-09-15T22:41:27.993275+0000","last_fullsized":"2024-09-15T22:41:27.993275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743409+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:28.743409+0000","last_peered":"2024-09-15T22:41:28.743409+0000","last_clean":"2024-09-15T22:41:28.743409+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:28.743409+0000","last_undegraded":"2024-09-15T22:41:28.743409+0000","last_fullsized":"2024-09-15T22:41:28.743409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701423+0000","last_change":"2024-09-15T22:41:26.711298+0000","last_active":"2024-09-15T22:41:27.701423+0000","last_peered":"2024-09-15T22:41:27.701423+0000","last_clean":"2024-09-15T22:41:27.701423+0000","last_became_active":"2024-09-15T22:41:26.711029+0000","last_became_peered":"2024-09-15T22:41:26.711029+0000","last_unstale":"2024-09-15T22:41:27.701423+0000","last_undegraded":"2024-09-15T22:41:27.701423+0000","last_fullsized":"2024-09-15T22:41:27.701423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:29.101148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698254+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:27.698254+0000","last_peered":"2024-09-15T22:41:27.698254+0000","last_clean":"2024-09-15T22:41:27.698254+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:27.698254+0000","last_undegraded":"2024-09-15T22:41:27.698254+0000","last_fullsized":"2024-09-15T22:41:27.698254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:23.492215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697818+0000","last_change":"2024-09-15T22:41:26.709651+0000","last_active":"2024-09-15T22:41:27.697818+0000","last_peered":"2024-09-15T22:41:27.697818+0000","last_clean":"2024-09-15T22:41:27.697818+0000","last_became_active":"2024-09-15T22:41:26.709419+0000","last_became_peered":"2024-09-15T22:41:26.709419+0000","last_unstale":"2024-09-15T22:41:27.697818+0000","last_undegraded":"2024-09-15T22:41:27.697818+0000","last_fullsized":"2024-09-15T22:41:27.697818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992998+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:27.992998+0000","last_peered":"2024-09-15T22:41:27.992998+0000","last_clean":"2024-09-15T22:41:27.992998+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:27.992998+0000","last_undegraded":"2024-09-15T22:41:27.992998+0000","last_fullsized":"2024-09-15T22:41:27.992998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742983+0000","last_change":"2024-09-15T22:41:26.712445+0000","last_active":"2024-09-15T22:41:28.742983+0000","last_peered":"2024-09-15T22:41:28.742983+0000","last_clean":"2024-09-15T22:41:28.742983+0000","last_became_active":"2024-09-15T22:41:26.712201+0000","last_became_peered":"2024-09-15T22:41:26.712201+0000","last_unstale":"2024-09-15T22:41:28.742983+0000","last_undegraded":"2024-09-15T22:41:28.742983+0000","last_fullsized":"2024-09-15T22:41:28.742983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700874+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:27.700874+0000","last_peered":"2024-09-15T22:41:27.700874+0000","last_clean":"2024-09-15T22:41:27.700874+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:27.700874+0000","last_undegraded":"2024-09-15T22:41:27.700874+0000","last_fullsized":"2024-09-15T22:41:27.700874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697754+0000","last_change":"2024-09-15T22:41:26.709001+0000","last_active":"2024-09-15T22:41:27.697754+0000","last_peered":"2024-09-15T22:41:27.697754+0000","last_clean":"2024-09-15T22:41:27.697754+0000","last_became_active":"2024-09-15T22:41:26.708687+0000","last_became_peered":"2024-09-15T22:41:26.708687+0000","last_unstale":"2024-09-15T22:41:27.697754+0000","last_undegraded":"2024-09-15T22:41:27.697754+0000","last_fullsized":"2024-09-15T22:41:27.697754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993549+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:27.993549+0000","last_peered":"2024-09-15T22:41:27.993549+0000","last_clean":"2024-09-15T22:41:27.993549+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:27.993549+0000","last_undegraded":"2024-09-15T22:41:27.993549+0000","last_fullsized":"2024-09-15T22:41:27.993549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743595+0000","last_change":"2024-09-15T22:41:26.706136+0000","last_active":"2024-09-15T22:41:28.743595+0000","last_peered":"2024-09-15T22:41:28.743595+0000","last_clean":"2024-09-15T22:41:28.743595+0000","last_became_active":"2024-09-15T22:41:26.705873+0000","last_became_peered":"2024-09-15T22:41:26.705873+0000","last_unstale":"2024-09-15T22:41:28.743595+0000","last_undegraded":"2024-09-15T22:41:28.743595+0000","last_fullsized":"2024-09-15T22:41:28.743595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:21.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702040+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:27.702040+0000","last_peered":"2024-09-15T22:41:27.702040+0000","last_clean":"2024-09-15T22:41:27.702040+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:27.702040+0000","last_undegraded":"2024-09-15T22:41:27.702040+0000","last_fullsized":"2024-09-15T22:41:27.702040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993537+0000","last_change":"2024-09-15T22:41:26.706050+0000","last_active":"2024-09-15T22:41:27.993537+0000","last_peered":"2024-09-15T22:41:27.993537+0000","last_clean":"2024-09-15T22:41:27.993537+0000","last_became_active":"2024-09-15T22:41:26.705788+0000","last_became_peered":"2024-09-15T22:41:26.705788+0000","last_unstale":"2024-09-15T22:41:27.993537+0000","last_undegraded":"2024-09-15T22:41:27.993537+0000","last_fullsized":"2024-09-15T22:41:27.993537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743774+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:28.743774+0000","last_peered":"2024-09-15T22:41:28.743774+0000","last_clean":"2024-09-15T22:41:28.743774+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:28.743774+0000","last_undegraded":"2024-09-15T22:41:28.743774+0000","last_fullsized":"2024-09-15T22:41:28.743774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993353+0000","last_change":"2024-09-15T22:41:26.707289+0000","last_active":"2024-09-15T22:41:27.993353+0000","last_peered":"2024-09-15T22:41:27.993353+0000","last_clean":"2024-09-15T22:41:27.993353+0000","last_became_active":"2024-09-15T22:41:26.706675+0000","last_became_peered":"2024-09-15T22:41:26.706675+0000","last_unstale":"2024-09-15T22:41:27.993353+0000","last_undegraded":"2024-09-15T22:41:27.993353+0000","last_fullsized":"2024-09-15T22:41:27.993353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701675+0000","last_change":"2024-09-15T22:41:25.702075+0000","last_active":"2024-09-15T22:41:27.701675+0000","last_peered":"2024-09-15T22:41:27.701675+0000","last_clean":"2024-09-15T22:41:27.701675+0000","last_became_active":"2024-09-15T22:41:25.701608+0000","last_became_peered":"2024-09-15T22:41:25.701608+0000","last_unstale":"2024-09-15T22:41:27.701675+0000","last_undegraded":"2024-09-15T22:41:27.701675+0000","last_fullsized":"2024-09-15T22:41:27.701675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:27.717750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698233+0000","last_change":"2024-09-15T22:41:26.706857+0000","last_active":"2024-09-15T22:41:27.698233+0000","last_peered":"2024-09-15T22:41:27.698233+0000","last_clean":"2024-09-15T22:41:27.698233+0000","last_became_active":"2024-09-15T22:41:26.706264+0000","last_became_peered":"2024-09-15T22:41:26.706264+0000","last_unstale":"2024-09-15T22:41:27.698233+0000","last_undegraded":"2024-09-15T22:41:27.698233+0000","last_fullsized":"2024-09-15T22:41:27.698233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:21.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743113+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:28.743113+0000","last_peered":"2024-09-15T22:41:28.743113+0000","last_clean":"2024-09-15T22:41:28.743113+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:28.743113+0000","last_undegraded":"2024-09-15T22:41:28.743113+0000","last_fullsized":"2024-09-15T22:41:28.743113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697987+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:27.697987+0000","last_peered":"2024-09-15T22:41:27.697987+0000","last_clean":"2024-09-15T22:41:27.697987+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:27.697987+0000","last_undegraded":"2024-09-15T22:41:27.697987+0000","last_fullsized":"2024-09-15T22:41:27.697987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:18.109760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702043+0000","last_change":"2024-09-15T22:41:26.698424+0000","last_active":"2024-09-15T22:41:27.702043+0000","last_peered":"2024-09-15T22:41:27.702043+0000","last_clean":"2024-09-15T22:41:27.702043+0000","last_became_active":"2024-09-15T22:41:26.697457+0000","last_became_peered":"2024-09-15T22:41:26.697457+0000","last_unstale":"2024-09-15T22:41:27.702043+0000","last_undegraded":"2024-09-15T22:41:27.702043+0000","last_fullsized":"2024-09-15T22:41:27.702043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:45.987437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697860+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:27.697860+0000","last_peered":"2024-09-15T22:41:27.697860+0000","last_clean":"2024-09-15T22:41:27.697860+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:27.697860+0000","last_undegraded":"2024-09-15T22:41:27.697860+0000","last_fullsized":"2024-09-15T22:41:27.697860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:20.614195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701274+0000","last_change":"2024-09-15T22:41:26.697850+0000","last_active":"2024-09-15T22:41:27.701274+0000","last_peered":"2024-09-15T22:41:27.701274+0000","last_clean":"2024-09-15T22:41:27.701274+0000","last_became_active":"2024-09-15T22:41:26.697079+0000","last_became_peered":"2024-09-15T22:41:26.697079+0000","last_unstale":"2024-09-15T22:41:27.701274+0000","last_undegraded":"2024-09-15T22:41:27.701274+0000","last_fullsized":"2024-09-15T22:41:27.701274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:59.477248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743343+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:28.743343+0000","last_peered":"2024-09-15T22:41:28.743343+0000","last_clean":"2024-09-15T22:41:28.743343+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:28.743343+0000","last_undegraded":"2024-09-15T22:41:28.743343+0000","last_fullsized":"2024-09-15T22:41:28.743343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743627+0000","last_change":"2024-09-15T22:41:26.704828+0000","last_active":"2024-09-15T22:41:28.743627+0000","last_peered":"2024-09-15T22:41:28.743627+0000","last_clean":"2024-09-15T22:41:28.743627+0000","last_became_active":"2024-09-15T22:41:26.704229+0000","last_became_peered":"2024-09-15T22:41:26.704229+0000","last_unstale":"2024-09-15T22:41:28.743627+0000","last_undegraded":"2024-09-15T22:41:28.743627+0000","last_fullsized":"2024-09-15T22:41:28.743627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698347+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:27.698347+0000","last_peered":"2024-09-15T22:41:27.698347+0000","last_clean":"2024-09-15T22:41:27.698347+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:27.698347+0000","last_undegraded":"2024-09-15T22:41:27.698347+0000","last_fullsized":"2024-09-15T22:41:27.698347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:51.139105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993112+0000","last_change":"2024-09-15T22:41:26.707722+0000","last_active":"2024-09-15T22:41:27.993112+0000","last_peered":"2024-09-15T22:41:27.993112+0000","last_clean":"2024-09-15T22:41:27.993112+0000","last_became_active":"2024-09-15T22:41:26.706692+0000","last_became_peered":"2024-09-15T22:41:26.706692+0000","last_unstale":"2024-09-15T22:41:27.993112+0000","last_undegraded":"2024-09-15T22:41:27.993112+0000","last_fullsized":"2024-09-15T22:41:27.993112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743904+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:28.743904+0000","last_peered":"2024-09-15T22:41:28.743904+0000","last_clean":"2024-09-15T22:41:28.743904+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:28.743904+0000","last_undegraded":"2024-09-15T22:41:28.743904+0000","last_fullsized":"2024-09-15T22:41:28.743904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743222+0000","last_change":"2024-09-15T22:41:26.700622+0000","last_active":"2024-09-15T22:41:28.743222+0000","last_peered":"2024-09-15T22:41:28.743222+0000","last_clean":"2024-09-15T22:41:28.743222+0000","last_became_active":"2024-09-15T22:41:26.700351+0000","last_became_peered":"2024-09-15T22:41:26.700351+0000","last_unstale":"2024-09-15T22:41:28.743222+0000","last_undegraded":"2024-09-15T22:41:28.743222+0000","last_fullsized":"2024-09-15T22:41:28.743222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698400+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:27.698400+0000","last_peered":"2024-09-15T22:41:27.698400+0000","last_clean":"2024-09-15T22:41:27.698400+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:27.698400+0000","last_undegraded":"2024-09-15T22:41:27.698400+0000","last_fullsized":"2024-09-15T22:41:27.698400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701650+0000","last_change":"2024-09-15T22:41:26.698859+0000","last_active":"2024-09-15T22:41:27.701650+0000","last_peered":"2024-09-15T22:41:27.701650+0000","last_clean":"2024-09-15T22:41:27.701650+0000","last_became_active":"2024-09-15T22:41:26.698599+0000","last_became_peered":"2024-09-15T22:41:26.698599+0000","last_unstale":"2024-09-15T22:41:27.701650+0000","last_undegraded":"2024-09-15T22:41:27.701650+0000","last_fullsized":"2024-09-15T22:41:27.701650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:22.754810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702200+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:27.702200+0000","last_peered":"2024-09-15T22:41:27.702200+0000","last_clean":"2024-09-15T22:41:27.702200+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:27.702200+0000","last_undegraded":"2024-09-15T22:41:27.702200+0000","last_fullsized":"2024-09-15T22:41:27.702200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702397+0000","last_change":"2024-09-15T22:41:26.700100+0000","last_active":"2024-09-15T22:41:27.702397+0000","last_peered":"2024-09-15T22:41:27.702397+0000","last_clean":"2024-09-15T22:41:27.702397+0000","last_became_active":"2024-09-15T22:41:26.699340+0000","last_became_peered":"2024-09-15T22:41:26.699340+0000","last_unstale":"2024-09-15T22:41:27.702397+0000","last_undegraded":"2024-09-15T22:41:27.702397+0000","last_fullsized":"2024-09-15T22:41:27.702397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698274+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:27.698274+0000","last_peered":"2024-09-15T22:41:27.698274+0000","last_clean":"2024-09-15T22:41:27.698274+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:27.698274+0000","last_undegraded":"2024-09-15T22:41:27.698274+0000","last_fullsized":"2024-09-15T22:41:27.698274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701941+0000","last_change":"2024-09-15T22:41:26.702213+0000","last_active":"2024-09-15T22:41:27.701941+0000","last_peered":"2024-09-15T22:41:27.701941+0000","last_clean":"2024-09-15T22:41:27.701941+0000","last_became_active":"2024-09-15T22:41:26.701964+0000","last_became_peered":"2024-09-15T22:41:26.701964+0000","last_unstale":"2024-09-15T22:41:27.701941+0000","last_undegraded":"2024-09-15T22:41:27.701941+0000","last_fullsized":"2024-09-15T22:41:27.701941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:41.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992836+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:27.992836+0000","last_peered":"2024-09-15T22:41:27.992836+0000","last_clean":"2024-09-15T22:41:27.992836+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:27.992836+0000","last_undegraded":"2024-09-15T22:41:27.992836+0000","last_fullsized":"2024-09-15T22:41:27.992836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697762+0000","last_change":"2024-09-15T22:41:26.708970+0000","last_active":"2024-09-15T22:41:27.697762+0000","last_peered":"2024-09-15T22:41:27.697762+0000","last_clean":"2024-09-15T22:41:27.697762+0000","last_became_active":"2024-09-15T22:41:26.708421+0000","last_became_peered":"2024-09-15T22:41:26.708421+0000","last_unstale":"2024-09-15T22:41:27.697762+0000","last_undegraded":"2024-09-15T22:41:27.697762+0000","last_fullsized":"2024-09-15T22:41:27.697762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701850+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:27.701850+0000","last_peered":"2024-09-15T22:41:27.701850+0000","last_clean":"2024-09-15T22:41:27.701850+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:27.701850+0000","last_undegraded":"2024-09-15T22:41:27.701850+0000","last_fullsized":"2024-09-15T22:41:27.701850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700932+0000","last_change":"2024-09-15T22:41:26.704333+0000","last_active":"2024-09-15T22:41:27.700932+0000","last_peered":"2024-09-15T22:41:27.700932+0000","last_clean":"2024-09-15T22:41:27.700932+0000","last_became_active":"2024-09-15T22:41:26.704001+0000","last_became_peered":"2024-09-15T22:41:26.704001+0000","last_unstale":"2024-09-15T22:41:27.700932+0000","last_undegraded":"2024-09-15T22:41:27.700932+0000","last_fullsized":"2024-09-15T22:41:27.700932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:16.328494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701465+0000","last_change":"2024-09-15T22:41:25.702682+0000","last_active":"2024-09-15T22:41:27.701465+0000","last_peered":"2024-09-15T22:41:27.701465+0000","last_clean":"2024-09-15T22:41:27.701465+0000","last_became_active":"2024-09-15T22:41:25.702368+0000","last_became_peered":"2024-09-15T22:41:25.702368+0000","last_unstale":"2024-09-15T22:41:27.701465+0000","last_undegraded":"2024-09-15T22:41:27.701465+0000","last_fullsized":"2024-09-15T22:41:27.701465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.825332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743470+0000","last_change":"2024-09-15T22:41:26.701366+0000","last_active":"2024-09-15T22:41:28.743470+0000","last_peered":"2024-09-15T22:41:28.743470+0000","last_clean":"2024-09-15T22:41:28.743470+0000","last_became_active":"2024-09-15T22:41:26.701105+0000","last_became_peered":"2024-09-15T22:41:26.701105+0000","last_unstale":"2024-09-15T22:41:28.743470+0000","last_undegraded":"2024-09-15T22:41:28.743470+0000","last_fullsized":"2024-09-15T22:41:28.743470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697909+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:27.697909+0000","last_peered":"2024-09-15T22:41:27.697909+0000","last_clean":"2024-09-15T22:41:27.697909+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:27.697909+0000","last_undegraded":"2024-09-15T22:41:27.697909+0000","last_fullsized":"2024-09-15T22:41:27.697909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697994+0000","last_change":"2024-09-15T22:41:26.707872+0000","last_active":"2024-09-15T22:41:27.697994+0000","last_peered":"2024-09-15T22:41:27.697994+0000","last_clean":"2024-09-15T22:41:27.697994+0000","last_became_active":"2024-09-15T22:41:26.707598+0000","last_became_peered":"2024-09-15T22:41:26.707598+0000","last_unstale":"2024-09-15T22:41:27.697994+0000","last_undegraded":"2024-09-15T22:41:27.697994+0000","last_fullsized":"2024-09-15T22:41:27.697994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698210+0000","last_change":"2024-09-15T22:41:26.707659+0000","last_active":"2024-09-15T22:41:27.698210+0000","last_peered":"2024-09-15T22:41:27.698210+0000","last_clean":"2024-09-15T22:41:27.698210+0000","last_became_active":"2024-09-15T22:41:26.707159+0000","last_became_peered":"2024-09-15T22:41:26.707159+0000","last_unstale":"2024-09-15T22:41:27.698210+0000","last_undegraded":"2024-09-15T22:41:27.698210+0000","last_fullsized":"2024-09-15T22:41:27.698210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:24.277275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993467+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:27.993467+0000","last_peered":"2024-09-15T22:41:27.993467+0000","last_clean":"2024-09-15T22:41:27.993467+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:27.993467+0000","last_undegraded":"2024-09-15T22:41:27.993467+0000","last_fullsized":"2024-09-15T22:41:27.993467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743049+0000","last_change":"2024-09-15T22:41:26.710722+0000","last_active":"2024-09-15T22:41:28.743049+0000","last_peered":"2024-09-15T22:41:28.743049+0000","last_clean":"2024-09-15T22:41:28.743049+0000","last_became_active":"2024-09-15T22:41:26.709829+0000","last_became_peered":"2024-09-15T22:41:26.709829+0000","last_unstale":"2024-09-15T22:41:28.743049+0000","last_undegraded":"2024-09-15T22:41:28.743049+0000","last_fullsized":"2024-09-15T22:41:28.743049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993304+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:27.993304+0000","last_peered":"2024-09-15T22:41:27.993304+0000","last_clean":"2024-09-15T22:41:27.993304+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:27.993304+0000","last_undegraded":"2024-09-15T22:41:27.993304+0000","last_fullsized":"2024-09-15T22:41:27.993304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744150+0000","last_change":"2024-09-15T22:41:26.704494+0000","last_active":"2024-09-15T22:41:28.744150+0000","last_peered":"2024-09-15T22:41:28.744150+0000","last_clean":"2024-09-15T22:41:28.744150+0000","last_became_active":"2024-09-15T22:41:26.703887+0000","last_became_peered":"2024-09-15T22:41:26.703887+0000","last_unstale":"2024-09-15T22:41:28.744150+0000","last_undegraded":"2024-09-15T22:41:28.744150+0000","last_fullsized":"2024-09-15T22:41:28.744150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744057+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:28.744057+0000","last_peered":"2024-09-15T22:41:28.744057+0000","last_clean":"2024-09-15T22:41:28.744057+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:28.744057+0000","last_undegraded":"2024-09-15T22:41:28.744057+0000","last_fullsized":"2024-09-15T22:41:28.744057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744111+0000","last_change":"2024-09-15T22:41:26.706602+0000","last_active":"2024-09-15T22:41:28.744111+0000","last_peered":"2024-09-15T22:41:28.744111+0000","last_clean":"2024-09-15T22:41:28.744111+0000","last_became_active":"2024-09-15T22:41:26.706228+0000","last_became_peered":"2024-09-15T22:41:26.706228+0000","last_unstale":"2024-09-15T22:41:28.744111+0000","last_undegraded":"2024-09-15T22:41:28.744111+0000","last_fullsized":"2024-09-15T22:41:28.744111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702368+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:27.702368+0000","last_peered":"2024-09-15T22:41:27.702368+0000","last_clean":"2024-09-15T22:41:27.702368+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:27.702368+0000","last_undegraded":"2024-09-15T22:41:27.702368+0000","last_fullsized":"2024-09-15T22:41:27.702368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:34.336 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:41:34.336 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:41:34.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:41:34.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T22:41:34.337 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T22:41:34.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.468+0000 7f220bca6640 1 Processor -- start 2024-09-15T22:41:34.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.468+0000 7f220bca6640 1 -- start start 2024-09-15T22:41:34.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f22040d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f220415ca40 0x7f220415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 0x7f22041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f22040d0bc0 con 0x7f220415ca40 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f220415d390 con 0x7f220415ce80 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220bca6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f220415d670 con 0x7f22040d02a0 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f220415ca40 0x7f220415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f220415ca40 0x7f220415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37252/0 (socket says 172.21.15.134:37252) 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 -- 172.21.15.134:0/3439303363 learned_addr learned my addr 172.21.15.134:0/3439303363 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220a243640 1 --2- 172.21.15.134:0/3439303363 >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 0x7f22041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209a42640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f22040d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 -- 172.21.15.134:0/3439303363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 msgr2=0x7f22040d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f22040d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 -- 172.21.15.134:0/3439303363 >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 msgr2=0x7f22041594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:34.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 --2- 172.21.15.134:0/3439303363 >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 0x7f22041594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f2209241640 1 -- 172.21.15.134:0/3439303363 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220415d950 con 0x7f220415ca40 2024-09-15T22:41:34.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.469+0000 7f220a243640 1 --2- 172.21.15.134:0/3439303363 >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 0x7f22041594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f2209241640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f220415e430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f220406cd20 tx=0x7f220002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227baf4dc275fb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f2208a40640 1 -- 172.21.15.134:0/3439303363 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200037070 con 0x7f220415ca40 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f2208a40640 1 -- 172.21.15.134:0/3439303363 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2200032440 con 0x7f220415ca40 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f2208a40640 1 -- 172.21.15.134:0/3439303363 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200032810 con 0x7f220415ca40 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 -- 172.21.15.134:0/3439303363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 msgr2=0x7f220415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f220415e430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f220406cd20 tx=0x7f220002a140 comp rx=0 tx=0).stop 2024-09-15T22:41:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 -- 172.21.15.134:0/3439303363 shutdown_connections 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 --2- 172.21.15.134:0/3439303363 >> v2:172.21.15.177:3300/0 conn(0x7f220415ce80 0x7f22041594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f220415e430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 --2- 172.21.15.134:0/3439303363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f22040d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.470+0000 7f220bca6640 1 -- 172.21.15.134:0/3439303363 >> 172.21.15.134:0/3439303363 conn(0x7f2204062cc0 msgr2=0x7f220406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.471+0000 7f220bca6640 1 -- 172.21.15.134:0/3439303363 shutdown_connections 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.471+0000 7f220bca6640 1 -- 172.21.15.134:0/3439303363 wait complete. 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 Processor -- start 2024-09-15T22:41:34.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 -- start start 2024-09-15T22:41:34.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f2204147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 0x7f220406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2204155b90 con 0x7f220415ca40 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f220415df10 con 0x7f220415ce80 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f220bca6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2204155d10 con 0x7f22040d02a0 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f2209241640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f2209241640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37258/0 (socket says 172.21.15.134:37258) 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.472+0000 7f2209241640 1 -- 172.21.15.134:0/2989289700 learned_addr learned my addr 172.21.15.134:0/2989289700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f220a243640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 0x7f220406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209a42640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f2204147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 -- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 msgr2=0x7f2204147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f2204147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 -- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 msgr2=0x7f220406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 0x7f220406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 -- 172.21.15.134:0/2989289700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22041599e0 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f220a243640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 0x7f220406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f2209241640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2200000c00 tx=0x7f22000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200041020 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22000306c0 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220415ae30 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200037040 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.473+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2204071480 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.474+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22040b4790 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.474+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2200044020 con 0x7f220415ca40 2024-09-15T22:41:34.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.475+0000 7f21fa7fc640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 0x7f21e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.475+0000 7f2209a42640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 0x7f21e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.475+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f22000abbe0 con 0x7f220415ca40 2024-09-15T22:41:34.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.475+0000 7f2209a42640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 0x7f21e806e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006fd0 tx=0x7f21f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.479+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f220004b030 con 0x7f220415ca40 2024-09-15T22:41:34.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.690+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f220406c8e0 con 0x7f220415ca40 2024-09-15T22:41:34.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.693+0000 7f21fa7fc640 1 -- 172.21.15.134:0/2989289700 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173509 (secure 0 0 0) 0x7f220007a3e0 con 0x7f220415ca40 2024-09-15T22:41:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:34.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 msgr2=0x7f21e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 0x7f21e806e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006fd0 tx=0x7f21f4008040 comp rx=0 tx=0).stop 2024-09-15T22:41:34.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 msgr2=0x7f22041594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2200000c00 tx=0x7f22000046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 shutdown_connections 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21e806c2b0 0x7f21e806e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220415ce80 0x7f220406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f220415ca40 0x7f22041594a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 --2- 172.21.15.134:0/2989289700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22040d02a0 0x7f2204147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 >> 172.21.15.134:0/2989289700 conn(0x7f2204062cc0 msgr2=0x7f220406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 shutdown_connections 2024-09-15T22:41:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.695+0000 7f220bca6640 1 -- 172.21.15.134:0/2989289700 wait complete. 2024-09-15T22:41:34.708 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":210106985},{"type":"v1","addr":"172.21.15.134:6825","nonce":210106985}]},"active_addr":"172.21.15.134:6825/210106985","active_change":"2024-09-15T22:41:06.939854+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1996904897}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2765650614}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2745699943}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2376424591}]}]} 2024-09-15T22:41:34.712 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T22:41:34.712 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T22:41:34.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:34.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.808+0000 7f339fea6640 1 Processor -- start 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.809+0000 7f339fea6640 1 -- start start 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.809+0000 7f339fea6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f339815c690 0x7f33980b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.809+0000 7f339fea6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3398073da0 con 0x7f33980b4290 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.809+0000 7f339fea6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3398074060 con 0x7f33980b1980 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.809+0000 7f339fea6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f33980b6aa0 con 0x7f339815c690 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339dc42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f339815c690 0x7f33980b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339e443640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f33980b4290 0x7f33980b6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41908/0 (socket says 172.21.15.134:41908) 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339e443640 1 -- 172.21.15.134:0/1999061606 learned_addr learned my addr 172.21.15.134:0/1999061606 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:34.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339dc42640 1 -- 172.21.15.134:0/1999061606 >> v1:172.21.15.177:6789/0 conn(0x7f33980b1980 legacy=0x7f33980d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:34.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339dc42640 1 -- 172.21.15.134:0/1999061606 >> v1:172.21.15.134:6789/0 conn(0x7f33980b4290 legacy=0x7f33980b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339dc42640 1 -- 172.21.15.134:0/1999061606 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33980733a0 con 0x7f339815c690 2024-09-15T22:41:34.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.810+0000 7f339cc40640 1 -- 172.21.15.134:0/1999061606 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227410875 0 0) 0x7f3398073da0 con 0x7f33980b4290 2024-09-15T22:41:34.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339dc42640 1 --2- 172.21.15.134:0/1999061606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339815c690 0x7f33980b6010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f338c0097a0 tx=0x7f338c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112b951343e26567 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339cc40640 1 -- 172.21.15.134:0/1999061606 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c037070 con 0x7f339815c690 2024-09-15T22:41:34.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339cc40640 1 -- 172.21.15.134:0/1999061606 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c032440 con 0x7f339815c690 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339cc40640 1 -- 172.21.15.134:0/1999061606 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c032810 con 0x7f339815c690 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 -- 172.21.15.134:0/1999061606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339815c690 msgr2=0x7f33980b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 --2- 172.21.15.134:0/1999061606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339815c690 0x7f33980b6010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f338c0097a0 tx=0x7f338c02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 -- 172.21.15.134:0/1999061606 shutdown_connections 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 --2- 172.21.15.134:0/1999061606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339815c690 0x7f33980b6010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 -- 172.21.15.134:0/1999061606 >> 172.21.15.134:0/1999061606 conn(0x7f3398062630 msgr2=0x7f3398062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 -- 172.21.15.134:0/1999061606 shutdown_connections 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.811+0000 7f339fea6640 1 -- 172.21.15.134:0/1999061606 wait complete. 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.812+0000 7f339fea6640 1 Processor -- start 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.812+0000 7f339fea6640 1 -- start start 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33980b4290 0x7f339806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339815c690 0x7f339814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33980d0dd0 con 0x7f33980b1980 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33980d0c50 con 0x7f339815c690 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339fea6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f33980b76d0 con 0x7f33980b4290 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339dc42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339dc42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37274/0 (socket says 172.21.15.134:37274) 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339dc42640 1 -- 172.21.15.134:0/1192434825 learned_addr learned my addr 172.21.15.134:0/1192434825 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339e443640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339815c690 0x7f339814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.813+0000 7f339d441640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33980b4290 0x7f339806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 -- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33980b4290 msgr2=0x7f339806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33980b4290 0x7f339806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 -- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339815c690 msgr2=0x7f339814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339815c690 0x7f339814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 -- 172.21.15.134:0/1192434825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339815d390 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339dc42640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f338c0098c0 tx=0x7f338c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c041070 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c03c870 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339806ddc0 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c037040 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.814+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339806e380 con 0x7f33980b1980 2024-09-15T22:41:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.815+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33980b6010 con 0x7f33980b1980 2024-09-15T22:41:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.815+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f338c044070 con 0x7f33980b1980 2024-09-15T22:41:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.816+0000 7f338a7fc640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 0x7f337c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.816+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f338c0abef0 con 0x7f33980b1980 2024-09-15T22:41:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.816+0000 7f339d441640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 0x7f337c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.816+0000 7f339d441640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 0x7f337c06e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3398160010 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:34.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.820+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f338c07a130 con 0x7f33980b1980 2024-09-15T22:41:34.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.988+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33980b3cc0 con 0x7f33980b1980 2024-09-15T22:41:34.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.989+0000 7f338a7fc640 1 -- 172.21.15.134:0/1192434825 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7f338c07e430 con 0x7f33980b1980 2024-09-15T22:41:34.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:34.991 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 msgr2=0x7f337c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 0x7f337c06e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3398160010 tx=0x7f3394009040 comp rx=0 tx=0).stop 2024-09-15T22:41:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 msgr2=0x7f339815f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f338c0098c0 tx=0x7f338c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 shutdown_connections 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337c06c2b0 0x7f337c06e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339815c690 0x7f339814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33980b4290 0x7f339806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 --2- 172.21.15.134:0/1192434825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33980b1980 0x7f339815f5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 >> 172.21.15.134:0/1192434825 conn(0x7f3398062630 msgr2=0x7f33980b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 shutdown_connections 2024-09-15T22:41:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:34.992+0000 7f339fea6640 1 -- 172.21.15.134:0/1192434825 wait complete. 2024-09-15T22:41:35.005 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T22:41:35.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:35.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.102+0000 7f1f6d827640 1 Processor -- start 2024-09-15T22:41:35.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.102+0000 7f1f6d827640 1 -- start start 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f6d827640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1f680b8f90 0x7f1f680b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f6d827640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680b7170 con 0x7f1f6815ed20 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f6d827640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680b7aa0 con 0x7f1f6815e940 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f6d827640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1f680d3660 con 0x7f1f680b8f90 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f667fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1f6815ed20 0x7f1f680b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41916/0 (socket says 172.21.15.134:41916) 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f667fc640 1 -- 172.21.15.134:0/410008896 learned_addr learned my addr 172.21.15.134:0/410008896 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f677fe640 1 --2- 172.21.15.134:0/410008896 >> v2:172.21.15.177:3300/0 conn(0x7f1f680b8f90 0x7f1f680b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116751711 0 0) 0x7f1f5c001110 con 0x7f1f6815ed20 2024-09-15T22:41:35.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.103+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f50003520 con 0x7f1f6815ed20 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2492202792 0 0) 0x7f1f50003520 con 0x7f1f6815ed20 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 >> v2:172.21.15.177:3300/0 conn(0x7f1f680b8f90 msgr2=0x7f1f680b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 --2- 172.21.15.134:0/410008896 >> v2:172.21.15.177:3300/0 conn(0x7f1f680b8f90 0x7f1f680b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 >> v1:172.21.15.177:6789/0 conn(0x7f1f6815e940 legacy=0x7f1f680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680d3940 con 0x7f1f6815ed20 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f1f5c001840 con 0x7f1f6815ed20 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 >> v1:172.21.15.134:6789/0 conn(0x7f1f6815ed20 legacy=0x7f1f680b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f500039b0 0x7f1f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 0x7f1f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f500051c0 0x7f1f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680d3660 con 0x7f1f50004800 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5000c070 con 0x7f1f500039b0 2024-09-15T22:41:35.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5000c270 con 0x7f1f500051c0 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 0x7f1f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f66ffd640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f500039b0 0x7f1f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f677fe640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f500051c0 0x7f1f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 -- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f500051c0 msgr2=0x7f1f5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f500051c0 0x7f1f5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 -- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f500039b0 msgr2=0x7f1f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f500039b0 0x7f1f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f667fc640 1 -- 172.21.15.134:0/410008896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f50003520 con 0x7f1f50004800 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.104+0000 7f1f677fe640 1 -- 172.21.15.134:0/410008896 reap_dead start 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f667fc640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 0x7f1f50004c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c490 tx=0x7f1f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cd91eb771a2216 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00c0e0 con 0x7f1f50004800 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c02c040 con 0x7f1f50004800 2024-09-15T22:41:35.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f65ffb640 1 -- 172.21.15.134:0/410008896 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c005d70 con 0x7f1f50004800 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f6d827640 1 -- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 msgr2=0x7f1f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f6d827640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 0x7f1f50004c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c490 tx=0x7f1f50005830 comp rx=0 tx=0).stop 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f6d827640 1 -- 172.21.15.134:0/410008896 shutdown_connections 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f6d827640 1 --2- 172.21.15.134:0/410008896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50004800 0x7f1f50004c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.105+0000 7f1f6d827640 1 -- 172.21.15.134:0/410008896 >> 172.21.15.134:0/410008896 conn(0x7f1f680b6240 msgr2=0x7f1f680b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.106+0000 7f1f6d827640 1 -- 172.21.15.134:0/410008896 shutdown_connections 2024-09-15T22:41:35.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.106+0000 7f1f6d827640 1 -- 172.21.15.134:0/410008896 wait complete. 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.107+0000 7f1f6d827640 1 Processor -- start 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.107+0000 7f1f6d827640 1 -- start start 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f50004800 0x7f1f68150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f680c8260 0x7f1f680c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680d1ef0 con 0x7f1f6815d400 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680d3f00 con 0x7f1f50004800 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1f680d2070 con 0x7f1f680c8260 2024-09-15T22:41:35.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37296/0 (socket says 172.21.15.134:37296) 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 -- 172.21.15.134:0/3121795318 learned_addr learned my addr 172.21.15.134:0/3121795318 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f66ffd640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f50004800 0x7f1f68150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f677fe640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f680c8260 0x7f1f680c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 -- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f680c8260 msgr2=0x7f1f680c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f680c8260 0x7f1f680c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 -- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f50004800 msgr2=0x7f1f68150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f50004800 0x7f1f68150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 -- 172.21.15.134:0/3121795318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680c8c20 con 0x7f1f6815d400 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f667fc640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c5b0 tx=0x7f1f680d3b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c007270 con 0x7f1f6815d400 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c043070 con 0x7f1f6815d400 2024-09-15T22:41:35.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c007610 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f680c8e90 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.108+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f680c9450 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.109+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f680cf020 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.110+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f5c048460 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.110+0000 7f1f4ffff640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 0x7f1f5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.110+0000 7f1f66ffd640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 0x7f1f5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.110+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1f5c0abc90 con 0x7f1f6815d400 2024-09-15T22:41:35.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.111+0000 7f1f66ffd640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 0x7f1f5406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f58000f80 tx=0x7f1f58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.115+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f5c04d020 con 0x7f1f6815d400 2024-09-15T22:41:35.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.279+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f680ba6b0 con 0x7f1f6815d400 2024-09-15T22:41:35.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.280+0000 7f1f4ffff640 1 -- 172.21.15.134:0/3121795318 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7f1f680b7170 con 0x7f1f6815d400 2024-09-15T22:41:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:35.282 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:35.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 msgr2=0x7f1f5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 0x7f1f5406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f58000f80 tx=0x7f1f58009040 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 msgr2=0x7f1f6815d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c5b0 tx=0x7f1f680d3b10 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 shutdown_connections 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1f5406c2b0 0x7f1f5406e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f680c8260 0x7f1f680c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6815d400 0x7f1f6815d840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 --2- 172.21.15.134:0/3121795318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f50004800 0x7f1f68150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 >> 172.21.15.134:0/3121795318 conn(0x7f1f680b6240 msgr2=0x7f1f68160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 shutdown_connections 2024-09-15T22:41:35.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.282+0000 7f1f6d827640 1 -- 172.21.15.134:0/3121795318 wait complete. 2024-09-15T22:41:35.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T22:41:35.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T22:41:35.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T22:41:35.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T22:41:35.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T22:41:35.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T22:41:35.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T22:41:35.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T22:41:35.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.460+0000 7f8a82303640 1 Processor -- start 2024-09-15T22:41:35.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.461+0000 7f8a82303640 1 -- start start 2024-09-15T22:41:35.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7fc9e359e640 1 Processor -- start 2024-09-15T22:41:35.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7fc9e359e640 1 -- start start 2024-09-15T22:41:35.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f6c868d7640 1 Processor -- start 2024-09-15T22:41:35.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f6c868d7640 1 -- start start 2024-09-15T22:41:35.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc7ad443640 1 Processor -- start 2024-09-15T22:41:35.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc7ad443640 1 -- start start 2024-09-15T22:41:35.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc9e359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc9e359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 0x7fc9dc04ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc9e359e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9dc006f80 con 0x7fc9dc036010 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc9e359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc9dc006d30 con 0x7fc9dc04eb50 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7fc9e359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc007260 con 0x7fc9dc00b760 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a82303640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a7c0b2b30 0x7f8a7c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a82303640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a82303640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c0cce30 con 0x7f8a7c1582c0 2024-09-15T22:41:35.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a82303640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c06c860 con 0x7f8a7c0b2b30 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a82303640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cda40 con 0x7f8a7c06beb0 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a7bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8a7c1582c0 0x7f8a7c0cfab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41924/0 (socket says 172.21.15.134:41924) 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a7bfff640 1 -- 172.21.15.134:0/1687456240 learned_addr learned my addr 172.21.15.134:0/1687456240 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f571239f640 1 Processor -- start 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a7b7fe640 1 --2- 172.21.15.134:0/1687456240 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c0b2b30 0x7f8a7c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.463+0000 7f8a808a0640 1 --2- 172.21.15.134:0/1687456240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f8a808a0640 1 -- 172.21.15.134:0/1687456240 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c0b2b30 msgr2=0x7f8a7c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f8a808a0640 1 --2- 172.21.15.134:0/1687456240 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c0b2b30 0x7f8a7c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f8a808a0640 1 -- 172.21.15.134:0/1687456240 >> v1:172.21.15.134:6789/0 conn(0x7f8a7c1582c0 legacy=0x7f8a7c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.464+0000 7f8a808a0640 1 -- 172.21.15.134:0/1687456240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0cd110 con 0x7f8a7c06beb0 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f6c868d7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c8015f100 0x7f6c8015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59692/0 (socket says 172.21.15.134:59692) 2024-09-15T22:41:35.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 -- 172.21.15.134:0/504745364 learned_addr learned my addr 172.21.15.134:0/504745364 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e1d9b640 1 --2- 172.21.15.134:0/504745364 >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 0x7fc9dc04ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 -- 172.21.15.134:0/504745364 >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 msgr2=0x7fc9dc04ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f8a808a0640 1 --2- 172.21.15.134:0/1687456240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c06c320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009d90 tx=0x7f8a7402a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e15d963c0911e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f6c7ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c8015f100 0x7f6c8015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f6c7ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c8015f100 0x7f6c8015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37298/0 (socket says 172.21.15.134:37298) 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f6c868d7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c80162980 0x7f6c8015e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f6c7ffff640 1 -- 172.21.15.134:0/3186518934 learned_addr learned my addr 172.21.15.134:0/3186518934 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 --2- 172.21.15.134:0/504745364 >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 0x7fc9dc04ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7fc9e259c640 1 -- 172.21.15.134:0/504745364 >> v1:172.21.15.134:6789/0 conn(0x7fc9dc036010 legacy=0x7fc9dc036480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c868d7640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c800b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.465+0000 7f571239f640 1 -- start start 2024-09-15T22:41:35.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f8a7affd640 1 -- 172.21.15.134:0/1687456240 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74007740 con 0x7f8a7c06beb0 2024-09-15T22:41:35.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c777fe640 1 --2- 172.21.15.134:0/3186518934 >> v2:172.21.15.177:3300/0 conn(0x7f6c80162980 0x7f6c8015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c84e74640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c800b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6c80144aa0 con 0x7f6c8015f100 2024-09-15T22:41:35.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f8a7affd640 1 -- 172.21.15.134:0/1687456240 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740078e0 con 0x7f8a7c06beb0 2024-09-15T22:41:35.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6c80162df0 con 0x7f6c80162980 2024-09-15T22:41:35.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f8a7affd640 1 -- 172.21.15.134:0/1687456240 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74007cb0 con 0x7f8a7c06beb0 2024-09-15T22:41:35.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c80143f20 con 0x7f6c800b1f60 2024-09-15T22:41:35.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fd32bfff640 1 Processor -- start 2024-09-15T22:41:35.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7ad443640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a0053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c7ffff640 1 -- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 msgr2=0x7f6c800b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7ad443640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7a004eb60 0x7fc7a001d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7ad443640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a0052330 con 0x7fc7a00e7120 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7ad443640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a00520e0 con 0x7fc7a004eb60 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7ad443640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a0006c80 con 0x7fc7a0005a60 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7acc42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7a004eb60 0x7fc7a001d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7acc42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7a004eb60 0x7fc7a001d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37310/0 (socket says 172.21.15.134:37310) 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7acc42640 1 -- 172.21.15.134:0/3807344464 learned_addr learned my addr 172.21.15.134:0/3807344464 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c800b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fc7a7fff640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a0053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c7ffff640 1 -- 172.21.15.134:0/3186518934 >> v2:172.21.15.177:3300/0 conn(0x7f6c80162980 msgr2=0x7f6c8015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/3186518934 >> v2:172.21.15.177:3300/0 conn(0x7f6c80162980 0x7f6c8015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f571239f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c06c2b0 0x7f570c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f571239f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f570c0d0130 0x7f570c0d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f571239f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570c0d0ed0 con 0x7f570c149320 2024-09-15T22:41:35.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f571239f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f570c0d11b0 con 0x7f570c0d0130 2024-09-15T22:41:35.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f571239f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f570c0b4e50 con 0x7f570c06c2b0 2024-09-15T22:41:35.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7f6c7ffff640 1 -- 172.21.15.134:0/3186518934 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c80144200 con 0x7f6c8015f100 2024-09-15T22:41:35.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f6c84e74640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c800b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f27c631f640 1 Processor -- start 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f570c0d0130 0x7f570c0d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f570c0d0130 0x7f570c0d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42768/0 (socket says 172.21.15.134:42768) 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 -- 172.21.15.134:0/155777241 learned_addr learned my addr 172.21.15.134:0/155777241 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc7acc42640 1 -- 172.21.15.134:0/3807344464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 msgr2=0x7fc7a0053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc7acc42640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a0053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc7acc42640 1 -- 172.21.15.134:0/3807344464 >> v1:172.21.15.177:6789/0 conn(0x7fc7a00e7120 legacy=0x7fc7a0005e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:41:35.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc7acc42640 1 -- 172.21.15.134:0/3807344464 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a0006f60 con 0x7fc7a004eb60 2024-09-15T22:41:35.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 -- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c06c2b0 msgr2=0x7f570c1498b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:41:35.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 --2- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c06c2b0 0x7f570c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 -- 172.21.15.134:0/155777241 >> v1:172.21.15.177:6789/0 conn(0x7f570c149320 legacy=0x7f570c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f570affd640 1 -- 172.21.15.134:0/155777241 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873828490 0 0) 0x7f570c0d0ed0 con 0x7f570c149320 2024-09-15T22:41:35.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 -- 172.21.15.134:0/1687456240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 msgr2=0x7f8a7c06c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 --2- 172.21.15.134:0/1687456240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c06c320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009d90 tx=0x7f8a7402a560 comp rx=0 tx=0).stop 2024-09-15T22:41:35.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc9e259c640 1 -- 172.21.15.134:0/504745364 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc009d90 con 0x7fc9dc00b760 2024-09-15T22:41:35.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f571093c640 1 -- 172.21.15.134:0/155777241 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c0b5130 con 0x7f570c0d0130 2024-09-15T22:41:35.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7fc9e1d9b640 1 --2- 172.21.15.134:0/504745364 >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 0x7fc9dc04ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 -- 172.21.15.134:0/1687456240 shutdown_connections 2024-09-15T22:41:35.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 --2- 172.21.15.134:0/1687456240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c06c320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.466+0000 7fd32bfff640 1 -- start start 2024-09-15T22:41:35.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 --2- 172.21.15.134:0/1687456240 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c0b2b30 0x7f8a7c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 -- 172.21.15.134:0/1687456240 >> 172.21.15.134:0/1687456240 conn(0x7f8a7c0b2040 msgr2=0x7f8a7c0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f8a82303640 1 -- 172.21.15.134:0/1687456240 shutdown_connections 2024-09-15T22:41:35.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c8015f4e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c801419c0 tx=0x7f6c6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cbaf50659a4da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd32c06e8b0 0x7fd32c072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd32c071fc0 0x7fd32c072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32bfff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c0730d0 con 0x7fd32c1629b0 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32bfff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c073380 con 0x7fd32c06e8b0 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c071200 con 0x7fd32c071fc0 2024-09-15T22:41:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc7acc42640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a004eb60 0x7fc7a001d530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80637b0 tx=0x7fc7a80a6110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3489dc89bf219a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f8a82303640 1 -- 172.21.15.134:0/1687456240 wait complete. 2024-09-15T22:41:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f6c7f7fe640 1 -- 172.21.15.134:0/3186518934 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037070 con 0x7f6c8015f100 2024-09-15T22:41:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f6c7f7fe640 1 -- 172.21.15.134:0/3186518934 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c68032440 con 0x7f6c8015f100 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd32c1629b0 0x7fd32c06e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41938/0 (socket says 172.21.15.134:41938) 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32affd640 1 -- 172.21.15.134:0/1320938780 learned_addr learned my addr 172.21.15.134:0/1320938780 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd32c06e8b0 0x7fd32c072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/1320938780 >> v2:172.21.15.177:3300/0 conn(0x7fd32c071fc0 0x7fd32c072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f8a82303640 1 Processor -- start 2024-09-15T22:41:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f6c7f7fe640 1 -- 172.21.15.134:0/3186518934 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68032810 con 0x7f6c8015f100 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.467+0000 7f27c631f640 1 -- start start 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f27c631f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27c00b5100 0x7f27c00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f27c631f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27c00cf120 0x7f27c00b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f27c631f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c00b5610 con 0x7f27c0163480 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f27c631f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00b3530 con 0x7f27c00b5100 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7f27c631f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00cd5d0 con 0x7f27c00cf120 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27c531d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f27c0163480 0x7f27c0163860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41946/0 (socket says 172.21.15.134:41946) 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27c531d640 1 -- 172.21.15.134:0/569585191 learned_addr learned my addr 172.21.15.134:0/569585191 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80594048 0 0) 0x7f27c00b5610 con 0x7f27c0163480 2024-09-15T22:41:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ac003520 con 0x7f27c0163480 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/569585191 >> v2:172.21.15.134:3300/0 conn(0x7f27c00b5100 0x7f27c00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc9e259c640 1 --2- 172.21.15.134:0/504745364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400b910 tx=0x7fc9d402a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d287c156534a757 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc9e159a640 1 -- 172.21.15.134:0/504745364 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d402d070 con 0x7fc9dc00b760 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc9e159a640 1 -- 172.21.15.134:0/504745364 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d4031750 con 0x7fc9dc00b760 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc9e159a640 1 -- 172.21.15.134:0/504745364 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4031b20 con 0x7fc9dc00b760 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fc7a6ffd640 1 -- 172.21.15.134:0/3807344464 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80b3070 con 0x7fc7a004eb60 2024-09-15T22:41:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fc7a6ffd640 1 -- 172.21.15.134:0/3807344464 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a80ae440 con 0x7fc7a004eb60 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd329ffb640 1 -- 172.21.15.134:0/1320938780 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934526283 0 0) 0x7fd32c0730d0 con 0x7fd32c1629b0 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd329ffb640 1 -- 172.21.15.134:0/1320938780 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd314003520 con 0x7fd32c1629b0 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.468+0000 7fd32b7fe640 1 -- 172.21.15.134:0/1320938780 >> v2:172.21.15.134:3300/0 conn(0x7fd32c06e8b0 msgr2=0x7fd32c072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/1320938780 >> v2:172.21.15.134:3300/0 conn(0x7fd32c06e8b0 0x7fd32c072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fd32b7fe640 1 -- 172.21.15.134:0/1320938780 >> v1:172.21.15.134:6789/0 conn(0x7fd32c1629b0 legacy=0x7fd32c06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fd32b7fe640 1 -- 172.21.15.134:0/1320938780 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c0714e0 con 0x7fd32c071fc0 2024-09-15T22:41:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 msgr2=0x7f6c8015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fc9e359e640 1 -- 172.21.15.134:0/504745364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 msgr2=0x7fc9dc0063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f6c868d7640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c8015f4e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c801419c0 tx=0x7f6c6802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fc9e359e640 1 --2- 172.21.15.134:0/504745364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400b910 tx=0x7fc9d402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27c00cf120 0x7f27c00b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7fc7a6ffd640 1 -- 172.21.15.134:0/3807344464 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80ae870 con 0x7fc7a004eb60 2024-09-15T22:41:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 -- 172.21.15.134:0/3807344464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a004eb60 msgr2=0x7fc7a001d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a004eb60 0x7fc7a001d530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80637b0 tx=0x7fc7a80a6110 comp rx=0 tx=0).stop 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 -- 172.21.15.134:0/3807344464 shutdown_connections 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a004eb60 0x7fc7a001d530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 --2- 172.21.15.134:0/3807344464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a0053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 -- 172.21.15.134:0/3807344464 >> 172.21.15.134:0/3807344464 conn(0x7fc7a0036090 msgr2=0x7fc7a00364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f571093c640 1 --2- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c0d0130 0x7f570c0d05c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5700009870 tx=0x7f570002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70f247d2a0f8dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3725816987 0 0) 0x7f27ac003520 con 0x7f27c0163480 2024-09-15T22:41:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27c00cf120 msgr2=0x7f27c00b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27c00cf120 0x7f27c00b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 -- 172.21.15.134:0/3807344464 shutdown_connections 2024-09-15T22:41:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 >> v2:172.21.15.134:3300/0 conn(0x7f27c00b5100 msgr2=0x7f27c00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 --2- 172.21.15.134:0/569585191 >> v2:172.21.15.134:3300/0 conn(0x7f27c00b5100 0x7f27c00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00cd8b0 con 0x7f27c0163480 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 -- 172.21.15.134:0/504745364 shutdown_connections 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 --2- 172.21.15.134:0/504745364 >> v2:172.21.15.177:3300/0 conn(0x7fc9dc04eb50 0x7fc9dc04ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 --2- 172.21.15.134:0/504745364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc00b760 0x7fc9dc0063c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 -- 172.21.15.134:0/504745364 >> 172.21.15.134:0/504745364 conn(0x7fc9dc01d920 msgr2=0x7fc9dc054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f27a80019d0 con 0x7f27c0163480 2024-09-15T22:41:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 -- 172.21.15.134:0/504745364 shutdown_connections 2024-09-15T22:41:35.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 >> v1:172.21.15.134:6789/0 conn(0x7f27c0163480 legacy=0x7f27c0163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/1320938780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c071fc0 0x7fd32c072b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0b5d10 tx=0x7fd32402a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7b49f5127fd696 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fd329ffb640 1 -- 172.21.15.134:0/1320938780 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324007740 con 0x7fd32c071fc0 2024-09-15T22:41:35.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f570affd640 1 -- 172.21.15.134:0/155777241 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700037070 con 0x7f570c0d0130 2024-09-15T22:41:35.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f570affd640 1 -- 172.21.15.134:0/155777241 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5700032440 con 0x7f570c0d0130 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.469+0000 7f8a82303640 1 -- start start 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac0039f0 0x7f27ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac004390 0x7f27ac004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac004f70 0x7f27ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00cd5d0 con 0x7f27ac004390 2024-09-15T22:41:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac00bf00 con 0x7f27ac004f70 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac00c080 con 0x7f27ac0039f0 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a7c0b2b30 0x7f8a7c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 0x7f8a7c144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0b5670 con 0x7f8a7c0b2b30 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cd6d0 con 0x7f8a7c1582c0 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a82303640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0b57f0 con 0x7f8a7c06beb0 2024-09-15T22:41:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 shutdown_connections 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c800b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 --2- 172.21.15.134:0/3186518934 >> v2:172.21.15.177:3300/0 conn(0x7f6c80162980 0x7f6c8015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 --2- 172.21.15.134:0/3186518934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c8015f4e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 >> 172.21.15.134:0/3186518934 conn(0x7f6c8006bba0 msgr2=0x7f6c8006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27c531d640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac0039f0 0x7f27ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac004390 0x7f27ac004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac004f70 0x7f27ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc9e359e640 1 -- 172.21.15.134:0/504745364 wait complete. 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 -- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c0d0130 msgr2=0x7f570c0d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f570affd640 1 -- 172.21.15.134:0/155777241 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700037070 con 0x7f570c0d0130 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 --2- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c0d0130 0x7f570c0d05c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5700009870 tx=0x7f570002a250 comp rx=0 tx=0).stop 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 -- 172.21.15.134:0/155777241 shutdown_connections 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 --2- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c0d0130 0x7f570c0d05c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 --2- 172.21.15.134:0/155777241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c06c2b0 0x7f570c1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f571239f640 1 -- 172.21.15.134:0/155777241 >> 172.21.15.134:0/155777241 conn(0x7f570c062a80 msgr2=0x7f570c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f571239f640 1 -- 172.21.15.134:0/155777241 shutdown_connections 2024-09-15T22:41:35.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f571239f640 1 -- 172.21.15.134:0/155777241 wait complete. 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7fc7ad443640 1 -- 172.21.15.134:0/3807344464 wait complete. 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 0x7f8a7c144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 0x7f8a7c144ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42812/0 (socket says 172.21.15.134:42812) 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 -- 172.21.15.134:0/2870637626 learned_addr learned my addr 172.21.15.134:0/2870637626 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.470+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 shutdown_connections 2024-09-15T22:41:35.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a7b7fe640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a7c0b2b30 0x7f8a7c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7fd329ffb640 1 -- 172.21.15.134:0/1320938780 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32402ae50 con 0x7fd32c071fc0 2024-09-15T22:41:35.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 -- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 msgr2=0x7f8a7c0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c0aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 -- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a7c0b2b30 msgr2=0x7f8a7c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a7c0b2b30 0x7f8a7c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c144230 con 0x7f8a7c1582c0 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a7bfff640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c06beb0 0x7f8a7c0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f8a808a0640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 0x7f8a7c144ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a7402ab50 tx=0x7f8a74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f6c868d7640 1 -- 172.21.15.134:0/3186518934 wait complete. 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f27c4b1c640 1 -- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac0039f0 msgr2=0x7f27ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac0039f0 0x7f27ac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f27c4b1c640 1 -- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac004f70 msgr2=0x7f27ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac004f70 0x7f27ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7f27c4b1c640 1 -- 172.21.15.134:0/569585191 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00cd8b0 con 0x7f27ac004390 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.471+0000 7fd329ffb640 1 -- 172.21.15.134:0/1320938780 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324007b20 con 0x7fd32c071fc0 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74040070 con 0x7f8a7c1582c0 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74031bc0 con 0x7f8a7c1582c0 2024-09-15T22:41:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74009450 con 0x7f8a7c1582c0 2024-09-15T22:41:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f8a82303640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c144510 con 0x7f8a7c1582c0 2024-09-15T22:41:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f8a82303640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c143bd0 con 0x7f8a7c1582c0 2024-09-15T22:41:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7fc9e359e640 1 Processor -- start 2024-09-15T22:41:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7fc9e359e640 1 -- start start 2024-09-15T22:41:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac004f70 0x7f27ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac004390 0x7f27ac004860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009a90 tx=0x7f27ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3b1f80ca383807 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f8a82303640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a7c153400 con 0x7f8a7c1582c0 2024-09-15T22:41:35.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7f571239f640 1 Processor -- start 2024-09-15T22:41:35.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f571239f640 1 -- start start 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0036070 con 0x7f27ac004390 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b0031400 con 0x7f27ac004390 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7f908b996640 1 Processor -- start 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7fc7ad443640 1 Processor -- start 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.472+0000 7fc7ad443640 1 -- start start 2024-09-15T22:41:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7fc7ad443640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a00e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7fc7ad443640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a004eb60 0x7fc7a004c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.473+0000 7fd32bfff640 1 -- 172.21.15.134:0/1320938780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c071fc0 msgr2=0x7fd32c072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fd32bfff640 1 --2- 172.21.15.134:0/1320938780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c071fc0 0x7fd32c072b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0b5d10 tx=0x7fd32402a630 comp rx=0 tx=0).stop 2024-09-15T22:41:35.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f6c868d7640 1 Processor -- start 2024-09-15T22:41:35.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a00e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fd32bfff640 1 -- 172.21.15.134:0/1320938780 shutdown_connections 2024-09-15T22:41:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fd32bfff640 1 --2- 172.21.15.134:0/1320938780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c071fc0 0x7fd32c072b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fd32bfff640 1 --2- 172.21.15.134:0/1320938780 >> v2:172.21.15.134:3300/0 conn(0x7fd32c06e8b0 0x7fd32c072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fd32bfff640 1 -- 172.21.15.134:0/1320938780 >> 172.21.15.134:0/1320938780 conn(0x7fd32c062c60 msgr2=0x7fd32c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f6c868d7640 1 -- start start 2024-09-15T22:41:35.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a00e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59740/0 (socket says 172.21.15.134:59740) 2024-09-15T22:41:35.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fc7a7fff640 1 -- 172.21.15.134:0/4068545543 learned_addr learned my addr 172.21.15.134:0/4068545543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fc7a77fe640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a004eb60 0x7fc7a004c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7fc7ad443640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a00e7120 0x7fc7a00e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f27c631f640 1 -- 172.21.15.134:0/569585191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac004390 msgr2=0x7f27ac004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f27bffff640 1 -- 172.21.15.134:0/569585191 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0036070 con 0x7f27ac004390 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f27c631f640 1 --2- 172.21.15.134:0/569585191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac004390 0x7f27ac004860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009a90 tx=0x7f27ac005830 comp rx=0 tx=0).stop 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f27c5b1e640 1 -- 172.21.15.134:0/569585191 reap_dead start 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f908b996640 1 -- start start 2024-09-15T22:41:35.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc00b760 0x7fc9dc04dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a74039040 con 0x7f8a7c1582c0 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a78ff9640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a6806c380 0x7f8a6806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 0x7f570c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c0d0130 0x7f570c13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c149320 0x7f570c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 0x7fc9dc1037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0d0c80 con 0x7f570c06c2b0 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0d0b00 con 0x7f570c149320 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571239f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f570c0b5650 con 0x7f570c0d0130 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f570bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 0x7f570c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f570bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 0x7f570c144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37338/0 (socket says 172.21.15.134:37338) 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f570bfff640 1 -- 172.21.15.134:0/587820461 learned_addr learned my addr 172.21.15.134:0/587820461 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.474+0000 7f571093c640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c149320 0x7f570c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570b7fe640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c0d0130 0x7f570c13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 -- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c0d0130 msgr2=0x7f570c13e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f570c0d0130 0x7f570c13e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 -- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c149320 msgr2=0x7f570c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f570c149320 0x7f570c13ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c163c60 con 0x7f570c06c2b0 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f908b996640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90841440b0 0x7f908406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f908b996640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9084062630 0x7f90840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8a740ac8f0 con 0x7f8a7c1582c0 2024-09-15T22:41:35.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 0x7fc9dc0fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f570bfff640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 0x7f570c144600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00c3c0 tx=0x7f56fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc00b760 0x7fc9dc04dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc00b760 0x7fc9dc04dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37352/0 (socket says 172.21.15.134:37352) 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 0x7fc9dc1037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 0x7fc9dc1037b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42840/0 (socket says 172.21.15.134:42840) 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0047b50 con 0x7fc7a00e7120 2024-09-15T22:41:35.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a78ff9640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f8a680745a0 0x7f8a680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a7bfff640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a6806c380 0x7f8a6806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a74032e70 con 0x7f8a680745a0 2024-09-15T22:41:35.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8a740b12a0 con 0x7f8a7c1582c0 2024-09-15T22:41:35.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f9088f31640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9084062630 0x7f90840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f6c868d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c801f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc036d10 con 0x7fc9dc00b760 2024-09-15T22:41:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f6c868d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c80140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc036b90 con 0x7fc9dc036010 2024-09-15T22:41:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f9088f31640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9084062630 0x7f90840b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37366/0 (socket says 172.21.15.134:37366) 2024-09-15T22:41:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc7acc42640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a00e7120 0x7fc7a00e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0053a10 con 0x7fc7a004eb60 2024-09-15T22:41:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a0047cd0 con 0x7fc7a0005a60 2024-09-15T22:41:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f8a7b7fe640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f8a680745a0 0x7f8a680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fd32bfff640 1 -- 172.21.15.134:0/1320938780 shutdown_connections 2024-09-15T22:41:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9088f31640 1 -- 172.21.15.134:0/2293130936 learned_addr learned my addr 172.21.15.134:0/2293130936 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908406eb40 con 0x7f9084062aa0 2024-09-15T22:41:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c801f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f908406ee20 con 0x7f9084062630 2024-09-15T22:41:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f908406f100 con 0x7f90841440b0 2024-09-15T22:41:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c801f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59770/0 (socket says 172.21.15.134:59770) 2024-09-15T22:41:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7fc9e2d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 0x7fc9dc0fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7fc9e2d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 0x7fc9dc0fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59758/0 (socket says 172.21.15.134:59758) 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7fc9e2d9d640 1 -- 172.21.15.134:0/3513420708 learned_addr learned my addr 172.21.15.134:0/3513420708 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9089732640 1 --2- 172.21.15.134:0/2293130936 >> v2:172.21.15.177:3300/0 conn(0x7f90841440b0 0x7f908406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc017070 con 0x7f570c06c2b0 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.475+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c144e50 con 0x7f570c06c2b0 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c145410 con 0x7f570c06c2b0 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc0035f0 con 0x7f570c06c2b0 2024-09-15T22:41:35.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc0039e0 con 0x7f570c06c2b0 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c80140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c868d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c80162980 0x7f6c80142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c868d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8015eec0 con 0x7f6c8015f100 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c80140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37376/0 (socket says 172.21.15.134:37376) 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c777fe640 1 -- 172.21.15.134:0/584141083 learned_addr learned my addr 172.21.15.134:0/584141083 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801447c0 con 0x7f6c80162980 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c80143b80 con 0x7f6c800b1f60 2024-09-15T22:41:35.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f8a7bfff640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a6806c380 0x7f8a6806e840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a70007fd0 tx=0x7f8a70007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f27c631f640 1 -- 172.21.15.134:0/569585191 shutdown_connections 2024-09-15T22:41:35.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f27c631f640 1 -- 172.21.15.134:0/569585191 >> 172.21.15.134:0/569585191 conn(0x7f27c006e700 msgr2=0x7f27c006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f8a7b7fe640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f8a680745a0 0x7f8a680769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7fc9e359e640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc04e590 con 0x7fc9dc04eb50 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 -- 172.21.15.134:0/584141083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c80162980 msgr2=0x7f6c80142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c80162980 0x7f6c80142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 -- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 msgr2=0x7f6c80140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c8015f100 0x7f6c80140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f6c7ffff640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c80144fe0 con 0x7f6c800b1f60 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f27c631f640 1 -- 172.21.15.134:0/569585191 shutdown_connections 2024-09-15T22:41:35.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f27c631f640 1 -- 172.21.15.134:0/569585191 wait complete. 2024-09-15T22:41:35.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9088f31640 1 -- 172.21.15.134:0/2293130936 >> v2:172.21.15.177:3300/0 conn(0x7f90841440b0 msgr2=0x7f908406e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9088f31640 1 --2- 172.21.15.134:0/2293130936 >> v2:172.21.15.177:3300/0 conn(0x7f90841440b0 0x7f908406e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9088f31640 1 -- 172.21.15.134:0/2293130936 >> v1:172.21.15.134:6789/0 conn(0x7f9084062aa0 legacy=0x7f9084071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.476+0000 7f9088f31640 1 -- 172.21.15.134:0/2293130936 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908406f3e0 con 0x7f9084062630 2024-09-15T22:41:35.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c7ffff640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c801f3830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c68031000 tx=0x7f6c680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 -- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 msgr2=0x7fc9dc0fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 0x7fc9dc0fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 -- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc00b760 msgr2=0x7fc9dc04dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc00b760 0x7fc9dc04dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc1029f0 con 0x7fc9dc036010 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037040 con 0x7f6c800b1f60 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 -- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a004eb60 msgr2=0x7fc7a004c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a004eb60 0x7fc7a004c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 -- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a00e7120 msgr2=0x7fc7a00e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a00e7120 0x7fc7a00e3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a004bb80 con 0x7fc7a0005a60 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a77fe640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a004eb60 0x7fc7a004c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7acc42640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7a00e7120 0x7fc7a00e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c68042070 con 0x7f6c800b1f60 2024-09-15T22:41:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e2d9d640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9dc04eb50 0x7fc9dc0fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68030bd0 con 0x7f6c800b1f60 2024-09-15T22:41:35.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9e1d9b640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 0x7fc9dc1037b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4050d60 tx=0x7fc9e4069ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c801452c0 con 0x7f6c800b1f60 2024-09-15T22:41:35.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== osd.0 v2:172.21.15.134:6826/3150812732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a74032e70 con 0x7f8a680745a0 2024-09-15T22:41:35.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c80145880 con 0x7f6c800b1f60 2024-09-15T22:41:35.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4085a70 con 0x7fc9dc036010 2024-09-15T22:41:35.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f9088f31640 1 --2- 172.21.15.134:0/2293130936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f90840b4e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90840b3ad0 tx=0x7f907402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd10e2b58b1ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fc7a7fff640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a00e7540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e900 tx=0x7fc79c00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7fd32bfff640 1 -- 172.21.15.134:0/1320938780 wait complete. 2024-09-15T22:41:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7fc9e359e640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc102cd0 con 0x7fc9dc036010 2024-09-15T22:41:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.477+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56ec001030 con 0x7f570c06c2b0 2024-09-15T22:41:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7fc9e359e640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc103290 con 0x7fc9dc036010 2024-09-15T22:41:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7f907bfff640 1 -- 172.21.15.134:0/2293130936 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074037070 con 0x7f9084062630 2024-09-15T22:41:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7f907bfff640 1 -- 172.21.15.134:0/2293130936 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074032440 con 0x7f9084062630 2024-09-15T22:41:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7f907bfff640 1 -- 172.21.15.134:0/2293130936 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074032810 con 0x7f9084062630 2024-09-15T22:41:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c80069010 con 0x7f6c800b1f60 2024-09-15T22:41:35.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fd32bfff640 1 Processor -- start 2024-09-15T22:41:35.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e4085c10 con 0x7fc9dc036010 2024-09-15T22:41:35.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7f27c631f640 1 Processor -- start 2024-09-15T22:41:35.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.478+0000 7f27c631f640 1 -- start start 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f56fc01a070 con 0x7f570c06c2b0 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c017070 con 0x7fc7a0005a60 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c00ca00 con 0x7fc7a0005a60 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00cdb0 con 0x7fc7a0005a60 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a004b8a0 con 0x7fc7a0005a60 2024-09-15T22:41:35.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a00d9bd0 con 0x7fc7a0005a60 2024-09-15T22:41:35.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e408d400 con 0x7fc9dc036010 2024-09-15T22:41:35.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.479+0000 7fc9e359e640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9dc0063c0 con 0x7fc9dc036010 2024-09-15T22:41:35.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f5708ff9640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f56f806c380 0x7f56f806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 0x7f27c01ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c0073f40 0x7f27c0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 msgr2=0x7f90840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f908b996640 1 --2- 172.21.15.134:0/2293130936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f90840b4e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90840b3ad0 tx=0x7f907402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f56fc08a7c0 con 0x7f570c06c2b0 2024-09-15T22:41:35.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c531d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 0x7f27c01ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c531d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 0x7f27c01ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59776/0 (socket says 172.21.15.134:59776) 2024-09-15T22:41:35.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c68047460 con 0x7f6c800b1f60 2024-09-15T22:41:35.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c531d640 1 -- 172.21.15.134:0/2067224982 learned_addr learned my addr 172.21.15.134:0/2067224982 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f5708ff9640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f56f80745a0 0x7f56f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27c01585d0 0x7f27c00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7fd32bfff640 1 -- start start 2024-09-15T22:41:35.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56fc015e70 con 0x7f56f80745a0 2024-09-15T22:41:35.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00b2520 con 0x7f27c0073f40 2024-09-15T22:41:35.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27c01585d0 0x7f27c00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00b23a0 con 0x7f27c01585d0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c631f640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00b26a0 con 0x7f27ac004390 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c0073f40 0x7f27c0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9e4067950 con 0x7fc9dc036010 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f56fc091050 con 0x7f570c06c2b0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f570b7fe640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f56f806c380 0x7f56f806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.480+0000 7f571093c640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f56f80745a0 0x7f56f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f570b7fe640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f56f806c380 0x7f56f806e840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f570c1465e0 tx=0x7f57040072f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f6c7d7fa640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c6006c2b0 0x7f6c6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7fc9d2ffd640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9c406c330 0x7fc9c406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7fc9e259c640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9c406c330 0x7fc9c406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 -- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27c01585d0 msgr2=0x7f27c00b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27c01585d0 0x7f27c00b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 -- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c0073f40 msgr2=0x7f27c0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c0073f40 0x7f27c0158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c01efec0 con 0x7f27ac004390 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f27c531d640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 0x7f27c01ece50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27a800aad0 tx=0x7f27a800aed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f6c777fe640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c6006c2b0 0x7f6c6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e40fedc0 con 0x7fc9dc036010 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6c680abee0 con 0x7f6c800b1f60 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f6c7d7fa640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7f6c600744d0 0x7f6c600768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c68032440 con 0x7f6c600744d0 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6c680ae540 con 0x7f6c800b1f60 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8007910 con 0x7f27ac004390 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8018070 con 0x7f27ac004390 2024-09-15T22:41:35.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f27c631f640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c01ec370 con 0x7f27ac004390 2024-09-15T22:41:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f571093c640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f56f80745a0 0x7f56f80769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 shutdown_connections 2024-09-15T22:41:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f908b996640 1 --2- 172.21.15.134:0/2293130936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f90840b4e20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f908b996640 1 --2- 172.21.15.134:0/2293130936 >> v2:172.21.15.177:3300/0 conn(0x7f90841440b0 0x7f908406e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 >> 172.21.15.134:0/2293130936 conn(0x7f908406cae0 msgr2=0x7f908406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.481+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc79c01a070 con 0x7fc7a0005a60 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc788001030 con 0x7fc7a0005a60 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32c06e8b0 0x7fd32c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 0x7fd32c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c1629b0 0x7fd32c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c162d90 con 0x7fd32c071fc0 2024-09-15T22:41:35.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 0x7fd32c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c071aa0 con 0x7fd32c1629b0 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 0x7fd32c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37396/0 (socket says 172.21.15.134:37396) 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c162f10 con 0x7fd32c06e8b0 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32a7fc640 1 -- 172.21.15.134:0/2474888675 learned_addr learned my addr 172.21.15.134:0/2474888675 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32affd640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32c06e8b0 0x7fd32c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f6c84e74640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7f6c600744d0 0x7f6c600768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f27c631f640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01ec930 con 0x7f27ac004390 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc9d2ffd640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7fc9c4074550 0x7fc9c4076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9c4077020 con 0x7fc9c4074550 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc9e40ff170 con 0x7fc9dc036010 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc9e2d9d640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7fc9c4074550 0x7fc9c4076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc9e259c640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9c406c330 0x7fc9c406e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4036000 tx=0x7fc9d403e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c1629b0 0x7fd32c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80135f0 con 0x7f27ac004390 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fd32a7fc640 1 -- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32c06e8b0 msgr2=0x7fd32c1598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fd32a7fc640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32c06e8b0 0x7fd32c1598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fd32a7fc640 1 -- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c1629b0 msgr2=0x7fd32c0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fd32a7fc640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32c1629b0 0x7fd32c0aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fd32a7fc640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c15a550 con 0x7fd32c071fc0 2024-09-15T22:41:35.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7f6c84e74640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7f6c600744d0 0x7f6c600768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc9e2d9d640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7fc9c4074550 0x7fc9c4076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== osd.4 v2:172.21.15.177:6809/324643051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56fc015e70 con 0x7f56f80745a0 2024-09-15T22:41:35.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc7a4ff9640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc78c06c300 0x7fc78c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.482+0000 7fc7a77fe640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc78c06c300 0x7fc78c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc79c08b7f0 con 0x7fc7a0005a60 2024-09-15T22:41:35.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7a4ff9640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7fc78c0744a0 0x7fc78c0768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc78c076f70 con 0x7fc78c0744a0 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7a77fe640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc78c06c300 0x7fc78c06e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00d9ea0 tx=0x7fc794008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc79c092050 con 0x7fc7a0005a60 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.483+0000 7fc7acc42640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7fc78c0744a0 0x7fc78c0768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== osd.1 v2:172.21.15.134:6800/1167728120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c68032440 con 0x7f6c600744d0 2024-09-15T22:41:35.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27c01f01a0 con 0x7f27ac004390 2024-09-15T22:41:35.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7fd32a7fc640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 0x7fd32c15b5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d830 tx=0x7fd31c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== osd.3 v2:172.21.15.134:6808/1380536575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c4077020 con 0x7fc9c4074550 2024-09-15T22:41:35.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 shutdown_connections 2024-09-15T22:41:35.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f6c777fe640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c6006c2b0 0x7f6c6006e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009fd0 tx=0x7f6c7000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27a8013790 con 0x7f27ac004390 2024-09-15T22:41:35.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7fc7acc42640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7fc78c0744a0 0x7fc78c0768c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00b6c0 con 0x7fd32c071fc0 2024-09-15T22:41:35.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c019070 con 0x7fd32c071fc0 2024-09-15T22:41:35.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00ba80 con 0x7fd32c071fc0 2024-09-15T22:41:35.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7f27bdffb640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27a006c3b0 0x7f27a006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f27a808bab0 con 0x7f27ac004390 2024-09-15T22:41:35.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7f27bdffb640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f27a00745d0 0x7f27a00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27a006c3b0 0x7f27a006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== osd.6 v2:172.21.15.177:6824/410834460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc78c076f70 con 0x7fc78c0744a0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.485+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f27a00745d0 0x7f27a00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f27c4b1c640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27a006c3b0 0x7f27a006e870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27b0033000 tx=0x7f27b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f27c5b1e640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f27a00745d0 0x7f27a00769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27a00770a0 con 0x7f27a00745d0 2024-09-15T22:41:35.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f27a80902a0 con 0x7f27ac004390 2024-09-15T22:41:35.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.484+0000 7f908b996640 1 -- 172.21.15.134:0/2293130936 wait complete. 2024-09-15T22:41:35.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f908b996640 1 Processor -- start 2024-09-15T22:41:35.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.487+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== osd.2 v2:172.21.15.134:6816/802177628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27a00770a0 con 0x7f27a00745d0 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7f908b996640 1 -- start start 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.487+0000 7f908b996640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f9084158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.487+0000 7f908b996640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9084062aa0 0x7f9084159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f9084158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f9084158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37408/0 (socket says 172.21.15.134:37408) 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7fd32bfff640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c15a830 con 0x7fd32c071fc0 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.486+0000 7fd32bfff640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c15adf0 con 0x7fd32c071fc0 2024-09-15T22:41:35.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.487+0000 7fd32bfff640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd32c06e1a0 con 0x7fd32c071fc0 2024-09-15T22:41:35.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f908b996640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90841440b0 0x7f908414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f908b996640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9084143e60 con 0x7f9084062630 2024-09-15T22:41:35.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f908b996640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9084143ce0 con 0x7f9084062aa0 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f908b996640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90840cf380 con 0x7f90841440b0 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 -- 172.21.15.134:0/999193819 learned_addr learned my addr 172.21.15.134:0/999193819 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 -- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90841440b0 msgr2=0x7f908414ec10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90841440b0 0x7f908414ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 -- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9084062aa0 msgr2=0x7f9084159cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9084062aa0 0x7f9084159cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.488+0000 7f9089732640 1 -- 172.21.15.134:0/999193819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9084159070 con 0x7f9084062630 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.489+0000 7f9089732640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f9084158970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f908000ec10 tx=0x7f908000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.489+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080017070 con 0x7f9084062630 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.489+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908000ed00 con 0x7f9084062630 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.489+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908000ce70 con 0x7f9084062630 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.489+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908414e130 con 0x7f9084062630 2024-09-15T22:41:35.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.490+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908414f150 con 0x7f9084062630 2024-09-15T22:41:35.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.490+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd31c01e460 con 0x7fd32c071fc0 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.491+0000 7fd313fff640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd31806c380 0x7fd31806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.491+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd31c08c4a0 con 0x7fd32c071fc0 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.491+0000 7fd313fff640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7fd3180745a0 0x7fd3180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd318077070 con 0x7fd3180745a0 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd31c08c890 con 0x7fd32c071fc0 2024-09-15T22:41:35.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f908001a070 con 0x7f9084062630 2024-09-15T22:41:35.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7fd3180745a0 0x7fd3180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7fd32affd640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd31806c380 0x7fd31806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.492+0000 7fd32b7fe640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7fd3180745a0 0x7fd3180769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7f9079ffb640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f906806c380 0x7f906806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7fd32affd640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd31806c380 0x7fd31806e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3200011e0 tx=0x7fd320007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7f9088f31640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f906806c380 0x7f906806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f908008b7b0 con 0x7f9084062630 2024-09-15T22:41:35.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7f908b996640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7f908413dd10 0x7f9084155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 --> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f908406e4b0 con 0x7f908413dd10 2024-09-15T22:41:35.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.494+0000 7f9088f31640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f906806c380 0x7f906806e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9074034000 tx=0x7f907402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.493+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== osd.7 v2:172.21.15.177:6808/1620102708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd318077070 con 0x7fd3180745a0 2024-09-15T22:41:35.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.495+0000 7f9089f33640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7f908413dd10 0x7f9084155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.495+0000 7f9089f33640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7f908413dd10 0x7f9084155c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.496+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== osd.5 v2:172.21.15.177:6800/3233781875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f908406e4b0 con 0x7f908413dd10 2024-09-15T22:41:35.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.508+0000 7f8a82303640 1 -- 172.21.15.134:0/2870637626 --> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a7c06c320 con 0x7f8a680745a0 2024-09-15T22:41:35.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.508+0000 7f8a78ff9640 1 -- 172.21.15.134:0/2870637626 <== osd.0 v2:172.21.15.134:6826/3150812732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a7c06c320 con 0x7f8a680745a0 2024-09-15T22:41:35.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.509+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f8a680745a0 msgr2=0x7f8a680769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.509+0000 7f8a627fc640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f8a680745a0 0x7f8a680769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.509+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a6806c380 msgr2=0x7f8a6806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.509+0000 7f8a627fc640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a6806c380 0x7f8a6806e840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a70007fd0 tx=0x7f8a70007e00 comp rx=0 tx=0).stop 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 msgr2=0x7f8a7c144ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 --2- 172.21.15.134:0/2870637626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c1582c0 0x7f8a7c144ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a7402ab50 tx=0x7f8a74004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a808a0640 1 -- 172.21.15.134:0/2870637626 reap_dead start 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 shutdown_connections 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 >> 172.21.15.134:0/2870637626 conn(0x7f8a7c0b2040 msgr2=0x7f8a7c15bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 shutdown_connections 2024-09-15T22:41:35.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.510+0000 7f8a627fc640 1 -- 172.21.15.134:0/2870637626 wait complete. 2024-09-15T22:41:35.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.511+0000 7fc9e359e640 1 -- 172.21.15.134:0/3513420708 --> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9dc101d90 con 0x7fc9c4074550 2024-09-15T22:41:35.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.512+0000 7fc9d2ffd640 1 -- 172.21.15.134:0/3513420708 <== osd.3 v2:172.21.15.134:6808/1380536575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc9dc101d90 con 0x7fc9c4074550 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.512+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7fc9c4074550 msgr2=0x7fc9c4076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.512+0000 7fc9d0ff9640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7fc9c4074550 0x7fc9c4076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9c406c330 msgr2=0x7fc9c406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9c406c330 0x7fc9c406e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4036000 tx=0x7fc9d403e040 comp rx=0 tx=0).stop 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 msgr2=0x7fc9dc1037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 --2- 172.21.15.134:0/3513420708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9dc036010 0x7fc9dc1037b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4050d60 tx=0x7fc9e4069ed0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9e2d9d640 1 -- 172.21.15.134:0/3513420708 reap_dead start 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 shutdown_connections 2024-09-15T22:41:35.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 >> 172.21.15.134:0/3513420708 conn(0x7fc9dc01d920 msgr2=0x7fc9dc04f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 --> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56ec002dd0 con 0x7f56f80745a0 2024-09-15T22:41:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 shutdown_connections 2024-09-15T22:41:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7fc9d0ff9640 1 -- 172.21.15.134:0/3513420708 wait complete. 2024-09-15T22:41:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.513+0000 7f5708ff9640 1 -- 172.21.15.134:0/587820461 <== osd.4 v2:172.21.15.177:6809/324643051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f56ec002dd0 con 0x7f56f80745a0 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f56f80745a0 msgr2=0x7f56f80769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f56f80745a0 0x7f56f80769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f56f806c380 msgr2=0x7f56f806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f56f806c380 0x7f56f806e840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f570c1465e0 tx=0x7f57040072f0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 msgr2=0x7f570c144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571239f640 1 --2- 172.21.15.134:0/587820461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f570c06c2b0 0x7f570c144600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00c3c0 tx=0x7f56fc00c880 comp rx=0 tx=0).stop 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.515+0000 7f571093c640 1 -- 172.21.15.134:0/587820461 reap_dead start 2024-09-15T22:41:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.516+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 shutdown_connections 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.516+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 >> 172.21.15.134:0/587820461 conn(0x7f570c062a80 msgr2=0x7f570c0b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.516+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 shutdown_connections 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.516+0000 7f571239f640 1 -- 172.21.15.134:0/587820461 wait complete. 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.516+0000 7f6c868d7640 1 -- 172.21.15.134:0/584141083 --> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c800afd20 con 0x7f6c600744d0 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.517+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 --> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc788002dd0 con 0x7fc78c0744a0 2024-09-15T22:41:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.517+0000 7f6c7d7fa640 1 -- 172.21.15.134:0/584141083 <== osd.1 v2:172.21.15.134:6800/1167728120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c800afd20 con 0x7f6c600744d0 2024-09-15T22:41:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7f6c600744d0 msgr2=0x7f6c600768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7f6c600744d0 0x7f6c600768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c6006c2b0 msgr2=0x7f6c6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c6006c2b0 0x7f6c6006e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009fd0 tx=0x7f6c7000b040 comp rx=0 tx=0).stop 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 msgr2=0x7f6c801f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 --2- 172.21.15.134:0/584141083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c800b1f60 0x7f6c801f3830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c68031000 tx=0x7f6c680046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c84e74640 1 -- 172.21.15.134:0/584141083 reap_dead start 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7fc7a4ff9640 1 -- 172.21.15.134:0/4068545543 <== osd.6 v2:172.21.15.177:6824/410834460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc788002dd0 con 0x7fc78c0744a0 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 shutdown_connections 2024-09-15T22:41:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.518+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 >> 172.21.15.134:0/584141083 conn(0x7f6c8006bba0 msgr2=0x7f6c800b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 --> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27c00b1e60 con 0x7f27a00745d0 2024-09-15T22:41:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 shutdown_connections 2024-09-15T22:41:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7f6c767fc640 1 -- 172.21.15.134:0/584141083 wait complete. 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7fc78c0744a0 msgr2=0x7fc78c0768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7fc78c0744a0 0x7fc78c0768c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc78c06c300 msgr2=0x7fc78c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc78c06c300 0x7fc78c06e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00d9ea0 tx=0x7fc794008040 comp rx=0 tx=0).stop 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 msgr2=0x7fc7a00e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7f27bdffb640 1 -- 172.21.15.134:0/2067224982 <== osd.2 v2:172.21.15.134:6816/802177628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27c00b1e60 con 0x7f27a00745d0 2024-09-15T22:41:35.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7ad443640 1 --2- 172.21.15.134:0/4068545543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a0005a60 0x7fc7a00e7540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e900 tx=0x7fc79c00edc0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.519+0000 7fc7acc42640 1 -- 172.21.15.134:0/4068545543 reap_dead start 2024-09-15T22:41:35.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f27a00745d0 msgr2=0x7f27a00769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 shutdown_connections 2024-09-15T22:41:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 >> 172.21.15.134:0/4068545543 conn(0x7fc7a0036090 msgr2=0x7fc7a0053e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f27a00745d0 0x7f27a00769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27a006c3b0 msgr2=0x7f27a006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27a006c3b0 0x7f27a006e870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27b0033000 tx=0x7f27b0008030 comp rx=0 tx=0).stop 2024-09-15T22:41:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 shutdown_connections 2024-09-15T22:41:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 msgr2=0x7f27c01ece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 --2- 172.21.15.134:0/2067224982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac004390 0x7f27c01ece50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27a800aad0 tx=0x7f27a800aed0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27c5b1e640 1 -- 172.21.15.134:0/2067224982 reap_dead start 2024-09-15T22:41:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7fc7ad443640 1 -- 172.21.15.134:0/4068545543 wait complete. 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 shutdown_connections 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.520+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 >> 172.21.15.134:0/2067224982 conn(0x7f27c006e700 msgr2=0x7f27c006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.521+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 shutdown_connections 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.521+0000 7f27b77fe640 1 -- 172.21.15.134:0/2067224982 wait complete. 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.522+0000 7fd32bfff640 1 -- 172.21.15.134:0/2474888675 --> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd32c0b1630 con 0x7fd3180745a0 2024-09-15T22:41:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.523+0000 7fd313fff640 1 -- 172.21.15.134:0/2474888675 <== osd.7 v2:172.21.15.177:6808/1620102708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd32c0b1630 con 0x7fd3180745a0 2024-09-15T22:41:35.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 --> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9084157850 con 0x7f908413dd10 2024-09-15T22:41:35.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7fd3180745a0 msgr2=0x7fd3180769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7fd3180745a0 0x7fd3180769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd31806c380 msgr2=0x7fd31806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd31806c380 0x7fd31806e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3200011e0 tx=0x7fd320007d30 comp rx=0 tx=0).stop 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 msgr2=0x7fd32c15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.524+0000 7fd311ffb640 1 --2- 172.21.15.134:0/2474888675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32c071fc0 0x7fd32c15b5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d830 tx=0x7fd31c00dcf0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7fd32b7fe640 1 -- 172.21.15.134:0/2474888675 reap_dead start 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7f9079ffb640 1 -- 172.21.15.134:0/999193819 <== osd.5 v2:172.21.15.177:6800/3233781875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9084157850 con 0x7f908413dd10 2024-09-15T22:41:35.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 shutdown_connections 2024-09-15T22:41:35.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 >> 172.21.15.134:0/2474888675 conn(0x7fd32c062c60 msgr2=0x7fd32c06cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 shutdown_connections 2024-09-15T22:41:35.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.525+0000 7fd311ffb640 1 -- 172.21.15.134:0/2474888675 wait complete. 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7f908413dd10 msgr2=0x7f9084155c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7f908413dd10 0x7f9084155c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f906806c380 msgr2=0x7f906806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f906806c380 0x7f906806e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9074034000 tx=0x7f907402e000 comp rx=0 tx=0).stop 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 msgr2=0x7f9084158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f908b996640 1 --2- 172.21.15.134:0/999193819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9084062630 0x7f9084158970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f908000ec10 tx=0x7f908000c520 comp rx=0 tx=0).stop 2024-09-15T22:41:35.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.526+0000 7f9089f33640 1 -- 172.21.15.134:0/999193819 reap_dead start 2024-09-15T22:41:35.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.528+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 shutdown_connections 2024-09-15T22:41:35.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.528+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 >> 172.21.15.134:0/999193819 conn(0x7f908406cae0 msgr2=0x7f9084142ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.583 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:35.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:41:35.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.530+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 shutdown_connections 2024-09-15T22:41:35.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.530+0000 7f908b996640 1 -- 172.21.15.134:0/999193819 wait complete. 2024-09-15T22:41:35.585 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:35.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:41:35.586 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:35.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:41:35.587 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:35.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:41:35.588 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:35.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:41:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-09-15T22:41:35.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:41:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:35.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:41:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:35.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:41:35.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7fd512cdd640 1 Processor -- start 2024-09-15T22:41:35.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7fd512cdd640 1 -- start start 2024-09-15T22:41:35.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7fbb90417640 1 Processor -- start 2024-09-15T22:41:35.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7fbb90417640 1 -- start start 2024-09-15T22:41:35.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7f637b28d640 1 Processor -- start 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.792+0000 7f3ac2a65640 1 Processor -- start 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7f3ac2a65640 1 -- start start 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac2a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 0x7f3abc0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac2a65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3abc0ce0c0 con 0x7f3abc0b5640 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac2a65640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3abc15e0e0 con 0x7f3abc0b3930 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac2a65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3abc15e3c0 con 0x7f3abc0cd7a0 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac1002640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3abc0b3930 0x7f3abc0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:44934/0 (socket says 172.21.15.134:44934) 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3ac1002640 1 -- 172.21.15.134:0/2181922003 learned_addr learned my addr 172.21.15.134:0/2181922003 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f3abbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3abc0b5640 0x7f3abc0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:41972/0 (socket says 172.21.15.134:41972) 2024-09-15T22:41:35.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347665435 0 0) 0x7f3abc15e0e0 con 0x7f3abc0b3930 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3aa4003520 con 0x7f3abc0b3930 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f3ac0801640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 0x7f3abc0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7fd512cdd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 0x7fd5040eb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7fd510a79640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 0x7fd5040eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd510a79640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 0x7fd5040eb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37422/0 (socket says 172.21.15.134:37422) 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd510a79640 1 -- 172.21.15.134:0/3247290599 learned_addr learned my addr 172.21.15.134:0/3247290599 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd512cdd640 1 --2- 172.21.15.134:0/3247290599 >> v2:172.21.15.177:3300/0 conn(0x7fd504008ed0 0x7fd5040eb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd50bfff640 1 --2- 172.21.15.134:0/3247290599 >> v2:172.21.15.177:3300/0 conn(0x7fd504008ed0 0x7fd5040eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd504034ad0 con 0x7fd504037780 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd50400aca0 con 0x7fd5040373a0 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd504034db0 con 0x7fd504008ed0 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50b7fe640 1 -- 172.21.15.134:0/3247290599 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249897861 0 0) 0x7fd504034ad0 con 0x7fd504037780 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50b7fe640 1 -- 172.21.15.134:0/3247290599 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc003520 con 0x7fd504037780 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb88162930 0x7fbb880cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 0x7fbb8806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb8806c0e0 0x7fbb881664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbb880b4870 con 0x7fbb88162930 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbb880afd60 con 0x7fbb8806c0e0 2024-09-15T22:41:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7fbb90417640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbb880cf3a0 con 0x7fbb880af900 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8d9b2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 0x7fbb8806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb8806c0e0 0x7fbb881664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb8806c0e0 0x7fbb881664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42922/0 (socket says 172.21.15.134:42922) 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 -- 172.21.15.134:0/2763383748 learned_addr learned my addr 172.21.15.134:0/2763383748 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8d9b2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 0x7fbb8806bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59808/0 (socket says 172.21.15.134:59808) 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 -- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 msgr2=0x7fbb8806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 --2- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 0x7fbb8806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 -- 172.21.15.134:0/2763383748 >> v2:172.21.15.134:3300/0 conn(0x7fbb88162930 msgr2=0x7fbb880cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 --2- 172.21.15.134:0/2763383748 >> v2:172.21.15.134:3300/0 conn(0x7fbb88162930 0x7fbb880cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbb8e9b4640 1 -- 172.21.15.134:0/2763383748 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb880b4010 con 0x7fbb8806c0e0 2024-09-15T22:41:35.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7f6ca759e640 1 Processor -- start 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7f6ca759e640 1 -- start start 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 0x7f6ca80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 0x7f6ca80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 0x7f6ca80720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37458/0 (socket says 172.21.15.134:37458) 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca6d9d640 1 -- 172.21.15.134:0/3299979163 learned_addr learned my addr 172.21.15.134:0/3299979163 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca5d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6ca8071c60 0x7f6ca8157840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:44954/0 (socket says 172.21.15.134:44954) 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca815af00 con 0x7f6ca80aff10 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80b4720 con 0x7f6ca8071c60 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca80b5330 con 0x7f6ca806e500 2024-09-15T22:41:35.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7f637b28d640 1 -- start start 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637b28d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 0x7f637415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637b28d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637406d4c0 con 0x7f637415a5c0 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637b28d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637406d7a0 con 0x7f637406cf70 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637b28d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63740b32d0 con 0x7f63740b2670 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637982a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 0x7f637415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637982a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 0x7f637415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37426/0 (socket says 172.21.15.134:37426) 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.794+0000 7f637982a640 1 -- 172.21.15.134:0/1293394195 learned_addr learned my addr 172.21.15.134:0/1293394195 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341217706 0 0) 0x7f637406d7a0 con 0x7f637406cf70 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6360003520 con 0x7f637406cf70 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1857246838 0 0) 0x7f6360003520 con 0x7f637406cf70 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 msgr2=0x7f637415a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 --2- 172.21.15.134:0/1293394195 >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 0x7f637415a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 >> v1:172.21.15.134:6789/0 conn(0x7f637415a5c0 legacy=0x7f63740cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637406da80 con 0x7f637406cf70 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f636c0019f0 con 0x7f637406cf70 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 >> v1:172.21.15.177:6789/0 conn(0x7f637406cf70 legacy=0x7f63740b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6360004b90 0x7f63600037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 0x7f6360004220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f636000d700 0x7f636000fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63740b32d0 con 0x7f6360004b90 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63600104a0 con 0x7f636000d700 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63600106a0 con 0x7f6360003da0 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7fbf8bfff640 1 Processor -- start 2024-09-15T22:41:35.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.793+0000 7fbf8bfff640 1 -- start start 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf8c1629c0 0x7fbf8c0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbf8c072f70 0x7fbf8c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8bfff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8c0b4c90 con 0x7fbf8c0cd040 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8bfff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8c0b55c0 con 0x7fbf8c072f70 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8c0b4f70 con 0x7fbf8c1629c0 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8a7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbf8c0cd040 0x7fbf8c072860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42000/0 (socket says 172.21.15.134:42000) 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8a7fc640 1 -- 172.21.15.134:0/2267416476 learned_addr learned my addr 172.21.15.134:0/2267416476 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fbf8b7fe640 1 --2- 172.21.15.134:0/2267416476 >> v2:172.21.15.134:3300/0 conn(0x7fbf8c072f70 0x7fbf8c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 0x7f6360004220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7fbf8affd640 1 --2- 172.21.15.134:0/2267416476 >> v2:172.21.15.177:3300/0 conn(0x7fbf8c1629c0 0x7fbf8c0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6379029640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6360004b90 0x7f63600037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50bfff640 1 -- 172.21.15.134:0/3247290599 >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 msgr2=0x7fd5040eb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50bfff640 1 --2- 172.21.15.134:0/3247290599 >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 0x7fd5040eb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50bfff640 1 -- 172.21.15.134:0/3247290599 >> v1:172.21.15.134:6789/0 conn(0x7fd504037780 legacy=0x7fd50400b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291316033 0 0) 0x7f3aa4003520 con 0x7f3abc0b3930 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 msgr2=0x7f3abc0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 0x7f3abc0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 >> v1:172.21.15.134:6789/0 conn(0x7f3abc0b5640 legacy=0x7f3abc0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc15e6a0 con 0x7f3abc0b3930 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f3ab40019f0 con 0x7f3abc0b3930 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 >> v1:172.21.15.177:6789/0 conn(0x7f3abc0b3930 legacy=0x7f3abc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 0x7f3aa40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa4003fe0 0x7f3aa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa4004d40 0x7f3aa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc15e3c0 con 0x7f3aa4004d40 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa400bbd0 con 0x7f3aa4003fe0 2024-09-15T22:41:35.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa400bdd0 con 0x7f3abc0cd7a0 2024-09-15T22:41:35.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7fbf8affd640 1 -- 172.21.15.134:0/2267416476 >> v2:172.21.15.134:3300/0 conn(0x7fbf8c072f70 msgr2=0x7fbf8c0cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7fbf8affd640 1 --2- 172.21.15.134:0/2267416476 >> v2:172.21.15.134:3300/0 conn(0x7fbf8c072f70 0x7fbf8c0cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7fbf8affd640 1 -- 172.21.15.134:0/2267416476 >> v1:172.21.15.134:6789/0 conn(0x7fbf8c0cd040 legacy=0x7fbf8c072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7fbf8affd640 1 -- 172.21.15.134:0/2267416476 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c0b5250 con 0x7fbf8c1629c0 2024-09-15T22:41:35.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.795+0000 7fd50bfff640 1 -- 172.21.15.134:0/3247290599 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50400aef0 con 0x7fd504008ed0 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548997642 0 0) 0x7f6ca80b4720 con 0x7f6ca8071c60 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c94003520 con 0x7f6ca8071c60 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799028906 0 0) 0x7f6ca815af00 con 0x7f6ca80aff10 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca80b4720 con 0x7f6ca80aff10 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f9a90c77640 1 Processor -- start 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f9a90c77640 1 -- start start 2024-09-15T22:41:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fd50bfff640 1 --2- 172.21.15.134:0/3247290599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd504008ed0 0x7fd5040eb580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd50400ea50 tx=0x7fd4f802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4efaf5bec04cdc2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1362997882 0 0) 0x7f6c94003520 con 0x7f6ca8071c60 2024-09-15T22:41:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 msgr2=0x7f6ca80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 --2- 172.21.15.134:0/3299979163 >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 0x7f6ca80720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 >> v1:172.21.15.134:6789/0 conn(0x7f6ca80aff10 legacy=0x7f6ca80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca80b4a00 con 0x7f6ca8071c60 2024-09-15T22:41:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fd50b7fe640 1 -- 172.21.15.134:0/3247290599 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8037070 con 0x7fd504008ed0 2024-09-15T22:41:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fd50b7fe640 1 -- 172.21.15.134:0/3247290599 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f8032440 con 0x7fd504008ed0 2024-09-15T22:41:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6c98001670 con 0x7f6ca8071c60 2024-09-15T22:41:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 >> v1:172.21.15.177:6789/0 conn(0x7f6ca8071c60 legacy=0x7f6ca8157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f9a90c77640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a8400bda0 0x7f9a84049c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fd50b7fe640 1 -- 172.21.15.134:0/3247290599 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80327f0 con 0x7fd504008ed0 2024-09-15T22:41:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94003b40 0x7f6c94003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 0x7f6c94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fbb8e9b4640 1 --2- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881664c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb880b5890 tx=0x7fbb8402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595cc6a04e76ee28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c940051c0 0x7f6c9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 -- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f636000d700 msgr2=0x7f636000fbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:41:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f636000d700 0x7f636000fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 -- 172.21.15.134:0/1293394195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6360004b90 msgr2=0x7f63600037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6360004b90 0x7f63600037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca80b5330 con 0x7f6c940051c0 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6378828640 1 -- 172.21.15.134:0/1293394195 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637406da80 con 0x7f6360003da0 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f6379029640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6360004b90 0x7f63600037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f637982a640 1 --2- 172.21.15.134:0/1293394195 >> v2:172.21.15.134:3300/0 conn(0x7f63740b2670 0x7f637415a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f637982a640 1 -- 172.21.15.134:0/1293394195 reap_dead start 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.796+0000 7f3ac1002640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa4004d40 0x7f3aa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f3ac1002640 1 -- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 msgr2=0x7f3aa40039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:41:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f3ac1002640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3abc0cd7a0 0x7f3aa40039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f3ac1002640 1 -- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa4003fe0 msgr2=0x7f3aa4004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:41:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f3ac1002640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa4003fe0 0x7f3aa4004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9400c0f0 con 0x7f6c94003b40 2024-09-15T22:41:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f3ac1002640 1 -- 172.21.15.134:0/2181922003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc15e6a0 con 0x7f3aa4004d40 2024-09-15T22:41:35.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9400c2f0 con 0x7f6c94004800 2024-09-15T22:41:35.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 0x7f6c94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6378828640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 0x7f6360004220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f636c00c4e0 tx=0x7f6360004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d16af9524684b0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fbb8d1b1640 1 -- 172.21.15.134:0/2763383748 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84037070 con 0x7fbb8806c0e0 2024-09-15T22:41:35.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fbb8d1b1640 1 -- 172.21.15.134:0/2763383748 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84032440 con 0x7fbb8806c0e0 2024-09-15T22:41:35.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7fbb8d1b1640 1 -- 172.21.15.134:0/2763383748 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84032810 con 0x7fbb8806c0e0 2024-09-15T22:41:35.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f6ca6d9d640 1 --2- 172.21.15.134:0/3299979163 >> v2:172.21.15.134:3300/0 conn(0x7f6ca806e500 0x7f6ca80720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7fbf8affd640 1 --2- 172.21.15.134:0/2267416476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0b5a50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c063260 tx=0x7fbf7c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6e8518320f65f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca659c640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94003b40 0x7f6c94003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca5d9b640 1 -- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94003b40 msgr2=0x7f6c94003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca6d9d640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c940051c0 0x7f6c9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94003b40 0x7f6c94003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca5d9b640 1 -- 172.21.15.134:0/3299979163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c940051c0 msgr2=0x7f6c9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd504008ed0 msgr2=0x7fd5040eb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00c0e0 con 0x7f6360003da0 2024-09-15T22:41:35.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c02c610 con 0x7f6360003da0 2024-09-15T22:41:35.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f636bfff640 1 -- 172.21.15.134:0/1293394195 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c02ca80 con 0x7f6360003da0 2024-09-15T22:41:35.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7fd512cdd640 1 --2- 172.21.15.134:0/3247290599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd504008ed0 0x7fd5040eb580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd50400ea50 tx=0x7fd4f802a130 comp rx=0 tx=0).stop 2024-09-15T22:41:35.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7fbb90417640 1 -- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 msgr2=0x7fbb881664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c940051c0 0x7f6c9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca5d9b640 1 -- 172.21.15.134:0/3299979163 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c94003520 con 0x7f6c94004800 2024-09-15T22:41:35.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca6d9d640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c940051c0 0x7f6c9400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f6ca6d9d640 1 -- 172.21.15.134:0/3299979163 reap_dead start 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7fbb90417640 1 --2- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881664c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb880b5890 tx=0x7fbb8402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 -- 172.21.15.134:0/2763383748 shutdown_connections 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 --2- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881664c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 --2- 172.21.15.134:0/2763383748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb880af900 0x7fbb8806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 --2- 172.21.15.134:0/2763383748 >> v2:172.21.15.134:3300/0 conn(0x7fbb88162930 0x7fbb880cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 -- 172.21.15.134:0/2763383748 >> 172.21.15.134:0/2763383748 conn(0x7fbb88062cc0 msgr2=0x7fbb8806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f637b28d640 1 -- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 msgr2=0x7f6360004220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f637b28d640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 0x7f6360004220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f636c00c4e0 tx=0x7f6360004820 comp rx=0 tx=0).stop 2024-09-15T22:41:35.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 -- 172.21.15.134:0/2763383748 shutdown_connections 2024-09-15T22:41:35.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbb90417640 1 -- 172.21.15.134:0/2763383748 wait complete. 2024-09-15T22:41:35.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 0x7f6c94004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001eb0 tx=0x7f6c94005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fafbab95559aabf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f9a90c77640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a84007810 0x7f9a84007c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f9a90c77640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a840ea940 con 0x7f9a840560a0 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f9a90c77640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9a84055070 con 0x7f9a84007810 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.797+0000 7f9a90c77640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9a84055350 con 0x7f9a8400bda0 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8affd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9a840560a0 0x7f9a8400c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:44960/0 (socket says 172.21.15.134:44960) 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8affd640 1 -- 172.21.15.134:0/3790043689 learned_addr learned my addr 172.21.15.134:0/3790043689 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/3790043689 >> v2:172.21.15.177:3300/0 conn(0x7f9a8400bda0 0x7f9a84049c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8a7fc640 1 -- 172.21.15.134:0/3790043689 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637057680 0 0) 0x7f9a840ea940 con 0x7f9a840560a0 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8a7fc640 1 -- 172.21.15.134:0/3790043689 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a7c003520 con 0x7f9a840560a0 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/3790043689 >> v2:172.21.15.134:3300/0 conn(0x7f9a84007810 msgr2=0x7f9a84007c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/3790043689 >> v2:172.21.15.134:3300/0 conn(0x7f9a84007810 0x7f9a84007c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/3790043689 >> v1:172.21.15.177:6789/0 conn(0x7f9a840560a0 legacy=0x7f9a8400c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/3790043689 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a84055630 con 0x7f9a8400bda0 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004a80 con 0x7f6c94004800 2024-09-15T22:41:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9802f030 con 0x7f6c94004800 2024-09-15T22:41:35.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 shutdown_connections 2024-09-15T22:41:35.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f6ca559a640 1 -- 172.21.15.134:0/3299979163 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98008510 con 0x7f6c94004800 2024-09-15T22:41:35.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fd512cdd640 1 --2- 172.21.15.134:0/3247290599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd504008ed0 0x7fd5040eb580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fd512cdd640 1 --2- 172.21.15.134:0/3247290599 >> v2:172.21.15.134:3300/0 conn(0x7fd5040373a0 0x7fd5040eb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 >> 172.21.15.134:0/3247290599 conn(0x7fd50401ea40 msgr2=0x7fd5040556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/3790043689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a84049c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a84039320 tx=0x7f9a8003b090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73afc04be03638e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 shutdown_connections 2024-09-15T22:41:35.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.798+0000 7f3ac1002640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa4004d40 0x7f3aa40051c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400a8a0 tx=0x7f3aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7e2c609731eaba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fd512cdd640 1 -- 172.21.15.134:0/3247290599 wait complete. 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbf89ffb640 1 -- 172.21.15.134:0/2267416476 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c037070 con 0x7fbf8c1629c0 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbf89ffb640 1 -- 172.21.15.134:0/2267416476 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c032440 con 0x7fbf8c1629c0 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7fbf89ffb640 1 -- 172.21.15.134:0/2267416476 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c032810 con 0x7fbf8c1629c0 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 -- 172.21.15.134:0/2267416476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c1629c0 msgr2=0x7fbf8c0b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/2267416476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0b5a50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c063260 tx=0x7fbf7c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400a4a0 con 0x7f3aa4004d40 2024-09-15T22:41:35.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 -- 172.21.15.134:0/2267416476 shutdown_connections 2024-09-15T22:41:35.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/2267416476 >> v2:172.21.15.134:3300/0 conn(0x7fbf8c072f70 0x7fbf8c0cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/2267416476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0b5a50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 -- 172.21.15.134:0/2267416476 >> 172.21.15.134:0/2267416476 conn(0x7fbf8c0b0640 msgr2=0x7fbf8c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab402f070 con 0x7f3aa4004d40 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 -- 172.21.15.134:0/2267416476 shutdown_connections 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.799+0000 7f3abb7fe640 1 -- 172.21.15.134:0/2181922003 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab402bd30 con 0x7f3aa4004d40 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac2a65640 1 -- 172.21.15.134:0/2181922003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa4004d40 msgr2=0x7f3aa40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/2181922003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa4004d40 0x7f3aa40051c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400a8a0 tx=0x7f3aa4005830 comp rx=0 tx=0).stop 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac1002640 1 -- 172.21.15.134:0/2181922003 reap_dead start 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac2a65640 1 -- 172.21.15.134:0/2181922003 shutdown_connections 2024-09-15T22:41:35.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac2a65640 1 -- 172.21.15.134:0/2181922003 >> 172.21.15.134:0/2181922003 conn(0x7f3abc062cc0 msgr2=0x7f3abc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f3ac2a65640 1 -- 172.21.15.134:0/2181922003 shutdown_connections 2024-09-15T22:41:35.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 msgr2=0x7f6c94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 0x7f6c94004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001eb0 tx=0x7f6c94005830 comp rx=0 tx=0).stop 2024-09-15T22:41:35.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f637b28d640 1 -- 172.21.15.134:0/1293394195 shutdown_connections 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f637b28d640 1 --2- 172.21.15.134:0/1293394195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6360003da0 0x7f6360004220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f637b28d640 1 -- 172.21.15.134:0/1293394195 >> 172.21.15.134:0/1293394195 conn(0x7f637406bba0 msgr2=0x7f637406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7fbf8bfff640 1 -- 172.21.15.134:0/2267416476 wait complete. 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 shutdown_connections 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3299979163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c94004800 0x7f6c94004c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 >> 172.21.15.134:0/3299979163 conn(0x7f6ca806bba0 msgr2=0x7f6ca806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f637b28d640 1 -- 172.21.15.134:0/1293394195 shutdown_connections 2024-09-15T22:41:35.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 shutdown_connections 2024-09-15T22:41:35.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f637b28d640 1 -- 172.21.15.134:0/1293394195 wait complete. 2024-09-15T22:41:35.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f9a8a7fc640 1 -- 172.21.15.134:0/3790043689 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80048070 con 0x7f9a8400bda0 2024-09-15T22:41:35.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f3ac2a65640 1 -- 172.21.15.134:0/2181922003 wait complete. 2024-09-15T22:41:35.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f9a8a7fc640 1 -- 172.21.15.134:0/3790043689 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8003bde0 con 0x7f9a8400bda0 2024-09-15T22:41:35.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.800+0000 7f9a8a7fc640 1 -- 172.21.15.134:0/3790043689 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80043660 con 0x7f9a8400bda0 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 -- 172.21.15.134:0/3790043689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 msgr2=0x7f9a84049c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 --2- 172.21.15.134:0/3790043689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a84049c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a84039320 tx=0x7f9a8003b090 comp rx=0 tx=0).stop 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f6ca759e640 1 -- 172.21.15.134:0/3299979163 wait complete. 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7fbb90417640 1 Processor -- start 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7fbb90417640 1 -- start start 2024-09-15T22:41:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fd512cdd640 1 Processor -- start 2024-09-15T22:41:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 -- 172.21.15.134:0/3790043689 shutdown_connections 2024-09-15T22:41:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 --2- 172.21.15.134:0/3790043689 >> v2:172.21.15.134:3300/0 conn(0x7f9a84007810 0x7f9a84007c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 --2- 172.21.15.134:0/3790043689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a84049c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.801+0000 7f9a90c77640 1 -- 172.21.15.134:0/3790043689 >> 172.21.15.134:0/3790043689 conn(0x7f9a840567b0 msgr2=0x7f9a84056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fbf8bfff640 1 Processor -- start 2024-09-15T22:41:35.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fd512cdd640 1 -- start start 2024-09-15T22:41:35.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fbb90417640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7f9a90c77640 1 -- 172.21.15.134:0/3790043689 shutdown_connections 2024-09-15T22:41:35.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fbb90417640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7f9a90c77640 1 -- 172.21.15.134:0/3790043689 wait complete. 2024-09-15T22:41:35.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7fbf8bfff640 1 -- start start 2024-09-15T22:41:35.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7f3ac2a65640 1 Processor -- start 2024-09-15T22:41:35.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7f637b28d640 1 Processor -- start 2024-09-15T22:41:35.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.802+0000 7f637b28d640 1 -- start start 2024-09-15T22:41:35.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb8d9b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7f3ac2a65640 1 -- start start 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb8d9b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37498/0 (socket says 172.21.15.134:37498) 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb8d9b2640 1 -- 172.21.15.134:0/4223716481 learned_addr learned my addr 172.21.15.134:0/4223716481 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 0x7fbb881570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88162d10 con 0x7fbb880af900 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb880b4590 con 0x7fbb8806c0e0 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb8e1b3640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb8e9b4640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 0x7fbb881570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf8c072f70 0x7fbf8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 0x7fbf8c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbb880cde00 con 0x7fbb88162930 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7f637b28d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 0x7f6374156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7f637b28d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.803+0000 7f637b28d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 0x7f63741ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 0x7fbf8c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 0x7fd50404d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 0x7fbf8c14ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42980/0 (socket says 172.21.15.134:42980) 2024-09-15T22:41:35.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637982a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 0x7f63741ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f6ca759e640 1 Processor -- start 2024-09-15T22:41:35.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5040373a0 0x7fd50417a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637982a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 0x7f63741ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37510/0 (socket says 172.21.15.134:37510) 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f6378828640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f6378828640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59866/0 (socket says 172.21.15.134:59866) 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637982a640 1 -- 172.21.15.134:0/2467294181 learned_addr learned my addr 172.21.15.134:0/2467294181 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f637406c810 con 0x7f63740b18d0 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f637406c690 con 0x7f6360003da0 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f637415a9a0 con 0x7f6374073220 2024-09-15T22:41:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd510a79640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 0x7fd50404d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd510a79640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 0x7fd50404d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59878/0 (socket says 172.21.15.134:59878) 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8bfff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c167320 con 0x7fbf8c1629c0 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c0b5f90 con 0x7fbf8c0cd040 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37526/0 (socket says 172.21.15.134:37526) 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 -- 172.21.15.134:0/3503599945 learned_addr learned my addr 172.21.15.134:0/3503599945 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8c166f40 con 0x7fbf8c072f70 2024-09-15T22:41:35.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5040373a0 0x7fd50417a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbb8d9b2640 1 -- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 msgr2=0x7fbb881570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbb8d9b2640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 0x7fbb881570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbb8d9b2640 1 -- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 msgr2=0x7fbb881638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd510a79640 1 -- 172.21.15.134:0/2525582135 learned_addr learned my addr 172.21.15.134:0/2525582135 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f3ac2a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f3ac2a65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3abc1588f0 0x7f3abc158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59884/0 (socket says 172.21.15.134:59884) 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 0x7fd50417cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd50403b470 con 0x7fd504037780 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd504034530 con 0x7fd5040373a0 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd51127a640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 0x7fd50417cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd50403b5f0 con 0x7fd504008ed0 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbb8d9b2640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbb8d9b2640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb88163fa0 con 0x7fbb880af900 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fbb8e9b4640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 0x7fbb881570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fbb8d9b2640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800eba0 tx=0x7fbb7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f9a90c77640 1 Processor -- start 2024-09-15T22:41:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f9a90c77640 1 -- start start 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7f6379029640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 0x7f6374156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fbb8e1b3640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 -- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 msgr2=0x7f6374156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 0x7f6374156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 -- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 msgr2=0x7f63741ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 0x7f63741ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6374149310 con 0x7f6374073220 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6379029640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 0x7f6374156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 -- 172.21.15.134:0/3227179911 learned_addr learned my addr 172.21.15.134:0/3227179911 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3abc15d340 0x7f3abc15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 -- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf8c072f70 msgr2=0x7fbf8c06e7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf8c072f70 0x7fbf8c06e7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 -- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 msgr2=0x7fbf8c14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 0x7fbf8c14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.804+0000 7fbf8b7fe640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c06feb0 con 0x7fbf8c1629c0 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc0cfe60 con 0x7f3abc1588f0 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc15ec60 con 0x7f3abc15d340 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3abc15a820 con 0x7f3aa4004d40 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3abbfff640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3abc1588f0 0x7f3abc158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 -- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3abc15d340 msgr2=0x7f3abc15d7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3abc15d340 0x7f3abc15d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 -- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3abc1588f0 msgr2=0x7f3abc158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3abc1588f0 0x7f3abc158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f3ac0801640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc150720 con 0x7f3aa4004d40 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 -- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 msgr2=0x7fd50404d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 0x7fd50404d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 -- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5040373a0 msgr2=0x7fd50417a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5040373a0 0x7fd50417a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50417d500 con 0x7fd504037780 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7fd51127a640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 0x7fd50417cd90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0746d0 tx=0x7fd50c069ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c090070 con 0x7fd504037780 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c069040 con 0x7fd504037780 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c094610 con 0x7fd504037780 2024-09-15T22:41:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50417d7e0 con 0x7fd504037780 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5040ea050 con 0x7fd504037780 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78017070 con 0x7fbb880af900 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6ca759e640 1 -- start start 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f6ca759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 0x7f6ca80abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:43016/0 (socket says 172.21.15.134:43016) 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca659c640 1 -- 172.21.15.134:0/3019950031 learned_addr learned my addr 172.21.15.134:0/3019950031 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ca8156870 0x7f6ca8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 0x7f6ca80abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f9a90c77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a90c77640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a840d9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a90c77640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a840560a0 0x7f9a8403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37558/0 (socket says 172.21.15.134:37558) 2024-09-15T22:41:35.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a90c77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84054d00 con 0x7f9a84007810 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a90c77640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84055bf0 con 0x7f9a8400bda0 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a90c77640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9a84008180 con 0x7f9a840560a0 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/1487848504 learned_addr learned my addr 172.21.15.134:0/1487848504 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8affd640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a840d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8bfff640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a840560a0 0x7f9a8403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a840560a0 msgr2=0x7f9a8403adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a840560a0 0x7f9a8403adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 msgr2=0x7f9a840d9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a840d9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8b7fe640 1 -- 172.21.15.134:0/1487848504 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a840e1220 con 0x7f9a84007810 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f9a8affd640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a840d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:35.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f9a8b7fe640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009850 tx=0x7f9a80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f27ff59e640 1 Processor -- start 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f27ff59e640 1 -- start start 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6378828640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f636c001c20 tx=0x7f636c001b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c044070 con 0x7f6374073220 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c003970 con 0x7f6374073220 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c003d60 con 0x7f6374073220 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.805+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6374156090 con 0x7f6374073220 2024-09-15T22:41:35.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f637415ae80 con 0x7f6374073220 2024-09-15T22:41:35.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fbf8b7fe640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009fd0 tx=0x7fbf8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.806+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7800edb0 con 0x7fbb880af900 2024-09-15T22:41:35.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8075f90 con 0x7f6ca80ab930 2024-09-15T22:41:35.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca6d9d640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ca8156870 0x7f6ca8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca80b4fc0 con 0x7f6c94004800 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca8076110 con 0x7f6ca8156870 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78017070 con 0x7fbb880af900 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27ff59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2800151580 0x7f280015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27ff59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28000d05a0 0x7f28000d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27ff59e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f280015f0a0 con 0x7f280006e2e0 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27ff59e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f280015baf0 con 0x7f28000d05a0 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27ff59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f280015af70 con 0x7f2800151580 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27fed9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f280006e2e0 0x7f280006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42030/0 (socket says 172.21.15.134:42030) 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27fed9d640 1 -- 172.21.15.134:0/2233988247 learned_addr learned my addr 172.21.15.134:0/2233988247 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb88164280 con 0x7fbb880af900 2024-09-15T22:41:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f3ac0801640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00ea60 tx=0x7f3aac00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb88164840 con 0x7fbb880af900 2024-09-15T22:41:35.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50417dd00 con 0x7fd504037780 2024-09-15T22:41:35.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63740b1f60 con 0x7f6374073220 2024-09-15T22:41:35.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f27fdd9b640 1 --2- 172.21.15.134:0/2233988247 >> v2:172.21.15.134:3300/0 conn(0x7f28000d05a0 0x7f28000d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.807+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00cde0 con 0x7f3aa4004d40 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac00a410 con 0x7f3aa4004d40 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00a7e0 con 0x7f3aa4004d40 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3abc150a00 con 0x7f3aa4004d40 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3abc150fc0 con 0x7f3aa4004d40 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80052070 con 0x7f9a84007810 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a840e1500 con 0x7f9a84007810 2024-09-15T22:41:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8404dcb0 con 0x7f9a84007810 2024-09-15T22:41:35.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f27fd59a640 1 -- 172.21.15.134:0/2233988247 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340325023 0 0) 0x7f27f8001110 con 0x7f280006e2e0 2024-09-15T22:41:35.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f27fd59a640 1 -- 172.21.15.134:0/2233988247 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ec003520 con 0x7f280006e2e0 2024-09-15T22:41:35.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f27fe59c640 1 --2- 172.21.15.134:0/2233988247 >> v2:172.21.15.177:3300/0 conn(0x7f2800151580 0x7f280015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f636c005110 con 0x7f6374073220 2024-09-15T22:41:35.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6369ffb640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 0x7f635806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca659c640 1 -- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ca8156870 msgr2=0x7f6ca8156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca659c640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ca8156870 0x7f6ca8156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca659c640 1 -- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 msgr2=0x7f6ca80abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca659c640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 0x7f6ca80abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca659c640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca80ad7b0 con 0x7f6c94004800 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.808+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 0x7f6ca80abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f6ca659c640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003f70 tx=0x7f6c90001860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f27fe59c640 1 -- 172.21.15.134:0/2233988247 >> v2:172.21.15.134:3300/0 conn(0x7f28000d05a0 msgr2=0x7f28000d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f27fe59c640 1 --2- 172.21.15.134:0/2233988247 >> v2:172.21.15.134:3300/0 conn(0x7f28000d05a0 0x7f28000d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f27fe59c640 1 -- 172.21.15.134:0/2233988247 >> v1:172.21.15.134:6789/0 conn(0x7f280006e2e0 legacy=0x7f280006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f27fe59c640 1 -- 172.21.15.134:0/2233988247 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280015b250 con 0x7f2800151580 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3abc06f030 con 0x7f3aa4004d40 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f6379029640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 0x7f635806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.809+0000 7f6379029640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 0x7f635806e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6364001650 tx=0x7f6364009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd50c093070 con 0x7fd504037780 2024-09-15T22:41:35.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f636c0ab7e0 con 0x7f6374073220 2024-09-15T22:41:35.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90017070 con 0x7f6c94004800 2024-09-15T22:41:35.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9000e820 con 0x7f6c94004800 2024-09-15T22:41:35.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb7801a070 con 0x7fbb880af900 2024-09-15T22:41:35.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fd5097fa640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 0x7fd4f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd50c106d40 con 0x7fd504037780 2024-09-15T22:41:35.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbb7effd640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 0x7fbb6c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbb7800f040 con 0x7fbb880af900 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84014420 con 0x7fbf8c1629c0 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf84019070 con 0x7fbf8c1629c0 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84014800 con 0x7fbf8c1629c0 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8c06ee10 con 0x7fbf8c1629c0 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8c06f3d0 con 0x7fbf8c1629c0 2024-09-15T22:41:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000ec10 con 0x7f6c94004800 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca8157580 con 0x7f6c94004800 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca8157b40 con 0x7f6c94004800 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7fd510a79640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 0x7fd4f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.810+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8806bba0 con 0x7fbb880af900 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a80049040 con 0x7f9a84007810 2024-09-15T22:41:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80048070 con 0x7f9a84007810 2024-09-15T22:41:35.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7fd510a79640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 0x7fd4f006e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd500009440 tx=0x7fd500009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca80720f0 con 0x7f6c94004800 2024-09-15T22:41:35.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8c0b6410 con 0x7fbf8c1629c0 2024-09-15T22:41:35.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7fbb8e1b3640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 0x7fbb6c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f27fe59c640 1 --2- 172.21.15.134:0/2233988247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f280015eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28000709c0 tx=0x7f27f002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4a91d3a02e02fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7fbb8e1b3640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 0x7fbb6c06eb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb88131660 tx=0x7fbb800073e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.811+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3aac00a980 con 0x7f3aa4004d40 2024-09-15T22:41:35.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.812+0000 7f3ab97fa640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 0x7f3aa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3aac08bd20 con 0x7f3aa4004d40 2024-09-15T22:41:35.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c005290 con 0x7f9a84007810 2024-09-15T22:41:35.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f3abbfff640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 0x7f3aa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f27fd59a640 1 -- 172.21.15.134:0/2233988247 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0007740 con 0x7f2800151580 2024-09-15T22:41:35.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f27fd59a640 1 -- 172.21.15.134:0/2233988247 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f00078e0 con 0x7f2800151580 2024-09-15T22:41:35.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f27fd59a640 1 -- 172.21.15.134:0/2233988247 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0007cb0 con 0x7f2800151580 2024-09-15T22:41:35.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a80055070 con 0x7f9a84007810 2024-09-15T22:41:35.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c9001c450 con 0x7f6c94004800 2024-09-15T22:41:35.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f3abbfff640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 0x7f3aa806e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0007fd0 tx=0x7f3ab0007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.813+0000 7f6c9effd640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 0x7f6c8806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6c9008b260 con 0x7f6c94004800 2024-09-15T22:41:35.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 0x7f6c8806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f636c032030 con 0x7f6374073220 2024-09-15T22:41:35.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 -- 172.21.15.134:0/2233988247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 msgr2=0x7f280015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 --2- 172.21.15.134:0/2233988247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f280015eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28000709c0 tx=0x7f27f002a5f0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f9a77fff640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f6ca5d9b640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 0x7f6c8806e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c98033000 tx=0x7f6c9800a070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 -- 172.21.15.134:0/2233988247 shutdown_connections 2024-09-15T22:41:35.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 --2- 172.21.15.134:0/2233988247 >> v2:172.21.15.134:3300/0 conn(0x7f28000d05a0 0x7f28000d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 --2- 172.21.15.134:0/2233988247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f280015eb60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 -- 172.21.15.134:0/2233988247 >> 172.21.15.134:0/2233988247 conn(0x7f280006d080 msgr2=0x7f280006d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:35.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f9a8affd640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 -- 172.21.15.134:0/2233988247 shutdown_connections 2024-09-15T22:41:35.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f27ff59e640 1 -- 172.21.15.134:0/2233988247 wait complete. 2024-09-15T22:41:35.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.814+0000 7f9a8affd640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 0x7f9a7006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c06b750 tx=0x7f9a8c06e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.816+0000 7f27ff59e640 1 Processor -- start 2024-09-15T22:41:35.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.816+0000 7f27ff59e640 1 -- start start 2024-09-15T22:41:35.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.816+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9a800ba0f0 con 0x7f9a84007810 2024-09-15T22:41:35.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.816+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd50417dd00 con 0x7fd504037780 2024-09-15T22:41:35.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f280006e2e0 0x7f28000c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f28000724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28000b3a30 con 0x7f28000d05a0 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f280015b810 con 0x7f2800151580 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27ff59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2800151960 con 0x7f280006e2e0 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fdd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fdd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37584/0 (socket says 172.21.15.134:37584) 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fdd9b640 1 -- 172.21.15.134:0/1761522091 learned_addr learned my addr 172.21.15.134:0/1761522091 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f28000724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fe59c640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f280006e2e0 0x7f28000c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 -- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f280006e2e0 msgr2=0x7f28000c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f280006e2e0 0x7f28000c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 -- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 msgr2=0x7f2800073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 -- 172.21.15.134:0/1761522091 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280014fa20 con 0x7f2800151580 2024-09-15T22:41:35.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fdd9b640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:35.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.817+0000 7f27fed9d640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f28000724d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27f800c3c0 tx=0x7f27f800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.821+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb780598f0 con 0x7fbb880af900 2024-09-15T22:41:35.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.822+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbf840149a0 con 0x7fbf8c1629c0 2024-09-15T22:41:35.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.823+0000 7fbf837fe640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 0x7fbf7406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.823+0000 7fbf8affd640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 0x7fbf7406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.823+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3aac013070 con 0x7f3aa4004d40 2024-09-15T22:41:35.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c90059360 con 0x7f6c94004800 2024-09-15T22:41:35.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7fbf8affd640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 0x7fbf7406e7c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c034000 tx=0x7fbf7c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8017070 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8005ce0 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80072f0 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28000c7200 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.824+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28000c7780 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.825+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280015ab10 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.827+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27f801a070 con 0x7f2800151580 2024-09-15T22:41:35.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.827+0000 7f27f6ffd640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 0x7f27e006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:35.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.828+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f27f808aad0 con 0x7f2800151580 2024-09-15T22:41:35.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.828+0000 7f27fe59c640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 0x7f27e006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:35.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.828+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbf84058870 con 0x7fbf8c1629c0 2024-09-15T22:41:35.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.828+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a8008a260 con 0x7f9a84007810 2024-09-15T22:41:35.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.829+0000 7f27fe59c640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 0x7f27e006e840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27f0034000 tx=0x7f27f002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:35.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.830+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27f8021020 con 0x7f2800151580 2024-09-15T22:41:35.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:35.837+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf8401b310 con 0x7fbf8c1629c0 2024-09-15T22:41:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.211+0000 7f637b28d640 1 -- 172.21.15.134:0/2467294181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f637414d540 con 0x7f6374073220 2024-09-15T22:41:36.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.211+0000 7f6369ffb640 1 -- 172.21.15.134:0/2467294181 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f636c0798e0 con 0x7f6374073220 2024-09-15T22:41:36.213 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 msgr2=0x7f635806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 0x7f635806e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6364001650 tx=0x7f6364009040 comp rx=0 tx=0).stop 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 msgr2=0x7f637414b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f636c001c20 tx=0x7f636c001b90 comp rx=0 tx=0).stop 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 shutdown_connections 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f635806c380 0x7f635806e840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63740b18d0 0x7f63741ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6374073220 0x7f637414b230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 --2- 172.21.15.134:0/2467294181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6360003da0 0x7f6374156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 >> 172.21.15.134:0/2467294181 conn(0x7f637406bba0 msgr2=0x7f63740b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.216+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 shutdown_connections 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.216+0000 7f63577fe640 1 -- 172.21.15.134:0/2467294181 wait complete. 2024-09-15T22:41:36.218 INFO:teuthology.orchestra.run.smithi134.stdout:64424509445 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.215+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd50401f1a0 con 0x7fd504037780 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.216+0000 7fd5097fa640 1 -- 172.21.15.134:0/2525582135 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd50c0d4ed0 con 0x7fd504037780 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 msgr2=0x7fd4f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 0x7fd4f006e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd500009440 tx=0x7fd500009240 comp rx=0 tx=0).stop 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 msgr2=0x7fd50417cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 0x7fd50417cd90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0746d0 tx=0x7fd50c069ed0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 shutdown_connections 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd4f006c2b0 0x7fd4f006e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd504037780 0x7fd50417cd90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5040373a0 0x7fd50417a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 --2- 172.21.15.134:0/2525582135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd504008ed0 0x7fd50404d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 >> 172.21.15.134:0/2525582135 conn(0x7fd50401ea40 msgr2=0x7fd50400b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 shutdown_connections 2024-09-15T22:41:36.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.220+0000 7fd512cdd640 1 -- 172.21.15.134:0/2525582135 wait complete. 2024-09-15T22:41:36.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.225+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3abc072250 con 0x7f3aa4004d40 2024-09-15T22:41:36.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.226+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbb880ce0c0 con 0x7fbb880af900 2024-09-15T22:41:36.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.226+0000 7f3ab97fa640 1 -- 172.21.15.134:0/3227179911 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3aac059e30 con 0x7f3aa4004d40 2024-09-15T22:41:36.227 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.226+0000 7fbb7effd640 1 -- 172.21.15.134:0/4223716481 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb780598f0 con 0x7fbb880af900 2024-09-15T22:41:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.226+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6ca80ac2f0 con 0x7f6c94004800 2024-09-15T22:41:36.228 INFO:teuthology.orchestra.run.smithi134.stdout:64424509446 2024-09-15T22:41:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.227+0000 7f6c9effd640 1 -- 172.21.15.134:0/3019950031 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c9005d660 con 0x7f6c94004800 2024-09-15T22:41:36.229 INFO:teuthology.orchestra.run.smithi134.stdout:64424509445 2024-09-15T22:41:36.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.229+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9a6c005580 con 0x7f9a84007810 2024-09-15T22:41:36.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.229+0000 7f9a77fff640 1 -- 172.21.15.134:0/1487848504 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a80089b60 con 0x7f9a84007810 2024-09-15T22:41:36.231 INFO:teuthology.orchestra.run.smithi134.stdout:64424509445 2024-09-15T22:41:36.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 msgr2=0x7f3aa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 0x7f3aa806e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0007fd0 tx=0x7f3ab0007dc0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 msgr2=0x7f3abc14f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00ea60 tx=0x7f3aac00ef20 comp rx=0 tx=0).stop 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 shutdown_connections 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3aa806c2b0 0x7f3aa806e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3abc15d340 0x7f3abc15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3abc1588f0 0x7f3abc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 --2- 172.21.15.134:0/3227179911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aa4004d40 0x7f3abc14f020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.230+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 >> 172.21.15.134:0/3227179911 conn(0x7f3abc062cc0 msgr2=0x7f3abc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 shutdown_connections 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 msgr2=0x7fbb6c06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 0x7fbb6c06eb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb88131660 tx=0x7fbb800073e0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 msgr2=0x7fbb8815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800eba0 tx=0x7fbb7800c520 comp rx=0 tx=0).stop 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 shutdown_connections 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb6c06c6b0 0x7fbb6c06eb70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb88162930 0x7fbb881570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb880af900 0x7fbb8815bed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 --2- 172.21.15.134:0/4223716481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb8806c0e0 0x7fbb881638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 msgr2=0x7f6c8806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 >> 172.21.15.134:0/4223716481 conn(0x7fbb88062cc0 msgr2=0x7fbb88161500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 shutdown_connections 2024-09-15T22:41:36.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7fbb90417640 1 -- 172.21.15.134:0/4223716481 wait complete. 2024-09-15T22:41:36.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 0x7f6c8806e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c98033000 tx=0x7f6c9800a070 comp rx=0 tx=0).stop 2024-09-15T22:41:36.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 msgr2=0x7f6ca81587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003f70 tx=0x7f6c90001860 comp rx=0 tx=0).stop 2024-09-15T22:41:36.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 shutdown_connections 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c8806c380 0x7f6c8806e840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ca8156870 0x7f6ca8156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca80ab930 0x7f6ca80abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 --2- 172.21.15.134:0/3019950031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c94004800 0x7f6ca81587c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 >> 172.21.15.134:0/3019950031 conn(0x7f6ca806bba0 msgr2=0x7f6ca80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f3ac2a65640 1 -- 172.21.15.134:0/3227179911 wait complete. 2024-09-15T22:41:36.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 shutdown_connections 2024-09-15T22:41:36.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.231+0000 7f6ca759e640 1 -- 172.21.15.134:0/3019950031 wait complete. 2024-09-15T22:41:36.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-09-15T22:41:36.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f280006dc80 con 0x7f2800151580 2024-09-15T22:41:36.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 msgr2=0x7f9a7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 0x7f9a7006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c06b750 tx=0x7f9a8c06e040 comp rx=0 tx=0).stop 2024-09-15T22:41:36.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 msgr2=0x7f9a840d8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009850 tx=0x7f9a80004730 comp rx=0 tx=0).stop 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 shutdown_connections 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a840560a0 0x7f9a8403adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8400bda0 0x7f9a840d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 --2- 172.21.15.134:0/1487848504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a84007810 0x7f9a840d8bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 >> 172.21.15.134:0/1487848504 conn(0x7f9a840567b0 msgr2=0x7f9a8403be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.233+0000 7f27f6ffd640 1 -- 172.21.15.134:0/1761522091 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f280015f0a0 con 0x7f2800151580 2024-09-15T22:41:36.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.234+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 shutdown_connections 2024-09-15T22:41:36.240 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-09-15T22:41:36.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.234+0000 7f9a90c77640 1 -- 172.21.15.134:0/1487848504 wait complete. 2024-09-15T22:41:36.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.237+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 msgr2=0x7f27e006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.237+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 0x7f27e006e840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27f0034000 tx=0x7f27f002f000 comp rx=0 tx=0).stop 2024-09-15T22:41:36.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 msgr2=0x7f28000724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f28000724d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27f800c3c0 tx=0x7f27f800c880 comp rx=0 tx=0).stop 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 shutdown_connections 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f27e006c380 0x7f27e006e840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2800151580 0x7f28000724d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000d05a0 0x7f2800073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 --2- 172.21.15.134:0/1761522091 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f280006e2e0 0x7f28000c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 >> 172.21.15.134:0/1761522091 conn(0x7f280006d080 msgr2=0x7f280015bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 shutdown_connections 2024-09-15T22:41:36.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.238+0000 7f27ff59e640 1 -- 172.21.15.134:0/1761522091 wait complete. 2024-09-15T22:41:36.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2024-09-15T22:41:36.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.241+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbf8c162100 con 0x7fbf8c1629c0 2024-09-15T22:41:36.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.242+0000 7fbf837fe640 1 -- 172.21.15.134:0/3503599945 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf8405aed0 con 0x7fbf8c1629c0 2024-09-15T22:41:36.244 INFO:teuthology.orchestra.run.smithi134.stdout:64424509445 2024-09-15T22:41:36.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 msgr2=0x7fbf7406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 0x7fbf7406e7c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c034000 tx=0x7fbf7c02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 msgr2=0x7fbf8c0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009fd0 tx=0x7fbf8400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 shutdown_connections 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbf7406c300 0x7fbf7406e7c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf8c1629c0 0x7fbf8c0cf640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8c0cd040 0x7fbf8c14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 --2- 172.21.15.134:0/3503599945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf8c072f70 0x7fbf8c06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 >> 172.21.15.134:0/3503599945 conn(0x7fbf8c0b0640 msgr2=0x7fbf8c160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 shutdown_connections 2024-09-15T22:41:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:36.245+0000 7fbf8bfff640 1 -- 172.21.15.134:0/3503599945 wait complete. 2024-09-15T22:41:36.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-15T22:41:36.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-15T22:41:36.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-15T22:41:36.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-15T22:41:36.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-09-15T22:41:36.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-09-15T22:41:37.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:41:37.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:41:37.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:41:37.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:41:37.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:41:37.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:41:37.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:41:37.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:41:37.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.389+0000 7f9e8a73b640 1 Processor -- start 2024-09-15T22:41:37.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.389+0000 7f9e8a73b640 1 -- start start 2024-09-15T22:41:37.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c035b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 0x7f9e7c0486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e7c048bf0 0x7f9e7c03a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7c049060 con 0x7f9e7c036090 2024-09-15T22:41:37.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7c052090 con 0x7f9e7c048bf0 2024-09-15T22:41:37.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e8a73b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7c052370 con 0x7f9e7c034c40 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e88cd8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e7c048bf0 0x7f9e7c03a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e88cd8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e7c048bf0 0x7f9e7c03a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53648/0 (socket says 172.21.15.134:53648) 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3716516171 learned_addr learned my addr 172.21.15.134:0/3716516171 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.391+0000 7f9e837fe640 1 --2- 172.21.15.134:0/3716516171 >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 0x7f9e7c0486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.392+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 msgr2=0x7f9e7c035b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:41:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.392+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c035b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.392+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3716516171 >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 msgr2=0x7f9e7c0486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.392+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3716516171 >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 0x7f9e7c0486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.392+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3716516171 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c052650 con 0x7f9e7c048bf0 2024-09-15T22:41:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.393+0000 7f9e837fe640 1 --2- 172.21.15.134:0/3716516171 >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 0x7f9e7c0486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.393+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c03a390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e840637b0 tx=0x7f9e8406b1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9b53d76ad0e62f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.394+0000 7f9e82ffd640 1 -- 172.21.15.134:0/3716516171 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b3070 con 0x7f9e7c048bf0 2024-09-15T22:41:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.394+0000 7f9e82ffd640 1 -- 172.21.15.134:0/3716516171 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840ae440 con 0x7f9e7c048bf0 2024-09-15T22:41:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.394+0000 7f9e82ffd640 1 -- 172.21.15.134:0/3716516171 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ae870 con 0x7f9e7c048bf0 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 msgr2=0x7f9e7c03a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 --2- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c03a390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e840637b0 tx=0x7f9e8406b1c0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3716516171 shutdown_connections 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 --2- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c03a390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 --2- 172.21.15.134:0/3716516171 >> v2:172.21.15.134:3300/0 conn(0x7f9e7c036090 0x7f9e7c0486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 --2- 172.21.15.134:0/3716516171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c035b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3716516171 >> 172.21.15.134:0/3716516171 conn(0x7f9e7c01ea40 msgr2=0x7f9e7c0556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3716516171 shutdown_connections 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.395+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3716516171 wait complete. 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.398+0000 7f9e8a73b640 1 Processor -- start 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.398+0000 7f9e8a73b640 1 -- start start 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c0e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 0x7f9e7c0e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c035570 con 0x7f9e7c036090 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c052c10 con 0x7f9e7c048bf0 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e8a73b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7c03a8d0 con 0x7f9e7c034c40 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e88cd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e88cd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53650/0 (socket says 172.21.15.134:53650) 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3884980276 learned_addr learned my addr 172.21.15.134:0/3884980276 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.400+0000 7f9e837fe640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 0x7f9e7c0e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 msgr2=0x7f9e7c0e4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c0e4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 msgr2=0x7f9e7c0e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 0x7f9e7c0e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e88cd8640 1 -- 172.21.15.134:0/3884980276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c1970f0 con 0x7f9e7c048bf0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.401+0000 7f9e837fe640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 0x7f9e7c0e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.402+0000 7f9e88cd8640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e840637b0 tx=0x7f9e840506b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.403+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84089070 con 0x7f9e7c048bf0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.403+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3884980276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c0e5280 con 0x7f9e7c048bf0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.404+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3884980276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c196850 con 0x7f9e7c048bf0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.404+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840ad670 con 0x7f9e7c048bf0 2024-09-15T22:41:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.404+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ada20 con 0x7f9e7c048bf0 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.406+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e840adbc0 con 0x7f9e7c048bf0 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.407+0000 7f9e80ff9640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 0x7f9e7406e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.407+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9e84115f60 con 0x7f9e7c048bf0 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.407+0000 7f9e83fff640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 0x7f9e7406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.408+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3884980276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e64005290 con 0x7f9e7c048bf0 2024-09-15T22:41:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.408+0000 7f9e83fff640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 0x7f9e7406e980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c051540 tx=0x7f9e70006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.413+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e84144d50 con 0x7f9e7c048bf0 2024-09-15T22:41:37.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.448+0000 7f6bfc511640 1 Processor -- start 2024-09-15T22:41:37.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.448+0000 7f6bfc511640 1 -- start start 2024-09-15T22:41:37.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.449+0000 7f9ce719f640 1 Processor -- start 2024-09-15T22:41:37.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.449+0000 7f9ce719f640 1 -- start start 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfc511640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6bf40cfe90 0x7f6bf40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfc511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40b3560 0x7f6bf406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfc511640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40741d0 con 0x7f6bf406c2c0 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfc511640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf40cdea0 con 0x7f6bf40cfe90 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfc511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf4167460 con 0x7f6bf40b3560 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfaaae640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6bf406c2c0 0x7f6bf406e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55962/0 (socket says 172.21.15.134:55962) 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfa2ad640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6bf40cfe90 0x7f6bf40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f6bfaaae640 1 -- 172.21.15.134:0/3753792343 learned_addr learned my addr 172.21.15.134:0/3753792343 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.450+0000 7f660ace4640 1 Processor -- start 2024-09-15T22:41:37.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f660ace4640 1 -- start start 2024-09-15T22:41:37.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927529955 0 0) 0x7f6bf40741d0 con 0x7f6bf406c2c0 2024-09-15T22:41:37.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc003520 con 0x7f6bf406c2c0 2024-09-15T22:41:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f9ce719f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ce00b8f90 0x7f9ce00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f9ce719f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce00b7170 con 0x7f9ce015e940 2024-09-15T22:41:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f9ce719f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce00b7aa0 con 0x7f9ce015ed20 2024-09-15T22:41:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f9ce719f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00d3660 con 0x7f9ce00b8f90 2024-09-15T22:41:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4015211347 0 0) 0x7f6bdc003520 con 0x7f6bf406c2c0 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40b3560 msgr2=0x7f6bf406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40b3560 0x7f6bf406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40cfe90 msgr2=0x7f6bf40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 --2- 172.21.15.134:0/3753792343 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40cfe90 0x7f6bf40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f15cc696640 1 Processor -- start 2024-09-15T22:41:37.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f15cc696640 1 -- start start 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf41666a0 con 0x7f6bf406c2c0 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6bec001670 con 0x7f6bf406c2c0 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 >> v1:172.21.15.134:6789/0 conn(0x7f6bf406c2c0 legacy=0x7f6bf406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bdc004800 0x7f6bdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bdc0052e0 0x7f6bdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40cdea0 con 0x7f6bdc0052e0 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4167460 con 0x7f6bdc0039b0 2024-09-15T22:41:37.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6bdc00c210 con 0x7f6bdc004800 2024-09-15T22:41:37.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f9cdffff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9ce015ed20 0x7f9ce00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:50916/0 (socket says 172.21.15.134:50916) 2024-09-15T22:41:37.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f9cdffff640 1 -- 172.21.15.134:0/3722805666 learned_addr learned my addr 172.21.15.134:0/3722805666 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f6bf9aac640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bdc004800 0x7f6bdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f6bfaaae640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bdc0052e0 0x7f6bdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023238910 0 0) 0x7f9ce00b7aa0 con 0x7f9ce015ed20 2024-09-15T22:41:37.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd0003520 con 0x7f9ce015ed20 2024-09-15T22:41:37.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f5a7dffc640 1 Processor -- start 2024-09-15T22:41:37.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.451+0000 7f5a7dffc640 1 -- start start 2024-09-15T22:41:37.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f9ce573c640 1 --2- 172.21.15.134:0/3722805666 >> v2:172.21.15.134:3300/0 conn(0x7f9ce00b8f90 0x7f9ce00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f660ace4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f660415bdf0 0x7f66040b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f660ace4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f66040b57e0 0x7f660406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bdc004800 msgr2=0x7f6bdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bdc004800 0x7f6bdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/3753792343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bdc0052e0 msgr2=0x7f6bdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bdc0052e0 0x7f6bdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/3753792343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf41666a0 con 0x7f6bdc0039b0 2024-09-15T22:41:37.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505518287 0 0) 0x7f9cd0003520 con 0x7f9ce015ed20 2024-09-15T22:41:37.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 >> v2:172.21.15.134:3300/0 conn(0x7f9ce00b8f90 msgr2=0x7f9ce00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 --2- 172.21.15.134:0/3722805666 >> v2:172.21.15.134:3300/0 conn(0x7f9ce00b8f90 0x7f9ce00b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 >> v1:172.21.15.134:6789/0 conn(0x7f9ce015e940 legacy=0x7f9ce00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00d3940 con 0x7f9ce015ed20 2024-09-15T22:41:37.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f9cd4001670 con 0x7f9ce015ed20 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 >> v1:172.21.15.177:6789/0 conn(0x7f9ce015ed20 legacy=0x7f9ce00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cd0003a00 0x7f9cd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd0004800 0x7f9cd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9cd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d3660 con 0x7f9cd0004800 2024-09-15T22:41:37.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0014960 con 0x7f9cd0003a00 2024-09-15T22:41:37.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd0014b60 con 0x7f9cd0005210 2024-09-15T22:41:37.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15cc696640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c415e940 0x7f15c40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.452+0000 7f59be991640 1 Processor -- start 2024-09-15T22:41:37.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f59be991640 1 -- start start 2024-09-15T22:41:37.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a7dffc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700debe0 0x7f5a70009af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a7dffc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7001c5c0 con 0x7f5a7000bb70 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a7dffc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7001c830 con 0x7f5a700323c0 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a7dffc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7001cb10 con 0x7f5a700debe0 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a77fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5a700323c0 0x7f5a70052350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:50930/0 (socket says 172.21.15.134:50930) 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f5a77fff640 1 -- 172.21.15.134:0/3190719800 learned_addr learned my addr 172.21.15.134:0/3190719800 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9ce4f3b640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cd0003a00 0x7f9cd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f9ce573c640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9cd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15c9c31640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f15c415ed20 0x7f15c40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:50932/0 (socket says 172.21.15.134:50932) 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15ca432640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c415e940 0x7f15c40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15cc696640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 0x7f15c40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15cc696640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c40b7170 con 0x7f15c415ed20 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15cc696640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f15c40d1ae0 con 0x7f15c415e940 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f15cc696640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15c40b7aa0 con 0x7f15c40cef90 2024-09-15T22:41:37.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15c9c31640 1 -- 172.21.15.134:0/1316011929 learned_addr learned my addr 172.21.15.134:0/1316011929 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a7d7fb640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700debe0 0x7f5a70009af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.453+0000 7f6603fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f660415bdf0 0x7f66040b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f660ace4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660415c280 con 0x7f66040b2430 2024-09-15T22:41:37.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6608a80640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f66040b2430 0x7f66040b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55972/0 (socket says 172.21.15.134:55972) 2024-09-15T22:41:37.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6608a80640 1 -- 172.21.15.134:0/1177417034 learned_addr learned my addr 172.21.15.134:0/1177417034 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6c41994640 1 Processor -- start 2024-09-15T22:41:37.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456321599 0 0) 0x7f5a7001c5c0 con 0x7f5a7000bb70 2024-09-15T22:41:37.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a68003520 con 0x7f5a7000bb70 2024-09-15T22:41:37.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15cac33640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 0x7f15c40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15ca432640 1 -- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 msgr2=0x7f15c40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15ca432640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 0x7f15c40d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6be800ba00 tx=0x7f6bdc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52f1be9e2e6d4f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15ca432640 1 -- 172.21.15.134:0/1316011929 >> v1:172.21.15.177:6789/0 conn(0x7f15c415ed20 legacy=0x7f15c40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15ca432640 1 -- 172.21.15.134:0/1316011929 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c40d3660 con 0x7f15c415e940 2024-09-15T22:41:37.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f59be991640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59b8162c00 0x7f59b80b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f59be991640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59b8162fe0 0x7f59b806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15c9430640 1 -- 172.21.15.134:0/1316011929 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518695616 0 0) 0x7f15c0001110 con 0x7f15c415ed20 2024-09-15T22:41:37.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f59bcf2e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f59b80b3830 0x7f59b80d3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55986/0 (socket says 172.21.15.134:55986) 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1732674946 0 0) 0x7f5a68003520 con 0x7f5a7000bb70 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700debe0 msgr2=0x7f5a70009af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700debe0 0x7f5a70009af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 >> v1:172.21.15.177:6789/0 conn(0x7f5a700323c0 legacy=0x7f5a70052350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7001cdf0 con 0x7f5a7000bb70 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5a640016c0 con 0x7f5a7000bb70 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 >> v1:172.21.15.134:6789/0 conn(0x7f5a7000bb70 legacy=0x7f5a70006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f5a777fe640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a68004800 0x7f5a68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f15cac33640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 0x7f15c40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:37.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f59bcf2e640 1 -- 172.21.15.134:0/646695744 learned_addr learned my addr 172.21.15.134:0/646695744 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:37.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b80ba2d0 con 0x7f59b80b3830 2024-09-15T22:41:37.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f9ce573c640 1 -- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cd0003a00 msgr2=0x7f9cd0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f59b80cf990 con 0x7f59b8162c00 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f9ce573c640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cd0003a00 0x7f9cd0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f9ce573c640 1 -- 172.21.15.134:0/3722805666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd0004800 msgr2=0x7f9cd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f9ce573c640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cd0004800 0x7f9cd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f9ce573c640 1 -- 172.21.15.134:0/3722805666 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd0003520 con 0x7f9cd0005210 2024-09-15T22:41:37.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f9ce573c640 1 -- 172.21.15.134:0/3722805666 reap_dead start 2024-09-15T22:41:37.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8030070 con 0x7f6bdc0039b0 2024-09-15T22:41:37.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be802ade0 con 0x7f6bdc0039b0 2024-09-15T22:41:37.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6bf92ab640 1 -- 172.21.15.134:0/3753792343 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be800b600 con 0x7f6bdc0039b0 2024-09-15T22:41:37.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f5a77fff640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a68004800 0x7f5a68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f59b80d53b0 con 0x7f59b8162fe0 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13874840 0 0) 0x7f59b80ba2d0 con 0x7f59b80b3830 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a0003520 con 0x7f59b80b3830 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f15ca432640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40d1060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097a0 tx=0x7f15b402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29153dcb3ec36b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f5a777fe640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680051c0 0x7f5a680141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7001cb10 con 0x7f5a68004800 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a680148a0 con 0x7f5a680051c0 2024-09-15T22:41:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a68014aa0 con 0x7f5a680039e0 2024-09-15T22:41:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f9ce573c640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9cd000b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8007360 tx=0x7f9cd0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d2773f29dbe4365 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6c41994640 1 -- start start 2024-09-15T22:41:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6c41994640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34036470 0x7f6c34033890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3044863621 0 0) 0x7f59a0003520 con 0x7f59b80b3830 2024-09-15T22:41:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 >> v2:172.21.15.177:3300/0 conn(0x7f59b8162fe0 msgr2=0x7f59b806c070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:41:37.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 --2- 172.21.15.134:0/646695744 >> v2:172.21.15.177:3300/0 conn(0x7f59b8162fe0 0x7f59b806c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6c41994640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c34055630 0x7f6c34036850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 >> v2:172.21.15.134:3300/0 conn(0x7f59b8162c00 msgr2=0x7f59b80b74d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:41:37.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 --2- 172.21.15.134:0/646695744 >> v2:172.21.15.134:3300/0 conn(0x7f59b8162c00 0x7f59b80b74d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80b7a10 con 0x7f59b80b3830 2024-09-15T22:41:37.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.454+0000 7f6609281640 1 --2- 172.21.15.134:0/1177417034 >> v2:172.21.15.177:3300/0 conn(0x7f66040b57e0 0x7f660406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f15c9430640 1 -- 172.21.15.134:0/1316011929 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4037070 con 0x7f15c415e940 2024-09-15T22:41:37.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f660415aff0 con 0x7f660415bdf0 2024-09-15T22:41:37.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f660415b2d0 con 0x7f66040b57e0 2024-09-15T22:41:37.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6bfc511640 1 -- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 msgr2=0x7f6bdc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6bfc511640 1 --2- 172.21.15.134:0/3753792343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6be800ba00 tx=0x7f6bdc005830 comp rx=0 tx=0).stop 2024-09-15T22:41:37.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6c41994640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 0x7f6c340396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6bfaaae640 1 -- 172.21.15.134:0/3753792343 reap_dead start 2024-09-15T22:41:37.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f15c9430640 1 -- 172.21.15.134:0/1316011929 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4032440 con 0x7f15c415e940 2024-09-15T22:41:37.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8009be0 con 0x7f9cd0005210 2024-09-15T22:41:37.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8003bd0 con 0x7f9cd0005210 2024-09-15T22:41:37.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f15c9430640 1 -- 172.21.15.134:0/1316011929 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4032810 con 0x7f15c415e940 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f9cdf7fe640 1 -- 172.21.15.134:0/3722805666 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8004020 con 0x7f9cd0005210 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6bfc511640 1 -- 172.21.15.134:0/3753792343 shutdown_connections 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6c3bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c34055630 0x7f6c34036850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.455+0000 7f6c3bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c34055630 0x7f6c34036850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53694/0 (socket says 172.21.15.134:53694) 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c41193640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 0x7f6c340396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c41193640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 0x7f6c340396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43468/0 (socket says 172.21.15.134:43468) 2024-09-15T22:41:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1613314251 learned_addr learned my addr 172.21.15.134:0/1613314251 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6bfc511640 1 -- 172.21.15.134:0/3753792343 >> 172.21.15.134:0/3753792343 conn(0x7f6bf40b2040 msgr2=0x7f6bf40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7d7fb640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680051c0 0x7f5a680141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6c34006a90 con 0x7f6c34036d90 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6c34037380 con 0x7f6c34055630 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c34047af0 con 0x7f6c34036470 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6bfc511640 1 -- 172.21.15.134:0/3753792343 shutdown_connections 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f66037fe640 1 -- 172.21.15.134:0/1177417034 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386106438 0 0) 0x7f660415c280 con 0x7f66040b2430 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6609281640 1 -- 172.21.15.134:0/1177417034 >> v2:172.21.15.134:3300/0 conn(0x7f660415bdf0 msgr2=0x7f66040b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6bfc511640 1 -- 172.21.15.134:0/3753792343 wait complete. 2024-09-15T22:41:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f59b00019f0 con 0x7f59b80b3830 2024-09-15T22:41:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 >> v1:172.21.15.134:6789/0 conn(0x7f59b80b3830 legacy=0x7f59b80d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0004800 0x7f59a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34036470 msgr2=0x7f6c34033890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34036470 0x7f6c34033890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1613314251 >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 msgr2=0x7f6c340396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1613314251 >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 0x7f6c340396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1613314251 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c34047dd0 con 0x7f6c34055630 2024-09-15T22:41:37.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00053c0 0x7f59a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59b80cf990 con 0x7f59a0004800 2024-09-15T22:41:37.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59b80d53b0 con 0x7f59a00039b0 2024-09-15T22:41:37.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f59a000c300 con 0x7f59a00053c0 2024-09-15T22:41:37.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 -- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 msgr2=0x7f15c40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f59bcf2e640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00053c0 0x7f59a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40d1060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097a0 tx=0x7f15b402a230 comp rx=0 tx=0).stop 2024-09-15T22:41:37.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f9ce719f640 1 -- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 msgr2=0x7f9cd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f9ce719f640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9cd000b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8007360 tx=0x7f9cd0005830 comp rx=0 tx=0).stop 2024-09-15T22:41:37.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6609281640 1 --2- 172.21.15.134:0/1177417034 >> v2:172.21.15.134:3300/0 conn(0x7f660415bdf0 0x7f66040b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6609281640 1 -- 172.21.15.134:0/1177417034 >> v1:172.21.15.134:6789/0 conn(0x7f66040b2430 legacy=0x7f66040b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f6609281640 1 -- 172.21.15.134:0/1177417034 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660415b5b0 con 0x7f66040b57e0 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f9ce719f640 1 -- 172.21.15.134:0/3722805666 shutdown_connections 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f9ce719f640 1 --2- 172.21.15.134:0/3722805666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9cd000b9c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f9ce719f640 1 -- 172.21.15.134:0/3722805666 >> 172.21.15.134:0/3722805666 conn(0x7f9ce00b6240 msgr2=0x7f9ce00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 -- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680051c0 msgr2=0x7f5a680141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f9ce719f640 1 -- 172.21.15.134:0/3722805666 shutdown_connections 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 -- 172.21.15.134:0/1316011929 shutdown_connections 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40cef90 0x7f15c40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 --2- 172.21.15.134:0/1316011929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40d1060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 -- 172.21.15.134:0/1316011929 >> 172.21.15.134:0/1316011929 conn(0x7f15c40b6240 msgr2=0x7f15c40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f6609281640 1 --2- 172.21.15.134:0/1177417034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f660406d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66040d1730 tx=0x7f65fc02ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f14744fd36fe6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f9ce719f640 1 -- 172.21.15.134:0/3722805666 wait complete. 2024-09-15T22:41:37.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 -- 172.21.15.134:0/1316011929 shutdown_connections 2024-09-15T22:41:37.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f15cc696640 1 -- 172.21.15.134:0/1316011929 wait complete. 2024-09-15T22:41:37.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680051c0 0x7f5a680141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34055630 0x7f6c34036850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400f050 tx=0x7f6c3002a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4265459e83e78605 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 -- 172.21.15.134:0/3190719800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a68004800 msgr2=0x7f5a68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a68004800 0x7f5a68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.456+0000 7f5a7cffa640 1 -- 172.21.15.134:0/3190719800 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7001cdf0 con 0x7f5a680039e0 2024-09-15T22:41:37.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f6bfc511640 1 Processor -- start 2024-09-15T22:41:37.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a68003e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c140 tx=0x7f5a68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a658bb6b7e540e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f66037fe640 1 -- 172.21.15.134:0/1177417034 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc036070 con 0x7f66040b57e0 2024-09-15T22:41:37.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 -- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00053c0 msgr2=0x7f59a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f6c3b7fe640 1 -- 172.21.15.134:0/1613314251 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30037070 con 0x7f6c34055630 2024-09-15T22:41:37.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f6c3b7fe640 1 -- 172.21.15.134:0/1613314251 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3002ae30 con 0x7f6c34055630 2024-09-15T22:41:37.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f66037fe640 1 -- 172.21.15.134:0/1177417034 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc00d4e0 con 0x7f66040b57e0 2024-09-15T22:41:37.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f66037fe640 1 -- 172.21.15.134:0/1177417034 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00b940 con 0x7f66040b57e0 2024-09-15T22:41:37.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f6bfc511640 1 -- start start 2024-09-15T22:41:37.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f6c3b7fe640 1 -- 172.21.15.134:0/1613314251 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30032640 con 0x7f6c34055630 2024-09-15T22:41:37.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00053c0 0x7f59a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 -- 172.21.15.134:0/646695744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0004800 msgr2=0x7f59a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:37.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0004800 0x7f59a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59b7fff640 1 -- 172.21.15.134:0/646695744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0003520 con 0x7f59a00039b0 2024-09-15T22:41:37.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.457+0000 7f59bcf2e640 1 -- 172.21.15.134:0/646695744 reap_dead start 2024-09-15T22:41:37.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40c64b0 0x7f6bf4163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f59b7fff640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59a0003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009860 tx=0x7f59a0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775db4047436197c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8037070 con 0x7f59a00039b0 2024-09-15T22:41:37.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf41642f0 0x7f6bf40c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a802a9c0 con 0x7f59a00039b0 2024-09-15T22:41:37.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64007c00 con 0x7f5a680039e0 2024-09-15T22:41:37.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64031600 con 0x7f5a680039e0 2024-09-15T22:41:37.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f5a777fe640 1 -- 172.21.15.134:0/3190719800 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64031a50 con 0x7f5a680039e0 2024-09-15T22:41:37.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 -- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 msgr2=0x7f5a68003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/3190719800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a68003e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c140 tx=0x7f5a68005830 comp rx=0 tx=0).stop 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7d7fb640 1 -- 172.21.15.134:0/3190719800 reap_dead start 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34055630 msgr2=0x7f6c34036850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 --2- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34055630 0x7f6c34036850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400f050 tx=0x7f6c3002a0e0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 -- 172.21.15.134:0/3190719800 shutdown_connections 2024-09-15T22:41:37.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 -- 172.21.15.134:0/3190719800 >> 172.21.15.134:0/3190719800 conn(0x7f5a70036090 msgr2=0x7f5a700364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 msgr2=0x7f660406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.458+0000 7f59b6ffd640 1 -- 172.21.15.134:0/646695744 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8037070 con 0x7f59a00039b0 2024-09-15T22:41:37.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 --2- 172.21.15.134:0/1177417034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f660406d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66040d1730 tx=0x7f65fc02ead0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 -- 172.21.15.134:0/3190719800 shutdown_connections 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfa2ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b4e40 con 0x7f6bf41642f0 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4166c60 con 0x7f6bdc0039b0 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfc511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf406bd80 con 0x7f6bf40c64b0 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfa2ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53720/0 (socket says 172.21.15.134:53720) 2024-09-15T22:41:37.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/541448811 learned_addr learned my addr 172.21.15.134:0/541448811 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f15cc696640 1 Processor -- start 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 shutdown_connections 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 --2- 172.21.15.134:0/1613314251 >> v2:172.21.15.134:3300/0 conn(0x7f6c34036d90 0x7f6c340396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 --2- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34055630 0x7f6c34036850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 --2- 172.21.15.134:0/1613314251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34036470 0x7f6c34033890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 >> 172.21.15.134:0/1613314251 conn(0x7f6c3401dd80 msgr2=0x7f6c340549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 shutdown_connections 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 --2- 172.21.15.134:0/1177417034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f660406d6b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 --2- 172.21.15.134:0/1177417034 >> v2:172.21.15.134:3300/0 conn(0x7f660415bdf0 0x7f66040b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 >> 172.21.15.134:0/1177417034 conn(0x7f660406bba0 msgr2=0x7f660406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bfaaae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf41642f0 0x7f6bf40c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f6bf9aac640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40c64b0 0x7f6bf4163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f15cc696640 1 -- start start 2024-09-15T22:41:37.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f5a7dffc640 1 -- 172.21.15.134:0/3190719800 wait complete. 2024-09-15T22:41:37.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 shutdown_connections 2024-09-15T22:41:37.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f660ace4640 1 -- 172.21.15.134:0/1177417034 wait complete. 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40c64b0 msgr2=0x7f6bf4163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40c64b0 0x7f6bf4163db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf41642f0 msgr2=0x7f6bf40c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf41642f0 0x7f6bf40c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 -- 172.21.15.134:0/541448811 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40c5450 con 0x7f6bdc0039b0 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 msgr2=0x7f59a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59a0003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009860 tx=0x7f59a0005830 comp rx=0 tx=0).stop 2024-09-15T22:41:37.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.459+0000 7f9ce719f640 1 Processor -- start 2024-09-15T22:41:37.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f9ce719f640 1 -- start start 2024-09-15T22:41:37.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 shutdown_connections 2024-09-15T22:41:37.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 --2- 172.21.15.134:0/646695744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59a0003dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 >> 172.21.15.134:0/646695744 conn(0x7f59b80d4680 msgr2=0x7f59b80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 shutdown_connections 2024-09-15T22:41:37.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfa2ad640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6be802a8d0 tx=0x7f6be80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6c41994640 1 -- 172.21.15.134:0/1613314251 wait complete. 2024-09-15T22:41:37.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 0x7f15c40ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8043030 con 0x7f6bdc0039b0 2024-09-15T22:41:37.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be8035e90 con 0x7f6bdc0039b0 2024-09-15T22:41:37.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8004020 con 0x7f6bdc0039b0 2024-09-15T22:41:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15ca432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 0x7f15c40ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 0x7f15c415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15ca432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 0x7f15c40ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43488/0 (socket says 172.21.15.134:43488) 2024-09-15T22:41:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf40c56f0 con 0x7f6bdc0039b0 2024-09-15T22:41:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf40c5cb0 con 0x7f6bdc0039b0 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9ce00cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 0x7f9ce0161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 0x7f9ce00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d1ef0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d3f00 con 0x7f9ce00cb800 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15c9c31640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15c9c31640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53736/0 (socket says 172.21.15.134:53736) 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40d3f00 con 0x7f15c40cef90 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40d3c20 con 0x7f15c415e940 2024-09-15T22:41:37.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cc696640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15c40d3310 con 0x7f15c415ed20 2024-09-15T22:41:37.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15ca432640 1 -- 172.21.15.134:0/1769750497 learned_addr learned my addr 172.21.15.134:0/1769750497 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f9ce719f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00d2070 con 0x7f9cd0005210 2024-09-15T22:41:37.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.460+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 shutdown_connections 2024-09-15T22:41:37.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f5a7dffc640 1 Processor -- start 2024-09-15T22:41:37.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f59be991640 1 -- 172.21.15.134:0/646695744 wait complete. 2024-09-15T22:41:37.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.461+0000 7f15cac33640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 0x7f15c415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 0x7f9ce0161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce4f3b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9ce00cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 0x7f9ce0161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53740/0 (socket says 172.21.15.134:53740) 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 0x7f9ce00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9cdffff640 1 -- 172.21.15.134:0/1465835144 learned_addr learned my addr 172.21.15.134:0/1465835144 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 -- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 msgr2=0x7f15c415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 0x7f15c415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 -- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 msgr2=0x7f15c40ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 0x7f15c40ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 -- 172.21.15.134:0/1769750497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4159f80 con 0x7f15c415e940 2024-09-15T22:41:37.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15cac33640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 0x7f15c415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:37.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f660ace4640 1 Processor -- start 2024-09-15T22:41:37.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f660ace4640 1 -- start start 2024-09-15T22:41:37.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f6c41994640 1 Processor -- start 2024-09-15T22:41:37.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f5a7dffc640 1 -- start start 2024-09-15T22:41:37.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 -- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 msgr2=0x7f9ce00cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9ce00cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 -- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 msgr2=0x7f9ce0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 0x7f9ce0161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f15c9c31640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15c415f150 tx=0x7f15c000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.462+0000 7f9ce573c640 1 -- 172.21.15.134:0/1465835144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00cbfe0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f9ce573c640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 0x7f9ce00c9740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00d0d90 tx=0x7f9cd8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0018070 con 0x7f15c415e940 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c00070d0 con 0x7f15c415e940 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0007500 con 0x7f15c415e940 2024-09-15T22:41:37.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f6c41994640 1 -- start start 2024-09-15T22:41:37.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f660ace4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 0x7f66040ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8046070 con 0x7f9ce00c92b0 2024-09-15T22:41:37.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8039e40 con 0x7f9ce00c92b0 2024-09-15T22:41:37.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8009be0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce00cc2c0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce00cc880 con 0x7f9ce00c92b0 2024-09-15T22:41:37.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6608a80640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 0x7f66040ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6608a80640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 0x7f66040ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:57398/0 (socket says 172.21.15.134:57398) 2024-09-15T22:41:37.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f59be991640 1 Processor -- start 2024-09-15T22:41:37.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f660ace4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f6604151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6608a80640 1 -- 172.21.15.134:0/3388482390 learned_addr learned my addr 172.21.15.134:0/3388482390 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34036470 0x7f6c340e7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.463+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6be8046070 con 0x7f6bdc0039b0 2024-09-15T22:41:37.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6bf2ffd640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 0x7f6be006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6be80abd10 con 0x7f6bdc0039b0 2024-09-15T22:41:37.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f59be991640 1 -- start start 2024-09-15T22:41:37.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34055630 0x7f6c3404a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6603fff640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f6604151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660415bdf0 0x7f66040aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6bf9aac640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 0x7f6be006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66040d03d0 con 0x7f660415bdf0 2024-09-15T22:41:37.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f660415bb70 con 0x7f66040b57e0 2024-09-15T22:41:37.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f66040d0550 con 0x7f66040b2430 2024-09-15T22:41:37.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34039be0 con 0x7f6c34036d90 2024-09-15T22:41:37.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34007130 con 0x7f6c34036470 2024-09-15T22:41:37.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c41994640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c34039d60 con 0x7f6c34055630 2024-09-15T22:41:37.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c3bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c3bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43496/0 (socket says 172.21.15.134:43496) 2024-09-15T22:41:37.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.464+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1922130537 learned_addr learned my addr 172.21.15.134:0/1922130537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c41193640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34055630 0x7f6c3404a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6603fff640 1 -- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 msgr2=0x7f66040ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6bf9aac640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 0x7f6be006e840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4165150 tx=0x7f6be4009540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6603fff640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 0x7f66040ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6603fff640 1 -- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660415bdf0 msgr2=0x7f66040aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6603fff640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660415bdf0 0x7f66040aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c40cb120 con 0x7f15c415e940 2024-09-15T22:41:37.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf40d0890 con 0x7f6bdc0039b0 2024-09-15T22:41:37.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c40cc2b0 con 0x7f15c415e940 2024-09-15T22:41:37.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6603fff640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6604152770 con 0x7f66040b57e0 2024-09-15T22:41:37.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59b8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 0x7f59b81563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34055630 msgr2=0x7f6c3404a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34055630 0x7f6c3404a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34036470 msgr2=0x7f6c340e7020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34036470 0x7f6c340e7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.465+0000 7f6c3bfff640 1 -- 172.21.15.134:0/1922130537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c340e7560 con 0x7f6c34036d90 2024-09-15T22:41:37.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c3bfff640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009960 tx=0x7f6c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 0x7f59b814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59b77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 0x7f59b81563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59b77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 0x7f59b81563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43508/0 (socket says 172.21.15.134:43508) 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59b8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59b8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53774/0 (socket says 172.21.15.134:53774) 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59b77fe640 1 -- 172.21.15.134:0/3068329407 learned_addr learned my addr 172.21.15.134:0/3068329407 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59b806d0c0 con 0x7f59b814de70 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59b806cf40 con 0x7f59a00039b0 2024-09-15T22:41:37.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f59b806d240 con 0x7f59b8153db0 2024-09-15T22:41:37.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce00cf020 con 0x7f9ce00c92b0 2024-09-15T22:41:37.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30041070 con 0x7f6c34036d90 2024-09-15T22:41:37.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3003c670 con 0x7f6c34036d90 2024-09-15T22:41:37.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30037040 con 0x7f6c34036d90 2024-09-15T22:41:37.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6603fff640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f6604151d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e870 tx=0x7f65f000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59bcf2e640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 0x7f59b814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3401e900 con 0x7f6c34036d90 2024-09-15T22:41:37.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 0x7f5a700356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a700dd2b0 0x7f5a700dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9cd8049070 con 0x7f9ce00c92b0 2024-09-15T22:41:37.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3401eec0 con 0x7f6c34036d90 2024-09-15T22:41:37.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59bcf2e640 1 -- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 msgr2=0x7f59b8155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f59bcf2e640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59b8155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59bcf2e640 1 -- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 msgr2=0x7f59b81563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59bcf2e640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 0x7f59b81563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59bcf2e640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b81f8620 con 0x7f59b8153db0 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70009af0 con 0x7f5a700dd2b0 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a700df030 con 0x7f5a700ce6a0 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.466+0000 7f5a7dffc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a70009c70 con 0x7f5a680039e0 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a7cffa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a7cffa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:57438/0 (socket says 172.21.15.134:57438) 2024-09-15T22:41:37.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 0x7f5a700356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a7cffa640 1 -- 172.21.15.134:0/2531866367 learned_addr learned my addr 172.21.15.134:0/2531866367 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:37.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a77fff640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 0x7f5a700356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53782/0 (socket says 172.21.15.134:53782) 2024-09-15T22:41:37.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59bcf2e640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 0x7f59b814be20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f59b80d08c0 tx=0x7f59b0007b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c40d1ef0 con 0x7f15c415e940 2024-09-15T22:41:37.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b000ac40 con 0x7f59b8153db0 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f9cdd7fa640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 0x7f9cc406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd80abaa0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0018070 con 0x7f59b8153db0 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b81548b0 con 0x7f59b8153db0 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b00133f0 con 0x7f59b8153db0 2024-09-15T22:41:37.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b8161100 con 0x7f59b8153db0 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.467+0000 7f5a7d7fb640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a700dd2b0 0x7f5a700dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 -- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 msgr2=0x7f5a700356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 0x7f5a700356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 -- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a700dd2b0 msgr2=0x7f5a700dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a700dd2b0 0x7f5a700dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 -- 172.21.15.134:0/2531866367 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a700ce4b0 con 0x7f5a680039e0 2024-09-15T22:41:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c340493b0 con 0x7f6c34036d90 2024-09-15T22:41:37.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7cffa640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c0e0 tx=0x7f5a64001030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640319c0 con 0x7f5a680039e0 2024-09-15T22:41:37.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a701779a0 con 0x7f5a680039e0 2024-09-15T22:41:37.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a70177f60 con 0x7f5a680039e0 2024-09-15T22:41:37.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c30044070 con 0x7f6c34036d90 2024-09-15T22:41:37.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.468+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64031b60 con 0x7f5a680039e0 2024-09-15T22:41:37.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640319c0 con 0x7f5a680039e0 2024-09-15T22:41:37.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f9ce4f3b640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 0x7f9cc406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b80b74d0 con 0x7f59b8153db0 2024-09-15T22:41:37.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f9ce4f3b640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 0x7f9cc406e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0017b0 tx=0x7f9ccc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f6c397fa640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 0x7f6c2006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.469+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6c300ac370 con 0x7f6c34036d90 2024-09-15T22:41:37.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f6c40992640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 0x7f6c2006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a70009ff0 con 0x7f5a680039e0 2024-09-15T22:41:37.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59b0013590 con 0x7f59b8153db0 2024-09-15T22:41:37.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6be8079d80 con 0x7f6bdc0039b0 2024-09-15T22:41:37.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f6c40992640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 0x7f6c2006e7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c050d60 tx=0x7f6c3c06b1c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0017070 con 0x7f66040b57e0 2024-09-15T22:41:37.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f000ee60 con 0x7f66040b57e0 2024-09-15T22:41:37.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.470+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000cb60 con 0x7f66040b57e0 2024-09-15T22:41:37.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66040ae910 con 0x7f66040b57e0 2024-09-15T22:41:37.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f59b4ff9640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 0x7f59a406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66040aeed0 con 0x7f66040b57e0 2024-09-15T22:41:37.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a64039040 con 0x7f5a680039e0 2024-09-15T22:41:37.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59b008b780 con 0x7f59b8153db0 2024-09-15T22:41:37.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f59b7fff640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 0x7f59a406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.471+0000 7f5a757fa640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 0x7f5a5c06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.472+0000 7f5a77fff640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 0x7f5a5c06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.472+0000 7f59b7fff640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 0x7f59a406e7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59a8034000 tx=0x7f59a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.472+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5a64031400 con 0x7f5a680039e0 2024-09-15T22:41:37.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.472+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660415df90 con 0x7f66040b57e0 2024-09-15T22:41:37.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.472+0000 7f5a77fff640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 0x7f5a5c06eba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a700540e0 tx=0x7f5a6c007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.473+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15c001b070 con 0x7f15c415e940 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.473+0000 7f15baffd640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 0x7f15a806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.473+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f15c008a9f0 con 0x7f15c415e940 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.473+0000 7f15ca432640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 0x7f15a806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.474+0000 7f15ca432640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 0x7f15a806e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15b402a270 tx=0x7f15b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.475+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15c0022020 con 0x7f15c415e940 2024-09-15T22:41:37.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.476+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59b0059980 con 0x7f59b8153db0 2024-09-15T22:41:37.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.476+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cd8032030 con 0x7f9ce00c92b0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.477+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f65f001a070 con 0x7f66040b57e0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.477+0000 7f66017fa640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 0x7f65e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.477+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f65f008b8b0 con 0x7f66040b57e0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.477+0000 7f6608a80640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 0x7f65e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.478+0000 7f6608a80640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 0x7f65e806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007b10 tx=0x7f65f8007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.479+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65f0059ab0 con 0x7f66040b57e0 2024-09-15T22:41:37.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.480+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a64040020 con 0x7f5a680039e0 2024-09-15T22:41:37.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.486+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c340e7560 con 0x7f6c34036d90 2024-09-15T22:41:37.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.794+0000 7f9e8a73b640 1 -- 172.21.15.134:0/3884980276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9e64005580 con 0x7f9e7c048bf0 2024-09-15T22:41:37.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.795+0000 7f9e80ff9640 1 -- 172.21.15.134:0/3884980276 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e840e40f0 con 0x7f9e7c048bf0 2024-09-15T22:41:37.796 INFO:teuthology.orchestra.run.smithi134.stdout:64424509448 2024-09-15T22:41:37.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.798+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 msgr2=0x7f9e7406e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.798+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 0x7f9e7406e980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c051540 tx=0x7f9e70006bd0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 msgr2=0x7f9e7c0e59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e840637b0 tx=0x7f9e840506b0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 shutdown_connections 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9e7406c4c0 0x7f9e7406e980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e7c048bf0 0x7f9e7c0e59d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e7c036090 0x7f9e7c0e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 --2- 172.21.15.134:0/3884980276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e7c034c40 0x7f9e7c0e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 >> 172.21.15.134:0/3884980276 conn(0x7f9e7c01ea40 msgr2=0x7f9e7c0370f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.799+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 shutdown_connections 2024-09-15T22:41:37.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.800+0000 7f9e6e7fc640 1 -- 172.21.15.134:0/3884980276 wait complete. 2024-09-15T22:41:37.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2024-09-15T22:41:37.817 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.835+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f59b80b96f0 con 0x7f59b8153db0 2024-09-15T22:41:37.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.836+0000 7f59b4ff9640 1 -- 172.21.15.134:0/3068329407 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59b005dc80 con 0x7f59b8153db0 2024-09-15T22:41:37.837 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 msgr2=0x7f59a406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 0x7f59a406e7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59a8034000 tx=0x7f59a802e000 comp rx=0 tx=0).stop 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 msgr2=0x7f59b814be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 0x7f59b814be20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f59b80d08c0 tx=0x7f59b0007b00 comp rx=0 tx=0).stop 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 shutdown_connections 2024-09-15T22:41:37.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f59a406c330 0x7f59a406e7f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59b8153db0 0x7f59b814be20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b814de70 0x7f59b81563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 --2- 172.21.15.134:0/3068329407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a00039b0 0x7f59b8155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.838+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 >> 172.21.15.134:0/3068329407 conn(0x7f59b80d4680 msgr2=0x7f59b80d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.839+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 shutdown_connections 2024-09-15T22:41:37.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.839+0000 7f59be991640 1 -- 172.21.15.134:0/3068329407 wait complete. 2024-09-15T22:41:37.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-15T22:41:37.851 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.868+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6bf40cd720 con 0x7f6bdc0039b0 2024-09-15T22:41:37.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.869+0000 7f6bf2ffd640 1 -- 172.21.15.134:0/541448811 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6be807e080 con 0x7f6bdc0039b0 2024-09-15T22:41:37.870 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:37.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 msgr2=0x7f6be006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 0x7f6be006e840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4165150 tx=0x7f6be4009540 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 msgr2=0x7f6bf41508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6be802a8d0 tx=0x7f6be80046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 shutdown_connections 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6be006c380 0x7f6be006e840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf41642f0 0x7f6bf40c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6bf40c64b0 0x7f6bf4163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 --2- 172.21.15.134:0/541448811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bdc0039b0 0x7f6bf41508c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 >> 172.21.15.134:0/541448811 conn(0x7f6bf40b2040 msgr2=0x7f6bf4071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 shutdown_connections 2024-09-15T22:41:37.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.871+0000 7f6bfc511640 1 -- 172.21.15.134:0/541448811 wait complete. 2024-09-15T22:41:37.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.875+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9ce00ba6b0 con 0x7f9ce00c92b0 2024-09-15T22:41:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.875+0000 7f9cdd7fa640 1 -- 172.21.15.134:0/1465835144 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cd8079c30 con 0x7f9ce00c92b0 2024-09-15T22:41:37.877 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.877+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f15c40ba6b0 con 0x7f15c415e940 2024-09-15T22:41:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.877+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5a700321a0 con 0x7f5a680039e0 2024-09-15T22:41:37.879 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f15baffd640 1 -- 172.21.15.134:0/1769750497 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15c40b7170 con 0x7f15c415e940 2024-09-15T22:41:37.880 INFO:teuthology.orchestra.run.smithi134.stdout:64424509447 2024-09-15T22:41:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f5a757fa640 1 -- 172.21.15.134:0/2531866367 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a64079720 con 0x7f5a680039e0 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 msgr2=0x7f9cc406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 0x7f9cc406e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0017b0 tx=0x7f9ccc009040 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 msgr2=0x7f9ce00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.878+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 0x7f9ce00c9740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00d0d90 tx=0x7f9cd8004ab0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 shutdown_connections 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9cc406c380 0x7f9cc406e840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce00c92b0 0x7f9ce00c9740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ce00cb800 0x7f9ce0161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 --2- 172.21.15.134:0/1465835144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9cd0005210 0x7f9ce00cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 >> 172.21.15.134:0/1465835144 conn(0x7f9ce00b6240 msgr2=0x7f9ce015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 shutdown_connections 2024-09-15T22:41:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.879+0000 7f9ce719f640 1 -- 172.21.15.134:0/1465835144 wait complete. 2024-09-15T22:41:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.880+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 msgr2=0x7f5a5c06eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.880+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 0x7f5a5c06eba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a700540e0 tx=0x7f5a6c007ed0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.880+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 msgr2=0x7f5a70173e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.880+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c0e0 tx=0x7f5a64001030 comp rx=0 tx=0).stop 2024-09-15T22:41:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6c3400bdf0 con 0x7f6c34036d90 2024-09-15T22:41:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 shutdown_connections 2024-09-15T22:41:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a5c06c6e0 0x7f5a5c06eba0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a700dd2b0 0x7f5a700dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700ce6a0 0x7f5a700356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 --2- 172.21.15.134:0/2531866367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a680039e0 0x7f5a70173e70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 >> 172.21.15.134:0/2531866367 conn(0x7f5a70036090 msgr2=0x7f5a7004eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 shutdown_connections 2024-09-15T22:41:37.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f5a7dffc640 1 -- 172.21.15.134:0/2531866367 wait complete. 2024-09-15T22:41:37.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.881+0000 7f6c397fa640 1 -- 172.21.15.134:0/1922130537 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c3007aac0 con 0x7f6c34036d90 2024-09-15T22:41:37.884 INFO:teuthology.orchestra.run.smithi134.stdout:64424509448 2024-09-15T22:41:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.882+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 msgr2=0x7f15a806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.882+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 0x7f15a806e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15b402a270 tx=0x7f15b402e000 comp rx=0 tx=0).stop 2024-09-15T22:41:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.882+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 msgr2=0x7f15c40cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.882+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15c415f150 tx=0x7f15c000cbe0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.882+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f660415ab90 con 0x7f66040b57e0 2024-09-15T22:41:37.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 shutdown_connections 2024-09-15T22:41:37.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a806c300 0x7f15a806e7c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c415ed20 0x7f15c415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415e940 0x7f15c40cabe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 --2- 172.21.15.134:0/1769750497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c40cef90 0x7f15c40ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 >> 172.21.15.134:0/1769750497 conn(0x7f15c40b6240 msgr2=0x7f15c40b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 shutdown_connections 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f15cc696640 1 -- 172.21.15.134:0/1769750497 wait complete. 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 msgr2=0x7f6c2006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 0x7f6c2006e7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c050d60 tx=0x7f6c3c06b1c0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 msgr2=0x7f6c3403b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f66017fa640 1 -- 172.21.15.134:0/3388482390 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65f005ddb0 con 0x7f66040b57e0 2024-09-15T22:41:37.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009960 tx=0x7f6c300046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 shutdown_connections 2024-09-15T22:41:37.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2006c300 0x7f6c2006e7c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.889 INFO:teuthology.orchestra.run.smithi134.stdout:64424509448 2024-09-15T22:41:37.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c34055630 0x7f6c3404a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c34036d90 0x7f6c3403b960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 --2- 172.21.15.134:0/1922130537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34036470 0x7f6c340e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 >> 172.21.15.134:0/1922130537 conn(0x7f6c3401dd80 msgr2=0x7f6c34031b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 shutdown_connections 2024-09-15T22:41:37.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.884+0000 7f6c41994640 1 -- 172.21.15.134:0/1922130537 wait complete. 2024-09-15T22:41:37.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2024-09-15T22:41:37.894 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 msgr2=0x7f65e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 0x7f65e806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007b10 tx=0x7f65f8007a60 comp rx=0 tx=0).stop 2024-09-15T22:41:37.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 msgr2=0x7f6604151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:37.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f6604151d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e870 tx=0x7f65f000ed30 comp rx=0 tx=0).stop 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 shutdown_connections 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f65e806c2b0 0x7f65e806e770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660415bdf0 0x7f66040aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66040b57e0 0x7f6604151d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 --2- 172.21.15.134:0/3388482390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66040b2430 0x7f66040ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 >> 172.21.15.134:0/3388482390 conn(0x7f660406bba0 msgr2=0x7f660406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 shutdown_connections 2024-09-15T22:41:37.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:37.888+0000 7f660ace4640 1 -- 172.21.15.134:0/3388482390 wait complete. 2024-09-15T22:41:37.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-09-15T22:41:37.900 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2024-09-15T22:41:37.901 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2024-09-15T22:41:37.903 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.2 2024-09-15T22:41:37.907 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.0 2024-09-15T22:41:37.909 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:37.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:41:37.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.046+0000 7f1b46fd6640 1 Processor -- start 2024-09-15T22:41:38.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.046+0000 7f1b46fd6640 1 -- start start 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b46fd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b400d02a0 0x7f1b400d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b46fd6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b4015ca40 0x7f1b4015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b46fd6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400d0bc0 con 0x7f1b4015ce80 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b46fd6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4015d390 con 0x7f1b4015ca40 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b46fd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4015d670 con 0x7f1b400d02a0 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b4015ca40 0x7f1b4015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b4015ca40 0x7f1b4015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43526/0 (socket says 172.21.15.134:43526) 2024-09-15T22:41:38.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 -- 172.21.15.134:0/1100203666 learned_addr learned my addr 172.21.15.134:0/1100203666 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:38.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 -- 172.21.15.134:0/1100203666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b400d02a0 msgr2=0x7f1b400d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 --2- 172.21.15.134:0/1100203666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b400d02a0 0x7f1b400d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.047+0000 7f1b3ffff640 1 -- 172.21.15.134:0/1100203666 >> v1:172.21.15.177:6789/0 conn(0x7f1b4015ce80 legacy=0x7f1b401594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.048+0000 7f1b3ffff640 1 -- 172.21.15.134:0/1100203666 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4015d950 con 0x7f1b4015ca40 2024-09-15T22:41:38.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.048+0000 7f1b3ffff640 1 --2- 172.21.15.134:0/1100203666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b4015e430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009870 tx=0x7f1b2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745f793e7ea95e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.048+0000 7f1b3f7fe640 1 -- 172.21.15.134:0/1100203666 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28037070 con 0x7f1b4015ca40 2024-09-15T22:41:38.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.048+0000 7f1b3f7fe640 1 -- 172.21.15.134:0/1100203666 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b28032440 con 0x7f1b4015ca40 2024-09-15T22:41:38.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.048+0000 7f1b3f7fe640 1 -- 172.21.15.134:0/1100203666 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28032810 con 0x7f1b4015ca40 2024-09-15T22:41:38.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 -- 172.21.15.134:0/1100203666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 msgr2=0x7f1b4015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/1100203666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b4015e430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009870 tx=0x7f1b2802a180 comp rx=0 tx=0).stop 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 -- 172.21.15.134:0/1100203666 shutdown_connections 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/1100203666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b4015e430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/1100203666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b400d02a0 0x7f1b400d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 -- 172.21.15.134:0/1100203666 >> 172.21.15.134:0/1100203666 conn(0x7f1b40062cc0 msgr2=0x7f1b4006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 -- 172.21.15.134:0/1100203666 shutdown_connections 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.049+0000 7f1b46fd6640 1 -- 172.21.15.134:0/1100203666 wait complete. 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.050+0000 7f1b46fd6640 1 Processor -- start 2024-09-15T22:41:38.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.050+0000 7f1b46fd6640 1 -- start start 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b400d02a0 0x7f1b401594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b4015ce80 0x7f1b40147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b40155b90 con 0x7f1b4015ca40 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4015df10 con 0x7f1b400d02a0 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b46fd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1b40155d10 con 0x7f1b4015ce80 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43528/0 (socket says 172.21.15.134:43528) 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 -- 172.21.15.134:0/2135575402 learned_addr learned my addr 172.21.15.134:0/2135575402 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b45573640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b4015ce80 0x7f1b40147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b44d72640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b400d02a0 0x7f1b401594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 -- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b4015ce80 msgr2=0x7f1b40147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b4015ce80 0x7f1b40147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 -- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b400d02a0 msgr2=0x7f1b401594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b400d02a0 0x7f1b401594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.051+0000 7f1b3ffff640 1 -- 172.21.15.134:0/2135575402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40151970 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b3ffff640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009870 tx=0x7f1b280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28041070 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2803c870 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b40151c50 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28037040 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.052+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b40167b00 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.053+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b400b4790 con 0x7f1b4015ca40 2024-09-15T22:41:38.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.053+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b28044070 con 0x7f1b4015ca40 2024-09-15T22:41:38.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.053+0000 7f1b3d7fa640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 0x7f1b2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.054+0000 7f1b44d72640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 0x7f1b2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.054+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1b280abf80 con 0x7f1b4015ca40 2024-09-15T22:41:38.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.054+0000 7f1b44d72640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 0x7f1b2006e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1b30007dc0 tx=0x7f1b300072f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.058+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b2807a6f0 con 0x7f1b4015ca40 2024-09-15T22:41:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.219+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b400b1950 con 0x7f1b2006c2b0 2024-09-15T22:41:38.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.225+0000 7f1b3d7fa640 1 -- 172.21.15.134:0/2135575402 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f1b400b1950 con 0x7f1b2006c2b0 2024-09-15T22:41:38.229 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:38.230 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 msgr2=0x7f1b2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 0x7f1b2006e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1b30007dc0 tx=0x7f1b300072f0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 msgr2=0x7f1b40151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009870 tx=0x7f1b280046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 shutdown_connections 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1b2006c2b0 0x7f1b2006e770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b4015ce80 0x7f1b40147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b4015ca40 0x7f1b40151320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 --2- 172.21.15.134:0/2135575402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b400d02a0 0x7f1b401594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 >> 172.21.15.134:0/2135575402 conn(0x7f1b40062cc0 msgr2=0x7f1b400b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 shutdown_connections 2024-09-15T22:41:38.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.228+0000 7f1b46fd6640 1 -- 172.21.15.134:0/2135575402 wait complete. 2024-09-15T22:41:38.240 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-15T22:41:36.950125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219308,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755412,"statfs":{"total":773094113280,"available":772869541888,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002126"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993495+0000","last_change":"2024-09-15T22:41:26.715026+0000","last_active":"2024-09-15T22:41:27.993495+0000","last_peered":"2024-09-15T22:41:27.993495+0000","last_clean":"2024-09-15T22:41:27.993495+0000","last_became_active":"2024-09-15T22:41:26.714732+0000","last_became_peered":"2024-09-15T22:41:26.714732+0000","last_unstale":"2024-09-15T22:41:27.993495+0000","last_undegraded":"2024-09-15T22:41:27.993495+0000","last_fullsized":"2024-09-15T22:41:27.993495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743708+0000","last_change":"2024-09-15T22:41:26.708187+0000","last_active":"2024-09-15T22:41:28.743708+0000","last_peered":"2024-09-15T22:41:28.743708+0000","last_clean":"2024-09-15T22:41:28.743708+0000","last_became_active":"2024-09-15T22:41:26.707542+0000","last_became_peered":"2024-09-15T22:41:26.707542+0000","last_unstale":"2024-09-15T22:41:28.743708+0000","last_undegraded":"2024-09-15T22:41:28.743708+0000","last_fullsized":"2024-09-15T22:41:28.743708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743729+0000","last_change":"2024-09-15T22:41:26.702417+0000","last_active":"2024-09-15T22:41:28.743729+0000","last_peered":"2024-09-15T22:41:28.743729+0000","last_clean":"2024-09-15T22:41:28.743729+0000","last_became_active":"2024-09-15T22:41:26.702137+0000","last_became_peered":"2024-09-15T22:41:26.702137+0000","last_unstale":"2024-09-15T22:41:28.743729+0000","last_undegraded":"2024-09-15T22:41:28.743729+0000","last_fullsized":"2024-09-15T22:41:28.743729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743282+0000","last_change":"2024-09-15T22:41:26.705417+0000","last_active":"2024-09-15T22:41:28.743282+0000","last_peered":"2024-09-15T22:41:28.743282+0000","last_clean":"2024-09-15T22:41:28.743282+0000","last_became_active":"2024-09-15T22:41:26.704860+0000","last_became_peered":"2024-09-15T22:41:26.704860+0000","last_unstale":"2024-09-15T22:41:28.743282+0000","last_undegraded":"2024-09-15T22:41:28.743282+0000","last_fullsized":"2024-09-15T22:41:28.743282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:16.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993172+0000","last_change":"2024-09-15T22:41:26.705602+0000","last_active":"2024-09-15T22:41:27.993172+0000","last_peered":"2024-09-15T22:41:27.993172+0000","last_clean":"2024-09-15T22:41:27.993172+0000","last_became_active":"2024-09-15T22:41:26.705349+0000","last_became_peered":"2024-09-15T22:41:26.705349+0000","last_unstale":"2024-09-15T22:41:27.993172+0000","last_undegraded":"2024-09-15T22:41:27.993172+0000","last_fullsized":"2024-09-15T22:41:27.993172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742873+0000","last_change":"2024-09-15T22:41:26.705590+0000","last_active":"2024-09-15T22:41:28.742873+0000","last_peered":"2024-09-15T22:41:28.742873+0000","last_clean":"2024-09-15T22:41:28.742873+0000","last_became_active":"2024-09-15T22:41:26.705121+0000","last_became_peered":"2024-09-15T22:41:26.705121+0000","last_unstale":"2024-09-15T22:41:28.742873+0000","last_undegraded":"2024-09-15T22:41:28.742873+0000","last_fullsized":"2024-09-15T22:41:28.742873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993014+0000","last_change":"2024-09-15T22:41:26.711621+0000","last_active":"2024-09-15T22:41:27.993014+0000","last_peered":"2024-09-15T22:41:27.993014+0000","last_clean":"2024-09-15T22:41:27.993014+0000","last_became_active":"2024-09-15T22:41:26.711350+0000","last_became_peered":"2024-09-15T22:41:26.711350+0000","last_unstale":"2024-09-15T22:41:27.993014+0000","last_undegraded":"2024-09-15T22:41:27.993014+0000","last_fullsized":"2024-09-15T22:41:27.993014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743588+0000","last_change":"2024-09-15T22:41:26.709226+0000","last_active":"2024-09-15T22:41:28.743588+0000","last_peered":"2024-09-15T22:41:28.743588+0000","last_clean":"2024-09-15T22:41:28.743588+0000","last_became_active":"2024-09-15T22:41:26.708822+0000","last_became_peered":"2024-09-15T22:41:26.708822+0000","last_unstale":"2024-09-15T22:41:28.743588+0000","last_undegraded":"2024-09-15T22:41:28.743588+0000","last_fullsized":"2024-09-15T22:41:28.743588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743223+0000","last_change":"2024-09-15T22:41:26.714192+0000","last_active":"2024-09-15T22:41:28.743223+0000","last_peered":"2024-09-15T22:41:28.743223+0000","last_clean":"2024-09-15T22:41:28.743223+0000","last_became_active":"2024-09-15T22:41:26.713880+0000","last_became_peered":"2024-09-15T22:41:26.713880+0000","last_unstale":"2024-09-15T22:41:28.743223+0000","last_undegraded":"2024-09-15T22:41:28.743223+0000","last_fullsized":"2024-09-15T22:41:28.743223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993371+0000","last_change":"2024-09-15T22:41:26.707274+0000","last_active":"2024-09-15T22:41:27.993371+0000","last_peered":"2024-09-15T22:41:27.993371+0000","last_clean":"2024-09-15T22:41:27.993371+0000","last_became_active":"2024-09-15T22:41:26.707019+0000","last_became_peered":"2024-09-15T22:41:26.707019+0000","last_unstale":"2024-09-15T22:41:27.993371+0000","last_undegraded":"2024-09-15T22:41:27.993371+0000","last_fullsized":"2024-09-15T22:41:27.993371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993235+0000","last_change":"2024-09-15T22:41:26.715027+0000","last_active":"2024-09-15T22:41:27.993235+0000","last_peered":"2024-09-15T22:41:27.993235+0000","last_clean":"2024-09-15T22:41:27.993235+0000","last_became_active":"2024-09-15T22:41:26.714742+0000","last_became_peered":"2024-09-15T22:41:26.714742+0000","last_unstale":"2024-09-15T22:41:27.993235+0000","last_undegraded":"2024-09-15T22:41:27.993235+0000","last_fullsized":"2024-09-15T22:41:27.993235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993177+0000","last_change":"2024-09-15T22:41:26.705354+0000","last_active":"2024-09-15T22:41:27.993177+0000","last_peered":"2024-09-15T22:41:27.993177+0000","last_clean":"2024-09-15T22:41:27.993177+0000","last_became_active":"2024-09-15T22:41:26.704817+0000","last_became_peered":"2024-09-15T22:41:26.704817+0000","last_unstale":"2024-09-15T22:41:27.993177+0000","last_undegraded":"2024-09-15T22:41:27.993177+0000","last_fullsized":"2024-09-15T22:41:27.993177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701520+0000","last_change":"2024-09-15T22:41:26.707362+0000","last_active":"2024-09-15T22:41:27.701520+0000","last_peered":"2024-09-15T22:41:27.701520+0000","last_clean":"2024-09-15T22:41:27.701520+0000","last_became_active":"2024-09-15T22:41:26.707108+0000","last_became_peered":"2024-09-15T22:41:26.707108+0000","last_unstale":"2024-09-15T22:41:27.701520+0000","last_undegraded":"2024-09-15T22:41:27.701520+0000","last_fullsized":"2024-09-15T22:41:27.701520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:00.028580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701343+0000","last_change":"2024-09-15T22:41:26.701767+0000","last_active":"2024-09-15T22:41:27.701343+0000","last_peered":"2024-09-15T22:41:27.701343+0000","last_clean":"2024-09-15T22:41:27.701343+0000","last_became_active":"2024-09-15T22:41:26.701488+0000","last_became_peered":"2024-09-15T22:41:26.701488+0000","last_unstale":"2024-09-15T22:41:27.701343+0000","last_undegraded":"2024-09-15T22:41:27.701343+0000","last_fullsized":"2024-09-15T22:41:27.701343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:02.532139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.704769+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.704475+0000","last_became_peered":"2024-09-15T22:41:26.704475+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697745+0000","last_change":"2024-09-15T22:41:26.702125+0000","last_active":"2024-09-15T22:41:27.697745+0000","last_peered":"2024-09-15T22:41:27.697745+0000","last_clean":"2024-09-15T22:41:27.697745+0000","last_became_active":"2024-09-15T22:41:26.701707+0000","last_became_peered":"2024-09-15T22:41:26.701707+0000","last_unstale":"2024-09-15T22:41:27.697745+0000","last_undegraded":"2024-09-15T22:41:27.697745+0000","last_fullsized":"2024-09-15T22:41:27.697745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698334+0000","last_change":"2024-09-15T22:41:26.709603+0000","last_active":"2024-09-15T22:41:27.698334+0000","last_peered":"2024-09-15T22:41:27.698334+0000","last_clean":"2024-09-15T22:41:27.698334+0000","last_became_active":"2024-09-15T22:41:26.709357+0000","last_became_peered":"2024-09-15T22:41:26.709357+0000","last_unstale":"2024-09-15T22:41:27.698334+0000","last_undegraded":"2024-09-15T22:41:27.698334+0000","last_fullsized":"2024-09-15T22:41:27.698334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:59.454273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.700010+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.699679+0000","last_became_peered":"2024-09-15T22:41:26.699679+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698344+0000","last_change":"2024-09-15T22:41:26.707446+0000","last_active":"2024-09-15T22:41:27.698344+0000","last_peered":"2024-09-15T22:41:27.698344+0000","last_clean":"2024-09-15T22:41:27.698344+0000","last_became_active":"2024-09-15T22:41:26.706549+0000","last_became_peered":"2024-09-15T22:41:26.706549+0000","last_unstale":"2024-09-15T22:41:27.698344+0000","last_undegraded":"2024-09-15T22:41:27.698344+0000","last_fullsized":"2024-09-15T22:41:27.698344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:53.685207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993375+0000","last_change":"2024-09-15T22:41:26.707073+0000","last_active":"2024-09-15T22:41:27.993375+0000","last_peered":"2024-09-15T22:41:27.993375+0000","last_clean":"2024-09-15T22:41:27.993375+0000","last_became_active":"2024-09-15T22:41:26.706499+0000","last_became_peered":"2024-09-15T22:41:26.706499+0000","last_unstale":"2024-09-15T22:41:27.993375+0000","last_undegraded":"2024-09-15T22:41:27.993375+0000","last_fullsized":"2024-09-15T22:41:27.993375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702082+0000","last_change":"2024-09-15T22:41:26.701194+0000","last_active":"2024-09-15T22:41:27.702082+0000","last_peered":"2024-09-15T22:41:27.702082+0000","last_clean":"2024-09-15T22:41:27.702082+0000","last_became_active":"2024-09-15T22:41:26.700907+0000","last_became_peered":"2024-09-15T22:41:26.700907+0000","last_unstale":"2024-09-15T22:41:27.702082+0000","last_undegraded":"2024-09-15T22:41:27.702082+0000","last_fullsized":"2024-09-15T22:41:27.702082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742859+0000","last_change":"2024-09-15T22:41:26.708589+0000","last_active":"2024-09-15T22:41:28.742859+0000","last_peered":"2024-09-15T22:41:28.742859+0000","last_clean":"2024-09-15T22:41:28.742859+0000","last_became_active":"2024-09-15T22:41:26.708297+0000","last_became_peered":"2024-09-15T22:41:26.708297+0000","last_unstale":"2024-09-15T22:41:28.742859+0000","last_undegraded":"2024-09-15T22:41:28.742859+0000","last_fullsized":"2024-09-15T22:41:28.742859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:56.536210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744342+0000","last_change":"2024-09-15T22:41:26.705794+0000","last_active":"2024-09-15T22:41:28.744342+0000","last_peered":"2024-09-15T22:41:28.744342+0000","last_clean":"2024-09-15T22:41:28.744342+0000","last_became_active":"2024-09-15T22:41:26.705524+0000","last_became_peered":"2024-09-15T22:41:26.705524+0000","last_unstale":"2024-09-15T22:41:28.744342+0000","last_undegraded":"2024-09-15T22:41:28.744342+0000","last_fullsized":"2024-09-15T22:41:28.744342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697744+0000","last_change":"2024-09-15T22:41:26.710283+0000","last_active":"2024-09-15T22:41:27.697744+0000","last_peered":"2024-09-15T22:41:27.697744+0000","last_clean":"2024-09-15T22:41:27.697744+0000","last_became_active":"2024-09-15T22:41:26.709982+0000","last_became_peered":"2024-09-15T22:41:26.709982+0000","last_unstale":"2024-09-15T22:41:27.697744+0000","last_undegraded":"2024-09-15T22:41:27.697744+0000","last_fullsized":"2024-09-15T22:41:27.697744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744011+0000","last_change":"2024-09-15T22:41:26.705107+0000","last_active":"2024-09-15T22:41:28.744011+0000","last_peered":"2024-09-15T22:41:28.744011+0000","last_clean":"2024-09-15T22:41:28.744011+0000","last_became_active":"2024-09-15T22:41:26.704217+0000","last_became_peered":"2024-09-15T22:41:26.704217+0000","last_unstale":"2024-09-15T22:41:28.744011+0000","last_undegraded":"2024-09-15T22:41:28.744011+0000","last_fullsized":"2024-09-15T22:41:28.744011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743459+0000","last_change":"2024-09-15T22:41:26.712467+0000","last_active":"2024-09-15T22:41:28.743459+0000","last_peered":"2024-09-15T22:41:28.743459+0000","last_clean":"2024-09-15T22:41:28.743459+0000","last_became_active":"2024-09-15T22:41:26.711787+0000","last_became_peered":"2024-09-15T22:41:26.711787+0000","last_unstale":"2024-09-15T22:41:28.743459+0000","last_undegraded":"2024-09-15T22:41:28.743459+0000","last_fullsized":"2024-09-15T22:41:28.743459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:08.624131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701840+0000","last_change":"2024-09-15T22:41:26.702206+0000","last_active":"2024-09-15T22:41:27.701840+0000","last_peered":"2024-09-15T22:41:27.701840+0000","last_clean":"2024-09-15T22:41:27.701840+0000","last_became_active":"2024-09-15T22:41:26.701499+0000","last_became_peered":"2024-09-15T22:41:26.701499+0000","last_unstale":"2024-09-15T22:41:27.701840+0000","last_undegraded":"2024-09-15T22:41:27.701840+0000","last_fullsized":"2024-09-15T22:41:27.701840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.486966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701565+0000","last_change":"2024-09-15T22:41:26.706783+0000","last_active":"2024-09-15T22:41:27.701565+0000","last_peered":"2024-09-15T22:41:27.701565+0000","last_clean":"2024-09-15T22:41:27.701565+0000","last_became_active":"2024-09-15T22:41:26.706518+0000","last_became_peered":"2024-09-15T22:41:26.706518+0000","last_unstale":"2024-09-15T22:41:27.701565+0000","last_undegraded":"2024-09-15T22:41:27.701565+0000","last_fullsized":"2024-09-15T22:41:27.701565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:11.596810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744294+0000","last_change":"2024-09-15T22:41:26.703909+0000","last_active":"2024-09-15T22:41:28.744294+0000","last_peered":"2024-09-15T22:41:28.744294+0000","last_clean":"2024-09-15T22:41:28.744294+0000","last_became_active":"2024-09-15T22:41:26.703596+0000","last_became_peered":"2024-09-15T22:41:26.703596+0000","last_unstale":"2024-09-15T22:41:28.744294+0000","last_undegraded":"2024-09-15T22:41:28.744294+0000","last_fullsized":"2024-09-15T22:41:28.744294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697926+0000","last_change":"2024-09-15T22:41:26.711096+0000","last_active":"2024-09-15T22:41:27.697926+0000","last_peered":"2024-09-15T22:41:27.697926+0000","last_clean":"2024-09-15T22:41:27.697926+0000","last_became_active":"2024-09-15T22:41:26.710825+0000","last_became_peered":"2024-09-15T22:41:26.710825+0000","last_unstale":"2024-09-15T22:41:27.697926+0000","last_undegraded":"2024-09-15T22:41:27.697926+0000","last_fullsized":"2024-09-15T22:41:27.697926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:20.909561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743281+0000","last_change":"2024-09-15T22:41:26.705332+0000","last_active":"2024-09-15T22:41:28.743281+0000","last_peered":"2024-09-15T22:41:28.743281+0000","last_clean":"2024-09-15T22:41:28.743281+0000","last_became_active":"2024-09-15T22:41:26.705041+0000","last_became_peered":"2024-09-15T22:41:26.705041+0000","last_unstale":"2024-09-15T22:41:28.743281+0000","last_undegraded":"2024-09-15T22:41:28.743281+0000","last_fullsized":"2024-09-15T22:41:28.743281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742844+0000","last_change":"2024-09-15T22:41:26.700581+0000","last_active":"2024-09-15T22:41:28.742844+0000","last_peered":"2024-09-15T22:41:28.742844+0000","last_clean":"2024-09-15T22:41:28.742844+0000","last_became_active":"2024-09-15T22:41:26.700298+0000","last_became_peered":"2024-09-15T22:41:26.700298+0000","last_unstale":"2024-09-15T22:41:28.742844+0000","last_undegraded":"2024-09-15T22:41:28.742844+0000","last_fullsized":"2024-09-15T22:41:28.742844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742899+0000","last_change":"2024-09-15T22:41:26.711782+0000","last_active":"2024-09-15T22:41:28.742899+0000","last_peered":"2024-09-15T22:41:28.742899+0000","last_clean":"2024-09-15T22:41:28.742899+0000","last_became_active":"2024-09-15T22:41:26.711523+0000","last_became_peered":"2024-09-15T22:41:26.711523+0000","last_unstale":"2024-09-15T22:41:28.742899+0000","last_undegraded":"2024-09-15T22:41:28.742899+0000","last_fullsized":"2024-09-15T22:41:28.742899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743927+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:28.743927+0000","last_peered":"2024-09-15T22:41:28.743927+0000","last_clean":"2024-09-15T22:41:28.743927+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:28.743927+0000","last_undegraded":"2024-09-15T22:41:28.743927+0000","last_fullsized":"2024-09-15T22:41:28.743927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702315+0000","last_change":"2024-09-15T22:41:26.707739+0000","last_active":"2024-09-15T22:41:27.702315+0000","last_peered":"2024-09-15T22:41:27.702315+0000","last_clean":"2024-09-15T22:41:27.702315+0000","last_became_active":"2024-09-15T22:41:26.707466+0000","last_became_peered":"2024-09-15T22:41:26.707466+0000","last_unstale":"2024-09-15T22:41:27.702315+0000","last_undegraded":"2024-09-15T22:41:27.702315+0000","last_fullsized":"2024-09-15T22:41:27.702315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698149+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:27.698149+0000","last_peered":"2024-09-15T22:41:27.698149+0000","last_clean":"2024-09-15T22:41:27.698149+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:27.698149+0000","last_undegraded":"2024-09-15T22:41:27.698149+0000","last_fullsized":"2024-09-15T22:41:27.698149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:15.504080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701240+0000","last_change":"2024-09-15T22:41:25.702016+0000","last_active":"2024-09-15T22:41:27.701240+0000","last_peered":"2024-09-15T22:41:27.701240+0000","last_clean":"2024-09-15T22:41:27.701240+0000","last_became_active":"2024-09-15T22:41:25.701650+0000","last_became_peered":"2024-09-15T22:41:25.701650+0000","last_unstale":"2024-09-15T22:41:27.701240+0000","last_undegraded":"2024-09-15T22:41:27.701240+0000","last_fullsized":"2024-09-15T22:41:27.701240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:09.408758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744370+0000","last_change":"2024-09-15T22:41:26.709592+0000","last_active":"2024-09-15T22:41:28.744370+0000","last_peered":"2024-09-15T22:41:28.744370+0000","last_clean":"2024-09-15T22:41:28.744370+0000","last_became_active":"2024-09-15T22:41:26.709146+0000","last_became_peered":"2024-09-15T22:41:26.709146+0000","last_unstale":"2024-09-15T22:41:28.744370+0000","last_undegraded":"2024-09-15T22:41:28.744370+0000","last_fullsized":"2024-09-15T22:41:28.744370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697853+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:27.697853+0000","last_peered":"2024-09-15T22:41:27.697853+0000","last_clean":"2024-09-15T22:41:27.697853+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:27.697853+0000","last_undegraded":"2024-09-15T22:41:27.697853+0000","last_fullsized":"2024-09-15T22:41:27.697853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:07.616440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701757+0000","last_change":"2024-09-15T22:41:26.708462+0000","last_active":"2024-09-15T22:41:27.701757+0000","last_peered":"2024-09-15T22:41:27.701757+0000","last_clean":"2024-09-15T22:41:27.701757+0000","last_became_active":"2024-09-15T22:41:26.708159+0000","last_became_peered":"2024-09-15T22:41:26.708159+0000","last_unstale":"2024-09-15T22:41:27.701757+0000","last_undegraded":"2024-09-15T22:41:27.701757+0000","last_fullsized":"2024-09-15T22:41:27.701757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:03.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743325+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:28.743325+0000","last_peered":"2024-09-15T22:41:28.743325+0000","last_clean":"2024-09-15T22:41:28.743325+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:28.743325+0000","last_undegraded":"2024-09-15T22:41:28.743325+0000","last_fullsized":"2024-09-15T22:41:28.743325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743496+0000","last_change":"2024-09-15T22:41:26.712084+0000","last_active":"2024-09-15T22:41:28.743496+0000","last_peered":"2024-09-15T22:41:28.743496+0000","last_clean":"2024-09-15T22:41:28.743496+0000","last_became_active":"2024-09-15T22:41:26.711768+0000","last_became_peered":"2024-09-15T22:41:26.711768+0000","last_unstale":"2024-09-15T22:41:28.743496+0000","last_undegraded":"2024-09-15T22:41:28.743496+0000","last_fullsized":"2024-09-15T22:41:28.743496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:24.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993377+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:27.993377+0000","last_peered":"2024-09-15T22:41:27.993377+0000","last_clean":"2024-09-15T22:41:27.993377+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:27.993377+0000","last_undegraded":"2024-09-15T22:41:27.993377+0000","last_fullsized":"2024-09-15T22:41:27.993377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744355+0000","last_change":"2024-09-15T22:41:26.710472+0000","last_active":"2024-09-15T22:41:28.744355+0000","last_peered":"2024-09-15T22:41:28.744355+0000","last_clean":"2024-09-15T22:41:28.744355+0000","last_became_active":"2024-09-15T22:41:26.710156+0000","last_became_peered":"2024-09-15T22:41:26.710156+0000","last_unstale":"2024-09-15T22:41:28.744355+0000","last_undegraded":"2024-09-15T22:41:28.744355+0000","last_fullsized":"2024-09-15T22:41:28.744355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743487+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:28.743487+0000","last_peered":"2024-09-15T22:41:28.743487+0000","last_clean":"2024-09-15T22:41:28.743487+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:28.743487+0000","last_undegraded":"2024-09-15T22:41:28.743487+0000","last_fullsized":"2024-09-15T22:41:28.743487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698025+0000","last_change":"2024-09-15T22:41:26.705756+0000","last_active":"2024-09-15T22:41:27.698025+0000","last_peered":"2024-09-15T22:41:27.698025+0000","last_clean":"2024-09-15T22:41:27.698025+0000","last_became_active":"2024-09-15T22:41:26.705439+0000","last_became_peered":"2024-09-15T22:41:26.705439+0000","last_unstale":"2024-09-15T22:41:27.698025+0000","last_undegraded":"2024-09-15T22:41:27.698025+0000","last_fullsized":"2024-09-15T22:41:27.698025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:50.176003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743328+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:28.743328+0000","last_peered":"2024-09-15T22:41:28.743328+0000","last_clean":"2024-09-15T22:41:28.743328+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:28.743328+0000","last_undegraded":"2024-09-15T22:41:28.743328+0000","last_fullsized":"2024-09-15T22:41:28.743328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993275+0000","last_change":"2024-09-15T22:41:26.704427+0000","last_active":"2024-09-15T22:41:27.993275+0000","last_peered":"2024-09-15T22:41:27.993275+0000","last_clean":"2024-09-15T22:41:27.993275+0000","last_became_active":"2024-09-15T22:41:26.704031+0000","last_became_peered":"2024-09-15T22:41:26.704031+0000","last_unstale":"2024-09-15T22:41:27.993275+0000","last_undegraded":"2024-09-15T22:41:27.993275+0000","last_fullsized":"2024-09-15T22:41:27.993275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743409+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:28.743409+0000","last_peered":"2024-09-15T22:41:28.743409+0000","last_clean":"2024-09-15T22:41:28.743409+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:28.743409+0000","last_undegraded":"2024-09-15T22:41:28.743409+0000","last_fullsized":"2024-09-15T22:41:28.743409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701423+0000","last_change":"2024-09-15T22:41:26.711298+0000","last_active":"2024-09-15T22:41:27.701423+0000","last_peered":"2024-09-15T22:41:27.701423+0000","last_clean":"2024-09-15T22:41:27.701423+0000","last_became_active":"2024-09-15T22:41:26.711029+0000","last_became_peered":"2024-09-15T22:41:26.711029+0000","last_unstale":"2024-09-15T22:41:27.701423+0000","last_undegraded":"2024-09-15T22:41:27.701423+0000","last_fullsized":"2024-09-15T22:41:27.701423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:29.101148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698254+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:27.698254+0000","last_peered":"2024-09-15T22:41:27.698254+0000","last_clean":"2024-09-15T22:41:27.698254+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:27.698254+0000","last_undegraded":"2024-09-15T22:41:27.698254+0000","last_fullsized":"2024-09-15T22:41:27.698254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:23.492215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697818+0000","last_change":"2024-09-15T22:41:26.709651+0000","last_active":"2024-09-15T22:41:27.697818+0000","last_peered":"2024-09-15T22:41:27.697818+0000","last_clean":"2024-09-15T22:41:27.697818+0000","last_became_active":"2024-09-15T22:41:26.709419+0000","last_became_peered":"2024-09-15T22:41:26.709419+0000","last_unstale":"2024-09-15T22:41:27.697818+0000","last_undegraded":"2024-09-15T22:41:27.697818+0000","last_fullsized":"2024-09-15T22:41:27.697818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992998+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:27.992998+0000","last_peered":"2024-09-15T22:41:27.992998+0000","last_clean":"2024-09-15T22:41:27.992998+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:27.992998+0000","last_undegraded":"2024-09-15T22:41:27.992998+0000","last_fullsized":"2024-09-15T22:41:27.992998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742983+0000","last_change":"2024-09-15T22:41:26.712445+0000","last_active":"2024-09-15T22:41:28.742983+0000","last_peered":"2024-09-15T22:41:28.742983+0000","last_clean":"2024-09-15T22:41:28.742983+0000","last_became_active":"2024-09-15T22:41:26.712201+0000","last_became_peered":"2024-09-15T22:41:26.712201+0000","last_unstale":"2024-09-15T22:41:28.742983+0000","last_undegraded":"2024-09-15T22:41:28.742983+0000","last_fullsized":"2024-09-15T22:41:28.742983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700874+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:27.700874+0000","last_peered":"2024-09-15T22:41:27.700874+0000","last_clean":"2024-09-15T22:41:27.700874+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:27.700874+0000","last_undegraded":"2024-09-15T22:41:27.700874+0000","last_fullsized":"2024-09-15T22:41:27.700874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697754+0000","last_change":"2024-09-15T22:41:26.709001+0000","last_active":"2024-09-15T22:41:27.697754+0000","last_peered":"2024-09-15T22:41:27.697754+0000","last_clean":"2024-09-15T22:41:27.697754+0000","last_became_active":"2024-09-15T22:41:26.708687+0000","last_became_peered":"2024-09-15T22:41:26.708687+0000","last_unstale":"2024-09-15T22:41:27.697754+0000","last_undegraded":"2024-09-15T22:41:27.697754+0000","last_fullsized":"2024-09-15T22:41:27.697754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993549+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:27.993549+0000","last_peered":"2024-09-15T22:41:27.993549+0000","last_clean":"2024-09-15T22:41:27.993549+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:27.993549+0000","last_undegraded":"2024-09-15T22:41:27.993549+0000","last_fullsized":"2024-09-15T22:41:27.993549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743595+0000","last_change":"2024-09-15T22:41:26.706136+0000","last_active":"2024-09-15T22:41:28.743595+0000","last_peered":"2024-09-15T22:41:28.743595+0000","last_clean":"2024-09-15T22:41:28.743595+0000","last_became_active":"2024-09-15T22:41:26.705873+0000","last_became_peered":"2024-09-15T22:41:26.705873+0000","last_unstale":"2024-09-15T22:41:28.743595+0000","last_undegraded":"2024-09-15T22:41:28.743595+0000","last_fullsized":"2024-09-15T22:41:28.743595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:21.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702040+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:27.702040+0000","last_peered":"2024-09-15T22:41:27.702040+0000","last_clean":"2024-09-15T22:41:27.702040+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:27.702040+0000","last_undegraded":"2024-09-15T22:41:27.702040+0000","last_fullsized":"2024-09-15T22:41:27.702040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993537+0000","last_change":"2024-09-15T22:41:26.706050+0000","last_active":"2024-09-15T22:41:27.993537+0000","last_peered":"2024-09-15T22:41:27.993537+0000","last_clean":"2024-09-15T22:41:27.993537+0000","last_became_active":"2024-09-15T22:41:26.705788+0000","last_became_peered":"2024-09-15T22:41:26.705788+0000","last_unstale":"2024-09-15T22:41:27.993537+0000","last_undegraded":"2024-09-15T22:41:27.993537+0000","last_fullsized":"2024-09-15T22:41:27.993537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743774+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:28.743774+0000","last_peered":"2024-09-15T22:41:28.743774+0000","last_clean":"2024-09-15T22:41:28.743774+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:28.743774+0000","last_undegraded":"2024-09-15T22:41:28.743774+0000","last_fullsized":"2024-09-15T22:41:28.743774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993353+0000","last_change":"2024-09-15T22:41:26.707289+0000","last_active":"2024-09-15T22:41:27.993353+0000","last_peered":"2024-09-15T22:41:27.993353+0000","last_clean":"2024-09-15T22:41:27.993353+0000","last_became_active":"2024-09-15T22:41:26.706675+0000","last_became_peered":"2024-09-15T22:41:26.706675+0000","last_unstale":"2024-09-15T22:41:27.993353+0000","last_undegraded":"2024-09-15T22:41:27.993353+0000","last_fullsized":"2024-09-15T22:41:27.993353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701675+0000","last_change":"2024-09-15T22:41:25.702075+0000","last_active":"2024-09-15T22:41:27.701675+0000","last_peered":"2024-09-15T22:41:27.701675+0000","last_clean":"2024-09-15T22:41:27.701675+0000","last_became_active":"2024-09-15T22:41:25.701608+0000","last_became_peered":"2024-09-15T22:41:25.701608+0000","last_unstale":"2024-09-15T22:41:27.701675+0000","last_undegraded":"2024-09-15T22:41:27.701675+0000","last_fullsized":"2024-09-15T22:41:27.701675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:27.717750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698233+0000","last_change":"2024-09-15T22:41:26.706857+0000","last_active":"2024-09-15T22:41:27.698233+0000","last_peered":"2024-09-15T22:41:27.698233+0000","last_clean":"2024-09-15T22:41:27.698233+0000","last_became_active":"2024-09-15T22:41:26.706264+0000","last_became_peered":"2024-09-15T22:41:26.706264+0000","last_unstale":"2024-09-15T22:41:27.698233+0000","last_undegraded":"2024-09-15T22:41:27.698233+0000","last_fullsized":"2024-09-15T22:41:27.698233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:21.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743113+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:28.743113+0000","last_peered":"2024-09-15T22:41:28.743113+0000","last_clean":"2024-09-15T22:41:28.743113+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:28.743113+0000","last_undegraded":"2024-09-15T22:41:28.743113+0000","last_fullsized":"2024-09-15T22:41:28.743113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697987+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:27.697987+0000","last_peered":"2024-09-15T22:41:27.697987+0000","last_clean":"2024-09-15T22:41:27.697987+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:27.697987+0000","last_undegraded":"2024-09-15T22:41:27.697987+0000","last_fullsized":"2024-09-15T22:41:27.697987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:18.109760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702043+0000","last_change":"2024-09-15T22:41:26.698424+0000","last_active":"2024-09-15T22:41:27.702043+0000","last_peered":"2024-09-15T22:41:27.702043+0000","last_clean":"2024-09-15T22:41:27.702043+0000","last_became_active":"2024-09-15T22:41:26.697457+0000","last_became_peered":"2024-09-15T22:41:26.697457+0000","last_unstale":"2024-09-15T22:41:27.702043+0000","last_undegraded":"2024-09-15T22:41:27.702043+0000","last_fullsized":"2024-09-15T22:41:27.702043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:45.987437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697860+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:27.697860+0000","last_peered":"2024-09-15T22:41:27.697860+0000","last_clean":"2024-09-15T22:41:27.697860+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:27.697860+0000","last_undegraded":"2024-09-15T22:41:27.697860+0000","last_fullsized":"2024-09-15T22:41:27.697860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:20.614195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701274+0000","last_change":"2024-09-15T22:41:26.697850+0000","last_active":"2024-09-15T22:41:27.701274+0000","last_peered":"2024-09-15T22:41:27.701274+0000","last_clean":"2024-09-15T22:41:27.701274+0000","last_became_active":"2024-09-15T22:41:26.697079+0000","last_became_peered":"2024-09-15T22:41:26.697079+0000","last_unstale":"2024-09-15T22:41:27.701274+0000","last_undegraded":"2024-09-15T22:41:27.701274+0000","last_fullsized":"2024-09-15T22:41:27.701274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:59.477248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743343+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:28.743343+0000","last_peered":"2024-09-15T22:41:28.743343+0000","last_clean":"2024-09-15T22:41:28.743343+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:28.743343+0000","last_undegraded":"2024-09-15T22:41:28.743343+0000","last_fullsized":"2024-09-15T22:41:28.743343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743627+0000","last_change":"2024-09-15T22:41:26.704828+0000","last_active":"2024-09-15T22:41:28.743627+0000","last_peered":"2024-09-15T22:41:28.743627+0000","last_clean":"2024-09-15T22:41:28.743627+0000","last_became_active":"2024-09-15T22:41:26.704229+0000","last_became_peered":"2024-09-15T22:41:26.704229+0000","last_unstale":"2024-09-15T22:41:28.743627+0000","last_undegraded":"2024-09-15T22:41:28.743627+0000","last_fullsized":"2024-09-15T22:41:28.743627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698347+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:27.698347+0000","last_peered":"2024-09-15T22:41:27.698347+0000","last_clean":"2024-09-15T22:41:27.698347+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:27.698347+0000","last_undegraded":"2024-09-15T22:41:27.698347+0000","last_fullsized":"2024-09-15T22:41:27.698347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:51.139105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993112+0000","last_change":"2024-09-15T22:41:26.707722+0000","last_active":"2024-09-15T22:41:27.993112+0000","last_peered":"2024-09-15T22:41:27.993112+0000","last_clean":"2024-09-15T22:41:27.993112+0000","last_became_active":"2024-09-15T22:41:26.706692+0000","last_became_peered":"2024-09-15T22:41:26.706692+0000","last_unstale":"2024-09-15T22:41:27.993112+0000","last_undegraded":"2024-09-15T22:41:27.993112+0000","last_fullsized":"2024-09-15T22:41:27.993112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743904+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:28.743904+0000","last_peered":"2024-09-15T22:41:28.743904+0000","last_clean":"2024-09-15T22:41:28.743904+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:28.743904+0000","last_undegraded":"2024-09-15T22:41:28.743904+0000","last_fullsized":"2024-09-15T22:41:28.743904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743222+0000","last_change":"2024-09-15T22:41:26.700622+0000","last_active":"2024-09-15T22:41:28.743222+0000","last_peered":"2024-09-15T22:41:28.743222+0000","last_clean":"2024-09-15T22:41:28.743222+0000","last_became_active":"2024-09-15T22:41:26.700351+0000","last_became_peered":"2024-09-15T22:41:26.700351+0000","last_unstale":"2024-09-15T22:41:28.743222+0000","last_undegraded":"2024-09-15T22:41:28.743222+0000","last_fullsized":"2024-09-15T22:41:28.743222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698400+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:27.698400+0000","last_peered":"2024-09-15T22:41:27.698400+0000","last_clean":"2024-09-15T22:41:27.698400+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:27.698400+0000","last_undegraded":"2024-09-15T22:41:27.698400+0000","last_fullsized":"2024-09-15T22:41:27.698400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701650+0000","last_change":"2024-09-15T22:41:26.698859+0000","last_active":"2024-09-15T22:41:27.701650+0000","last_peered":"2024-09-15T22:41:27.701650+0000","last_clean":"2024-09-15T22:41:27.701650+0000","last_became_active":"2024-09-15T22:41:26.698599+0000","last_became_peered":"2024-09-15T22:41:26.698599+0000","last_unstale":"2024-09-15T22:41:27.701650+0000","last_undegraded":"2024-09-15T22:41:27.701650+0000","last_fullsized":"2024-09-15T22:41:27.701650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:22.754810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702200+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:27.702200+0000","last_peered":"2024-09-15T22:41:27.702200+0000","last_clean":"2024-09-15T22:41:27.702200+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:27.702200+0000","last_undegraded":"2024-09-15T22:41:27.702200+0000","last_fullsized":"2024-09-15T22:41:27.702200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702397+0000","last_change":"2024-09-15T22:41:26.700100+0000","last_active":"2024-09-15T22:41:27.702397+0000","last_peered":"2024-09-15T22:41:27.702397+0000","last_clean":"2024-09-15T22:41:27.702397+0000","last_became_active":"2024-09-15T22:41:26.699340+0000","last_became_peered":"2024-09-15T22:41:26.699340+0000","last_unstale":"2024-09-15T22:41:27.702397+0000","last_undegraded":"2024-09-15T22:41:27.702397+0000","last_fullsized":"2024-09-15T22:41:27.702397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698274+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:27.698274+0000","last_peered":"2024-09-15T22:41:27.698274+0000","last_clean":"2024-09-15T22:41:27.698274+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:27.698274+0000","last_undegraded":"2024-09-15T22:41:27.698274+0000","last_fullsized":"2024-09-15T22:41:27.698274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701941+0000","last_change":"2024-09-15T22:41:26.702213+0000","last_active":"2024-09-15T22:41:27.701941+0000","last_peered":"2024-09-15T22:41:27.701941+0000","last_clean":"2024-09-15T22:41:27.701941+0000","last_became_active":"2024-09-15T22:41:26.701964+0000","last_became_peered":"2024-09-15T22:41:26.701964+0000","last_unstale":"2024-09-15T22:41:27.701941+0000","last_undegraded":"2024-09-15T22:41:27.701941+0000","last_fullsized":"2024-09-15T22:41:27.701941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:41.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992836+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:27.992836+0000","last_peered":"2024-09-15T22:41:27.992836+0000","last_clean":"2024-09-15T22:41:27.992836+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:27.992836+0000","last_undegraded":"2024-09-15T22:41:27.992836+0000","last_fullsized":"2024-09-15T22:41:27.992836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697762+0000","last_change":"2024-09-15T22:41:26.708970+0000","last_active":"2024-09-15T22:41:27.697762+0000","last_peered":"2024-09-15T22:41:27.697762+0000","last_clean":"2024-09-15T22:41:27.697762+0000","last_became_active":"2024-09-15T22:41:26.708421+0000","last_became_peered":"2024-09-15T22:41:26.708421+0000","last_unstale":"2024-09-15T22:41:27.697762+0000","last_undegraded":"2024-09-15T22:41:27.697762+0000","last_fullsized":"2024-09-15T22:41:27.697762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701850+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:27.701850+0000","last_peered":"2024-09-15T22:41:27.701850+0000","last_clean":"2024-09-15T22:41:27.701850+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:27.701850+0000","last_undegraded":"2024-09-15T22:41:27.701850+0000","last_fullsized":"2024-09-15T22:41:27.701850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700932+0000","last_change":"2024-09-15T22:41:26.704333+0000","last_active":"2024-09-15T22:41:27.700932+0000","last_peered":"2024-09-15T22:41:27.700932+0000","last_clean":"2024-09-15T22:41:27.700932+0000","last_became_active":"2024-09-15T22:41:26.704001+0000","last_became_peered":"2024-09-15T22:41:26.704001+0000","last_unstale":"2024-09-15T22:41:27.700932+0000","last_undegraded":"2024-09-15T22:41:27.700932+0000","last_fullsized":"2024-09-15T22:41:27.700932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:16.328494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701465+0000","last_change":"2024-09-15T22:41:25.702682+0000","last_active":"2024-09-15T22:41:27.701465+0000","last_peered":"2024-09-15T22:41:27.701465+0000","last_clean":"2024-09-15T22:41:27.701465+0000","last_became_active":"2024-09-15T22:41:25.702368+0000","last_became_peered":"2024-09-15T22:41:25.702368+0000","last_unstale":"2024-09-15T22:41:27.701465+0000","last_undegraded":"2024-09-15T22:41:27.701465+0000","last_fullsized":"2024-09-15T22:41:27.701465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.825332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743470+0000","last_change":"2024-09-15T22:41:26.701366+0000","last_active":"2024-09-15T22:41:28.743470+0000","last_peered":"2024-09-15T22:41:28.743470+0000","last_clean":"2024-09-15T22:41:28.743470+0000","last_became_active":"2024-09-15T22:41:26.701105+0000","last_became_peered":"2024-09-15T22:41:26.701105+0000","last_unstale":"2024-09-15T22:41:28.743470+0000","last_undegraded":"2024-09-15T22:41:28.743470+0000","last_fullsized":"2024-09-15T22:41:28.743470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697909+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:27.697909+0000","last_peered":"2024-09-15T22:41:27.697909+0000","last_clean":"2024-09-15T22:41:27.697909+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:27.697909+0000","last_undegraded":"2024-09-15T22:41:27.697909+0000","last_fullsized":"2024-09-15T22:41:27.697909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697994+0000","last_change":"2024-09-15T22:41:26.707872+0000","last_active":"2024-09-15T22:41:27.697994+0000","last_peered":"2024-09-15T22:41:27.697994+0000","last_clean":"2024-09-15T22:41:27.697994+0000","last_became_active":"2024-09-15T22:41:26.707598+0000","last_became_peered":"2024-09-15T22:41:26.707598+0000","last_unstale":"2024-09-15T22:41:27.697994+0000","last_undegraded":"2024-09-15T22:41:27.697994+0000","last_fullsized":"2024-09-15T22:41:27.697994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698210+0000","last_change":"2024-09-15T22:41:26.707659+0000","last_active":"2024-09-15T22:41:27.698210+0000","last_peered":"2024-09-15T22:41:27.698210+0000","last_clean":"2024-09-15T22:41:27.698210+0000","last_became_active":"2024-09-15T22:41:26.707159+0000","last_became_peered":"2024-09-15T22:41:26.707159+0000","last_unstale":"2024-09-15T22:41:27.698210+0000","last_undegraded":"2024-09-15T22:41:27.698210+0000","last_fullsized":"2024-09-15T22:41:27.698210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:24.277275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993467+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:27.993467+0000","last_peered":"2024-09-15T22:41:27.993467+0000","last_clean":"2024-09-15T22:41:27.993467+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:27.993467+0000","last_undegraded":"2024-09-15T22:41:27.993467+0000","last_fullsized":"2024-09-15T22:41:27.993467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743049+0000","last_change":"2024-09-15T22:41:26.710722+0000","last_active":"2024-09-15T22:41:28.743049+0000","last_peered":"2024-09-15T22:41:28.743049+0000","last_clean":"2024-09-15T22:41:28.743049+0000","last_became_active":"2024-09-15T22:41:26.709829+0000","last_became_peered":"2024-09-15T22:41:26.709829+0000","last_unstale":"2024-09-15T22:41:28.743049+0000","last_undegraded":"2024-09-15T22:41:28.743049+0000","last_fullsized":"2024-09-15T22:41:28.743049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993304+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:27.993304+0000","last_peered":"2024-09-15T22:41:27.993304+0000","last_clean":"2024-09-15T22:41:27.993304+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:27.993304+0000","last_undegraded":"2024-09-15T22:41:27.993304+0000","last_fullsized":"2024-09-15T22:41:27.993304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744150+0000","last_change":"2024-09-15T22:41:26.704494+0000","last_active":"2024-09-15T22:41:28.744150+0000","last_peered":"2024-09-15T22:41:28.744150+0000","last_clean":"2024-09-15T22:41:28.744150+0000","last_became_active":"2024-09-15T22:41:26.703887+0000","last_became_peered":"2024-09-15T22:41:26.703887+0000","last_unstale":"2024-09-15T22:41:28.744150+0000","last_undegraded":"2024-09-15T22:41:28.744150+0000","last_fullsized":"2024-09-15T22:41:28.744150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744057+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:28.744057+0000","last_peered":"2024-09-15T22:41:28.744057+0000","last_clean":"2024-09-15T22:41:28.744057+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:28.744057+0000","last_undegraded":"2024-09-15T22:41:28.744057+0000","last_fullsized":"2024-09-15T22:41:28.744057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744111+0000","last_change":"2024-09-15T22:41:26.706602+0000","last_active":"2024-09-15T22:41:28.744111+0000","last_peered":"2024-09-15T22:41:28.744111+0000","last_clean":"2024-09-15T22:41:28.744111+0000","last_became_active":"2024-09-15T22:41:26.706228+0000","last_became_peered":"2024-09-15T22:41:26.706228+0000","last_unstale":"2024-09-15T22:41:28.744111+0000","last_undegraded":"2024-09-15T22:41:28.744111+0000","last_fullsized":"2024-09-15T22:41:28.744111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702368+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:27.702368+0000","last_peered":"2024-09-15T22:41:27.702368+0000","last_clean":"2024-09-15T22:41:27.702368+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:27.702368+0000","last_undegraded":"2024-09-15T22:41:27.702368+0000","last_fullsized":"2024-09-15T22:41:27.702368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:38.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:41:38.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.378+0000 7fdbb200a640 1 Processor -- start 2024-09-15T22:41:38.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.378+0000 7fdbb200a640 1 -- start start 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbb200a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdbac0d02a0 0x7fdbac0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbb200a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbac0d0bc0 con 0x7fdbac15ca40 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbb200a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbac15d390 con 0x7fdbac15ceb0 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbb200a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdbac15d670 con 0x7fdbac0d02a0 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaaffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdbac15ca40 0x7fdbac15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55990/0 (socket says 172.21.15.134:55990) 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaaffd640 1 -- 172.21.15.134:0/4220283844 learned_addr learned my addr 172.21.15.134:0/4220283844 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/4220283844 >> v2:172.21.15.177:3300/0 conn(0x7fdbac0d02a0 0x7fdbac0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741317397 0 0) 0x7fdbac0d0bc0 con 0x7fdbac15ca40 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb94003520 con 0x7fdbac15ca40 2024-09-15T22:41:38.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147894616 0 0) 0x7fdbac15d390 con 0x7fdbac15ceb0 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbac0d0bc0 con 0x7fdbac15ceb0 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1180305918 0 0) 0x7fdb94003520 con 0x7fdbac15ca40 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 >> v2:172.21.15.177:3300/0 conn(0x7fdbac0d02a0 msgr2=0x7fdbac0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 --2- 172.21.15.134:0/4220283844 >> v2:172.21.15.177:3300/0 conn(0x7fdbac0d02a0 0x7fdbac0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 >> v1:172.21.15.177:6789/0 conn(0x7fdbac15ceb0 legacy=0x7fdbac1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac15d950 con 0x7fdbac15ca40 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fdba0001670 con 0x7fdbac15ca40 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/4220283844 >> v2:172.21.15.177:3300/0 conn(0x7fdbac0d02a0 0x7fdbac0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 >> v1:172.21.15.134:6789/0 conn(0x7fdbac15ca40 legacy=0x7fdbac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb94003b40 0x7fdb94003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb94004800 0x7fdb94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 0x7fdb9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac15d670 con 0x7fdb940051c0 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9400c0f0 con 0x7fdb94004800 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9400c2f0 con 0x7fdb94003b40 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbabfff640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 0x7fdb9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbaaffd640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb94004800 0x7fdb94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.379+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb94003b40 0x7fdb94003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 -- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb94003b40 msgr2=0x7fdb94003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb94003b40 0x7fdb94003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 -- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb94004800 msgr2=0x7fdb94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb94004800 0x7fdb94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 -- 172.21.15.134:0/4220283844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb94003520 con 0x7fdb940051c0 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 -- 172.21.15.134:0/4220283844 reap_dead start 2024-09-15T22:41:38.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbabfff640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 0x7fdb9400b9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdba4001bb0 tx=0x7fdb94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4896b7669b6bc82f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4001bf0 con 0x7fdb940051c0 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4003b70 con 0x7fdb940051c0 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.380+0000 7fdbaa7fc640 1 -- 172.21.15.134:0/4220283844 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba40050d0 con 0x7fdb940051c0 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 -- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 msgr2=0x7fdb9400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 0x7fdb9400b9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdba4001bb0 tx=0x7fdb94005830 comp rx=0 tx=0).stop 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 -- 172.21.15.134:0/4220283844 shutdown_connections 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 --2- 172.21.15.134:0/4220283844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940051c0 0x7fdb9400b9c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 -- 172.21.15.134:0/4220283844 >> 172.21.15.134:0/4220283844 conn(0x7fdbac062cc0 msgr2=0x7fdbac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 -- 172.21.15.134:0/4220283844 shutdown_connections 2024-09-15T22:41:38.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.381+0000 7fdbb200a640 1 -- 172.21.15.134:0/4220283844 wait complete. 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.382+0000 7fdbb200a640 1 Processor -- start 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.382+0000 7fdbb200a640 1 -- start start 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 0x7fdbac14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbac0b2620 0x7fdbac0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac155b90 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac15df10 con 0x7fdb940051c0 2024-09-15T22:41:38.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbb200a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdbac155d10 con 0x7fdbac0b2620 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43544/0 (socket says 172.21.15.134:43544) 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 -- 172.21.15.134:0/3554666916 learned_addr learned my addr 172.21.15.134:0/3554666916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 0x7fdbac14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbaaffd640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbac0b2620 0x7fdbac0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 -- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbac0b2620 msgr2=0x7fdbac0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbac0b2620 0x7fdbac0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 -- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 msgr2=0x7fdbac14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.383+0000 7fdbabfff640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 0x7fdbac14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdbabfff640 1 -- 172.21.15.134:0/3554666916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac073510 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 0x7fdbac14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdbabfff640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdba402cc80 tx=0x7fdba4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4001bf0 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4003970 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba403c480 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac0737f0 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.384+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac073db0 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.385+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbac0b4790 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.385+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdba403c620 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.386+0000 7fdb93fff640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 0x7fdb9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.386+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdba40ab3c0 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.386+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 0x7fdb9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.386+0000 7fdbab7fe640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 0x7fdb9806e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006b10 tx=0x7fdb9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.390+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdba4079b30 con 0x7fdbac0cdcf0 2024-09-15T22:41:38.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.552+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbac074230 con 0x7fdb9806c2b0 2024-09-15T22:41:38.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.557+0000 7fdb93fff640 1 -- 172.21.15.134:0/3554666916 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7fdbac074230 con 0x7fdb9806c2b0 2024-09-15T22:41:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 msgr2=0x7fdb9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 0x7fdb9806e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006b10 tx=0x7fdb9c008040 comp rx=0 tx=0).stop 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 msgr2=0x7fdbac0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdba402cc80 tx=0x7fdba4001650 comp rx=0 tx=0).stop 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 shutdown_connections 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdb9806c2b0 0x7fdb9806e770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0cdcf0 0x7fdbac0ce170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbac0b2620 0x7fdbac0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 --2- 172.21.15.134:0/3554666916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb940051c0 0x7fdbac14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 >> 172.21.15.134:0/3554666916 conn(0x7fdbac062cc0 msgr2=0x7fdbac154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 shutdown_connections 2024-09-15T22:41:38.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.560+0000 7fdbb200a640 1 -- 172.21.15.134:0/3554666916 wait complete. 2024-09-15T22:41:38.572 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-15T22:41:36.950125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219308,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755412,"statfs":{"total":773094113280,"available":772869541888,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002126"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993495+0000","last_change":"2024-09-15T22:41:26.715026+0000","last_active":"2024-09-15T22:41:27.993495+0000","last_peered":"2024-09-15T22:41:27.993495+0000","last_clean":"2024-09-15T22:41:27.993495+0000","last_became_active":"2024-09-15T22:41:26.714732+0000","last_became_peered":"2024-09-15T22:41:26.714732+0000","last_unstale":"2024-09-15T22:41:27.993495+0000","last_undegraded":"2024-09-15T22:41:27.993495+0000","last_fullsized":"2024-09-15T22:41:27.993495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743708+0000","last_change":"2024-09-15T22:41:26.708187+0000","last_active":"2024-09-15T22:41:28.743708+0000","last_peered":"2024-09-15T22:41:28.743708+0000","last_clean":"2024-09-15T22:41:28.743708+0000","last_became_active":"2024-09-15T22:41:26.707542+0000","last_became_peered":"2024-09-15T22:41:26.707542+0000","last_unstale":"2024-09-15T22:41:28.743708+0000","last_undegraded":"2024-09-15T22:41:28.743708+0000","last_fullsized":"2024-09-15T22:41:28.743708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743729+0000","last_change":"2024-09-15T22:41:26.702417+0000","last_active":"2024-09-15T22:41:28.743729+0000","last_peered":"2024-09-15T22:41:28.743729+0000","last_clean":"2024-09-15T22:41:28.743729+0000","last_became_active":"2024-09-15T22:41:26.702137+0000","last_became_peered":"2024-09-15T22:41:26.702137+0000","last_unstale":"2024-09-15T22:41:28.743729+0000","last_undegraded":"2024-09-15T22:41:28.743729+0000","last_fullsized":"2024-09-15T22:41:28.743729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743282+0000","last_change":"2024-09-15T22:41:26.705417+0000","last_active":"2024-09-15T22:41:28.743282+0000","last_peered":"2024-09-15T22:41:28.743282+0000","last_clean":"2024-09-15T22:41:28.743282+0000","last_became_active":"2024-09-15T22:41:26.704860+0000","last_became_peered":"2024-09-15T22:41:26.704860+0000","last_unstale":"2024-09-15T22:41:28.743282+0000","last_undegraded":"2024-09-15T22:41:28.743282+0000","last_fullsized":"2024-09-15T22:41:28.743282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:16.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993172+0000","last_change":"2024-09-15T22:41:26.705602+0000","last_active":"2024-09-15T22:41:27.993172+0000","last_peered":"2024-09-15T22:41:27.993172+0000","last_clean":"2024-09-15T22:41:27.993172+0000","last_became_active":"2024-09-15T22:41:26.705349+0000","last_became_peered":"2024-09-15T22:41:26.705349+0000","last_unstale":"2024-09-15T22:41:27.993172+0000","last_undegraded":"2024-09-15T22:41:27.993172+0000","last_fullsized":"2024-09-15T22:41:27.993172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742873+0000","last_change":"2024-09-15T22:41:26.705590+0000","last_active":"2024-09-15T22:41:28.742873+0000","last_peered":"2024-09-15T22:41:28.742873+0000","last_clean":"2024-09-15T22:41:28.742873+0000","last_became_active":"2024-09-15T22:41:26.705121+0000","last_became_peered":"2024-09-15T22:41:26.705121+0000","last_unstale":"2024-09-15T22:41:28.742873+0000","last_undegraded":"2024-09-15T22:41:28.742873+0000","last_fullsized":"2024-09-15T22:41:28.742873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993014+0000","last_change":"2024-09-15T22:41:26.711621+0000","last_active":"2024-09-15T22:41:27.993014+0000","last_peered":"2024-09-15T22:41:27.993014+0000","last_clean":"2024-09-15T22:41:27.993014+0000","last_became_active":"2024-09-15T22:41:26.711350+0000","last_became_peered":"2024-09-15T22:41:26.711350+0000","last_unstale":"2024-09-15T22:41:27.993014+0000","last_undegraded":"2024-09-15T22:41:27.993014+0000","last_fullsized":"2024-09-15T22:41:27.993014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743588+0000","last_change":"2024-09-15T22:41:26.709226+0000","last_active":"2024-09-15T22:41:28.743588+0000","last_peered":"2024-09-15T22:41:28.743588+0000","last_clean":"2024-09-15T22:41:28.743588+0000","last_became_active":"2024-09-15T22:41:26.708822+0000","last_became_peered":"2024-09-15T22:41:26.708822+0000","last_unstale":"2024-09-15T22:41:28.743588+0000","last_undegraded":"2024-09-15T22:41:28.743588+0000","last_fullsized":"2024-09-15T22:41:28.743588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743223+0000","last_change":"2024-09-15T22:41:26.714192+0000","last_active":"2024-09-15T22:41:28.743223+0000","last_peered":"2024-09-15T22:41:28.743223+0000","last_clean":"2024-09-15T22:41:28.743223+0000","last_became_active":"2024-09-15T22:41:26.713880+0000","last_became_peered":"2024-09-15T22:41:26.713880+0000","last_unstale":"2024-09-15T22:41:28.743223+0000","last_undegraded":"2024-09-15T22:41:28.743223+0000","last_fullsized":"2024-09-15T22:41:28.743223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993371+0000","last_change":"2024-09-15T22:41:26.707274+0000","last_active":"2024-09-15T22:41:27.993371+0000","last_peered":"2024-09-15T22:41:27.993371+0000","last_clean":"2024-09-15T22:41:27.993371+0000","last_became_active":"2024-09-15T22:41:26.707019+0000","last_became_peered":"2024-09-15T22:41:26.707019+0000","last_unstale":"2024-09-15T22:41:27.993371+0000","last_undegraded":"2024-09-15T22:41:27.993371+0000","last_fullsized":"2024-09-15T22:41:27.993371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993235+0000","last_change":"2024-09-15T22:41:26.715027+0000","last_active":"2024-09-15T22:41:27.993235+0000","last_peered":"2024-09-15T22:41:27.993235+0000","last_clean":"2024-09-15T22:41:27.993235+0000","last_became_active":"2024-09-15T22:41:26.714742+0000","last_became_peered":"2024-09-15T22:41:26.714742+0000","last_unstale":"2024-09-15T22:41:27.993235+0000","last_undegraded":"2024-09-15T22:41:27.993235+0000","last_fullsized":"2024-09-15T22:41:27.993235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993177+0000","last_change":"2024-09-15T22:41:26.705354+0000","last_active":"2024-09-15T22:41:27.993177+0000","last_peered":"2024-09-15T22:41:27.993177+0000","last_clean":"2024-09-15T22:41:27.993177+0000","last_became_active":"2024-09-15T22:41:26.704817+0000","last_became_peered":"2024-09-15T22:41:26.704817+0000","last_unstale":"2024-09-15T22:41:27.993177+0000","last_undegraded":"2024-09-15T22:41:27.993177+0000","last_fullsized":"2024-09-15T22:41:27.993177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701520+0000","last_change":"2024-09-15T22:41:26.707362+0000","last_active":"2024-09-15T22:41:27.701520+0000","last_peered":"2024-09-15T22:41:27.701520+0000","last_clean":"2024-09-15T22:41:27.701520+0000","last_became_active":"2024-09-15T22:41:26.707108+0000","last_became_peered":"2024-09-15T22:41:26.707108+0000","last_unstale":"2024-09-15T22:41:27.701520+0000","last_undegraded":"2024-09-15T22:41:27.701520+0000","last_fullsized":"2024-09-15T22:41:27.701520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:00.028580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701343+0000","last_change":"2024-09-15T22:41:26.701767+0000","last_active":"2024-09-15T22:41:27.701343+0000","last_peered":"2024-09-15T22:41:27.701343+0000","last_clean":"2024-09-15T22:41:27.701343+0000","last_became_active":"2024-09-15T22:41:26.701488+0000","last_became_peered":"2024-09-15T22:41:26.701488+0000","last_unstale":"2024-09-15T22:41:27.701343+0000","last_undegraded":"2024-09-15T22:41:27.701343+0000","last_fullsized":"2024-09-15T22:41:27.701343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:02.532139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.704769+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.704475+0000","last_became_peered":"2024-09-15T22:41:26.704475+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697745+0000","last_change":"2024-09-15T22:41:26.702125+0000","last_active":"2024-09-15T22:41:27.697745+0000","last_peered":"2024-09-15T22:41:27.697745+0000","last_clean":"2024-09-15T22:41:27.697745+0000","last_became_active":"2024-09-15T22:41:26.701707+0000","last_became_peered":"2024-09-15T22:41:26.701707+0000","last_unstale":"2024-09-15T22:41:27.697745+0000","last_undegraded":"2024-09-15T22:41:27.697745+0000","last_fullsized":"2024-09-15T22:41:27.697745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698334+0000","last_change":"2024-09-15T22:41:26.709603+0000","last_active":"2024-09-15T22:41:27.698334+0000","last_peered":"2024-09-15T22:41:27.698334+0000","last_clean":"2024-09-15T22:41:27.698334+0000","last_became_active":"2024-09-15T22:41:26.709357+0000","last_became_peered":"2024-09-15T22:41:26.709357+0000","last_unstale":"2024-09-15T22:41:27.698334+0000","last_undegraded":"2024-09-15T22:41:27.698334+0000","last_fullsized":"2024-09-15T22:41:27.698334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:59.454273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744094+0000","last_change":"2024-09-15T22:41:26.700010+0000","last_active":"2024-09-15T22:41:28.744094+0000","last_peered":"2024-09-15T22:41:28.744094+0000","last_clean":"2024-09-15T22:41:28.744094+0000","last_became_active":"2024-09-15T22:41:26.699679+0000","last_became_peered":"2024-09-15T22:41:26.699679+0000","last_unstale":"2024-09-15T22:41:28.744094+0000","last_undegraded":"2024-09-15T22:41:28.744094+0000","last_fullsized":"2024-09-15T22:41:28.744094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:30.709727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698344+0000","last_change":"2024-09-15T22:41:26.707446+0000","last_active":"2024-09-15T22:41:27.698344+0000","last_peered":"2024-09-15T22:41:27.698344+0000","last_clean":"2024-09-15T22:41:27.698344+0000","last_became_active":"2024-09-15T22:41:26.706549+0000","last_became_peered":"2024-09-15T22:41:26.706549+0000","last_unstale":"2024-09-15T22:41:27.698344+0000","last_undegraded":"2024-09-15T22:41:27.698344+0000","last_fullsized":"2024-09-15T22:41:27.698344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:53.685207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993375+0000","last_change":"2024-09-15T22:41:26.707073+0000","last_active":"2024-09-15T22:41:27.993375+0000","last_peered":"2024-09-15T22:41:27.993375+0000","last_clean":"2024-09-15T22:41:27.993375+0000","last_became_active":"2024-09-15T22:41:26.706499+0000","last_became_peered":"2024-09-15T22:41:26.706499+0000","last_unstale":"2024-09-15T22:41:27.993375+0000","last_undegraded":"2024-09-15T22:41:27.993375+0000","last_fullsized":"2024-09-15T22:41:27.993375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702082+0000","last_change":"2024-09-15T22:41:26.701194+0000","last_active":"2024-09-15T22:41:27.702082+0000","last_peered":"2024-09-15T22:41:27.702082+0000","last_clean":"2024-09-15T22:41:27.702082+0000","last_became_active":"2024-09-15T22:41:26.700907+0000","last_became_peered":"2024-09-15T22:41:26.700907+0000","last_unstale":"2024-09-15T22:41:27.702082+0000","last_undegraded":"2024-09-15T22:41:27.702082+0000","last_fullsized":"2024-09-15T22:41:27.702082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:39.349843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742859+0000","last_change":"2024-09-15T22:41:26.708589+0000","last_active":"2024-09-15T22:41:28.742859+0000","last_peered":"2024-09-15T22:41:28.742859+0000","last_clean":"2024-09-15T22:41:28.742859+0000","last_became_active":"2024-09-15T22:41:26.708297+0000","last_became_peered":"2024-09-15T22:41:26.708297+0000","last_unstale":"2024-09-15T22:41:28.742859+0000","last_undegraded":"2024-09-15T22:41:28.742859+0000","last_fullsized":"2024-09-15T22:41:28.742859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:56.536210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744342+0000","last_change":"2024-09-15T22:41:26.705794+0000","last_active":"2024-09-15T22:41:28.744342+0000","last_peered":"2024-09-15T22:41:28.744342+0000","last_clean":"2024-09-15T22:41:28.744342+0000","last_became_active":"2024-09-15T22:41:26.705524+0000","last_became_peered":"2024-09-15T22:41:26.705524+0000","last_unstale":"2024-09-15T22:41:28.744342+0000","last_undegraded":"2024-09-15T22:41:28.744342+0000","last_fullsized":"2024-09-15T22:41:28.744342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697744+0000","last_change":"2024-09-15T22:41:26.710283+0000","last_active":"2024-09-15T22:41:27.697744+0000","last_peered":"2024-09-15T22:41:27.697744+0000","last_clean":"2024-09-15T22:41:27.697744+0000","last_became_active":"2024-09-15T22:41:26.709982+0000","last_became_peered":"2024-09-15T22:41:26.709982+0000","last_unstale":"2024-09-15T22:41:27.697744+0000","last_undegraded":"2024-09-15T22:41:27.697744+0000","last_fullsized":"2024-09-15T22:41:27.697744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744011+0000","last_change":"2024-09-15T22:41:26.705107+0000","last_active":"2024-09-15T22:41:28.744011+0000","last_peered":"2024-09-15T22:41:28.744011+0000","last_clean":"2024-09-15T22:41:28.744011+0000","last_became_active":"2024-09-15T22:41:26.704217+0000","last_became_peered":"2024-09-15T22:41:26.704217+0000","last_unstale":"2024-09-15T22:41:28.744011+0000","last_undegraded":"2024-09-15T22:41:28.744011+0000","last_fullsized":"2024-09-15T22:41:28.744011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:01.164036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743459+0000","last_change":"2024-09-15T22:41:26.712467+0000","last_active":"2024-09-15T22:41:28.743459+0000","last_peered":"2024-09-15T22:41:28.743459+0000","last_clean":"2024-09-15T22:41:28.743459+0000","last_became_active":"2024-09-15T22:41:26.711787+0000","last_became_peered":"2024-09-15T22:41:26.711787+0000","last_unstale":"2024-09-15T22:41:28.743459+0000","last_undegraded":"2024-09-15T22:41:28.743459+0000","last_fullsized":"2024-09-15T22:41:28.743459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:08.624131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701840+0000","last_change":"2024-09-15T22:41:26.702206+0000","last_active":"2024-09-15T22:41:27.701840+0000","last_peered":"2024-09-15T22:41:27.701840+0000","last_clean":"2024-09-15T22:41:27.701840+0000","last_became_active":"2024-09-15T22:41:26.701499+0000","last_became_peered":"2024-09-15T22:41:26.701499+0000","last_unstale":"2024-09-15T22:41:27.701840+0000","last_undegraded":"2024-09-15T22:41:27.701840+0000","last_fullsized":"2024-09-15T22:41:27.701840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.486966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701565+0000","last_change":"2024-09-15T22:41:26.706783+0000","last_active":"2024-09-15T22:41:27.701565+0000","last_peered":"2024-09-15T22:41:27.701565+0000","last_clean":"2024-09-15T22:41:27.701565+0000","last_became_active":"2024-09-15T22:41:26.706518+0000","last_became_peered":"2024-09-15T22:41:26.706518+0000","last_unstale":"2024-09-15T22:41:27.701565+0000","last_undegraded":"2024-09-15T22:41:27.701565+0000","last_fullsized":"2024-09-15T22:41:27.701565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:11.596810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744294+0000","last_change":"2024-09-15T22:41:26.703909+0000","last_active":"2024-09-15T22:41:28.744294+0000","last_peered":"2024-09-15T22:41:28.744294+0000","last_clean":"2024-09-15T22:41:28.744294+0000","last_became_active":"2024-09-15T22:41:26.703596+0000","last_became_peered":"2024-09-15T22:41:26.703596+0000","last_unstale":"2024-09-15T22:41:28.744294+0000","last_undegraded":"2024-09-15T22:41:28.744294+0000","last_fullsized":"2024-09-15T22:41:28.744294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697926+0000","last_change":"2024-09-15T22:41:26.711096+0000","last_active":"2024-09-15T22:41:27.697926+0000","last_peered":"2024-09-15T22:41:27.697926+0000","last_clean":"2024-09-15T22:41:27.697926+0000","last_became_active":"2024-09-15T22:41:26.710825+0000","last_became_peered":"2024-09-15T22:41:26.710825+0000","last_unstale":"2024-09-15T22:41:27.697926+0000","last_undegraded":"2024-09-15T22:41:27.697926+0000","last_fullsized":"2024-09-15T22:41:27.697926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:20.909561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743281+0000","last_change":"2024-09-15T22:41:26.705332+0000","last_active":"2024-09-15T22:41:28.743281+0000","last_peered":"2024-09-15T22:41:28.743281+0000","last_clean":"2024-09-15T22:41:28.743281+0000","last_became_active":"2024-09-15T22:41:26.705041+0000","last_became_peered":"2024-09-15T22:41:26.705041+0000","last_unstale":"2024-09-15T22:41:28.743281+0000","last_undegraded":"2024-09-15T22:41:28.743281+0000","last_fullsized":"2024-09-15T22:41:28.743281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742844+0000","last_change":"2024-09-15T22:41:26.700581+0000","last_active":"2024-09-15T22:41:28.742844+0000","last_peered":"2024-09-15T22:41:28.742844+0000","last_clean":"2024-09-15T22:41:28.742844+0000","last_became_active":"2024-09-15T22:41:26.700298+0000","last_became_peered":"2024-09-15T22:41:26.700298+0000","last_unstale":"2024-09-15T22:41:28.742844+0000","last_undegraded":"2024-09-15T22:41:28.742844+0000","last_fullsized":"2024-09-15T22:41:28.742844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742899+0000","last_change":"2024-09-15T22:41:26.711782+0000","last_active":"2024-09-15T22:41:28.742899+0000","last_peered":"2024-09-15T22:41:28.742899+0000","last_clean":"2024-09-15T22:41:28.742899+0000","last_became_active":"2024-09-15T22:41:26.711523+0000","last_became_peered":"2024-09-15T22:41:26.711523+0000","last_unstale":"2024-09-15T22:41:28.742899+0000","last_undegraded":"2024-09-15T22:41:28.742899+0000","last_fullsized":"2024-09-15T22:41:28.742899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743927+0000","last_change":"2024-09-15T22:41:25.699436+0000","last_active":"2024-09-15T22:41:28.743927+0000","last_peered":"2024-09-15T22:41:28.743927+0000","last_clean":"2024-09-15T22:41:28.743927+0000","last_became_active":"2024-09-15T22:41:25.699145+0000","last_became_peered":"2024-09-15T22:41:25.699145+0000","last_unstale":"2024-09-15T22:41:28.743927+0000","last_undegraded":"2024-09-15T22:41:28.743927+0000","last_fullsized":"2024-09-15T22:41:28.743927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702315+0000","last_change":"2024-09-15T22:41:26.707739+0000","last_active":"2024-09-15T22:41:27.702315+0000","last_peered":"2024-09-15T22:41:27.702315+0000","last_clean":"2024-09-15T22:41:27.702315+0000","last_became_active":"2024-09-15T22:41:26.707466+0000","last_became_peered":"2024-09-15T22:41:26.707466+0000","last_unstale":"2024-09-15T22:41:27.702315+0000","last_undegraded":"2024-09-15T22:41:27.702315+0000","last_fullsized":"2024-09-15T22:41:27.702315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:59.569856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698149+0000","last_change":"2024-09-15T22:41:25.707035+0000","last_active":"2024-09-15T22:41:27.698149+0000","last_peered":"2024-09-15T22:41:27.698149+0000","last_clean":"2024-09-15T22:41:27.698149+0000","last_became_active":"2024-09-15T22:41:25.706777+0000","last_became_peered":"2024-09-15T22:41:25.706777+0000","last_unstale":"2024-09-15T22:41:27.698149+0000","last_undegraded":"2024-09-15T22:41:27.698149+0000","last_fullsized":"2024-09-15T22:41:27.698149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:15.504080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701240+0000","last_change":"2024-09-15T22:41:25.702016+0000","last_active":"2024-09-15T22:41:27.701240+0000","last_peered":"2024-09-15T22:41:27.701240+0000","last_clean":"2024-09-15T22:41:27.701240+0000","last_became_active":"2024-09-15T22:41:25.701650+0000","last_became_peered":"2024-09-15T22:41:25.701650+0000","last_unstale":"2024-09-15T22:41:27.701240+0000","last_undegraded":"2024-09-15T22:41:27.701240+0000","last_fullsized":"2024-09-15T22:41:27.701240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:09.408758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744370+0000","last_change":"2024-09-15T22:41:26.709592+0000","last_active":"2024-09-15T22:41:28.744370+0000","last_peered":"2024-09-15T22:41:28.744370+0000","last_clean":"2024-09-15T22:41:28.744370+0000","last_became_active":"2024-09-15T22:41:26.709146+0000","last_became_peered":"2024-09-15T22:41:26.709146+0000","last_unstale":"2024-09-15T22:41:28.744370+0000","last_undegraded":"2024-09-15T22:41:28.744370+0000","last_fullsized":"2024-09-15T22:41:28.744370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697853+0000","last_change":"2024-09-15T22:41:25.702916+0000","last_active":"2024-09-15T22:41:27.697853+0000","last_peered":"2024-09-15T22:41:27.697853+0000","last_clean":"2024-09-15T22:41:27.697853+0000","last_became_active":"2024-09-15T22:41:25.702338+0000","last_became_peered":"2024-09-15T22:41:25.702338+0000","last_unstale":"2024-09-15T22:41:27.697853+0000","last_undegraded":"2024-09-15T22:41:27.697853+0000","last_fullsized":"2024-09-15T22:41:27.697853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:07.616440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701757+0000","last_change":"2024-09-15T22:41:26.708462+0000","last_active":"2024-09-15T22:41:27.701757+0000","last_peered":"2024-09-15T22:41:27.701757+0000","last_clean":"2024-09-15T22:41:27.701757+0000","last_became_active":"2024-09-15T22:41:26.708159+0000","last_became_peered":"2024-09-15T22:41:26.708159+0000","last_unstale":"2024-09-15T22:41:27.701757+0000","last_undegraded":"2024-09-15T22:41:27.701757+0000","last_fullsized":"2024-09-15T22:41:27.701757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:03.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743325+0000","last_change":"2024-09-15T22:41:25.694842+0000","last_active":"2024-09-15T22:41:28.743325+0000","last_peered":"2024-09-15T22:41:28.743325+0000","last_clean":"2024-09-15T22:41:28.743325+0000","last_became_active":"2024-09-15T22:41:25.694587+0000","last_became_peered":"2024-09-15T22:41:25.694587+0000","last_unstale":"2024-09-15T22:41:28.743325+0000","last_undegraded":"2024-09-15T22:41:28.743325+0000","last_fullsized":"2024-09-15T22:41:28.743325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743496+0000","last_change":"2024-09-15T22:41:26.712084+0000","last_active":"2024-09-15T22:41:28.743496+0000","last_peered":"2024-09-15T22:41:28.743496+0000","last_clean":"2024-09-15T22:41:28.743496+0000","last_became_active":"2024-09-15T22:41:26.711768+0000","last_became_peered":"2024-09-15T22:41:26.711768+0000","last_unstale":"2024-09-15T22:41:28.743496+0000","last_undegraded":"2024-09-15T22:41:28.743496+0000","last_fullsized":"2024-09-15T22:41:28.743496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:24.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993377+0000","last_change":"2024-09-15T22:41:25.701461+0000","last_active":"2024-09-15T22:41:27.993377+0000","last_peered":"2024-09-15T22:41:27.993377+0000","last_clean":"2024-09-15T22:41:27.993377+0000","last_became_active":"2024-09-15T22:41:25.701221+0000","last_became_peered":"2024-09-15T22:41:25.701221+0000","last_unstale":"2024-09-15T22:41:27.993377+0000","last_undegraded":"2024-09-15T22:41:27.993377+0000","last_fullsized":"2024-09-15T22:41:27.993377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744355+0000","last_change":"2024-09-15T22:41:26.710472+0000","last_active":"2024-09-15T22:41:28.744355+0000","last_peered":"2024-09-15T22:41:28.744355+0000","last_clean":"2024-09-15T22:41:28.744355+0000","last_became_active":"2024-09-15T22:41:26.710156+0000","last_became_peered":"2024-09-15T22:41:26.710156+0000","last_unstale":"2024-09-15T22:41:28.744355+0000","last_undegraded":"2024-09-15T22:41:28.744355+0000","last_fullsized":"2024-09-15T22:41:28.744355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:36.641076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743487+0000","last_change":"2024-09-15T22:41:25.699710+0000","last_active":"2024-09-15T22:41:28.743487+0000","last_peered":"2024-09-15T22:41:28.743487+0000","last_clean":"2024-09-15T22:41:28.743487+0000","last_became_active":"2024-09-15T22:41:25.699383+0000","last_became_peered":"2024-09-15T22:41:25.699383+0000","last_unstale":"2024-09-15T22:41:28.743487+0000","last_undegraded":"2024-09-15T22:41:28.743487+0000","last_fullsized":"2024-09-15T22:41:28.743487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:27.823825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698025+0000","last_change":"2024-09-15T22:41:26.705756+0000","last_active":"2024-09-15T22:41:27.698025+0000","last_peered":"2024-09-15T22:41:27.698025+0000","last_clean":"2024-09-15T22:41:27.698025+0000","last_became_active":"2024-09-15T22:41:26.705439+0000","last_became_peered":"2024-09-15T22:41:26.705439+0000","last_unstale":"2024-09-15T22:41:27.698025+0000","last_undegraded":"2024-09-15T22:41:27.698025+0000","last_fullsized":"2024-09-15T22:41:27.698025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:50.176003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743328+0000","last_change":"2024-09-15T22:41:25.696865+0000","last_active":"2024-09-15T22:41:28.743328+0000","last_peered":"2024-09-15T22:41:28.743328+0000","last_clean":"2024-09-15T22:41:28.743328+0000","last_became_active":"2024-09-15T22:41:25.696588+0000","last_became_peered":"2024-09-15T22:41:25.696588+0000","last_unstale":"2024-09-15T22:41:28.743328+0000","last_undegraded":"2024-09-15T22:41:28.743328+0000","last_fullsized":"2024-09-15T22:41:28.743328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:21.945362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993275+0000","last_change":"2024-09-15T22:41:26.704427+0000","last_active":"2024-09-15T22:41:27.993275+0000","last_peered":"2024-09-15T22:41:27.993275+0000","last_clean":"2024-09-15T22:41:27.993275+0000","last_became_active":"2024-09-15T22:41:26.704031+0000","last_became_peered":"2024-09-15T22:41:26.704031+0000","last_unstale":"2024-09-15T22:41:27.993275+0000","last_undegraded":"2024-09-15T22:41:27.993275+0000","last_fullsized":"2024-09-15T22:41:27.993275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:49.749616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743409+0000","last_change":"2024-09-15T22:41:25.701394+0000","last_active":"2024-09-15T22:41:28.743409+0000","last_peered":"2024-09-15T22:41:28.743409+0000","last_clean":"2024-09-15T22:41:28.743409+0000","last_became_active":"2024-09-15T22:41:25.701135+0000","last_became_peered":"2024-09-15T22:41:25.701135+0000","last_unstale":"2024-09-15T22:41:28.743409+0000","last_undegraded":"2024-09-15T22:41:28.743409+0000","last_fullsized":"2024-09-15T22:41:28.743409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.377666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701423+0000","last_change":"2024-09-15T22:41:26.711298+0000","last_active":"2024-09-15T22:41:27.701423+0000","last_peered":"2024-09-15T22:41:27.701423+0000","last_clean":"2024-09-15T22:41:27.701423+0000","last_became_active":"2024-09-15T22:41:26.711029+0000","last_became_peered":"2024-09-15T22:41:26.711029+0000","last_unstale":"2024-09-15T22:41:27.701423+0000","last_undegraded":"2024-09-15T22:41:27.701423+0000","last_fullsized":"2024-09-15T22:41:27.701423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:29.101148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698254+0000","last_change":"2024-09-15T22:41:25.706556+0000","last_active":"2024-09-15T22:41:27.698254+0000","last_peered":"2024-09-15T22:41:27.698254+0000","last_clean":"2024-09-15T22:41:27.698254+0000","last_became_active":"2024-09-15T22:41:25.705657+0000","last_became_peered":"2024-09-15T22:41:25.705657+0000","last_unstale":"2024-09-15T22:41:27.698254+0000","last_undegraded":"2024-09-15T22:41:27.698254+0000","last_fullsized":"2024-09-15T22:41:27.698254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:23.492215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697818+0000","last_change":"2024-09-15T22:41:26.709651+0000","last_active":"2024-09-15T22:41:27.697818+0000","last_peered":"2024-09-15T22:41:27.697818+0000","last_clean":"2024-09-15T22:41:27.697818+0000","last_became_active":"2024-09-15T22:41:26.709419+0000","last_became_peered":"2024-09-15T22:41:26.709419+0000","last_unstale":"2024-09-15T22:41:27.697818+0000","last_undegraded":"2024-09-15T22:41:27.697818+0000","last_fullsized":"2024-09-15T22:41:27.697818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:23.380199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992998+0000","last_change":"2024-09-15T22:41:25.705072+0000","last_active":"2024-09-15T22:41:27.992998+0000","last_peered":"2024-09-15T22:41:27.992998+0000","last_clean":"2024-09-15T22:41:27.992998+0000","last_became_active":"2024-09-15T22:41:25.704828+0000","last_became_peered":"2024-09-15T22:41:25.704828+0000","last_unstale":"2024-09-15T22:41:27.992998+0000","last_undegraded":"2024-09-15T22:41:27.992998+0000","last_fullsized":"2024-09-15T22:41:27.992998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.742983+0000","last_change":"2024-09-15T22:41:26.712445+0000","last_active":"2024-09-15T22:41:28.742983+0000","last_peered":"2024-09-15T22:41:28.742983+0000","last_clean":"2024-09-15T22:41:28.742983+0000","last_became_active":"2024-09-15T22:41:26.712201+0000","last_became_peered":"2024-09-15T22:41:26.712201+0000","last_unstale":"2024-09-15T22:41:28.742983+0000","last_undegraded":"2024-09-15T22:41:28.742983+0000","last_fullsized":"2024-09-15T22:41:28.742983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700874+0000","last_change":"2024-09-15T22:41:25.694812+0000","last_active":"2024-09-15T22:41:27.700874+0000","last_peered":"2024-09-15T22:41:27.700874+0000","last_clean":"2024-09-15T22:41:27.700874+0000","last_became_active":"2024-09-15T22:41:25.694502+0000","last_became_peered":"2024-09-15T22:41:25.694502+0000","last_unstale":"2024-09-15T22:41:27.700874+0000","last_undegraded":"2024-09-15T22:41:27.700874+0000","last_fullsized":"2024-09-15T22:41:27.700874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697754+0000","last_change":"2024-09-15T22:41:26.709001+0000","last_active":"2024-09-15T22:41:27.697754+0000","last_peered":"2024-09-15T22:41:27.697754+0000","last_clean":"2024-09-15T22:41:27.697754+0000","last_became_active":"2024-09-15T22:41:26.708687+0000","last_became_peered":"2024-09-15T22:41:26.708687+0000","last_unstale":"2024-09-15T22:41:27.697754+0000","last_undegraded":"2024-09-15T22:41:27.697754+0000","last_fullsized":"2024-09-15T22:41:27.697754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993549+0000","last_change":"2024-09-15T22:41:25.707500+0000","last_active":"2024-09-15T22:41:27.993549+0000","last_peered":"2024-09-15T22:41:27.993549+0000","last_clean":"2024-09-15T22:41:27.993549+0000","last_became_active":"2024-09-15T22:41:25.707204+0000","last_became_peered":"2024-09-15T22:41:25.707204+0000","last_unstale":"2024-09-15T22:41:27.993549+0000","last_undegraded":"2024-09-15T22:41:27.993549+0000","last_fullsized":"2024-09-15T22:41:27.993549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743595+0000","last_change":"2024-09-15T22:41:26.706136+0000","last_active":"2024-09-15T22:41:28.743595+0000","last_peered":"2024-09-15T22:41:28.743595+0000","last_clean":"2024-09-15T22:41:28.743595+0000","last_became_active":"2024-09-15T22:41:26.705873+0000","last_became_peered":"2024-09-15T22:41:26.705873+0000","last_unstale":"2024-09-15T22:41:28.743595+0000","last_undegraded":"2024-09-15T22:41:28.743595+0000","last_fullsized":"2024-09-15T22:41:28.743595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:21.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702040+0000","last_change":"2024-09-15T22:41:25.703928+0000","last_active":"2024-09-15T22:41:27.702040+0000","last_peered":"2024-09-15T22:41:27.702040+0000","last_clean":"2024-09-15T22:41:27.702040+0000","last_became_active":"2024-09-15T22:41:25.703073+0000","last_became_peered":"2024-09-15T22:41:25.703073+0000","last_unstale":"2024-09-15T22:41:27.702040+0000","last_undegraded":"2024-09-15T22:41:27.702040+0000","last_fullsized":"2024-09-15T22:41:27.702040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993537+0000","last_change":"2024-09-15T22:41:26.706050+0000","last_active":"2024-09-15T22:41:27.993537+0000","last_peered":"2024-09-15T22:41:27.993537+0000","last_clean":"2024-09-15T22:41:27.993537+0000","last_became_active":"2024-09-15T22:41:26.705788+0000","last_became_peered":"2024-09-15T22:41:26.705788+0000","last_unstale":"2024-09-15T22:41:27.993537+0000","last_undegraded":"2024-09-15T22:41:27.993537+0000","last_fullsized":"2024-09-15T22:41:27.993537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743774+0000","last_change":"2024-09-15T22:41:25.702529+0000","last_active":"2024-09-15T22:41:28.743774+0000","last_peered":"2024-09-15T22:41:28.743774+0000","last_clean":"2024-09-15T22:41:28.743774+0000","last_became_active":"2024-09-15T22:41:25.702154+0000","last_became_peered":"2024-09-15T22:41:25.702154+0000","last_unstale":"2024-09-15T22:41:28.743774+0000","last_undegraded":"2024-09-15T22:41:28.743774+0000","last_fullsized":"2024-09-15T22:41:28.743774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993353+0000","last_change":"2024-09-15T22:41:26.707289+0000","last_active":"2024-09-15T22:41:27.993353+0000","last_peered":"2024-09-15T22:41:27.993353+0000","last_clean":"2024-09-15T22:41:27.993353+0000","last_became_active":"2024-09-15T22:41:26.706675+0000","last_became_peered":"2024-09-15T22:41:26.706675+0000","last_unstale":"2024-09-15T22:41:27.993353+0000","last_undegraded":"2024-09-15T22:41:27.993353+0000","last_fullsized":"2024-09-15T22:41:27.993353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:01.673923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701675+0000","last_change":"2024-09-15T22:41:25.702075+0000","last_active":"2024-09-15T22:41:27.701675+0000","last_peered":"2024-09-15T22:41:27.701675+0000","last_clean":"2024-09-15T22:41:27.701675+0000","last_became_active":"2024-09-15T22:41:25.701608+0000","last_became_peered":"2024-09-15T22:41:25.701608+0000","last_unstale":"2024-09-15T22:41:27.701675+0000","last_undegraded":"2024-09-15T22:41:27.701675+0000","last_fullsized":"2024-09-15T22:41:27.701675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:27.717750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698233+0000","last_change":"2024-09-15T22:41:26.706857+0000","last_active":"2024-09-15T22:41:27.698233+0000","last_peered":"2024-09-15T22:41:27.698233+0000","last_clean":"2024-09-15T22:41:27.698233+0000","last_became_active":"2024-09-15T22:41:26.706264+0000","last_became_peered":"2024-09-15T22:41:26.706264+0000","last_unstale":"2024-09-15T22:41:27.698233+0000","last_undegraded":"2024-09-15T22:41:27.698233+0000","last_fullsized":"2024-09-15T22:41:27.698233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:21.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743113+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:41:28.743113+0000","last_peered":"2024-09-15T22:41:28.743113+0000","last_clean":"2024-09-15T22:41:28.743113+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:41:28.743113+0000","last_undegraded":"2024-09-15T22:41:28.743113+0000","last_fullsized":"2024-09-15T22:41:28.743113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697987+0000","last_change":"2024-09-15T22:41:25.701490+0000","last_active":"2024-09-15T22:41:27.697987+0000","last_peered":"2024-09-15T22:41:27.697987+0000","last_clean":"2024-09-15T22:41:27.697987+0000","last_became_active":"2024-09-15T22:41:25.701155+0000","last_became_peered":"2024-09-15T22:41:25.701155+0000","last_unstale":"2024-09-15T22:41:27.697987+0000","last_undegraded":"2024-09-15T22:41:27.697987+0000","last_fullsized":"2024-09-15T22:41:27.697987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:18.109760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702043+0000","last_change":"2024-09-15T22:41:26.698424+0000","last_active":"2024-09-15T22:41:27.702043+0000","last_peered":"2024-09-15T22:41:27.702043+0000","last_clean":"2024-09-15T22:41:27.702043+0000","last_became_active":"2024-09-15T22:41:26.697457+0000","last_became_peered":"2024-09-15T22:41:26.697457+0000","last_unstale":"2024-09-15T22:41:27.702043+0000","last_undegraded":"2024-09-15T22:41:27.702043+0000","last_fullsized":"2024-09-15T22:41:27.702043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:45.987437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697860+0000","last_change":"2024-09-15T22:41:25.704288+0000","last_active":"2024-09-15T22:41:27.697860+0000","last_peered":"2024-09-15T22:41:27.697860+0000","last_clean":"2024-09-15T22:41:27.697860+0000","last_became_active":"2024-09-15T22:41:25.704028+0000","last_became_peered":"2024-09-15T22:41:25.704028+0000","last_unstale":"2024-09-15T22:41:27.697860+0000","last_undegraded":"2024-09-15T22:41:27.697860+0000","last_fullsized":"2024-09-15T22:41:27.697860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:20.614195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701274+0000","last_change":"2024-09-15T22:41:26.697850+0000","last_active":"2024-09-15T22:41:27.701274+0000","last_peered":"2024-09-15T22:41:27.701274+0000","last_clean":"2024-09-15T22:41:27.701274+0000","last_became_active":"2024-09-15T22:41:26.697079+0000","last_became_peered":"2024-09-15T22:41:26.697079+0000","last_unstale":"2024-09-15T22:41:27.701274+0000","last_undegraded":"2024-09-15T22:41:27.701274+0000","last_fullsized":"2024-09-15T22:41:27.701274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:59.477248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743343+0000","last_change":"2024-09-15T22:41:25.703451+0000","last_active":"2024-09-15T22:41:28.743343+0000","last_peered":"2024-09-15T22:41:28.743343+0000","last_clean":"2024-09-15T22:41:28.743343+0000","last_became_active":"2024-09-15T22:41:25.703107+0000","last_became_peered":"2024-09-15T22:41:25.703107+0000","last_unstale":"2024-09-15T22:41:28.743343+0000","last_undegraded":"2024-09-15T22:41:28.743343+0000","last_fullsized":"2024-09-15T22:41:28.743343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:38.824712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743627+0000","last_change":"2024-09-15T22:41:26.704828+0000","last_active":"2024-09-15T22:41:28.743627+0000","last_peered":"2024-09-15T22:41:28.743627+0000","last_clean":"2024-09-15T22:41:28.743627+0000","last_became_active":"2024-09-15T22:41:26.704229+0000","last_became_peered":"2024-09-15T22:41:26.704229+0000","last_unstale":"2024-09-15T22:41:28.743627+0000","last_undegraded":"2024-09-15T22:41:28.743627+0000","last_fullsized":"2024-09-15T22:41:28.743627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:03.263576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698347+0000","last_change":"2024-09-15T22:41:25.700239+0000","last_active":"2024-09-15T22:41:27.698347+0000","last_peered":"2024-09-15T22:41:27.698347+0000","last_clean":"2024-09-15T22:41:27.698347+0000","last_became_active":"2024-09-15T22:41:25.699972+0000","last_became_peered":"2024-09-15T22:41:25.699972+0000","last_unstale":"2024-09-15T22:41:27.698347+0000","last_undegraded":"2024-09-15T22:41:27.698347+0000","last_fullsized":"2024-09-15T22:41:27.698347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:51.139105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993112+0000","last_change":"2024-09-15T22:41:26.707722+0000","last_active":"2024-09-15T22:41:27.993112+0000","last_peered":"2024-09-15T22:41:27.993112+0000","last_clean":"2024-09-15T22:41:27.993112+0000","last_became_active":"2024-09-15T22:41:26.706692+0000","last_became_peered":"2024-09-15T22:41:26.706692+0000","last_unstale":"2024-09-15T22:41:27.993112+0000","last_undegraded":"2024-09-15T22:41:27.993112+0000","last_fullsized":"2024-09-15T22:41:27.993112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:16.283183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743904+0000","last_change":"2024-09-15T22:41:25.699764+0000","last_active":"2024-09-15T22:41:28.743904+0000","last_peered":"2024-09-15T22:41:28.743904+0000","last_clean":"2024-09-15T22:41:28.743904+0000","last_became_active":"2024-09-15T22:41:25.699491+0000","last_became_peered":"2024-09-15T22:41:25.699491+0000","last_unstale":"2024-09-15T22:41:28.743904+0000","last_undegraded":"2024-09-15T22:41:28.743904+0000","last_fullsized":"2024-09-15T22:41:28.743904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743222+0000","last_change":"2024-09-15T22:41:26.700622+0000","last_active":"2024-09-15T22:41:28.743222+0000","last_peered":"2024-09-15T22:41:28.743222+0000","last_clean":"2024-09-15T22:41:28.743222+0000","last_became_active":"2024-09-15T22:41:26.700351+0000","last_became_peered":"2024-09-15T22:41:26.700351+0000","last_unstale":"2024-09-15T22:41:28.743222+0000","last_undegraded":"2024-09-15T22:41:28.743222+0000","last_fullsized":"2024-09-15T22:41:28.743222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:19.117451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698400+0000","last_change":"2024-09-15T22:41:25.705067+0000","last_active":"2024-09-15T22:41:27.698400+0000","last_peered":"2024-09-15T22:41:27.698400+0000","last_clean":"2024-09-15T22:41:27.698400+0000","last_became_active":"2024-09-15T22:41:25.704761+0000","last_became_peered":"2024-09-15T22:41:25.704761+0000","last_unstale":"2024-09-15T22:41:27.698400+0000","last_undegraded":"2024-09-15T22:41:27.698400+0000","last_fullsized":"2024-09-15T22:41:27.698400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701650+0000","last_change":"2024-09-15T22:41:26.698859+0000","last_active":"2024-09-15T22:41:27.701650+0000","last_peered":"2024-09-15T22:41:27.701650+0000","last_clean":"2024-09-15T22:41:27.701650+0000","last_became_active":"2024-09-15T22:41:26.698599+0000","last_became_peered":"2024-09-15T22:41:26.698599+0000","last_unstale":"2024-09-15T22:41:27.701650+0000","last_undegraded":"2024-09-15T22:41:27.701650+0000","last_fullsized":"2024-09-15T22:41:27.701650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:22.754810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702200+0000","last_change":"2024-09-15T22:41:25.701064+0000","last_active":"2024-09-15T22:41:27.702200+0000","last_peered":"2024-09-15T22:41:27.702200+0000","last_clean":"2024-09-15T22:41:27.702200+0000","last_became_active":"2024-09-15T22:41:25.700558+0000","last_became_peered":"2024-09-15T22:41:25.700558+0000","last_unstale":"2024-09-15T22:41:27.702200+0000","last_undegraded":"2024-09-15T22:41:27.702200+0000","last_fullsized":"2024-09-15T22:41:27.702200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702397+0000","last_change":"2024-09-15T22:41:26.700100+0000","last_active":"2024-09-15T22:41:27.702397+0000","last_peered":"2024-09-15T22:41:27.702397+0000","last_clean":"2024-09-15T22:41:27.702397+0000","last_became_active":"2024-09-15T22:41:26.699340+0000","last_became_peered":"2024-09-15T22:41:26.699340+0000","last_unstale":"2024-09-15T22:41:27.702397+0000","last_undegraded":"2024-09-15T22:41:27.702397+0000","last_fullsized":"2024-09-15T22:41:27.702397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.974453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698274+0000","last_change":"2024-09-15T22:41:25.709650+0000","last_active":"2024-09-15T22:41:27.698274+0000","last_peered":"2024-09-15T22:41:27.698274+0000","last_clean":"2024-09-15T22:41:27.698274+0000","last_became_active":"2024-09-15T22:41:25.709383+0000","last_became_peered":"2024-09-15T22:41:25.709383+0000","last_unstale":"2024-09-15T22:41:27.698274+0000","last_undegraded":"2024-09-15T22:41:27.698274+0000","last_fullsized":"2024-09-15T22:41:27.698274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:54.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701941+0000","last_change":"2024-09-15T22:41:26.702213+0000","last_active":"2024-09-15T22:41:27.701941+0000","last_peered":"2024-09-15T22:41:27.701941+0000","last_clean":"2024-09-15T22:41:27.701941+0000","last_became_active":"2024-09-15T22:41:26.701964+0000","last_became_peered":"2024-09-15T22:41:26.701964+0000","last_unstale":"2024-09-15T22:41:27.701941+0000","last_undegraded":"2024-09-15T22:41:27.701941+0000","last_fullsized":"2024-09-15T22:41:27.701941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:41.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.992836+0000","last_change":"2024-09-15T22:41:25.704181+0000","last_active":"2024-09-15T22:41:27.992836+0000","last_peered":"2024-09-15T22:41:27.992836+0000","last_clean":"2024-09-15T22:41:27.992836+0000","last_became_active":"2024-09-15T22:41:25.703924+0000","last_became_peered":"2024-09-15T22:41:25.703924+0000","last_unstale":"2024-09-15T22:41:27.992836+0000","last_undegraded":"2024-09-15T22:41:27.992836+0000","last_fullsized":"2024-09-15T22:41:27.992836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:22.200751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697762+0000","last_change":"2024-09-15T22:41:26.708970+0000","last_active":"2024-09-15T22:41:27.697762+0000","last_peered":"2024-09-15T22:41:27.697762+0000","last_clean":"2024-09-15T22:41:27.697762+0000","last_became_active":"2024-09-15T22:41:26.708421+0000","last_became_peered":"2024-09-15T22:41:26.708421+0000","last_unstale":"2024-09-15T22:41:27.697762+0000","last_undegraded":"2024-09-15T22:41:27.697762+0000","last_fullsized":"2024-09-15T22:41:27.697762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:47.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701850+0000","last_change":"2024-09-15T22:41:25.701927+0000","last_active":"2024-09-15T22:41:27.701850+0000","last_peered":"2024-09-15T22:41:27.701850+0000","last_clean":"2024-09-15T22:41:27.701850+0000","last_became_active":"2024-09-15T22:41:25.701470+0000","last_became_peered":"2024-09-15T22:41:25.701470+0000","last_unstale":"2024-09-15T22:41:27.701850+0000","last_undegraded":"2024-09-15T22:41:27.701850+0000","last_fullsized":"2024-09-15T22:41:27.701850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:55.528519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.700932+0000","last_change":"2024-09-15T22:41:26.704333+0000","last_active":"2024-09-15T22:41:27.700932+0000","last_peered":"2024-09-15T22:41:27.700932+0000","last_clean":"2024-09-15T22:41:27.700932+0000","last_became_active":"2024-09-15T22:41:26.704001+0000","last_became_peered":"2024-09-15T22:41:26.704001+0000","last_unstale":"2024-09-15T22:41:27.700932+0000","last_undegraded":"2024-09-15T22:41:27.700932+0000","last_fullsized":"2024-09-15T22:41:27.700932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:16.328494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.701465+0000","last_change":"2024-09-15T22:41:25.702682+0000","last_active":"2024-09-15T22:41:27.701465+0000","last_peered":"2024-09-15T22:41:27.701465+0000","last_clean":"2024-09-15T22:41:27.701465+0000","last_became_active":"2024-09-15T22:41:25.702368+0000","last_became_peered":"2024-09-15T22:41:25.702368+0000","last_unstale":"2024-09-15T22:41:27.701465+0000","last_undegraded":"2024-09-15T22:41:27.701465+0000","last_fullsized":"2024-09-15T22:41:27.701465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.825332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743470+0000","last_change":"2024-09-15T22:41:26.701366+0000","last_active":"2024-09-15T22:41:28.743470+0000","last_peered":"2024-09-15T22:41:28.743470+0000","last_clean":"2024-09-15T22:41:28.743470+0000","last_became_active":"2024-09-15T22:41:26.701105+0000","last_became_peered":"2024-09-15T22:41:26.701105+0000","last_unstale":"2024-09-15T22:41:28.743470+0000","last_undegraded":"2024-09-15T22:41:28.743470+0000","last_fullsized":"2024-09-15T22:41:28.743470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697909+0000","last_change":"2024-09-15T22:41:25.702993+0000","last_active":"2024-09-15T22:41:27.697909+0000","last_peered":"2024-09-15T22:41:27.697909+0000","last_clean":"2024-09-15T22:41:27.697909+0000","last_became_active":"2024-09-15T22:41:25.701924+0000","last_became_peered":"2024-09-15T22:41:25.701924+0000","last_unstale":"2024-09-15T22:41:27.697909+0000","last_undegraded":"2024-09-15T22:41:27.697909+0000","last_fullsized":"2024-09-15T22:41:27.697909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.697994+0000","last_change":"2024-09-15T22:41:26.707872+0000","last_active":"2024-09-15T22:41:27.697994+0000","last_peered":"2024-09-15T22:41:27.697994+0000","last_clean":"2024-09-15T22:41:27.697994+0000","last_became_active":"2024-09-15T22:41:26.707598+0000","last_became_peered":"2024-09-15T22:41:26.707598+0000","last_unstale":"2024-09-15T22:41:27.697994+0000","last_undegraded":"2024-09-15T22:41:27.697994+0000","last_fullsized":"2024-09-15T22:41:27.697994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:50.794398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.698210+0000","last_change":"2024-09-15T22:41:26.707659+0000","last_active":"2024-09-15T22:41:27.698210+0000","last_peered":"2024-09-15T22:41:27.698210+0000","last_clean":"2024-09-15T22:41:27.698210+0000","last_became_active":"2024-09-15T22:41:26.707159+0000","last_became_peered":"2024-09-15T22:41:26.707159+0000","last_unstale":"2024-09-15T22:41:27.698210+0000","last_undegraded":"2024-09-15T22:41:27.698210+0000","last_fullsized":"2024-09-15T22:41:27.698210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:24.277275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993467+0000","last_change":"2024-09-15T22:41:25.704494+0000","last_active":"2024-09-15T22:41:27.993467+0000","last_peered":"2024-09-15T22:41:27.993467+0000","last_clean":"2024-09-15T22:41:27.993467+0000","last_became_active":"2024-09-15T22:41:25.703087+0000","last_became_peered":"2024-09-15T22:41:25.703087+0000","last_unstale":"2024-09-15T22:41:27.993467+0000","last_undegraded":"2024-09-15T22:41:27.993467+0000","last_fullsized":"2024-09-15T22:41:27.993467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:29.702035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.743049+0000","last_change":"2024-09-15T22:41:26.710722+0000","last_active":"2024-09-15T22:41:28.743049+0000","last_peered":"2024-09-15T22:41:28.743049+0000","last_clean":"2024-09-15T22:41:28.743049+0000","last_became_active":"2024-09-15T22:41:26.709829+0000","last_became_peered":"2024-09-15T22:41:26.709829+0000","last_unstale":"2024-09-15T22:41:28.743049+0000","last_undegraded":"2024-09-15T22:41:28.743049+0000","last_fullsized":"2024-09-15T22:41:28.743049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:55.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.993304+0000","last_change":"2024-09-15T22:41:25.700877+0000","last_active":"2024-09-15T22:41:27.993304+0000","last_peered":"2024-09-15T22:41:27.993304+0000","last_clean":"2024-09-15T22:41:27.993304+0000","last_became_active":"2024-09-15T22:41:25.700613+0000","last_became_peered":"2024-09-15T22:41:25.700613+0000","last_unstale":"2024-09-15T22:41:27.993304+0000","last_undegraded":"2024-09-15T22:41:27.993304+0000","last_fullsized":"2024-09-15T22:41:27.993304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:58.154266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744150+0000","last_change":"2024-09-15T22:41:26.704494+0000","last_active":"2024-09-15T22:41:28.744150+0000","last_peered":"2024-09-15T22:41:28.744150+0000","last_clean":"2024-09-15T22:41:28.744150+0000","last_became_active":"2024-09-15T22:41:26.703887+0000","last_became_peered":"2024-09-15T22:41:26.703887+0000","last_unstale":"2024-09-15T22:41:28.744150+0000","last_undegraded":"2024-09-15T22:41:28.744150+0000","last_fullsized":"2024-09-15T22:41:28.744150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.959480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744057+0000","last_change":"2024-09-15T22:41:25.699536+0000","last_active":"2024-09-15T22:41:28.744057+0000","last_peered":"2024-09-15T22:41:28.744057+0000","last_clean":"2024-09-15T22:41:28.744057+0000","last_became_active":"2024-09-15T22:41:25.699129+0000","last_became_peered":"2024-09-15T22:41:25.699129+0000","last_unstale":"2024-09-15T22:41:28.744057+0000","last_undegraded":"2024-09-15T22:41:28.744057+0000","last_fullsized":"2024-09-15T22:41:28.744057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:28.744111+0000","last_change":"2024-09-15T22:41:26.706602+0000","last_active":"2024-09-15T22:41:28.744111+0000","last_peered":"2024-09-15T22:41:28.744111+0000","last_clean":"2024-09-15T22:41:28.744111+0000","last_became_active":"2024-09-15T22:41:26.706228+0000","last_became_peered":"2024-09-15T22:41:26.706228+0000","last_unstale":"2024-09-15T22:41:28.744111+0000","last_undegraded":"2024-09-15T22:41:28.744111+0000","last_fullsized":"2024-09-15T22:41:28.744111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:25.679081+0000","last_clean_scrub_stamp":"2024-09-15T22:41:25.679081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:17.247696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-15T22:41:27.702368+0000","last_change":"2024-09-15T22:41:25.701562+0000","last_active":"2024-09-15T22:41:27.702368+0000","last_peered":"2024-09-15T22:41:27.702368+0000","last_clean":"2024-09-15T22:41:27.702368+0000","last_became_active":"2024-09-15T22:41:25.700522+0000","last_became_peered":"2024-09-15T22:41:25.700522+0000","last_unstale":"2024-09-15T22:41:27.702368+0000","last_undegraded":"2024-09-15T22:41:27.702368+0000","last_fullsized":"2024-09-15T22:41:27.702368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:24.671390+0000","last_clean_scrub_stamp":"2024-09-15T22:41:24.671390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:03.216082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:41:38.576 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:41:38.577 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:41:38.577 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:41:38.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T22:41:38.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.709+0000 7f8ee6a1e640 1 Processor -- start 2024-09-15T22:41:38.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.709+0000 7f8ee6a1e640 1 -- start start 2024-09-15T22:41:38.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8ee015c300 0x7f8ee00affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ee00cd300 0x7f8ee006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee01622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee015ecf0 con 0x7f8ee00cd300 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee015c6e0 con 0x7f8ee015c300 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee6a1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee015efb0 con 0x7f8ee006f010 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ee00cd300 0x7f8ee006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ee00cd300 0x7f8ee006ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43550/0 (socket says 172.21.15.134:43550) 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 -- 172.21.15.134:0/3809488013 learned_addr learned my addr 172.21.15.134:0/3809488013 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8ee4fbb640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee01622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edffff640 1 --2- 172.21.15.134:0/3809488013 >> v2:172.21.15.177:3300/0 conn(0x7f8ee015c300 0x7f8ee00affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 -- 172.21.15.134:0/3809488013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 msgr2=0x7f8ee01622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee01622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 -- 172.21.15.134:0/3809488013 >> v2:172.21.15.177:3300/0 conn(0x7f8ee015c300 msgr2=0x7f8ee00affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 --2- 172.21.15.134:0/3809488013 >> v2:172.21.15.177:3300/0 conn(0x7f8ee015c300 0x7f8ee00affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.710+0000 7f8edf7fe640 1 -- 172.21.15.134:0/3809488013 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee015f290 con 0x7f8ee00cd300 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.711+0000 7f8edf7fe640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee00cd300 0x7f8ee006ead0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0069490 tx=0x7f8ed402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449f37314f6cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.711+0000 7f8edeffd640 1 -- 172.21.15.134:0/3809488013 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4037070 con 0x7f8ee00cd300 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.711+0000 7f8edeffd640 1 -- 172.21.15.134:0/3809488013 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed4032440 con 0x7f8ee00cd300 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.711+0000 7f8edeffd640 1 -- 172.21.15.134:0/3809488013 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4032810 con 0x7f8ee00cd300 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/3809488013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee00cd300 msgr2=0x7f8ee006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee00cd300 0x7f8ee006ead0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0069490 tx=0x7f8ed402a140 comp rx=0 tx=0).stop 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/3809488013 shutdown_connections 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee01622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/3809488013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee00cd300 0x7f8ee006ead0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/3809488013 >> v2:172.21.15.177:3300/0 conn(0x7f8ee015c300 0x7f8ee00affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/3809488013 >> 172.21.15.134:0/3809488013 conn(0x7f8ee006cae0 msgr2=0x7f8ee006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/3809488013 shutdown_connections 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.712+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/3809488013 wait complete. 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.713+0000 7f8ee6a1e640 1 Processor -- start 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.713+0000 7f8ee6a1e640 1 -- start start 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ee00cd300 0x7f8ee01499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0071880 con 0x7f8ee015c300 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee015f850 con 0x7f8ee00cd300 2024-09-15T22:41:38.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee6a1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee00b0500 con 0x7f8ee006f010 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43558/0 (socket says 172.21.15.134:43558) 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 -- 172.21.15.134:0/2516302523 learned_addr learned my addr 172.21.15.134:0/2516302523 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8edffff640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8edf7fe640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ee00cd300 0x7f8ee01499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 -- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 msgr2=0x7f8ee0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 -- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ee00cd300 msgr2=0x7f8ee01499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ee00cd300 0x7f8ee01499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 -- 172.21.15.134:0/2516302523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee014a7f0 con 0x7f8ee015c300 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8ee4fbb640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800cb80 tx=0x7f8ed800a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.714+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8015070 con 0x7f8ee015c300 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.715+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed800abd0 con 0x7f8ee015c300 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.715+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee014aad0 con 0x7f8ee015c300 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.715+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800d040 con 0x7f8ee015c300 2024-09-15T22:41:38.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.715+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee015fea0 con 0x7f8ee015c300 2024-09-15T22:41:38.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.716+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee006ead0 con 0x7f8ee015c300 2024-09-15T22:41:38.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.716+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ed8018070 con 0x7f8ee015c300 2024-09-15T22:41:38.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.717+0000 7f8edcff9640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 0x7f8ecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.717+0000 7f8edffff640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 0x7f8ecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.717+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8ed808af40 con 0x7f8ee015c300 2024-09-15T22:41:38.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.717+0000 7f8edffff640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 0x7f8ecc06e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000aac0 tx=0x7f8ed0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.721+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ed80590f0 con 0x7f8ee015c300 2024-09-15T22:41:38.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.925+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ee00b62a0 con 0x7f8ee015c300 2024-09-15T22:41:38.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.925+0000 7f8edcff9640 1 -- 172.21.15.134:0/2516302523 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8ed805d3f0 con 0x7f8ee015c300 2024-09-15T22:41:38.927 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:38.928 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:41:38.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 msgr2=0x7f8ecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 0x7f8ecc06e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000aac0 tx=0x7f8ed0008040 comp rx=0 tx=0).stop 2024-09-15T22:41:38.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 msgr2=0x7f8ee014a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800cb80 tx=0x7f8ed800a4c0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 shutdown_connections 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8ecc06c2b0 0x7f8ecc06e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee015c300 0x7f8ee014a080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ee00cd300 0x7f8ee01499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 --2- 172.21.15.134:0/2516302523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ee006f010 0x7f8ee0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 >> 172.21.15.134:0/2516302523 conn(0x7f8ee006cae0 msgr2=0x7f8ee0074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 shutdown_connections 2024-09-15T22:41:38.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:38.927+0000 7f8ee6a1e640 1 -- 172.21.15.134:0/2516302523 wait complete. 2024-09-15T22:41:38.939 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:41:38.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.036+0000 7fe651591640 1 Processor -- start 2024-09-15T22:41:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.036+0000 7fe651591640 1 -- start start 2024-09-15T22:41:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe651591640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe64c15e940 0x7fe64c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe651591640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe651591640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0b7170 con 0x7fe64c0cef90 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe651591640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c0d1ae0 con 0x7fe64c15e940 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe651591640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c0b7aa0 con 0x7fe64c15ed20 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe64c15e940 0x7fe64c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe64c15e940 0x7fe64c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43564/0 (socket says 172.21.15.134:43564) 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 -- 172.21.15.134:0/2370819148 learned_addr learned my addr 172.21.15.134:0/2370819148 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64b7fe640 1 --1- 172.21.15.134:0/2370819148 >> v1:172.21.15.134:6789/0 conn(0x7fe64c0cef90 0x7fe64c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55996/0 (socket says 172.21.15.134:55996) 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64a7fc640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 -- 172.21.15.134:0/2370819148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 msgr2=0x7fe64c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 -- 172.21.15.134:0/2370819148 >> v1:172.21.15.134:6789/0 conn(0x7fe64c0cef90 legacy=0x7fe64c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe64affd640 1 -- 172.21.15.134:0/2370819148 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c0d3660 con 0x7fe64c15e940 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.037+0000 7fe649ffb640 1 -- 172.21.15.134:0/2370819148 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324592673 0 0) 0x7fe644001490 con 0x7fe64c0cef90 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe64affd640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c15e940 0x7fe64c0d1060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009870 tx=0x7fe63c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8d6f3dcad0382 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe649ffb640 1 -- 172.21.15.134:0/2370819148 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c037070 con 0x7fe64c15e940 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe649ffb640 1 -- 172.21.15.134:0/2370819148 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c02ae50 con 0x7fe64c15e940 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe649ffb640 1 -- 172.21.15.134:0/2370819148 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c032860 con 0x7fe64c15e940 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe651591640 1 -- 172.21.15.134:0/2370819148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c15e940 msgr2=0x7fe64c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.038+0000 7fe651591640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c15e940 0x7fe64c0d1060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009870 tx=0x7fe63c02a300 comp rx=0 tx=0).stop 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 -- 172.21.15.134:0/2370819148 shutdown_connections 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 --2- 172.21.15.134:0/2370819148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c15e940 0x7fe64c0d1060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 -- 172.21.15.134:0/2370819148 >> 172.21.15.134:0/2370819148 conn(0x7fe64c0b6240 msgr2=0x7fe64c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 -- 172.21.15.134:0/2370819148 shutdown_connections 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.039+0000 7fe651591640 1 -- 172.21.15.134:0/2370819148 wait complete. 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.040+0000 7fe651591640 1 Processor -- start 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.040+0000 7fe651591640 1 -- start start 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe64c15e940 0x7fe64c1e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0d3f00 con 0x7fe64c0cef90 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0d3c20 con 0x7fe64c15e940 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c0d3310 con 0x7fe64c15ed20 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43568/0 (socket says 172.21.15.134:43568) 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 -- 172.21.15.134:0/4083347627 learned_addr learned my addr 172.21.15.134:0/4083347627 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64b7fe640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64a7fc640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe64c15e940 0x7fe64c1e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 -- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 msgr2=0x7fe64c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 -- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe64c15e940 msgr2=0x7fe64c1e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe64c15e940 0x7fe64c1e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 -- 172.21.15.134:0/4083347627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c155dd0 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe64affd640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0090b0 tx=0x7fe63c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c037040 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c004230 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c1e7a40 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c032e20 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.041+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c1e8000 con 0x7fe64c0cef90 2024-09-15T22:41:39.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.042+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c0d1ef0 con 0x7fe64c0cef90 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.043+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe63c03a070 con 0x7fe64c0cef90 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.043+0000 7fe6337fe640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 0x7fe63806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.043+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe63c0ab9d0 con 0x7fe64c0cef90 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.043+0000 7fe64a7fc640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 0x7fe63806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.044+0000 7fe64a7fc640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 0x7fe63806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0ceb10 tx=0x7fe640008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.048+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe63c041020 con 0x7fe64c0cef90 2024-09-15T22:41:39.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.246+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe64c0ba6b0 con 0x7fe64c0cef90 2024-09-15T22:41:39.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.247+0000 7fe6337fe640 1 -- 172.21.15.134:0/4083347627 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fe63c07a2f0 con 0x7fe64c0cef90 2024-09-15T22:41:39.249 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:39.249 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:39.249 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 msgr2=0x7fe63806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 0x7fe63806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0ceb10 tx=0x7fe640008040 comp rx=0 tx=0).stop 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 msgr2=0x7fe64c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0090b0 tx=0x7fe63c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 shutdown_connections 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe63806c2b0 0x7fe63806e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe64c15ed20 0x7fe64c0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe64c15e940 0x7fe64c1e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 --2- 172.21.15.134:0/4083347627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0cef90 0x7fe64c155890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 >> 172.21.15.134:0/4083347627 conn(0x7fe64c0b6240 msgr2=0x7fe64c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 shutdown_connections 2024-09-15T22:41:39.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.249+0000 7fe651591640 1 -- 172.21.15.134:0/4083347627 wait complete. 2024-09-15T22:41:39.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:39.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.359+0000 7fa5c400a640 1 Processor -- start 2024-09-15T22:41:39.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.359+0000 7fa5c400a640 1 -- start start 2024-09-15T22:41:39.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c400a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5bc06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c400a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc06d660 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c400a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc0741c0 con 0x7fa5bc0b5600 2024-09-15T22:41:39.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c400a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc06e680 con 0x7fa5bc06ccb0 2024-09-15T22:41:39.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c1da6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa5bc15e7b0 0x7fa5bc071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56002/0 (socket says 172.21.15.134:56002) 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c1da6640 1 -- 172.21.15.134:0/2971161121 learned_addr learned my addr 172.21.15.134:0/2971161121 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463336128 0 0) 0x7fa5bc06d660 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5a8003520 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.360+0000 7fa5c25a7640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5bc06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 725608186 0 0) 0x7fa5a8003520 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 msgr2=0x7fa5bc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5bc06d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 >> v1:172.21.15.177:6789/0 conn(0x7fa5bc0b5600 legacy=0x7fa5bc073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc06e8d0 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa5b80019f0 con 0x7fa5bc15e7b0 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 >> v1:172.21.15.134:6789/0 conn(0x7fa5bc15e7b0 legacy=0x7fa5bc071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5a8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc06e680 con 0x7fa5a8003f80 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a800bb80 con 0x7fa5a8004d40 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a800bd80 con 0x7fa5bc06ccb0 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c1da6640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5a8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c25a7640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 -- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 msgr2=0x7fa5a8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc06ccb0 0x7fa5a8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 -- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5a8004d40 msgr2=0x7fa5a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.361+0000 7fa5c15a5640 1 -- 172.21.15.134:0/2971161121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a8003520 con 0x7fa5a8003f80 2024-09-15T22:41:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.362+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5a8004800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001720 tx=0x7fa5a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f2a86b46572adb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.362+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac001370 con 0x7fa5a8003f80 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.362+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0052d0 con 0x7fa5a8003f80 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.362+0000 7fa5c0da4640 1 -- 172.21.15.134:0/2971161121 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac02abc0 con 0x7fa5a8003f80 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 -- 172.21.15.134:0/2971161121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 msgr2=0x7fa5a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 --2- 172.21.15.134:0/2971161121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5a8004800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001720 tx=0x7fa5a8005830 comp rx=0 tx=0).stop 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c25a7640 1 -- 172.21.15.134:0/2971161121 reap_dead start 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 -- 172.21.15.134:0/2971161121 shutdown_connections 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 -- 172.21.15.134:0/2971161121 >> 172.21.15.134:0/2971161121 conn(0x7fa5bc0b4300 msgr2=0x7fa5bc0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 -- 172.21.15.134:0/2971161121 shutdown_connections 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.363+0000 7fa5c400a640 1 -- 172.21.15.134:0/2971161121 wait complete. 2024-09-15T22:41:39.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.364+0000 7fa5c400a640 1 Processor -- start 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.364+0000 7fa5c400a640 1 -- start start 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc149f60 0x7fa5bc159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc14a3c0 0x7fa5bc15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc073590 con 0x7fa5a8003f80 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc0732b0 con 0x7fa5bc149f60 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc06d120 con 0x7fa5bc14a3c0 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43590/0 (socket says 172.21.15.134:43590) 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 -- 172.21.15.134:0/1798139286 learned_addr learned my addr 172.21.15.134:0/1798139286 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc149f60 0x7fa5bc159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c25a7640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc14a3c0 0x7fa5bc15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 -- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc14a3c0 msgr2=0x7fa5bc15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc14a3c0 0x7fa5bc15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 -- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc149f60 msgr2=0x7fa5bc159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc149f60 0x7fa5bc159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 -- 172.21.15.134:0/1798139286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc0cf610 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c1da6640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80079a0 tx=0x7fa5b800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80079d0 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8018070 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc0cf8f0 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8013630 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.365+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc0cfeb0 con 0x7fa5a8003f80 2024-09-15T22:41:39.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.366+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5bc06d500 con 0x7fa5a8003f80 2024-09-15T22:41:39.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.367+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5b80139e0 con 0x7fa5a8003f80 2024-09-15T22:41:39.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.367+0000 7fa5b27fc640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 0x7fa5a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.367+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 0x7fa5a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.367+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa5b808bda0 con 0x7fa5a8003f80 2024-09-15T22:41:39.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.368+0000 7fa5c15a5640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 0x7fa5a006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac032000 tx=0x7fa5ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.371+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5b805a5a0 con 0x7fa5a8003f80 2024-09-15T22:41:39.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.572+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5bc0b1a90 con 0x7fa5a8003f80 2024-09-15T22:41:39.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.572+0000 7fa5b27fc640 1 -- 172.21.15.134:0/1798139286 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fa5b8059ea0 con 0x7fa5a8003f80 2024-09-15T22:41:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:39.574 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:39.574 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:39.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 msgr2=0x7fa5a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 0x7fa5a006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac032000 tx=0x7fa5ac02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 msgr2=0x7fa5bc0d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80079a0 tx=0x7fa5b800a730 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 shutdown_connections 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5a006c2b0 0x7fa5a006e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc14a3c0 0x7fa5bc15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc149f60 0x7fa5bc159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 --2- 172.21.15.134:0/1798139286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5a8003f80 0x7fa5bc0d06b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 >> 172.21.15.134:0/1798139286 conn(0x7fa5bc0b4300 msgr2=0x7fa5bc06d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 shutdown_connections 2024-09-15T22:41:39.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.574+0000 7fa5c400a640 1 -- 172.21.15.134:0/1798139286 wait complete. 2024-09-15T22:41:39.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:39.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.684+0000 7fea665f8640 1 Processor -- start 2024-09-15T22:41:39.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.684+0000 7fea665f8640 1 -- start start 2024-09-15T22:41:39.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea665f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea665f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea600b66e0 0x7fea600b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea665f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6015c9c0 con 0x7fea600b6d50 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea665f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fea60074100 con 0x7fea600b66e0 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea665f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fea600b76d0 con 0x7fea6015c5e0 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea600b66e0 0x7fea600b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea600b66e0 0x7fea600b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43600/0 (socket says 172.21.15.134:43600) 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 -- 172.21.15.134:0/3959985189 learned_addr learned my addr 172.21.15.134:0/3959985189 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 -- 172.21.15.134:0/3959985189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 msgr2=0x7fea600712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 --2- 172.21.15.134:0/3959985189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 -- 172.21.15.134:0/3959985189 >> v1:172.21.15.177:6789/0 conn(0x7fea600b6d50 legacy=0x7fea601600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.685+0000 7fea64b95640 1 -- 172.21.15.134:0/3959985189 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea600b1dd0 con 0x7fea600b66e0 2024-09-15T22:41:39.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea64b95640 1 --2- 172.21.15.134:0/3959985189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea600b7190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea58009e50 tx=0x7fea5802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd38857a9ea85c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea5effd640 1 -- 172.21.15.134:0/3959985189 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58036070 con 0x7fea600b66e0 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea5effd640 1 -- 172.21.15.134:0/3959985189 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea58031600 con 0x7fea600b66e0 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea5effd640 1 -- 172.21.15.134:0/3959985189 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea580319d0 con 0x7fea600b66e0 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 -- 172.21.15.134:0/3959985189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 msgr2=0x7fea600b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 --2- 172.21.15.134:0/3959985189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea600b7190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea58009e50 tx=0x7fea5802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 -- 172.21.15.134:0/3959985189 shutdown_connections 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 --2- 172.21.15.134:0/3959985189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea600b7190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 --2- 172.21.15.134:0/3959985189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 -- 172.21.15.134:0/3959985189 >> 172.21.15.134:0/3959985189 conn(0x7fea600b4220 msgr2=0x7fea600b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 -- 172.21.15.134:0/3959985189 shutdown_connections 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.686+0000 7fea665f8640 1 -- 172.21.15.134:0/3959985189 wait complete. 2024-09-15T22:41:39.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.687+0000 7fea665f8640 1 Processor -- start 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 -- start start 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea600b6d50 0x7fea601512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea60073ab0 con 0x7fea600b66e0 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fea600737d0 con 0x7fea600b6d50 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.688+0000 7fea665f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fea60073d90 con 0x7fea6015c5e0 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43606/0 (socket says 172.21.15.134:43606) 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 -- 172.21.15.134:0/2910030586 learned_addr learned my addr 172.21.15.134:0/2910030586 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5f7fe640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea600b6d50 0x7fea601512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea64b95640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 -- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 msgr2=0x7fea600b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 -- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea600b6d50 msgr2=0x7fea601512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea600b6d50 0x7fea601512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 -- 172.21.15.134:0/2910030586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea60150230 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5ffff640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea5000b410 tx=0x7fea5000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50015020 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea50011850 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea60150510 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50011c40 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.689+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea60150ad0 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.690+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea600b1b30 con 0x7fea600b66e0 2024-09-15T22:41:39.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.690+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea50018020 con 0x7fea600b66e0 2024-09-15T22:41:39.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.691+0000 7fea5cff9640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 0x7fea4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.691+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea5008b400 con 0x7fea600b66e0 2024-09-15T22:41:39.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.691+0000 7fea5f7fe640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 0x7fea4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.691+0000 7fea5f7fe640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 0x7fea4c06e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea600ce770 tx=0x7fea54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.695+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea600b1b30 con 0x7fea600b66e0 2024-09-15T22:41:39.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.862+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea60073130 con 0x7fea600b66e0 2024-09-15T22:41:39.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.863+0000 7fea5cff9640 1 -- 172.21.15.134:0/2910030586 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7fea5001f020 con 0x7fea600b66e0 2024-09-15T22:41:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:39.864 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:39.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 msgr2=0x7fea4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 0x7fea4c06e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea600ce770 tx=0x7fea54009040 comp rx=0 tx=0).stop 2024-09-15T22:41:39.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 msgr2=0x7fea6014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea5000b410 tx=0x7fea5000b8d0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 shutdown_connections 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fea4c06c2b0 0x7fea4c06e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea6015c5e0 0x7fea600b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea600b6d50 0x7fea601512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 --2- 172.21.15.134:0/2910030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea600b66e0 0x7fea6014e200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 >> 172.21.15.134:0/2910030586 conn(0x7fea600b4220 msgr2=0x7fea6015ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 shutdown_connections 2024-09-15T22:41:39.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.865+0000 7fea665f8640 1 -- 172.21.15.134:0/2910030586 wait complete. 2024-09-15T22:41:39.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.974+0000 7fda03ec9640 1 Processor -- start 2024-09-15T22:41:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.974+0000 7fda03ec9640 1 -- start start 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda03ec9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd9fc0b4b70 0x7fd9fc0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda03ec9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd9fc15e8e0 0x7fd9fc0d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda03ec9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9fc074200 con 0x7fd9fc15e500 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda03ec9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc0b6e80 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda03ec9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc0b7160 con 0x7fd9fc15e8e0 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01c65640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd9fc15e500 0x7fd9fc0b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56016/0 (socket says 172.21.15.134:56016) 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01c65640 1 -- 172.21.15.134:0/854512780 learned_addr learned my addr 172.21.15.134:0/854512780 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01464640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd9fc0b4b70 0x7fd9fc0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01464640 1 -- 172.21.15.134:0/854512780 >> v2:172.21.15.177:3300/0 conn(0x7fd9fc15e8e0 msgr2=0x7fd9fc0d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01464640 1 --2- 172.21.15.134:0/854512780 >> v2:172.21.15.177:3300/0 conn(0x7fd9fc15e8e0 0x7fd9fc0d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01464640 1 -- 172.21.15.134:0/854512780 >> v1:172.21.15.134:6789/0 conn(0x7fd9fc15e500 legacy=0x7fd9fc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda00c63640 1 -- 172.21.15.134:0/854512780 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081933196 0 0) 0x7fd9fc074200 con 0x7fd9fc15e500 2024-09-15T22:41:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.975+0000 7fda01464640 1 -- 172.21.15.134:0/854512780 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc0b7440 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.976+0000 7fda01464640 1 --2- 172.21.15.134:0/854512780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc0d2460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e1631972e01ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.976+0000 7fda00c63640 1 -- 172.21.15.134:0/854512780 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec037070 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.976+0000 7fda00c63640 1 -- 172.21.15.134:0/854512780 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ec02ae50 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.976+0000 7fda00c63640 1 -- 172.21.15.134:0/854512780 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec032660 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 -- 172.21.15.134:0/854512780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc0b4b70 msgr2=0x7fd9fc0d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 --2- 172.21.15.134:0/854512780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc0d2460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec02a140 comp rx=0 tx=0).stop 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 -- 172.21.15.134:0/854512780 shutdown_connections 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 --2- 172.21.15.134:0/854512780 >> v2:172.21.15.177:3300/0 conn(0x7fd9fc15e8e0 0x7fd9fc0d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 --2- 172.21.15.134:0/854512780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc0d2460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 -- 172.21.15.134:0/854512780 >> 172.21.15.134:0/854512780 conn(0x7fd9fc062810 msgr2=0x7fd9fc062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:39.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 -- 172.21.15.134:0/854512780 shutdown_connections 2024-09-15T22:41:39.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.977+0000 7fda03ec9640 1 -- 172.21.15.134:0/854512780 wait complete. 2024-09-15T22:41:39.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.978+0000 7fda03ec9640 1 Processor -- start 2024-09-15T22:41:39.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.978+0000 7fda03ec9640 1 -- start start 2024-09-15T22:41:39.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc1e8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 0x7fd9fc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc06ce30 con 0x7fd9fc15e500 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc06ccb0 con 0x7fd9fc0b4b70 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc073cb0 con 0x7fd9fc15e8e0 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43636/0 (socket says 172.21.15.134:43636) 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 -- 172.21.15.134:0/4118963007 learned_addr learned my addr 172.21.15.134:0/4118963007 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01c65640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc1e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda02466640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 0x7fd9fc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 -- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 msgr2=0x7fd9fc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 0x7fd9fc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 -- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9fc0b4b70 msgr2=0x7fd9fc1e8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc1e8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 -- 172.21.15.134:0/4118963007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc1e8af0 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda02466640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 0x7fd9fc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda01464640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec042070 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ec03e670 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc1525c0 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.979+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec037040 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.980+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc1e87a0 con 0x7fd9fc15e500 2024-09-15T22:41:39.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.980+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc0d1cf0 con 0x7fd9fc15e500 2024-09-15T22:41:39.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.981+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd9ec045070 con 0x7fd9fc15e500 2024-09-15T22:41:39.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.981+0000 7fd9f27fc640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 0x7fd9e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:39.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.981+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd9ec0aba90 con 0x7fd9fc15e500 2024-09-15T22:41:39.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.982+0000 7fda01c65640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 0x7fd9e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:39.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.982+0000 7fda01c65640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 0x7fd9e006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8000f60 tx=0x7fd9f8007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:39.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:39.986+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9ec07a200 con 0x7fd9fc15e500 2024-09-15T22:41:40.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.183+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9fc069160 con 0x7fd9fc15e500 2024-09-15T22:41:40.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.184+0000 7fd9f27fc640 1 -- 172.21.15.134:0/4118963007 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fd9ec079b00 con 0x7fd9fc15e500 2024-09-15T22:41:40.185 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:40.185 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:40.186 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:40.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 msgr2=0x7fd9e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 0x7fd9e006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8000f60 tx=0x7fd9f8007b70 comp rx=0 tx=0).stop 2024-09-15T22:41:40.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 msgr2=0x7fd9fc14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec0046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 shutdown_connections 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e006c2b0 0x7fd9e006e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9fc15e8e0 0x7fd9fc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9fc15e500 0x7fd9fc14f4a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 --2- 172.21.15.134:0/4118963007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9fc0b4b70 0x7fd9fc1e8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 >> 172.21.15.134:0/4118963007 conn(0x7fd9fc062810 msgr2=0x7fd9fc151590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 shutdown_connections 2024-09-15T22:41:40.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.186+0000 7fda03ec9640 1 -- 172.21.15.134:0/4118963007 wait complete. 2024-09-15T22:41:40.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:41:26.022625+0000', 'modified': '2024-09-15T22:41:28.026546+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/1771891380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 1771891380}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 1771891380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-09-15T22:41:40.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:41:40.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T22:41:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.699+0000 7fd44085a640 1 Processor -- start 2024-09-15T22:41:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.699+0000 7fd44085a640 1 -- start start 2024-09-15T22:41:40.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd44085a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd43c140a40 0x7fd43c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd44085a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 0x7fd43c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd44085a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c0b4ee0 con 0x7fd43c0720c0 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd44085a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd43c0b5780 con 0x7fd43c140a40 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd44085a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c13ef30 con 0x7fd43c13eaf0 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd43c140a40 0x7fd43c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 0x7fd43c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd43c140a40 0x7fd43c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53932/0 (socket says 172.21.15.134:53932) 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 -- 172.21.15.134:0/3020470757 learned_addr learned my addr 172.21.15.134:0/3020470757 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43ad9d640 1 --1- 172.21.15.134:0/3020470757 >> v1:172.21.15.177:6789/0 conn(0x7fd43c0720c0 0x7fd43c0b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:50962/0 (socket says 172.21.15.134:50962) 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 -- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 msgr2=0x7fd43c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 0x7fd43c0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 -- 172.21.15.134:0/3020470757 >> v1:172.21.15.177:6789/0 conn(0x7fd43c0720c0 legacy=0x7fd43c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd43a59c640 1 -- 172.21.15.134:0/3020470757 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c0b51c0 con 0x7fd43c140a40 2024-09-15T22:41:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd439d9b640 1 -- 172.21.15.134:0/3020470757 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250662730 0 0) 0x7fd43c0b4ee0 con 0x7fd43c0720c0 2024-09-15T22:41:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.700+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 0x7fd43c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.701+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c15c480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=585f07312c27ca0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.701+0000 7fd439d9b640 1 -- 172.21.15.134:0/3020470757 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c037070 con 0x7fd43c140a40 2024-09-15T22:41:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.701+0000 7fd439d9b640 1 -- 172.21.15.134:0/3020470757 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c032440 con 0x7fd43c140a40 2024-09-15T22:41:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.701+0000 7fd439d9b640 1 -- 172.21.15.134:0/3020470757 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c032810 con 0x7fd43c140a40 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 -- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 msgr2=0x7fd43c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c15c480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 -- 172.21.15.134:0/3020470757 shutdown_connections 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c13eaf0 0x7fd43c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 --2- 172.21.15.134:0/3020470757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c15c480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 -- 172.21.15.134:0/3020470757 >> 172.21.15.134:0/3020470757 conn(0x7fd43c062a80 msgr2=0x7fd43c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 -- 172.21.15.134:0/3020470757 shutdown_connections 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.702+0000 7fd44085a640 1 -- 172.21.15.134:0/3020470757 wait complete. 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.703+0000 7fd44085a640 1 Processor -- start 2024-09-15T22:41:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.703+0000 7fd44085a640 1 -- start start 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c0720c0 0x7fd43c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c13d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c140e20 con 0x7fd43c13eaf0 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0b5ad0 con 0x7fd43c140a40 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd44085a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c072530 con 0x7fd43c0720c0 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43646/0 (socket says 172.21.15.134:43646) 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 -- 172.21.15.134:0/2029772349 learned_addr learned my addr 172.21.15.134:0/2029772349 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c13d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd43a59c640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c0720c0 0x7fd43c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 -- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c0720c0 msgr2=0x7fd43c1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c0720c0 0x7fd43c1f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 -- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 msgr2=0x7fd43c13d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c13d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 -- 172.21.15.134:0/2029772349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c142b80 con 0x7fd43c13eaf0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.704+0000 7fd431d9b640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42400ebe0 tx=0x7fd42400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.705+0000 7fd4337fe640 1 -- 172.21.15.134:0/2029772349 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424017070 con 0x7fd43c13eaf0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.705+0000 7fd4337fe640 1 -- 172.21.15.134:0/2029772349 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42400cc30 con 0x7fd43c13eaf0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.705+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c142e60 con 0x7fd43c13eaf0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.705+0000 7fd4337fe640 1 -- 172.21.15.134:0/2029772349 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424013470 con 0x7fd43c13eaf0 2024-09-15T22:41:40.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.705+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c143420 con 0x7fd43c13eaf0 2024-09-15T22:41:40.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.706+0000 7fd4337fe640 1 -- 172.21.15.134:0/2029772349 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd42401a070 con 0x7fd43c13eaf0 2024-09-15T22:41:40.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.706+0000 7fd4337fe640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 0x7fd41c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.707+0000 7fd4337fe640 1 -- 172.21.15.134:0/2029772349 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd42408b660 con 0x7fd43c13eaf0 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.707+0000 7fd43a59c640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 0x7fd41c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.707+0000 7fd43a59c640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 0x7fd41c06e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd42c034000 tx=0x7fd42c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 Processor -- start 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 -- start start 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1dbb6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db6ee90 0x55ec1db71ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec1dacf520 con 0x55ec1db72e60 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ec1da773e0 con 0x55ec1db6ee90 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.708+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55ec1dacb4e0 con 0x55ec1db716d0 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43660/0 (socket says 172.21.15.134:43660) 2024-09-15T22:41:40.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 -- 172.21.15.134:0/2049455478 learned_addr learned my addr 172.21.15.134:0/2049455478 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43a59c640 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1dbb6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd431d9b640 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db6ee90 0x55ec1db71ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 -- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 msgr2=0x55ec1dbb6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1dbb6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 -- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db6ee90 msgr2=0x55ec1db71ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db6ee90 0x55ec1db71ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 -- 172.21.15.134:0/2049455478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec1da922f0 con 0x55ec1db72e60 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd434001c90 tx=0x7fd434002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8b584cb89999c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd41bfff640 1 -- 172.21.15.134:0/2049455478 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434007890 con 0x55ec1db72e60 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd41bfff640 1 -- 172.21.15.134:0/2049455478 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4340133f0 con 0x55ec1db72e60 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.709+0000 7fd41bfff640 1 -- 172.21.15.134:0/2049455478 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340135e0 con 0x55ec1db72e60 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- 172.21.15.134:0/2049455478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 msgr2=0x55ec1db6bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd434001c90 tx=0x7fd434002150 comp rx=0 tx=0).stop 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- 172.21.15.134:0/2049455478 shutdown_connections 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bcc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db6ee90 0x55ec1db71ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 --2- 172.21.15.134:0/2049455478 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1dbb6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- 172.21.15.134:0/2049455478 >> 172.21.15.134:0/2049455478 conn(0x55ec1db6de90 msgr2=0x55ec1dbb6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- 172.21.15.134:0/2049455478 shutdown_connections 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- 172.21.15.134:0/2049455478 wait complete. 2024-09-15T22:41:40.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.710+0000 7fd4435f5740 1 -- start start 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 Processor -- start 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db94440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db94980 0x55ec1db91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec1db6d330 con 0x55ec1db72e60 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ec1da58450 con 0x55ec1db94980 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55ec1dbb76a0 con 0x55ec1db716d0 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.711+0000 7fd4435f5740 10 client.0 _ll_register_callbacks cb 0x55ec1d7e1ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43674/0 (socket says 172.21.15.134:43674) 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 -- 172.21.15.134:0/3102010067 learned_addr learned my addr 172.21.15.134:0/3102010067 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db94980 0x55ec1db91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db94440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 -- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 msgr2=0x55ec1db94440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db94440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 -- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db94980 msgr2=0x55ec1db91d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db94980 0x55ec1db91d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 -- 172.21.15.134:0/3102010067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec1d7e22d0 con 0x55ec1db72e60 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd42400ebb0 tx=0x7fd4240590e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9879a6f3d39b867a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424071030 con 0x55ec1db72e60 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd42406dd60 con 0x55ec1db72e60 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4340133f0 con 0x55ec1db72e60 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd424021040 con 0x55ec1db72e60 2024-09-15T22:41:40.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 10 client.4647 fetch_fsmap learned FSMap version 6 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55ec1d8ac6b0 con 0x55ec1db72e60 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4340133f0 con 0x55ec1db72e60 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fd424058bd0 con 0x55ec1db72e60 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 10 client.4647 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.712+0000 7fd4435f5740 20 client.4647 populate_metadata read hostname 'smithi134' 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbd1980 0x55ec1dbd3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd4435f5740 4 client.4647 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 --> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec1dadcc50 con 0x55ec1dbd1980 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbd1980 0x55ec1dbd3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd4197fa640 10 client.4647 ms_handle_connect on v2:172.21.15.177:6834/1771891380 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.713+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbd1980 0x55ec1dbd3d70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a73fbe87f6f277e server_cookie=be847ee7df4037ad in_seq=0 out_seq=0 2024-09-15T22:41:40.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4197fa640 1 -- 172.21.15.134:0/3102010067 <== mds.0 v2:172.21.15.177:6834/1771891380 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec1dadcc50 con 0x55ec1dbd1980 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4197fa640 10 client.4647 handle_command_reply: tid=0 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 client.4647 shutdown 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 msgr2=0x55ec1db91850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd42400ebb0 tx=0x7fd4240590e0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 shutdown_connections 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbd1980 0x55ec1dbd3d70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db94980 0x55ec1db91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4197fa640 0 client.4647 ms_handle_reset on v2:172.21.15.177:6834/1771891380 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db91850 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3102010067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db94440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.714+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 >> 172.21.15.134:0/3102010067 conn(0x55ec1db6ee90 msgr2=0x55ec1dbb9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.715+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 shutdown_connections 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.715+0000 7fd4435f5740 1 -- 172.21.15.134:0/3102010067 wait complete. 2024-09-15T22:41:40.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.715+0000 7fd4435f5740 20 client.4647 trim_cache size 0 max 16384 2024-09-15T22:41:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.732+0000 7fd4435f5740 1 Processor -- start 2024-09-15T22:41:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.732+0000 7fd4435f5740 1 -- start start 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db716d0 0x55ec1db7f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db94980 0x55ec1db6c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c15b010 con 0x55ec1db72e60 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1e3f70 con 0x55ec1db716d0 2024-09-15T22:41:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c15a9c0 con 0x55ec1db94980 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43678/0 (socket says 172.21.15.134:43678) 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 -- 172.21.15.134:0/3423388886 learned_addr learned my addr 172.21.15.134:0/3423388886 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db94980 0x55ec1db6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd43a59c640 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db716d0 0x55ec1db7f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 -- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db94980 msgr2=0x55ec1db6c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db94980 0x55ec1db6c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 -- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db716d0 msgr2=0x55ec1db7f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db716d0 0x55ec1db7f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 -- 172.21.15.134:0/3423388886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec1db947b0 con 0x55ec1db72e60 2024-09-15T22:41:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.733+0000 7fd431d9b640 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd42406dfd0 tx=0x7fd42401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c590a99a22e474 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.735+0000 7fd41b7fe640 1 -- 172.21.15.134:0/3423388886 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424071040 con 0x55ec1db72e60 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.735+0000 7fd41b7fe640 1 -- 172.21.15.134:0/3423388886 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42406db60 con 0x55ec1db72e60 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.735+0000 7fd41b7fe640 1 -- 172.21.15.134:0/3423388886 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240554d0 con 0x55ec1db72e60 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- 172.21.15.134:0/3423388886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 msgr2=0x55ec1db6bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd42406dfd0 tx=0x7fd42401e000 comp rx=0 tx=0).stop 2024-09-15T22:41:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- 172.21.15.134:0/3423388886 shutdown_connections 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db94980 0x55ec1db6c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db72e60 0x55ec1db6bc10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 --2- 172.21.15.134:0/3423388886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db716d0 0x55ec1db7f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- 172.21.15.134:0/3423388886 >> 172.21.15.134:0/3423388886 conn(0x55ec1db6ee90 msgr2=0x55ec1dbb38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- 172.21.15.134:0/3423388886 shutdown_connections 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- 172.21.15.134:0/3423388886 wait complete. 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.736+0000 7fd4435f5740 1 -- start start 2024-09-15T22:41:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 Processor -- start 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db6c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db72e60 0x55ec1dc1a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec1db94dd0 con 0x55ec1db94980 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ec1db80c60 con 0x55ec1db72e60 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55ec1db7ff30 con 0x55ec1db716d0 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.737+0000 7fd4435f5740 10 client.0 _ll_register_callbacks cb 0x7fd424009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43692/0 (socket says 172.21.15.134:43692) 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 -- 172.21.15.134:0/4162059337 learned_addr learned my addr 172.21.15.134:0/4162059337 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43a59c640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db6c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd431d9b640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db72e60 0x55ec1dc1a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 -- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 msgr2=0x55ec1db6c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db6c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 -- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db72e60 msgr2=0x55ec1dc1a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db72e60 0x55ec1dc1a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 -- 172.21.15.134:0/4162059337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec1dc1ab30 con 0x55ec1db94980 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd43ad9d640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd434001c60 tx=0x7fd434007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64935ac77a0e0394 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:41:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43401d860 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd434018040 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd42406db60 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd43402f050 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4435f5740 10 client.4653 fetch_fsmap learned FSMap version 6 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55ec1dbc84e0 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.738+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42406db60 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fd434032020 con 0x55ec1db94980 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 10 client.4653 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 20 client.4653 populate_metadata read hostname 'smithi134' 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbb2e40 0x55ec1dc376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 4 client.4653 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 --> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] -- command(tid 0: {"prefix": "status"}) -- 0x55ec1dad6fa0 con 0x55ec1dbb2e40 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd43a59c640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbb2e40 0x55ec1dc376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4197fa640 10 client.4653 ms_handle_connect on v2:172.21.15.177:6834/1771891380 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd43a59c640 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbb2e40 0x55ec1dc376c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dbde42ee4a8b4ce server_cookie=4e3ee7edcedf2ba8 in_seq=0 out_seq=0 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4197fa640 1 -- 172.21.15.134:0/4162059337 <== mds.0 v2:172.21.15.177:6834/1771891380 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ec1dad6fa0 con 0x55ec1dbb2e40 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4197fa640 10 client.4653 handle_command_reply: tid=0 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 1 client.4653 shutdown 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 msgr2=0x55ec1dbc7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.739+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd434001c60 tx=0x7fd434007f90 comp rx=0 tx=0).stop 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 shutdown_connections 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:6834/1771891380,v1:172.21.15.177:6835/1771891380] conn(0x55ec1dbb2e40 0x55ec1dc376c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec1db94980 0x55ec1dbc7fa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ec1db72e60 0x55ec1dc1a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 --2- 172.21.15.134:0/4162059337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ec1db716d0 0x55ec1db6c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4197fa640 0 client.4653 ms_handle_reset on v2:172.21.15.177:6834/1771891380 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 >> 172.21.15.134:0/4162059337 conn(0x55ec1db6ee90 msgr2=0x55ec1dbb38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 shutdown_connections 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 1 -- 172.21.15.134:0/4162059337 wait complete. 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd4435f5740 20 client.4653 trim_cache size 0 max 16384 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4294, 2024-09-15T22:41:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 14.054775575000001, 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 6, 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 23, 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 23, 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 20.175040849999998 2024-09-15T22:41:40.749 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 msgr2=0x7fd41c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 0x7fd41c06e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd42c034000 tx=0x7fd42c02e000 comp rx=0 tx=0).stop 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 msgr2=0x7fd43c142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42400ebe0 tx=0x7fd42400c520 comp rx=0 tx=0).stop 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 shutdown_connections 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd41c06c2b0 0x7fd41c06e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43c140a40 0x7fd43c13d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43c13eaf0 0x7fd43c142400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 --2- 172.21.15.134:0/2029772349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd43c0720c0 0x7fd43c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:40.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 >> 172.21.15.134:0/2029772349 conn(0x7fd43c062a80 msgr2=0x7fd43c13f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:40.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 shutdown_connections 2024-09-15T22:41:40.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:40.740+0000 7fd44085a640 1 -- 172.21.15.134:0/2029772349 wait complete. 2024-09-15T22:41:40.752 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:41:40.769 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:41:40.769 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:41:40.770 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:41:40.770 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:41:40.798 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:41:40.798 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-15T22:41:40.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:40.798 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:41:40.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:40.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-15T22:41:40.881 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-15T22:41:40.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:40.882 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:41:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:40.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-15T22:41:41.005 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-15T22:41:41.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:41.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.007 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:41:41.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-09-15T22:41:41.098 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-09-15T22:41:41.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:41.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.101 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:41:41.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-09-15T22:41:41.227 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-09-15T22:41:41.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:41.229 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-15T22:41:41.229 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:41:41.229 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:41:41.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:41:41.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.325+0000 7f196d94b640 1 Processor -- start 2024-09-15T22:41:41.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 -- start start 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196806be10 0x7f19680cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f196806c1f0 0x7f196815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19680cd5f0 con 0x7f1968151540 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f19680cd8d0 con 0x7f196806c1f0 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f196d94b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19680cdbb0 con 0x7f196806be10 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.326+0000 7f195e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f196806c1f0 0x7f196815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f196806c1f0 0x7f196815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43702/0 (socket says 172.21.15.134:43702) 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 -- 172.21.15.134:0/3756760566 learned_addr learned my addr 172.21.15.134:0/3756760566 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f1966ffd640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196806be10 0x7f19680cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 -- 172.21.15.134:0/3756760566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196806be10 msgr2=0x7f19680cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196806be10 0x7f19680cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 -- 172.21.15.134:0/3756760566 >> v1:172.21.15.177:6789/0 conn(0x7f1968151540 legacy=0x7f196815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 -- 172.21.15.134:0/3756760566 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680cde90 con 0x7f196806c1f0 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.327+0000 7f195e7fc640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806c1f0 0x7f196815baa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f195000bb00 tx=0x7f195002c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0868d63c16e19f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f19667fc640 1 -- 172.21.15.134:0/3756760566 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195003a070 con 0x7f196806c1f0 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f19667fc640 1 -- 172.21.15.134:0/3756760566 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1950032480 con 0x7f196806c1f0 2024-09-15T22:41:41.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f19667fc640 1 -- 172.21.15.134:0/3756760566 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950032850 con 0x7f196806c1f0 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 -- 172.21.15.134:0/3756760566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806c1f0 msgr2=0x7f196815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806c1f0 0x7f196815baa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f195000bb00 tx=0x7f195002c6e0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 -- 172.21.15.134:0/3756760566 shutdown_connections 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806c1f0 0x7f196815baa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 --2- 172.21.15.134:0/3756760566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196806be10 0x7f19680cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 -- 172.21.15.134:0/3756760566 >> 172.21.15.134:0/3756760566 conn(0x7f1968062cc0 msgr2=0x7f196806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 -- 172.21.15.134:0/3756760566 shutdown_connections 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.328+0000 7f196d94b640 1 -- 172.21.15.134:0/3756760566 wait complete. 2024-09-15T22:41:41.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.329+0000 7f196d94b640 1 Processor -- start 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 -- start start 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196806c1f0 0x7f1968149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1968151540 0x7f1968070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19681519d0 con 0x7f196806be10 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19680ce690 con 0x7f196806c1f0 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f196d94b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1968151b50 con 0x7f1968151540 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f1966ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f1966ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43712/0 (socket says 172.21.15.134:43712) 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.330+0000 7f1966ffd640 1 -- 172.21.15.134:0/1176704126 learned_addr learned my addr 172.21.15.134:0/1176704126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f195e7fc640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196806c1f0 0x7f1968149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f19677fe640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1968151540 0x7f1968070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 -- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1968151540 msgr2=0x7f1968070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1968151540 0x7f1968070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 -- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196806c1f0 msgr2=0x7f1968149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196806c1f0 0x7f1968149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 -- 172.21.15.134:0/1176704126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680718b0 con 0x7f196806be10 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1966ffd640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f195800d800 tx=0x7f195800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195800b6c0 con 0x7f196806be10 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1958019070 con 0x7f196806be10 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195800ba80 con 0x7f196806be10 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1968071b90 con 0x7f196806be10 2024-09-15T22:41:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.331+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1968072150 con 0x7f196806be10 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.332+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19680cd010 con 0x7f196806be10 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.332+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f195800bc20 con 0x7f196806be10 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.333+0000 7f1964ff9640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 0x7f194806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.333+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f195808b7c0 con 0x7f196806be10 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.333+0000 7f195e7fc640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 0x7f194806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.333+0000 7f195e7fc640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 0x7f194806e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1950037000 tx=0x7f1950030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:41.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.337+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19580598e0 con 0x7f196806be10 2024-09-15T22:41:41.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.537+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f19680b1bd0 con 0x7f196806be10 2024-09-15T22:41:41.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.537+0000 7f1964ff9640 1 -- 172.21.15.134:0/1176704126 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f195805dbe0 con 0x7f196806be10 2024-09-15T22:41:41.539 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 msgr2=0x7f194806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 0x7f194806e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1950037000 tx=0x7f1950030000 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 msgr2=0x7f1968072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f195800d800 tx=0x7f195800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 shutdown_connections 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f194806c2b0 0x7f194806e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1968151540 0x7f1968070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196806c1f0 0x7f1968149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 --2- 172.21.15.134:0/1176704126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f196806be10 0x7f1968072950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 >> 172.21.15.134:0/1176704126 conn(0x7f1968062cc0 msgr2=0x7f196806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 shutdown_connections 2024-09-15T22:41:41.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41.539+0000 7f196d94b640 1 -- 172.21.15.134:0/1176704126 wait complete. 2024-09-15T22:41:41.552 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:41:41.552 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:41:41.552 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:41:41.552 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:41:41.552 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:41:41.553 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:41:41.553 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:41:41.553 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:41:41.553 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:41:41.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.553 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:41:41.568 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:41:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:41:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42792sec preferred_lft 42792sec 2024-09-15T22:41:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:41:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:41.570 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:41:41.572 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:41.572 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:41.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:41:41.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-09-15T22:41:41.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-09-15T22:41:41.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:41:41.573 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:41.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:41.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.783 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:41:41.808 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:41:41.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:41.810 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:41:41.885 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:41:41.885 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:41:41.885 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:41:41.885 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:41:41.885 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:41:41.886 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:41.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:42.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:42.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:42.164 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:41:42.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:42.180 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-09-15T22:41:42.235 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:42.235 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:42.236 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:41:42.236 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:41:42.236 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:42.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:42.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:42.354 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:41:42.355 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:42.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:42.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:42.479 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:42.479 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:42.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:41:42.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:41:42.479 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:42.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:42.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:42.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:42.557 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:41:42.572 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:41:42.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:42.572 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:41:42.627 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:41:42.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:42.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:41:42.723 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:41:42.724 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:41:42.724 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:42.857 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:41:42.857 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:41:42.857 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:42.857 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:42.857 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:42.863 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:41:42.863 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:41:42.863 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:41:42.864 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:41:42.865 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:41:42.865 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:41:42.865 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:41:42.865 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:41:42.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:41:42.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:42.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:41:42.891 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:42.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:42.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:42.992 INFO:teuthology.orchestra.run.smithi134.stdout:client4552 2024-09-15T22:41:42.992 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:42.992 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:43.008 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:43.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:43.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:43.109 INFO:teuthology.orchestra.run.smithi134.stdout:client4552 2024-09-15T22:41:43.109 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:43.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:43.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:43.170 INFO:teuthology.orchestra.run.smithi134.stdout:client4552 2024-09-15T22:41:43.171 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5af37fce-f477-417d-bd72-01ffdf727d70.client4552/status') 2024-09-15T22:41:43.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:43.235 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4552 (3)172.21.15.134:0/440580651 2024-09-15T22:41:43.235 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-09-15T22:41:43.235 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-09-15T22:41:43.235 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-09-15T22:41:43.236 INFO:teuthology.orchestra.run.smithi134.stderr:70 bytes copied, 3.8731e-05 s, 1.8 MB/s 2024-09-15T22:41:43.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:43.242 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-15T22:41:43.243 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:41:43.243 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:41:43.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:41:43.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 Processor -- start 2024-09-15T22:41:43.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 -- start start 2024-09-15T22:41:43.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb7815c250 0x7feb7815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:43.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7815fbf0 con 0x7feb780b6a20 2024-09-15T22:41:43.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7806ea10 con 0x7feb7806e570 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.339+0000 7feb7e92c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7feb780b7870 con 0x7feb7815c250 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb77fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb7815c250 0x7feb7815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb7cec9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7feb780b6a20 0x7feb780b6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56032/0 (socket says 172.21.15.134:56032) 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb7cec9640 1 -- 172.21.15.134:0/4012405220 learned_addr learned my addr 172.21.15.134:0/4012405220 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb77fff640 1 -- 172.21.15.134:0/4012405220 >> v1:172.21.15.177:6789/0 conn(0x7feb7806e570 legacy=0x7feb780712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb77fff640 1 -- 172.21.15.134:0/4012405220 >> v1:172.21.15.134:6789/0 conn(0x7feb780b6a20 legacy=0x7feb780b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb77fff640 1 -- 172.21.15.134:0/4012405220 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7806ecf0 con 0x7feb7815c250 2024-09-15T22:41:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.340+0000 7feb76ffd640 1 -- 172.21.15.134:0/4012405220 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620063416 0 0) 0x7feb7815fbf0 con 0x7feb780b6a20 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb77fff640 1 --2- 172.21.15.134:0/4012405220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7815c250 0x7feb7815f6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62610a8018bcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb76ffd640 1 -- 172.21.15.134:0/4012405220 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68037070 con 0x7feb7815c250 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb76ffd640 1 -- 172.21.15.134:0/4012405220 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb68032440 con 0x7feb7815c250 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb76ffd640 1 -- 172.21.15.134:0/4012405220 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68032810 con 0x7feb7815c250 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 -- 172.21.15.134:0/4012405220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7815c250 msgr2=0x7feb7815f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 --2- 172.21.15.134:0/4012405220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7815c250 0x7feb7815f6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb6802a230 comp rx=0 tx=0).stop 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 -- 172.21.15.134:0/4012405220 shutdown_connections 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 --2- 172.21.15.134:0/4012405220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7815c250 0x7feb7815f6b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 -- 172.21.15.134:0/4012405220 >> 172.21.15.134:0/4012405220 conn(0x7feb780b4220 msgr2=0x7feb780b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 -- 172.21.15.134:0/4012405220 shutdown_connections 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.341+0000 7feb7e92c640 1 -- 172.21.15.134:0/4012405220 wait complete. 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.343+0000 7feb7e92c640 1 Processor -- start 2024-09-15T22:41:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.343+0000 7feb7e92c640 1 -- start start 2024-09-15T22:41:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb780b6a20 0x7feb78153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 0x7feb78157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb78070e60 con 0x7feb7806e570 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feb780708a0 con 0x7feb7815c250 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feb7815c630 con 0x7feb780b6a20 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43734/0 (socket says 172.21.15.134:43734) 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 -- 172.21.15.134:0/1649948664 learned_addr learned my addr 172.21.15.134:0/1649948664 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7cec9640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 0x7feb78157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb777fe640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb780b6a20 0x7feb78153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 -- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb780b6a20 msgr2=0x7feb78153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb780b6a20 0x7feb78153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 -- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 msgr2=0x7feb78157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 0x7feb78157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 -- 172.21.15.134:0/1649948664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb781f49f0 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7cec9640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 0x7feb78157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb77fff640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68037050 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb68038040 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7815e670 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68004490 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.344+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7815ddd0 con 0x7feb7806e570 2024-09-15T22:41:43.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.345+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb780712f0 con 0x7feb7806e570 2024-09-15T22:41:43.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.346+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb68030900 con 0x7feb7806e570 2024-09-15T22:41:43.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.346+0000 7feb74ff9640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 0x7feb5806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:43.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.346+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb680ac020 con 0x7feb7806e570 2024-09-15T22:41:43.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.346+0000 7feb777fe640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 0x7feb5806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:43.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.347+0000 7feb777fe640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 0x7feb5806e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb60000f60 tx=0x7feb60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:43.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.351+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb6807a790 con 0x7feb7806e570 2024-09-15T22:41:43.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.551+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feb780b7650 con 0x7feb7806e570 2024-09-15T22:41:43.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.551+0000 7feb74ff9640 1 -- 172.21.15.134:0/1649948664 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7feb6807a090 con 0x7feb7806e570 2024-09-15T22:41:43.554 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 msgr2=0x7feb5806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 0x7feb5806e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb60000f60 tx=0x7feb60009040 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 msgr2=0x7feb7815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb680046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 shutdown_connections 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feb5806c2b0 0x7feb5806e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7815c250 0x7feb78157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb780b6a20 0x7feb78153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 --2- 172.21.15.134:0/1649948664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7806e570 0x7feb7815f810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:43.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 >> 172.21.15.134:0/1649948664 conn(0x7feb780b4220 msgr2=0x7feb780b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:43.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 shutdown_connections 2024-09-15T22:41:43.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43.553+0000 7feb7e92c640 1 -- 172.21.15.134:0/1649948664 wait complete. 2024-09-15T22:41:43.566 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:41:43.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:41:43.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:41:43.567 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:41:43.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:43.567 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:41:43.583 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:41:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42790sec preferred_lft 42790sec 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link tentative 2024-09-15T22:41:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:43.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:43.586 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:41:43.646 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:41:43.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:43.648 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:41:43.704 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:41:43.704 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:41:43.704 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:41:43.704 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:41:43.704 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:41:43.705 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:43.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:43.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:43.830 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:41:43.845 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:41:43.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:43.846 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-09-15T22:41:43.901 INFO:teuthology.orchestra.run.smithi134.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T22:41:43.902 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:43.902 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:43.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:41:43.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-15T22:41:43.902 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:43.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:44.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:44.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:41:44.045 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:44.045 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 12:70:39:4a:56:2c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::1070:39ff:fe4a:562c/64 scope link 2024-09-15T22:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:44.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:41:44.111 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:44.111 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 12:70:39:4a:56:2c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::1070:39ff:fe4a:562c/64 scope link 2024-09-15T22:41:44.112 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:44.113 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-15T22:41:44.114 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:44.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:44.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.265 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:44.266 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:41:44.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.1 up 2024-09-15T22:41:44.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:41:44.266 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:41:44.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:44.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:44.342 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-15T22:41:44.369 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:41:44.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:44.370 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:41:44.426 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:41:44.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:44.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:41:44.510 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:41:44.510 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:41:44.510 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:44.518 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:41:44.519 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:41:44.519 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:44.519 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:44.519 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:44.527 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:41:44.528 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:41:44.529 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-15T22:41:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:41:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:41:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:41:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:41:44.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:41:44.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:44.534 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:41:44.559 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.655 INFO:teuthology.orchestra.run.smithi134.stdout:client4671 2024-09-15T22:41:44.655 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:44.655 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:44.671 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:44.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:44.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.767 INFO:teuthology.orchestra.run.smithi134.stdout:client4671 2024-09-15T22:41:44.767 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:44.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:44.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.823 INFO:teuthology.orchestra.run.smithi134.stdout:client4671 2024-09-15T22:41:44.823 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5af37fce-f477-417d-bd72-01ffdf727d70.client4671/status') 2024-09-15T22:41:44.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4671 (3)192.168.0.2:0/2656413871 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stderr:69 bytes copied, 2.1502e-05 s, 3.2 MB/s 2024-09-15T22:41:44.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:44.888 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-15T22:41:44.888 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:41:44.888 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:41:44.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:41:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.985+0000 7fd5d8e37640 1 Processor -- start 2024-09-15T22:41:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.985+0000 7fd5d8e37640 1 -- start start 2024-09-15T22:41:44.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.986+0000 7fd5d8e37640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d415e840 0x7fd5d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.986+0000 7fd5d8e37640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5d40b73f0 0x7fd5d406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.986+0000 7fd5d8e37640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d40738c0 con 0x7fd5d4073150 2024-09-15T22:41:44.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.986+0000 7fd5d8e37640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d415ec20 con 0x7fd5d40b73f0 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.986+0000 7fd5d8e37640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d4073ba0 con 0x7fd5d415e840 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5d40b73f0 0x7fd5d406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5d40b73f0 0x7fd5d406d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43746/0 (socket says 172.21.15.134:43746) 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 -- 172.21.15.134:0/1458819033 learned_addr learned my addr 172.21.15.134:0/1458819033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d259c640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d415e840 0x7fd5d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 -- 172.21.15.134:0/1458819033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d415e840 msgr2=0x7fd5d4070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d415e840 0x7fd5d4070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 -- 172.21.15.134:0/1458819033 >> v1:172.21.15.177:6789/0 conn(0x7fd5d4073150 legacy=0x7fd5d40b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.987+0000 7fd5d2d9d640 1 -- 172.21.15.134:0/1458819033 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d4073e80 con 0x7fd5d40b73f0 2024-09-15T22:41:44.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d2d9d640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d40b73f0 0x7fd5d406d1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009e50 tx=0x7fd5c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1b8d0def286149 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:44.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d159a640 1 -- 172.21.15.134:0/1458819033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4036070 con 0x7fd5d40b73f0 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d159a640 1 -- 172.21.15.134:0/1458819033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4031600 con 0x7fd5d40b73f0 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d159a640 1 -- 172.21.15.134:0/1458819033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40319d0 con 0x7fd5d40b73f0 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 -- 172.21.15.134:0/1458819033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d40b73f0 msgr2=0x7fd5d406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d40b73f0 0x7fd5d406d1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009e50 tx=0x7fd5c402a710 comp rx=0 tx=0).stop 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 -- 172.21.15.134:0/1458819033 shutdown_connections 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d40b73f0 0x7fd5d406d1d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/1458819033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d415e840 0x7fd5d4070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 -- 172.21.15.134:0/1458819033 >> 172.21.15.134:0/1458819033 conn(0x7fd5d406f390 msgr2=0x7fd5d406f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 -- 172.21.15.134:0/1458819033 shutdown_connections 2024-09-15T22:41:44.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.988+0000 7fd5d8e37640 1 -- 172.21.15.134:0/1458819033 wait complete. 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.990+0000 7fd5d8e37640 1 Processor -- start 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.990+0000 7fd5d8e37640 1 -- start start 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.990+0000 7fd5d8e37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.990+0000 7fd5d8e37640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 0x7fd5d414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 0x7fd5d415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4073590 con 0x7fd5d4073150 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d406ccb0 con 0x7fd5d415e840 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d406d710 con 0x7fd5d40b73f0 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43758/0 (socket says 172.21.15.134:43758) 2024-09-15T22:41:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 -- 172.21.15.134:0/4028115184 learned_addr learned my addr 172.21.15.134:0/4028115184 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d2d9d640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 0x7fd5d415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d1d9b640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 0x7fd5d414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 -- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 msgr2=0x7fd5d414bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 0x7fd5d414bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 -- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 msgr2=0x7fd5d415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 0x7fd5d415edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 -- 172.21.15.134:0/4028115184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d415f770 con 0x7fd5d4073150 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d2d9d640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 0x7fd5d415edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d1d9b640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 0x7fd5d414bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d259c640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e8a0 tx=0x7fd5cc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc017070 con 0x7fd5d4073150 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00c940 con 0x7fd5d4073150 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d415fa50 con 0x7fd5d4073150 2024-09-15T22:41:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00cd30 con 0x7fd5d4073150 2024-09-15T22:41:44.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.991+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d414c530 con 0x7fd5d4073150 2024-09-15T22:41:44.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.992+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d406d1d0 con 0x7fd5d4073150 2024-09-15T22:41:44.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.993+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5cc01a070 con 0x7fd5d4073150 2024-09-15T22:41:44.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.993+0000 7fd5caffd640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 0x7fd5b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:44.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.993+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd5cc08b5f0 con 0x7fd5d4073150 2024-09-15T22:41:44.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.993+0000 7fd5d1d9b640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 0x7fd5b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:44.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.994+0000 7fd5d1d9b640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 0x7fd5b406e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4162090 tx=0x7fd5bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:44.997+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5cc059df0 con 0x7fd5d4073150 2024-09-15T22:41:45.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.197+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd5d40d30e0 con 0x7fd5d4073150 2024-09-15T22:41:45.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.198+0000 7fd5caffd640 1 -- 172.21.15.134:0/4028115184 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fd5cc0596f0 con 0x7fd5d4073150 2024-09-15T22:41:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:41:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 msgr2=0x7fd5b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 0x7fd5b406e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4162090 tx=0x7fd5bc009040 comp rx=0 tx=0).stop 2024-09-15T22:41:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 msgr2=0x7fd5d41f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e8a0 tx=0x7fd5cc00ed60 comp rx=0 tx=0).stop 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 shutdown_connections 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd5b406c2b0 0x7fd5b406e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d415e840 0x7fd5d415edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5d40b73f0 0x7fd5d414bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 --2- 172.21.15.134:0/4028115184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4073150 0x7fd5d41f8650 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 >> 172.21.15.134:0/4028115184 conn(0x7fd5d406f390 msgr2=0x7fd5d406f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 shutdown_connections 2024-09-15T22:41:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:45.200+0000 7fd5d8e37640 1 -- 172.21.15.134:0/4028115184 wait complete. 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:41:45.212 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:41:45.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:45.213 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42778sec preferred_lft 42778sec 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:41:45.233 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:45.234 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:41:45.234 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:45.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:45.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:45.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:45.513 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:41:45.538 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:41:45.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:45.539 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:41:45.611 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:41:45.612 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:41:45.612 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:41:45.612 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:41:45.612 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:41:45.613 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:45.613 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:45.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:41:45.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:41:45.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:41:45.614 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:45.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:45.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:45.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:45.887 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:41:45.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:45.902 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-09-15T22:41:45.957 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:45.957 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:45.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:41:45.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-15T22:41:45.958 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:46.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.074 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-15T22:41:46.074 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T22:41:46.075 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:46.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:46.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.197 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:46.197 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:46.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:41:46.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:41:46.197 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:46.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:46.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:46.273 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:41:46.288 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:41:46.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:46.288 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:41:46.343 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:41:46.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:46.343 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:41:46.444 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:41:46.445 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:41:46.445 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:46.581 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:41:46.581 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:41:46.582 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:46.582 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:46.582 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:41:46.590 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:41:46.591 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:41:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:41:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:41:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:41:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:41:46.593 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:41:46.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:46.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:41:46.617 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:46.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:46.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.715 INFO:teuthology.orchestra.run.smithi177.stdout:client4442 2024-09-15T22:41:46.715 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:46.715 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:46.731 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:46.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:46.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.826 INFO:teuthology.orchestra.run.smithi177.stdout:client4442 2024-09-15T22:41:46.827 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:46.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:46.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.881 INFO:teuthology.orchestra.run.smithi177.stdout:client4442 2024-09-15T22:41:46.882 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5af37fce-f477-417d-bd72-01ffdf727d70.client4442/status') 2024-09-15T22:41:46.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4442 (3)192.168.0.1:0/622799205 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stderr:68 bytes copied, 2.3638e-05 s, 2.9 MB/s 2024-09-15T22:41:46.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:46.948 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-15T22:41:46.948 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:41:46.948 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:41:46.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:41:47.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.058+0000 7f12e595b640 1 Processor -- start 2024-09-15T22:41:47.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.058+0000 7f12e595b640 1 -- start start 2024-09-15T22:41:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12e595b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 0x7f12e00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12e595b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 0x7f12e00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12e595b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e00b7170 con 0x7f12e015e940 2024-09-15T22:41:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12e595b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f12e00b7aa0 con 0x7f12e015ed20 2024-09-15T22:41:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12e595b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f12e00d3660 con 0x7f12e00cef90 2024-09-15T22:41:47.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12df7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 0x7f12e00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12d67fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 0x7f12e00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12deffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f12e015e940 0x7f12e00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:60006/0 (socket says 172.21.15.134:60006) 2024-09-15T22:41:47.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12deffd640 1 -- 172.21.15.134:0/1642834688 learned_addr learned my addr 172.21.15.134:0/1642834688 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:47.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12df7fe640 1 -- 172.21.15.134:0/1642834688 >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 msgr2=0x7f12e00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12df7fe640 1 --2- 172.21.15.134:0/1642834688 >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 0x7f12e00b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12df7fe640 1 -- 172.21.15.134:0/1642834688 >> v1:172.21.15.177:6789/0 conn(0x7f12e015e940 legacy=0x7f12e00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12df7fe640 1 -- 172.21.15.134:0/1642834688 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e00d3940 con 0x7f12e00cef90 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.059+0000 7f12d67fc640 1 --2- 172.21.15.134:0/1642834688 >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 0x7f12e00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.060+0000 7f12df7fe640 1 --2- 172.21.15.134:0/1642834688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 0x7f12e00b3760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009d90 tx=0x7f12d802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745870e96359df95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.060+0000 7f12de7fc640 1 -- 172.21.15.134:0/1642834688 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8007740 con 0x7f12e00cef90 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.060+0000 7f12de7fc640 1 -- 172.21.15.134:0/1642834688 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d80078e0 con 0x7f12e00cef90 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.060+0000 7f12de7fc640 1 -- 172.21.15.134:0/1642834688 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8007cb0 con 0x7f12e00cef90 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 -- 172.21.15.134:0/1642834688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 msgr2=0x7f12e00b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 --2- 172.21.15.134:0/1642834688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 0x7f12e00b3760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009d90 tx=0x7f12d802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 -- 172.21.15.134:0/1642834688 shutdown_connections 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 --2- 172.21.15.134:0/1642834688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e00cef90 0x7f12e00b3760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 --2- 172.21.15.134:0/1642834688 >> v2:172.21.15.177:3300/0 conn(0x7f12e015ed20 0x7f12e00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 -- 172.21.15.134:0/1642834688 >> 172.21.15.134:0/1642834688 conn(0x7f12e00b6240 msgr2=0x7f12e00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 -- 172.21.15.134:0/1642834688 shutdown_connections 2024-09-15T22:41:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.061+0000 7f12e595b640 1 -- 172.21.15.134:0/1642834688 wait complete. 2024-09-15T22:41:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.062+0000 7f12e595b640 1 Processor -- start 2024-09-15T22:41:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.062+0000 7f12e595b640 1 -- start start 2024-09-15T22:41:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 0x7f12e00ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 0x7f12e00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12e00d3310 con 0x7f12e015ed20 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12e00d3f00 con 0x7f12e00cef90 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12e595b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f12e00d1ef0 con 0x7f12e015e940 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12df7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12df7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35708/0 (socket says 172.21.15.134:35708) 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12df7fe640 1 -- 172.21.15.134:0/3066087697 learned_addr learned my addr 172.21.15.134:0/3066087697 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12d67fc640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 0x7f12e00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.063+0000 7f12deffd640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 0x7f12e00ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 -- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 msgr2=0x7f12e00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 0x7f12e00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 -- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 msgr2=0x7f12e00ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 0x7f12e00ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 -- 172.21.15.134:0/3066087697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e015b580 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12d67fc640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 0x7f12e00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12deffd640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 0x7f12e00ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12df7fe640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009eb0 tx=0x7f12d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8040070 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d8031bc0 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8009450 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e01488a0 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.064+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e015b860 con 0x7f12e015ed20 2024-09-15T22:41:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.065+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e00d1060 con 0x7f12e015ed20 2024-09-15T22:41:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.065+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f12d8039040 con 0x7f12e015ed20 2024-09-15T22:41:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.066+0000 7f12dcff9640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 0x7f12c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.066+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f12d80ac540 con 0x7f12e015ed20 2024-09-15T22:41:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.066+0000 7f12deffd640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 0x7f12c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.066+0000 7f12deffd640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 0x7f12c006e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.070+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12d804c070 con 0x7f12e015ed20 2024-09-15T22:41:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.272+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f12e00ba6b0 con 0x7f12e015ed20 2024-09-15T22:41:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.272+0000 7f12dcff9640 1 -- 172.21.15.134:0/3066087697 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f12d807a5e0 con 0x7f12e015ed20 2024-09-15T22:41:47.274 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:41:47.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 msgr2=0x7f12c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 0x7f12c006e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0007e80 comp rx=0 tx=0).stop 2024-09-15T22:41:47.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 msgr2=0x7f12e00cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009eb0 tx=0x7f12d8004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 shutdown_connections 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12c006c2b0 0x7f12c006e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e015ed20 0x7f12e00cc850 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12e015e940 0x7f12e00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 --2- 172.21.15.134:0/3066087697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12e00cef90 0x7f12e00ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 >> 172.21.15.134:0/3066087697 conn(0x7f12e00b6240 msgr2=0x7f12e015fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 shutdown_connections 2024-09-15T22:41:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:47.275+0000 7f12e595b640 1 -- 172.21.15.134:0/3066087697 wait complete. 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:41:47.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:41:47.288 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:41:47.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.288 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:41:47.305 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:47.305 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:47.305 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:47.305 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:47.306 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42776sec preferred_lft 42776sec 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:41:47.307 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:41:47.308 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link tentative 2024-09-15T22:41:47.308 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.308 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:41:47.369 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:41:47.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.371 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:41:47.428 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:41:47.428 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:41:47.428 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:41:47.428 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:41:47.428 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:41:47.428 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:47.428 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:47.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:41:47.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:41:47.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:41:47.429 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:47.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:47.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:47.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.554 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:41:47.570 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:41:47.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.570 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-09-15T22:41:47.625 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-15T22:41:47.625 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:47.625 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:47.625 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:41:47.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-15T22:41:47.626 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:47.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:47.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:47.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.742 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:47.767 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 62:10:1d:e7:12:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:41:47.768 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:41:47.768 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.768 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::6010:1dff:fee7:12bf/64 scope link tentative 2024-09-15T22:41:47.768 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:47.769 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:41:47.833 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:41:47.833 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:41:47.833 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 62:10:1d:e7:12:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::6010:1dff:fee7:12bf/64 scope link 2024-09-15T22:41:47.834 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:41:47.835 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-15T22:41:47.835 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-15T22:41:47.836 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:47.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:47.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:47.986 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:41:47.987 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:41:47.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2024-09-15T22:41:47.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:41:47.987 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:41:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:48.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:48.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:48.064 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-15T22:41:48.079 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:41:48.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:41:48.080 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:41:48.134 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:41:48.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:48.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:41:48.217 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:41:48.217 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:41:48.217 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:41:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:41:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:41:48.236 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:41:48.237 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-15T22:41:48.237 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:41:48.237 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:41:48.237 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:41:48.237 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:41:48.238 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:41:48.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:48.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:41:48.303 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:48.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:48.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:client4683 2024-09-15T22:41:48.399 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:48.399 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:48.416 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:48.504 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:48.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:48.511 INFO:teuthology.orchestra.run.smithi177.stdout:client4683 2024-09-15T22:41:48.511 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:41:48.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:41:48.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:48.567 INFO:teuthology.orchestra.run.smithi177.stdout:client4683 2024-09-15T22:41:48.567 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5af37fce-f477-417d-bd72-01ffdf727d70.client4683/status') 2024-09-15T22:41:48.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:41:48.625 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4683 (3)172.21.15.177:0/731514899 2024-09-15T22:41:48.625 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-09-15T22:41:48.625 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-09-15T22:41:48.625 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-09-15T22:41:48.626 INFO:teuthology.orchestra.run.smithi177.stderr:70 bytes copied, 2.0521e-05 s, 3.4 MB/s 2024-09-15T22:41:48.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:41:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:41:48.632 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T22:41:48.732 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-15T22:41:48.732 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:41:48.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:48.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.842+0000 7fe545c2e640 1 Processor -- start 2024-09-15T22:41:48.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.842+0000 7fe545c2e640 1 -- start start 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe545c2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5400b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe545c2e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5400ce150 con 0x7fe540156880 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe545c2e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5400ce430 con 0x7fe5400aff30 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe545c2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5400b6b00 con 0x7fe5400cdae0 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe540156880 0x7fe540160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42834/0 (socket says 172.21.15.134:42834) 2024-09-15T22:41:48.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53f7fe640 1 -- 172.21.15.134:0/3108391507 learned_addr learned my addr 172.21.15.134:0/3108391507 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020534578 0 0) 0x7fe5400ce150 con 0x7fe540156880 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53effd640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5400b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe528003520 con 0x7fe540156880 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1912091585 0 0) 0x7fe528003520 con 0x7fe540156880 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 msgr2=0x7fe5400b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5400b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 >> v1:172.21.15.177:6789/0 conn(0x7fe5400aff30 legacy=0x7fe54015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54015ff30 con 0x7fe540156880 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fe530001670 con 0x7fe540156880 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 >> v1:172.21.15.134:6789/0 conn(0x7fe540156880 legacy=0x7fe540160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:48.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5280039e0 0x7fe528003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe528004390 0x7fe528004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5280050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5400b6b00 con 0x7fe5280039e0 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe52800b9f0 con 0x7fe528004390 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.843+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe52800bbf0 con 0x7fe5400cdae0 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5280039e0 0x7fe528003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53effd640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe528004390 0x7fe528004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53ffff640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5280050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 -- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 msgr2=0x7fe5280050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:48.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5400cdae0 0x7fe5280050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 -- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe528004390 msgr2=0x7fe528004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe528004390 0x7fe528004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.844+0000 7fe53f7fe640 1 -- 172.21.15.134:0/3108391507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe528003520 con 0x7fe5280039e0 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5280039e0 0x7fe528003dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c240 tx=0x7fe528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d7bc5829c0d6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53002e070 con 0x7fe5280039e0 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe530005af0 con 0x7fe5280039e0 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe53e7fc640 1 -- 172.21.15.134:0/3108391507 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530007d30 con 0x7fe5280039e0 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 -- 172.21.15.134:0/3108391507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5280039e0 msgr2=0x7fe528003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 --2- 172.21.15.134:0/3108391507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5280039e0 0x7fe528003dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c240 tx=0x7fe528005830 comp rx=0 tx=0).stop 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe53ffff640 1 -- 172.21.15.134:0/3108391507 reap_dead start 2024-09-15T22:41:48.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 -- 172.21.15.134:0/3108391507 shutdown_connections 2024-09-15T22:41:48.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 -- 172.21.15.134:0/3108391507 >> 172.21.15.134:0/3108391507 conn(0x7fe54006cae0 msgr2=0x7fe54006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:48.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 -- 172.21.15.134:0/3108391507 shutdown_connections 2024-09-15T22:41:48.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.845+0000 7fe545c2e640 1 -- 172.21.15.134:0/3108391507 wait complete. 2024-09-15T22:41:48.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.847+0000 7fe545c2e640 1 Processor -- start 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.847+0000 7fe545c2e640 1 -- start start 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.847+0000 7fe545c2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5280039e0 0x7fe54014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.847+0000 7fe545c2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5401f3eb0 0x7fe54015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.847+0000 7fe545c2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe545c2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5400ce710 con 0x7fe54015b730 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe545c2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe540156c60 con 0x7fe5401f3eb0 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe545c2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5400b65c0 con 0x7fe5280039e0 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35718/0 (socket says 172.21.15.134:35718) 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 -- 172.21.15.134:0/1334463412 learned_addr learned my addr 172.21.15.134:0/1334463412 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53effd640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5401f3eb0 0x7fe54015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5280039e0 0x7fe54014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 -- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5280039e0 msgr2=0x7fe54014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5280039e0 0x7fe54014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 -- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5401f3eb0 msgr2=0x7fe54015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5401f3eb0 0x7fe54015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 -- 172.21.15.134:0/1334463412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5400b1830 con 0x7fe54015b730 2024-09-15T22:41:48.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe53ffff640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b2b30 tx=0x7fe53800feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538003b80 con 0x7fe54015b730 2024-09-15T22:41:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe538018070 con 0x7fe54015b730 2024-09-15T22:41:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5400b1b10 con 0x7fe54015b730 2024-09-15T22:41:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5380050d0 con 0x7fe54015b730 2024-09-15T22:41:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.848+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5400b20d0 con 0x7fe54015b730 2024-09-15T22:41:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.849+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54015bbb0 con 0x7fe54015b730 2024-09-15T22:41:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.850+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe538005270 con 0x7fe54015b730 2024-09-15T22:41:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.850+0000 7fe527fff640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 0x7fe52c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.850+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe53808b350 con 0x7fe54015b730 2024-09-15T22:41:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.850+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 0x7fe52c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.851+0000 7fe53f7fe640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 0x7fe52c06e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe530033000 tx=0x7fe53002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:48.855+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe538059ac0 con 0x7fe54015b730 2024-09-15T22:41:49.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.021+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5400cf570 con 0x7fe54015b730 2024-09-15T22:41:49.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.022+0000 7fe527fff640 1 -- 172.21.15.134:0/1334463412 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7fe5400cf570 con 0x7fe54015b730 2024-09-15T22:41:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:49.024 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 msgr2=0x7fe52c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 0x7fe52c06e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe530033000 tx=0x7fe53002e000 comp rx=0 tx=0).stop 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 msgr2=0x7fe5401f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b2b30 tx=0x7fe53800feb0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 shutdown_connections 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe52c06c2e0 0x7fe52c06e7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54015b730 0x7fe5401f74f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5401f3eb0 0x7fe54015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 --2- 172.21.15.134:0/1334463412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5280039e0 0x7fe54014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 >> 172.21.15.134:0/1334463412 conn(0x7fe54006cae0 msgr2=0x7fe54015ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 shutdown_connections 2024-09-15T22:41:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.024+0000 7fe545c2e640 1 -- 172.21.15.134:0/1334463412 wait complete. 2024-09-15T22:41:49.037 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:41:23.739181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:41:25.007723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:41:49.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:41:49.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 Processor -- start 2024-09-15T22:41:49.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 -- start start 2024-09-15T22:41:49.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe3900ae8e0 0x7fe3900aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390148400 con 0x7fe3900b0b30 2024-09-15T22:41:49.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900b53e0 con 0x7fe390148020 2024-09-15T22:41:49.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.137+0000 7fe396303640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe3900b5ff0 con 0x7fe3900ae8e0 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe3948a0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe3900ae8e0 0x7fe3900aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe38f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe3900b0b30 0x7fe3900b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42840/0 (socket says 172.21.15.134:42840) 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe38f7fe640 1 -- 172.21.15.134:0/2861845503 learned_addr learned my addr 172.21.15.134:0/2861845503 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe3948a0640 1 -- 172.21.15.134:0/2861845503 >> v1:172.21.15.177:6789/0 conn(0x7fe390148020 legacy=0x7fe3900b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe3948a0640 1 -- 172.21.15.134:0/2861845503 >> v1:172.21.15.134:6789/0 conn(0x7fe3900b0b30 legacy=0x7fe3900b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe38effd640 1 -- 172.21.15.134:0/2861845503 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965027966 0 0) 0x7fe390148400 con 0x7fe3900b0b30 2024-09-15T22:41:49.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.138+0000 7fe3948a0640 1 -- 172.21.15.134:0/2861845503 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3900b56c0 con 0x7fe3900ae8e0 2024-09-15T22:41:49.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe3948a0640 1 --2- 172.21.15.134:0/2861845503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3900ae8e0 0x7fe3900aed10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3900b6170 tx=0x7fe38802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5284a555be78c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe38effd640 1 -- 172.21.15.134:0/2861845503 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388007740 con 0x7fe3900ae8e0 2024-09-15T22:41:49.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe38effd640 1 -- 172.21.15.134:0/2861845503 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3880078e0 con 0x7fe3900ae8e0 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe38effd640 1 -- 172.21.15.134:0/2861845503 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388007cb0 con 0x7fe3900ae8e0 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 -- 172.21.15.134:0/2861845503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3900ae8e0 msgr2=0x7fe3900aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 --2- 172.21.15.134:0/2861845503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3900ae8e0 0x7fe3900aed10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3900b6170 tx=0x7fe38802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 -- 172.21.15.134:0/2861845503 shutdown_connections 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 --2- 172.21.15.134:0/2861845503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3900ae8e0 0x7fe3900aed10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 -- 172.21.15.134:0/2861845503 >> 172.21.15.134:0/2861845503 conn(0x7fe39006d0d0 msgr2=0x7fe39006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 -- 172.21.15.134:0/2861845503 shutdown_connections 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.139+0000 7fe396303640 1 -- 172.21.15.134:0/2861845503 wait complete. 2024-09-15T22:41:49.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.140+0000 7fe396303640 1 Processor -- start 2024-09-15T22:41:49.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 -- start start 2024-09-15T22:41:49.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 0x7fe390143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900b0b30 0x7fe3900b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900b5c80 con 0x7fe390148020 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900af250 con 0x7fe3900ae8e0 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe396303640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe39006e100 con 0x7fe3900b0b30 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe3948a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 0x7fe390143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe3948a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35744/0 (socket says 172.21.15.134:35744) 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.141+0000 7fe3948a0640 1 -- 172.21.15.134:0/214546424 learned_addr learned my addr 172.21.15.134:0/214546424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe38f7fe640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900b0b30 0x7fe3900b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 -- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900b0b30 msgr2=0x7fe3900b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900b0b30 0x7fe3900b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 -- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 msgr2=0x7fe390143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 0x7fe390143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 -- 172.21.15.134:0/214546424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901f5090 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe38ffff640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 0x7fe390143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe3948a0640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe38802ace0 tx=0x7fe388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388040070 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388031bc0 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3901f4480 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388045460 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.142+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901f4a40 con 0x7fe390148020 2024-09-15T22:41:49.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.143+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900aed10 con 0x7fe390148020 2024-09-15T22:41:49.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.144+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe388039040 con 0x7fe390148020 2024-09-15T22:41:49.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.144+0000 7fe38cff9640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 0x7fe37c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.144+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe3880acca0 con 0x7fe390148020 2024-09-15T22:41:49.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.144+0000 7fe38ffff640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 0x7fe37c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.145+0000 7fe38ffff640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 0x7fe37c06e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe39006fc30 tx=0x7fe380009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.148+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe38807adc0 con 0x7fe390148020 2024-09-15T22:41:49.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.312+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe390075010 con 0x7fe390148020 2024-09-15T22:41:49.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.312+0000 7fe38cff9640 1 -- 172.21.15.134:0/214546424 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fe38807f0c0 con 0x7fe390148020 2024-09-15T22:41:49.314 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 msgr2=0x7fe37c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 0x7fe37c06e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe39006fc30 tx=0x7fe380009040 comp rx=0 tx=0).stop 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 msgr2=0x7fe390145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe38802ace0 tx=0x7fe388004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 shutdown_connections 2024-09-15T22:41:49.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe37c06c2e0 0x7fe37c06e7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe390148020 0x7fe390145310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900b0b30 0x7fe3900b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 --2- 172.21.15.134:0/214546424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3900ae8e0 0x7fe390143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.314+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 >> 172.21.15.134:0/214546424 conn(0x7fe39006d0d0 msgr2=0x7fe3900b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.315+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 shutdown_connections 2024-09-15T22:41:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.315+0000 7fe396303640 1 -- 172.21.15.134:0/214546424 wait complete. 2024-09-15T22:41:49.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:41:49.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.427+0000 7fc6ed445640 1 Processor -- start 2024-09-15T22:41:49.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.427+0000 7fc6ed445640 1 -- start start 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6ed445640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6e80b3430 0x7fc6e80cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6ed445640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e815e9d0 con 0x7fc6e806c2d0 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6ed445640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e806ca70 con 0x7fc6e80d2d10 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6ed445640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e80d22c0 con 0x7fc6e80b3430 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6e80b3430 0x7fc6e80cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6e80b3430 0x7fc6e80cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35752/0 (socket says 172.21.15.134:35752) 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6de7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc6e806c2d0 0x7fc6e80b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42856/0 (socket says 172.21.15.134:42856) 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/3816460226 learned_addr learned my addr 172.21.15.134:0/3816460226 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/3816460226 >> v1:172.21.15.177:6789/0 conn(0x7fc6e80d2d10 legacy=0x7fc6e80d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/3816460226 >> v1:172.21.15.134:6789/0 conn(0x7fc6e806c2d0 legacy=0x7fc6e80b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.428+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/3816460226 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e806cd50 con 0x7fc6e80b3430 2024-09-15T22:41:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.429+0000 7fc6e6ffd640 1 --2- 172.21.15.134:0/3816460226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80b3430 0x7fc6e80cf750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cabbcb28b52f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.429+0000 7fc6e67fc640 1 -- 172.21.15.134:0/3816460226 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8037070 con 0x7fc6e80b3430 2024-09-15T22:41:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.429+0000 7fc6e67fc640 1 -- 172.21.15.134:0/3816460226 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d8032440 con 0x7fc6e80b3430 2024-09-15T22:41:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.429+0000 7fc6e67fc640 1 -- 172.21.15.134:0/3816460226 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8032810 con 0x7fc6e80b3430 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 -- 172.21.15.134:0/3816460226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80b3430 msgr2=0x7fc6e80cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 --2- 172.21.15.134:0/3816460226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80b3430 0x7fc6e80cf750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d802a210 comp rx=0 tx=0).stop 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 -- 172.21.15.134:0/3816460226 shutdown_connections 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 --2- 172.21.15.134:0/3816460226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80b3430 0x7fc6e80cf750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 -- 172.21.15.134:0/3816460226 >> 172.21.15.134:0/3816460226 conn(0x7fc6e80d4b10 msgr2=0x7fc6e80d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 -- 172.21.15.134:0/3816460226 shutdown_connections 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.430+0000 7fc6ed445640 1 -- 172.21.15.134:0/3816460226 wait complete. 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.431+0000 7fc6ed445640 1 Processor -- start 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.431+0000 7fc6ed445640 1 -- start start 2024-09-15T22:41:49.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b3430 0x7fc6e81e8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e80d2d10 0x7fc6e8152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e806c740 con 0x7fc6e806c2d0 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80d27f0 con 0x7fc6e80d2d10 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6ed445640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80d3870 con 0x7fc6e80b3430 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35754/0 (socket says 172.21.15.134:35754) 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/2957470457 learned_addr learned my addr 172.21.15.134:0/2957470457 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b3430 msgr2=0x7fc6e81e8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b3430 0x7fc6e81e8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e80d2d10 msgr2=0x7fc6e8152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e80d2d10 0x7fc6e8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 -- 172.21.15.134:0/2957470457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e81e7c70 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.432+0000 7fc6e6ffd640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.433+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8041070 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.433+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d803c870 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.433+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e81e7f50 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.433+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8037040 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.433+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e81f4970 con 0x7fc6e806c2d0 2024-09-15T22:41:49.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.434+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e80d3c80 con 0x7fc6e806c2d0 2024-09-15T22:41:49.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.434+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6d8044070 con 0x7fc6e806c2d0 2024-09-15T22:41:49.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.434+0000 7fc6dffff640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 0x7fc6c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.435+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc6d80ac330 con 0x7fc6e806c2d0 2024-09-15T22:41:49.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.435+0000 7fc6de7fc640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 0x7fc6c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.435+0000 7fc6de7fc640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 0x7fc6c806e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f60 tx=0x7fc6d0007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.439+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6d807ab30 con 0x7fc6e806c2d0 2024-09-15T22:41:49.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.601+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc6e80b5580 con 0x7fc6e806c2d0 2024-09-15T22:41:49.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.601+0000 7fc6dffff640 1 -- 172.21.15.134:0/2957470457 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fc6d807a430 con 0x7fc6e806c2d0 2024-09-15T22:41:49.603 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 msgr2=0x7fc6c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 0x7fc6c806e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f60 tx=0x7fc6d0007a00 comp rx=0 tx=0).stop 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 msgr2=0x7fc6e81f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d80046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 shutdown_connections 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc6c806c2b0 0x7fc6c806e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e80d2d10 0x7fc6e8152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b3430 0x7fc6e81e8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 --2- 172.21.15.134:0/2957470457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e806c2d0 0x7fc6e81f4430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 >> 172.21.15.134:0/2957470457 conn(0x7fc6e80d4b10 msgr2=0x7fc6e80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 shutdown_connections 2024-09-15T22:41:49.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.603+0000 7fc6ed445640 1 -- 172.21.15.134:0/2957470457 wait complete. 2024-09-15T22:41:49.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:41:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.717+0000 7fdfc3186640 1 Processor -- start 2024-09-15T22:41:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc3186640 1 -- start start 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc3186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfbc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc3186640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc071a70 con 0x7fdfbc15c720 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc3186640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc0b5810 con 0x7fdfbc0b6da0 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc3186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b55c0 con 0x7fdfbc0b1ca0 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc0f22640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdfbc15c720 0x7fdfbc0b62f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42872/0 (socket says 172.21.15.134:42872) 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.718+0000 7fdfc0f22640 1 -- 172.21.15.134:0/1288912375 learned_addr learned my addr 172.21.15.134:0/1288912375 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfbc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676097639 0 0) 0x7fdfbc071a70 con 0x7fdfbc15c720 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa4003520 con 0x7fdfbc15c720 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2338612815 0 0) 0x7fdfa4003520 con 0x7fdfbc15c720 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 msgr2=0x7fdfbc0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfbc0713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 >> v1:172.21.15.177:6789/0 conn(0x7fdfbc0b6da0 legacy=0x7fdfbc0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0b5af0 con 0x7fdfbc15c720 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fdfac001670 con 0x7fdfbc15c720 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 >> v1:172.21.15.134:6789/0 conn(0x7fdfbc15c720 legacy=0x7fdfbc0b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfa40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa4003f20 0x7fdfa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa4004d40 0x7fdfa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b55c0 con 0x7fdfa4003f20 2024-09-15T22:41:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa400ba20 con 0x7fdfa4004d40 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa400bc20 con 0x7fdfbc0b1ca0 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa4003f20 0x7fdfa4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfc0f22640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfa40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfc1723640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa4004d40 0x7fdfa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 -- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 msgr2=0x7fdfa40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfbc0b1ca0 0x7fdfa40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 -- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa4004d40 msgr2=0x7fdfa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa4004d40 0x7fdfa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.719+0000 7fdfbbfff640 1 -- 172.21.15.134:0/1288912375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa4003520 con 0x7fdfa4003f20 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.720+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa4003f20 0x7fdfa4004800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009a90 tx=0x7fdfa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdd4bb6b3b8534d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.720+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0036070 con 0x7fdfa4003f20 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.720+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb0031400 con 0x7fdfa4003f20 2024-09-15T22:41:49.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.720+0000 7fdfbb7fe640 1 -- 172.21.15.134:0/1288912375 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0009690 con 0x7fdfa4003f20 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 -- 172.21.15.134:0/1288912375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa4003f20 msgr2=0x7fdfa4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 --2- 172.21.15.134:0/1288912375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa4003f20 0x7fdfa4004800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009a90 tx=0x7fdfa4005830 comp rx=0 tx=0).stop 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc1723640 1 -- 172.21.15.134:0/1288912375 reap_dead start 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 -- 172.21.15.134:0/1288912375 shutdown_connections 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 -- 172.21.15.134:0/1288912375 >> 172.21.15.134:0/1288912375 conn(0x7fdfbc0d2550 msgr2=0x7fdfbc0d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 -- 172.21.15.134:0/1288912375 shutdown_connections 2024-09-15T22:41:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.721+0000 7fdfc3186640 1 -- 172.21.15.134:0/1288912375 wait complete. 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.722+0000 7fdfc3186640 1 Processor -- start 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.722+0000 7fdfc3186640 1 -- start start 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfa4003f20 0x7fdfbc143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfbc0d12a0 0x7fdfbc0d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b6a00 con 0x7fdfbc1529d0 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0d2290 con 0x7fdfbc0d12a0 2024-09-15T22:41:49.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc3186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b6b80 con 0x7fdfa4003f20 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35784/0 (socket says 172.21.15.134:35784) 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 -- 172.21.15.134:0/3468215906 learned_addr learned my addr 172.21.15.134:0/3468215906 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 -- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfa4003f20 msgr2=0x7fdfbc143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc0f22640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfa4003f20 0x7fdfbc143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfa4003f20 0x7fdfbc143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfc1723640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfbc0d12a0 0x7fdfbc0d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 -- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfbc0d12a0 msgr2=0x7fdfbc0d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfbc0d12a0 0x7fdfbc0d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.723+0000 7fdfbbfff640 1 -- 172.21.15.134:0/3468215906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc152f90 con 0x7fdfbc1529d0 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfbbfff640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009a90 tx=0x7fdfb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0040020 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb003b660 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc153270 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0036040 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.724+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc153830 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.725+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc0713e0 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.725+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfb0043020 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.725+0000 7fdfb97fa640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 0x7fdfa806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.726+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdfb00abb60 con 0x7fdfbc1529d0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.726+0000 7fdfc0f22640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 0x7fdfa806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.726+0000 7fdfc0f22640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 0x7fdfa806e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007bf0 tx=0x7fdfac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:49.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.730+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfb004a030 con 0x7fdfbc1529d0 2024-09-15T22:41:49.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.896+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdfbc143d70 con 0x7fdfbc1529d0 2024-09-15T22:41:49.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.897+0000 7fdfb97fa640 1 -- 172.21.15.134:0/3468215906 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fdfb007a360 con 0x7fdfbc1529d0 2024-09-15T22:41:49.898 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-09-15T22:41:49.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.898+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 msgr2=0x7fdfa806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.898+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 0x7fdfa806e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007bf0 tx=0x7fdfac009040 comp rx=0 tx=0).stop 2024-09-15T22:41:49.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.898+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 msgr2=0x7fdfbc1f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:49.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.898+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009a90 tx=0x7fdfb0004730 comp rx=0 tx=0).stop 2024-09-15T22:41:49.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 shutdown_connections 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdfa806c2e0 0x7fdfa806e7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfbc0d12a0 0x7fdfbc0d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfbc1529d0 0x7fdfbc1f1550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 --2- 172.21.15.134:0/3468215906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdfa4003f20 0x7fdfbc143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 >> 172.21.15.134:0/3468215906 conn(0x7fdfbc0d2550 msgr2=0x7fdfbc0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 shutdown_connections 2024-09-15T22:41:49.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:49.899+0000 7fdfc3186640 1 -- 172.21.15.134:0/3468215906 wait complete. 2024-09-15T22:41:49.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:41:50.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.009+0000 7faf45e53640 1 Processor -- start 2024-09-15T22:41:50.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.009+0000 7faf45e53640 1 -- start start 2024-09-15T22:41:50.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf45e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf400cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf45e53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf400b3550 0x7faf400b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf45e53640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf40160bb0 con 0x7faf4015ffa0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf45e53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7faf400b3f40 con 0x7faf400b3550 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf45e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf40160e90 con 0x7faf4015f8e0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faf4015ffa0 0x7faf40160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42884/0 (socket says 172.21.15.134:42884) 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3effd640 1 -- 172.21.15.134:0/611661134 learned_addr learned my addr 172.21.15.134:0/611661134 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3ffff640 1 --2- 172.21.15.134:0/611661134 >> v2:172.21.15.177:3300/0 conn(0x7faf400b3550 0x7faf400b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf400cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111620766 0 0) 0x7faf40160bb0 con 0x7faf4015ffa0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf28003520 con 0x7faf4015ffa0 2024-09-15T22:41:50.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1772953462 0 0) 0x7faf28003520 con 0x7faf4015ffa0 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 msgr2=0x7faf400cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf400cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 >> v2:172.21.15.177:3300/0 conn(0x7faf400b3550 msgr2=0x7faf400b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 --2- 172.21.15.134:0/611661134 >> v2:172.21.15.177:3300/0 conn(0x7faf400b3550 0x7faf400b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf400ce170 con 0x7faf4015ffa0 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7faf34001670 con 0x7faf4015ffa0 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3ffff640 1 --2- 172.21.15.134:0/611661134 >> v2:172.21.15.177:3300/0 conn(0x7faf400b3550 0x7faf400b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 >> v1:172.21.15.134:6789/0 conn(0x7faf4015ffa0 legacy=0x7faf40160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf28003f30 0x7faf28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf28004d40 0x7faf280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf40160e90 con 0x7faf28003f30 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf2800b9c0 con 0x7faf28004d40 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.010+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf2800bb90 con 0x7faf4015f8e0 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf28003f30 0x7faf28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3ffff640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf28004d40 0x7faf280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 -- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 msgr2=0x7faf280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 -- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf28004d40 msgr2=0x7faf280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf28004d40 0x7faf280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 -- 172.21.15.134:0/611661134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf28003520 con 0x7faf28003f30 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf4015f8e0 0x7faf280039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:50.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3ffff640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf28004d40 0x7faf280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.011+0000 7faf3effd640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf28003f30 0x7faf28004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c210 tx=0x7faf28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1825c339cdd17730 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34007d50 con 0x7faf28003f30 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf34005af0 con 0x7faf28003f30 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf3e7fc640 1 -- 172.21.15.134:0/611661134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34007070 con 0x7faf28003f30 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 -- 172.21.15.134:0/611661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf28003f30 msgr2=0x7faf28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 --2- 172.21.15.134:0/611661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf28003f30 0x7faf28004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c210 tx=0x7faf28005830 comp rx=0 tx=0).stop 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf3ffff640 1 -- 172.21.15.134:0/611661134 reap_dead start 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 -- 172.21.15.134:0/611661134 shutdown_connections 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 -- 172.21.15.134:0/611661134 >> 172.21.15.134:0/611661134 conn(0x7faf4006ce90 msgr2=0x7faf4006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 -- 172.21.15.134:0/611661134 shutdown_connections 2024-09-15T22:41:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.012+0000 7faf45e53640 1 -- 172.21.15.134:0/611661134 wait complete. 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.013+0000 7faf45e53640 1 Processor -- start 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 -- start start 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 0x7faf4014e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf40158cd0 0x7faf40159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf4015fcc0 con 0x7faf40152bb0 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf400ce730 con 0x7faf40158cd0 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf45e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf400cec50 con 0x7faf28003f30 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf3effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf3effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35812/0 (socket says 172.21.15.134:35812) 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.014+0000 7faf3effd640 1 -- 172.21.15.134:0/2068957538 learned_addr learned my addr 172.21.15.134:0/2068957538 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3ffff640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf40158cd0 0x7faf40159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 0x7faf4014e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 -- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 msgr2=0x7faf4014e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 0x7faf4014e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 -- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf40158cd0 msgr2=0x7faf40159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf40158cd0 0x7faf40159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 -- 172.21.15.134:0/2068957538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf401554f0 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 0x7faf4014e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf3effd640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faf3402ae50 tx=0x7faf34001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34001c90 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf34043070 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf401557d0 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34007680 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.015+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf40155d90 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.016+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf400cf030 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.016+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf34048460 con 0x7faf40152bb0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.017+0000 7faf27fff640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 0x7faf2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.017+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 0x7faf2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.017+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faf340abe20 con 0x7faf40152bb0 2024-09-15T22:41:50.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.017+0000 7faf3f7fe640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 0x7faf2c06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf30006d40 tx=0x7faf30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.021+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf34005ac0 con 0x7faf40152bb0 2024-09-15T22:41:50.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.252+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7faf4015a8a0 con 0x7faf40152bb0 2024-09-15T22:41:50.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:41:50.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:41:50.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.771+0000 7faf27fff640 1 -- 172.21.15.134:0/2068957538 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v47) ==== 161+0+0 (secure 0 0 0) 0x7faf3407a620 con 0x7faf40152bb0 2024-09-15T22:41:50.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 msgr2=0x7faf2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 0x7faf2c06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf30006d40 tx=0x7faf30008040 comp rx=0 tx=0).stop 2024-09-15T22:41:50.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 msgr2=0x7faf40153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faf3402ae50 tx=0x7faf34001a40 comp rx=0 tx=0).stop 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 shutdown_connections 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7faf2c06c2b0 0x7faf2c06e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf40158cd0 0x7faf40159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf40152bb0 0x7faf40153030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 --2- 172.21.15.134:0/2068957538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf28003f30 0x7faf4014e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 >> 172.21.15.134:0/2068957538 conn(0x7faf4006ce90 msgr2=0x7faf4006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 shutdown_connections 2024-09-15T22:41:50.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.773+0000 7faf45e53640 1 -- 172.21.15.134:0/2068957538 wait complete. 2024-09-15T22:41:50.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:41:50.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.886+0000 7f21de6f8640 1 Processor -- start 2024-09-15T22:41:50.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.886+0000 7f21de6f8640 1 -- start start 2024-09-15T22:41:50.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21de6f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f21d80b0b30 0x7f21d80b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21de6f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f21d80ae8e0 0x7f21d80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21de6f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d8148400 con 0x7f21d8148020 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21de6f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80b5ff0 con 0x7f21d80ae8e0 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21de6f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80af250 con 0x7f21d80b0b30 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21dcc95640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f21d80ae8e0 0x7f21d80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21d7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f21d8148020 0x7f21d80b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42894/0 (socket says 172.21.15.134:42894) 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21d7fff640 1 -- 172.21.15.134:0/1868505259 learned_addr learned my addr 172.21.15.134:0/1868505259 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21d77fe640 1 --2- 172.21.15.134:0/1868505259 >> v2:172.21.15.177:3300/0 conn(0x7f21d80b0b30 0x7f21d80b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21dcc95640 1 -- 172.21.15.134:0/1868505259 >> v2:172.21.15.177:3300/0 conn(0x7f21d80b0b30 msgr2=0x7f21d80b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21dcc95640 1 --2- 172.21.15.134:0/1868505259 >> v2:172.21.15.177:3300/0 conn(0x7f21d80b0b30 0x7f21d80b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21dcc95640 1 -- 172.21.15.134:0/1868505259 >> v1:172.21.15.134:6789/0 conn(0x7f21d8148020 legacy=0x7f21d80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21d6ffd640 1 -- 172.21.15.134:0/1868505259 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699755517 0 0) 0x7f21d8148400 con 0x7f21d8148020 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.887+0000 7f21dcc95640 1 -- 172.21.15.134:0/1868505259 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80b53e0 con 0x7f21d80ae8e0 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.888+0000 7f21dcc95640 1 --2- 172.21.15.134:0/1868505259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80ae8e0 0x7f21d80aed10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f21d80d1480 tx=0x7f21d002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a52039ab5d0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.888+0000 7f21d6ffd640 1 -- 172.21.15.134:0/1868505259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0007740 con 0x7f21d80ae8e0 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.888+0000 7f21d6ffd640 1 -- 172.21.15.134:0/1868505259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00078e0 con 0x7f21d80ae8e0 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.888+0000 7f21d6ffd640 1 -- 172.21.15.134:0/1868505259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0007cb0 con 0x7f21d80ae8e0 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 -- 172.21.15.134:0/1868505259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80ae8e0 msgr2=0x7f21d80aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1868505259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80ae8e0 0x7f21d80aed10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f21d80d1480 tx=0x7f21d002a680 comp rx=0 tx=0).stop 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 -- 172.21.15.134:0/1868505259 shutdown_connections 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1868505259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80ae8e0 0x7f21d80aed10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1868505259 >> v2:172.21.15.177:3300/0 conn(0x7f21d80b0b30 0x7f21d80b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 -- 172.21.15.134:0/1868505259 >> 172.21.15.134:0/1868505259 conn(0x7f21d806d0d0 msgr2=0x7f21d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:50.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 -- 172.21.15.134:0/1868505259 shutdown_connections 2024-09-15T22:41:50.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.889+0000 7f21de6f8640 1 -- 172.21.15.134:0/1868505259 wait complete. 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.890+0000 7f21de6f8640 1 Processor -- start 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.890+0000 7f21de6f8640 1 -- start start 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21d80ae8e0 0x7f21d80c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21d8148020 0x7f21d80cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80b5c80 con 0x7f21d80b0b30 2024-09-15T22:41:50.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80b59a0 con 0x7f21d8148020 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f21d80b69c0 con 0x7f21d80ae8e0 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35828/0 (socket says 172.21.15.134:35828) 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 -- 172.21.15.134:0/1537978569 learned_addr learned my addr 172.21.15.134:0/1537978569 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d7fff640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21d80ae8e0 0x7f21d80c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21dcc95640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21d8148020 0x7f21d80cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 -- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21d80ae8e0 msgr2=0x7f21d80c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21d80ae8e0 0x7f21d80c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 -- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21d8148020 msgr2=0x7f21d80cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21d8148020 0x7f21d80cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:50.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 -- 172.21.15.134:0/1537978569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80c6c90 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d77fe640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00e870 tx=0x7f21cc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc017070 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc00c940 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d80c6f70 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.891+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00cd30 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.892+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d80c7530 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.893+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d80aed10 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.893+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f21cc01a070 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.893+0000 7f21d4ff9640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 0x7f21c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.893+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f21cc08b5f0 con 0x7f21d80b0b30 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.893+0000 7f21d7fff640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 0x7f21c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:50.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.894+0000 7f21d7fff640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 0x7f21c406e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21c8007fd0 tx=0x7f21c8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:50.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:50.898+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21cc059710 con 0x7f21d80b0b30 2024-09-15T22:41:51.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.068+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f21d80709d0 con 0x7f21d80b0b30 2024-09-15T22:41:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.071+0000 7f21d4ff9640 1 -- 172.21.15.134:0/1537978569 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f21cc05da10 con 0x7f21d80b0b30 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 msgr2=0x7f21c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 0x7f21c406e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21c8007fd0 tx=0x7f21c8007de0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 msgr2=0x7f21d80cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00e870 tx=0x7f21cc00ed30 comp rx=0 tx=0).stop 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 shutdown_connections 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21c406c2b0 0x7f21c406e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21d8148020 0x7f21d80cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d80b0b30 0x7f21d80cb360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 --2- 172.21.15.134:0/1537978569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21d80ae8e0 0x7f21d80c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.073+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 >> 172.21.15.134:0/1537978569 conn(0x7f21d806d0d0 msgr2=0x7f21d80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.074+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 shutdown_connections 2024-09-15T22:41:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.074+0000 7f21de6f8640 1 -- 172.21.15.134:0/1537978569 wait complete. 2024-09-15T22:41:51.085 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:41:51.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:41:51.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:41:51.158 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:41:51.159 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:51.159 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.179 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:51.180 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.237 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:51.237 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:41:51.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.430+0000 7f9890847640 1 Processor -- start 2024-09-15T22:41:51.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.430+0000 7f9890847640 1 -- start start 2024-09-15T22:41:51.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.431+0000 7f9890847640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f988c0b6d50 0x7f988c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.431+0000 7f9890847640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f988c15c9c0 con 0x7f988c15c5e0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.431+0000 7f9890847640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f988c0b1dd0 con 0x7f988c0b56d0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.431+0000 7f9890847640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f988c074100 con 0x7f988c0b6d50 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f988a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f988c15c5e0 0x7f988c0712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42910/0 (socket says 172.21.15.134:42910) 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f988a59c640 1 -- 172.21.15.134:0/1237210901 learned_addr learned my addr 172.21.15.134:0/1237210901 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f9889d9b640 1 --2- 172.21.15.134:0/1237210901 >> v2:172.21.15.177:3300/0 conn(0x7f988c0b6d50 0x7f988c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929399198 0 0) 0x7f988c15c9c0 con 0x7f988c15c5e0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9878003520 con 0x7f988c15c5e0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f9889d9b640 1 -- 172.21.15.134:0/1237210901 >> v1:172.21.15.177:6789/0 conn(0x7f988c0b56d0 legacy=0x7f988c0b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356287523 0 0) 0x7f988c0b1dd0 con 0x7f988c0b56d0 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f9889d9b640 1 -- 172.21.15.134:0/1237210901 >> v1:172.21.15.134:6789/0 conn(0x7f988c15c5e0 legacy=0x7f988c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.432+0000 7f9889d9b640 1 -- 172.21.15.134:0/1237210901 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c0734f0 con 0x7f988c0b6d50 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f9889d9b640 1 --2- 172.21.15.134:0/1237210901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c0b7190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98740097a0 tx=0x7f987402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2053a3e4253e76d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874037070 con 0x7f988c0b6d50 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9874032440 con 0x7f988c0b6d50 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f988959a640 1 -- 172.21.15.134:0/1237210901 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98740327f0 con 0x7f988c0b6d50 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f9890847640 1 -- 172.21.15.134:0/1237210901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 msgr2=0x7f988c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.433+0000 7f9890847640 1 --2- 172.21.15.134:0/1237210901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c0b7190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98740097a0 tx=0x7f987402a230 comp rx=0 tx=0).stop 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.434+0000 7f9890847640 1 -- 172.21.15.134:0/1237210901 shutdown_connections 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.434+0000 7f9890847640 1 --2- 172.21.15.134:0/1237210901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c0b7190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.434+0000 7f9890847640 1 -- 172.21.15.134:0/1237210901 >> 172.21.15.134:0/1237210901 conn(0x7f988c0b4220 msgr2=0x7f988c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.434+0000 7f9890847640 1 -- 172.21.15.134:0/1237210901 shutdown_connections 2024-09-15T22:41:51.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.434+0000 7f9890847640 1 -- 172.21.15.134:0/1237210901 wait complete. 2024-09-15T22:41:51.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.435+0000 7f9890847640 1 Processor -- start 2024-09-15T22:41:51.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.435+0000 7f9890847640 1 -- start start 2024-09-15T22:41:51.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 0x7f988c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f988c073ab0 con 0x7f988c0b56d0 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f988c0b76d0 con 0x7f988c0b6d50 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f988c073d90 con 0x7f988c15c5e0 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35830/0 (socket says 172.21.15.134:35830) 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 -- 172.21.15.134:0/4069133292 learned_addr learned my addr 172.21.15.134:0/4069133292 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9889d9b640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988ad9d640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 0x7f988c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 -- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 msgr2=0x7f988c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 0x7f988c15d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 -- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 msgr2=0x7f988c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 -- 172.21.15.134:0/4069133292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c1557a0 con 0x7f988c0b56d0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988ad9d640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 0x7f988c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f988a59c640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f988400cb40 tx=0x7f988400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884017070 con 0x7f988c0b56d0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988400aca0 con 0x7f988c0b56d0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c14fa70 con 0x7f988c0b56d0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884012620 con 0x7f988c0b56d0 2024-09-15T22:41:51.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.436+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c150030 con 0x7f988c0b56d0 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.438+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c073130 con 0x7f988c0b56d0 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.438+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f988401a070 con 0x7f988c0b56d0 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.438+0000 7f9882ffd640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 0x7f986c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.438+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f988408b210 con 0x7f988c0b56d0 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.438+0000 7f9889d9b640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 0x7f986c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.439+0000 7f9889d9b640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 0x7f986c06e7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9874034000 tx=0x7f987402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.443+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9884059340 con 0x7f988c0b56d0 2024-09-15T22:41:51.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.616+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f988c071a60 con 0x7f988c0b56d0 2024-09-15T22:41:51.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.617+0000 7f9882ffd640 1 -- 172.21.15.134:0/4069133292 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f988405d640 con 0x7f988c0b56d0 2024-09-15T22:41:51.618 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 msgr2=0x7f986c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 0x7f986c06e7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9874034000 tx=0x7f987402e000 comp rx=0 tx=0).stop 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 msgr2=0x7f988c13ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f988400cb40 tx=0x7f988400a060 comp rx=0 tx=0).stop 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 shutdown_connections 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f986c06c2e0 0x7f986c06e7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988c15c5e0 0x7f988c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c0b6d50 0x7f988c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 --2- 172.21.15.134:0/4069133292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f988c0b56d0 0x7f988c13ffd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 >> 172.21.15.134:0/4069133292 conn(0x7f988c0b4220 msgr2=0x7f988c0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 shutdown_connections 2024-09-15T22:41:51.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.619+0000 7f9890847640 1 -- 172.21.15.134:0/4069133292 wait complete. 2024-09-15T22:41:51.631 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:41:51.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:51.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-15T22:41:51.657 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:41:51.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:51.657 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:41:51.726 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:51.726 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.742 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:51.743 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.800 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:51.800 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:51.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:41:51.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.955+0000 7f6d156b7640 1 Processor -- start 2024-09-15T22:41:51.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.955+0000 7f6d156b7640 1 -- start start 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d156b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6d100d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d156b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d100b77f0 con 0x7f6d10073ff0 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d156b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d100d2cf0 con 0x7f6d100b4530 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d156b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1015ca00 con 0x7f6d1015c620 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d07fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6d10073ff0 0x7f6d100b70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42920/0 (socket says 172.21.15.134:42920) 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d07fff640 1 -- 172.21.15.134:0/2039092986 learned_addr learned my addr 172.21.15.134:0/2039092986 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354750595 0 0) 0x7f6d100b77f0 con 0x7f6d10073ff0 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc003520 con 0x7f6d10073ff0 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0effd640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6d100d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2225948670 0 0) 0x7f6cfc003520 con 0x7f6d10073ff0 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 msgr2=0x7f6d100d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6d100d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 >> v1:172.21.15.177:6789/0 conn(0x7f6d100b4530 legacy=0x7f6d100d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d100d2fd0 con 0x7f6d10073ff0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6cf8001670 con 0x7f6d10073ff0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.956+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 >> v1:172.21.15.134:6789/0 conn(0x7f6d10073ff0 legacy=0x7f6d100b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0039e0 0x7f6cfc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6cfc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0054f0 con 0x7f6cfc004800 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc00bf00 con 0x7f6cfc0039e0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc00c080 con 0x7f6d1015c620 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0effd640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0039e0 0x7f6cfc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d0f7fe640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6cfc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 -- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 msgr2=0x7f6cfc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d1015c620 0x7f6cfc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 -- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0039e0 msgr2=0x7f6cfc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0039e0 0x7f6cfc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.957+0000 7f6d07fff640 1 -- 172.21.15.134:0/2039092986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc003520 con 0x7f6cfc004800 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d07fff640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6cfc004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d10074410 tx=0x7f6cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9751d6269e7a794 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8007d10 con 0x7f6cfc004800 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8005ad0 con 0x7f6cfc004800 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d0e7fc640 1 -- 172.21.15.134:0/2039092986 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8007070 con 0x7f6cfc004800 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 -- 172.21.15.134:0/2039092986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 msgr2=0x7f6cfc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 --2- 172.21.15.134:0/2039092986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6cfc004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d10074410 tx=0x7f6cfc005830 comp rx=0 tx=0).stop 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d0f7fe640 1 -- 172.21.15.134:0/2039092986 reap_dead start 2024-09-15T22:41:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 -- 172.21.15.134:0/2039092986 shutdown_connections 2024-09-15T22:41:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 -- 172.21.15.134:0/2039092986 >> 172.21.15.134:0/2039092986 conn(0x7f6d10062810 msgr2=0x7f6d10062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 -- 172.21.15.134:0/2039092986 shutdown_connections 2024-09-15T22:41:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.958+0000 7f6d156b7640 1 -- 172.21.15.134:0/2039092986 wait complete. 2024-09-15T22:41:51.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.959+0000 7f6d156b7640 1 Processor -- start 2024-09-15T22:41:51.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 -- start start 2024-09-15T22:41:51.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d10151e40 0x7f6d10150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d10150890 0x7f6d10155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100b68e0 con 0x7f6cfc004800 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100b6c50 con 0x7f6d10150890 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d156b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d100d0a10 con 0x7f6d10151e40 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35846/0 (socket says 172.21.15.134:35846) 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d0effd640 1 -- 172.21.15.134:0/870474795 learned_addr learned my addr 172.21.15.134:0/870474795 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d07fff640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d10151e40 0x7f6d10150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.960+0000 7f6d0f7fe640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d10150890 0x7f6d10155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 -- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d10151e40 msgr2=0x7f6d10150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d10151e40 0x7f6d10150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 -- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d10150890 msgr2=0x7f6d10155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d10150890 0x7f6d10155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 -- 172.21.15.134:0/870474795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d10146490 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d0effd640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000b820 tx=0x7f6d0000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00018070 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d00010830 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00010c00 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d10150da0 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.961+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d10151360 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.962+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d100b49e0 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.962+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d0001b070 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.963+0000 7f6d077fe640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 0x7f6cf006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.963+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6d0008b6f0 con 0x7f6cfc004800 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.963+0000 7f6d07fff640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 0x7f6cf006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.963+0000 7f6d07fff640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 0x7f6cf006e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8032000 tx=0x7f6cf802d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:51.967+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d00059780 con 0x7f6cfc004800 2024-09-15T22:41:52.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.144+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d100b16a0 con 0x7f6cfc004800 2024-09-15T22:41:52.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.144+0000 7f6d077fe640 1 -- 172.21.15.134:0/870474795 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f6d0005da80 con 0x7f6cfc004800 2024-09-15T22:41:52.146 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:41:52.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.146+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 msgr2=0x7f6cf006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.146+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 0x7f6cf006e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8032000 tx=0x7f6cf802d000 comp rx=0 tx=0).stop 2024-09-15T22:41:52.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.146+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 msgr2=0x7f6d10145f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.146+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000b820 tx=0x7f6d0000bc20 comp rx=0 tx=0).stop 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 shutdown_connections 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6cf006c2e0 0x7f6cf006e7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d10150890 0x7f6d10155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d10151e40 0x7f6d10150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 --2- 172.21.15.134:0/870474795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc004800 0x7f6d10145f50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 >> 172.21.15.134:0/870474795 conn(0x7f6d10062810 msgr2=0x7f6d100b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 shutdown_connections 2024-09-15T22:41:52.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.147+0000 7f6d156b7640 1 -- 172.21.15.134:0/870474795 wait complete. 2024-09-15T22:41:52.159 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:41:52.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:52.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-15T22:41:52.189 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:41:52.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:52.189 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:41:52.257 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:52.257 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.273 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:52.273 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.328 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:41:52.328 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:41:52.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.523+0000 7f83ddea6640 1 Processor -- start 2024-09-15T22:41:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.523+0000 7f83ddea6640 1 -- start start 2024-09-15T22:41:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.523+0000 7f83ddea6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d815c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.523+0000 7f83ddea6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 0x7f83d80b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.523+0000 7f83ddea6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d80b4ee0 con 0x7f83d8140a40 2024-09-15T22:41:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83ddea6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f83d80b5780 con 0x7f83d813eaf0 2024-09-15T22:41:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83ddea6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83d80b51c0 con 0x7f83d80727d0 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d6ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 0x7f83d80b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d77fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f83d8140a40 0x7f83d80720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:60056/0 (socket says 172.21.15.134:60056) 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d77fe640 1 -- 172.21.15.134:0/3971774053 learned_addr learned my addr 172.21.15.134:0/3971774053 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d67fc640 1 -- 172.21.15.134:0/3971774053 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271055413 0 0) 0x7f83d80b4ee0 con 0x7f83d8140a40 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d67fc640 1 -- 172.21.15.134:0/3971774053 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c4003520 con 0x7f83d8140a40 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d6ffd640 1 -- 172.21.15.134:0/3971774053 >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 msgr2=0x7f83d80b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d6ffd640 1 --2- 172.21.15.134:0/3971774053 >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 0x7f83d80b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d6ffd640 1 -- 172.21.15.134:0/3971774053 >> v1:172.21.15.177:6789/0 conn(0x7f83d8140a40 legacy=0x7f83d80720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d6ffd640 1 -- 172.21.15.134:0/3971774053 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d80b54a0 con 0x7f83d80727d0 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.524+0000 7f83d7fff640 1 --2- 172.21.15.134:0/3971774053 >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 0x7f83d80b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.525+0000 7f83d6ffd640 1 --2- 172.21.15.134:0/3971774053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d815c480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83c00097a0 tx=0x7f83c002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1224a7a0005fa883 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.525+0000 7f83d67fc640 1 -- 172.21.15.134:0/3971774053 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0037070 con 0x7f83d80727d0 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.525+0000 7f83d67fc640 1 -- 172.21.15.134:0/3971774053 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c002ae50 con 0x7f83d80727d0 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.525+0000 7f83d67fc640 1 -- 172.21.15.134:0/3971774053 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0032660 con 0x7f83d80727d0 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 -- 172.21.15.134:0/3971774053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 msgr2=0x7f83d815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 --2- 172.21.15.134:0/3971774053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d815c480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83c00097a0 tx=0x7f83c002a100 comp rx=0 tx=0).stop 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 -- 172.21.15.134:0/3971774053 shutdown_connections 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 --2- 172.21.15.134:0/3971774053 >> v2:172.21.15.177:3300/0 conn(0x7f83d813eaf0 0x7f83d80b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 --2- 172.21.15.134:0/3971774053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d815c480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 -- 172.21.15.134:0/3971774053 >> 172.21.15.134:0/3971774053 conn(0x7f83d8062a80 msgr2=0x7f83d806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:52.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 -- 172.21.15.134:0/3971774053 shutdown_connections 2024-09-15T22:41:52.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.526+0000 7f83ddea6640 1 -- 172.21.15.134:0/3971774053 wait complete. 2024-09-15T22:41:52.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.527+0000 7f83ddea6640 1 Processor -- start 2024-09-15T22:41:52.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.527+0000 7f83ddea6640 1 -- start start 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 0x7f83d813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83d80b5ff0 con 0x7f83d813eaf0 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8140e20 con 0x7f83d8140a40 2024-09-15T22:41:52.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83ddea6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83d80b6170 con 0x7f83d80727d0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83d6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83d6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35848/0 (socket says 172.21.15.134:35848) 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83d6ffd640 1 -- 172.21.15.134:0/1527023288 learned_addr learned my addr 172.21.15.134:0/1527023288 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83d7fff640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 0x7f83d813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.528+0000 7f83d77fe640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 -- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 msgr2=0x7f83d813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d813e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 -- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 msgr2=0x7f83d813dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 0x7f83d813dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 -- 172.21.15.134:0/1527023288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d813e1f0 con 0x7f83d813eaf0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d7fff640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 0x7f83d813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83d6ffd640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f83c0035040 tx=0x7f83c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:52.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0041070 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c003c460 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d8143590 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0037040 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.529+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d80ce2a0 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.530+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d815c480 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.530+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f83c003a070 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.531+0000 7f83cffff640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 0x7f83b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.531+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f83c00ab440 con 0x7f83d813eaf0 2024-09-15T22:41:52.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.531+0000 7f83d77fe640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 0x7f83b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:52.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.532+0000 7f83d77fe640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 0x7f83b806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83c8005880 tx=0x7f83c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:52.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.535+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83c00795f0 con 0x7f83d813eaf0 2024-09-15T22:41:52.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.717+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83d806d0c0 con 0x7f83d813eaf0 2024-09-15T22:41:52.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.717+0000 7f83cffff640 1 -- 172.21.15.134:0/1527023288 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f83c007d8f0 con 0x7f83d813eaf0 2024-09-15T22:41:52.718 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 msgr2=0x7f83b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 0x7f83b806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83c8005880 tx=0x7f83c8009040 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 msgr2=0x7f83d80cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f83c0035040 tx=0x7f83c00046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 shutdown_connections 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83b806c2b0 0x7f83b806e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83d8140a40 0x7f83d813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83d813eaf0 0x7f83d80cac60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 --2- 172.21.15.134:0/1527023288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83d80727d0 0x7f83d813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 >> 172.21.15.134:0/1527023288 conn(0x7f83d8062a80 msgr2=0x7f83d806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:52.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 shutdown_connections 2024-09-15T22:41:52.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:52.719+0000 7f83ddea6640 1 -- 172.21.15.134:0/1527023288 wait complete. 2024-09-15T22:41:52.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-15T22:41:52.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:52.732 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-15T22:41:52.757 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:41:52.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:52.758 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T22:41:52.814 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:52.814 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.831 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:52.831 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.887 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:41:52.887 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:41:52.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:41:53.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.043+0000 7fbd17de8640 1 Processor -- start 2024-09-15T22:41:53.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.043+0000 7fbd17de8640 1 -- start start 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd17de8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd10156880 0x7fbd100cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd17de8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd100ce150 con 0x7fbd100aff30 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd17de8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd100ce430 con 0x7fbd100b65c0 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd17de8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1015ff30 con 0x7fbd10156880 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd10156880 0x7fbd100cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd10156880 0x7fbd100cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35860/0 (socket says 172.21.15.134:35860) 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 -- 172.21.15.134:0/2293849074 learned_addr learned my addr 172.21.15.134:0/2293849074 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 -- 172.21.15.134:0/2293849074 >> v1:172.21.15.177:6789/0 conn(0x7fbd100b65c0 legacy=0x7fbd10160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 -- 172.21.15.134:0/2293849074 >> v1:172.21.15.134:6789/0 conn(0x7fbd100aff30 legacy=0x7fbd100b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.044+0000 7fbd15b84640 1 -- 172.21.15.134:0/2293849074 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd10160210 con 0x7fbd10156880 2024-09-15T22:41:53.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd15b84640 1 --2- 172.21.15.134:0/2293849074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd10156880 0x7fbd100cdae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009e50 tx=0x7fbd0c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202c0220d1cfe331 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd14b82640 1 -- 172.21.15.134:0/2293849074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c036070 con 0x7fbd10156880 2024-09-15T22:41:53.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd14b82640 1 -- 172.21.15.134:0/2293849074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c031600 con 0x7fbd10156880 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd14b82640 1 -- 172.21.15.134:0/2293849074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0319d0 con 0x7fbd10156880 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd17de8640 1 -- 172.21.15.134:0/2293849074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd10156880 msgr2=0x7fbd100cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd17de8640 1 --2- 172.21.15.134:0/2293849074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd10156880 0x7fbd100cdae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009e50 tx=0x7fbd0c02a6d0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd17de8640 1 -- 172.21.15.134:0/2293849074 shutdown_connections 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd17de8640 1 --2- 172.21.15.134:0/2293849074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd10156880 0x7fbd100cdae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.045+0000 7fbd17de8640 1 -- 172.21.15.134:0/2293849074 >> 172.21.15.134:0/2293849074 conn(0x7fbd1006cae0 msgr2=0x7fbd1006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.046+0000 7fbd17de8640 1 -- 172.21.15.134:0/2293849074 shutdown_connections 2024-09-15T22:41:53.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.046+0000 7fbd17de8640 1 -- 172.21.15.134:0/2293849074 wait complete. 2024-09-15T22:41:53.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 Processor -- start 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 -- start start 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 0x7fbd101445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd10156880 0x7fbd1015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100ce710 con 0x7fbd100aff30 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100b6a30 con 0x7fbd10156880 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.047+0000 7fbd17de8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1015c8a0 con 0x7fbd100b65c0 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35872/0 (socket says 172.21.15.134:35872) 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 -- 172.21.15.134:0/3444837212 learned_addr learned my addr 172.21.15.134:0/3444837212 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd16385640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd10156880 0x7fbd1015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15383640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 0x7fbd101445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 -- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 msgr2=0x7fbd101445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 0x7fbd101445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 -- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd10156880 msgr2=0x7fbd1015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd10156880 0x7fbd1015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 -- 172.21.15.134:0/3444837212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd101586d0 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15383640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 0x7fbd101445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd15b84640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009e50 tx=0x7fbd0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c036050 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c042070 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd101589b0 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c009510 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.048+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd10158f70 con 0x7fbd100aff30 2024-09-15T22:41:53.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.049+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd100cdae0 con 0x7fbd100aff30 2024-09-15T22:41:53.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.050+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd0c007c50 con 0x7fbd100aff30 2024-09-15T22:41:53.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.050+0000 7fbd067fc640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.050+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd0c0ac340 con 0x7fbd100aff30 2024-09-15T22:41:53.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.050+0000 7fbd15383640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.050+0000 7fbd15383640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 0x7fbcf406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd100cd5b0 tx=0x7fbd00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.054+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd0c07aab0 con 0x7fbd100aff30 2024-09-15T22:41:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.235+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd100d08f0 con 0x7fbd100aff30 2024-09-15T22:41:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.236+0000 7fbd067fc640 1 -- 172.21.15.134:0/3444837212 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fbd100d08f0 con 0x7fbd100aff30 2024-09-15T22:41:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:41:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 msgr2=0x7fbcf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 0x7fbcf406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd100cd5b0 tx=0x7fbd00009040 comp rx=0 tx=0).stop 2024-09-15T22:41:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 msgr2=0x7fbd10159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009e50 tx=0x7fbd0c004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 shutdown_connections 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd10156880 0x7fbd1015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd100b65c0 0x7fbd101445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 --2- 172.21.15.134:0/3444837212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd100aff30 0x7fbd10159770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 >> 172.21.15.134:0/3444837212 conn(0x7fbd1006cae0 msgr2=0x7fbd100cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 shutdown_connections 2024-09-15T22:41:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.238+0000 7fbd17de8640 1 -- 172.21.15.134:0/3444837212 wait complete. 2024-09-15T22:41:53.250 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-15T22:41:53.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:53.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-15T22:41:53.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:41:53.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:41:53.277 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T22:41:53.333 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:41:53.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:53.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.429+0000 7f5c6747b640 1 Processor -- start 2024-09-15T22:41:53.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.429+0000 7f5c6747b640 1 -- start start 2024-09-15T22:41:53.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c6747b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c600d02a0 0x7f5c600d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c6747b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 0x7f5c6015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c6747b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c600d0bc0 con 0x7f5c6015ce80 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c6747b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6015d390 con 0x7f5c600d02a0 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c6747b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6015d670 con 0x7f5c6015ca40 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c600d02a0 0x7f5c600d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c600d02a0 0x7f5c600d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35874/0 (socket says 172.21.15.134:35874) 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 -- 172.21.15.134:0/3212118731 learned_addr learned my addr 172.21.15.134:0/3212118731 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 -- 172.21.15.134:0/3212118731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 msgr2=0x7f5c6015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c64a16640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 0x7f5c6015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 0x7f5c6015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 -- 172.21.15.134:0/3212118731 >> v1:172.21.15.177:6789/0 conn(0x7f5c6015ce80 legacy=0x7f5c601594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c65217640 1 -- 172.21.15.134:0/3212118731 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6015d950 con 0x7f5c600d02a0 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.430+0000 7f5c64a16640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 0x7f5c6015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.431+0000 7f5c65217640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c600d02a0 0x7f5c600d0680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800bb10 tx=0x7f5c5802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7c1315afa493dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.431+0000 7f5c5ffff640 1 -- 172.21.15.134:0/3212118731 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58032790 con 0x7f5c600d02a0 2024-09-15T22:41:53.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.431+0000 7f5c5ffff640 1 -- 172.21.15.134:0/3212118731 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c58038070 con 0x7f5c600d02a0 2024-09-15T22:41:53.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.431+0000 7f5c5ffff640 1 -- 172.21.15.134:0/3212118731 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58032b50 con 0x7f5c600d02a0 2024-09-15T22:41:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 -- 172.21.15.134:0/3212118731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c600d02a0 msgr2=0x7f5c600d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c600d02a0 0x7f5c600d0680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800bb10 tx=0x7f5c5802c890 comp rx=0 tx=0).stop 2024-09-15T22:41:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 -- 172.21.15.134:0/3212118731 shutdown_connections 2024-09-15T22:41:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ca40 0x7f5c6015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 --2- 172.21.15.134:0/3212118731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c600d02a0 0x7f5c600d0680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 -- 172.21.15.134:0/3212118731 >> 172.21.15.134:0/3212118731 conn(0x7f5c60062cc0 msgr2=0x7f5c6006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 -- 172.21.15.134:0/3212118731 shutdown_connections 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.432+0000 7f5c6747b640 1 -- 172.21.15.134:0/3212118731 wait complete. 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.433+0000 7f5c6747b640 1 Processor -- start 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.433+0000 7f5c6747b640 1 -- start start 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c600d02a0 0x7f5c600b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ce80 0x7f5c6014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c60155b90 con 0x7f5c6015ca40 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6015df10 con 0x7f5c600d02a0 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c6747b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c60155d10 con 0x7f5c6015ce80 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35876/0 (socket says 172.21.15.134:35876) 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 -- 172.21.15.134:0/2335349297 learned_addr learned my addr 172.21.15.134:0/2335349297 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c65217640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c600d02a0 0x7f5c600b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c65a18640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ce80 0x7f5c6014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 -- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ce80 msgr2=0x7f5c6014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ce80 0x7f5c6014adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 -- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c600d02a0 msgr2=0x7f5c600b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c600d02a0 0x7f5c600b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 -- 172.21.15.134:0/2335349297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c601f4870 con 0x7f5c6015ca40 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.434+0000 7f5c64a16640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c7f0 tx=0x7f5c5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.435+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54015070 con 0x7f5c6015ca40 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.435+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c54007a30 con 0x7f5c6015ca40 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.435+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c601f4b10 con 0x7f5c6015ca40 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.435+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54007e00 con 0x7f5c6015ca40 2024-09-15T22:41:53.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.435+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c601f50d0 con 0x7f5c6015ca40 2024-09-15T22:41:53.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.436+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c600b4790 con 0x7f5c6015ca40 2024-09-15T22:41:53.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.436+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c54018070 con 0x7f5c6015ca40 2024-09-15T22:41:53.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.437+0000 7f5c5dffb640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 0x7f5c4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.437+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5c5408b2b0 con 0x7f5c6015ca40 2024-09-15T22:41:53.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.437+0000 7f5c65217640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 0x7f5c4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.437+0000 7f5c65217640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 0x7f5c4c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c58037000 tx=0x7f5c58032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.441+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c54059460 con 0x7f5c6015ca40 2024-09-15T22:41:53.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.640+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c6006d360 con 0x7f5c6015ca40 2024-09-15T22:41:53.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.641+0000 7f5c5dffb640 1 -- 172.21.15.134:0/2335349297 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f5c5405d760 con 0x7f5c6015ca40 2024-09-15T22:41:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:53.642 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:53.643 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 msgr2=0x7f5c4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 0x7f5c4c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c58037000 tx=0x7f5c58032000 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 msgr2=0x7f5c601f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c7f0 tx=0x7f5c5400cbf0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 shutdown_connections 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c4c06c2b0 0x7f5c4c06e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c6015ce80 0x7f5c6014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6015ca40 0x7f5c601f4330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 --2- 172.21.15.134:0/2335349297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c600d02a0 0x7f5c600b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 >> 172.21.15.134:0/2335349297 conn(0x7f5c60062cc0 msgr2=0x7f5c600cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 shutdown_connections 2024-09-15T22:41:53.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.643+0000 7f5c6747b640 1 -- 172.21.15.134:0/2335349297 wait complete. 2024-09-15T22:41:53.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:53.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.753+0000 7f04684c9640 1 Processor -- start 2024-09-15T22:41:53.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.753+0000 7f04684c9640 1 -- start start 2024-09-15T22:41:53.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f04684c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f046015e960 0x7f04600b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f04684c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f04600cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f04684c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046015ed40 con 0x7f0460073390 2024-09-15T22:41:53.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f04684c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f04600b78a0 con 0x7f046015e960 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f04684c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f046006ce50 con 0x7f04600b4bd0 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f046015e960 0x7f04600b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f046015e960 0x7f04600b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:47056/0 (socket says 172.21.15.134:47056) 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 -- 172.21.15.134:0/3205042051 learned_addr learned my addr 172.21.15.134:0/3205042051 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466a66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f04600cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 -- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 msgr2=0x7f04600cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 --2- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f04600cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 -- 172.21.15.134:0/3205042051 >> v1:172.21.15.177:6789/0 conn(0x7f0460073390 legacy=0x7f04600b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.754+0000 7f0466265640 1 -- 172.21.15.134:0/3205042051 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600b72e0 con 0x7f046015e960 2024-09-15T22:41:53.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.755+0000 7f0466265640 1 --2- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04600b6ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f045c009870 tx=0x7f045c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f1cc81c98f0e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.755+0000 7f0465263640 1 -- 172.21.15.134:0/3205042051 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c037070 con 0x7f046015e960 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.755+0000 7f0465263640 1 -- 172.21.15.134:0/3205042051 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c032440 con 0x7f046015e960 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.755+0000 7f0465263640 1 -- 172.21.15.134:0/3205042051 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c032810 con 0x7f046015e960 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 -- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 msgr2=0x7f04600b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 --2- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04600b6ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f045c009870 tx=0x7f045c02a270 comp rx=0 tx=0).stop 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 -- 172.21.15.134:0/3205042051 shutdown_connections 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 --2- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f04600cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 --2- 172.21.15.134:0/3205042051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04600b6ce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 -- 172.21.15.134:0/3205042051 >> 172.21.15.134:0/3205042051 conn(0x7f0460062810 msgr2=0x7f0460062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 -- 172.21.15.134:0/3205042051 shutdown_connections 2024-09-15T22:41:53.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.756+0000 7f04684c9640 1 -- 172.21.15.134:0/3205042051 wait complete. 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.757+0000 7f04684c9640 1 Processor -- start 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.757+0000 7f04684c9640 1 -- start start 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f0460151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04601520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0460073cb0 con 0x7f0460073390 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f046006d0f0 con 0x7f046015e960 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f04684c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0460073e30 con 0x7f04600b4bd0 2024-09-15T22:41:53.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35886/0 (socket says 172.21.15.134:35886) 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 -- 172.21.15.134:0/655514797 learned_addr learned my addr 172.21.15.134:0/655514797 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0465a64640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f0460151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466a66640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04601520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 -- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 msgr2=0x7f0460151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f0460151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 -- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 msgr2=0x7f04601520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04601520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 -- 172.21.15.134:0/655514797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460142000 con 0x7f0460073390 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466a66640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04601520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.758+0000 7f0466265640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.759+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c037040 con 0x7f0460073390 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.759+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c042070 con 0x7f0460073390 2024-09-15T22:41:53.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.759+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c030860 con 0x7f0460073390 2024-09-15T22:41:53.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.759+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046015ff40 con 0x7f0460073390 2024-09-15T22:41:53.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.759+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04601424a0 con 0x7f0460073390 2024-09-15T22:41:53.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.760+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460160460 con 0x7f0460073390 2024-09-15T22:41:53.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.760+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f045c030a00 con 0x7f0460073390 2024-09-15T22:41:53.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.760+0000 7f0456ffd640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:53.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.761+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f045c0abc30 con 0x7f0460073390 2024-09-15T22:41:53.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.761+0000 7f0465a64640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:53.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.761+0000 7f0465a64640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3b00 tx=0x7f0450009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:53.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.765+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0460160460 con 0x7f0460073390 2024-09-15T22:41:53.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.966+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04600b6ce0 con 0x7f0460073390 2024-09-15T22:41:53.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.966+0000 7f0456ffd640 1 -- 172.21.15.134:0/655514797 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f045c07a3a0 con 0x7f0460073390 2024-09-15T22:41:53.968 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:53.968 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:53.968 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:53.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 msgr2=0x7f044406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3b00 tx=0x7f0450009040 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 msgr2=0x7f0460141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 shutdown_connections 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046015e960 0x7f04601520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04600b4bd0 0x7f0460151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 --2- 172.21.15.134:0/655514797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0460073390 0x7f0460141ac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 >> 172.21.15.134:0/655514797 conn(0x7f0460062810 msgr2=0x7f04600b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 shutdown_connections 2024-09-15T22:41:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:53.968+0000 7f04684c9640 1 -- 172.21.15.134:0/655514797 wait complete. 2024-09-15T22:41:53.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:54.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.077+0000 7fa87f1c4640 1 Processor -- start 2024-09-15T22:41:54.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.077+0000 7fa87f1c4640 1 -- start start 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87f1c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87815e7b0 0x7fa878071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87f1c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa87806ccb0 0x7fa87806d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87f1c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa878071880 con 0x7fa8780b5600 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87f1c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa87806e680 con 0x7fa87806ccb0 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87f1c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa87806d660 con 0x7fa87815e7b0 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa87806ccb0 0x7fa87806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa87806ccb0 0x7fa87806d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35890/0 (socket says 172.21.15.134:35890) 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 -- 172.21.15.134:0/958276162 learned_addr learned my addr 172.21.15.134:0/958276162 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa877fff640 1 --1- 172.21.15.134:0/958276162 >> v1:172.21.15.134:6789/0 conn(0x7fa8780b5600 0x7fa878073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42942/0 (socket says 172.21.15.134:42942) 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87cf60640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87815e7b0 0x7fa878071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 -- 172.21.15.134:0/958276162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87815e7b0 msgr2=0x7fa878071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87815e7b0 0x7fa878071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 -- 172.21.15.134:0/958276162 >> v1:172.21.15.134:6789/0 conn(0x7fa8780b5600 legacy=0x7fa878073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa87d761640 1 -- 172.21.15.134:0/958276162 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8780741c0 con 0x7fa87806ccb0 2024-09-15T22:41:54.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.078+0000 7fa8777fe640 1 -- 172.21.15.134:0/958276162 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812022146 0 0) 0x7fa86c001110 con 0x7fa8780b5600 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.079+0000 7fa87d761640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87806ccb0 0x7fa87806d120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa870009e50 tx=0x7fa87002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413a0bd78ed7fc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.079+0000 7fa8777fe640 1 -- 172.21.15.134:0/958276162 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870036070 con 0x7fa87806ccb0 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.079+0000 7fa8777fe640 1 -- 172.21.15.134:0/958276162 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa870031600 con 0x7fa87806ccb0 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.079+0000 7fa8777fe640 1 -- 172.21.15.134:0/958276162 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700319d0 con 0x7fa87806ccb0 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 -- 172.21.15.134:0/958276162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87806ccb0 msgr2=0x7fa87806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87806ccb0 0x7fa87806d120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa870009e50 tx=0x7fa87002a680 comp rx=0 tx=0).stop 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 -- 172.21.15.134:0/958276162 shutdown_connections 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87806ccb0 0x7fa87806d120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/958276162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87815e7b0 0x7fa878071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 -- 172.21.15.134:0/958276162 >> 172.21.15.134:0/958276162 conn(0x7fa8780b4300 msgr2=0x7fa8780b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 -- 172.21.15.134:0/958276162 shutdown_connections 2024-09-15T22:41:54.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.080+0000 7fa87f1c4640 1 -- 172.21.15.134:0/958276162 wait complete. 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.081+0000 7fa87f1c4640 1 Processor -- start 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.081+0000 7fa87f1c4640 1 -- start start 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87806ccb0 0x7fa878158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 0x7fa878151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780732b0 con 0x7fa8780b5600 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa87806ebb0 con 0x7fa87815e7b0 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87f1c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa878073590 con 0x7fa87806ccb0 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35894/0 (socket says 172.21.15.134:35894) 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 -- 172.21.15.134:0/3497433136 learned_addr learned my addr 172.21.15.134:0/3497433136 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:54.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87d761640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 0x7fa878151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87cf60640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87806ccb0 0x7fa878158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 -- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87806ccb0 msgr2=0x7fa878158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87806ccb0 0x7fa878158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 -- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 msgr2=0x7fa878151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 0x7fa878151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa877fff640 1 -- 172.21.15.134:0/3497433136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa878158e00 con 0x7fa8780b5600 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.082+0000 7fa87d761640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 0x7fa878151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa877fff640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c750 tx=0x7fa86c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c018070 con 0x7fa8780b5600 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c0072d0 con 0x7fa8780b5600 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0047e0 con 0x7fa8780b5600 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8781590e0 con 0x7fa8780b5600 2024-09-15T22:41:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.083+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781596a0 con 0x7fa8780b5600 2024-09-15T22:41:54.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.084+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8780b1a90 con 0x7fa8780b5600 2024-09-15T22:41:54.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.084+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa86c01b070 con 0x7fa8780b5600 2024-09-15T22:41:54.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.085+0000 7fa8757fa640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 0x7fa86406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.085+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa86c08a790 con 0x7fa8780b5600 2024-09-15T22:41:54.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.085+0000 7fa87cf60640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 0x7fa86406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.085+0000 7fa87cf60640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 0x7fa86406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.089+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa878071880 con 0x7fa8780b5600 2024-09-15T22:41:54.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.256+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8780b4e50 con 0x7fa8780b5600 2024-09-15T22:41:54.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.257+0000 7fa8757fa640 1 -- 172.21.15.134:0/3497433136 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7fa86c058f00 con 0x7fa8780b5600 2024-09-15T22:41:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:54.258 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:54.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 msgr2=0x7fa86406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 0x7fa86406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868008040 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 msgr2=0x7fa878158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c750 tx=0x7fa86c00cc10 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 shutdown_connections 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa86406c2b0 0x7fa86406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87815e7b0 0x7fa878151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8780b5600 0x7fa878158040 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 --2- 172.21.15.134:0/3497433136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa87806ccb0 0x7fa878158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 >> 172.21.15.134:0/3497433136 conn(0x7fa8780b4300 msgr2=0x7fa8780b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 shutdown_connections 2024-09-15T22:41:54.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.259+0000 7fa87f1c4640 1 -- 172.21.15.134:0/3497433136 wait complete. 2024-09-15T22:41:54.272 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:41:54.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:54.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 Processor -- start 2024-09-15T22:41:54.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 -- start start 2024-09-15T22:41:54.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e1015ed20 0x7f9e100d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e100cef90 0x7f9e100b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9e100d1ae0 con 0x7f9e100cef90 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9e100b7170 con 0x7f9e1015ed20 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.370+0000 7f9e16bef640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9e100b7aa0 con 0x7f9e1015e940 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e100cef90 0x7f9e100b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e100cef90 0x7f9e100b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35908/0 (socket says 172.21.15.134:35908) 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 -- 172.21.15.134:0/600727663 learned_addr learned my addr 172.21.15.134:0/600727663 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e0ffff640 1 --2- 172.21.15.134:0/600727663 >> v2:172.21.15.177:3300/0 conn(0x7f9e1015ed20 0x7f9e100d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 -- 172.21.15.134:0/600727663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 msgr2=0x7f9e100d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 --2- 172.21.15.134:0/600727663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 -- 172.21.15.134:0/600727663 >> v2:172.21.15.177:3300/0 conn(0x7f9e1015ed20 msgr2=0x7f9e100d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:54.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 --2- 172.21.15.134:0/600727663 >> v2:172.21.15.177:3300/0 conn(0x7f9e1015ed20 0x7f9e100d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.371+0000 7f9e1518c640 1 -- 172.21.15.134:0/600727663 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e100d3660 con 0x7f9e100cef90 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e1518c640 1 --2- 172.21.15.134:0/600727663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e100cef90 0x7f9e100b3220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e100d5830 tx=0x7f9e0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84dd24e5920648e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e0f7fe640 1 -- 172.21.15.134:0/600727663 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08036070 con 0x7f9e100cef90 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e0f7fe640 1 -- 172.21.15.134:0/600727663 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08031600 con 0x7f9e100cef90 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e0f7fe640 1 -- 172.21.15.134:0/600727663 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e080319d0 con 0x7f9e100cef90 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 -- 172.21.15.134:0/600727663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e100cef90 msgr2=0x7f9e100b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 --2- 172.21.15.134:0/600727663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e100cef90 0x7f9e100b3220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e100d5830 tx=0x7f9e0802a730 comp rx=0 tx=0).stop 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 -- 172.21.15.134:0/600727663 shutdown_connections 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 --2- 172.21.15.134:0/600727663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e100cef90 0x7f9e100b3220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 --2- 172.21.15.134:0/600727663 >> v2:172.21.15.177:3300/0 conn(0x7f9e1015ed20 0x7f9e100d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 --2- 172.21.15.134:0/600727663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 -- 172.21.15.134:0/600727663 >> 172.21.15.134:0/600727663 conn(0x7f9e100b6240 msgr2=0x7f9e100b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 -- 172.21.15.134:0/600727663 shutdown_connections 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.372+0000 7f9e16bef640 1 -- 172.21.15.134:0/600727663 wait complete. 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.373+0000 7f9e16bef640 1 Processor -- start 2024-09-15T22:41:54.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 -- start start 2024-09-15T22:41:54.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e100cef90 0x7f9e10159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100d3f00 con 0x7f9e1015ed20 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100d3c20 con 0x7f9e100cef90 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e16bef640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9e100d1ef0 con 0x7f9e1015e940 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.374+0000 7f9e1518c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35916/0 (socket says 172.21.15.134:35916) 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 -- 172.21.15.134:0/2235371137 learned_addr learned my addr 172.21.15.134:0/2235371137 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1498b640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e100cef90 0x7f9e10159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e0ffff640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 -- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 msgr2=0x7f9e100ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 -- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e100cef90 msgr2=0x7f9e10159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e100cef90 0x7f9e10159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 -- 172.21.15.134:0/2235371137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e10158b40 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e1518c640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009f40 tx=0x7f9e08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08036050 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08042070 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e10158e20 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08009510 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.375+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e101593e0 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.376+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e101607f0 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.377+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e08007c70 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.377+0000 7f9e0d7fa640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 0x7f9df406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.377+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9e080ac4a0 con 0x7f9e1015ed20 2024-09-15T22:41:54.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.377+0000 7f9e1498b640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 0x7f9df406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.378+0000 7f9e1498b640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 0x7f9df406e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e10157090 tx=0x7f9e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.381+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e101607f0 con 0x7f9e1015ed20 2024-09-15T22:41:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.576+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e100d1060 con 0x7f9e1015ed20 2024-09-15T22:41:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.577+0000 7f9e0d7fa640 1 -- 172.21.15.134:0/2235371137 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f9e0807ac10 con 0x7f9e1015ed20 2024-09-15T22:41:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:54.578 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 msgr2=0x7f9df406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 0x7f9df406e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e10157090 tx=0x7f9e04008040 comp rx=0 tx=0).stop 2024-09-15T22:41:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 msgr2=0x7f9e100ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009f40 tx=0x7f9e08004a40 comp rx=0 tx=0).stop 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 shutdown_connections 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9df406c2b0 0x7f9df406e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1015ed20 0x7f9e100ccaf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e1015e940 0x7f9e100ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 --2- 172.21.15.134:0/2235371137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e100cef90 0x7f9e10159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 >> 172.21.15.134:0/2235371137 conn(0x7f9e100b6240 msgr2=0x7f9e100b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 shutdown_connections 2024-09-15T22:41:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.579+0000 7f9e16bef640 1 -- 172.21.15.134:0/2235371137 wait complete. 2024-09-15T22:41:54.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:41:54.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.688+0000 7f7cfa9bd640 1 Processor -- start 2024-09-15T22:41:54.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.688+0000 7f7cfa9bd640 1 -- start start 2024-09-15T22:41:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cfa9bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cf40d02a0 0x7f7cf40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cfa9bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf40d0bc0 con 0x7f7cf415ca40 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cfa9bd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf415d390 con 0x7f7cf415ceb0 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cfa9bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf415d670 con 0x7f7cf40d02a0 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cf40d02a0 0x7f7cf40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7cf415ca40 0x7f7cf415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42956/0 (socket says 172.21.15.134:42956) 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf37fe640 1 -- 172.21.15.134:0/3850333238 learned_addr learned my addr 172.21.15.134:0/3850333238 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cf40d02a0 0x7f7cf40d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35928/0 (socket says 172.21.15.134:35928) 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf3fff640 1 -- 172.21.15.134:0/3850333238 >> v1:172.21.15.177:6789/0 conn(0x7f7cf415ceb0 legacy=0x7f7cf41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf3fff640 1 -- 172.21.15.134:0/3850333238 >> v1:172.21.15.134:6789/0 conn(0x7f7cf415ca40 legacy=0x7f7cf415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.689+0000 7f7cf3fff640 1 -- 172.21.15.134:0/3850333238 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf415d950 con 0x7f7cf40d02a0 2024-09-15T22:41:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.690+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/3850333238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf40d02a0 0x7f7cf40d0680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40097a0 tx=0x7f7ce402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e3565108e5c1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.690+0000 7f7cf2ffd640 1 -- 172.21.15.134:0/3850333238 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4037070 con 0x7f7cf40d02a0 2024-09-15T22:41:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.690+0000 7f7cf2ffd640 1 -- 172.21.15.134:0/3850333238 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce402ae50 con 0x7f7cf40d02a0 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.690+0000 7f7cf2ffd640 1 -- 172.21.15.134:0/3850333238 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4032660 con 0x7f7cf40d02a0 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/3850333238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf40d02a0 msgr2=0x7f7cf40d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/3850333238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf40d02a0 0x7f7cf40d0680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40097a0 tx=0x7f7ce402a140 comp rx=0 tx=0).stop 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/3850333238 shutdown_connections 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/3850333238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf40d02a0 0x7f7cf40d0680 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/3850333238 >> 172.21.15.134:0/3850333238 conn(0x7f7cf4062cc0 msgr2=0x7f7cf406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/3850333238 shutdown_connections 2024-09-15T22:41:54.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.691+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/3850333238 wait complete. 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.692+0000 7f7cfa9bd640 1 Processor -- start 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.692+0000 7f7cfa9bd640 1 -- start start 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 0x7f7cf40af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 0x7f7cf4073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf415eb40 con 0x7f7cf415ceb0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf415df10 con 0x7f7cf415ca40 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf4155b90 con 0x7f7cf40d02a0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35934/0 (socket says 172.21.15.134:35934) 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 -- 172.21.15.134:0/717267477 learned_addr learned my addr 172.21.15.134:0/717267477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 0x7f7cf40af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf37fe640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 0x7f7cf4073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 -- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 msgr2=0x7f7cf40af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 0x7f7cf40af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 -- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 msgr2=0x7f7cf4073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 0x7f7cf4073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 -- 172.21.15.134:0/717267477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf41e4610 con 0x7f7cf415ceb0 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 0x7f7cf40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf37fe640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 0x7f7cf4073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf8f5a640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c780 tx=0x7f7cec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec017070 con 0x7f7cf415ceb0 2024-09-15T22:41:54.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec003da0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf41e48f0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.693+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0052b0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.694+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf41e4eb0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.695+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf40b4790 con 0x7f7cf415ceb0 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.695+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7cec01a070 con 0x7f7cf415ceb0 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.695+0000 7f7cf0ff9640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.696+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7cec08aaa0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.696+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:54.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.696+0000 7f7cf3fff640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 0x7f7ce006e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4034000 tx=0x7f7ce402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:54.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.700+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cec0592a0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.897+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cf40b1260 con 0x7f7cf415ceb0 2024-09-15T22:41:54.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.898+0000 7f7cf0ff9640 1 -- 172.21.15.134:0/717267477 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f7cec058ba0 con 0x7f7cf415ceb0 2024-09-15T22:41:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:54.899 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":6,"btime":"2024-09-15T22:41:28:696189+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3131220276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3131220276},{"type":"v1","addr":"172.21.15.134:6837","nonce":3131220276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/404613908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":404613908},{"type":"v1","addr":"172.21.15.134:6836","nonce":404613908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1464098761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1464098761},{"type":"v1","addr":"172.21.15.177:6833","nonce":1464098761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:41:26.022625+0000","modified":"2024-09-15T22:41:28.026546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1771891380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1771891380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1771891380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-15T22:41:54.900 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 6 2024-09-15T22:41:54.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 msgr2=0x7f7ce006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 0x7f7ce006e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4034000 tx=0x7f7ce402e000 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 msgr2=0x7f7cf40737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c780 tx=0x7f7cec00cc40 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 shutdown_connections 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf415ceb0 0x7f7cf40737c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cf415ca40 0x7f7cf4073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 --2- 172.21.15.134:0/717267477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cf40d02a0 0x7f7cf40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 >> 172.21.15.134:0/717267477 conn(0x7f7cf4062cc0 msgr2=0x7f7cf40b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 shutdown_connections 2024-09-15T22:41:54.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:54.900+0000 7f7cfa9bd640 1 -- 172.21.15.134:0/717267477 wait complete. 2024-09-15T22:41:54.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:41:55.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.009+0000 7f0b98bc4640 1 Processor -- start 2024-09-15T22:41:55.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.009+0000 7f0b98bc4640 1 -- start start 2024-09-15T22:41:55.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b98bc4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b94073390 0x7f0b940b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b98bc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9415ed40 con 0x7f0b9415e960 2024-09-15T22:41:55.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b98bc4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9406ce50 con 0x7f0b940b4bd0 2024-09-15T22:41:55.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b98bc4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0b940b78a0 con 0x7f0b94073390 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b9259c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0b9415e960 0x7f0b940b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42968/0 (socket says 172.21.15.134:42968) 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.010+0000 7f0b9259c640 1 -- 172.21.15.134:0/2290726305 learned_addr learned my addr 172.21.15.134:0/2290726305 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/2290726305 >> v2:172.21.15.177:3300/0 conn(0x7f0b94073390 0x7f0b940b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959763624 0 0) 0x7f0b9415ed40 con 0x7f0b9415e960 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7c003520 con 0x7f0b9415e960 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1760608590 0 0) 0x7f0b7c003520 con 0x7f0b9415e960 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 >> v2:172.21.15.177:3300/0 conn(0x7f0b94073390 msgr2=0x7f0b940b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 --2- 172.21.15.134:0/2290726305 >> v2:172.21.15.177:3300/0 conn(0x7f0b94073390 0x7f0b940b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 >> v1:172.21.15.177:6789/0 conn(0x7f0b940b4bd0 legacy=0x7f0b9406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b940b72e0 con 0x7f0b9415e960 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0b84001670 con 0x7f0b9415e960 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 >> v1:172.21.15.134:6789/0 conn(0x7f0b9415e960 legacy=0x7f0b940b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0039b0 0x7f0b7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 0x7f0b7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b940b78a0 con 0x7f0b7c0051c0 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c00c060 con 0x7f0b7c0039b0 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c00c260 con 0x7f0b7c004800 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 0x7f0b7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b9259c640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0039b0 0x7f0b7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 -- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c004800 msgr2=0x7f0b7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 -- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0039b0 msgr2=0x7f0b7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0039b0 0x7f0b7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b92d9d640 1 -- 172.21.15.134:0/2290726305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c003520 con 0x7f0b7c0051c0 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.011+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.012+0000 7f0b92d9d640 1 -- 172.21.15.134:0/2290726305 reap_dead start 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.012+0000 7f0b92d9d640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 0x7f0b7c00b9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c001e20 tx=0x7f0b7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7bbab84050d42a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.012+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c001a70 con 0x7f0b7c0051c0 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.012+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c02ae40 con 0x7f0b7c0051c0 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.012+0000 7f0b9159a640 1 -- 172.21.15.134:0/2290726305 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c003bb0 con 0x7f0b7c0051c0 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 -- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 msgr2=0x7f0b7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 0x7f0b7c00b9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c001e20 tx=0x7f0b7c005830 comp rx=0 tx=0).stop 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 -- 172.21.15.134:0/2290726305 shutdown_connections 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/2290726305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c0051c0 0x7f0b7c00b9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 -- 172.21.15.134:0/2290726305 >> 172.21.15.134:0/2290726305 conn(0x7f0b94062810 msgr2=0x7f0b94062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:55.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 -- 172.21.15.134:0/2290726305 shutdown_connections 2024-09-15T22:41:55.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.013+0000 7f0b98bc4640 1 -- 172.21.15.134:0/2290726305 wait complete. 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.014+0000 7f0b98bc4640 1 Processor -- start 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.014+0000 7f0b98bc4640 1 -- start start 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c0051c0 0x7f0b9415f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b941f44b0 0x7f0b941f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94073cb0 con 0x7f0b9415fe80 2024-09-15T22:41:55.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9406d0f0 con 0x7f0b941f44b0 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b98bc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b94073e30 con 0x7f0b7c0051c0 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35956/0 (socket says 172.21.15.134:35956) 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 -- 172.21.15.134:0/893531708 learned_addr learned my addr 172.21.15.134:0/893531708 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b92d9d640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b941f44b0 0x7f0b941f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b9259c640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c0051c0 0x7f0b9415f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 -- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c0051c0 msgr2=0x7f0b9415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c0051c0 0x7f0b9415f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 -- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b941f44b0 msgr2=0x7f0b941f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b941f44b0 0x7f0b941f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.015+0000 7f0b91d9b640 1 -- 172.21.15.134:0/893531708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b94160370 con 0x7f0b9415fe80 2024-09-15T22:41:55.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b91d9b640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b88011540 tx=0x7f0b88011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88015870 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b88015a10 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b94160650 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88015dc0 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.016+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b941f5610 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.017+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b940b6ce0 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.017+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b8801d400 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.018+0000 7f0b82ffd640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 0x7f0b7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.018+0000 7f0b9259c640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 0x7f0b7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.018+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b8808bb70 con 0x7f0b9415fe80 2024-09-15T22:41:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.018+0000 7f0b9259c640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 0x7f0b7406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b840017e0 tx=0x7f0b84001590 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.022+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b88019030 con 0x7f0b9415fe80 2024-09-15T22:41:55.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.187+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b94069160 con 0x7f0b9415fe80 2024-09-15T22:41:55.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.188+0000 7f0b82ffd640 1 -- 172.21.15.134:0/893531708 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16705 (secure 0 0 0) 0x7f0b88060070 con 0x7f0b9415fe80 2024-09-15T22:41:55.190 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:41:55.190 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:41:27.691605+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:41:23.739181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:41:25.007723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:41:55.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.190+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 msgr2=0x7f0b7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.190+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 0x7f0b7406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b840017e0 tx=0x7f0b84001590 comp rx=0 tx=0).stop 2024-09-15T22:41:55.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.190+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 msgr2=0x7f0b941f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.190+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b88011540 tx=0x7f0b88011940 comp rx=0 tx=0).stop 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.190+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 shutdown_connections 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0b7406c2b0 0x7f0b7406e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b941f44b0 0x7f0b941f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9415fe80 0x7f0b941f3f70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 --2- 172.21.15.134:0/893531708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b7c0051c0 0x7f0b9415f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 >> 172.21.15.134:0/893531708 conn(0x7f0b94062810 msgr2=0x7f0b9406fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 shutdown_connections 2024-09-15T22:41:55.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.191+0000 7f0b98bc4640 1 -- 172.21.15.134:0/893531708 wait complete. 2024-09-15T22:41:55.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:41:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.301+0000 7f0c8d9bd640 1 Processor -- start 2024-09-15T22:41:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.301+0000 7f0c8d9bd640 1 -- start start 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c8d9bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c880d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c8d9bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c880b7170 con 0x7f0c8815ed20 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c8d9bd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c880b7aa0 con 0x7f0c880cef90 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c8d9bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0c880d3660 con 0x7f0c8815e940 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c867fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0c8815ed20 0x7f0c880b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42980/0 (socket says 172.21.15.134:42980) 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.302+0000 7f0c867fc640 1 -- 172.21.15.134:0/2206629467 learned_addr learned my addr 172.21.15.134:0/2206629467 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c880d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941256672 0 0) 0x7f0c70001110 con 0x7f0c8815ed20 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c74003520 con 0x7f0c8815ed20 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1195564063 0 0) 0x7f0c74003520 con 0x7f0c8815ed20 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 msgr2=0x7f0c880d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c880d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 >> v1:172.21.15.177:6789/0 conn(0x7f0c880cef90 legacy=0x7f0c880b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c880d3940 con 0x7f0c8815ed20 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0c70001840 con 0x7f0c8815ed20 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 >> v1:172.21.15.134:6789/0 conn(0x7f0c8815ed20 legacy=0x7f0c880b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74003f20 0x7f0c74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c74004d40 0x7f0c740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880d3660 con 0x7f0c74003f20 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7400ba20 con 0x7f0c74004d40 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7400bc20 con 0x7f0c8815e940 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74003f20 0x7f0c74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c877fe640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c74004d40 0x7f0c740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 -- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 msgr2=0x7f0c740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c8815e940 0x7f0c740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 -- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c74004d40 msgr2=0x7f0c740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c74004d40 0x7f0c740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c867fc640 1 -- 172.21.15.134:0/2206629467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c74003520 con 0x7f0c74003f20 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.303+0000 7f0c877fe640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c74004d40 0x7f0c740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.304+0000 7f0c867fc640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74003f20 0x7f0c74004800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c4c0 tx=0x7f0c74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5982f009e378ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.304+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70036070 con 0x7f0c74003f20 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.304+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c70005ad0 con 0x7f0c74003f20 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.304+0000 7f0c85ffb640 1 -- 172.21.15.134:0/2206629467 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000c0e0 con 0x7f0c74003f20 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/2206629467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74003f20 msgr2=0x7f0c74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/2206629467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74003f20 0x7f0c74004800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c4c0 tx=0x7f0c74005830 comp rx=0 tx=0).stop 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c877fe640 1 -- 172.21.15.134:0/2206629467 reap_dead start 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/2206629467 shutdown_connections 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/2206629467 >> 172.21.15.134:0/2206629467 conn(0x7f0c880b6240 msgr2=0x7f0c880b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/2206629467 shutdown_connections 2024-09-15T22:41:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.305+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/2206629467 wait complete. 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.306+0000 7f0c8d9bd640 1 Processor -- start 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.306+0000 7f0c8d9bd640 1 -- start start 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 0x7f0c88158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c880c8440 0x7f0c880caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880d3310 con 0x7f0c8815acb0 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880d3f00 con 0x7f0c880c8440 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c8d9bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0c880d1ef0 con 0x7f0c74003f20 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35964/0 (socket says 172.21.15.134:35964) 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 -- 172.21.15.134:0/1764235601 learned_addr learned my addr 172.21.15.134:0/1764235601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c867fc640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c880c8440 0x7f0c880caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 0x7f0c88158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 -- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 msgr2=0x7f0c88158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 0x7f0c88158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 -- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c880c8440 msgr2=0x7f0c880caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c880c8440 0x7f0c880caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 -- 172.21.15.134:0/1764235601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c880c88c0 con 0x7f0c8815acb0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 0x7f0c88158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c877fe640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c880d04f0 tx=0x7f0c8000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.307+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80019070 con 0x7f0c8815acb0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.308+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c800052e0 con 0x7f0c8815acb0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.308+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c880cb800 con 0x7f0c8815acb0 2024-09-15T22:41:55.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.308+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80003850 con 0x7f0c8815acb0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.308+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c880cbdc0 con 0x7f0c8815acb0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.309+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c880d1060 con 0x7f0c8815acb0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.309+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c8001c070 con 0x7f0c8815acb0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.310+0000 7f0c7ffff640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 0x7f0c6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.310+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 0x7f0c6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.310+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0c8008a960 con 0x7f0c8815acb0 2024-09-15T22:41:55.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.310+0000 7f0c86ffd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 0x7f0c6806e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c78007440 tx=0x7f0c7800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.314+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c800590d0 con 0x7f0c8815acb0 2024-09-15T22:41:55.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.511+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0c880ba6b0 con 0x7f0c8815acb0 2024-09-15T22:41:55.513 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:41:55.512+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.513+0000 7f0c7ffff640 1 -- 172.21.15.134:0/1764235601 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f0c800589d0 con 0x7f0c8815acb0 2024-09-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:41:55.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 msgr2=0x7f0c6806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 0x7f0c6806e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c78007440 tx=0x7f0c7800b040 comp rx=0 tx=0).stop 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 msgr2=0x7f0c8815b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c880d04f0 tx=0x7f0c8000e890 comp rx=0 tx=0).stop 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 shutdown_connections 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0c6806c2e0 0x7f0c6806e7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8815acb0 0x7f0c8815b130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c880c8440 0x7f0c880caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 --2- 172.21.15.134:0/1764235601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c74003f20 0x7f0c88158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 >> 172.21.15.134:0/1764235601 conn(0x7f0c880b6240 msgr2=0x7f0c88161160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:55.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 shutdown_connections 2024-09-15T22:41:55.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.515+0000 7f0c8d9bd640 1 -- 172.21.15.134:0/1764235601 wait complete. 2024-09-15T22:41:55.521 INFO:tasks.ceph.mds.d.smithi177.stderr: -6560> 2024-09-15T22:41:31.562+0000 7f8be629e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:41:55.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:41:55.555 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:41:55.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.628+0000 7f43c9401640 1 Processor -- start 2024-09-15T22:41:55.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.628+0000 7f43c9401640 1 -- start start 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c9401640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c9401640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43c4162bc0 0x7f43c4073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c9401640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c415fa60 con 0x7f43c415e670 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c9401640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f43c4072fa0 con 0x7f43c4162bc0 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c9401640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f43c40d0eb0 con 0x7f43c4070f20 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43c4162bc0 0x7f43c4073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c2ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f43c415e670 0x7f43c4070810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42996/0 (socket says 172.21.15.134:42996) 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c2ffd640 1 -- 172.21.15.134:0/430800274 learned_addr learned my addr 172.21.15.134:0/430800274 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c37fe640 1 -- 172.21.15.134:0/430800274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 msgr2=0x7f43c406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c37fe640 1 --2- 172.21.15.134:0/430800274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c37fe640 1 -- 172.21.15.134:0/430800274 >> v1:172.21.15.134:6789/0 conn(0x7f43c415e670 legacy=0x7f43c4070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c37fe640 1 -- 172.21.15.134:0/430800274 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c40d1190 con 0x7f43c4162bc0 2024-09-15T22:41:55.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.629+0000 7f43c27fc640 1 -- 172.21.15.134:0/430800274 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226134734 0 0) 0x7f43c415fa60 con 0x7f43c415e670 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.630+0000 7f43c37fe640 1 --2- 172.21.15.134:0/430800274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c4162bc0 0x7f43c4073430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009d90 tx=0x7f43bc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1199d6f2d24d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.630+0000 7f43c27fc640 1 -- 172.21.15.134:0/430800274 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc007740 con 0x7f43c4162bc0 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.630+0000 7f43c27fc640 1 -- 172.21.15.134:0/430800274 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0078e0 con 0x7f43c4162bc0 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.630+0000 7f43c27fc640 1 -- 172.21.15.134:0/430800274 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc007cb0 con 0x7f43c4162bc0 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 -- 172.21.15.134:0/430800274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c4162bc0 msgr2=0x7f43c4073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 --2- 172.21.15.134:0/430800274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c4162bc0 0x7f43c4073430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009d90 tx=0x7f43bc02a680 comp rx=0 tx=0).stop 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 -- 172.21.15.134:0/430800274 shutdown_connections 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 --2- 172.21.15.134:0/430800274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c4162bc0 0x7f43c4073430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 --2- 172.21.15.134:0/430800274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 -- 172.21.15.134:0/430800274 >> 172.21.15.134:0/430800274 conn(0x7f43c40d2440 msgr2=0x7f43c40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:55.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 -- 172.21.15.134:0/430800274 shutdown_connections 2024-09-15T22:41:55.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.631+0000 7f43c9401640 1 -- 172.21.15.134:0/430800274 wait complete. 2024-09-15T22:41:55.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 Processor -- start 2024-09-15T22:41:55.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 -- start start 2024-09-15T22:41:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c41593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c4162bc0 0x7f43c40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4071680 con 0x7f43c415e670 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4071500 con 0x7f43c4162bc0 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.632+0000 7f43c9401640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f43c40d3080 con 0x7f43c4070f20 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35980/0 (socket says 172.21.15.134:35980) 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 -- 172.21.15.134:0/31373468 learned_addr learned my addr 172.21.15.134:0/31373468 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43c2ffd640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c41593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43c37fe640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c4162bc0 0x7f43c40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 -- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 msgr2=0x7f43c41593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c41593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 -- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c4162bc0 msgr2=0x7f43c40cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c4162bc0 0x7f43c40cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 -- 172.21.15.134:0/31373468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c41f5100 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bbfff640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b430 tx=0x7f43ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac015020 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac011830 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c40cb8d0 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011c00 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.633+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c40cbe90 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.634+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c406d310 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.635+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43ac018020 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.635+0000 7f43bb7fe640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.635+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f43ac08b300 con 0x7f43c415e670 2024-09-15T22:41:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.635+0000 7f43c2ffd640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.635+0000 7f43c2ffd640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 0x7f43a406e7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000f60 tx=0x7f43b4007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.639+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43ac01f020 con 0x7f43c415e670 2024-09-15T22:41:55.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:55.840+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43c40d0930 con 0x7f43c415e670 2024-09-15T22:41:56.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.514+0000 7f43bb7fe640 1 -- 172.21.15.134:0/31373468 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f43c41f5100 con 0x7f43c415e670 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 msgr2=0x7f43a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 0x7f43a406e7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000f60 tx=0x7f43b4007b70 comp rx=0 tx=0).stop 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 msgr2=0x7f43c41f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b430 tx=0x7f43ac00b8f0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 shutdown_connections 2024-09-15T22:41:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c4162bc0 0x7f43c40cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c415e670 0x7f43c41f4bc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 --2- 172.21.15.134:0/31373468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c4070f20 0x7f43c41593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 >> 172.21.15.134:0/31373468 conn(0x7f43c40d2440 msgr2=0x7f43c40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 shutdown_connections 2024-09-15T22:41:56.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.517+0000 7f43c9401640 1 -- 172.21.15.134:0/31373468 wait complete. 2024-09-15T22:41:56.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:41:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.634+0000 7fc00b54b640 1 Processor -- start 2024-09-15T22:41:56.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.634+0000 7fc00b54b640 1 -- start start 2024-09-15T22:41:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc00b54b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 0x7fc004073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc00b54b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc004073bb0 0x7fc0040b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc00b54b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0040b4be0 con 0x7fc0040b47d0 2024-09-15T22:41:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc00b54b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc0040b1da0 con 0x7fc004073bb0 2024-09-15T22:41:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc00b54b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc00406ccb0 con 0x7fc00415e840 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc008ae6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc004073bb0 0x7fc0040b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc008ae6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc004073bb0 0x7fc0040b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53778/0 (socket says 172.21.15.134:53778) 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.635+0000 7fc008ae6640 1 -- 172.21.15.134:0/138953759 learned_addr learned my addr 172.21.15.134:0/138953759 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc0092e7640 1 --2- 172.21.15.134:0/138953759 >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 0x7fc004073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc008ae6640 1 -- 172.21.15.134:0/138953759 >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 msgr2=0x7fc004073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc008ae6640 1 --2- 172.21.15.134:0/138953759 >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 0x7fc004073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc008ae6640 1 -- 172.21.15.134:0/138953759 >> v1:172.21.15.134:6789/0 conn(0x7fc0040b47d0 legacy=0x7fc0040d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc008ae6640 1 -- 172.21.15.134:0/138953759 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc004073790 con 0x7fc004073bb0 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc003fff640 1 -- 172.21.15.134:0/138953759 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173028242 0 0) 0x7fbffc001110 con 0x7fc0040b47d0 2024-09-15T22:41:56.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc0092e7640 1 --2- 172.21.15.134:0/138953759 >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 0x7fc004073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.636+0000 7fc008ae6640 1 --2- 172.21.15.134:0/138953759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc004073bb0 0x7fc0040b4290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc004071170 tx=0x7fbff802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d696604afd9f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc003fff640 1 -- 172.21.15.134:0/138953759 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037070 con 0x7fc004073bb0 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc003fff640 1 -- 172.21.15.134:0/138953759 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8032440 con 0x7fc004073bb0 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc003fff640 1 -- 172.21.15.134:0/138953759 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8032810 con 0x7fc004073bb0 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 -- 172.21.15.134:0/138953759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc004073bb0 msgr2=0x7fc0040b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 --2- 172.21.15.134:0/138953759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc004073bb0 0x7fc0040b4290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc004071170 tx=0x7fbff802a150 comp rx=0 tx=0).stop 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 -- 172.21.15.134:0/138953759 shutdown_connections 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 --2- 172.21.15.134:0/138953759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc004073bb0 0x7fc0040b4290 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 --2- 172.21.15.134:0/138953759 >> v2:172.21.15.177:3300/0 conn(0x7fc00415e840 0x7fc004073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 -- 172.21.15.134:0/138953759 >> 172.21.15.134:0/138953759 conn(0x7fc004062630 msgr2=0x7fc004062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 -- 172.21.15.134:0/138953759 shutdown_connections 2024-09-15T22:41:56.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.637+0000 7fc00b54b640 1 -- 172.21.15.134:0/138953759 wait complete. 2024-09-15T22:41:56.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.638+0000 7fc00b54b640 1 Processor -- start 2024-09-15T22:41:56.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.638+0000 7fc00b54b640 1 -- start start 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc004073bb0 0x7fc004161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc00415e840 0x7fc0040cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc00406cf00 con 0x7fc0040b47d0 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc00406d550 con 0x7fc004073bb0 2024-09-15T22:41:56.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc00b54b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc00406d1e0 con 0x7fc00415e840 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc008ae6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc008ae6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53794/0 (socket says 172.21.15.134:53794) 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc008ae6640 1 -- 172.21.15.134:0/2182996190 learned_addr learned my addr 172.21.15.134:0/2182996190 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc0092e7640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc004073bb0 0x7fc004161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.639+0000 7fc009ae8640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc00415e840 0x7fc0040cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 -- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc00415e840 msgr2=0x7fc0040cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc00415e840 0x7fc0040cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 -- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc004073bb0 msgr2=0x7fc004161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc004073bb0 0x7fc004161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 -- 172.21.15.134:0/2182996190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041604b0 con 0x7fc0040b47d0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc008ae6640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbff802a190 tx=0x7fbff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037040 con 0x7fc0040b47d0 2024-09-15T22:41:56.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8042070 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8030bb0 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc004160790 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.640+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc004160d50 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.641+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc004076290 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.641+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbff8047460 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.642+0000 7fc001ffb640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 0x7fbff006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.642+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fbff80ac000 con 0x7fc0040b47d0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.642+0000 7fc0092e7640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 0x7fbff006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:56.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.642+0000 7fc0092e7640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 0x7fbff006e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007510 tx=0x7fbff40074a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:56.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.646+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbff807a710 con 0x7fc0040b47d0 2024-09-15T22:41:56.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:56.812+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc00406e990 con 0x7fc0040b47d0 2024-09-15T22:41:57.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.802+0000 7fc001ffb640 1 -- 172.21.15.134:0/2182996190 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fbff807a010 con 0x7fc0040b47d0 2024-09-15T22:41:57.803 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 msgr2=0x7fbff006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 0x7fbff006e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007510 tx=0x7fbff40074a0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 msgr2=0x7fc004154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbff802a190 tx=0x7fbff80046c0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 shutdown_connections 2024-09-15T22:41:57.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbff006c2b0 0x7fbff006e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc00415e840 0x7fc0040cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0040b47d0 0x7fc004154ea0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 --2- 172.21.15.134:0/2182996190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc004073bb0 0x7fc004161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 >> 172.21.15.134:0/2182996190 conn(0x7fc004062630 msgr2=0x7fc0040d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 shutdown_connections 2024-09-15T22:41:57.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.806+0000 7fc00b54b640 1 -- 172.21.15.134:0/2182996190 wait complete. 2024-09-15T22:41:57.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:41:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.928+0000 7f3d31baf640 1 Processor -- start 2024-09-15T22:41:57.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.928+0000 7f3d31baf640 1 -- start start 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d31baf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3b00 0x7f3d2c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d31baf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d31baf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2c0d20e0 con 0x7f3d2c0b61e0 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d31baf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2c0d24f0 con 0x7f3d2c0b3540 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d31baf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c0cfa70 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53800/0 (socket says 172.21.15.134:53800) 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 -- 172.21.15.134:0/3860098124 learned_addr learned my addr 172.21.15.134:0/3860098124 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 -- 172.21.15.134:0/3860098124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3b00 msgr2=0x7f3d2c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 --2- 172.21.15.134:0/3860098124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3b00 0x7f3d2c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 -- 172.21.15.134:0/3860098124 >> v1:172.21.15.134:6789/0 conn(0x7f3d2c0b61e0 legacy=0x7f3d2c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.929+0000 7f3d2bfff640 1 -- 172.21.15.134:0/3860098124 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c0cfd50 con 0x7f3d2c0b3540 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.930+0000 7f3d2bfff640 1 --2- 172.21.15.134:0/3860098124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009e50 tx=0x7f3d2402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8f104dcceab4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.930+0000 7f3d2a7fc640 1 -- 172.21.15.134:0/3860098124 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24036070 con 0x7f3d2c0b3540 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.930+0000 7f3d2a7fc640 1 -- 172.21.15.134:0/3860098124 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d24031600 con 0x7f3d2c0b3540 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.930+0000 7f3d2a7fc640 1 -- 172.21.15.134:0/3860098124 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d240319d0 con 0x7f3d2c0b3540 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 -- 172.21.15.134:0/3860098124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3540 msgr2=0x7f3d2c0d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 --2- 172.21.15.134:0/3860098124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009e50 tx=0x7f3d2402a5f0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 -- 172.21.15.134:0/3860098124 shutdown_connections 2024-09-15T22:41:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 --2- 172.21.15.134:0/3860098124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3540 0x7f3d2c0d2ec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 --2- 172.21.15.134:0/3860098124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3b00 0x7f3d2c0d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 -- 172.21.15.134:0/3860098124 >> 172.21.15.134:0/3860098124 conn(0x7f3d2c0d11e0 msgr2=0x7f3d2c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 -- 172.21.15.134:0/3860098124 shutdown_connections 2024-09-15T22:41:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.931+0000 7f3d31baf640 1 -- 172.21.15.134:0/3860098124 wait complete. 2024-09-15T22:41:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.932+0000 7f3d31baf640 1 Processor -- start 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.932+0000 7f3d31baf640 1 -- start start 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3540 0x7f3d2c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 0x7f3d2c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c15edc0 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c0d1d00 con 0x7f3d2c0b61e0 2024-09-15T22:41:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d31baf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c1500f0 con 0x7f3d2c0b3540 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53802/0 (socket says 172.21.15.134:53802) 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 -- 172.21.15.134:0/2953816658 learned_addr learned my addr 172.21.15.134:0/2953816658 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2b7fe640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3540 0x7f3d2c14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2bfff640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 0x7f3d2c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 -- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3540 msgr2=0x7f3d2c14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3540 0x7f3d2c14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 -- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 msgr2=0x7f3d2c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 0x7f3d2c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 -- 172.21.15.134:0/2953816658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c0ac770 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2bfff640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 0x7f3d2c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.933+0000 7f3d2affd640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000b440 tx=0x7f3d2000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.934+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20015020 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.934+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d20011850 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.934+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2c0abbf0 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.934+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20011c40 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.934+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2c0ac1b0 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.935+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2c0b65c0 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.935+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d20018020 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.935+0000 7f3d13fff640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 0x7f3d1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.936+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f3d2008b110 con 0x7f3d2c0b3b00 2024-09-15T22:41:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.936+0000 7f3d2b7fe640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 0x7f3d1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.936+0000 7f3d2b7fe640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 0x7f3d1806e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c001780 tx=0x7f3d1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:57.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:57.940+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d2001f020 con 0x7f3d2c0b3b00 2024-09-15T22:41:58.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.105+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3d2c0ba6e0 con 0x7f3d2c0b3b00 2024-09-15T22:41:58.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.803+0000 7f3d13fff640 1 -- 172.21.15.134:0/2953816658 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f3d200599e0 con 0x7f3d2c0b3b00 2024-09-15T22:41:58.805 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:41:58.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 msgr2=0x7f3d1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 0x7f3d1806e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c001780 tx=0x7f3d1c009040 comp rx=0 tx=0).stop 2024-09-15T22:41:58.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 msgr2=0x7f3d2c0ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000b440 tx=0x7f3d2000b900 comp rx=0 tx=0).stop 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 shutdown_connections 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3d1806c2b0 0x7f3d1806e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c0b61e0 0x7f3d2c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c0b3b00 0x7f3d2c0ab1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 --2- 172.21.15.134:0/2953816658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b3540 0x7f3d2c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.807+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 >> 172.21.15.134:0/2953816658 conn(0x7f3d2c0d11e0 msgr2=0x7f3d2c0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.808+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 shutdown_connections 2024-09-15T22:41:58.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:41:58.808+0000 7f3d31baf640 1 -- 172.21.15.134:0/2953816658 wait complete. 2024-09-15T22:41:58.823 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:41:58.823 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:41:58.823 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:41:58.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:41:58.824 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:41:58.824 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:41:58.824 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:41:58.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:41:58.824 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:41:58.825 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:41:58.825 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:41:58.825 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:41:58.825 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:41:58.825 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:41:58.825 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:41:58.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:41:58.835 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:41:58.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:41:58.836 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:41:58.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:41:58.837 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:41:58.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:41:58.878 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:41:58.878 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:58.878 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:41:58.879 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:58.881 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:41:58.881 DEBUG:teuthology.parallel:result is None 2024-09-15T22:41:58.955 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:41:58.956 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:41:58.961 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:42:02.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-15T22:42:04.838 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:42:04.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:42:04.840 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:42:04.844 DEBUG:teuthology.parallel:result is None 2024-09-15T22:42:04.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:42:04.923 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:42:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.953+0000 7f015500a640 1 Processor -- start 2024-09-15T22:42:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.953+0000 7f015500a640 1 -- start start 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f015500a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015e940 0x7f01500d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f015500a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f015015ed20 0x7f01500d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f015500a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01500b7170 con 0x7f01500cef90 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f015500a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f01500d1ae0 con 0x7f015015ed20 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f015500a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f01500b7aa0 con 0x7f015015e940 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014f59e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f01500cef90 0x7f01500b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54314/0 (socket says 172.21.15.134:54314) 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014f59e640 1 -- 172.21.15.134:0/518838647 learned_addr learned my addr 172.21.15.134:0/518838647 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014659c640 1 --2- 172.21.15.134:0/518838647 >> v2:172.21.15.177:3300/0 conn(0x7f015015ed20 0x7f01500d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014ed9d640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015e940 0x7f01500d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014e59c640 1 -- 172.21.15.134:0/518838647 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273338965 0 0) 0x7f0148001490 con 0x7f01500cef90 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014e59c640 1 -- 172.21.15.134:0/518838647 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013c003520 con 0x7f01500cef90 2024-09-15T22:42:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014659c640 1 -- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015e940 msgr2=0x7f01500d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014659c640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015e940 0x7f01500d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014659c640 1 -- 172.21.15.134:0/518838647 >> v1:172.21.15.134:6789/0 conn(0x7f01500cef90 legacy=0x7f01500b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.954+0000 7f014659c640 1 -- 172.21.15.134:0/518838647 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01500d3660 con 0x7f015015ed20 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.955+0000 7f014659c640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015ed20 0x7f01500d15a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01380097a0 tx=0x7f013802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769f5e09d7320ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.955+0000 7f014e59c640 1 -- 172.21.15.134:0/518838647 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138037070 con 0x7f015015ed20 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.955+0000 7f014e59c640 1 -- 172.21.15.134:0/518838647 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0138032440 con 0x7f015015ed20 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.955+0000 7f014e59c640 1 -- 172.21.15.134:0/518838647 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138032810 con 0x7f015015ed20 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 -- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015ed20 msgr2=0x7f01500d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015ed20 0x7f01500d15a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01380097a0 tx=0x7f013802a210 comp rx=0 tx=0).stop 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 -- 172.21.15.134:0/518838647 shutdown_connections 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015ed20 0x7f01500d15a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 --2- 172.21.15.134:0/518838647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015e940 0x7f01500d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 -- 172.21.15.134:0/518838647 >> 172.21.15.134:0/518838647 conn(0x7f01500b6240 msgr2=0x7f01500b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:04.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 -- 172.21.15.134:0/518838647 shutdown_connections 2024-09-15T22:42:04.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.956+0000 7f015500a640 1 -- 172.21.15.134:0/518838647 wait complete. 2024-09-15T22:42:04.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.957+0000 7f015500a640 1 Processor -- start 2024-09-15T22:42:04.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 -- start start 2024-09-15T22:42:04.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 0x7f01500cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 0x7f015015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01500d3f00 con 0x7f01500cef90 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01500d3c20 con 0x7f015015e940 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f015500a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f01500d3310 con 0x7f015015ed20 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f014ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f014ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53848/0 (socket says 172.21.15.134:53848) 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.958+0000 7f014ed9d640 1 -- 172.21.15.134:0/3697991681 learned_addr learned my addr 172.21.15.134:0/3697991681 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014f59e640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 0x7f015015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014659c640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 0x7f01500cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 -- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 msgr2=0x7f015015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 0x7f015015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 -- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 msgr2=0x7f01500cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 0x7f01500cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 -- 172.21.15.134:0/3697991681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015015a780 con 0x7f01500cef90 2024-09-15T22:42:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014f59e640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 0x7f015015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014659c640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 0x7f01500cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f014ed9d640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f014000e9e0 tx=0x7f014000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140017070 con 0x7f01500cef90 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014000c9d0 con 0x7f01500cef90 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01501596e0 con 0x7f01500cef90 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014000cdc0 con 0x7f01500cef90 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.959+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0150159ca0 con 0x7f01500cef90 2024-09-15T22:42:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.960+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01500d1f80 con 0x7f01500cef90 2024-09-15T22:42:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.961+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f014001a070 con 0x7f01500cef90 2024-09-15T22:42:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.961+0000 7f0147fff640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 0x7f013006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.961+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4943+0+0 (secure 0 0 0) 0x7f014008b160 con 0x7f01500cef90 2024-09-15T22:42:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.961+0000 7f014659c640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 0x7f013006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.962+0000 7f014659c640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 0x7f013006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0138034000 tx=0x7f013802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:04.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:04.966+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0140059bd0 con 0x7f01500cef90 2024-09-15T22:42:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:05.143+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f01500ba6b0 con 0x7f01500cef90 2024-09-15T22:42:06.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.837+0000 7f0147fff640 1 -- 172.21.15.134:0/3697991681 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) ==== 97+0+0 (secure 0 0 0) 0x7f01400594d0 con 0x7f01500cef90 2024-09-15T22:42:06.839 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:42:06.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 msgr2=0x7f013006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 0x7f013006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0138034000 tx=0x7f013802e000 comp rx=0 tx=0).stop 2024-09-15T22:42:06.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 msgr2=0x7f015014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f014000e9e0 tx=0x7f014000eea0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 shutdown_connections 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f013006c2b0 0x7f013006e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f015015ed20 0x7f015015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f015015e940 0x7f01500cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 --2- 172.21.15.134:0/3697991681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01500cef90 0x7f015014ea40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 >> 172.21.15.134:0/3697991681 conn(0x7f01500b6240 msgr2=0x7f01500d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 shutdown_connections 2024-09-15T22:42:06.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.840+0000 7f015500a640 1 -- 172.21.15.134:0/3697991681 wait complete. 2024-09-15T22:42:06.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:42:06.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.953+0000 7f21f8dc4640 1 Processor -- start 2024-09-15T22:42:06.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.953+0000 7f21f8dc4640 1 -- start start 2024-09-15T22:42:06.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.954+0000 7f21f8dc4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f21f4152380 0x7f21f4072990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.954+0000 7f21f8dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 0x7f21f406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.954+0000 7f21f8dc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f40738f0 con 0x7f21f415c380 2024-09-15T22:42:06.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.954+0000 7f21f8dc4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f21f40b4610 con 0x7f21f4152380 2024-09-15T22:42:06.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.954+0000 7f21f8dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f21f4073050 con 0x7f21f40b51b0 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f1d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f21f415c380 0x7f21f40b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48140/0 (socket says 172.21.15.134:48140) 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f1d9b640 1 -- 172.21.15.134:0/3006647427 learned_addr learned my addr 172.21.15.134:0/3006647427 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f259c640 1 --2- 172.21.15.134:0/3006647427 >> v2:172.21.15.177:3300/0 conn(0x7f21f4152380 0x7f21f4072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f2d9d640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 0x7f21f406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f259c640 1 -- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 msgr2=0x7f21f406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f259c640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 0x7f21f406ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f259c640 1 -- 172.21.15.134:0/3006647427 >> v1:172.21.15.134:6789/0 conn(0x7f21f415c380 legacy=0x7f21f40b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f259c640 1 -- 172.21.15.134:0/3006647427 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f4073330 con 0x7f21f4152380 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f159a640 1 -- 172.21.15.134:0/3006647427 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623260958 0 0) 0x7f21f40738f0 con 0x7f21f415c380 2024-09-15T22:42:06.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.955+0000 7f21f2d9d640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 0x7f21f406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:06.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.956+0000 7f21f259c640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f4152380 0x7f21f4072990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b4790 tx=0x7f21e402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e95bd62973b912 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:06.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.956+0000 7f21f159a640 1 -- 172.21.15.134:0/3006647427 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4037070 con 0x7f21f4152380 2024-09-15T22:42:06.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.956+0000 7f21f159a640 1 -- 172.21.15.134:0/3006647427 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e402ae50 con 0x7f21f4152380 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.956+0000 7f21f159a640 1 -- 172.21.15.134:0/3006647427 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4032660 con 0x7f21f4152380 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 -- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f4152380 msgr2=0x7f21f4072990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f4152380 0x7f21f4072990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b4790 tx=0x7f21e402a100 comp rx=0 tx=0).stop 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 -- 172.21.15.134:0/3006647427 shutdown_connections 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f40b51b0 0x7f21f406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/3006647427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f4152380 0x7f21f4072990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 -- 172.21.15.134:0/3006647427 >> 172.21.15.134:0/3006647427 conn(0x7f21f406cae0 msgr2=0x7f21f406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 -- 172.21.15.134:0/3006647427 shutdown_connections 2024-09-15T22:42:06.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.957+0000 7f21f8dc4640 1 -- 172.21.15.134:0/3006647427 wait complete. 2024-09-15T22:42:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.958+0000 7f21f8dc4640 1 Processor -- start 2024-09-15T22:42:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.958+0000 7f21f8dc4640 1 -- start start 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 0x7f21f4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f4152380 0x7f21f414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4152760 con 0x7f21f415c380 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21f415c810 con 0x7f21f40b51b0 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f8dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f21f406f010 con 0x7f21f4152380 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42862/0 (socket says 172.21.15.134:42862) 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 -- 172.21.15.134:0/1584711472 learned_addr learned my addr 172.21.15.134:0/1584711472 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f1d9b640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f4152380 0x7f21f414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f259c640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 0x7f21f4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 -- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f4152380 msgr2=0x7f21f414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f4152380 0x7f21f414c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 -- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 msgr2=0x7f21f4154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 0x7f21f4154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f2d9d640 1 -- 172.21.15.134:0/1584711472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f41594d0 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.959+0000 7f21f259c640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 0x7f21f4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21f2d9d640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00efb0 tx=0x7f21ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec018020 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec014480 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f4155520 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec014850 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.960+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f4159770 con 0x7f21f415c380 2024-09-15T22:42:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.961+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f406f3c0 con 0x7f21f415c380 2024-09-15T22:42:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.961+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f21ec005d10 con 0x7f21f415c380 2024-09-15T22:42:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.962+0000 7f21e2ffd640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.962+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f21ec08bed0 con 0x7f21f415c380 2024-09-15T22:42:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.962+0000 7f21f259c640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.962+0000 7f21f259c640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 0x7f21d406e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21e4034000 tx=0x7f21e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:06.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:06.966+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21ec022030 con 0x7f21f415c380 2024-09-15T22:42:07.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.192+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f21f4062aa0 con 0x7f21f415c380 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.192+0000 7f21e2ffd640 1 -- 172.21.15.134:0/1584711472 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f21ec010040 con 0x7f21f415c380 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:42:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:42:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:42:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-mds", 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+Yudm96jJNhAA27wF46NLLJ5trYy8+okx+g==", 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+YudmT7HJNhAAojECsRuMMCpmJMDBGIG1/A==", 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-osd", 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+Yudm+LjJNhAAX8+wVG21fHFCKQWt9V2RxA==", 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+YudmCcDJNhAA018yt+gtaRQb5eddNo7nsA==", 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+YudmAMfJNhAAKE8c3rbVcPZEkfOVf6JaOg==", 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB+YudmU87JNhAAptMOtFWe7/i/Pa78i9XsNw==", 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:42:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:42:07.210 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 msgr2=0x7f21d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 0x7f21d406e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21e4034000 tx=0x7f21e402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 msgr2=0x7f21f40b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00efb0 tx=0x7f21ec00c490 comp rx=0 tx=0).stop 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 shutdown_connections 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21f415c380 0x7f21f40b12f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f4152380 0x7f21f414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 --2- 172.21.15.134:0/1584711472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f40b51b0 0x7f21f4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 >> 172.21.15.134:0/1584711472 conn(0x7f21f406cae0 msgr2=0x7f21f40b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 shutdown_connections 2024-09-15T22:42:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.195+0000 7f21f8dc4640 1 -- 172.21.15.134:0/1584711472 wait complete. 2024-09-15T22:42:07.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T22:42:07.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.311+0000 7fe2ce2f1640 1 Processor -- start 2024-09-15T22:42:07.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.311+0000 7fe2ce2f1640 1 -- start start 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2ce2f1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2c815c0b0 0x7fe2c80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2ce2f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2ce2f1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c8160970 con 0x7fe2c8160410 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2ce2f1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c8160c50 con 0x7fe2c815c0b0 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2ce2f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c80ce200 con 0x7fe2c815c490 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2c815c0b0 0x7fe2c80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2cc88e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe2c8160410 0x7fe2c80b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48142/0 (socket says 172.21.15.134:48142) 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2c815c0b0 0x7fe2c80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42874/0 (socket says 172.21.15.134:42874) 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2cc88e640 1 -- 172.21.15.134:0/506424525 learned_addr learned my addr 172.21.15.134:0/506424525 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c77fe640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 -- 172.21.15.134:0/506424525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 msgr2=0x7fe2c815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:07.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c815fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 -- 172.21.15.134:0/506424525 >> v1:172.21.15.134:6789/0 conn(0x7fe2c8160410 legacy=0x7fe2c80b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c6ffd640 1 -- 172.21.15.134:0/506424525 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777415614 0 0) 0x7fe2c8160970 con 0x7fe2c8160410 2024-09-15T22:42:07.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.312+0000 7fe2c7fff640 1 -- 172.21.15.134:0/506424525 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c80ce4e0 con 0x7fe2c815c0b0 2024-09-15T22:42:07.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.313+0000 7fe2c7fff640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c815c0b0 0x7fe2c80cea00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80097a0 tx=0x7fe2b802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3788cfff8ffc9a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.313+0000 7fe2c6ffd640 1 -- 172.21.15.134:0/506424525 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8037070 con 0x7fe2c815c0b0 2024-09-15T22:42:07.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.313+0000 7fe2c6ffd640 1 -- 172.21.15.134:0/506424525 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b8032440 con 0x7fe2c815c0b0 2024-09-15T22:42:07.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.313+0000 7fe2c6ffd640 1 -- 172.21.15.134:0/506424525 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8032810 con 0x7fe2c815c0b0 2024-09-15T22:42:07.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/506424525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c815c0b0 msgr2=0x7fe2c80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c815c0b0 0x7fe2c80cea00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80097a0 tx=0x7fe2b802a180 comp rx=0 tx=0).stop 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/506424525 shutdown_connections 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/506424525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c815c0b0 0x7fe2c80cea00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/506424525 >> 172.21.15.134:0/506424525 conn(0x7fe2c806ce90 msgr2=0x7fe2c806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/506424525 shutdown_connections 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.314+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/506424525 wait complete. 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.315+0000 7fe2ce2f1640 1 Processor -- start 2024-09-15T22:42:07.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.315+0000 7fe2ce2f1640 1 -- start start 2024-09-15T22:42:07.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2c815c0b0 0x7fe2c81f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c8150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80b3c60 con 0x7fe2c8160410 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80cef40 con 0x7fe2c815c0b0 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c80b3de0 con 0x7fe2c815c490 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42886/0 (socket says 172.21.15.134:42886) 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 -- 172.21.15.134:0/3868943368 learned_addr learned my addr 172.21.15.134:0/3868943368 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2c77fe640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c8150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2c7fff640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2c815c0b0 0x7fe2c81f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 -- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 msgr2=0x7fe2c8150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c8150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 -- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2c815c0b0 msgr2=0x7fe2c81f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2c815c0b0 0x7fe2c81f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 -- 172.21.15.134:0/3868943368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c81555e0 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2cc88e640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0002230 tx=0x7fe2c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0017070 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c000acc0 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c81543a0 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.316+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0012640 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.317+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c8150e50 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.317+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c80cea00 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.318+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2c001a070 con 0x7fe2c8160410 2024-09-15T22:42:07.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.318+0000 7fe2c4ff9640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 0x7fe2b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.318+0000 7fe2c7fff640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 0x7fe2b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.318+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fe2c008ae50 con 0x7fe2c8160410 2024-09-15T22:42:07.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.319+0000 7fe2c7fff640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 0x7fe2b406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8034000 tx=0x7fe2b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.323+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2c00599a0 con 0x7fe2c8160410 2024-09-15T22:42:07.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.547+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fe2c8076030 con 0x7fe2c8160410 2024-09-15T22:42:07.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.550+0000 7fe2c4ff9640 1 -- 172.21.15.134:0/3868943368 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fe2c00592a0 con 0x7fe2c8160410 2024-09-15T22:42:07.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 msgr2=0x7fe2b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 0x7fe2b406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8034000 tx=0x7fe2b802e000 comp rx=0 tx=0).stop 2024-09-15T22:42:07.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 msgr2=0x7fe2c8157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0002230 tx=0x7fe2c000a060 comp rx=0 tx=0).stop 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 shutdown_connections 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe2b406c2b0 0x7fe2b406e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2c8160410 0x7fe2c8157d30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2c815c490 0x7fe2c8150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 --2- 172.21.15.134:0/3868943368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2c815c0b0 0x7fe2c81f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 >> 172.21.15.134:0/3868943368 conn(0x7fe2c806ce90 msgr2=0x7fe2c80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 shutdown_connections 2024-09-15T22:42:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.552+0000 7fe2ce2f1640 1 -- 172.21.15.134:0/3868943368 wait complete. 2024-09-15T22:42:07.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T22:42:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.661+0000 7f8a9919f640 1 Processor -- start 2024-09-15T22:42:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.661+0000 7f8a9919f640 1 -- start start 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a9919f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a9406f510 0x7f8a940b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a9919f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a9406f8f0 0x7f8a94161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a9919f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9406e680 con 0x7f8a94162ed0 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a9919f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8a940b5da0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a9919f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9406e2f0 con 0x7f8a9406f510 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a9406f8f0 0x7f8a94161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a9406f8f0 0x7f8a94161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42894/0 (socket says 172.21.15.134:42894) 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 -- 172.21.15.134:0/2668505870 learned_addr learned my addr 172.21.15.134:0/2668505870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a93fff640 1 --2- 172.21.15.134:0/2668505870 >> v2:172.21.15.177:3300/0 conn(0x7f8a9406f510 0x7f8a940b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 -- 172.21.15.134:0/2668505870 >> v2:172.21.15.177:3300/0 conn(0x7f8a9406f510 msgr2=0x7f8a940b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:07.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 --2- 172.21.15.134:0/2668505870 >> v2:172.21.15.177:3300/0 conn(0x7f8a9406f510 0x7f8a940b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 -- 172.21.15.134:0/2668505870 >> v1:172.21.15.177:6789/0 conn(0x7f8a94162ed0 legacy=0x7f8a94072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:07.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.662+0000 7f8a937fe640 1 -- 172.21.15.134:0/2668505870 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a940b57e0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.663+0000 7f8a937fe640 1 --2- 172.21.15.134:0/2668505870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a94161690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a94063730 tx=0x7f8a8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d27d2d84e6cfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.663+0000 7f8a92ffd640 1 -- 172.21.15.134:0/2668505870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88037070 con 0x7f8a9406f8f0 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.663+0000 7f8a92ffd640 1 -- 172.21.15.134:0/2668505870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88032440 con 0x7f8a9406f8f0 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.663+0000 7f8a92ffd640 1 -- 172.21.15.134:0/2668505870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88032810 con 0x7f8a9406f8f0 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 -- 172.21.15.134:0/2668505870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 msgr2=0x7f8a94161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2668505870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a94161690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a94063730 tx=0x7f8a8802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 -- 172.21.15.134:0/2668505870 shutdown_connections 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2668505870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a94161690 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2668505870 >> v2:172.21.15.177:3300/0 conn(0x7f8a9406f510 0x7f8a940b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 -- 172.21.15.134:0/2668505870 >> 172.21.15.134:0/2668505870 conn(0x7f8a94062630 msgr2=0x7f8a94062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 -- 172.21.15.134:0/2668505870 shutdown_connections 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.664+0000 7f8a9919f640 1 -- 172.21.15.134:0/2668505870 wait complete. 2024-09-15T22:42:07.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.665+0000 7f8a9919f640 1 Processor -- start 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.665+0000 7f8a9919f640 1 -- start start 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9406f510 0x7f8a94148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 0x7f8a940d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a940b65e0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a940b5590 con 0x7f8a94162ed0 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9919f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9406eb60 con 0x7f8a9406f510 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42900/0 (socket says 172.21.15.134:42900) 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 -- 172.21.15.134:0/2415133628 learned_addr learned my addr 172.21.15.134:0/2415133628 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a93fff640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9406f510 0x7f8a94148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9899e640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 0x7f8a940d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 -- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9406f510 msgr2=0x7f8a94148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9406f510 0x7f8a94148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 -- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 msgr2=0x7f8a940d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 0x7f8a940d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a937fe640 1 -- 172.21.15.134:0/2415133628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a940b2200 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.666+0000 7f8a9899e640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 0x7f8a940d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a937fe640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a8802a220 tx=0x7f8a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88041020 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a880306c0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88037040 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a940d05b0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.667+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a940b24c0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.668+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a940b60a0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.668+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a88044020 con 0x7f8a9406f8f0 2024-09-15T22:42:07.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.669+0000 7f8a90ff9640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 0x7f8a8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.669+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f8a880ab8a0 con 0x7f8a9406f8f0 2024-09-15T22:42:07.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.669+0000 7f8a93fff640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 0x7f8a8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.669+0000 7f8a93fff640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 0x7f8a8006e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.673+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a8804b030 con 0x7f8a9406f8f0 2024-09-15T22:42:07.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.904+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f8a940cee10 con 0x7f8a9406f8f0 2024-09-15T22:42:07.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.908+0000 7f8a90ff9640 1 -- 172.21.15.134:0/2415133628 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f8a8807a360 con 0x7f8a9406f8f0 2024-09-15T22:42:07.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 msgr2=0x7f8a8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 0x7f8a8006e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84008040 comp rx=0 tx=0).stop 2024-09-15T22:42:07.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 msgr2=0x7f8a940cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a8802a220 tx=0x7f8a880046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 shutdown_connections 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a8006c2b0 0x7f8a8006e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a94162ed0 0x7f8a940d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a9406f8f0 0x7f8a940cfd60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 --2- 172.21.15.134:0/2415133628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9406f510 0x7f8a94148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 >> 172.21.15.134:0/2415133628 conn(0x7f8a94062630 msgr2=0x7f8a9415bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.910+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 shutdown_connections 2024-09-15T22:42:07.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:07.911+0000 7f8a9919f640 1 -- 172.21.15.134:0/2415133628 wait complete. 2024-09-15T22:42:07.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T22:42:08.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.020+0000 7f326c9bd640 1 Processor -- start 2024-09-15T22:42:08.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.020+0000 7f326c9bd640 1 -- start start 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326c9bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32680b3040 0x7f32680cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326c9bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 0x7f326806c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326c9bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3268153a70 con 0x7f326806bba0 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326c9bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f326806c550 con 0x7f32680b3040 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326c9bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f326815d7e0 con 0x7f326815d3a0 2024-09-15T22:42:08.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32680b3040 0x7f32680cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f3265d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f326806bba0 0x7f326815cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48152/0 (socket says 172.21.15.134:48152) 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f3265d9b640 1 -- 172.21.15.134:0/1469538512 learned_addr learned my addr 172.21.15.134:0/1469538512 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.021+0000 7f326659c640 1 --2- 172.21.15.134:0/1469538512 >> v2:172.21.15.134:3300/0 conn(0x7f32680b3040 0x7f32680cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42908/0 (socket says 172.21.15.134:42908) 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f3266d9d640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 0x7f326806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f326659c640 1 -- 172.21.15.134:0/1469538512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 msgr2=0x7f326806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f326659c640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 0x7f326806c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f326659c640 1 -- 172.21.15.134:0/1469538512 >> v1:172.21.15.134:6789/0 conn(0x7f326806bba0 legacy=0x7f326815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f326559a640 1 -- 172.21.15.134:0/1469538512 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622726529 0 0) 0x7f3268153a70 con 0x7f326806bba0 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f326659c640 1 -- 172.21.15.134:0/1469538512 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32680ce820 con 0x7f32680b3040 2024-09-15T22:42:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.022+0000 7f3266d9d640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 0x7f326806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326659c640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32680b3040 0x7f32680cf570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32580097a0 tx=0x7f325802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b758a4795be353a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326559a640 1 -- 172.21.15.134:0/1469538512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258037070 con 0x7f32680b3040 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326559a640 1 -- 172.21.15.134:0/1469538512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3258032440 con 0x7f32680b3040 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326559a640 1 -- 172.21.15.134:0/1469538512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258032810 con 0x7f32680b3040 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 -- 172.21.15.134:0/1469538512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32680b3040 msgr2=0x7f32680cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32680b3040 0x7f32680cf570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32580097a0 tx=0x7f325802a180 comp rx=0 tx=0).stop 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 -- 172.21.15.134:0/1469538512 shutdown_connections 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f326815d3a0 0x7f326806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 --2- 172.21.15.134:0/1469538512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32680b3040 0x7f32680cf570 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 -- 172.21.15.134:0/1469538512 >> 172.21.15.134:0/1469538512 conn(0x7f3268062a80 msgr2=0x7f326806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 -- 172.21.15.134:0/1469538512 shutdown_connections 2024-09-15T22:42:08.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.023+0000 7f326c9bd640 1 -- 172.21.15.134:0/1469538512 wait complete. 2024-09-15T22:42:08.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.025+0000 7f326c9bd640 1 Processor -- start 2024-09-15T22:42:08.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.025+0000 7f326c9bd640 1 -- start start 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 0x7f3268155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 0x7f3268155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32680cf050 con 0x7f326806bba0 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32680ced70 con 0x7f326815d3a0 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f326815da10 con 0x7f32680b3040 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42914/0 (socket says 172.21.15.134:42914) 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 -- 172.21.15.134:0/604981544 learned_addr learned my addr 172.21.15.134:0/604981544 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3265d9b640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 0x7f3268155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3266d9d640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 0x7f3268155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 -- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 msgr2=0x7f3268155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 0x7f3268155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 -- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 msgr2=0x7f3268155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 0x7f3268155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 -- 172.21.15.134:0/604981544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3268152520 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3265d9b640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 0x7f3268155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3266d9d640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 0x7f3268155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326659c640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3258035040 tx=0x7f32580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258037040 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3258030770 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258030b80 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3268152800 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.026+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3268152dc0 con 0x7f326806bba0 2024-09-15T22:42:08.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.027+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32680cf570 con 0x7f326806bba0 2024-09-15T22:42:08.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.028+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3258044020 con 0x7f326806bba0 2024-09-15T22:42:08.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.028+0000 7f3256ffd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 0x7f324806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.029+0000 7f3265d9b640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 0x7f324806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.029+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f32580ab5e0 con 0x7f326806bba0 2024-09-15T22:42:08.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.029+0000 7f3265d9b640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 0x7f324806e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f326815c200 tx=0x7f325c007c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.033+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3258032e20 con 0x7f326806bba0 2024-09-15T22:42:08.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.265+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f326806cd50 con 0x7f326806bba0 2024-09-15T22:42:08.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.267+0000 7f3256ffd640 1 -- 172.21.15.134:0/604981544 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f325807a130 con 0x7f326806bba0 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 msgr2=0x7f324806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 0x7f324806e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f326815c200 tx=0x7f325c007c50 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 msgr2=0x7f3268150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3258035040 tx=0x7f32580046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 shutdown_connections 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f324806c2b0 0x7f324806e770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f326815d3a0 0x7f3268155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32680b3040 0x7f3268155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 --2- 172.21.15.134:0/604981544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f326806bba0 0x7f3268150fe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 >> 172.21.15.134:0/604981544 conn(0x7f3268062a80 msgr2=0x7f32681e6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 shutdown_connections 2024-09-15T22:42:08.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.269+0000 7f326c9bd640 1 -- 172.21.15.134:0/604981544 wait complete. 2024-09-15T22:42:08.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T22:42:08.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.379+0000 7f94f10af640 1 Processor -- start 2024-09-15T22:42:08.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.379+0000 7f94f10af640 1 -- start start 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94f10af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94ec15c300 0x7f94ec0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94f10af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec15ecf0 con 0x7f94ec06f1e0 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94f10af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec15c6e0 con 0x7f94ec0cd300 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94f10af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec15efb0 con 0x7f94ec15c300 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ead9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94ec15c300 0x7f94ec0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94eb59e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f94ec06f1e0 0x7f94ec0ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48162/0 (socket says 172.21.15.134:48162) 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94eb59e640 1 -- 172.21.15.134:0/1047307315 learned_addr learned my addr 172.21.15.134:0/1047307315 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ea59c640 1 -- 172.21.15.134:0/1047307315 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588872582 0 0) 0x7f94ec15ecf0 con 0x7f94ec06f1e0 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ea59c640 1 -- 172.21.15.134:0/1047307315 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d8003520 con 0x7f94ec06f1e0 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ead9d640 1 -- 172.21.15.134:0/1047307315 >> v1:172.21.15.177:6789/0 conn(0x7f94ec0cd300 legacy=0x7f94ec06ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ead9d640 1 -- 172.21.15.134:0/1047307315 >> v1:172.21.15.134:6789/0 conn(0x7f94ec06f1e0 legacy=0x7f94ec0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.380+0000 7f94ead9d640 1 -- 172.21.15.134:0/1047307315 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec15f290 con 0x7f94ec15c300 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.381+0000 7f94ead9d640 1 --2- 172.21.15.134:0/1047307315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec15c300 0x7f94ec0affc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0097a0 tx=0x7f94dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5937ecf96c3614 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.381+0000 7f94ea59c640 1 -- 172.21.15.134:0/1047307315 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc037070 con 0x7f94ec15c300 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.381+0000 7f94ea59c640 1 -- 172.21.15.134:0/1047307315 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc02ae50 con 0x7f94ec15c300 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.381+0000 7f94ea59c640 1 -- 172.21.15.134:0/1047307315 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc032660 con 0x7f94ec15c300 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 -- 172.21.15.134:0/1047307315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec15c300 msgr2=0x7f94ec0affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 --2- 172.21.15.134:0/1047307315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec15c300 0x7f94ec0affc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0097a0 tx=0x7f94dc02a140 comp rx=0 tx=0).stop 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 -- 172.21.15.134:0/1047307315 shutdown_connections 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 --2- 172.21.15.134:0/1047307315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec15c300 0x7f94ec0affc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 -- 172.21.15.134:0/1047307315 >> 172.21.15.134:0/1047307315 conn(0x7f94ec06cae0 msgr2=0x7f94ec06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 -- 172.21.15.134:0/1047307315 shutdown_connections 2024-09-15T22:42:08.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.382+0000 7f94f10af640 1 -- 172.21.15.134:0/1047307315 wait complete. 2024-09-15T22:42:08.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.383+0000 7f94f10af640 1 Processor -- start 2024-09-15T22:42:08.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.383+0000 7f94f10af640 1 -- start start 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 0x7f94ec15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec15c300 0x7f94ec149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec071880 con 0x7f94ec0cd300 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec15f850 con 0x7f94ec15c300 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94f10af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0b0500 con 0x7f94ec06f1e0 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42934/0 (socket says 172.21.15.134:42934) 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 -- 172.21.15.134:0/1452943451 learned_addr learned my addr 172.21.15.134:0/1452943451 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:08.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94eb59e640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec15c300 0x7f94ec149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94ead9d640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 0x7f94ec15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 -- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 msgr2=0x7f94ec15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 0x7f94ec15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 -- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec15c300 msgr2=0x7f94ec149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec15c300 0x7f94ec149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94e3fff640 1 -- 172.21.15.134:0/1452943451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0cd900 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.384+0000 7f94ead9d640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 0x7f94ec15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94e3fff640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c430 tx=0x7f94d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4011790 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec158040 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4011bb0 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.385+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec0cde50 con 0x7f94ec0cd300 2024-09-15T22:42:08.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.386+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec0ce050 con 0x7f94ec0cd300 2024-09-15T22:42:08.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.386+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94d401c460 con 0x7f94ec0cd300 2024-09-15T22:42:08.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.387+0000 7f94e37fe640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 0x7f94cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.387+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f94d408af90 con 0x7f94ec0cd300 2024-09-15T22:42:08.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.387+0000 7f94ead9d640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 0x7f94cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.387+0000 7f94ead9d640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 0x7f94cc06e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f94dc034000 tx=0x7f94dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.391+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94ec0ce050 con 0x7f94ec0cd300 2024-09-15T22:42:08.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.621+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f94ec0affc0 con 0x7f94ec0cd300 2024-09-15T22:42:08.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.625+0000 7f94e37fe640 1 -- 172.21.15.134:0/1452943451 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f94ec158040 con 0x7f94ec0cd300 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 msgr2=0x7f94cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 0x7f94cc06e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f94dc034000 tx=0x7f94dc02e000 comp rx=0 tx=0).stop 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 msgr2=0x7f94ec0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c430 tx=0x7f94d400c8f0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 shutdown_connections 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f94cc06c2b0 0x7f94cc06e770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec15c300 0x7f94ec149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ec0cd300 0x7f94ec0ce370 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 --2- 172.21.15.134:0/1452943451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec06f1e0 0x7f94ec15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 >> 172.21.15.134:0/1452943451 conn(0x7f94ec06cae0 msgr2=0x7f94ec162270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 shutdown_connections 2024-09-15T22:42:08.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.627+0000 7f94f10af640 1 -- 172.21.15.134:0/1452943451 wait complete. 2024-09-15T22:42:08.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T22:42:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.738+0000 7f7687d5b640 1 Processor -- start 2024-09-15T22:42:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.738+0000 7f7687d5b640 1 -- start start 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7687d5b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f768015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7687d5b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 0x7f76801594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7687d5b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f768015d390 con 0x7f76800d02a0 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7687d5b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f768015d670 con 0x7f768015ce80 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7687d5b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f768015d950 con 0x7f768015ca40 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7685af7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f76800d02a0 0x7f76800d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48170/0 (socket says 172.21.15.134:48170) 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7685af7640 1 -- 172.21.15.134:0/1045253127 learned_addr learned my addr 172.21.15.134:0/1045253127 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76852f6640 1 --2- 172.21.15.134:0/1045253127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f768015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76862f8640 1 --2- 172.21.15.134:0/1045253127 >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 0x7f76801594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344806711 0 0) 0x7f768015d390 con 0x7f76800d02a0 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f766c003520 con 0x7f76800d02a0 2024-09-15T22:42:08.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76852f6640 1 -- 172.21.15.134:0/1045253127 >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 msgr2=0x7f76801594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76852f6640 1 --2- 172.21.15.134:0/1045253127 >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 0x7f76801594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 378458508 0 0) 0x7f766c003520 con 0x7f76800d02a0 2024-09-15T22:42:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76852f6640 1 -- 172.21.15.134:0/1045253127 >> v1:172.21.15.134:6789/0 conn(0x7f76800d02a0 legacy=0x7f76800d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76852f6640 1 -- 172.21.15.134:0/1045253127 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768015dc30 con 0x7f768015ca40 2024-09-15T22:42:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.739+0000 7f76862f8640 1 --2- 172.21.15.134:0/1045253127 >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 0x7f76801594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.740+0000 7f76852f6640 1 --2- 172.21.15.134:0/1045253127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f768015e430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76700097a0 tx=0x7f767002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c6c7b451a8d39a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.740+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037070 con 0x7f768015ca40 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.740+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767002ab10 con 0x7f768015ca40 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.740+0000 7f7684af5640 1 -- 172.21.15.134:0/1045253127 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c001670 con 0x7f768015ca40 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 -- 172.21.15.134:0/1045253127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 msgr2=0x7f768015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 --2- 172.21.15.134:0/1045253127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f768015e430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76700097a0 tx=0x7f767002a080 comp rx=0 tx=0).stop 2024-09-15T22:42:08.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 -- 172.21.15.134:0/1045253127 shutdown_connections 2024-09-15T22:42:08.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 --2- 172.21.15.134:0/1045253127 >> v2:172.21.15.177:3300/0 conn(0x7f768015ce80 0x7f76801594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 --2- 172.21.15.134:0/1045253127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f768015e430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 -- 172.21.15.134:0/1045253127 >> 172.21.15.134:0/1045253127 conn(0x7f7680062cc0 msgr2=0x7f768006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 -- 172.21.15.134:0/1045253127 shutdown_connections 2024-09-15T22:42:08.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.741+0000 7f7687d5b640 1 -- 172.21.15.134:0/1045253127 wait complete. 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.742+0000 7f7687d5b640 1 Processor -- start 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.742+0000 7f7687d5b640 1 -- start start 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 0x7f7680155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f76801528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7680155d10 con 0x7f768015ce80 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7680155b90 con 0x7f76800d02a0 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7687d5b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f76800b4790 con 0x7f768015ca40 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42940/0 (socket says 172.21.15.134:42940) 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 -- 172.21.15.134:0/2724231308 learned_addr learned my addr 172.21.15.134:0/2724231308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7685af7640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 0x7f7680155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76852f6640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f76801528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 -- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 msgr2=0x7f76801528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f76801528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 -- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 msgr2=0x7f7680155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 0x7f7680155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76862f8640 1 -- 172.21.15.134:0/2724231308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7680158580 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f7685af7640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 0x7f7680155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.743+0000 7f76852f6640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f76801528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f76862f8640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f767800e5b0 tx=0x7f767800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678003b90 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7678003d30 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7680156470 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678004240 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.744+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7680158b20 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.745+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76800d0680 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.745+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7678005d10 con 0x7f768015ce80 2024-09-15T22:42:08.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.746+0000 7f76767fc640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 0x7f766406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:08.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.746+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f767808de70 con 0x7f768015ce80 2024-09-15T22:42:08.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.746+0000 7f7685af7640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 0x7f766406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:08.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.746+0000 7f7685af7640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 0x7f766406e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f767c005880 tx=0x7f767c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:08.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.750+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f767805c930 con 0x7f768015ce80 2024-09-15T22:42:08.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.976+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f76801550d0 con 0x7f768015ce80 2024-09-15T22:42:08.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.980+0000 7f76767fc640 1 -- 172.21.15.134:0/2724231308 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f7678018e10 con 0x7f768015ce80 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 msgr2=0x7f766406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 0x7f766406e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f767c005880 tx=0x7f767c009040 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 msgr2=0x7f7680073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f767800e5b0 tx=0x7f767800ea70 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 shutdown_connections 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f766406c2b0 0x7f766406e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f768015ce80 0x7f7680073a50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f768015ca40 0x7f76801528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 --2- 172.21.15.134:0/2724231308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76800d02a0 0x7f7680155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 >> 172.21.15.134:0/2724231308 conn(0x7f7680062cc0 msgr2=0x7f76800affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 shutdown_connections 2024-09-15T22:42:08.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:08.983+0000 7f7687d5b640 1 -- 172.21.15.134:0/2724231308 wait complete. 2024-09-15T22:42:08.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T22:42:09.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 Processor -- start 2024-09-15T22:42:09.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 -- start start 2024-09-15T22:42:09.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a4c15e940 0x7f1a4c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0b7170 con 0x7f1a4c0cef90 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4c0d1ae0 con 0x7f1a4c15e940 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.093+0000 7f1a52df6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b7aa0 con 0x7f1a4c15ed20 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a50b92640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a4c15e940 0x7f1a4c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a51393640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1a4c0cef90 0x7f1a4c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:38116/0 (socket says 172.21.15.134:38116) 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:46548/0 (socket says 172.21.15.134:46548) 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a51393640 1 -- 172.21.15.134:0/2295558141 learned_addr learned my addr 172.21.15.134:0/2295558141 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a50b92640 1 -- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 msgr2=0x7f1a4c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a50b92640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a50b92640 1 -- 172.21.15.134:0/2295558141 >> v1:172.21.15.177:6789/0 conn(0x7f1a4c0cef90 legacy=0x7f1a4c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a50b92640 1 -- 172.21.15.134:0/2295558141 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c0d3660 con 0x7f1a4c15e940 2024-09-15T22:42:09.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.094+0000 7f1a4bfff640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:09.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.095+0000 7f1a50b92640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c15e940 0x7f1a4c0d1060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a400097a0 tx=0x7f1a4002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a082b9a14e1467 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.095+0000 7f1a4b7fe640 1 -- 172.21.15.134:0/2295558141 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40037070 con 0x7f1a4c15e940 2024-09-15T22:42:09.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.095+0000 7f1a4b7fe640 1 -- 172.21.15.134:0/2295558141 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a40032440 con 0x7f1a4c15e940 2024-09-15T22:42:09.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.095+0000 7f1a4b7fe640 1 -- 172.21.15.134:0/2295558141 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40032810 con 0x7f1a4c15e940 2024-09-15T22:42:09.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 -- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c15e940 msgr2=0x7f1a4c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c15e940 0x7f1a4c0d1060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a400097a0 tx=0x7f1a4002a230 comp rx=0 tx=0).stop 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 -- 172.21.15.134:0/2295558141 shutdown_connections 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15ed20 0x7f1a4c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 --2- 172.21.15.134:0/2295558141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c15e940 0x7f1a4c0d1060 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 -- 172.21.15.134:0/2295558141 >> 172.21.15.134:0/2295558141 conn(0x7f1a4c0b6240 msgr2=0x7f1a4c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 -- 172.21.15.134:0/2295558141 shutdown_connections 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.096+0000 7f1a52df6640 1 -- 172.21.15.134:0/2295558141 wait complete. 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.097+0000 7f1a52df6640 1 Processor -- start 2024-09-15T22:42:09.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.097+0000 7f1a52df6640 1 -- start start 2024-09-15T22:42:09.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 0x7f1a4c1f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15e940 0x7f1a4c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3f00 con 0x7f1a4c15ed20 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3c20 con 0x7f1a4c0cef90 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a52df6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3310 con 0x7f1a4c15e940 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42952/0 (socket says 172.21.15.134:42952) 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 -- 172.21.15.134:0/363487398 learned_addr learned my addr 172.21.15.134:0/363487398 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a50b92640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 0x7f1a4c1f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a4bfff640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15e940 0x7f1a4c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 -- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15e940 msgr2=0x7f1a4c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15e940 0x7f1a4c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 -- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 msgr2=0x7f1a4c1f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 0x7f1a4c1f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a51393640 1 -- 172.21.15.134:0/363487398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c1f6680 con 0x7f1a4c15ed20 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.098+0000 7f1a50b92640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 0x7f1a4c1f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a51393640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400ca80 tx=0x7f1a4400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44017070 con 0x7f1a4c15ed20 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4400ac30 con 0x7f1a4c15ed20 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c1f6960 con 0x7f1a4c15ed20 2024-09-15T22:42:09.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44012600 con 0x7f1a4c15ed20 2024-09-15T22:42:09.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.099+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1f6f20 con 0x7f1a4c15ed20 2024-09-15T22:42:09.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.100+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c0d1f80 con 0x7f1a4c15ed20 2024-09-15T22:42:09.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.100+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a4401a070 con 0x7f1a4c15ed20 2024-09-15T22:42:09.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.101+0000 7f1a497fa640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 0x7f1a3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.101+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f1a4408aca0 con 0x7f1a4c15ed20 2024-09-15T22:42:09.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.101+0000 7f1a50b92640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 0x7f1a3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.101+0000 7f1a50b92640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 0x7f1a3006e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a40034000 tx=0x7f1a4002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.105+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a4c0b7170 con 0x7f1a4c15ed20 2024-09-15T22:42:09.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.331+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f1a4c0ba6b0 con 0x7f1a4c15ed20 2024-09-15T22:42:09.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.335+0000 7f1a497fa640 1 -- 172.21.15.134:0/363487398 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f1a4400ae20 con 0x7f1a4c15ed20 2024-09-15T22:42:09.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 msgr2=0x7f1a3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 0x7f1a3006e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a40034000 tx=0x7f1a4002e000 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 msgr2=0x7f1a4c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400ca80 tx=0x7f1a4400cf40 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 shutdown_connections 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1a3006c2b0 0x7f1a3006e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a4c15ed20 0x7f1a4c15bd80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a4c15e940 0x7f1a4c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 --2- 172.21.15.134:0/363487398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a4c0cef90 0x7f1a4c1f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 >> 172.21.15.134:0/363487398 conn(0x7f1a4c0b6240 msgr2=0x7f1a4c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 shutdown_connections 2024-09-15T22:42:09.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.337+0000 7f1a52df6640 1 -- 172.21.15.134:0/363487398 wait complete. 2024-09-15T22:42:09.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:42:09.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 Processor -- start 2024-09-15T22:42:09.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 -- start start 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9f80b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f80716c0 con 0x7fc9f806ebc0 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f8073eb0 con 0x7fc9f80b1a70 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.446+0000 7fc9feff6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f806d720 con 0x7fc9f80b6b20 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fd593640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc9f806ebc0 0x7fc9f8070fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48184/0 (socket says 172.21.15.134:48184) 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fd593640 1 -- 172.21.15.134:0/419142259 learned_addr learned my addr 172.21.15.134:0/419142259 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143665170 0 0) 0x7fc9f80716c0 con 0x7fc9f806ebc0 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9f80b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e8003520 con 0x7fc9f806ebc0 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2207551560 0 0) 0x7fc9e8003520 con 0x7fc9f806ebc0 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 msgr2=0x7fc9f80b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9f80b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 >> v1:172.21.15.177:6789/0 conn(0x7fc9f80b1a70 legacy=0x7fc9f80708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f806cdf0 con 0x7fc9f806ebc0 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc9f00019f0 con 0x7fc9f806ebc0 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9f80b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 >> v1:172.21.15.134:6789/0 conn(0x7fc9f806ebc0 legacy=0x7fc9f8070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8004d40 0x7fc9e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f806d720 con 0x7fc9e8004d40 2024-09-15T22:42:09.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e800bc50 con 0x7fc9e8003fd0 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e800be50 con 0x7fc9f80b6b20 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fd593640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8004d40 0x7fc9e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.447+0000 7fc9f7fff640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 -- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 msgr2=0x7fc9e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f80b6b20 0x7fc9e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 -- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8003fd0 msgr2=0x7fc9e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 -- 172.21.15.134:0/419142259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e8003520 con 0x7fc9e8004d40 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9fd593640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8004d40 0x7fc9e80051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000a840 tx=0x7fc9e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6bc9aa2b5da943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000a460 con 0x7fc9e8004d40 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f002f070 con 0x7fc9e8004d40 2024-09-15T22:42:09.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.448+0000 7fc9f77fe640 1 -- 172.21.15.134:0/419142259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f002bcf0 con 0x7fc9e8004d40 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 -- 172.21.15.134:0/419142259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8004d40 msgr2=0x7fc9e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 --2- 172.21.15.134:0/419142259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8004d40 0x7fc9e80051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000a840 tx=0x7fc9e8005830 comp rx=0 tx=0).stop 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9fd593640 1 -- 172.21.15.134:0/419142259 reap_dead start 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 -- 172.21.15.134:0/419142259 shutdown_connections 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 -- 172.21.15.134:0/419142259 >> 172.21.15.134:0/419142259 conn(0x7fc9f80b4220 msgr2=0x7fc9f80b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 -- 172.21.15.134:0/419142259 shutdown_connections 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.449+0000 7fc9feff6640 1 -- 172.21.15.134:0/419142259 wait complete. 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.450+0000 7fc9feff6640 1 Processor -- start 2024-09-15T22:42:09.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.450+0000 7fc9feff6640 1 -- start start 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8004d40 0x7fc9f81f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 0x7fc9f815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f8073b40 con 0x7fc9f815c620 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f806d3b0 con 0x7fc9e8004d40 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9feff6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f8162dc0 con 0x7fc9f815dfe0 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42962/0 (socket says 172.21.15.134:42962) 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9f7fff640 1 -- 172.21.15.134:0/1331093079 learned_addr learned my addr 172.21.15.134:0/1331093079 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8004d40 0x7fc9f81f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.451+0000 7fc9fd593640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 0x7fc9f815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 -- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 msgr2=0x7fc9f815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 0x7fc9f815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 -- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8004d40 msgr2=0x7fc9f81f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8004d40 0x7fc9f81f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 -- 172.21.15.134:0/1331093079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f815caa0 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9fd593640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 0x7fc9f815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f7fff640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400f7f0 tx=0x7fc9e400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40050d0 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e4018070 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f81f90c0 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400d730 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.452+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f81f9680 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.453+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f80b6f00 con 0x7fc9f815c620 2024-09-15T22:42:09.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.453+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9e400d8d0 con 0x7fc9f815c620 2024-09-15T22:42:09.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.454+0000 7fc9f57fa640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 0x7fc9dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.454+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fc9e408ae30 con 0x7fc9f815c620 2024-09-15T22:42:09.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.454+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 0x7fc9dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.454+0000 7fc9fcd92640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 0x7fc9dc06e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006fa0 tx=0x7fc9ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.458+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9e4059980 con 0x7fc9f815c620 2024-09-15T22:42:09.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-15T22:42:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.623+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc9f8161650 con 0x7fc9f815c620 2024-09-15T22:42:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.624+0000 7fc9f57fa640 1 -- 172.21.15.134:0/1331093079 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7fc9e4059280 con 0x7fc9f815c620 2024-09-15T22:42:09.625 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:09.625 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:42:09.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:09.626 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:42:09.626 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:42:09.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:09.626 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:42:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 msgr2=0x7fc9dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 0x7fc9dc06e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006fa0 tx=0x7fc9ec008040 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 msgr2=0x7fc9f8163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400f7f0 tx=0x7fc9e400fcb0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 shutdown_connections 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc9dc06c2b0 0x7fc9dc06e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f815dfe0 0x7fc9f815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9f815c620 0x7fc9f8163ae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 --2- 172.21.15.134:0/1331093079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e8004d40 0x7fc9f81f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 >> 172.21.15.134:0/1331093079 conn(0x7fc9f80b4220 msgr2=0x7fc9f80b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 shutdown_connections 2024-09-15T22:42:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.626+0000 7fc9feff6640 1 -- 172.21.15.134:0/1331093079 wait complete. 2024-09-15T22:42:09.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:42:09.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:42:09.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.740+0000 7f7999a74640 1 Processor -- start 2024-09-15T22:42:09.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.740+0000 7f7999a74640 1 -- start start 2024-09-15T22:42:09.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7999a74640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 0x7f799406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7999a74640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f799415ed20 0x7f799415f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7999a74640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799406c500 con 0x7f7994148100 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7999a74640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f79940b58a0 con 0x7f799415ed20 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7999a74640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f799406f270 con 0x7f799406bba0 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f799415ed20 0x7f799415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f799415ed20 0x7f799415f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42970/0 (socket says 172.21.15.134:42970) 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 -- 172.21.15.134:0/2865707181 learned_addr learned my addr 172.21.15.134:0/2865707181 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7992ffd640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 0x7f799406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 -- 172.21.15.134:0/2865707181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 msgr2=0x7f799406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 0x7f799406bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 -- 172.21.15.134:0/2865707181 >> v1:172.21.15.177:6789/0 conn(0x7f7994148100 legacy=0x7f799406eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7993fff640 1 -- 172.21.15.134:0/2865707181 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79940b4800 con 0x7f799415ed20 2024-09-15T22:42:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.741+0000 7f7992ffd640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 0x7f799406bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f7993fff640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799415ed20 0x7f799415f170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f798c009e50 tx=0x7f798c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d71aee04f5e7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f79927fc640 1 -- 172.21.15.134:0/2865707181 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c036070 con 0x7f799415ed20 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f79927fc640 1 -- 172.21.15.134:0/2865707181 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c031600 con 0x7f799415ed20 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f79927fc640 1 -- 172.21.15.134:0/2865707181 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0319d0 con 0x7f799415ed20 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f7999a74640 1 -- 172.21.15.134:0/2865707181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799415ed20 msgr2=0x7f799415f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.742+0000 7f7999a74640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799415ed20 0x7f799415f170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f798c009e50 tx=0x7f798c02a710 comp rx=0 tx=0).stop 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 -- 172.21.15.134:0/2865707181 shutdown_connections 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799415ed20 0x7f799415f170 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 --2- 172.21.15.134:0/2865707181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f799406bba0 0x7f799406bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 -- 172.21.15.134:0/2865707181 >> 172.21.15.134:0/2865707181 conn(0x7f7994062810 msgr2=0x7f799406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 -- 172.21.15.134:0/2865707181 shutdown_connections 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.743+0000 7f7999a74640 1 -- 172.21.15.134:0/2865707181 wait complete. 2024-09-15T22:42:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.744+0000 7f7999a74640 1 Processor -- start 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.744+0000 7f7999a74640 1 -- start start 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 0x7f799413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f799415ed20 0x7f7994141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79940b4dc0 con 0x7f799406bba0 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79941484e0 con 0x7f799415ed20 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f79940b50a0 con 0x7f7994148100 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42982/0 (socket says 172.21.15.134:42982) 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 -- 172.21.15.134:0/1608167911 learned_addr learned my addr 172.21.15.134:0/1608167911 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7992ffd640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 0x7f799413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7993fff640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f799415ed20 0x7f7994141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 -- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 msgr2=0x7f799413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 0x7f799413f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 -- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f799415ed20 msgr2=0x7f7994141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f799415ed20 0x7f7994141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 -- 172.21.15.134:0/1608167911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799413c380 con 0x7f799406bba0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7992ffd640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 0x7f799413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f79937fe640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f798400c400 tx=0x7f798400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840052d0 con 0x7f799406bba0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984005490 con 0x7f799406bba0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941e7420 con 0x7f799406bba0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984007260 con 0x7f799406bba0 2024-09-15T22:42:09.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.745+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941e79e0 con 0x7f799406bba0 2024-09-15T22:42:09.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.746+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79940b5380 con 0x7f799406bba0 2024-09-15T22:42:09.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.747+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7984007400 con 0x7f799406bba0 2024-09-15T22:42:09.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.747+0000 7f797bfff640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 0x7f798006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.748+0000 7f7992ffd640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 0x7f798006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.748+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f798408a4e0 con 0x7f799406bba0 2024-09-15T22:42:09.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.748+0000 7f7992ffd640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 0x7f798006e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f799413ee60 tx=0x7f7988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.752+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f799413c380 con 0x7f799406bba0 2024-09-15T22:42:09.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:09.920+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f799406ed60 con 0x7f799406bba0 2024-09-15T22:42:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.865+0000 7f797bfff640 1 -- 172.21.15.134:0/1608167911 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f79840589e0 con 0x7f799406bba0 2024-09-15T22:42:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:42:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 msgr2=0x7f798006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 0x7f798006e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f799413ee60 tx=0x7f7988008040 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 msgr2=0x7f799413be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f798400c400 tx=0x7f798400c8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 shutdown_connections 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f798006c2e0 0x7f798006e7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f799415ed20 0x7f7994141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7994148100 0x7f799413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 --2- 172.21.15.134:0/1608167911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799406bba0 0x7f799413be40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 >> 172.21.15.134:0/1608167911 conn(0x7f7994062810 msgr2=0x7f79940cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 shutdown_connections 2024-09-15T22:42:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.869+0000 7f7999a74640 1 -- 172.21.15.134:0/1608167911 wait complete. 2024-09-15T22:42:10.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:42:10.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.997+0000 7f6ddae53640 1 Processor -- start 2024-09-15T22:42:10.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.997+0000 7f6ddae53640 1 -- start start 2024-09-15T22:42:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6ddae53640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6dd40b5630 0x7f6dd406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6ddae53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 0x7f6dd406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6ddae53640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd40b0470 con 0x7f6dd415c4b0 2024-09-15T22:42:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6ddae53640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40cdc10 con 0x7f6dd40b5630 2024-09-15T22:42:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6ddae53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40cdef0 con 0x7f6dd40b5c10 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6dcbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6dd40b5630 0x7f6dd406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6dcbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6dd40b5630 0x7f6dd406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42996/0 (socket says 172.21.15.134:42996) 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6dcbfff640 1 -- 172.21.15.134:0/3754775455 learned_addr learned my addr 172.21.15.134:0/3754775455 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.998+0000 7f6dd8bef640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6dd415c4b0 0x7f6dd40b4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48196/0 (socket says 172.21.15.134:48196) 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcbfff640 1 -- 172.21.15.134:0/3754775455 >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 msgr2=0x7f6dd406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcb7fe640 1 -- 172.21.15.134:0/3754775455 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403430759 0 0) 0x7f6dd40b0470 con 0x7f6dd415c4b0 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dd93f0640 1 --2- 172.21.15.134:0/3754775455 >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 0x7f6dd406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcbfff640 1 --2- 172.21.15.134:0/3754775455 >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 0x7f6dd406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcbfff640 1 -- 172.21.15.134:0/3754775455 >> v1:172.21.15.134:6789/0 conn(0x7f6dd415c4b0 legacy=0x7f6dd40b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcbfff640 1 -- 172.21.15.134:0/3754775455 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40ce1d0 con 0x7f6dd40b5630 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dd93f0640 1 --2- 172.21.15.134:0/3754775455 >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 0x7f6dd406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcbfff640 1 --2- 172.21.15.134:0/3754775455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5630 0x7f6dd406de50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b3b00 tx=0x7f6dc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51df7b2b06cf9b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcb7fe640 1 -- 172.21.15.134:0/3754775455 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4037070 con 0x7f6dd40b5630 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcb7fe640 1 -- 172.21.15.134:0/3754775455 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4032440 con 0x7f6dd40b5630 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:10.999+0000 7f6dcb7fe640 1 -- 172.21.15.134:0/3754775455 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4032810 con 0x7f6dd40b5630 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 -- 172.21.15.134:0/3754775455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5630 msgr2=0x7f6dd406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 --2- 172.21.15.134:0/3754775455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5630 0x7f6dd406de50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b3b00 tx=0x7f6dc402a270 comp rx=0 tx=0).stop 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 -- 172.21.15.134:0/3754775455 shutdown_connections 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 --2- 172.21.15.134:0/3754775455 >> v2:172.21.15.177:3300/0 conn(0x7f6dd40b5c10 0x7f6dd406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 --2- 172.21.15.134:0/3754775455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5630 0x7f6dd406de50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 -- 172.21.15.134:0/3754775455 >> 172.21.15.134:0/3754775455 conn(0x7f6dd406c9f0 msgr2=0x7f6dd406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 -- 172.21.15.134:0/3754775455 shutdown_connections 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.000+0000 7f6ddae53640 1 -- 172.21.15.134:0/3754775455 wait complete. 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.001+0000 7f6ddae53640 1 Processor -- start 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.001+0000 7f6ddae53640 1 -- start start 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 0x7f6dd41f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 0x7f6dd415f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40ce790 con 0x7f6dd40b5c10 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd415c890 con 0x7f6dd40b5630 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6ddae53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40ce910 con 0x7f6dd415c4b0 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42998/0 (socket says 172.21.15.134:42998) 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6dcbfff640 1 -- 172.21.15.134:0/1727928447 learned_addr learned my addr 172.21.15.134:0/1727928447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6dd8bef640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 0x7f6dd41f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.002+0000 7f6dd93f0640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 0x7f6dd415f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 -- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 msgr2=0x7f6dd415f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 0x7f6dd415f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 -- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 msgr2=0x7f6dd41f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 0x7f6dd41f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 -- 172.21.15.134:0/1727928447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd41546f0 con 0x7f6dd40b5c10 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dd8bef640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 0x7f6dd41f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dd93f0640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 0x7f6dd415f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dcbfff640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000c00 tx=0x7f6dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4037040 con 0x7f6dd40b5c10 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4004230 con 0x7f6dd40b5c10 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd41549d0 con 0x7f6dd40b5c10 2024-09-15T22:42:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc403c670 con 0x7f6dd40b5c10 2024-09-15T22:42:11.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.003+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd4154f90 con 0x7f6dd40b5c10 2024-09-15T22:42:11.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.004+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd40d0820 con 0x7f6dd40b5c10 2024-09-15T22:42:11.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.004+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6dc403a070 con 0x7f6dd40b5c10 2024-09-15T22:42:11.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.005+0000 7f6dc97fa640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 0x7f6dc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.005+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7f6dc40ab9f0 con 0x7f6dd40b5c10 2024-09-15T22:42:11.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.005+0000 7f6dd8bef640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 0x7f6dc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.005+0000 7f6dd8bef640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 0x7f6dc006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00012e0 tx=0x7f6dd0005b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:11.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.009+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dc4041020 con 0x7f6dd40b5c10 2024-09-15T22:42:11.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.177+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6dd41591f0 con 0x7f6dd40b5c10 2024-09-15T22:42:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.870+0000 7f6dc97fa640 1 -- 172.21.15.134:0/1727928447 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7f6dc407a340 con 0x7f6dd40b5c10 2024-09-15T22:42:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:42:11.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 msgr2=0x7f6dc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 0x7f6dc006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00012e0 tx=0x7f6dd0005b90 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 msgr2=0x7f6dd4153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000c00 tx=0x7f6dc40046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 shutdown_connections 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6dc006c2b0 0x7f6dc006e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6dd415c4b0 0x7f6dd415f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd40b5c10 0x7f6dd4153ff0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 --2- 172.21.15.134:0/1727928447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd40b5630 0x7f6dd41f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 >> 172.21.15.134:0/1727928447 conn(0x7f6dd406c9f0 msgr2=0x7f6dd4156790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 shutdown_connections 2024-09-15T22:42:11.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.873+0000 7f6ddae53640 1 -- 172.21.15.134:0/1727928447 wait complete. 2024-09-15T22:42:11.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.998+0000 7f4ef3fff640 1 Processor -- start 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.998+0000 7f4ef3fff640 1 -- start start 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ef40cf510 0x7f4ef40b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4ef40b7bb0 0x7f4ef406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef3fff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef415eaa0 con 0x7f4ef415e6c0 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef3fff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef40d34d0 con 0x7f4ef40cf510 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef3fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef40d28c0 con 0x7f4ef40b7bb0 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef27fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ef40cf510 0x7f4ef40b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef27fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ef40cf510 0x7f4ef40b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43014/0 (socket says 172.21.15.134:43014) 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef27fc640 1 -- 172.21.15.134:0/3689505533 learned_addr learned my addr 172.21.15.134:0/3689505533 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:11.999+0000 7f4ef2ffd640 1 --1- 172.21.15.134:0/3689505533 >> v1:172.21.15.134:6789/0 conn(0x7f4ef415e6c0 0x7f4ef406c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48206/0 (socket says 172.21.15.134:48206) 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef37fe640 1 --2- 172.21.15.134:0/3689505533 >> v2:172.21.15.177:3300/0 conn(0x7f4ef40b7bb0 0x7f4ef406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef27fc640 1 -- 172.21.15.134:0/3689505533 >> v2:172.21.15.177:3300/0 conn(0x7f4ef40b7bb0 msgr2=0x7f4ef406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef27fc640 1 --2- 172.21.15.134:0/3689505533 >> v2:172.21.15.177:3300/0 conn(0x7f4ef40b7bb0 0x7f4ef406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef27fc640 1 -- 172.21.15.134:0/3689505533 >> v1:172.21.15.134:6789/0 conn(0x7f4ef415e6c0 legacy=0x7f4ef406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef1ffb640 1 -- 172.21.15.134:0/3689505533 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526508435 0 0) 0x7f4ef415eaa0 con 0x7f4ef415e6c0 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef27fc640 1 -- 172.21.15.134:0/3689505533 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef40d2ba0 con 0x7f4ef40cf510 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.000+0000 7f4ef27fc640 1 --2- 172.21.15.134:0/3689505533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef40b7670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40cb510 tx=0x7f4ee802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3a99bc439fbded server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef1ffb640 1 -- 172.21.15.134:0/3689505533 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8037070 con 0x7f4ef40cf510 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef1ffb640 1 -- 172.21.15.134:0/3689505533 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8032440 con 0x7f4ef40cf510 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef1ffb640 1 -- 172.21.15.134:0/3689505533 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8032810 con 0x7f4ef40cf510 2024-09-15T22:42:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 -- 172.21.15.134:0/3689505533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 msgr2=0x7f4ef40b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/3689505533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef40b7670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40cb510 tx=0x7f4ee802a270 comp rx=0 tx=0).stop 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 -- 172.21.15.134:0/3689505533 shutdown_connections 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/3689505533 >> v2:172.21.15.177:3300/0 conn(0x7f4ef40b7bb0 0x7f4ef406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/3689505533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef40b7670 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 -- 172.21.15.134:0/3689505533 >> 172.21.15.134:0/3689505533 conn(0x7f4ef40d4720 msgr2=0x7f4ef40d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 -- 172.21.15.134:0/3689505533 shutdown_connections 2024-09-15T22:42:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.001+0000 7f4ef3fff640 1 -- 172.21.15.134:0/3689505533 wait complete. 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.002+0000 7f4ef3fff640 1 Processor -- start 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 -- start start 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40b7bb0 0x7f4ef4159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 0x7f4ef414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef406db50 con 0x7f4ef40cf510 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40d3160 con 0x7f4ef415e6c0 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef3fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef406dcd0 con 0x7f4ef40b7bb0 2024-09-15T22:42:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43024/0 (socket says 172.21.15.134:43024) 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef27fc640 1 -- 172.21.15.134:0/2057246869 learned_addr learned my addr 172.21.15.134:0/2057246869 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.003+0000 7f4ef37fe640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 0x7f4ef414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef2ffd640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40b7bb0 0x7f4ef4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 -- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40b7bb0 msgr2=0x7f4ef4159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40b7bb0 0x7f4ef4159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 -- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 msgr2=0x7f4ef414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 0x7f4ef414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 -- 172.21.15.134:0/2057246869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef415f850 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef37fe640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 0x7f4ef414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef27fc640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80090b0 tx=0x7f4ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8037040 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8004030 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef415faf0 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004400 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.004+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef41612e0 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.005+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef406d610 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.006+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ee803a070 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.006+0000 7f4edb7fe640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 0x7f4ee006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.006+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7f4ee80aba20 con 0x7f4ef40cf510 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.006+0000 7f4ef2ffd640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 0x7f4ee006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.007+0000 7f4ef2ffd640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 0x7f4ee006e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40012e0 tx=0x7f4ee4005eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.011+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ee8041020 con 0x7f4ef40cf510 2024-09-15T22:42:12.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.210+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4ef40b6e20 con 0x7f4ef40cf510 2024-09-15T22:42:12.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.872+0000 7f4edb7fe640 1 -- 172.21.15.134:0/2057246869 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f4ee807a1f0 con 0x7f4ef40cf510 2024-09-15T22:42:12.874 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 4 and data pool 5 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 msgr2=0x7f4ee006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 0x7f4ee006e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40012e0 tx=0x7f4ee4005eb0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 msgr2=0x7f4ef41605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80090b0 tx=0x7f4ee80046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 shutdown_connections 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4ee006c2b0 0x7f4ee006e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef415e6c0 0x7f4ef414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ef40cf510 0x7f4ef41605d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 --2- 172.21.15.134:0/2057246869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40b7bb0 0x7f4ef4159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.875+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 >> 172.21.15.134:0/2057246869 conn(0x7f4ef40d4720 msgr2=0x7f4ef40b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.876+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 shutdown_connections 2024-09-15T22:42:12.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:12.876+0000 7f4ef3fff640 1 -- 172.21.15.134:0/2057246869 wait complete. 2024-09-15T22:42:12.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:13.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.008+0000 7f2edfa8d640 1 Processor -- start 2024-09-15T22:42:13.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.008+0000 7f2edfa8d640 1 -- start start 2024-09-15T22:42:13.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edfa8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ed815c180 0x7f2ed80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edfa8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed80ce740 con 0x7f2ed8073120 2024-09-15T22:42:13.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edfa8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed8072640 con 0x7f2ed80ce230 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edfa8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed8072920 con 0x7f2ed815c180 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ed815c180 0x7f2ed80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ed815c180 0x7f2ed80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43036/0 (socket says 172.21.15.134:43036) 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 -- 172.21.15.134:0/1488180037 learned_addr learned my addr 172.21.15.134:0/1488180037 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2ede02a640 1 --1- 172.21.15.134:0/1488180037 >> v1:172.21.15.134:6789/0 conn(0x7f2ed8073120 0x7f2ed806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48218/0 (socket says 172.21.15.134:48218) 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 -- 172.21.15.134:0/1488180037 >> v1:172.21.15.177:6789/0 conn(0x7f2ed80ce230 legacy=0x7f2ed80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 -- 172.21.15.134:0/1488180037 >> v1:172.21.15.134:6789/0 conn(0x7f2ed8073120 legacy=0x7f2ed806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.009+0000 7f2edd829640 1 -- 172.21.15.134:0/1488180037 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed8072c00 con 0x7f2ed815c180 2024-09-15T22:42:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.010+0000 7f2edd829640 1 --2- 172.21.15.134:0/1488180037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed80cdcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009870 tx=0x7f2ed402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04be5854c6771b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.010+0000 7f2edc827640 1 -- 172.21.15.134:0/1488180037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4037070 con 0x7f2ed815c180 2024-09-15T22:42:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.010+0000 7f2edc827640 1 -- 172.21.15.134:0/1488180037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4032440 con 0x7f2ed815c180 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.010+0000 7f2edc827640 1 -- 172.21.15.134:0/1488180037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4032810 con 0x7f2ed815c180 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1488180037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 msgr2=0x7f2ed80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1488180037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed80cdcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009870 tx=0x7f2ed402a210 comp rx=0 tx=0).stop 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1488180037 shutdown_connections 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1488180037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed80cdcf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1488180037 >> 172.21.15.134:0/1488180037 conn(0x7f2ed8062cc0 msgr2=0x7f2ed806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1488180037 shutdown_connections 2024-09-15T22:42:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.011+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1488180037 wait complete. 2024-09-15T22:42:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.012+0000 7f2edfa8d640 1 Processor -- start 2024-09-15T22:42:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.012+0000 7f2edfa8d640 1 -- start start 2024-09-15T22:42:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed8073120 0x7f2ed8148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80ce230 0x7f2ed80c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed80cf780 con 0x7f2ed815c180 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed80722f0 con 0x7f2ed80ce230 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edfa8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed815c560 con 0x7f2ed8073120 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43038/0 (socket says 172.21.15.134:43038) 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 -- 172.21.15.134:0/1638802667 learned_addr learned my addr 172.21.15.134:0/1638802667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edd829640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed8073120 0x7f2ed8148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2edd028640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80ce230 0x7f2ed80c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 -- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed8073120 msgr2=0x7f2ed8148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed8073120 0x7f2ed8148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 -- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80ce230 msgr2=0x7f2ed80c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80ce230 0x7f2ed80c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 -- 172.21.15.134:0/1638802667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed80c80b0 con 0x7f2ed815c180 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ede02a640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c7b0 tx=0x7f2ed000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.013+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0017070 con 0x7f2ed815c180 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.014+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed000a640 con 0x7f2ed815c180 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.014+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed80c8390 con 0x7f2ed815c180 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.014+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000a9f0 con 0x7f2ed815c180 2024-09-15T22:42:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.014+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed80c8950 con 0x7f2ed815c180 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.015+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed80cdcf0 con 0x7f2ed815c180 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.015+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ed001a070 con 0x7f2ed815c180 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.015+0000 7f2ece7fc640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 0x7f2ebc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.016+0000 7f2edd829640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 0x7f2ebc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.016+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed008a8f0 con 0x7f2ed815c180 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.016+0000 7f2edd829640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 0x7f2ebc06e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4034000 tx=0x7f2ed402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.020+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ed0058aa0 con 0x7f2ed815c180 2024-09-15T22:42:13.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.186+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ed806d520 con 0x7f2ed815c180 2024-09-15T22:42:13.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.187+0000 7f2ece7fc640 1 -- 172.21.15.134:0/1638802667 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16718 (secure 0 0 0) 0x7f2ed005cda0 con 0x7f2ed815c180 2024-09-15T22:42:13.189 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:13.189 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":34,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:12.211821+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:09.938942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:11.196490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.189+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 msgr2=0x7f2ebc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.189+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 0x7f2ebc06e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4034000 tx=0x7f2ed402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 msgr2=0x7f2ed815d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c7b0 tx=0x7f2ed000cc70 comp rx=0 tx=0).stop 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 shutdown_connections 2024-09-15T22:42:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2ebc06c2b0 0x7f2ebc06e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed815c180 0x7f2ed815d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80ce230 0x7f2ed80c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 --2- 172.21.15.134:0/1638802667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed8073120 0x7f2ed8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 >> 172.21.15.134:0/1638802667 conn(0x7f2ed8062cc0 msgr2=0x7f2ed815e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 shutdown_connections 2024-09-15T22:42:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.190+0000 7f2edfa8d640 1 -- 172.21.15.134:0/1638802667 wait complete. 2024-09-15T22:42:13.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.300+0000 7fd3280a5640 1 Processor -- start 2024-09-15T22:42:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.300+0000 7fd3280a5640 1 -- start start 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd3280a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32006f1e0 0x7fd320169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd3280a5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32015ecf0 con 0x7fd32015c300 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd3280a5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32015c6e0 con 0x7fd3200cd300 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd3280a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd32015efb0 con 0x7fd32006f1e0 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd325e41640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd32015c300 0x7fd3200affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48222/0 (socket says 172.21.15.134:48222) 2024-09-15T22:42:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd325e41640 1 -- 172.21.15.134:0/1147695729 learned_addr learned my addr 172.21.15.134:0/1147695729 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd326642640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32006f1e0 0x7fd320169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479440199 0 0) 0x7fd32015ecf0 con 0x7fd32015c300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.301+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd30c003520 con 0x7fd32015c300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832116035 0 0) 0x7fd32015c6e0 con 0x7fd3200cd300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd32015ecf0 con 0x7fd3200cd300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510528735 0 0) 0x7fd30c003520 con 0x7fd32015c300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32006f1e0 msgr2=0x7fd320169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32006f1e0 0x7fd320169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 >> v1:172.21.15.177:6789/0 conn(0x7fd3200cd300 legacy=0x7fd32006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32015f290 con 0x7fd32015c300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd31c001670 con 0x7fd32015c300 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 >> v1:172.21.15.134:6789/0 conn(0x7fd32015c300 legacy=0x7fd3200affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c003b70 0x7fd30c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd30c0051c0 0x7fd30c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd32015efb0 con 0x7fd30c004800 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c00c090 con 0x7fd30c0051c0 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd30c00c290 con 0x7fd30c003b70 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd326642640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd32006f1e0 0x7fd320169460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325e41640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c003b70 0x7fd30c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd326642640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd30c0051c0 0x7fd30c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 -- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c003b70 msgr2=0x7fd30c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c003b70 0x7fd30c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 -- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd30c0051c0 msgr2=0x7fd30c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd30c0051c0 0x7fd30c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.302+0000 7fd325640640 1 -- 172.21.15.134:0/1147695729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c003520 con 0x7fd30c004800 2024-09-15T22:42:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd325640640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3100018c0 tx=0x7fd30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9515de14c8f9558a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3100014e0 con 0x7fd30c004800 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3100052f0 con 0x7fd30c004800 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd324e3f640 1 -- 172.21.15.134:0/1147695729 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31002ac90 con 0x7fd30c004800 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd3280a5640 1 -- 172.21.15.134:0/1147695729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30c004800 msgr2=0x7fd30c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd3280a5640 1 --2- 172.21.15.134:0/1147695729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3100018c0 tx=0x7fd30c005830 comp rx=0 tx=0).stop 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.303+0000 7fd326642640 1 -- 172.21.15.134:0/1147695729 reap_dead start 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.304+0000 7fd3280a5640 1 -- 172.21.15.134:0/1147695729 shutdown_connections 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.304+0000 7fd3280a5640 1 -- 172.21.15.134:0/1147695729 >> 172.21.15.134:0/1147695729 conn(0x7fd32006cae0 msgr2=0x7fd32006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.304+0000 7fd3280a5640 1 -- 172.21.15.134:0/1147695729 shutdown_connections 2024-09-15T22:42:13.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.304+0000 7fd3280a5640 1 -- 172.21.15.134:0/1147695729 wait complete. 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 Processor -- start 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 -- start start 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c004800 0x7fd32014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32015af40 0x7fd32015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd320071880 con 0x7fd32015fe80 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd32015f850 con 0x7fd32015af40 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.305+0000 7fd3280a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd320167450 con 0x7fd30c004800 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43054/0 (socket says 172.21.15.134:43054) 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 -- 172.21.15.134:0/2857815235 learned_addr learned my addr 172.21.15.134:0/2857815235 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:13.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd326642640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32015af40 0x7fd32015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325e41640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c004800 0x7fd32014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 -- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c004800 msgr2=0x7fd32014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c004800 0x7fd32014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 -- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32015af40 msgr2=0x7fd32015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32015af40 0x7fd32015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 -- 172.21.15.134:0/2857815235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd320160f00 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd325640640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd310005040 tx=0x7fd3100012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3100014e0 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd310041070 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd320160680 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd310007a50 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.306+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd320160c20 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.307+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32006ead0 con 0x7fd32015fe80 2024-09-15T22:42:13.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.308+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3100052f0 con 0x7fd32015fe80 2024-09-15T22:42:13.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.308+0000 7fd3167fc640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 0x7fd30406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.308+0000 7fd325e41640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 0x7fd30406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.308+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd3100ab4f0 con 0x7fd32015fe80 2024-09-15T22:42:13.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.309+0000 7fd325e41640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 0x7fd30406e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd31c001eb0 tx=0x7fd31c000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.312+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd320160f00 con 0x7fd32015fe80 2024-09-15T22:42:13.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.479+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3200762f0 con 0x7fd32015fe80 2024-09-15T22:42:13.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.480+0000 7fd3167fc640 1 -- 172.21.15.134:0/2857815235 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16718 (secure 0 0 0) 0x7fd310007680 con 0x7fd32015fe80 2024-09-15T22:42:13.482 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:13.482 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":34,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:12.211821+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:09.938942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:11.196490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:13.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 msgr2=0x7fd30406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 0x7fd30406e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd31c001eb0 tx=0x7fd31c000f80 comp rx=0 tx=0).stop 2024-09-15T22:42:13.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 msgr2=0x7fd32015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd310005040 tx=0x7fd3100012d0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 shutdown_connections 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd30406c2b0 0x7fd30406e770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd32015af40 0x7fd32015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32015fe80 0x7fd32015dcc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 --2- 172.21.15.134:0/2857815235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd30c004800 0x7fd32014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 >> 172.21.15.134:0/2857815235 conn(0x7fd32006cae0 msgr2=0x7fd320071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 shutdown_connections 2024-09-15T22:42:13.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.483+0000 7fd3280a5640 1 -- 172.21.15.134:0/2857815235 wait complete. 2024-09-15T22:42:13.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:42:13.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.595+0000 7ffbe24f8640 1 Processor -- start 2024-09-15T22:42:13.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.595+0000 7ffbe24f8640 1 -- start start 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe24f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 0x7ffbdc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe24f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbdc0715c0 con 0x7ffbdc0cf320 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe24f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbdc06d700 con 0x7ffbdc15d790 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe24f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc06da30 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe0a95640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffbdc0cf320 0x7ffbdc0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48224/0 (socket says 172.21.15.134:48224) 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbe0a95640 1 -- 172.21.15.134:0/1791877693 learned_addr learned my addr 172.21.15.134:0/1791877693 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbdbfff640 1 --2- 172.21.15.134:0/1791877693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 0x7ffbdc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412057939 0 0) 0x7ffbdc0715c0 con 0x7ffbdc0cf320 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.596+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc4003520 con 0x7ffbdc0cf320 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261204898 0 0) 0x7ffbdc06d700 con 0x7ffbdc15d790 2024-09-15T22:42:13.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdbfff640 1 -- 172.21.15.134:0/1791877693 >> v1:172.21.15.177:6789/0 conn(0x7ffbdc15d790 legacy=0x7ffbdc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdbfff640 1 -- 172.21.15.134:0/1791877693 >> v1:172.21.15.134:6789/0 conn(0x7ffbdc0cf320 legacy=0x7ffbdc0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdbfff640 1 -- 172.21.15.134:0/1791877693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc0cde80 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdbfff640 1 --2- 172.21.15.134:0/1791877693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 0x7ffbdc071080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc06dbb0 tx=0x7ffbcc02a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40d29970819b4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.597+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc037070 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc02abf0 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbdaffd640 1 -- 172.21.15.134:0/1791877693 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40019f0 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 -- 172.21.15.134:0/1791877693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 msgr2=0x7ffbdc071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/1791877693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 0x7ffbdc071080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc06dbb0 tx=0x7ffbcc02a160 comp rx=0 tx=0).stop 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 -- 172.21.15.134:0/1791877693 shutdown_connections 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/1791877693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc15d3b0 0x7ffbdc071080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 -- 172.21.15.134:0/1791877693 >> 172.21.15.134:0/1791877693 conn(0x7ffbdc06bba0 msgr2=0x7ffbdc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 -- 172.21.15.134:0/1791877693 shutdown_connections 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.598+0000 7ffbe24f8640 1 -- 172.21.15.134:0/1791877693 wait complete. 2024-09-15T22:42:13.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.599+0000 7ffbe24f8640 1 Processor -- start 2024-09-15T22:42:13.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.599+0000 7ffbe24f8640 1 -- start start 2024-09-15T22:42:13.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbdc15d3b0 0x7ffbdc1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 0x7ffbdc155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc0cd580 con 0x7ffbdc0cf320 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc0cdba0 con 0x7ffbdc15d3b0 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe24f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc15cbf0 con 0x7ffbdc153720 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbdbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbdbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43064/0 (socket says 172.21.15.134:43064) 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbdbfff640 1 -- 172.21.15.134:0/4289179003 learned_addr learned my addr 172.21.15.134:0/4289179003 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbdb7fe640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbdc15d3b0 0x7ffbdc1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.600+0000 7ffbe0a95640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 0x7ffbdc155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 -- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 msgr2=0x7ffbdc155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 0x7ffbdc155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 -- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbdc15d3b0 msgr2=0x7ffbdc1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbdc15d3b0 0x7ffbdc1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 -- 172.21.15.134:0/4289179003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc1f61a0 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbe0a95640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 0x7ffbdc155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbdbfff640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc02a750 tx=0x7ffbcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc042020 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc003a40 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc14d5d0 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc037040 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.601+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc14db90 con 0x7ffbdc0cf320 2024-09-15T22:42:13.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.602+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc0cf730 con 0x7ffbdc0cf320 2024-09-15T22:42:13.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.602+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffbcc045020 con 0x7ffbdc0cf320 2024-09-15T22:42:13.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.603+0000 7ffbd8ff9640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 0x7ffbc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:13.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.603+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ffbcc0aba90 con 0x7ffbdc0cf320 2024-09-15T22:42:13.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.603+0000 7ffbdb7fe640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 0x7ffbc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:13.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.603+0000 7ffbdb7fe640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 0x7ffbc806e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc157a30 tx=0x7ffbd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:13.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.607+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbcc04c030 con 0x7ffbdc0cf320 2024-09-15T22:42:13.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.811+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffbdc06f260 con 0x7ffbdc0cf320 2024-09-15T22:42:13.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.902+0000 7ffbd8ff9640 1 -- 172.21.15.134:0/4289179003 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7ffbcc07a320 con 0x7ffbdc0cf320 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 msgr2=0x7ffbc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 0x7ffbc806e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc157a30 tx=0x7ffbd0009040 comp rx=0 tx=0).stop 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 msgr2=0x7ffbdc14cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc02a750 tx=0x7ffbcc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 shutdown_connections 2024-09-15T22:42:13.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbc806c2b0 0x7ffbc806e770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbdc153720 0x7ffbdc155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbdc15d3b0 0x7ffbdc1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 --2- 172.21.15.134:0/4289179003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbdc0cf320 0x7ffbdc14cf20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 >> 172.21.15.134:0/4289179003 conn(0x7ffbdc06bba0 msgr2=0x7ffbdc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 shutdown_connections 2024-09-15T22:42:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:13.904+0000 7ffbe24f8640 1 -- 172.21.15.134:0/4289179003 wait complete. 2024-09-15T22:42:13.917 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:42:13.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:42:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.017+0000 7f5ee67cf640 1 Processor -- start 2024-09-15T22:42:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.017+0000 7f5ee67cf640 1 -- start start 2024-09-15T22:42:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee67cf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ee0158e50 0x7f5ee00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee67cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee015c370 0x7f5ee006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee67cf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee015c800 con 0x7f5ee006ef60 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee67cf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee006f3d0 con 0x7f5ee0158e50 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee67cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee00b43f0 con 0x7f5ee015c370 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ee0158e50 0x7f5ee00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee4d6c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5ee006ef60 0x7f5ee015ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:38154/0 (socket says 172.21.15.134:38154) 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ee0158e50 0x7f5ee00b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:60928/0 (socket says 172.21.15.134:60928) 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5ee4d6c640 1 -- 172.21.15.134:0/4192866317 learned_addr learned my addr 172.21.15.134:0/4192866317 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edf7fe640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee015c370 0x7f5ee006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 -- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee015c370 msgr2=0x7f5ee006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee015c370 0x7f5ee006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 -- 172.21.15.134:0/4192866317 >> v1:172.21.15.177:6789/0 conn(0x7f5ee006ef60 legacy=0x7f5ee015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.018+0000 7f5edffff640 1 -- 172.21.15.134:0/4192866317 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee00b3630 con 0x7f5ee0158e50 2024-09-15T22:42:14.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.019+0000 7f5edffff640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00b5050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00097a0 tx=0x7f5ed002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0edb47368364ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:14.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.019+0000 7f5edeffd640 1 -- 172.21.15.134:0/4192866317 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0037070 con 0x7f5ee0158e50 2024-09-15T22:42:14.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.019+0000 7f5edeffd640 1 -- 172.21.15.134:0/4192866317 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed0032440 con 0x7f5ee0158e50 2024-09-15T22:42:14.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.019+0000 7f5edeffd640 1 -- 172.21.15.134:0/4192866317 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0032810 con 0x7f5ee0158e50 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 -- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 msgr2=0x7f5ee00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00b5050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00097a0 tx=0x7f5ed002a180 comp rx=0 tx=0).stop 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 -- 172.21.15.134:0/4192866317 shutdown_connections 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee015c370 0x7f5ee006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/4192866317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00b5050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 -- 172.21.15.134:0/4192866317 >> 172.21.15.134:0/4192866317 conn(0x7f5ee006bba0 msgr2=0x7f5ee006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 -- 172.21.15.134:0/4192866317 shutdown_connections 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.020+0000 7f5ee67cf640 1 -- 172.21.15.134:0/4192866317 wait complete. 2024-09-15T22:42:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.021+0000 7f5ee67cf640 1 Processor -- start 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.021+0000 7f5ee67cf640 1 -- start start 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee006ef60 0x7f5ee0165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee00b3ed0 con 0x7f5ee015c370 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee00b3bf0 con 0x7f5ee0158e50 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee67cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee0159230 con 0x7f5ee006ef60 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43066/0 (socket says 172.21.15.134:43066) 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 -- 172.21.15.134:0/618050458 learned_addr learned my addr 172.21.15.134:0/618050458 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5edffff640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee006ef60 0x7f5ee0165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5edf7fe640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 -- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee006ef60 msgr2=0x7f5ee0165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee006ef60 0x7f5ee0165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 -- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 msgr2=0x7f5ee00aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 -- 172.21.15.134:0/618050458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee014a0a0 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.022+0000 7f5ee4d6c640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800cbf0 tx=0x7f5ed800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.023+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8017070 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.023+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed800ad40 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.023+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee0152880 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.023+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8012600 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.023+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee0152e40 con 0x7f5ee015c370 2024-09-15T22:42:14.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.024+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee00afd70 con 0x7f5ee015c370 2024-09-15T22:42:14.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.024+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ed801a070 con 0x7f5ee015c370 2024-09-15T22:42:14.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.024+0000 7f5edcff9640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 0x7f5ec006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:14.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.025+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5ed808b060 con 0x7f5ee015c370 2024-09-15T22:42:14.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.025+0000 7f5edffff640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 0x7f5ec006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.025+0000 7f5edffff640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 0x7f5ec006e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0034000 tx=0x7f5ed002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.029+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ed8059210 con 0x7f5ee015c370 2024-09-15T22:42:14.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.230+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5ee00cef60 con 0x7f5ee015c370 2024-09-15T22:42:14.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.908+0000 7f5edcff9640 1 -- 172.21.15.134:0/618050458 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f5ed805d510 con 0x7f5ee015c370 2024-09-15T22:42:14.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 msgr2=0x7f5ec006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 0x7f5ec006e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0034000 tx=0x7f5ed002e000 comp rx=0 tx=0).stop 2024-09-15T22:42:14.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 msgr2=0x7f5ee0148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800cbf0 tx=0x7f5ed800a430 comp rx=0 tx=0).stop 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 shutdown_connections 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5ec006c2b0 0x7f5ec006e770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ee015c370 0x7f5ee0148f00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee0158e50 0x7f5ee00aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 --2- 172.21.15.134:0/618050458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ee006ef60 0x7f5ee0165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 >> 172.21.15.134:0/618050458 conn(0x7f5ee006bba0 msgr2=0x7f5ee00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 shutdown_connections 2024-09-15T22:42:14.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:14.911+0000 7f5ee67cf640 1 -- 172.21.15.134:0/618050458 wait complete. 2024-09-15T22:42:14.925 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:42:14.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.026+0000 7fa69e196640 1 Processor -- start 2024-09-15T22:42:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.026+0000 7fa69e196640 1 -- start start 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa69e196640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa698156880 0x7fa6980cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa69e196640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6980aff30 0x7fa6980b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa69e196640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6980b0880 con 0x7fa6980b65c0 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa69e196640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa6980ce150 con 0x7fa698156880 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa69e196640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa6980ce430 con 0x7fa6980aff30 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa6977fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa698156880 0x7fa6980cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa6977fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa698156880 0x7fa6980cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43082/0 (socket says 172.21.15.134:43082) 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa68ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa6980b65c0 0x7fa698160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48234/0 (socket says 172.21.15.134:48234) 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.027+0000 7fa6977fe640 1 -- 172.21.15.134:0/4013555440 learned_addr learned my addr 172.21.15.134:0/4013555440 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa6977fe640 1 -- 172.21.15.134:0/4013555440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6980aff30 msgr2=0x7fa6980b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa6977fe640 1 --2- 172.21.15.134:0/4013555440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6980aff30 0x7fa6980b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa6977fe640 1 -- 172.21.15.134:0/4013555440 >> v1:172.21.15.134:6789/0 conn(0x7fa6980b65c0 legacy=0x7fa698160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa6977fe640 1 -- 172.21.15.134:0/4013555440 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69815ff30 con 0x7fa698156880 2024-09-15T22:42:15.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa696ffd640 1 -- 172.21.15.134:0/4013555440 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201821155 0 0) 0x7fa680001110 con 0x7fa6980b65c0 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.028+0000 7fa6977fe640 1 --2- 172.21.15.134:0/4013555440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa698156880 0x7fa6980cdae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa688009870 tx=0x7fa68802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6564b785d9080d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa696ffd640 1 -- 172.21.15.134:0/4013555440 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688037070 con 0x7fa698156880 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa696ffd640 1 -- 172.21.15.134:0/4013555440 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa688032440 con 0x7fa698156880 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa696ffd640 1 -- 172.21.15.134:0/4013555440 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688032810 con 0x7fa698156880 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 -- 172.21.15.134:0/4013555440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa698156880 msgr2=0x7fa6980cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 --2- 172.21.15.134:0/4013555440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa698156880 0x7fa6980cdae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa688009870 tx=0x7fa68802a1c0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 -- 172.21.15.134:0/4013555440 shutdown_connections 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 --2- 172.21.15.134:0/4013555440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6980aff30 0x7fa6980b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 --2- 172.21.15.134:0/4013555440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa698156880 0x7fa6980cdae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 -- 172.21.15.134:0/4013555440 >> 172.21.15.134:0/4013555440 conn(0x7fa69806cae0 msgr2=0x7fa69806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 -- 172.21.15.134:0/4013555440 shutdown_connections 2024-09-15T22:42:15.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.029+0000 7fa69e196640 1 -- 172.21.15.134:0/4013555440 wait complete. 2024-09-15T22:42:15.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.030+0000 7fa69e196640 1 Processor -- start 2024-09-15T22:42:15.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.030+0000 7fa69e196640 1 -- start start 2024-09-15T22:42:15.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6980b65c0 0x7fa69815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa698156880 0x7fa6981e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6980b6a30 con 0x7fa6980aff30 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa698156c60 con 0x7fa6980b65c0 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa69e196640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa6980ce710 con 0x7fa698156880 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43090/0 (socket says 172.21.15.134:43090) 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 -- 172.21.15.134:0/796891638 learned_addr learned my addr 172.21.15.134:0/796891638 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 -- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa698156880 msgr2=0x7fa6981e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa698156880 0x7fa6981e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 -- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6980b65c0 msgr2=0x7fa69815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6980b65c0 0x7fa69815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.031+0000 7fa6977fe640 1 -- 172.21.15.134:0/796891638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa698142460 con 0x7fa6980aff30 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa6977fe640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa688009870 tx=0x7fa6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688041070 con 0x7fa6980aff30 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68803c870 con 0x7fa6980aff30 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa698142740 con 0x7fa6980aff30 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688037040 con 0x7fa6980aff30 2024-09-15T22:42:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.032+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa698142d00 con 0x7fa6980aff30 2024-09-15T22:42:15.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.033+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6980b0340 con 0x7fa6980aff30 2024-09-15T22:42:15.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.033+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa688044070 con 0x7fa6980aff30 2024-09-15T22:42:15.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.034+0000 7fa694ff9640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 0x7fa67806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.034+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa6880ac130 con 0x7fa6980aff30 2024-09-15T22:42:15.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.034+0000 7fa68ffff640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 0x7fa67806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.034+0000 7fa68ffff640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 0x7fa67806e7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6980cd1d0 tx=0x7fa680001310 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.038+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa68807a9c0 con 0x7fa6980aff30 2024-09-15T22:42:15.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.238+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6980b16e0 con 0x7fa6980aff30 2024-09-15T22:42:15.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.238+0000 7fa694ff9640 1 -- 172.21.15.134:0/796891638 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5228 (secure 0 0 0) 0x7fa68807a2c0 con 0x7fa6980aff30 2024-09-15T22:42:15.240 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:15.240 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":14,"btime":"2024-09-15T22:42:14:903131+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:15.240 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 msgr2=0x7fa67806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 0x7fa67806e7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6980cd1d0 tx=0x7fa680001310 comp rx=0 tx=0).stop 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 msgr2=0x7fa6980aaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa688009870 tx=0x7fa6880046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 shutdown_connections 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa67806c2e0 0x7fa67806e7a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa698156880 0x7fa6981e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6980b65c0 0x7fa69815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 --2- 172.21.15.134:0/796891638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980aff30 0x7fa6980aaee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.240+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 >> 172.21.15.134:0/796891638 conn(0x7fa69806cae0 msgr2=0x7fa6980b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.241+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 shutdown_connections 2024-09-15T22:42:15.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.241+0000 7fa69e196640 1 -- 172.21.15.134:0/796891638 wait complete. 2024-09-15T22:42:15.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:15.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.349+0000 7f630d4af640 1 Processor -- start 2024-09-15T22:42:15.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.349+0000 7f630d4af640 1 -- start start 2024-09-15T22:42:15.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f630d4af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f630815ed20 0x7f63080b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f630d4af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63080b7170 con 0x7f630815e940 2024-09-15T22:42:15.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f630d4af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63080b7aa0 con 0x7f63080cef90 2024-09-15T22:42:15.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f630d4af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f63080d3660 con 0x7f630815ed20 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f6306ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f630815e940 0x7f63080d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48236/0 (socket says 172.21.15.134:48236) 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f6306ffd640 1 -- 172.21.15.134:0/460203209 learned_addr learned my addr 172.21.15.134:0/460203209 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.350+0000 7f63067fc640 1 --2- 172.21.15.134:0/460203209 >> v2:172.21.15.177:3300/0 conn(0x7f630815ed20 0x7f63080b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641620288 0 0) 0x7f62f8001490 con 0x7f630815e940 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f0003520 con 0x7f630815e940 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468285060 0 0) 0x7f62f0003520 con 0x7f630815e940 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 >> v2:172.21.15.177:3300/0 conn(0x7f630815ed20 msgr2=0x7f63080b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 --2- 172.21.15.134:0/460203209 >> v2:172.21.15.177:3300/0 conn(0x7f630815ed20 0x7f63080b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 >> v1:172.21.15.177:6789/0 conn(0x7f63080cef90 legacy=0x7f63080b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63080d3940 con 0x7f630815e940 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f62f8001bc0 con 0x7f630815e940 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 >> v1:172.21.15.134:6789/0 conn(0x7f630815e940 legacy=0x7f63080d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f00039b0 0x7f62f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62f00043b0 0x7f62f0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 0x7f62f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63080d3660 con 0x7f62f0005080 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62f000bf30 con 0x7f62f00039b0 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f62f000c130 con 0x7f62f00043b0 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63067fc640 1 --2- 172.21.15.134:0/460203209 >> v2:172.21.15.177:3300/0 conn(0x7f630815ed20 0x7f63080b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 0x7f62f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f6306ffd640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f00039b0 0x7f62f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63067fc640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62f00043b0 0x7f62f0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 -- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62f00043b0 msgr2=0x7f62f0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62f00043b0 0x7f62f0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 -- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f00039b0 msgr2=0x7f62f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f00039b0 0x7f62f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.351+0000 7f63077fe640 1 -- 172.21.15.134:0/460203209 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f0003520 con 0x7f62f0005080 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.352+0000 7f63077fe640 1 -- 172.21.15.134:0/460203209 reap_dead start 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.352+0000 7f63077fe640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 0x7f62f000b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6300001860 tx=0x7f62f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b2c17bfeb23001 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.352+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300001430 con 0x7f62f0005080 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.352+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6300005330 con 0x7f62f0005080 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.352+0000 7f6305ffb640 1 -- 172.21.15.134:0/460203209 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630002ac10 con 0x7f62f0005080 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 -- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 msgr2=0x7f62f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 0x7f62f000b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6300001860 tx=0x7f62f0005830 comp rx=0 tx=0).stop 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 -- 172.21.15.134:0/460203209 shutdown_connections 2024-09-15T22:42:15.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 --2- 172.21.15.134:0/460203209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f0005080 0x7f62f000b9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 -- 172.21.15.134:0/460203209 >> 172.21.15.134:0/460203209 conn(0x7f63080b6240 msgr2=0x7f63080b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 -- 172.21.15.134:0/460203209 shutdown_connections 2024-09-15T22:42:15.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.353+0000 7f630d4af640 1 -- 172.21.15.134:0/460203209 wait complete. 2024-09-15T22:42:15.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.354+0000 7f630d4af640 1 Processor -- start 2024-09-15T22:42:15.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.354+0000 7f630d4af640 1 -- start start 2024-09-15T22:42:15.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f0005080 0x7f6308157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63080cb1b0 0x7f63081f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63080d1ef0 con 0x7f63080cd080 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63080d3f00 con 0x7f62f0005080 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63080d2070 con 0x7f63080cb1b0 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43114/0 (socket says 172.21.15.134:43114) 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 -- 172.21.15.134:0/930201241 learned_addr learned my addr 172.21.15.134:0/930201241 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f6306ffd640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f0005080 0x7f6308157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63067fc640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63080cb1b0 0x7f63081f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 -- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63080cb1b0 msgr2=0x7f63081f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63080cb1b0 0x7f63081f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 -- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f0005080 msgr2=0x7f6308157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f0005080 0x7f6308157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 -- 172.21.15.134:0/930201241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63080c8300 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f63077fe640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f630002a6c0 tx=0x7f6300001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300001430 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6300003b30 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.355+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6308158f30 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.356+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300007030 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.356+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6308159210 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.356+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63080d1060 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.357+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6300005290 con 0x7f63080cd080 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.357+0000 7f62ef7fe640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 0x7f62f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.358+0000 7f6306ffd640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 0x7f62f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.358+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f63000aa980 con 0x7f63080cd080 2024-09-15T22:42:15.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.358+0000 7f6306ffd640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 0x7f62f406e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62f8001630 tx=0x7f62f8006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.362+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6300044060 con 0x7f63080cd080 2024-09-15T22:42:15.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.527+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63080ba6b0 con 0x7f63080cd080 2024-09-15T22:42:15.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.528+0000 7f62ef7fe640 1 -- 172.21.15.134:0/930201241 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7f63000790f0 con 0x7f63080cd080 2024-09-15T22:42:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:15.530 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":35,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:13.873375+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:09.938942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:11.196490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:15.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 msgr2=0x7f62f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 0x7f62f406e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62f8001630 tx=0x7f62f8006040 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 msgr2=0x7f63080cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f630002a6c0 tx=0x7f6300001230 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 shutdown_connections 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f62f406c2b0 0x7f62f406e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63080cd080 0x7f63080cd500 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63080cb1b0 0x7f63081f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 --2- 172.21.15.134:0/930201241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62f0005080 0x7f6308157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 >> 172.21.15.134:0/930201241 conn(0x7f63080b6240 msgr2=0x7f63080b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 shutdown_connections 2024-09-15T22:42:15.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.530+0000 7f630d4af640 1 -- 172.21.15.134:0/930201241 wait complete. 2024-09-15T22:42:15.543 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:42:15.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:15.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.640+0000 7f16153b9640 1 Processor -- start 2024-09-15T22:42:15.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.640+0000 7f16153b9640 1 -- start start 2024-09-15T22:42:15.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f16153b9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f161015ceb0 0x7f16101594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f16153b9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161015d390 con 0x7f16100d02a0 2024-09-15T22:42:15.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f16153b9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161015d670 con 0x7f161015ca40 2024-09-15T22:42:15.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f16153b9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f161015d950 con 0x7f161015ceb0 2024-09-15T22:42:15.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f160effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f16100d02a0 0x7f16100d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48244/0 (socket says 172.21.15.134:48244) 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.641+0000 7f160effd640 1 -- 172.21.15.134:0/3561245274 learned_addr learned my addr 172.21.15.134:0/3561245274 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160f7fe640 1 --2- 172.21.15.134:0/3561245274 >> v2:172.21.15.177:3300/0 conn(0x7f161015ceb0 0x7f16101594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770083758 0 0) 0x7f161015d390 con 0x7f16100d02a0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc003520 con 0x7f16100d02a0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2757791496 0 0) 0x7f15fc003520 con 0x7f16100d02a0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 >> v2:172.21.15.177:3300/0 conn(0x7f161015ceb0 msgr2=0x7f16101594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 --2- 172.21.15.134:0/3561245274 >> v2:172.21.15.177:3300/0 conn(0x7f161015ceb0 0x7f16101594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 >> v1:172.21.15.177:6789/0 conn(0x7f161015ca40 legacy=0x7f161015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161015dc30 con 0x7f16100d02a0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f1600001670 con 0x7f16100d02a0 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 >> v1:172.21.15.134:6789/0 conn(0x7f16100d02a0 legacy=0x7f16100d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f161015d950 con 0x7f15fc0039b0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00c160 con 0x7f15fc004800 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc00c360 con 0x7f15fc0051c0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f16067fc640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160f7fe640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 -- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15fc0051c0 msgr2=0x7f15fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 -- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc004800 msgr2=0x7f15fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160effd640 1 -- 172.21.15.134:0/3561245274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc003520 con 0x7f15fc0039b0 2024-09-15T22:42:15.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.642+0000 7f160f7fe640 1 -- 172.21.15.134:0/3561245274 reap_dead start 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.643+0000 7f160effd640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f160000c210 tx=0x7f15fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175bd2aebd5acd33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.643+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600007d30 con 0x7f15fc0039b0 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.643+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600005ad0 con 0x7f15fc0039b0 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.643+0000 7f160e7fc640 1 -- 172.21.15.134:0/3561245274 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600007070 con 0x7f15fc0039b0 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 -- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 msgr2=0x7f15fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f160000c210 tx=0x7f15fc005830 comp rx=0 tx=0).stop 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 -- 172.21.15.134:0/3561245274 shutdown_connections 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 --2- 172.21.15.134:0/3561245274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 -- 172.21.15.134:0/3561245274 >> 172.21.15.134:0/3561245274 conn(0x7f1610062cc0 msgr2=0x7f161006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 -- 172.21.15.134:0/3561245274 shutdown_connections 2024-09-15T22:42:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.644+0000 7f16153b9640 1 -- 172.21.15.134:0/3561245274 wait complete. 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.645+0000 7f16153b9640 1 Processor -- start 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.645+0000 7f16153b9640 1 -- start start 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc0039b0 0x7f1610156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 0x7f16101f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1610155d10 con 0x7f16101ef610 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1610155b90 con 0x7f15fc0039b0 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f16100b4790 con 0x7f16101f5c20 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43138/0 (socket says 172.21.15.134:43138) 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 -- 172.21.15.134:0/3254906649 learned_addr learned my addr 172.21.15.134:0/3254906649 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f160effd640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc0039b0 0x7f1610156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f160f7fe640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 0x7f16101f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 -- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 msgr2=0x7f16101f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 0x7f16101f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 -- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc0039b0 msgr2=0x7f1610156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc0039b0 0x7f1610156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 -- 172.21.15.134:0/3254906649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101575a0 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f160f7fe640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 0x7f16101f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16067fc640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007fd0 tx=0x7f15f800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8019070 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f80052e0 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1610157880 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.646+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003810 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.647+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1610157e40 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.647+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16100d0680 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.648+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15f801c070 con 0x7f16101ef610 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.648+0000 7f1607fff640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 0x7f15f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.648+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f15f808a900 con 0x7f16101ef610 2024-09-15T22:42:15.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.648+0000 7f160effd640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 0x7f15f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.649+0000 7f160effd640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 0x7f15f006e7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1600032000 tx=0x7f160002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.653+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15f8058ab0 con 0x7f16101ef610 2024-09-15T22:42:15.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.814+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f161006d4f0 con 0x7f15f006c2e0 2024-09-15T22:42:15.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.820+0000 7f1607fff640 1 -- 172.21.15.134:0/3254906649 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241049 (secure 0 0 0) 0x7f161006d4f0 con 0x7f15f006c2e0 2024-09-15T22:42:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:15.825 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 msgr2=0x7f15f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 0x7f15f006e7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1600032000 tx=0x7f160002d000 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 msgr2=0x7f16101f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007fd0 tx=0x7f15f800e8a0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 shutdown_connections 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15f006c2e0 0x7f15f006e7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16101f5c20 0x7f16101f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16101ef610 0x7f16101f56e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 --2- 172.21.15.134:0/3254906649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15fc0039b0 0x7f1610156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 >> 172.21.15.134:0/3254906649 conn(0x7f1610062cc0 msgr2=0x7f1610154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 shutdown_connections 2024-09-15T22:42:15.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.823+0000 7f16153b9640 1 -- 172.21.15.134:0/3254906649 wait complete. 2024-09-15T22:42:15.832 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:42:15.831+0000 7fa3c4ab7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:42:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-15T22:42:14.956940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220124,"kb_used_data":3864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":3956736,"data_stored":2197879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.087637"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878178+0000","last_change":"2024-09-15T22:42:12.896604+0000","last_active":"2024-09-15T22:42:13.878178+0000","last_peered":"2024-09-15T22:42:13.878178+0000","last_clean":"2024-09-15T22:42:13.878178+0000","last_became_active":"2024-09-15T22:42:12.896338+0000","last_became_peered":"2024-09-15T22:42:12.896338+0000","last_unstale":"2024-09-15T22:42:13.878178+0000","last_undegraded":"2024-09-15T22:42:13.878178+0000","last_fullsized":"2024-09-15T22:42:13.878178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:46.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879322+0000","last_change":"2024-09-15T22:42:12.895866+0000","last_active":"2024-09-15T22:42:13.879322+0000","last_peered":"2024-09-15T22:42:13.879322+0000","last_clean":"2024-09-15T22:42:13.879322+0000","last_became_active":"2024-09-15T22:42:12.895588+0000","last_became_peered":"2024-09-15T22:42:12.895588+0000","last_unstale":"2024-09-15T22:42:13.879322+0000","last_undegraded":"2024-09-15T22:42:13.879322+0000","last_fullsized":"2024-09-15T22:42:13.879322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:26.004143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877932+0000","last_change":"2024-09-15T22:42:12.890470+0000","last_active":"2024-09-15T22:42:13.877932+0000","last_peered":"2024-09-15T22:42:13.877932+0000","last_clean":"2024-09-15T22:42:13.877932+0000","last_became_active":"2024-09-15T22:42:12.889280+0000","last_became_peered":"2024-09-15T22:42:12.889280+0000","last_unstale":"2024-09-15T22:42:13.877932+0000","last_undegraded":"2024-09-15T22:42:13.877932+0000","last_fullsized":"2024-09-15T22:42:13.877932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.734305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879478+0000","last_change":"2024-09-15T22:42:12.891613+0000","last_active":"2024-09-15T22:42:13.879478+0000","last_peered":"2024-09-15T22:42:13.879478+0000","last_clean":"2024-09-15T22:42:13.879478+0000","last_became_active":"2024-09-15T22:42:12.891023+0000","last_became_peered":"2024-09-15T22:42:12.891023+0000","last_unstale":"2024-09-15T22:42:13.879478+0000","last_undegraded":"2024-09-15T22:42:13.879478+0000","last_fullsized":"2024-09-15T22:42:13.879478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:08.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874324+0000","last_change":"2024-09-15T22:42:10.874324+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874324+0000","last_undegraded":"2024-09-15T22:42:10.874324+0000","last_fullsized":"2024-09-15T22:42:10.874324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871709+0000","last_change":"2024-09-15T22:42:10.871709+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871709+0000","last_undegraded":"2024-09-15T22:42:10.871709+0000","last_fullsized":"2024-09-15T22:42:10.871709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872541+0000","last_change":"2024-09-15T22:42:10.872541+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872541+0000","last_undegraded":"2024-09-15T22:42:10.872541+0000","last_fullsized":"2024-09-15T22:42:10.872541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872185+0000","last_change":"2024-09-15T22:42:10.872185+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872185+0000","last_undegraded":"2024-09-15T22:42:10.872185+0000","last_fullsized":"2024-09-15T22:42:10.872185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873518+0000","last_change":"2024-09-15T22:42:10.873518+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873518+0000","last_undegraded":"2024-09-15T22:42:10.873518+0000","last_fullsized":"2024-09-15T22:42:10.873518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869270+0000","last_change":"2024-09-15T22:42:10.869270+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869270+0000","last_undegraded":"2024-09-15T22:42:10.869270+0000","last_fullsized":"2024-09-15T22:42:10.869270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869984+0000","last_change":"2024-09-15T22:42:10.869984+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869984+0000","last_undegraded":"2024-09-15T22:42:10.869984+0000","last_fullsized":"2024-09-15T22:42:10.869984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874262+0000","last_change":"2024-09-15T22:42:10.874262+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874262+0000","last_undegraded":"2024-09-15T22:42:10.874262+0000","last_fullsized":"2024-09-15T22:42:10.874262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879334+0000","last_change":"2024-09-15T22:42:11.882504+0000","last_active":"2024-09-15T22:42:13.879334+0000","last_peered":"2024-09-15T22:42:13.879334+0000","last_clean":"2024-09-15T22:42:13.879334+0000","last_became_active":"2024-09-15T22:42:11.881991+0000","last_became_peered":"2024-09-15T22:42:11.881991+0000","last_unstale":"2024-09-15T22:42:13.879334+0000","last_undegraded":"2024-09-15T22:42:13.879334+0000","last_fullsized":"2024-09-15T22:42:13.879334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878186+0000","last_change":"2024-09-15T22:42:12.890997+0000","last_active":"2024-09-15T22:42:13.878186+0000","last_peered":"2024-09-15T22:42:13.878186+0000","last_clean":"2024-09-15T22:42:13.878186+0000","last_became_active":"2024-09-15T22:42:12.890727+0000","last_became_peered":"2024-09-15T22:42:12.890727+0000","last_unstale":"2024-09-15T22:42:13.878186+0000","last_undegraded":"2024-09-15T22:42:13.878186+0000","last_fullsized":"2024-09-15T22:42:13.878186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:26.495173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871814+0000","last_change":"2024-09-15T22:42:10.871814+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871814+0000","last_undegraded":"2024-09-15T22:42:10.871814+0000","last_fullsized":"2024-09-15T22:42:10.871814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871584+0000","last_change":"2024-09-15T22:42:10.871584+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871584+0000","last_undegraded":"2024-09-15T22:42:10.871584+0000","last_fullsized":"2024-09-15T22:42:10.871584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873031+0000","last_change":"2024-09-15T22:42:10.873031+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873031+0000","last_undegraded":"2024-09-15T22:42:10.873031+0000","last_fullsized":"2024-09-15T22:42:10.873031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872587+0000","last_change":"2024-09-15T22:42:10.872587+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872587+0000","last_undegraded":"2024-09-15T22:42:10.872587+0000","last_fullsized":"2024-09-15T22:42:10.872587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873841+0000","last_change":"2024-09-15T22:42:10.873841+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873841+0000","last_undegraded":"2024-09-15T22:42:10.873841+0000","last_fullsized":"2024-09-15T22:42:10.873841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872903+0000","last_change":"2024-09-15T22:42:10.872903+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872903+0000","last_undegraded":"2024-09-15T22:42:10.872903+0000","last_fullsized":"2024-09-15T22:42:10.872903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878102+0000","last_change":"2024-09-15T22:42:12.899753+0000","last_active":"2024-09-15T22:42:13.878102+0000","last_peered":"2024-09-15T22:42:13.878102+0000","last_clean":"2024-09-15T22:42:13.878102+0000","last_became_active":"2024-09-15T22:42:12.899475+0000","last_became_peered":"2024-09-15T22:42:12.899475+0000","last_unstale":"2024-09-15T22:42:13.878102+0000","last_undegraded":"2024-09-15T22:42:13.878102+0000","last_fullsized":"2024-09-15T22:42:13.878102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:35.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869347+0000","last_change":"2024-09-15T22:42:10.869347+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869347+0000","last_undegraded":"2024-09-15T22:42:10.869347+0000","last_fullsized":"2024-09-15T22:42:10.869347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877785+0000","last_change":"2024-09-15T22:42:12.894563+0000","last_active":"2024-09-15T22:42:13.877785+0000","last_peered":"2024-09-15T22:42:13.877785+0000","last_clean":"2024-09-15T22:42:13.877785+0000","last_became_active":"2024-09-15T22:42:12.894216+0000","last_became_peered":"2024-09-15T22:42:12.894216+0000","last_unstale":"2024-09-15T22:42:13.877785+0000","last_undegraded":"2024-09-15T22:42:13.877785+0000","last_fullsized":"2024-09-15T22:42:13.877785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:59.153843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873005+0000","last_change":"2024-09-15T22:42:10.873005+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873005+0000","last_undegraded":"2024-09-15T22:42:10.873005+0000","last_fullsized":"2024-09-15T22:42:10.873005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873368+0000","last_change":"2024-09-15T22:42:10.873368+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873368+0000","last_undegraded":"2024-09-15T22:42:10.873368+0000","last_fullsized":"2024-09-15T22:42:10.873368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879224+0000","last_change":"2024-09-15T22:42:11.886225+0000","last_active":"2024-09-15T22:42:13.879224+0000","last_peered":"2024-09-15T22:42:13.879224+0000","last_clean":"2024-09-15T22:42:13.879224+0000","last_became_active":"2024-09-15T22:42:11.885851+0000","last_became_peered":"2024-09-15T22:42:11.885851+0000","last_unstale":"2024-09-15T22:42:13.879224+0000","last_undegraded":"2024-09-15T22:42:13.879224+0000","last_fullsized":"2024-09-15T22:42:13.879224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:43.788609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869373+0000","last_change":"2024-09-15T22:42:10.869373+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869373+0000","last_undegraded":"2024-09-15T22:42:10.869373+0000","last_fullsized":"2024-09-15T22:42:10.869373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879436+0000","last_change":"2024-09-15T22:42:11.887249+0000","last_active":"2024-09-15T22:42:13.879436+0000","last_peered":"2024-09-15T22:42:13.879436+0000","last_clean":"2024-09-15T22:42:13.879436+0000","last_became_active":"2024-09-15T22:42:11.886981+0000","last_became_peered":"2024-09-15T22:42:11.886981+0000","last_unstale":"2024-09-15T22:42:13.879436+0000","last_undegraded":"2024-09-15T22:42:13.879436+0000","last_fullsized":"2024-09-15T22:42:13.879436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:39.307694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878348+0000","last_change":"2024-09-15T22:42:11.888253+0000","last_active":"2024-09-15T22:42:13.878348+0000","last_peered":"2024-09-15T22:42:13.878348+0000","last_clean":"2024-09-15T22:42:13.878348+0000","last_became_active":"2024-09-15T22:42:11.887964+0000","last_became_peered":"2024-09-15T22:42:11.887964+0000","last_unstale":"2024-09-15T22:42:13.878348+0000","last_undegraded":"2024-09-15T22:42:13.878348+0000","last_fullsized":"2024-09-15T22:42:13.878348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:24.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878284+0000","last_change":"2024-09-15T22:42:11.889475+0000","last_active":"2024-09-15T22:42:13.878284+0000","last_peered":"2024-09-15T22:42:13.878284+0000","last_clean":"2024-09-15T22:42:13.878284+0000","last_became_active":"2024-09-15T22:42:11.889160+0000","last_became_peered":"2024-09-15T22:42:11.889160+0000","last_unstale":"2024-09-15T22:42:13.878284+0000","last_undegraded":"2024-09-15T22:42:13.878284+0000","last_fullsized":"2024-09-15T22:42:13.878284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:05.509527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871575+0000","last_change":"2024-09-15T22:42:10.871575+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871575+0000","last_undegraded":"2024-09-15T22:42:10.871575+0000","last_fullsized":"2024-09-15T22:42:10.871575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873126+0000","last_change":"2024-09-15T22:42:10.873126+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873126+0000","last_undegraded":"2024-09-15T22:42:10.873126+0000","last_fullsized":"2024-09-15T22:42:10.873126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T22:42:10.871216+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:10.871216+0000","last_peered":"2024-09-15T22:42:10.871216+0000","last_clean":"2024-09-15T22:42:10.871216+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:10.871216+0000","last_undegraded":"2024-09-15T22:42:10.871216+0000","last_fullsized":"2024-09-15T22:42:10.871216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":50,"acting":50,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":145062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:15.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:15.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.973+0000 7ff785ceb640 1 Processor -- start 2024-09-15T22:42:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.973+0000 7ff785ceb640 1 -- start start 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff785ceb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff78015ca40 0x7ff78015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff785ceb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ceb0 0x7ff7801594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff785ceb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff78015d390 con 0x7ff7800d02a0 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff785ceb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff78015d670 con 0x7ff78015ca40 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff785ceb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff78015d950 con 0x7ff78015ceb0 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff78015ca40 0x7ff78015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff78015ca40 0x7ff78015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43140/0 (socket says 172.21.15.134:43140) 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 -- 172.21.15.134:0/1629325542 learned_addr learned my addr 172.21.15.134:0/1629325542 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77ffff640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ceb0 0x7ff7801594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 -- 172.21.15.134:0/1629325542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ceb0 msgr2=0x7ff7801594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ceb0 0x7ff7801594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 -- 172.21.15.134:0/1629325542 >> v1:172.21.15.177:6789/0 conn(0x7ff7800d02a0 legacy=0x7ff7800d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77effd640 1 -- 172.21.15.134:0/1629325542 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78015dc30 con 0x7ff78015ca40 2024-09-15T22:42:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.974+0000 7ff77e7fc640 1 -- 172.21.15.134:0/1629325542 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465829612 0 0) 0x7ff78015d390 con 0x7ff7800d02a0 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.975+0000 7ff77effd640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ca40 0x7ff78015e430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff774009870 tx=0x7ff77402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aa4ff0d423d7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.975+0000 7ff77e7fc640 1 -- 172.21.15.134:0/1629325542 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774037070 con 0x7ff78015ca40 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.975+0000 7ff77e7fc640 1 -- 172.21.15.134:0/1629325542 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff774032440 con 0x7ff78015ca40 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.975+0000 7ff77e7fc640 1 -- 172.21.15.134:0/1629325542 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774032810 con 0x7ff78015ca40 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 -- 172.21.15.134:0/1629325542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ca40 msgr2=0x7ff78015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ca40 0x7ff78015e430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff774009870 tx=0x7ff77402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 -- 172.21.15.134:0/1629325542 shutdown_connections 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ceb0 0x7ff7801594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 --2- 172.21.15.134:0/1629325542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ca40 0x7ff78015e430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 -- 172.21.15.134:0/1629325542 >> 172.21.15.134:0/1629325542 conn(0x7ff780062cc0 msgr2=0x7ff78006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 -- 172.21.15.134:0/1629325542 shutdown_connections 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.976+0000 7ff785ceb640 1 -- 172.21.15.134:0/1629325542 wait complete. 2024-09-15T22:42:15.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.977+0000 7ff785ceb640 1 Processor -- start 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.977+0000 7ff785ceb640 1 -- start start 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7800d02a0 0x7ff78014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ca40 0x7ff780155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff780155d10 con 0x7ff78015ceb0 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff780155b90 con 0x7ff7800d02a0 2024-09-15T22:42:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff785ceb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff7800b4790 con 0x7ff78015ca40 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43142/0 (socket says 172.21.15.134:43142) 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77ffff640 1 -- 172.21.15.134:0/3987213942 learned_addr learned my addr 172.21.15.134:0/3987213942 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77f7fe640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7800d02a0 0x7ff78014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77effd640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ca40 0x7ff780155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.978+0000 7ff77ffff640 1 -- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ca40 msgr2=0x7ff780155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff77ffff640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ca40 0x7ff780155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff77ffff640 1 -- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7800d02a0 msgr2=0x7ff78014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff77ffff640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7800d02a0 0x7ff78014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff77ffff640 1 -- 172.21.15.134:0/3987213942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff780071bb0 con 0x7ff78015ceb0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff77ffff640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff77800ef90 tx=0x7ff77800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778018020 con 0x7ff78015ceb0 2024-09-15T22:42:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff778014480 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778014870 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff780071e90 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.979+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff780073330 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.980+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7800d0680 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.980+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff778005d10 con 0x7ff78015ceb0 2024-09-15T22:42:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.981+0000 7ff767fff640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 0x7ff76c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.981+0000 7ff77f7fe640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 0x7ff76c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.981+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7ff77808c210 con 0x7ff78015ceb0 2024-09-15T22:42:15.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.981+0000 7ff77f7fe640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 0x7ff76c06e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff770000f60 tx=0x7ff770009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:15.985+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff778022030 con 0x7ff78015ceb0 2024-09-15T22:42:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.155+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff780073680 con 0x7ff76c06c2b0 2024-09-15T22:42:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.160+0000 7ff767fff640 1 -- 172.21.15.134:0/3987213942 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241049 (secure 0 0 0) 0x7ff770001420 con 0x7ff76c06c2b0 2024-09-15T22:42:16.164 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.163+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 msgr2=0x7ff76c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.163+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 0x7ff76c06e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff770000f60 tx=0x7ff770009040 comp rx=0 tx=0).stop 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.163+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 msgr2=0x7ff780156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.163+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff77800ef90 tx=0x7ff77800c490 comp rx=0 tx=0).stop 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.163+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 shutdown_connections 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff76c06c2b0 0x7ff76c06e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff78015ceb0 0x7ff780156460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff78015ca40 0x7ff780155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 --2- 172.21.15.134:0/3987213942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7800d02a0 0x7ff78014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 >> 172.21.15.134:0/3987213942 conn(0x7ff780062cc0 msgr2=0x7ff78006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 shutdown_connections 2024-09-15T22:42:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.164+0000 7ff785ceb640 1 -- 172.21.15.134:0/3987213942 wait complete. 2024-09-15T22:42:16.176 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-15T22:42:14.956940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220124,"kb_used_data":3864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":3956736,"data_stored":2197879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.087637"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878178+0000","last_change":"2024-09-15T22:42:12.896604+0000","last_active":"2024-09-15T22:42:13.878178+0000","last_peered":"2024-09-15T22:42:13.878178+0000","last_clean":"2024-09-15T22:42:13.878178+0000","last_became_active":"2024-09-15T22:42:12.896338+0000","last_became_peered":"2024-09-15T22:42:12.896338+0000","last_unstale":"2024-09-15T22:42:13.878178+0000","last_undegraded":"2024-09-15T22:42:13.878178+0000","last_fullsized":"2024-09-15T22:42:13.878178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:46.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879322+0000","last_change":"2024-09-15T22:42:12.895866+0000","last_active":"2024-09-15T22:42:13.879322+0000","last_peered":"2024-09-15T22:42:13.879322+0000","last_clean":"2024-09-15T22:42:13.879322+0000","last_became_active":"2024-09-15T22:42:12.895588+0000","last_became_peered":"2024-09-15T22:42:12.895588+0000","last_unstale":"2024-09-15T22:42:13.879322+0000","last_undegraded":"2024-09-15T22:42:13.879322+0000","last_fullsized":"2024-09-15T22:42:13.879322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:26.004143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877932+0000","last_change":"2024-09-15T22:42:12.890470+0000","last_active":"2024-09-15T22:42:13.877932+0000","last_peered":"2024-09-15T22:42:13.877932+0000","last_clean":"2024-09-15T22:42:13.877932+0000","last_became_active":"2024-09-15T22:42:12.889280+0000","last_became_peered":"2024-09-15T22:42:12.889280+0000","last_unstale":"2024-09-15T22:42:13.877932+0000","last_undegraded":"2024-09-15T22:42:13.877932+0000","last_fullsized":"2024-09-15T22:42:13.877932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.734305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879478+0000","last_change":"2024-09-15T22:42:12.891613+0000","last_active":"2024-09-15T22:42:13.879478+0000","last_peered":"2024-09-15T22:42:13.879478+0000","last_clean":"2024-09-15T22:42:13.879478+0000","last_became_active":"2024-09-15T22:42:12.891023+0000","last_became_peered":"2024-09-15T22:42:12.891023+0000","last_unstale":"2024-09-15T22:42:13.879478+0000","last_undegraded":"2024-09-15T22:42:13.879478+0000","last_fullsized":"2024-09-15T22:42:13.879478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:08.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874324+0000","last_change":"2024-09-15T22:42:10.874324+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874324+0000","last_undegraded":"2024-09-15T22:42:10.874324+0000","last_fullsized":"2024-09-15T22:42:10.874324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871709+0000","last_change":"2024-09-15T22:42:10.871709+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871709+0000","last_undegraded":"2024-09-15T22:42:10.871709+0000","last_fullsized":"2024-09-15T22:42:10.871709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872541+0000","last_change":"2024-09-15T22:42:10.872541+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872541+0000","last_undegraded":"2024-09-15T22:42:10.872541+0000","last_fullsized":"2024-09-15T22:42:10.872541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872185+0000","last_change":"2024-09-15T22:42:10.872185+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872185+0000","last_undegraded":"2024-09-15T22:42:10.872185+0000","last_fullsized":"2024-09-15T22:42:10.872185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873518+0000","last_change":"2024-09-15T22:42:10.873518+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873518+0000","last_undegraded":"2024-09-15T22:42:10.873518+0000","last_fullsized":"2024-09-15T22:42:10.873518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869270+0000","last_change":"2024-09-15T22:42:10.869270+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869270+0000","last_undegraded":"2024-09-15T22:42:10.869270+0000","last_fullsized":"2024-09-15T22:42:10.869270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869984+0000","last_change":"2024-09-15T22:42:10.869984+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869984+0000","last_undegraded":"2024-09-15T22:42:10.869984+0000","last_fullsized":"2024-09-15T22:42:10.869984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874262+0000","last_change":"2024-09-15T22:42:10.874262+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874262+0000","last_undegraded":"2024-09-15T22:42:10.874262+0000","last_fullsized":"2024-09-15T22:42:10.874262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879334+0000","last_change":"2024-09-15T22:42:11.882504+0000","last_active":"2024-09-15T22:42:13.879334+0000","last_peered":"2024-09-15T22:42:13.879334+0000","last_clean":"2024-09-15T22:42:13.879334+0000","last_became_active":"2024-09-15T22:42:11.881991+0000","last_became_peered":"2024-09-15T22:42:11.881991+0000","last_unstale":"2024-09-15T22:42:13.879334+0000","last_undegraded":"2024-09-15T22:42:13.879334+0000","last_fullsized":"2024-09-15T22:42:13.879334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878186+0000","last_change":"2024-09-15T22:42:12.890997+0000","last_active":"2024-09-15T22:42:13.878186+0000","last_peered":"2024-09-15T22:42:13.878186+0000","last_clean":"2024-09-15T22:42:13.878186+0000","last_became_active":"2024-09-15T22:42:12.890727+0000","last_became_peered":"2024-09-15T22:42:12.890727+0000","last_unstale":"2024-09-15T22:42:13.878186+0000","last_undegraded":"2024-09-15T22:42:13.878186+0000","last_fullsized":"2024-09-15T22:42:13.878186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:26.495173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871814+0000","last_change":"2024-09-15T22:42:10.871814+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871814+0000","last_undegraded":"2024-09-15T22:42:10.871814+0000","last_fullsized":"2024-09-15T22:42:10.871814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871584+0000","last_change":"2024-09-15T22:42:10.871584+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871584+0000","last_undegraded":"2024-09-15T22:42:10.871584+0000","last_fullsized":"2024-09-15T22:42:10.871584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873031+0000","last_change":"2024-09-15T22:42:10.873031+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873031+0000","last_undegraded":"2024-09-15T22:42:10.873031+0000","last_fullsized":"2024-09-15T22:42:10.873031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872587+0000","last_change":"2024-09-15T22:42:10.872587+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872587+0000","last_undegraded":"2024-09-15T22:42:10.872587+0000","last_fullsized":"2024-09-15T22:42:10.872587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873841+0000","last_change":"2024-09-15T22:42:10.873841+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873841+0000","last_undegraded":"2024-09-15T22:42:10.873841+0000","last_fullsized":"2024-09-15T22:42:10.873841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872903+0000","last_change":"2024-09-15T22:42:10.872903+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872903+0000","last_undegraded":"2024-09-15T22:42:10.872903+0000","last_fullsized":"2024-09-15T22:42:10.872903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878102+0000","last_change":"2024-09-15T22:42:12.899753+0000","last_active":"2024-09-15T22:42:13.878102+0000","last_peered":"2024-09-15T22:42:13.878102+0000","last_clean":"2024-09-15T22:42:13.878102+0000","last_became_active":"2024-09-15T22:42:12.899475+0000","last_became_peered":"2024-09-15T22:42:12.899475+0000","last_unstale":"2024-09-15T22:42:13.878102+0000","last_undegraded":"2024-09-15T22:42:13.878102+0000","last_fullsized":"2024-09-15T22:42:13.878102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:35.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869347+0000","last_change":"2024-09-15T22:42:10.869347+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869347+0000","last_undegraded":"2024-09-15T22:42:10.869347+0000","last_fullsized":"2024-09-15T22:42:10.869347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877785+0000","last_change":"2024-09-15T22:42:12.894563+0000","last_active":"2024-09-15T22:42:13.877785+0000","last_peered":"2024-09-15T22:42:13.877785+0000","last_clean":"2024-09-15T22:42:13.877785+0000","last_became_active":"2024-09-15T22:42:12.894216+0000","last_became_peered":"2024-09-15T22:42:12.894216+0000","last_unstale":"2024-09-15T22:42:13.877785+0000","last_undegraded":"2024-09-15T22:42:13.877785+0000","last_fullsized":"2024-09-15T22:42:13.877785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:59.153843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873005+0000","last_change":"2024-09-15T22:42:10.873005+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873005+0000","last_undegraded":"2024-09-15T22:42:10.873005+0000","last_fullsized":"2024-09-15T22:42:10.873005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873368+0000","last_change":"2024-09-15T22:42:10.873368+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873368+0000","last_undegraded":"2024-09-15T22:42:10.873368+0000","last_fullsized":"2024-09-15T22:42:10.873368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879224+0000","last_change":"2024-09-15T22:42:11.886225+0000","last_active":"2024-09-15T22:42:13.879224+0000","last_peered":"2024-09-15T22:42:13.879224+0000","last_clean":"2024-09-15T22:42:13.879224+0000","last_became_active":"2024-09-15T22:42:11.885851+0000","last_became_peered":"2024-09-15T22:42:11.885851+0000","last_unstale":"2024-09-15T22:42:13.879224+0000","last_undegraded":"2024-09-15T22:42:13.879224+0000","last_fullsized":"2024-09-15T22:42:13.879224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:43.788609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869373+0000","last_change":"2024-09-15T22:42:10.869373+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869373+0000","last_undegraded":"2024-09-15T22:42:10.869373+0000","last_fullsized":"2024-09-15T22:42:10.869373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879436+0000","last_change":"2024-09-15T22:42:11.887249+0000","last_active":"2024-09-15T22:42:13.879436+0000","last_peered":"2024-09-15T22:42:13.879436+0000","last_clean":"2024-09-15T22:42:13.879436+0000","last_became_active":"2024-09-15T22:42:11.886981+0000","last_became_peered":"2024-09-15T22:42:11.886981+0000","last_unstale":"2024-09-15T22:42:13.879436+0000","last_undegraded":"2024-09-15T22:42:13.879436+0000","last_fullsized":"2024-09-15T22:42:13.879436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:39.307694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878348+0000","last_change":"2024-09-15T22:42:11.888253+0000","last_active":"2024-09-15T22:42:13.878348+0000","last_peered":"2024-09-15T22:42:13.878348+0000","last_clean":"2024-09-15T22:42:13.878348+0000","last_became_active":"2024-09-15T22:42:11.887964+0000","last_became_peered":"2024-09-15T22:42:11.887964+0000","last_unstale":"2024-09-15T22:42:13.878348+0000","last_undegraded":"2024-09-15T22:42:13.878348+0000","last_fullsized":"2024-09-15T22:42:13.878348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:24.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878284+0000","last_change":"2024-09-15T22:42:11.889475+0000","last_active":"2024-09-15T22:42:13.878284+0000","last_peered":"2024-09-15T22:42:13.878284+0000","last_clean":"2024-09-15T22:42:13.878284+0000","last_became_active":"2024-09-15T22:42:11.889160+0000","last_became_peered":"2024-09-15T22:42:11.889160+0000","last_unstale":"2024-09-15T22:42:13.878284+0000","last_undegraded":"2024-09-15T22:42:13.878284+0000","last_fullsized":"2024-09-15T22:42:13.878284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:05.509527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871575+0000","last_change":"2024-09-15T22:42:10.871575+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871575+0000","last_undegraded":"2024-09-15T22:42:10.871575+0000","last_fullsized":"2024-09-15T22:42:10.871575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873126+0000","last_change":"2024-09-15T22:42:10.873126+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873126+0000","last_undegraded":"2024-09-15T22:42:10.873126+0000","last_fullsized":"2024-09-15T22:42:10.873126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T22:42:10.871216+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:10.871216+0000","last_peered":"2024-09-15T22:42:10.871216+0000","last_clean":"2024-09-15T22:42:10.871216+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:10.871216+0000","last_undegraded":"2024-09-15T22:42:10.871216+0000","last_fullsized":"2024-09-15T22:42:10.871216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":50,"acting":50,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":145062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:16.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.313+0000 7f88b1118640 1 Processor -- start 2024-09-15T22:42:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.313+0000 7f88b1118640 1 -- start start 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88b1118640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 0x7f88ac0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88b1118640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88ac0b4290 0x7f88ac0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88b1118640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac073da0 con 0x7f88ac0b1980 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88b1118640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac074060 con 0x7f88ac0b4290 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88b1118640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0b6aa0 con 0x7f88ac15c690 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88aa59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f88ac0b1980 0x7f88ac0d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49400/0 (socket says 172.21.15.134:49400) 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88aa59c640 1 -- 172.21.15.134:0/920854010 learned_addr learned my addr 172.21.15.134:0/920854010 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.314+0000 7f88ab59e640 1 --2- 172.21.15.134:0/920854010 >> v2:172.21.15.134:3300/0 conn(0x7f88ac0b4290 0x7f88ac0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88aad9d640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 0x7f88ac0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88ab59e640 1 -- 172.21.15.134:0/920854010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 msgr2=0x7f88ac0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88ab59e640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 0x7f88ac0b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88ab59e640 1 -- 172.21.15.134:0/920854010 >> v1:172.21.15.134:6789/0 conn(0x7f88ac0b1980 legacy=0x7f88ac0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88a9d9b640 1 -- 172.21.15.134:0/920854010 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660649675 0 0) 0x7f88ac073da0 con 0x7f88ac0b1980 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88ab59e640 1 -- 172.21.15.134:0/920854010 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0733a0 con 0x7f88ac0b4290 2024-09-15T22:42:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88aad9d640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 0x7f88ac0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88ab59e640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0b4740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d90 tx=0x7f88a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31d171aa93f08ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88a9d9b640 1 -- 172.21.15.134:0/920854010 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4007740 con 0x7f88ac0b4290 2024-09-15T22:42:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88a9d9b640 1 -- 172.21.15.134:0/920854010 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a40078e0 con 0x7f88ac0b4290 2024-09-15T22:42:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.315+0000 7f88a9d9b640 1 -- 172.21.15.134:0/920854010 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4007cb0 con 0x7f88ac0b4290 2024-09-15T22:42:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 -- 172.21.15.134:0/920854010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 msgr2=0x7f88ac0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0b4740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d90 tx=0x7f88a402a660 comp rx=0 tx=0).stop 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 -- 172.21.15.134:0/920854010 shutdown_connections 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0b4740 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 --2- 172.21.15.134:0/920854010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac15c690 0x7f88ac0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 -- 172.21.15.134:0/920854010 >> 172.21.15.134:0/920854010 conn(0x7f88ac062630 msgr2=0x7f88ac062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 -- 172.21.15.134:0/920854010 shutdown_connections 2024-09-15T22:42:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.316+0000 7f88b1118640 1 -- 172.21.15.134:0/920854010 wait complete. 2024-09-15T22:42:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.317+0000 7f88b1118640 1 Processor -- start 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 -- start start 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac0b1980 0x7f88ac14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 0x7f88ac0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0d0dd0 con 0x7f88ac0b4290 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0d0c50 con 0x7f88ac15c690 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88b1118640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0b6fc0 con 0x7f88ac0b1980 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88aa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88aa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51506/0 (socket says 172.21.15.134:51506) 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88aa59c640 1 -- 172.21.15.134:0/3503407173 learned_addr learned my addr 172.21.15.134:0/3503407173 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88aad9d640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac0b1980 0x7f88ac14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.318+0000 7f88ab59e640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 0x7f88ac0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 -- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac0b1980 msgr2=0x7f88ac14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac0b1980 0x7f88ac14cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 -- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 msgr2=0x7f88ac0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 0x7f88ac0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 -- 172.21.15.134:0/3503407173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0ab730 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88ab59e640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 0x7f88ac0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88aa59c640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c4e0 tx=0x7f88a000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0018070 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a0007500 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0004a20 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac0aba10 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.319+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac0abfd0 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.320+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac0b6010 con 0x7f88ac0b4290 2024-09-15T22:42:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.321+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88a001b070 con 0x7f88ac0b4290 2024-09-15T22:42:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.321+0000 7f88937fe640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 0x7f889806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.321+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f88a008a680 con 0x7f88ac0b4290 2024-09-15T22:42:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.321+0000 7f88aad9d640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 0x7f889806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.321+0000 7f88aad9d640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 0x7f889806e7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f889c00aac0 tx=0x7f889c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.325+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88a0058860 con 0x7f88ac0b4290 2024-09-15T22:42:16.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.487+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88ac0b74a0 con 0x7f889806c2e0 2024-09-15T22:42:16.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.493+0000 7f88937fe640 1 -- 172.21.15.134:0/3503407173 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241049 (secure 0 0 0) 0x7f88ac0b74a0 con 0x7f889806c2e0 2024-09-15T22:42:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:16.498 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 msgr2=0x7f889806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 0x7f889806e7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f889c00aac0 tx=0x7f889c008040 comp rx=0 tx=0).stop 2024-09-15T22:42:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 msgr2=0x7f88ac0ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c4e0 tx=0x7f88a000c9a0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 shutdown_connections 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f889806c2e0 0x7f889806e7a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ac15c690 0x7f88ac0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ac0b4290 0x7f88ac0ad070 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 --2- 172.21.15.134:0/3503407173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ac0b1980 0x7f88ac14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 >> 172.21.15.134:0/3503407173 conn(0x7f88ac062630 msgr2=0x7f88ac0d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 shutdown_connections 2024-09-15T22:42:16.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.496+0000 7f88b1118640 1 -- 172.21.15.134:0/3503407173 wait complete. 2024-09-15T22:42:16.508 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-15T22:42:14.956940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220124,"kb_used_data":3864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":3956736,"data_stored":2197879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.087637"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878178+0000","last_change":"2024-09-15T22:42:12.896604+0000","last_active":"2024-09-15T22:42:13.878178+0000","last_peered":"2024-09-15T22:42:13.878178+0000","last_clean":"2024-09-15T22:42:13.878178+0000","last_became_active":"2024-09-15T22:42:12.896338+0000","last_became_peered":"2024-09-15T22:42:12.896338+0000","last_unstale":"2024-09-15T22:42:13.878178+0000","last_undegraded":"2024-09-15T22:42:13.878178+0000","last_fullsized":"2024-09-15T22:42:13.878178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:46.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879322+0000","last_change":"2024-09-15T22:42:12.895866+0000","last_active":"2024-09-15T22:42:13.879322+0000","last_peered":"2024-09-15T22:42:13.879322+0000","last_clean":"2024-09-15T22:42:13.879322+0000","last_became_active":"2024-09-15T22:42:12.895588+0000","last_became_peered":"2024-09-15T22:42:12.895588+0000","last_unstale":"2024-09-15T22:42:13.879322+0000","last_undegraded":"2024-09-15T22:42:13.879322+0000","last_fullsized":"2024-09-15T22:42:13.879322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:26.004143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877932+0000","last_change":"2024-09-15T22:42:12.890470+0000","last_active":"2024-09-15T22:42:13.877932+0000","last_peered":"2024-09-15T22:42:13.877932+0000","last_clean":"2024-09-15T22:42:13.877932+0000","last_became_active":"2024-09-15T22:42:12.889280+0000","last_became_peered":"2024-09-15T22:42:12.889280+0000","last_unstale":"2024-09-15T22:42:13.877932+0000","last_undegraded":"2024-09-15T22:42:13.877932+0000","last_fullsized":"2024-09-15T22:42:13.877932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.734305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879478+0000","last_change":"2024-09-15T22:42:12.891613+0000","last_active":"2024-09-15T22:42:13.879478+0000","last_peered":"2024-09-15T22:42:13.879478+0000","last_clean":"2024-09-15T22:42:13.879478+0000","last_became_active":"2024-09-15T22:42:12.891023+0000","last_became_peered":"2024-09-15T22:42:12.891023+0000","last_unstale":"2024-09-15T22:42:13.879478+0000","last_undegraded":"2024-09-15T22:42:13.879478+0000","last_fullsized":"2024-09-15T22:42:13.879478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:08.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874324+0000","last_change":"2024-09-15T22:42:10.874324+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874324+0000","last_undegraded":"2024-09-15T22:42:10.874324+0000","last_fullsized":"2024-09-15T22:42:10.874324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871709+0000","last_change":"2024-09-15T22:42:10.871709+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871709+0000","last_undegraded":"2024-09-15T22:42:10.871709+0000","last_fullsized":"2024-09-15T22:42:10.871709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872541+0000","last_change":"2024-09-15T22:42:10.872541+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872541+0000","last_undegraded":"2024-09-15T22:42:10.872541+0000","last_fullsized":"2024-09-15T22:42:10.872541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872185+0000","last_change":"2024-09-15T22:42:10.872185+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872185+0000","last_undegraded":"2024-09-15T22:42:10.872185+0000","last_fullsized":"2024-09-15T22:42:10.872185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873518+0000","last_change":"2024-09-15T22:42:10.873518+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873518+0000","last_undegraded":"2024-09-15T22:42:10.873518+0000","last_fullsized":"2024-09-15T22:42:10.873518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869270+0000","last_change":"2024-09-15T22:42:10.869270+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869270+0000","last_undegraded":"2024-09-15T22:42:10.869270+0000","last_fullsized":"2024-09-15T22:42:10.869270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869984+0000","last_change":"2024-09-15T22:42:10.869984+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869984+0000","last_undegraded":"2024-09-15T22:42:10.869984+0000","last_fullsized":"2024-09-15T22:42:10.869984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.874262+0000","last_change":"2024-09-15T22:42:10.874262+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.874262+0000","last_undegraded":"2024-09-15T22:42:10.874262+0000","last_fullsized":"2024-09-15T22:42:10.874262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879334+0000","last_change":"2024-09-15T22:42:11.882504+0000","last_active":"2024-09-15T22:42:13.879334+0000","last_peered":"2024-09-15T22:42:13.879334+0000","last_clean":"2024-09-15T22:42:13.879334+0000","last_became_active":"2024-09-15T22:42:11.881991+0000","last_became_peered":"2024-09-15T22:42:11.881991+0000","last_unstale":"2024-09-15T22:42:13.879334+0000","last_undegraded":"2024-09-15T22:42:13.879334+0000","last_fullsized":"2024-09-15T22:42:13.879334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878186+0000","last_change":"2024-09-15T22:42:12.890997+0000","last_active":"2024-09-15T22:42:13.878186+0000","last_peered":"2024-09-15T22:42:13.878186+0000","last_clean":"2024-09-15T22:42:13.878186+0000","last_became_active":"2024-09-15T22:42:12.890727+0000","last_became_peered":"2024-09-15T22:42:12.890727+0000","last_unstale":"2024-09-15T22:42:13.878186+0000","last_undegraded":"2024-09-15T22:42:13.878186+0000","last_fullsized":"2024-09-15T22:42:13.878186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:26.495173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871814+0000","last_change":"2024-09-15T22:42:10.871814+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871814+0000","last_undegraded":"2024-09-15T22:42:10.871814+0000","last_fullsized":"2024-09-15T22:42:10.871814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871584+0000","last_change":"2024-09-15T22:42:10.871584+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871584+0000","last_undegraded":"2024-09-15T22:42:10.871584+0000","last_fullsized":"2024-09-15T22:42:10.871584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873031+0000","last_change":"2024-09-15T22:42:10.873031+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873031+0000","last_undegraded":"2024-09-15T22:42:10.873031+0000","last_fullsized":"2024-09-15T22:42:10.873031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872587+0000","last_change":"2024-09-15T22:42:10.872587+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872587+0000","last_undegraded":"2024-09-15T22:42:10.872587+0000","last_fullsized":"2024-09-15T22:42:10.872587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873841+0000","last_change":"2024-09-15T22:42:10.873841+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873841+0000","last_undegraded":"2024-09-15T22:42:10.873841+0000","last_fullsized":"2024-09-15T22:42:10.873841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.872903+0000","last_change":"2024-09-15T22:42:10.872903+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.872903+0000","last_undegraded":"2024-09-15T22:42:10.872903+0000","last_fullsized":"2024-09-15T22:42:10.872903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878102+0000","last_change":"2024-09-15T22:42:12.899753+0000","last_active":"2024-09-15T22:42:13.878102+0000","last_peered":"2024-09-15T22:42:13.878102+0000","last_clean":"2024-09-15T22:42:13.878102+0000","last_became_active":"2024-09-15T22:42:12.899475+0000","last_became_peered":"2024-09-15T22:42:12.899475+0000","last_unstale":"2024-09-15T22:42:13.878102+0000","last_undegraded":"2024-09-15T22:42:13.878102+0000","last_fullsized":"2024-09-15T22:42:13.878102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:35.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869347+0000","last_change":"2024-09-15T22:42:10.869347+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869347+0000","last_undegraded":"2024-09-15T22:42:10.869347+0000","last_fullsized":"2024-09-15T22:42:10.869347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877785+0000","last_change":"2024-09-15T22:42:12.894563+0000","last_active":"2024-09-15T22:42:13.877785+0000","last_peered":"2024-09-15T22:42:13.877785+0000","last_clean":"2024-09-15T22:42:13.877785+0000","last_became_active":"2024-09-15T22:42:12.894216+0000","last_became_peered":"2024-09-15T22:42:12.894216+0000","last_unstale":"2024-09-15T22:42:13.877785+0000","last_undegraded":"2024-09-15T22:42:13.877785+0000","last_fullsized":"2024-09-15T22:42:13.877785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:59.153843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873005+0000","last_change":"2024-09-15T22:42:10.873005+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873005+0000","last_undegraded":"2024-09-15T22:42:10.873005+0000","last_fullsized":"2024-09-15T22:42:10.873005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873368+0000","last_change":"2024-09-15T22:42:10.873368+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873368+0000","last_undegraded":"2024-09-15T22:42:10.873368+0000","last_fullsized":"2024-09-15T22:42:10.873368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879224+0000","last_change":"2024-09-15T22:42:11.886225+0000","last_active":"2024-09-15T22:42:13.879224+0000","last_peered":"2024-09-15T22:42:13.879224+0000","last_clean":"2024-09-15T22:42:13.879224+0000","last_became_active":"2024-09-15T22:42:11.885851+0000","last_became_peered":"2024-09-15T22:42:11.885851+0000","last_unstale":"2024-09-15T22:42:13.879224+0000","last_undegraded":"2024-09-15T22:42:13.879224+0000","last_fullsized":"2024-09-15T22:42:13.879224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:43.788609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.869373+0000","last_change":"2024-09-15T22:42:10.869373+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.869373+0000","last_undegraded":"2024-09-15T22:42:10.869373+0000","last_fullsized":"2024-09-15T22:42:10.869373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879436+0000","last_change":"2024-09-15T22:42:11.887249+0000","last_active":"2024-09-15T22:42:13.879436+0000","last_peered":"2024-09-15T22:42:13.879436+0000","last_clean":"2024-09-15T22:42:13.879436+0000","last_became_active":"2024-09-15T22:42:11.886981+0000","last_became_peered":"2024-09-15T22:42:11.886981+0000","last_unstale":"2024-09-15T22:42:13.879436+0000","last_undegraded":"2024-09-15T22:42:13.879436+0000","last_fullsized":"2024-09-15T22:42:13.879436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:39.307694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878348+0000","last_change":"2024-09-15T22:42:11.888253+0000","last_active":"2024-09-15T22:42:13.878348+0000","last_peered":"2024-09-15T22:42:13.878348+0000","last_clean":"2024-09-15T22:42:13.878348+0000","last_became_active":"2024-09-15T22:42:11.887964+0000","last_became_peered":"2024-09-15T22:42:11.887964+0000","last_unstale":"2024-09-15T22:42:13.878348+0000","last_undegraded":"2024-09-15T22:42:13.878348+0000","last_fullsized":"2024-09-15T22:42:13.878348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:24.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878284+0000","last_change":"2024-09-15T22:42:11.889475+0000","last_active":"2024-09-15T22:42:13.878284+0000","last_peered":"2024-09-15T22:42:13.878284+0000","last_clean":"2024-09-15T22:42:13.878284+0000","last_became_active":"2024-09-15T22:42:11.889160+0000","last_became_peered":"2024-09-15T22:42:11.889160+0000","last_unstale":"2024-09-15T22:42:13.878284+0000","last_undegraded":"2024-09-15T22:42:13.878284+0000","last_fullsized":"2024-09-15T22:42:13.878284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:05.509527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:10.859855+0000","last_change":"2024-09-15T22:42:10.859855+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.859855+0000","last_undegraded":"2024-09-15T22:42:10.859855+0000","last_fullsized":"2024-09-15T22:42:10.859855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.871575+0000","last_change":"2024-09-15T22:42:10.871575+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.871575+0000","last_undegraded":"2024-09-15T22:42:10.871575+0000","last_fullsized":"2024-09-15T22:42:10.871575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:11.866968+0000","last_change":"2024-09-15T22:42:11.866968+0000","last_active":"2024-09-15T22:42:11.866968+0000","last_peered":"2024-09-15T22:42:11.866968+0000","last_clean":"2024-09-15T22:42:11.866968+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:11.866968+0000","last_undegraded":"2024-09-15T22:42:11.866968+0000","last_fullsized":"2024-09-15T22:42:11.866968+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-15T22:42:10.873126+0000","last_change":"2024-09-15T22:42:10.873126+0000","last_active":"2024-09-15T22:42:10.859855+0000","last_peered":"2024-09-15T22:42:10.859855+0000","last_clean":"2024-09-15T22:42:10.859855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:10.873126+0000","last_undegraded":"2024-09-15T22:42:10.873126+0000","last_fullsized":"2024-09-15T22:42:10.873126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T22:42:10.871216+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:10.871216+0000","last_peered":"2024-09-15T22:42:10.871216+0000","last_clean":"2024-09-15T22:42:10.871216+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:10.871216+0000","last_undegraded":"2024-09-15T22:42:10.871216+0000","last_fullsized":"2024-09-15T22:42:10.871216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":50,"acting":50,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":714951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":124583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":145062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-15T22:42:16.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-15T22:42:16.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.515 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-15T22:42:16.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-15T22:42:16.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.874324+0000', 'last_change': '2024-09-15T22:42:10.874324+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.874324+0000', 'last_undegraded': '2024-09-15T22:42:10.874324+0000', 'last_fullsized': '2024-09-15T22:42:10.874324+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.871709+0000', 'last_change': '2024-09-15T22:42:10.871709+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.871709+0000', 'last_undegraded': '2024-09-15T22:42:10.871709+0000', 'last_fullsized': '2024-09-15T22:42:10.871709+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.872541+0000', 'last_change': '2024-09-15T22:42:10.872541+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.872541+0000', 'last_undegraded': '2024-09-15T22:42:10.872541+0000', 'last_fullsized': '2024-09-15T22:42:10.872541+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.518 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.872185+0000', 'last_change': '2024-09-15T22:42:10.872185+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.872185+0000', 'last_undegraded': '2024-09-15T22:42:10.872185+0000', 'last_fullsized': '2024-09-15T22:42:10.872185+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.519 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873518+0000', 'last_change': '2024-09-15T22:42:10.873518+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873518+0000', 'last_undegraded': '2024-09-15T22:42:10.873518+0000', 'last_fullsized': '2024-09-15T22:42:10.873518+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.869270+0000', 'last_change': '2024-09-15T22:42:10.869270+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.869270+0000', 'last_undegraded': '2024-09-15T22:42:10.869270+0000', 'last_fullsized': '2024-09-15T22:42:10.869270+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.520 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.869984+0000', 'last_change': '2024-09-15T22:42:10.869984+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.869984+0000', 'last_undegraded': '2024-09-15T22:42:10.869984+0000', 'last_fullsized': '2024-09-15T22:42:10.869984+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.874262+0000', 'last_change': '2024-09-15T22:42:10.874262+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.874262+0000', 'last_undegraded': '2024-09-15T22:42:10.874262+0000', 'last_fullsized': '2024-09-15T22:42:10.874262+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-15T22:42:16.521 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.871814+0000', 'last_change': '2024-09-15T22:42:10.871814+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.871814+0000', 'last_undegraded': '2024-09-15T22:42:10.871814+0000', 'last_fullsized': '2024-09-15T22:42:10.871814+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.871584+0000', 'last_change': '2024-09-15T22:42:10.871584+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.871584+0000', 'last_undegraded': '2024-09-15T22:42:10.871584+0000', 'last_fullsized': '2024-09-15T22:42:10.871584+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873031+0000', 'last_change': '2024-09-15T22:42:10.873031+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873031+0000', 'last_undegraded': '2024-09-15T22:42:10.873031+0000', 'last_fullsized': '2024-09-15T22:42:10.873031+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-15T22:42:16.522 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.872587+0000', 'last_change': '2024-09-15T22:42:10.872587+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.872587+0000', 'last_undegraded': '2024-09-15T22:42:10.872587+0000', 'last_fullsized': '2024-09-15T22:42:10.872587+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-15T22:42:16.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873841+0000', 'last_change': '2024-09-15T22:42:10.873841+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873841+0000', 'last_undegraded': '2024-09-15T22:42:10.873841+0000', 'last_fullsized': '2024-09-15T22:42:10.873841+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.872903+0000', 'last_change': '2024-09-15T22:42:10.872903+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.872903+0000', 'last_undegraded': '2024-09-15T22:42:10.872903+0000', 'last_fullsized': '2024-09-15T22:42:10.872903+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.869347+0000', 'last_change': '2024-09-15T22:42:10.869347+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.869347+0000', 'last_undegraded': '2024-09-15T22:42:10.869347+0000', 'last_fullsized': '2024-09-15T22:42:10.869347+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873005+0000', 'last_change': '2024-09-15T22:42:10.873005+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873005+0000', 'last_undegraded': '2024-09-15T22:42:10.873005+0000', 'last_fullsized': '2024-09-15T22:42:10.873005+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873368+0000', 'last_change': '2024-09-15T22:42:10.873368+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873368+0000', 'last_undegraded': '2024-09-15T22:42:10.873368+0000', 'last_fullsized': '2024-09-15T22:42:10.873368+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-15T22:42:16.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.869373+0000', 'last_change': '2024-09-15T22:42:10.869373+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.869373+0000', 'last_undegraded': '2024-09-15T22:42:10.869373+0000', 'last_fullsized': '2024-09-15T22:42:10.869373+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:10.859855+0000', 'last_change': '2024-09-15T22:42:10.859855+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.859855+0000', 'last_undegraded': '2024-09-15T22:42:10.859855+0000', 'last_fullsized': '2024-09-15T22:42:10.859855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.526 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.871575+0000', 'last_change': '2024-09-15T22:42:10.871575+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.871575+0000', 'last_undegraded': '2024-09-15T22:42:10.871575+0000', 'last_fullsized': '2024-09-15T22:42:10.871575+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:11.866968+0000', 'last_change': '2024-09-15T22:42:11.866968+0000', 'last_active': '2024-09-15T22:42:11.866968+0000', 'last_peered': '2024-09-15T22:42:11.866968+0000', 'last_clean': '2024-09-15T22:42:11.866968+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:11.866968+0000', 'last_undegraded': '2024-09-15T22:42:11.866968+0000', 'last_fullsized': '2024-09-15T22:42:11.866968+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:11.866968+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-15T22:42:16.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:42:10.873126+0000', 'last_change': '2024-09-15T22:42:10.873126+0000', 'last_active': '2024-09-15T22:42:10.859855+0000', 'last_peered': '2024-09-15T22:42:10.859855+0000', 'last_clean': '2024-09-15T22:42:10.859855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:10.873126+0000', 'last_undegraded': '2024-09-15T22:42:10.873126+0000', 'last_fullsized': '2024-09-15T22:42:10.873126+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:10.859855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:42:16.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:42:16.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.648+0000 7f15c90f1640 1 Processor -- start 2024-09-15T22:42:16.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.648+0000 7f15c90f1640 1 -- start start 2024-09-15T22:42:16.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.649+0000 7f15c90f1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.649+0000 7f15c90f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 0x7f15c40b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.649+0000 7f15c90f1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c40b4ee0 con 0x7f15c413eaf0 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.649+0000 7f15c90f1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f15c413ef60 con 0x7f15c4140a40 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.649+0000 7f15c90f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15c40b5780 con 0x7f15c40727d0 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c2d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 0x7f15c40b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c2d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:57034/0 (socket says 172.21.15.134:57034) 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c259c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f15c413eaf0 0x7f15c40720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:42344/0 (socket says 172.21.15.134:42344) 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c2d9d640 1 -- 172.21.15.134:0/118304020 learned_addr learned my addr 172.21.15.134:0/118304020 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c359e640 1 -- 172.21.15.134:0/118304020 >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 msgr2=0x7f15c415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c359e640 1 --2- 172.21.15.134:0/118304020 >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c359e640 1 -- 172.21.15.134:0/118304020 >> v1:172.21.15.177:6789/0 conn(0x7f15c413eaf0 legacy=0x7f15c40720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c1d9b640 1 -- 172.21.15.134:0/118304020 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388968440 0 0) 0x7f15c40b4ee0 con 0x7f15c413eaf0 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c359e640 1 -- 172.21.15.134:0/118304020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c40b51c0 con 0x7f15c40727d0 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.650+0000 7f15c2d9d640 1 --2- 172.21.15.134:0/118304020 >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.651+0000 7f15c359e640 1 --2- 172.21.15.134:0/118304020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 0x7f15c40b47e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009d90 tx=0x7f15bc02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6863af56af8ba5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.651+0000 7f15c1d9b640 1 -- 172.21.15.134:0/118304020 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc031600 con 0x7f15c40727d0 2024-09-15T22:42:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.651+0000 7f15c1d9b640 1 -- 172.21.15.134:0/118304020 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc0317a0 con 0x7f15c40727d0 2024-09-15T22:42:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.651+0000 7f15c1d9b640 1 -- 172.21.15.134:0/118304020 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc031b70 con 0x7f15c40727d0 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 -- 172.21.15.134:0/118304020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 msgr2=0x7f15c40b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 --2- 172.21.15.134:0/118304020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 0x7f15c40b47e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009d90 tx=0x7f15bc02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 -- 172.21.15.134:0/118304020 shutdown_connections 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 --2- 172.21.15.134:0/118304020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c40727d0 0x7f15c40b47e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 --2- 172.21.15.134:0/118304020 >> v2:172.21.15.177:3300/0 conn(0x7f15c4140a40 0x7f15c415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 -- 172.21.15.134:0/118304020 >> 172.21.15.134:0/118304020 conn(0x7f15c4062a80 msgr2=0x7f15c406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 -- 172.21.15.134:0/118304020 shutdown_connections 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.652+0000 7f15c90f1640 1 -- 172.21.15.134:0/118304020 wait complete. 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.653+0000 7f15c90f1640 1 Processor -- start 2024-09-15T22:42:16.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.653+0000 7f15c90f1640 1 -- start start 2024-09-15T22:42:16.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 0x7f15c412dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c4140a40 0x7f15c406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15c4140e20 con 0x7f15c413eaf0 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40b5ad0 con 0x7f15c40727d0 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c90f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15c40b5ff0 con 0x7f15c4140a40 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51514/0 (socket says 172.21.15.134:51514) 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 -- 172.21.15.134:0/2944288227 learned_addr learned my addr 172.21.15.134:0/2944288227 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c2d9d640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 0x7f15c412dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c359e640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c4140a40 0x7f15c406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 -- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c4140a40 msgr2=0x7f15c406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c4140a40 0x7f15c406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 -- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 msgr2=0x7f15c412dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 0x7f15c412dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 -- 172.21.15.134:0/2944288227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c406cc00 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c2d9d640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 0x7f15c412dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.654+0000 7f15c259c640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c4e0 tx=0x7f15ac00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.655+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac018070 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.655+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ac0074c0 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.655+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c412e300 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.655+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac004a20 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.655+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c412e8c0 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.656+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c415c480 con 0x7f15c413eaf0 2024-09-15T22:42:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.656+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15ac01b070 con 0x7f15c413eaf0 2024-09-15T22:42:16.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.657+0000 7f15bb7fe640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 0x7f15a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:16.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.657+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f15ac08a7a0 con 0x7f15c413eaf0 2024-09-15T22:42:16.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.657+0000 7f15c2d9d640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 0x7f15a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:16.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.657+0000 7f15c2d9d640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 0x7f15a406e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009b80 tx=0x7f15b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:16.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.661+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15c406cc00 con 0x7f15c413eaf0 2024-09-15T22:42:16.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.887+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f15c40633d0 con 0x7f15c413eaf0 2024-09-15T22:42:16.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.888+0000 7f15bb7fe640 1 -- 172.21.15.134:0/2944288227 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2698 (secure 0 0 0) 0x7f15ac059060 con 0x7f15c413eaf0 2024-09-15T22:42:16.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:16.890 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":20},{"state_name":"active+clean","count":13}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":591980,"bytes_used":225406976,"bytes_avail":772868706304,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":751,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":14,"btime":"2024-09-15T22:42:14:903131+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4842}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-15T22:42:14.957027+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:42:16.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 msgr2=0x7f15a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 0x7f15a406e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009b80 tx=0x7f15b4008040 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 msgr2=0x7f15c41f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c4e0 tx=0x7f15ac00c9a0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 shutdown_connections 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15a406c2b0 0x7f15a406e770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15c4140a40 0x7f15c406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15c413eaf0 0x7f15c41f4cd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 --2- 172.21.15.134:0/2944288227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40727d0 0x7f15c412dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 >> 172.21.15.134:0/2944288227 conn(0x7f15c4062a80 msgr2=0x7f15c4159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 shutdown_connections 2024-09-15T22:42:16.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:16.890+0000 7f15c90f1640 1 -- 172.21.15.134:0/2944288227 wait complete. 2024-09-15T22:42:16.902 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:42:16.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:17.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.001+0000 7fa98b853640 1 Processor -- start 2024-09-15T22:42:17.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.001+0000 7fa98b853640 1 -- start start 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa98415e500 0x7fa9840b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98415e8e0 0x7fa9840b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa984073cb0 0x7fa9841622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa984074200 con 0x7fa984073cb0 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa9840b6e80 con 0x7fa98415e500 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa98b853640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa9840b7160 con 0x7fa98415e8e0 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa984073cb0 0x7fa9841622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa984073cb0 0x7fa9841622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51530/0 (socket says 172.21.15.134:51530) 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 -- 172.21.15.134:0/275454715 learned_addr learned my addr 172.21.15.134:0/275454715 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:17.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa9895ef640 1 --2- 172.21.15.134:0/275454715 >> v2:172.21.15.177:3300/0 conn(0x7fa98415e500 0x7fa9840b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa988dee640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98415e8e0 0x7fa9840b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 -- 172.21.15.134:0/275454715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98415e8e0 msgr2=0x7fa9840b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98415e8e0 0x7fa9840b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 -- 172.21.15.134:0/275454715 >> v2:172.21.15.177:3300/0 conn(0x7fa98415e500 msgr2=0x7fa9840b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 --2- 172.21.15.134:0/275454715 >> v2:172.21.15.177:3300/0 conn(0x7fa98415e500 0x7fa9840b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.002+0000 7fa989df0640 1 -- 172.21.15.134:0/275454715 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9840b7440 con 0x7fa984073cb0 2024-09-15T22:42:17.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.003+0000 7fa989df0640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa984073cb0 0x7fa9841622a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa984070680 tx=0x7fa97c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8538fcdebe342 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:17.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.003+0000 7fa97bfff640 1 -- 172.21.15.134:0/275454715 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c036070 con 0x7fa984073cb0 2024-09-15T22:42:17.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.003+0000 7fa97bfff640 1 -- 172.21.15.134:0/275454715 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97c031600 con 0x7fa984073cb0 2024-09-15T22:42:17.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.003+0000 7fa97bfff640 1 -- 172.21.15.134:0/275454715 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0319d0 con 0x7fa984073cb0 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 -- 172.21.15.134:0/275454715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa984073cb0 msgr2=0x7fa9841622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa984073cb0 0x7fa9841622a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa984070680 tx=0x7fa97c02a610 comp rx=0 tx=0).stop 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 -- 172.21.15.134:0/275454715 shutdown_connections 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa984073cb0 0x7fa9841622a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 --2- 172.21.15.134:0/275454715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98415e8e0 0x7fa9840b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 --2- 172.21.15.134:0/275454715 >> v2:172.21.15.177:3300/0 conn(0x7fa98415e500 0x7fa9840b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 -- 172.21.15.134:0/275454715 >> 172.21.15.134:0/275454715 conn(0x7fa984062810 msgr2=0x7fa984062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 -- 172.21.15.134:0/275454715 shutdown_connections 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.004+0000 7fa98b853640 1 -- 172.21.15.134:0/275454715 wait complete. 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.005+0000 7fa98b853640 1 Processor -- start 2024-09-15T22:42:17.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.005+0000 7fa98b853640 1 -- start start 2024-09-15T22:42:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa984073cb0 0x7fa984154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 0x7fa9841f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa98406ce30 con 0x7fa98415e500 2024-09-15T22:42:17.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa98406ccb0 con 0x7fa98415e8e0 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa9840d1cf0 con 0x7fa984073cb0 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51546/0 (socket says 172.21.15.134:51546) 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 -- 172.21.15.134:0/1883919022 learned_addr learned my addr 172.21.15.134:0/1883919022 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa9895ef640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa984073cb0 0x7fa984154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa989df0640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 0x7fa9841f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 -- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa984073cb0 msgr2=0x7fa984154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa984073cb0 0x7fa984154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 -- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 msgr2=0x7fa9841f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 0x7fa9841f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 -- 172.21.15.134:0/1883919022 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa984158610 con 0x7fa98415e500 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa989df0640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 0x7fa9841f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:17.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa988dee640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa98000d5c0 tx=0x7fa98000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800125f0 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980019070 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9841f8790 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.006+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800129d0 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.007+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa984158b60 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.008+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9840b4460 con 0x7fa98415e500 2024-09-15T22:42:17.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.008+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa980012b70 con 0x7fa98415e500 2024-09-15T22:42:17.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.008+0000 7fa979ffb640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 0x7fa96806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:17.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.009+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa98008b830 con 0x7fa98415e500 2024-09-15T22:42:17.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.009+0000 7fa9895ef640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 0x7fa96806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:17.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.009+0000 7fa9895ef640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 0x7fa96806e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa974006fd0 tx=0x7fa974008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:17.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.013+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa980059fa0 con 0x7fa98415e500 2024-09-15T22:42:17.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.174+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa984069160 con 0x7fa96806c2b0 2024-09-15T22:42:17.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.180+0000 7fa979ffb640 1 -- 172.21.15.134:0/1883919022 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7fa984069160 con 0x7fa96806c2b0 2024-09-15T22:42:17.186 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:17.188 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:17.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 msgr2=0x7fa96806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:17.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 0x7fa96806e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa974006fd0 tx=0x7fa974008040 comp rx=0 tx=0).stop 2024-09-15T22:42:17.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 msgr2=0x7fa9841f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa98000d5c0 tx=0x7fa98000da80 comp rx=0 tx=0).stop 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 shutdown_connections 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa96806c2b0 0x7fa96806e770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98415e8e0 0x7fa9841f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98415e500 0x7fa9841f7bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 --2- 172.21.15.134:0/1883919022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa984073cb0 0x7fa984154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 >> 172.21.15.134:0/1883919022 conn(0x7fa984062810 msgr2=0x7fa9840b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 shutdown_connections 2024-09-15T22:42:17.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:17.183+0000 7fa98b853640 1 -- 172.21.15.134:0/1883919022 wait complete. 2024-09-15T22:42:17.196 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-15T22:42:16.957367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220496,"kb_used_data":4252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754224,"statfs":{"total":773094113280,"available":772868325376,"internally_reserved":0,"allocated":4354048,"data_stored":2377256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001006"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929490+0000","last_change":"2024-09-15T22:42:12.905988+0000","last_active":"2024-09-15T22:42:14.929490+0000","last_peered":"2024-09-15T22:42:14.929490+0000","last_clean":"2024-09-15T22:42:14.929490+0000","last_became_active":"2024-09-15T22:42:12.905676+0000","last_became_peered":"2024-09-15T22:42:12.905676+0000","last_unstale":"2024-09-15T22:42:14.929490+0000","last_undegraded":"2024-09-15T22:42:14.929490+0000","last_fullsized":"2024-09-15T22:42:14.929490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879349+0000","last_change":"2024-09-15T22:42:12.897747+0000","last_active":"2024-09-15T22:42:14.879349+0000","last_peered":"2024-09-15T22:42:14.879349+0000","last_clean":"2024-09-15T22:42:14.879349+0000","last_became_active":"2024-09-15T22:42:12.897511+0000","last_became_peered":"2024-09-15T22:42:12.897511+0000","last_unstale":"2024-09-15T22:42:14.879349+0000","last_undegraded":"2024-09-15T22:42:14.879349+0000","last_fullsized":"2024-09-15T22:42:14.879349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879459+0000","last_change":"2024-09-15T22:42:12.892903+0000","last_active":"2024-09-15T22:42:13.879459+0000","last_peered":"2024-09-15T22:42:13.879459+0000","last_clean":"2024-09-15T22:42:13.879459+0000","last_became_active":"2024-09-15T22:42:12.892560+0000","last_became_peered":"2024-09-15T22:42:12.892560+0000","last_unstale":"2024-09-15T22:42:13.879459+0000","last_undegraded":"2024-09-15T22:42:13.879459+0000","last_fullsized":"2024-09-15T22:42:13.879459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:12.251665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879143+0000","last_change":"2024-09-15T22:42:12.896954+0000","last_active":"2024-09-15T22:42:13.879143+0000","last_peered":"2024-09-15T22:42:13.879143+0000","last_clean":"2024-09-15T22:42:13.879143+0000","last_became_active":"2024-09-15T22:42:12.896692+0000","last_became_peered":"2024-09-15T22:42:12.896692+0000","last_unstale":"2024-09-15T22:42:13.879143+0000","last_undegraded":"2024-09-15T22:42:13.879143+0000","last_fullsized":"2024-09-15T22:42:13.879143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:45.253998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879199+0000","last_change":"2024-09-15T22:42:12.894327+0000","last_active":"2024-09-15T22:42:14.879199+0000","last_peered":"2024-09-15T22:42:14.879199+0000","last_clean":"2024-09-15T22:42:14.879199+0000","last_became_active":"2024-09-15T22:42:12.894012+0000","last_became_peered":"2024-09-15T22:42:12.894012+0000","last_unstale":"2024-09-15T22:42:14.879199+0000","last_undegraded":"2024-09-15T22:42:14.879199+0000","last_fullsized":"2024-09-15T22:42:14.879199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881580+0000","last_change":"2024-09-15T22:42:12.889057+0000","last_active":"2024-09-15T22:42:14.881580+0000","last_peered":"2024-09-15T22:42:14.881580+0000","last_clean":"2024-09-15T22:42:14.881580+0000","last_became_active":"2024-09-15T22:42:12.888747+0000","last_became_peered":"2024-09-15T22:42:12.888747+0000","last_unstale":"2024-09-15T22:42:14.881580+0000","last_undegraded":"2024-09-15T22:42:14.881580+0000","last_fullsized":"2024-09-15T22:42:14.881580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:45.642159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929110+0000","last_change":"2024-09-15T22:42:12.891980+0000","last_active":"2024-09-15T22:42:14.929110+0000","last_peered":"2024-09-15T22:42:14.929110+0000","last_clean":"2024-09-15T22:42:14.929110+0000","last_became_active":"2024-09-15T22:42:12.891654+0000","last_became_peered":"2024-09-15T22:42:12.891654+0000","last_unstale":"2024-09-15T22:42:14.929110+0000","last_undegraded":"2024-09-15T22:42:14.929110+0000","last_fullsized":"2024-09-15T22:42:14.929110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:16.327559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929002+0000","last_change":"2024-09-15T22:42:12.891062+0000","last_active":"2024-09-15T22:42:14.929002+0000","last_peered":"2024-09-15T22:42:14.929002+0000","last_clean":"2024-09-15T22:42:14.929002+0000","last_became_active":"2024-09-15T22:42:12.890455+0000","last_became_peered":"2024-09-15T22:42:12.890455+0000","last_unstale":"2024-09-15T22:42:14.929002+0000","last_undegraded":"2024-09-15T22:42:14.929002+0000","last_fullsized":"2024-09-15T22:42:14.929002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:02.723070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879420+0000","last_change":"2024-09-15T22:42:12.892821+0000","last_active":"2024-09-15T22:42:13.879420+0000","last_peered":"2024-09-15T22:42:13.879420+0000","last_clean":"2024-09-15T22:42:13.879420+0000","last_became_active":"2024-09-15T22:42:12.892534+0000","last_became_peered":"2024-09-15T22:42:12.892534+0000","last_unstale":"2024-09-15T22:42:13.879420+0000","last_undegraded":"2024-09-15T22:42:13.879420+0000","last_fullsized":"2024-09-15T22:42:13.879420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:45.642159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878950+0000","last_change":"2024-09-15T22:42:12.892139+0000","last_active":"2024-09-15T22:42:13.878950+0000","last_peered":"2024-09-15T22:42:13.878950+0000","last_clean":"2024-09-15T22:42:13.878950+0000","last_became_active":"2024-09-15T22:42:12.891143+0000","last_became_peered":"2024-09-15T22:42:12.891143+0000","last_unstale":"2024-09-15T22:42:13.878950+0000","last_undegraded":"2024-09-15T22:42:13.878950+0000","last_fullsized":"2024-09-15T22:42:13.878950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784394+0000","last_change":"2024-09-15T22:42:12.890873+0000","last_active":"2024-09-15T22:42:14.784394+0000","last_peered":"2024-09-15T22:42:14.784394+0000","last_clean":"2024-09-15T22:42:14.784394+0000","last_became_active":"2024-09-15T22:42:12.890612+0000","last_became_peered":"2024-09-15T22:42:12.890612+0000","last_unstale":"2024-09-15T22:42:14.784394+0000","last_undegraded":"2024-09-15T22:42:14.784394+0000","last_fullsized":"2024-09-15T22:42:14.784394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.841459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879442+0000","last_change":"2024-09-15T22:42:12.894661+0000","last_active":"2024-09-15T22:42:13.879442+0000","last_peered":"2024-09-15T22:42:13.879442+0000","last_clean":"2024-09-15T22:42:13.879442+0000","last_became_active":"2024-09-15T22:42:12.893600+0000","last_became_peered":"2024-09-15T22:42:12.893600+0000","last_unstale":"2024-09-15T22:42:13.879442+0000","last_undegraded":"2024-09-15T22:42:13.879442+0000","last_fullsized":"2024-09-15T22:42:13.879442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:39.873094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878178+0000","last_change":"2024-09-15T22:42:12.896604+0000","last_active":"2024-09-15T22:42:13.878178+0000","last_peered":"2024-09-15T22:42:13.878178+0000","last_clean":"2024-09-15T22:42:13.878178+0000","last_became_active":"2024-09-15T22:42:12.896338+0000","last_became_peered":"2024-09-15T22:42:12.896338+0000","last_unstale":"2024-09-15T22:42:13.878178+0000","last_undegraded":"2024-09-15T22:42:13.878178+0000","last_fullsized":"2024-09-15T22:42:13.878178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:46.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879323+0000","last_change":"2024-09-15T22:42:12.890511+0000","last_active":"2024-09-15T22:42:13.879323+0000","last_peered":"2024-09-15T22:42:13.879323+0000","last_clean":"2024-09-15T22:42:13.879323+0000","last_became_active":"2024-09-15T22:42:12.890202+0000","last_became_peered":"2024-09-15T22:42:12.890202+0000","last_unstale":"2024-09-15T22:42:13.879323+0000","last_undegraded":"2024-09-15T22:42:13.879323+0000","last_fullsized":"2024-09-15T22:42:13.879323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:19.029170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929585+0000","last_change":"2024-09-15T22:42:12.903155+0000","last_active":"2024-09-15T22:42:14.929585+0000","last_peered":"2024-09-15T22:42:14.929585+0000","last_clean":"2024-09-15T22:42:14.929585+0000","last_became_active":"2024-09-15T22:42:12.902884+0000","last_became_peered":"2024-09-15T22:42:12.902884+0000","last_unstale":"2024-09-15T22:42:14.929585+0000","last_undegraded":"2024-09-15T22:42:14.929585+0000","last_fullsized":"2024-09-15T22:42:14.929585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929018+0000","last_change":"2024-09-15T22:42:12.899223+0000","last_active":"2024-09-15T22:42:14.929018+0000","last_peered":"2024-09-15T22:42:14.929018+0000","last_clean":"2024-09-15T22:42:14.929018+0000","last_became_active":"2024-09-15T22:42:12.898961+0000","last_became_peered":"2024-09-15T22:42:12.898961+0000","last_unstale":"2024-09-15T22:42:14.929018+0000","last_undegraded":"2024-09-15T22:42:14.929018+0000","last_fullsized":"2024-09-15T22:42:14.929018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:37.614554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784395+0000","last_change":"2024-09-15T22:42:12.887390+0000","last_active":"2024-09-15T22:42:14.784395+0000","last_peered":"2024-09-15T22:42:14.784395+0000","last_clean":"2024-09-15T22:42:14.784395+0000","last_became_active":"2024-09-15T22:42:12.887134+0000","last_became_peered":"2024-09-15T22:42:12.887134+0000","last_unstale":"2024-09-15T22:42:14.784395+0000","last_undegraded":"2024-09-15T22:42:14.784395+0000","last_fullsized":"2024-09-15T22:42:14.784395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:27.268727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881849+0000","last_change":"2024-09-15T22:42:12.889999+0000","last_active":"2024-09-15T22:42:14.881849+0000","last_peered":"2024-09-15T22:42:14.881849+0000","last_clean":"2024-09-15T22:42:14.881849+0000","last_became_active":"2024-09-15T22:42:12.889722+0000","last_became_peered":"2024-09-15T22:42:12.889722+0000","last_unstale":"2024-09-15T22:42:14.881849+0000","last_undegraded":"2024-09-15T22:42:14.881849+0000","last_fullsized":"2024-09-15T22:42:14.881849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:39.080509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881686+0000","last_change":"2024-09-15T22:42:12.887927+0000","last_active":"2024-09-15T22:42:14.881686+0000","last_peered":"2024-09-15T22:42:14.881686+0000","last_clean":"2024-09-15T22:42:14.881686+0000","last_became_active":"2024-09-15T22:42:12.887354+0000","last_became_peered":"2024-09-15T22:42:12.887354+0000","last_unstale":"2024-09-15T22:42:14.881686+0000","last_undegraded":"2024-09-15T22:42:14.881686+0000","last_fullsized":"2024-09-15T22:42:14.881686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:12.251665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879322+0000","last_change":"2024-09-15T22:42:12.895866+0000","last_active":"2024-09-15T22:42:13.879322+0000","last_peered":"2024-09-15T22:42:13.879322+0000","last_clean":"2024-09-15T22:42:13.879322+0000","last_became_active":"2024-09-15T22:42:12.895588+0000","last_became_peered":"2024-09-15T22:42:12.895588+0000","last_unstale":"2024-09-15T22:42:13.879322+0000","last_undegraded":"2024-09-15T22:42:13.879322+0000","last_fullsized":"2024-09-15T22:42:13.879322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:26.004143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929305+0000","last_change":"2024-09-15T22:42:12.895626+0000","last_active":"2024-09-15T22:42:14.929305+0000","last_peered":"2024-09-15T22:42:14.929305+0000","last_clean":"2024-09-15T22:42:14.929305+0000","last_became_active":"2024-09-15T22:42:12.895315+0000","last_became_peered":"2024-09-15T22:42:12.895315+0000","last_unstale":"2024-09-15T22:42:14.929305+0000","last_undegraded":"2024-09-15T22:42:14.929305+0000","last_fullsized":"2024-09-15T22:42:14.929305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:26.793605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929523+0000","last_change":"2024-09-15T22:42:12.899337+0000","last_active":"2024-09-15T22:42:14.929523+0000","last_peered":"2024-09-15T22:42:14.929523+0000","last_clean":"2024-09-15T22:42:14.929523+0000","last_became_active":"2024-09-15T22:42:12.899068+0000","last_became_peered":"2024-09-15T22:42:12.899068+0000","last_unstale":"2024-09-15T22:42:14.929523+0000","last_undegraded":"2024-09-15T22:42:14.929523+0000","last_fullsized":"2024-09-15T22:42:14.929523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877932+0000","last_change":"2024-09-15T22:42:12.890470+0000","last_active":"2024-09-15T22:42:13.877932+0000","last_peered":"2024-09-15T22:42:13.877932+0000","last_clean":"2024-09-15T22:42:13.877932+0000","last_became_active":"2024-09-15T22:42:12.889280+0000","last_became_peered":"2024-09-15T22:42:12.889280+0000","last_unstale":"2024-09-15T22:42:13.877932+0000","last_undegraded":"2024-09-15T22:42:13.877932+0000","last_fullsized":"2024-09-15T22:42:13.877932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.734305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929159+0000","last_change":"2024-09-15T22:42:12.896339+0000","last_active":"2024-09-15T22:42:14.929159+0000","last_peered":"2024-09-15T22:42:14.929159+0000","last_clean":"2024-09-15T22:42:14.929159+0000","last_became_active":"2024-09-15T22:42:12.896103+0000","last_became_peered":"2024-09-15T22:42:12.896103+0000","last_unstale":"2024-09-15T22:42:14.929159+0000","last_undegraded":"2024-09-15T22:42:14.929159+0000","last_fullsized":"2024-09-15T22:42:14.929159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:37.614554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879230+0000","last_change":"2024-09-15T22:42:12.890123+0000","last_active":"2024-09-15T22:42:13.879230+0000","last_peered":"2024-09-15T22:42:13.879230+0000","last_clean":"2024-09-15T22:42:13.879230+0000","last_became_active":"2024-09-15T22:42:12.888844+0000","last_became_peered":"2024-09-15T22:42:12.888844+0000","last_unstale":"2024-09-15T22:42:13.879230+0000","last_undegraded":"2024-09-15T22:42:13.879230+0000","last_fullsized":"2024-09-15T22:42:13.879230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:12.290039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879383+0000","last_change":"2024-09-15T22:42:12.891556+0000","last_active":"2024-09-15T22:42:13.879383+0000","last_peered":"2024-09-15T22:42:13.879383+0000","last_clean":"2024-09-15T22:42:13.879383+0000","last_became_active":"2024-09-15T22:42:12.890755+0000","last_became_peered":"2024-09-15T22:42:12.890755+0000","last_unstale":"2024-09-15T22:42:13.879383+0000","last_undegraded":"2024-09-15T22:42:13.879383+0000","last_fullsized":"2024-09-15T22:42:13.879383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:40.296166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879300+0000","last_change":"2024-09-15T22:42:12.899577+0000","last_active":"2024-09-15T22:42:14.879300+0000","last_peered":"2024-09-15T22:42:14.879300+0000","last_clean":"2024-09-15T22:42:14.879300+0000","last_became_active":"2024-09-15T22:42:12.899316+0000","last_became_peered":"2024-09-15T22:42:12.899316+0000","last_unstale":"2024-09-15T22:42:14.879300+0000","last_undegraded":"2024-09-15T22:42:14.879300+0000","last_fullsized":"2024-09-15T22:42:14.879300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929625+0000","last_change":"2024-09-15T22:42:12.902191+0000","last_active":"2024-09-15T22:42:14.929625+0000","last_peered":"2024-09-15T22:42:14.929625+0000","last_clean":"2024-09-15T22:42:14.929625+0000","last_became_active":"2024-09-15T22:42:12.901926+0000","last_became_peered":"2024-09-15T22:42:12.901926+0000","last_unstale":"2024-09-15T22:42:14.929625+0000","last_undegraded":"2024-09-15T22:42:14.929625+0000","last_fullsized":"2024-09-15T22:42:14.929625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929443+0000","last_change":"2024-09-15T22:42:12.893318+0000","last_active":"2024-09-15T22:42:14.929443+0000","last_peered":"2024-09-15T22:42:14.929443+0000","last_clean":"2024-09-15T22:42:14.929443+0000","last_became_active":"2024-09-15T22:42:12.893055+0000","last_became_peered":"2024-09-15T22:42:12.893055+0000","last_unstale":"2024-09-15T22:42:14.929443+0000","last_undegraded":"2024-09-15T22:42:14.929443+0000","last_fullsized":"2024-09-15T22:42:14.929443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929664+0000","last_change":"2024-09-15T22:42:12.899557+0000","last_active":"2024-09-15T22:42:14.929664+0000","last_peered":"2024-09-15T22:42:14.929664+0000","last_clean":"2024-09-15T22:42:14.929664+0000","last_became_active":"2024-09-15T22:42:12.899286+0000","last_became_peered":"2024-09-15T22:42:12.899286+0000","last_unstale":"2024-09-15T22:42:14.929664+0000","last_undegraded":"2024-09-15T22:42:14.929664+0000","last_fullsized":"2024-09-15T22:42:14.929664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929347+0000","last_change":"2024-09-15T22:42:12.898046+0000","last_active":"2024-09-15T22:42:14.929347+0000","last_peered":"2024-09-15T22:42:14.929347+0000","last_clean":"2024-09-15T22:42:14.929347+0000","last_became_active":"2024-09-15T22:42:12.897679+0000","last_became_peered":"2024-09-15T22:42:12.897679+0000","last_unstale":"2024-09-15T22:42:14.929347+0000","last_undegraded":"2024-09-15T22:42:14.929347+0000","last_fullsized":"2024-09-15T22:42:14.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784126+0000","last_change":"2024-09-15T22:42:12.897375+0000","last_active":"2024-09-15T22:42:14.784126+0000","last_peered":"2024-09-15T22:42:14.784126+0000","last_clean":"2024-09-15T22:42:14.784126+0000","last_became_active":"2024-09-15T22:42:12.896933+0000","last_became_peered":"2024-09-15T22:42:12.896933+0000","last_unstale":"2024-09-15T22:42:14.784126+0000","last_undegraded":"2024-09-15T22:42:14.784126+0000","last_fullsized":"2024-09-15T22:42:14.784126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:12.277078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879478+0000","last_change":"2024-09-15T22:42:12.891613+0000","last_active":"2024-09-15T22:42:13.879478+0000","last_peered":"2024-09-15T22:42:13.879478+0000","last_clean":"2024-09-15T22:42:13.879478+0000","last_became_active":"2024-09-15T22:42:12.891023+0000","last_became_peered":"2024-09-15T22:42:12.891023+0000","last_unstale":"2024-09-15T22:42:13.879478+0000","last_undegraded":"2024-09-15T22:42:13.879478+0000","last_fullsized":"2024-09-15T22:42:13.879478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:08.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784459+0000","last_change":"2024-09-15T22:42:11.893091+0000","last_active":"2024-09-15T22:42:14.784459+0000","last_peered":"2024-09-15T22:42:14.784459+0000","last_clean":"2024-09-15T22:42:14.784459+0000","last_became_active":"2024-09-15T22:42:11.892689+0000","last_became_peered":"2024-09-15T22:42:11.892689+0000","last_unstale":"2024-09-15T22:42:14.784459+0000","last_undegraded":"2024-09-15T22:42:14.784459+0000","last_fullsized":"2024-09-15T22:42:14.784459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:49.016386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929509+0000","last_change":"2024-09-15T22:42:12.894192+0000","last_active":"2024-09-15T22:42:14.929509+0000","last_peered":"2024-09-15T22:42:14.929509+0000","last_clean":"2024-09-15T22:42:14.929509+0000","last_became_active":"2024-09-15T22:42:12.893894+0000","last_became_peered":"2024-09-15T22:42:12.893894+0000","last_unstale":"2024-09-15T22:42:14.929509+0000","last_undegraded":"2024-09-15T22:42:14.929509+0000","last_fullsized":"2024-09-15T22:42:14.929509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879008+0000","last_change":"2024-09-15T22:42:11.884187+0000","last_active":"2024-09-15T22:42:13.879008+0000","last_peered":"2024-09-15T22:42:13.879008+0000","last_clean":"2024-09-15T22:42:13.879008+0000","last_became_active":"2024-09-15T22:42:11.883776+0000","last_became_peered":"2024-09-15T22:42:11.883776+0000","last_unstale":"2024-09-15T22:42:13.879008+0000","last_undegraded":"2024-09-15T22:42:13.879008+0000","last_fullsized":"2024-09-15T22:42:13.879008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:20.657317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929760+0000","last_change":"2024-09-15T22:42:12.899434+0000","last_active":"2024-09-15T22:42:14.929760+0000","last_peered":"2024-09-15T22:42:14.929760+0000","last_clean":"2024-09-15T22:42:14.929760+0000","last_became_active":"2024-09-15T22:42:12.899175+0000","last_became_peered":"2024-09-15T22:42:12.899175+0000","last_unstale":"2024-09-15T22:42:14.929760+0000","last_undegraded":"2024-09-15T22:42:14.929760+0000","last_fullsized":"2024-09-15T22:42:14.929760+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:45.253998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881773+0000","last_change":"2024-09-15T22:42:11.893283+0000","last_active":"2024-09-15T22:42:14.881773+0000","last_peered":"2024-09-15T22:42:14.881773+0000","last_clean":"2024-09-15T22:42:14.881773+0000","last_became_active":"2024-09-15T22:42:11.892966+0000","last_became_peered":"2024-09-15T22:42:11.892966+0000","last_unstale":"2024-09-15T22:42:14.881773+0000","last_undegraded":"2024-09-15T22:42:14.881773+0000","last_fullsized":"2024-09-15T22:42:14.881773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:32.204342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878480+0000","last_change":"2024-09-15T22:42:12.891076+0000","last_active":"2024-09-15T22:42:13.878480+0000","last_peered":"2024-09-15T22:42:13.878480+0000","last_clean":"2024-09-15T22:42:13.878480+0000","last_became_active":"2024-09-15T22:42:12.890760+0000","last_became_peered":"2024-09-15T22:42:12.890760+0000","last_unstale":"2024-09-15T22:42:13.878480+0000","last_undegraded":"2024-09-15T22:42:13.878480+0000","last_fullsized":"2024-09-15T22:42:13.878480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879512+0000","last_change":"2024-09-15T22:42:11.880833+0000","last_active":"2024-09-15T22:42:13.879512+0000","last_peered":"2024-09-15T22:42:13.879512+0000","last_clean":"2024-09-15T22:42:13.879512+0000","last_became_active":"2024-09-15T22:42:11.880538+0000","last_became_peered":"2024-09-15T22:42:11.880538+0000","last_unstale":"2024-09-15T22:42:13.879512+0000","last_undegraded":"2024-09-15T22:42:13.879512+0000","last_fullsized":"2024-09-15T22:42:13.879512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:25.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879312+0000","last_change":"2024-09-15T22:42:12.893318+0000","last_active":"2024-09-15T22:42:13.879312+0000","last_peered":"2024-09-15T22:42:13.879312+0000","last_clean":"2024-09-15T22:42:13.879312+0000","last_became_active":"2024-09-15T22:42:12.892221+0000","last_became_peered":"2024-09-15T22:42:12.892221+0000","last_unstale":"2024-09-15T22:42:13.879312+0000","last_undegraded":"2024-09-15T22:42:13.879312+0000","last_fullsized":"2024-09-15T22:42:13.879312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929564+0000","last_change":"2024-09-15T22:42:11.892849+0000","last_active":"2024-09-15T22:42:14.929564+0000","last_peered":"2024-09-15T22:42:14.929564+0000","last_clean":"2024-09-15T22:42:14.929564+0000","last_became_active":"2024-09-15T22:42:11.892584+0000","last_became_peered":"2024-09-15T22:42:11.892584+0000","last_unstale":"2024-09-15T22:42:14.929564+0000","last_undegraded":"2024-09-15T22:42:14.929564+0000","last_fullsized":"2024-09-15T22:42:14.929564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.698652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929168+0000","last_change":"2024-09-15T22:42:12.893429+0000","last_active":"2024-09-15T22:42:14.929168+0000","last_peered":"2024-09-15T22:42:14.929168+0000","last_clean":"2024-09-15T22:42:14.929168+0000","last_became_active":"2024-09-15T22:42:12.893135+0000","last_became_peered":"2024-09-15T22:42:12.893135+0000","last_unstale":"2024-09-15T22:42:14.929168+0000","last_undegraded":"2024-09-15T22:42:14.929168+0000","last_fullsized":"2024-09-15T22:42:14.929168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:26.793605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929600+0000","last_change":"2024-09-15T22:42:11.888414+0000","last_active":"2024-09-15T22:42:14.929600+0000","last_peered":"2024-09-15T22:42:14.929600+0000","last_clean":"2024-09-15T22:42:14.929600+0000","last_became_active":"2024-09-15T22:42:11.887779+0000","last_became_peered":"2024-09-15T22:42:11.887779+0000","last_unstale":"2024-09-15T22:42:14.929600+0000","last_undegraded":"2024-09-15T22:42:14.929600+0000","last_fullsized":"2024-09-15T22:42:14.929600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:38.865982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879385+0000","last_change":"2024-09-15T22:42:12.902838+0000","last_active":"2024-09-15T22:42:13.879385+0000","last_peered":"2024-09-15T22:42:13.879385+0000","last_clean":"2024-09-15T22:42:13.879385+0000","last_became_active":"2024-09-15T22:42:12.902562+0000","last_became_peered":"2024-09-15T22:42:12.902562+0000","last_unstale":"2024-09-15T22:42:13.879385+0000","last_undegraded":"2024-09-15T22:42:13.879385+0000","last_fullsized":"2024-09-15T22:42:13.879385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:10.465162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881452+0000","last_change":"2024-09-15T22:42:11.888504+0000","last_active":"2024-09-15T22:42:14.881452+0000","last_peered":"2024-09-15T22:42:14.881452+0000","last_clean":"2024-09-15T22:42:14.881452+0000","last_became_active":"2024-09-15T22:42:11.888230+0000","last_became_peered":"2024-09-15T22:42:11.888230+0000","last_unstale":"2024-09-15T22:42:14.881452+0000","last_undegraded":"2024-09-15T22:42:14.881452+0000","last_fullsized":"2024-09-15T22:42:14.881452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:46.854697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878582+0000","last_change":"2024-09-15T22:42:12.889649+0000","last_active":"2024-09-15T22:42:13.878582+0000","last_peered":"2024-09-15T22:42:13.878582+0000","last_clean":"2024-09-15T22:42:13.878582+0000","last_became_active":"2024-09-15T22:42:12.889330+0000","last_became_peered":"2024-09-15T22:42:12.889330+0000","last_unstale":"2024-09-15T22:42:13.878582+0000","last_undegraded":"2024-09-15T22:42:13.878582+0000","last_fullsized":"2024-09-15T22:42:13.878582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929486+0000","last_change":"2024-09-15T22:42:11.892002+0000","last_active":"2024-09-15T22:42:14.929486+0000","last_peered":"2024-09-15T22:42:14.929486+0000","last_clean":"2024-09-15T22:42:14.929486+0000","last_became_active":"2024-09-15T22:42:11.891750+0000","last_became_peered":"2024-09-15T22:42:11.891750+0000","last_unstale":"2024-09-15T22:42:14.929486+0000","last_undegraded":"2024-09-15T22:42:14.929486+0000","last_fullsized":"2024-09-15T22:42:14.929486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:36.894242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784462+0000","last_change":"2024-09-15T22:42:12.888882+0000","last_active":"2024-09-15T22:42:14.784462+0000","last_peered":"2024-09-15T22:42:14.784462+0000","last_clean":"2024-09-15T22:42:14.784462+0000","last_became_active":"2024-09-15T22:42:12.888623+0000","last_became_peered":"2024-09-15T22:42:12.888623+0000","last_unstale":"2024-09-15T22:42:14.784462+0000","last_undegraded":"2024-09-15T22:42:14.784462+0000","last_fullsized":"2024-09-15T22:42:14.784462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:05.952973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879409+0000","last_change":"2024-09-15T22:42:11.894379+0000","last_active":"2024-09-15T22:42:14.879409+0000","last_peered":"2024-09-15T22:42:14.879409+0000","last_clean":"2024-09-15T22:42:14.879409+0000","last_became_active":"2024-09-15T22:42:11.894110+0000","last_became_peered":"2024-09-15T22:42:11.894110+0000","last_unstale":"2024-09-15T22:42:14.879409+0000","last_undegraded":"2024-09-15T22:42:14.879409+0000","last_fullsized":"2024-09-15T22:42:14.879409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.122467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879271+0000","last_change":"2024-09-15T22:42:12.893303+0000","last_active":"2024-09-15T22:42:13.879271+0000","last_peered":"2024-09-15T22:42:13.879271+0000","last_clean":"2024-09-15T22:42:13.879271+0000","last_became_active":"2024-09-15T22:42:12.893026+0000","last_became_peered":"2024-09-15T22:42:12.893026+0000","last_unstale":"2024-09-15T22:42:13.879271+0000","last_undegraded":"2024-09-15T22:42:13.879271+0000","last_fullsized":"2024-09-15T22:42:13.879271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:07.989066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879292+0000","last_change":"2024-09-15T22:42:11.891138+0000","last_active":"2024-09-15T22:42:14.879292+0000","last_peered":"2024-09-15T22:42:14.879292+0000","last_clean":"2024-09-15T22:42:14.879292+0000","last_became_active":"2024-09-15T22:42:11.890777+0000","last_became_peered":"2024-09-15T22:42:11.890777+0000","last_unstale":"2024-09-15T22:42:14.879292+0000","last_undegraded":"2024-09-15T22:42:14.879292+0000","last_fullsized":"2024-09-15T22:42:14.879292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:10.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879407+0000","last_change":"2024-09-15T22:42:12.892345+0000","last_active":"2024-09-15T22:42:13.879407+0000","last_peered":"2024-09-15T22:42:13.879407+0000","last_clean":"2024-09-15T22:42:13.879407+0000","last_became_active":"2024-09-15T22:42:12.892074+0000","last_became_peered":"2024-09-15T22:42:12.892074+0000","last_unstale":"2024-09-15T22:42:13.879407+0000","last_undegraded":"2024-09-15T22:42:13.879407+0000","last_fullsized":"2024-09-15T22:42:13.879407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784207+0000","last_change":"2024-09-15T22:42:11.889165+0000","last_active":"2024-09-15T22:42:14.784207+0000","last_peered":"2024-09-15T22:42:14.784207+0000","last_clean":"2024-09-15T22:42:14.784207+0000","last_became_active":"2024-09-15T22:42:11.888868+0000","last_became_peered":"2024-09-15T22:42:11.888868+0000","last_unstale":"2024-09-15T22:42:14.784207+0000","last_undegraded":"2024-09-15T22:42:14.784207+0000","last_fullsized":"2024-09-15T22:42:14.784207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.315288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784238+0000","last_change":"2024-09-15T22:42:12.891097+0000","last_active":"2024-09-15T22:42:14.784238+0000","last_peered":"2024-09-15T22:42:14.784238+0000","last_clean":"2024-09-15T22:42:14.784238+0000","last_became_active":"2024-09-15T22:42:12.890839+0000","last_became_peered":"2024-09-15T22:42:12.890839+0000","last_unstale":"2024-09-15T22:42:14.784238+0000","last_undegraded":"2024-09-15T22:42:14.784238+0000","last_fullsized":"2024-09-15T22:42:14.784238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:01.500931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879334+0000","last_change":"2024-09-15T22:42:11.882504+0000","last_active":"2024-09-15T22:42:13.879334+0000","last_peered":"2024-09-15T22:42:13.879334+0000","last_clean":"2024-09-15T22:42:13.879334+0000","last_became_active":"2024-09-15T22:42:11.881991+0000","last_became_peered":"2024-09-15T22:42:11.881991+0000","last_unstale":"2024-09-15T22:42:13.879334+0000","last_undegraded":"2024-09-15T22:42:13.879334+0000","last_fullsized":"2024-09-15T22:42:13.879334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878186+0000","last_change":"2024-09-15T22:42:12.890997+0000","last_active":"2024-09-15T22:42:13.878186+0000","last_peered":"2024-09-15T22:42:13.878186+0000","last_clean":"2024-09-15T22:42:13.878186+0000","last_became_active":"2024-09-15T22:42:12.890727+0000","last_became_peered":"2024-09-15T22:42:12.890727+0000","last_unstale":"2024-09-15T22:42:13.878186+0000","last_undegraded":"2024-09-15T22:42:13.878186+0000","last_fullsized":"2024-09-15T22:42:13.878186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:26.495173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929288+0000","last_change":"2024-09-15T22:42:11.891839+0000","last_active":"2024-09-15T22:42:14.929288+0000","last_peered":"2024-09-15T22:42:14.929288+0000","last_clean":"2024-09-15T22:42:14.929288+0000","last_became_active":"2024-09-15T22:42:11.891587+0000","last_became_peered":"2024-09-15T22:42:11.891587+0000","last_unstale":"2024-09-15T22:42:14.929288+0000","last_undegraded":"2024-09-15T22:42:14.929288+0000","last_fullsized":"2024-09-15T22:42:14.929288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:54.189602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878427+0000","last_change":"2024-09-15T22:42:12.893296+0000","last_active":"2024-09-15T22:42:13.878427+0000","last_peered":"2024-09-15T22:42:13.878427+0000","last_clean":"2024-09-15T22:42:13.878427+0000","last_became_active":"2024-09-15T22:42:12.891959+0000","last_became_peered":"2024-09-15T22:42:12.891959+0000","last_unstale":"2024-09-15T22:42:13.878427+0000","last_undegraded":"2024-09-15T22:42:13.878427+0000","last_fullsized":"2024-09-15T22:42:13.878427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879441+0000","last_change":"2024-09-15T22:42:11.888988+0000","last_active":"2024-09-15T22:42:13.879441+0000","last_peered":"2024-09-15T22:42:13.879441+0000","last_clean":"2024-09-15T22:42:13.879441+0000","last_became_active":"2024-09-15T22:42:11.888567+0000","last_became_peered":"2024-09-15T22:42:11.888567+0000","last_unstale":"2024-09-15T22:42:13.879441+0000","last_undegraded":"2024-09-15T22:42:13.879441+0000","last_fullsized":"2024-09-15T22:42:13.879441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:54.189602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929308+0000","last_change":"2024-09-15T22:42:12.891344+0000","last_active":"2024-09-15T22:42:14.929308+0000","last_peered":"2024-09-15T22:42:14.929308+0000","last_clean":"2024-09-15T22:42:14.929308+0000","last_became_active":"2024-09-15T22:42:12.890749+0000","last_became_peered":"2024-09-15T22:42:12.890749+0000","last_unstale":"2024-09-15T22:42:14.929308+0000","last_undegraded":"2024-09-15T22:42:14.929308+0000","last_fullsized":"2024-09-15T22:42:14.929308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878033+0000","last_change":"2024-09-15T22:42:11.888004+0000","last_active":"2024-09-15T22:42:13.878033+0000","last_peered":"2024-09-15T22:42:13.878033+0000","last_clean":"2024-09-15T22:42:13.878033+0000","last_became_active":"2024-09-15T22:42:11.887395+0000","last_became_peered":"2024-09-15T22:42:11.887395+0000","last_unstale":"2024-09-15T22:42:13.878033+0000","last_undegraded":"2024-09-15T22:42:13.878033+0000","last_fullsized":"2024-09-15T22:42:13.878033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:36.894242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784282+0000","last_change":"2024-09-15T22:42:12.888194+0000","last_active":"2024-09-15T22:42:14.784282+0000","last_peered":"2024-09-15T22:42:14.784282+0000","last_clean":"2024-09-15T22:42:14.784282+0000","last_became_active":"2024-09-15T22:42:12.887904+0000","last_became_peered":"2024-09-15T22:42:12.887904+0000","last_unstale":"2024-09-15T22:42:14.784282+0000","last_undegraded":"2024-09-15T22:42:14.784282+0000","last_fullsized":"2024-09-15T22:42:14.784282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:28.960857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881323+0000","last_change":"2024-09-15T22:42:11.890327+0000","last_active":"2024-09-15T22:42:14.881323+0000","last_peered":"2024-09-15T22:42:14.881323+0000","last_clean":"2024-09-15T22:42:14.881323+0000","last_became_active":"2024-09-15T22:42:11.889853+0000","last_became_peered":"2024-09-15T22:42:11.889853+0000","last_unstale":"2024-09-15T22:42:14.881323+0000","last_undegraded":"2024-09-15T22:42:14.881323+0000","last_fullsized":"2024-09-15T22:42:14.881323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:34.930390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784539+0000","last_change":"2024-09-15T22:42:12.883805+0000","last_active":"2024-09-15T22:42:14.784539+0000","last_peered":"2024-09-15T22:42:14.784539+0000","last_clean":"2024-09-15T22:42:14.784539+0000","last_became_active":"2024-09-15T22:42:12.883510+0000","last_became_peered":"2024-09-15T22:42:12.883510+0000","last_unstale":"2024-09-15T22:42:14.784539+0000","last_undegraded":"2024-09-15T22:42:14.784539+0000","last_fullsized":"2024-09-15T22:42:14.784539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:26.927237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881732+0000","last_change":"2024-09-15T22:42:11.890938+0000","last_active":"2024-09-15T22:42:14.881732+0000","last_peered":"2024-09-15T22:42:14.881732+0000","last_clean":"2024-09-15T22:42:14.881732+0000","last_became_active":"2024-09-15T22:42:11.890598+0000","last_became_peered":"2024-09-15T22:42:11.890598+0000","last_unstale":"2024-09-15T22:42:14.881732+0000","last_undegraded":"2024-09-15T22:42:14.881732+0000","last_fullsized":"2024-09-15T22:42:14.881732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:21.821850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879402+0000","last_change":"2024-09-15T22:42:12.894308+0000","last_active":"2024-09-15T22:42:13.879402+0000","last_peered":"2024-09-15T22:42:13.879402+0000","last_clean":"2024-09-15T22:42:13.879402+0000","last_became_active":"2024-09-15T22:42:12.894049+0000","last_became_peered":"2024-09-15T22:42:12.894049+0000","last_unstale":"2024-09-15T22:42:13.879402+0000","last_undegraded":"2024-09-15T22:42:13.879402+0000","last_fullsized":"2024-09-15T22:42:13.879402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:07.221039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929371+0000","last_change":"2024-09-15T22:42:11.892516+0000","last_active":"2024-09-15T22:42:14.929371+0000","last_peered":"2024-09-15T22:42:14.929371+0000","last_clean":"2024-09-15T22:42:14.929371+0000","last_became_active":"2024-09-15T22:42:11.892221+0000","last_became_peered":"2024-09-15T22:42:11.892221+0000","last_unstale":"2024-09-15T22:42:14.929371+0000","last_undegraded":"2024-09-15T22:42:14.929371+0000","last_fullsized":"2024-09-15T22:42:14.929371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:44.635047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879243+0000","last_change":"2024-09-15T22:42:12.898710+0000","last_active":"2024-09-15T22:42:14.879243+0000","last_peered":"2024-09-15T22:42:14.879243+0000","last_clean":"2024-09-15T22:42:14.879243+0000","last_became_active":"2024-09-15T22:42:12.898372+0000","last_became_peered":"2024-09-15T22:42:12.898372+0000","last_unstale":"2024-09-15T22:42:14.879243+0000","last_undegraded":"2024-09-15T22:42:14.879243+0000","last_fullsized":"2024-09-15T22:42:14.879243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784344+0000","last_change":"2024-09-15T22:42:11.891892+0000","last_active":"2024-09-15T22:42:14.784344+0000","last_peered":"2024-09-15T22:42:14.784344+0000","last_clean":"2024-09-15T22:42:14.784344+0000","last_became_active":"2024-09-15T22:42:11.891592+0000","last_became_peered":"2024-09-15T22:42:11.891592+0000","last_unstale":"2024-09-15T22:42:14.784344+0000","last_undegraded":"2024-09-15T22:42:14.784344+0000","last_fullsized":"2024-09-15T22:42:14.784344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:47.569436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881696+0000","last_change":"2024-09-15T22:42:12.894806+0000","last_active":"2024-09-15T22:42:14.881696+0000","last_peered":"2024-09-15T22:42:14.881696+0000","last_clean":"2024-09-15T22:42:14.881696+0000","last_became_active":"2024-09-15T22:42:12.894508+0000","last_became_peered":"2024-09-15T22:42:12.894508+0000","last_unstale":"2024-09-15T22:42:14.881696+0000","last_undegraded":"2024-09-15T22:42:14.881696+0000","last_fullsized":"2024-09-15T22:42:14.881696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:39.873094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929777+0000","last_change":"2024-09-15T22:42:11.882053+0000","last_active":"2024-09-15T22:42:14.929777+0000","last_peered":"2024-09-15T22:42:14.929777+0000","last_clean":"2024-09-15T22:42:14.929777+0000","last_became_active":"2024-09-15T22:42:11.881784+0000","last_became_peered":"2024-09-15T22:42:11.881784+0000","last_unstale":"2024-09-15T22:42:14.929777+0000","last_undegraded":"2024-09-15T22:42:14.929777+0000","last_fullsized":"2024-09-15T22:42:14.929777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:47.851991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878102+0000","last_change":"2024-09-15T22:42:12.899753+0000","last_active":"2024-09-15T22:42:13.878102+0000","last_peered":"2024-09-15T22:42:13.878102+0000","last_clean":"2024-09-15T22:42:13.878102+0000","last_became_active":"2024-09-15T22:42:12.899475+0000","last_became_peered":"2024-09-15T22:42:12.899475+0000","last_unstale":"2024-09-15T22:42:13.878102+0000","last_undegraded":"2024-09-15T22:42:13.878102+0000","last_fullsized":"2024-09-15T22:42:13.878102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:35.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879283+0000","last_change":"2024-09-15T22:42:11.892840+0000","last_active":"2024-09-15T22:42:14.879283+0000","last_peered":"2024-09-15T22:42:14.879283+0000","last_clean":"2024-09-15T22:42:14.879283+0000","last_became_active":"2024-09-15T22:42:11.892493+0000","last_became_peered":"2024-09-15T22:42:11.892493+0000","last_unstale":"2024-09-15T22:42:14.879283+0000","last_undegraded":"2024-09-15T22:42:14.879283+0000","last_fullsized":"2024-09-15T22:42:14.879283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:55.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879319+0000","last_change":"2024-09-15T22:42:12.896684+0000","last_active":"2024-09-15T22:42:14.879319+0000","last_peered":"2024-09-15T22:42:14.879319+0000","last_clean":"2024-09-15T22:42:14.879319+0000","last_became_active":"2024-09-15T22:42:12.896344+0000","last_became_peered":"2024-09-15T22:42:12.896344+0000","last_unstale":"2024-09-15T22:42:14.879319+0000","last_undegraded":"2024-09-15T22:42:14.879319+0000","last_fullsized":"2024-09-15T22:42:14.879319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929685+0000","last_change":"2024-09-15T22:42:11.891344+0000","last_active":"2024-09-15T22:42:14.929685+0000","last_peered":"2024-09-15T22:42:14.929685+0000","last_clean":"2024-09-15T22:42:14.929685+0000","last_became_active":"2024-09-15T22:42:11.891022+0000","last_became_peered":"2024-09-15T22:42:11.891022+0000","last_unstale":"2024-09-15T22:42:14.929685+0000","last_undegraded":"2024-09-15T22:42:14.929685+0000","last_fullsized":"2024-09-15T22:42:14.929685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:38.073397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877785+0000","last_change":"2024-09-15T22:42:12.894563+0000","last_active":"2024-09-15T22:42:13.877785+0000","last_peered":"2024-09-15T22:42:13.877785+0000","last_clean":"2024-09-15T22:42:13.877785+0000","last_became_active":"2024-09-15T22:42:12.894216+0000","last_became_peered":"2024-09-15T22:42:12.894216+0000","last_unstale":"2024-09-15T22:42:13.877785+0000","last_undegraded":"2024-09-15T22:42:13.877785+0000","last_fullsized":"2024-09-15T22:42:13.877785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:59.153843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879121+0000","last_change":"2024-09-15T22:42:11.893644+0000","last_active":"2024-09-15T22:42:13.879121+0000","last_peered":"2024-09-15T22:42:13.879121+0000","last_clean":"2024-09-15T22:42:13.879121+0000","last_became_active":"2024-09-15T22:42:11.893294+0000","last_became_peered":"2024-09-15T22:42:11.893294+0000","last_unstale":"2024-09-15T22:42:13.879121+0000","last_undegraded":"2024-09-15T22:42:13.879121+0000","last_fullsized":"2024-09-15T22:42:13.879121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:31.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879340+0000","last_change":"2024-09-15T22:42:12.895042+0000","last_active":"2024-09-15T22:42:13.879340+0000","last_peered":"2024-09-15T22:42:13.879340+0000","last_clean":"2024-09-15T22:42:13.879340+0000","last_became_active":"2024-09-15T22:42:12.894758+0000","last_became_peered":"2024-09-15T22:42:12.894758+0000","last_unstale":"2024-09-15T22:42:13.879340+0000","last_undegraded":"2024-09-15T22:42:13.879340+0000","last_fullsized":"2024-09-15T22:42:13.879340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:07.097447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784071+0000","last_change":"2024-09-15T22:42:11.889318+0000","last_active":"2024-09-15T22:42:14.784071+0000","last_peered":"2024-09-15T22:42:14.784071+0000","last_clean":"2024-09-15T22:42:14.784071+0000","last_became_active":"2024-09-15T22:42:11.888871+0000","last_became_peered":"2024-09-15T22:42:11.888871+0000","last_unstale":"2024-09-15T22:42:14.784071+0000","last_undegraded":"2024-09-15T22:42:14.784071+0000","last_fullsized":"2024-09-15T22:42:14.784071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:25.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881875+0000","last_change":"2024-09-15T22:42:12.895781+0000","last_active":"2024-09-15T22:42:14.881875+0000","last_peered":"2024-09-15T22:42:14.881875+0000","last_clean":"2024-09-15T22:42:14.881875+0000","last_became_active":"2024-09-15T22:42:12.894789+0000","last_became_peered":"2024-09-15T22:42:12.894789+0000","last_unstale":"2024-09-15T22:42:14.881875+0000","last_undegraded":"2024-09-15T22:42:14.881875+0000","last_fullsized":"2024-09-15T22:42:14.881875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:55.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879224+0000","last_change":"2024-09-15T22:42:11.886225+0000","last_active":"2024-09-15T22:42:13.879224+0000","last_peered":"2024-09-15T22:42:13.879224+0000","last_clean":"2024-09-15T22:42:13.879224+0000","last_became_active":"2024-09-15T22:42:11.885851+0000","last_became_peered":"2024-09-15T22:42:11.885851+0000","last_unstale":"2024-09-15T22:42:13.879224+0000","last_undegraded":"2024-09-15T22:42:13.879224+0000","last_fullsized":"2024-09-15T22:42:13.879224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:43.788609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784469+0000","last_change":"2024-09-15T22:42:12.886779+0000","last_active":"2024-09-15T22:42:14.784469+0000","last_peered":"2024-09-15T22:42:14.784469+0000","last_clean":"2024-09-15T22:42:14.784469+0000","last_became_active":"2024-09-15T22:42:12.886476+0000","last_became_peered":"2024-09-15T22:42:12.886476+0000","last_unstale":"2024-09-15T22:42:14.784469+0000","last_undegraded":"2024-09-15T22:42:14.784469+0000","last_fullsized":"2024-09-15T22:42:14.784469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:13.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879424+0000","last_change":"2024-09-15T22:42:11.893175+0000","last_active":"2024-09-15T22:42:14.879424+0000","last_peered":"2024-09-15T22:42:14.879424+0000","last_clean":"2024-09-15T22:42:14.879424+0000","last_became_active":"2024-09-15T22:42:11.892523+0000","last_became_peered":"2024-09-15T22:42:11.892523+0000","last_unstale":"2024-09-15T22:42:14.879424+0000","last_undegraded":"2024-09-15T22:42:14.879424+0000","last_fullsized":"2024-09-15T22:42:14.879424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:10.147343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881837+0000","last_change":"2024-09-15T22:42:12.892263+0000","last_active":"2024-09-15T22:42:14.881837+0000","last_peered":"2024-09-15T22:42:14.881837+0000","last_clean":"2024-09-15T22:42:14.881837+0000","last_became_active":"2024-09-15T22:42:12.891926+0000","last_became_peered":"2024-09-15T22:42:12.891926+0000","last_unstale":"2024-09-15T22:42:14.881837+0000","last_undegraded":"2024-09-15T22:42:14.881837+0000","last_fullsized":"2024-09-15T22:42:14.881837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:30.705765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879436+0000","last_change":"2024-09-15T22:42:11.887249+0000","last_active":"2024-09-15T22:42:13.879436+0000","last_peered":"2024-09-15T22:42:13.879436+0000","last_clean":"2024-09-15T22:42:13.879436+0000","last_became_active":"2024-09-15T22:42:11.886981+0000","last_became_peered":"2024-09-15T22:42:11.886981+0000","last_unstale":"2024-09-15T22:42:13.879436+0000","last_undegraded":"2024-09-15T22:42:13.879436+0000","last_fullsized":"2024-09-15T22:42:13.879436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:39.307694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929735+0000","last_change":"2024-09-15T22:42:12.898530+0000","last_active":"2024-09-15T22:42:14.929735+0000","last_peered":"2024-09-15T22:42:14.929735+0000","last_clean":"2024-09-15T22:42:14.929735+0000","last_became_active":"2024-09-15T22:42:12.898267+0000","last_became_peered":"2024-09-15T22:42:12.898267+0000","last_unstale":"2024-09-15T22:42:14.929735+0000","last_undegraded":"2024-09-15T22:42:14.929735+0000","last_fullsized":"2024-09-15T22:42:14.929735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878348+0000","last_change":"2024-09-15T22:42:11.888253+0000","last_active":"2024-09-15T22:42:13.878348+0000","last_peered":"2024-09-15T22:42:13.878348+0000","last_clean":"2024-09-15T22:42:13.878348+0000","last_became_active":"2024-09-15T22:42:11.887964+0000","last_became_peered":"2024-09-15T22:42:11.887964+0000","last_unstale":"2024-09-15T22:42:13.878348+0000","last_undegraded":"2024-09-15T22:42:13.878348+0000","last_fullsized":"2024-09-15T22:42:13.878348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:24.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878594+0000","last_change":"2024-09-15T22:42:12.891519+0000","last_active":"2024-09-15T22:42:13.878594+0000","last_peered":"2024-09-15T22:42:13.878594+0000","last_clean":"2024-09-15T22:42:13.878594+0000","last_became_active":"2024-09-15T22:42:12.891237+0000","last_became_peered":"2024-09-15T22:42:12.891237+0000","last_unstale":"2024-09-15T22:42:13.878594+0000","last_undegraded":"2024-09-15T22:42:13.878594+0000","last_fullsized":"2024-09-15T22:42:13.878594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878284+0000","last_change":"2024-09-15T22:42:11.889475+0000","last_active":"2024-09-15T22:42:13.878284+0000","last_peered":"2024-09-15T22:42:13.878284+0000","last_clean":"2024-09-15T22:42:13.878284+0000","last_became_active":"2024-09-15T22:42:11.889160+0000","last_became_peered":"2024-09-15T22:42:11.889160+0000","last_unstale":"2024-09-15T22:42:13.878284+0000","last_undegraded":"2024-09-15T22:42:13.878284+0000","last_fullsized":"2024-09-15T22:42:13.878284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:05.509527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878712+0000","last_change":"2024-09-15T22:42:12.893205+0000","last_active":"2024-09-15T22:42:13.878712+0000","last_peered":"2024-09-15T22:42:13.878712+0000","last_clean":"2024-09-15T22:42:13.878712+0000","last_became_active":"2024-09-15T22:42:12.892852+0000","last_became_peered":"2024-09-15T22:42:12.892852+0000","last_unstale":"2024-09-15T22:42:13.878712+0000","last_undegraded":"2024-09-15T22:42:13.878712+0000","last_fullsized":"2024-09-15T22:42:13.878712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929436+0000","last_change":"2024-09-15T22:42:11.892830+0000","last_active":"2024-09-15T22:42:14.929436+0000","last_peered":"2024-09-15T22:42:14.929436+0000","last_clean":"2024-09-15T22:42:14.929436+0000","last_became_active":"2024-09-15T22:42:11.892432+0000","last_became_peered":"2024-09-15T22:42:11.892432+0000","last_unstale":"2024-09-15T22:42:14.929436+0000","last_undegraded":"2024-09-15T22:42:14.929436+0000","last_fullsized":"2024-09-15T22:42:14.929436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:11.244552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784237+0000","last_change":"2024-09-15T22:42:12.889123+0000","last_active":"2024-09-15T22:42:14.784237+0000","last_peered":"2024-09-15T22:42:14.784237+0000","last_clean":"2024-09-15T22:42:14.784237+0000","last_became_active":"2024-09-15T22:42:12.888817+0000","last_became_peered":"2024-09-15T22:42:12.888817+0000","last_unstale":"2024-09-15T22:42:14.784237+0000","last_undegraded":"2024-09-15T22:42:14.784237+0000","last_fullsized":"2024-09-15T22:42:14.784237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:13.916525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878744+0000","last_change":"2024-09-15T22:42:11.888059+0000","last_active":"2024-09-15T22:42:13.878744+0000","last_peered":"2024-09-15T22:42:13.878744+0000","last_clean":"2024-09-15T22:42:13.878744+0000","last_became_active":"2024-09-15T22:42:11.887740+0000","last_became_peered":"2024-09-15T22:42:11.887740+0000","last_unstale":"2024-09-15T22:42:13.878744+0000","last_undegraded":"2024-09-15T22:42:13.878744+0000","last_fullsized":"2024-09-15T22:42:13.878744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.698652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929834+0000","last_change":"2024-09-15T22:42:12.897019+0000","last_active":"2024-09-15T22:42:14.929834+0000","last_peered":"2024-09-15T22:42:14.929834+0000","last_clean":"2024-09-15T22:42:14.929834+0000","last_became_active":"2024-09-15T22:42:12.896756+0000","last_became_peered":"2024-09-15T22:42:12.896756+0000","last_unstale":"2024-09-15T22:42:14.929834+0000","last_undegraded":"2024-09-15T22:42:14.929834+0000","last_fullsized":"2024-09-15T22:42:14.929834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784471+0000","last_change":"2024-09-15T22:42:11.889610+0000","last_active":"2024-09-15T22:42:14.784471+0000","last_peered":"2024-09-15T22:42:14.784471+0000","last_clean":"2024-09-15T22:42:14.784471+0000","last_became_active":"2024-09-15T22:42:11.889114+0000","last_became_peered":"2024-09-15T22:42:11.889114+0000","last_unstale":"2024-09-15T22:42:14.784471+0000","last_undegraded":"2024-09-15T22:42:14.784471+0000","last_fullsized":"2024-09-15T22:42:14.784471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:47.130960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879086+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:13.879086+0000","last_peered":"2024-09-15T22:42:13.879086+0000","last_clean":"2024-09-15T22:42:13.879086+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:13.879086+0000","last_undegraded":"2024-09-15T22:42:13.879086+0000","last_fullsized":"2024-09-15T22:42:13.879086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":987136,"data_stored":740700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":151384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":150526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":740188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":145062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:20.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:20.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.310+0000 7f480d05e640 1 Processor -- start 2024-09-15T22:42:20.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.310+0000 7f480d05e640 1 -- start start 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480d05e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f480815c300 0x7f48080affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480d05e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48080cd300 0x7f480806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480d05e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480815ecf0 con 0x7f480806f010 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480d05e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f480815c6e0 con 0x7f480815c300 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480d05e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f480815efb0 con 0x7f48080cd300 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f4806d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f480815c300 0x7f48080affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480759e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f480806f010 0x7f48081622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49410/0 (socket says 172.21.15.134:49410) 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f4806d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f480815c300 0x7f48080affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51554/0 (socket says 172.21.15.134:51554) 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480759e640 1 -- 172.21.15.134:0/1768601822 learned_addr learned my addr 172.21.15.134:0/1768601822 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:20.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.311+0000 7f480659c640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48080cd300 0x7f480806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4806d9d640 1 -- 172.21.15.134:0/1768601822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48080cd300 msgr2=0x7f480806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:20.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4806d9d640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48080cd300 0x7f480806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4806d9d640 1 -- 172.21.15.134:0/1768601822 >> v1:172.21.15.134:6789/0 conn(0x7f480806f010 legacy=0x7f48081622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4806d9d640 1 -- 172.21.15.134:0/1768601822 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480815f290 con 0x7f480815c300 2024-09-15T22:42:20.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4805d9b640 1 -- 172.21.15.134:0/1768601822 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085483048 0 0) 0x7f480815ecf0 con 0x7f480806f010 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4806d9d640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f480815c300 0x7f48080affc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097a0 tx=0x7f47f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f8290b6ebd7661 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4805d9b640 1 -- 172.21.15.134:0/1768601822 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8037070 con 0x7f480815c300 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4805d9b640 1 -- 172.21.15.134:0/1768601822 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f802ae50 con 0x7f480815c300 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.312+0000 7f4805d9b640 1 -- 172.21.15.134:0/1768601822 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8032660 con 0x7f480815c300 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 -- 172.21.15.134:0/1768601822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f480815c300 msgr2=0x7f48080affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f480815c300 0x7f48080affc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097a0 tx=0x7f47f802a100 comp rx=0 tx=0).stop 2024-09-15T22:42:20.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 -- 172.21.15.134:0/1768601822 shutdown_connections 2024-09-15T22:42:20.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48080cd300 0x7f480806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 --2- 172.21.15.134:0/1768601822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f480815c300 0x7f48080affc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 -- 172.21.15.134:0/1768601822 >> 172.21.15.134:0/1768601822 conn(0x7f480806cae0 msgr2=0x7f480806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:20.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 -- 172.21.15.134:0/1768601822 shutdown_connections 2024-09-15T22:42:20.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.313+0000 7f480d05e640 1 -- 172.21.15.134:0/1768601822 wait complete. 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 Processor -- start 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 -- start start 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f480806f010 0x7f4808161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f480815c300 0x7f48081f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4808071880 con 0x7f48080cd300 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f480815f850 con 0x7f480806f010 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480d05e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f48080b0500 con 0x7f480815c300 2024-09-15T22:42:20.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.315+0000 7f480659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51566/0 (socket says 172.21.15.134:51566) 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 -- 172.21.15.134:0/457313030 learned_addr learned my addr 172.21.15.134:0/457313030 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f4806d9d640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f480806f010 0x7f4808161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480759e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f480815c300 0x7f48081f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 -- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f480815c300 msgr2=0x7f48081f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f480815c300 0x7f48081f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 -- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f480806f010 msgr2=0x7f4808161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f480806f010 0x7f4808161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 -- 172.21.15.134:0/457313030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48081f7a90 con 0x7f48080cd300 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480659c640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00e8b0 tx=0x7f47fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc017070 con 0x7f48080cd300 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47fc00c940 con 0x7f48080cd300 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48081f7d30 con 0x7f48080cd300 2024-09-15T22:42:20.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00cd10 con 0x7f48080cd300 2024-09-15T22:42:20.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.316+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48081f82f0 con 0x7f48080cd300 2024-09-15T22:42:20.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.317+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480806ead0 con 0x7f48080cd300 2024-09-15T22:42:20.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.318+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f47fc01a070 con 0x7f48080cd300 2024-09-15T22:42:20.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.318+0000 7f47ef7fe640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 0x7f47f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.318+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f47fc08b660 con 0x7f48080cd300 2024-09-15T22:42:20.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.318+0000 7f4806d9d640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 0x7f47f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.319+0000 7f4806d9d640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 0x7f47f406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47f8034000 tx=0x7f47f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.323+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47fc059810 con 0x7f48080cd300 2024-09-15T22:42:20.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.485+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4808162890 con 0x7f47f406c2b0 2024-09-15T22:42:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.491+0000 7f47ef7fe640 1 -- 172.21.15.134:0/457313030 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f4808162890 con 0x7f47f406c2b0 2024-09-15T22:42:20.495 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 msgr2=0x7f47f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 0x7f47f406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47f8034000 tx=0x7f47f802e000 comp rx=0 tx=0).stop 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 msgr2=0x7f48081f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00e8b0 tx=0x7f47fc00ed70 comp rx=0 tx=0).stop 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 shutdown_connections 2024-09-15T22:42:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f47f406c2b0 0x7f47f406e770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f480815c300 0x7f48081f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48080cd300 0x7f48081f7550 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 --2- 172.21.15.134:0/457313030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f480806f010 0x7f4808161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.494+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 >> 172.21.15.134:0/457313030 conn(0x7f480806cae0 msgr2=0x7f4808157680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.495+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 shutdown_connections 2024-09-15T22:42:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.495+0000 7f480d05e640 1 -- 172.21.15.134:0/457313030 wait complete. 2024-09-15T22:42:20.507 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-15T22:42:18.957851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220496,"kb_used_data":4252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754224,"statfs":{"total":773094113280,"available":772868325376,"internally_reserved":0,"allocated":4354048,"data_stored":2377256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.085623"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929490+0000","last_change":"2024-09-15T22:42:12.905988+0000","last_active":"2024-09-15T22:42:14.929490+0000","last_peered":"2024-09-15T22:42:14.929490+0000","last_clean":"2024-09-15T22:42:14.929490+0000","last_became_active":"2024-09-15T22:42:12.905676+0000","last_became_peered":"2024-09-15T22:42:12.905676+0000","last_unstale":"2024-09-15T22:42:14.929490+0000","last_undegraded":"2024-09-15T22:42:14.929490+0000","last_fullsized":"2024-09-15T22:42:14.929490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879349+0000","last_change":"2024-09-15T22:42:12.897747+0000","last_active":"2024-09-15T22:42:14.879349+0000","last_peered":"2024-09-15T22:42:14.879349+0000","last_clean":"2024-09-15T22:42:14.879349+0000","last_became_active":"2024-09-15T22:42:12.897511+0000","last_became_peered":"2024-09-15T22:42:12.897511+0000","last_unstale":"2024-09-15T22:42:14.879349+0000","last_undegraded":"2024-09-15T22:42:14.879349+0000","last_fullsized":"2024-09-15T22:42:14.879349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879459+0000","last_change":"2024-09-15T22:42:12.892903+0000","last_active":"2024-09-15T22:42:13.879459+0000","last_peered":"2024-09-15T22:42:13.879459+0000","last_clean":"2024-09-15T22:42:13.879459+0000","last_became_active":"2024-09-15T22:42:12.892560+0000","last_became_peered":"2024-09-15T22:42:12.892560+0000","last_unstale":"2024-09-15T22:42:13.879459+0000","last_undegraded":"2024-09-15T22:42:13.879459+0000","last_fullsized":"2024-09-15T22:42:13.879459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:12.251665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879143+0000","last_change":"2024-09-15T22:42:12.896954+0000","last_active":"2024-09-15T22:42:13.879143+0000","last_peered":"2024-09-15T22:42:13.879143+0000","last_clean":"2024-09-15T22:42:13.879143+0000","last_became_active":"2024-09-15T22:42:12.896692+0000","last_became_peered":"2024-09-15T22:42:12.896692+0000","last_unstale":"2024-09-15T22:42:13.879143+0000","last_undegraded":"2024-09-15T22:42:13.879143+0000","last_fullsized":"2024-09-15T22:42:13.879143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:45.253998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879199+0000","last_change":"2024-09-15T22:42:12.894327+0000","last_active":"2024-09-15T22:42:14.879199+0000","last_peered":"2024-09-15T22:42:14.879199+0000","last_clean":"2024-09-15T22:42:14.879199+0000","last_became_active":"2024-09-15T22:42:12.894012+0000","last_became_peered":"2024-09-15T22:42:12.894012+0000","last_unstale":"2024-09-15T22:42:14.879199+0000","last_undegraded":"2024-09-15T22:42:14.879199+0000","last_fullsized":"2024-09-15T22:42:14.879199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881580+0000","last_change":"2024-09-15T22:42:12.889057+0000","last_active":"2024-09-15T22:42:14.881580+0000","last_peered":"2024-09-15T22:42:14.881580+0000","last_clean":"2024-09-15T22:42:14.881580+0000","last_became_active":"2024-09-15T22:42:12.888747+0000","last_became_peered":"2024-09-15T22:42:12.888747+0000","last_unstale":"2024-09-15T22:42:14.881580+0000","last_undegraded":"2024-09-15T22:42:14.881580+0000","last_fullsized":"2024-09-15T22:42:14.881580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:45.642159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929110+0000","last_change":"2024-09-15T22:42:12.891980+0000","last_active":"2024-09-15T22:42:14.929110+0000","last_peered":"2024-09-15T22:42:14.929110+0000","last_clean":"2024-09-15T22:42:14.929110+0000","last_became_active":"2024-09-15T22:42:12.891654+0000","last_became_peered":"2024-09-15T22:42:12.891654+0000","last_unstale":"2024-09-15T22:42:14.929110+0000","last_undegraded":"2024-09-15T22:42:14.929110+0000","last_fullsized":"2024-09-15T22:42:14.929110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:16.327559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929002+0000","last_change":"2024-09-15T22:42:12.891062+0000","last_active":"2024-09-15T22:42:14.929002+0000","last_peered":"2024-09-15T22:42:14.929002+0000","last_clean":"2024-09-15T22:42:14.929002+0000","last_became_active":"2024-09-15T22:42:12.890455+0000","last_became_peered":"2024-09-15T22:42:12.890455+0000","last_unstale":"2024-09-15T22:42:14.929002+0000","last_undegraded":"2024-09-15T22:42:14.929002+0000","last_fullsized":"2024-09-15T22:42:14.929002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:02.723070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879420+0000","last_change":"2024-09-15T22:42:12.892821+0000","last_active":"2024-09-15T22:42:13.879420+0000","last_peered":"2024-09-15T22:42:13.879420+0000","last_clean":"2024-09-15T22:42:13.879420+0000","last_became_active":"2024-09-15T22:42:12.892534+0000","last_became_peered":"2024-09-15T22:42:12.892534+0000","last_unstale":"2024-09-15T22:42:13.879420+0000","last_undegraded":"2024-09-15T22:42:13.879420+0000","last_fullsized":"2024-09-15T22:42:13.879420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:45.642159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878950+0000","last_change":"2024-09-15T22:42:12.892139+0000","last_active":"2024-09-15T22:42:13.878950+0000","last_peered":"2024-09-15T22:42:13.878950+0000","last_clean":"2024-09-15T22:42:13.878950+0000","last_became_active":"2024-09-15T22:42:12.891143+0000","last_became_peered":"2024-09-15T22:42:12.891143+0000","last_unstale":"2024-09-15T22:42:13.878950+0000","last_undegraded":"2024-09-15T22:42:13.878950+0000","last_fullsized":"2024-09-15T22:42:13.878950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784394+0000","last_change":"2024-09-15T22:42:12.890873+0000","last_active":"2024-09-15T22:42:14.784394+0000","last_peered":"2024-09-15T22:42:14.784394+0000","last_clean":"2024-09-15T22:42:14.784394+0000","last_became_active":"2024-09-15T22:42:12.890612+0000","last_became_peered":"2024-09-15T22:42:12.890612+0000","last_unstale":"2024-09-15T22:42:14.784394+0000","last_undegraded":"2024-09-15T22:42:14.784394+0000","last_fullsized":"2024-09-15T22:42:14.784394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.841459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879442+0000","last_change":"2024-09-15T22:42:12.894661+0000","last_active":"2024-09-15T22:42:13.879442+0000","last_peered":"2024-09-15T22:42:13.879442+0000","last_clean":"2024-09-15T22:42:13.879442+0000","last_became_active":"2024-09-15T22:42:12.893600+0000","last_became_peered":"2024-09-15T22:42:12.893600+0000","last_unstale":"2024-09-15T22:42:13.879442+0000","last_undegraded":"2024-09-15T22:42:13.879442+0000","last_fullsized":"2024-09-15T22:42:13.879442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:39.873094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878178+0000","last_change":"2024-09-15T22:42:12.896604+0000","last_active":"2024-09-15T22:42:13.878178+0000","last_peered":"2024-09-15T22:42:13.878178+0000","last_clean":"2024-09-15T22:42:13.878178+0000","last_became_active":"2024-09-15T22:42:12.896338+0000","last_became_peered":"2024-09-15T22:42:12.896338+0000","last_unstale":"2024-09-15T22:42:13.878178+0000","last_undegraded":"2024-09-15T22:42:13.878178+0000","last_fullsized":"2024-09-15T22:42:13.878178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:46.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879323+0000","last_change":"2024-09-15T22:42:12.890511+0000","last_active":"2024-09-15T22:42:13.879323+0000","last_peered":"2024-09-15T22:42:13.879323+0000","last_clean":"2024-09-15T22:42:13.879323+0000","last_became_active":"2024-09-15T22:42:12.890202+0000","last_became_peered":"2024-09-15T22:42:12.890202+0000","last_unstale":"2024-09-15T22:42:13.879323+0000","last_undegraded":"2024-09-15T22:42:13.879323+0000","last_fullsized":"2024-09-15T22:42:13.879323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:19.029170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929585+0000","last_change":"2024-09-15T22:42:12.903155+0000","last_active":"2024-09-15T22:42:14.929585+0000","last_peered":"2024-09-15T22:42:14.929585+0000","last_clean":"2024-09-15T22:42:14.929585+0000","last_became_active":"2024-09-15T22:42:12.902884+0000","last_became_peered":"2024-09-15T22:42:12.902884+0000","last_unstale":"2024-09-15T22:42:14.929585+0000","last_undegraded":"2024-09-15T22:42:14.929585+0000","last_fullsized":"2024-09-15T22:42:14.929585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929018+0000","last_change":"2024-09-15T22:42:12.899223+0000","last_active":"2024-09-15T22:42:14.929018+0000","last_peered":"2024-09-15T22:42:14.929018+0000","last_clean":"2024-09-15T22:42:14.929018+0000","last_became_active":"2024-09-15T22:42:12.898961+0000","last_became_peered":"2024-09-15T22:42:12.898961+0000","last_unstale":"2024-09-15T22:42:14.929018+0000","last_undegraded":"2024-09-15T22:42:14.929018+0000","last_fullsized":"2024-09-15T22:42:14.929018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:37.614554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784395+0000","last_change":"2024-09-15T22:42:12.887390+0000","last_active":"2024-09-15T22:42:14.784395+0000","last_peered":"2024-09-15T22:42:14.784395+0000","last_clean":"2024-09-15T22:42:14.784395+0000","last_became_active":"2024-09-15T22:42:12.887134+0000","last_became_peered":"2024-09-15T22:42:12.887134+0000","last_unstale":"2024-09-15T22:42:14.784395+0000","last_undegraded":"2024-09-15T22:42:14.784395+0000","last_fullsized":"2024-09-15T22:42:14.784395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:27.268727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881849+0000","last_change":"2024-09-15T22:42:12.889999+0000","last_active":"2024-09-15T22:42:14.881849+0000","last_peered":"2024-09-15T22:42:14.881849+0000","last_clean":"2024-09-15T22:42:14.881849+0000","last_became_active":"2024-09-15T22:42:12.889722+0000","last_became_peered":"2024-09-15T22:42:12.889722+0000","last_unstale":"2024-09-15T22:42:14.881849+0000","last_undegraded":"2024-09-15T22:42:14.881849+0000","last_fullsized":"2024-09-15T22:42:14.881849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:39.080509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881686+0000","last_change":"2024-09-15T22:42:12.887927+0000","last_active":"2024-09-15T22:42:14.881686+0000","last_peered":"2024-09-15T22:42:14.881686+0000","last_clean":"2024-09-15T22:42:14.881686+0000","last_became_active":"2024-09-15T22:42:12.887354+0000","last_became_peered":"2024-09-15T22:42:12.887354+0000","last_unstale":"2024-09-15T22:42:14.881686+0000","last_undegraded":"2024-09-15T22:42:14.881686+0000","last_fullsized":"2024-09-15T22:42:14.881686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:12.251665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879322+0000","last_change":"2024-09-15T22:42:12.895866+0000","last_active":"2024-09-15T22:42:13.879322+0000","last_peered":"2024-09-15T22:42:13.879322+0000","last_clean":"2024-09-15T22:42:13.879322+0000","last_became_active":"2024-09-15T22:42:12.895588+0000","last_became_peered":"2024-09-15T22:42:12.895588+0000","last_unstale":"2024-09-15T22:42:13.879322+0000","last_undegraded":"2024-09-15T22:42:13.879322+0000","last_fullsized":"2024-09-15T22:42:13.879322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:26.004143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929305+0000","last_change":"2024-09-15T22:42:12.895626+0000","last_active":"2024-09-15T22:42:14.929305+0000","last_peered":"2024-09-15T22:42:14.929305+0000","last_clean":"2024-09-15T22:42:14.929305+0000","last_became_active":"2024-09-15T22:42:12.895315+0000","last_became_peered":"2024-09-15T22:42:12.895315+0000","last_unstale":"2024-09-15T22:42:14.929305+0000","last_undegraded":"2024-09-15T22:42:14.929305+0000","last_fullsized":"2024-09-15T22:42:14.929305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:26.793605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929523+0000","last_change":"2024-09-15T22:42:12.899337+0000","last_active":"2024-09-15T22:42:14.929523+0000","last_peered":"2024-09-15T22:42:14.929523+0000","last_clean":"2024-09-15T22:42:14.929523+0000","last_became_active":"2024-09-15T22:42:12.899068+0000","last_became_peered":"2024-09-15T22:42:12.899068+0000","last_unstale":"2024-09-15T22:42:14.929523+0000","last_undegraded":"2024-09-15T22:42:14.929523+0000","last_fullsized":"2024-09-15T22:42:14.929523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877932+0000","last_change":"2024-09-15T22:42:12.890470+0000","last_active":"2024-09-15T22:42:13.877932+0000","last_peered":"2024-09-15T22:42:13.877932+0000","last_clean":"2024-09-15T22:42:13.877932+0000","last_became_active":"2024-09-15T22:42:12.889280+0000","last_became_peered":"2024-09-15T22:42:12.889280+0000","last_unstale":"2024-09-15T22:42:13.877932+0000","last_undegraded":"2024-09-15T22:42:13.877932+0000","last_fullsized":"2024-09-15T22:42:13.877932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.734305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929159+0000","last_change":"2024-09-15T22:42:12.896339+0000","last_active":"2024-09-15T22:42:14.929159+0000","last_peered":"2024-09-15T22:42:14.929159+0000","last_clean":"2024-09-15T22:42:14.929159+0000","last_became_active":"2024-09-15T22:42:12.896103+0000","last_became_peered":"2024-09-15T22:42:12.896103+0000","last_unstale":"2024-09-15T22:42:14.929159+0000","last_undegraded":"2024-09-15T22:42:14.929159+0000","last_fullsized":"2024-09-15T22:42:14.929159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:37.614554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879230+0000","last_change":"2024-09-15T22:42:12.890123+0000","last_active":"2024-09-15T22:42:13.879230+0000","last_peered":"2024-09-15T22:42:13.879230+0000","last_clean":"2024-09-15T22:42:13.879230+0000","last_became_active":"2024-09-15T22:42:12.888844+0000","last_became_peered":"2024-09-15T22:42:12.888844+0000","last_unstale":"2024-09-15T22:42:13.879230+0000","last_undegraded":"2024-09-15T22:42:13.879230+0000","last_fullsized":"2024-09-15T22:42:13.879230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:12.290039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879383+0000","last_change":"2024-09-15T22:42:12.891556+0000","last_active":"2024-09-15T22:42:13.879383+0000","last_peered":"2024-09-15T22:42:13.879383+0000","last_clean":"2024-09-15T22:42:13.879383+0000","last_became_active":"2024-09-15T22:42:12.890755+0000","last_became_peered":"2024-09-15T22:42:12.890755+0000","last_unstale":"2024-09-15T22:42:13.879383+0000","last_undegraded":"2024-09-15T22:42:13.879383+0000","last_fullsized":"2024-09-15T22:42:13.879383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:40.296166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879300+0000","last_change":"2024-09-15T22:42:12.899577+0000","last_active":"2024-09-15T22:42:14.879300+0000","last_peered":"2024-09-15T22:42:14.879300+0000","last_clean":"2024-09-15T22:42:14.879300+0000","last_became_active":"2024-09-15T22:42:12.899316+0000","last_became_peered":"2024-09-15T22:42:12.899316+0000","last_unstale":"2024-09-15T22:42:14.879300+0000","last_undegraded":"2024-09-15T22:42:14.879300+0000","last_fullsized":"2024-09-15T22:42:14.879300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929625+0000","last_change":"2024-09-15T22:42:12.902191+0000","last_active":"2024-09-15T22:42:14.929625+0000","last_peered":"2024-09-15T22:42:14.929625+0000","last_clean":"2024-09-15T22:42:14.929625+0000","last_became_active":"2024-09-15T22:42:12.901926+0000","last_became_peered":"2024-09-15T22:42:12.901926+0000","last_unstale":"2024-09-15T22:42:14.929625+0000","last_undegraded":"2024-09-15T22:42:14.929625+0000","last_fullsized":"2024-09-15T22:42:14.929625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.635014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929443+0000","last_change":"2024-09-15T22:42:12.893318+0000","last_active":"2024-09-15T22:42:14.929443+0000","last_peered":"2024-09-15T22:42:14.929443+0000","last_clean":"2024-09-15T22:42:14.929443+0000","last_became_active":"2024-09-15T22:42:12.893055+0000","last_became_peered":"2024-09-15T22:42:12.893055+0000","last_unstale":"2024-09-15T22:42:14.929443+0000","last_undegraded":"2024-09-15T22:42:14.929443+0000","last_fullsized":"2024-09-15T22:42:14.929443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929664+0000","last_change":"2024-09-15T22:42:12.899557+0000","last_active":"2024-09-15T22:42:14.929664+0000","last_peered":"2024-09-15T22:42:14.929664+0000","last_clean":"2024-09-15T22:42:14.929664+0000","last_became_active":"2024-09-15T22:42:12.899286+0000","last_became_peered":"2024-09-15T22:42:12.899286+0000","last_unstale":"2024-09-15T22:42:14.929664+0000","last_undegraded":"2024-09-15T22:42:14.929664+0000","last_fullsized":"2024-09-15T22:42:14.929664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929347+0000","last_change":"2024-09-15T22:42:12.898046+0000","last_active":"2024-09-15T22:42:14.929347+0000","last_peered":"2024-09-15T22:42:14.929347+0000","last_clean":"2024-09-15T22:42:14.929347+0000","last_became_active":"2024-09-15T22:42:12.897679+0000","last_became_peered":"2024-09-15T22:42:12.897679+0000","last_unstale":"2024-09-15T22:42:14.929347+0000","last_undegraded":"2024-09-15T22:42:14.929347+0000","last_fullsized":"2024-09-15T22:42:14.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784126+0000","last_change":"2024-09-15T22:42:12.897375+0000","last_active":"2024-09-15T22:42:14.784126+0000","last_peered":"2024-09-15T22:42:14.784126+0000","last_clean":"2024-09-15T22:42:14.784126+0000","last_became_active":"2024-09-15T22:42:12.896933+0000","last_became_peered":"2024-09-15T22:42:12.896933+0000","last_unstale":"2024-09-15T22:42:14.784126+0000","last_undegraded":"2024-09-15T22:42:14.784126+0000","last_fullsized":"2024-09-15T22:42:14.784126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:12.277078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879478+0000","last_change":"2024-09-15T22:42:12.891613+0000","last_active":"2024-09-15T22:42:13.879478+0000","last_peered":"2024-09-15T22:42:13.879478+0000","last_clean":"2024-09-15T22:42:13.879478+0000","last_became_active":"2024-09-15T22:42:12.891023+0000","last_became_peered":"2024-09-15T22:42:12.891023+0000","last_unstale":"2024-09-15T22:42:13.879478+0000","last_undegraded":"2024-09-15T22:42:13.879478+0000","last_fullsized":"2024-09-15T22:42:13.879478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:08.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784459+0000","last_change":"2024-09-15T22:42:11.893091+0000","last_active":"2024-09-15T22:42:14.784459+0000","last_peered":"2024-09-15T22:42:14.784459+0000","last_clean":"2024-09-15T22:42:14.784459+0000","last_became_active":"2024-09-15T22:42:11.892689+0000","last_became_peered":"2024-09-15T22:42:11.892689+0000","last_unstale":"2024-09-15T22:42:14.784459+0000","last_undegraded":"2024-09-15T22:42:14.784459+0000","last_fullsized":"2024-09-15T22:42:14.784459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:49.016386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929509+0000","last_change":"2024-09-15T22:42:12.894192+0000","last_active":"2024-09-15T22:42:14.929509+0000","last_peered":"2024-09-15T22:42:14.929509+0000","last_clean":"2024-09-15T22:42:14.929509+0000","last_became_active":"2024-09-15T22:42:12.893894+0000","last_became_peered":"2024-09-15T22:42:12.893894+0000","last_unstale":"2024-09-15T22:42:14.929509+0000","last_undegraded":"2024-09-15T22:42:14.929509+0000","last_fullsized":"2024-09-15T22:42:14.929509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879008+0000","last_change":"2024-09-15T22:42:11.884187+0000","last_active":"2024-09-15T22:42:13.879008+0000","last_peered":"2024-09-15T22:42:13.879008+0000","last_clean":"2024-09-15T22:42:13.879008+0000","last_became_active":"2024-09-15T22:42:11.883776+0000","last_became_peered":"2024-09-15T22:42:11.883776+0000","last_unstale":"2024-09-15T22:42:13.879008+0000","last_undegraded":"2024-09-15T22:42:13.879008+0000","last_fullsized":"2024-09-15T22:42:13.879008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:20.657317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929760+0000","last_change":"2024-09-15T22:42:12.899434+0000","last_active":"2024-09-15T22:42:14.929760+0000","last_peered":"2024-09-15T22:42:14.929760+0000","last_clean":"2024-09-15T22:42:14.929760+0000","last_became_active":"2024-09-15T22:42:12.899175+0000","last_became_peered":"2024-09-15T22:42:12.899175+0000","last_unstale":"2024-09-15T22:42:14.929760+0000","last_undegraded":"2024-09-15T22:42:14.929760+0000","last_fullsized":"2024-09-15T22:42:14.929760+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:45.253998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881773+0000","last_change":"2024-09-15T22:42:11.893283+0000","last_active":"2024-09-15T22:42:14.881773+0000","last_peered":"2024-09-15T22:42:14.881773+0000","last_clean":"2024-09-15T22:42:14.881773+0000","last_became_active":"2024-09-15T22:42:11.892966+0000","last_became_peered":"2024-09-15T22:42:11.892966+0000","last_unstale":"2024-09-15T22:42:14.881773+0000","last_undegraded":"2024-09-15T22:42:14.881773+0000","last_fullsized":"2024-09-15T22:42:14.881773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:32.204342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878480+0000","last_change":"2024-09-15T22:42:12.891076+0000","last_active":"2024-09-15T22:42:13.878480+0000","last_peered":"2024-09-15T22:42:13.878480+0000","last_clean":"2024-09-15T22:42:13.878480+0000","last_became_active":"2024-09-15T22:42:12.890760+0000","last_became_peered":"2024-09-15T22:42:12.890760+0000","last_unstale":"2024-09-15T22:42:13.878480+0000","last_undegraded":"2024-09-15T22:42:13.878480+0000","last_fullsized":"2024-09-15T22:42:13.878480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:48.576549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879512+0000","last_change":"2024-09-15T22:42:11.880833+0000","last_active":"2024-09-15T22:42:13.879512+0000","last_peered":"2024-09-15T22:42:13.879512+0000","last_clean":"2024-09-15T22:42:13.879512+0000","last_became_active":"2024-09-15T22:42:11.880538+0000","last_became_peered":"2024-09-15T22:42:11.880538+0000","last_unstale":"2024-09-15T22:42:13.879512+0000","last_undegraded":"2024-09-15T22:42:13.879512+0000","last_fullsized":"2024-09-15T22:42:13.879512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:25.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879312+0000","last_change":"2024-09-15T22:42:12.893318+0000","last_active":"2024-09-15T22:42:13.879312+0000","last_peered":"2024-09-15T22:42:13.879312+0000","last_clean":"2024-09-15T22:42:13.879312+0000","last_became_active":"2024-09-15T22:42:12.892221+0000","last_became_peered":"2024-09-15T22:42:12.892221+0000","last_unstale":"2024-09-15T22:42:13.879312+0000","last_undegraded":"2024-09-15T22:42:13.879312+0000","last_fullsized":"2024-09-15T22:42:13.879312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929564+0000","last_change":"2024-09-15T22:42:11.892849+0000","last_active":"2024-09-15T22:42:14.929564+0000","last_peered":"2024-09-15T22:42:14.929564+0000","last_clean":"2024-09-15T22:42:14.929564+0000","last_became_active":"2024-09-15T22:42:11.892584+0000","last_became_peered":"2024-09-15T22:42:11.892584+0000","last_unstale":"2024-09-15T22:42:14.929564+0000","last_undegraded":"2024-09-15T22:42:14.929564+0000","last_fullsized":"2024-09-15T22:42:14.929564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.698652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929168+0000","last_change":"2024-09-15T22:42:12.893429+0000","last_active":"2024-09-15T22:42:14.929168+0000","last_peered":"2024-09-15T22:42:14.929168+0000","last_clean":"2024-09-15T22:42:14.929168+0000","last_became_active":"2024-09-15T22:42:12.893135+0000","last_became_peered":"2024-09-15T22:42:12.893135+0000","last_unstale":"2024-09-15T22:42:14.929168+0000","last_undegraded":"2024-09-15T22:42:14.929168+0000","last_fullsized":"2024-09-15T22:42:14.929168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:26.793605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929600+0000","last_change":"2024-09-15T22:42:11.888414+0000","last_active":"2024-09-15T22:42:14.929600+0000","last_peered":"2024-09-15T22:42:14.929600+0000","last_clean":"2024-09-15T22:42:14.929600+0000","last_became_active":"2024-09-15T22:42:11.887779+0000","last_became_peered":"2024-09-15T22:42:11.887779+0000","last_unstale":"2024-09-15T22:42:14.929600+0000","last_undegraded":"2024-09-15T22:42:14.929600+0000","last_fullsized":"2024-09-15T22:42:14.929600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:38.865982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879385+0000","last_change":"2024-09-15T22:42:12.902838+0000","last_active":"2024-09-15T22:42:13.879385+0000","last_peered":"2024-09-15T22:42:13.879385+0000","last_clean":"2024-09-15T22:42:13.879385+0000","last_became_active":"2024-09-15T22:42:12.902562+0000","last_became_peered":"2024-09-15T22:42:12.902562+0000","last_unstale":"2024-09-15T22:42:13.879385+0000","last_undegraded":"2024-09-15T22:42:13.879385+0000","last_fullsized":"2024-09-15T22:42:13.879385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:10.465162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881452+0000","last_change":"2024-09-15T22:42:11.888504+0000","last_active":"2024-09-15T22:42:14.881452+0000","last_peered":"2024-09-15T22:42:14.881452+0000","last_clean":"2024-09-15T22:42:14.881452+0000","last_became_active":"2024-09-15T22:42:11.888230+0000","last_became_peered":"2024-09-15T22:42:11.888230+0000","last_unstale":"2024-09-15T22:42:14.881452+0000","last_undegraded":"2024-09-15T22:42:14.881452+0000","last_fullsized":"2024-09-15T22:42:14.881452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:46.854697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878582+0000","last_change":"2024-09-15T22:42:12.889649+0000","last_active":"2024-09-15T22:42:13.878582+0000","last_peered":"2024-09-15T22:42:13.878582+0000","last_clean":"2024-09-15T22:42:13.878582+0000","last_became_active":"2024-09-15T22:42:12.889330+0000","last_became_peered":"2024-09-15T22:42:12.889330+0000","last_unstale":"2024-09-15T22:42:13.878582+0000","last_undegraded":"2024-09-15T22:42:13.878582+0000","last_fullsized":"2024-09-15T22:42:13.878582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929486+0000","last_change":"2024-09-15T22:42:11.892002+0000","last_active":"2024-09-15T22:42:14.929486+0000","last_peered":"2024-09-15T22:42:14.929486+0000","last_clean":"2024-09-15T22:42:14.929486+0000","last_became_active":"2024-09-15T22:42:11.891750+0000","last_became_peered":"2024-09-15T22:42:11.891750+0000","last_unstale":"2024-09-15T22:42:14.929486+0000","last_undegraded":"2024-09-15T22:42:14.929486+0000","last_fullsized":"2024-09-15T22:42:14.929486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:36.894242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784462+0000","last_change":"2024-09-15T22:42:12.888882+0000","last_active":"2024-09-15T22:42:14.784462+0000","last_peered":"2024-09-15T22:42:14.784462+0000","last_clean":"2024-09-15T22:42:14.784462+0000","last_became_active":"2024-09-15T22:42:12.888623+0000","last_became_peered":"2024-09-15T22:42:12.888623+0000","last_unstale":"2024-09-15T22:42:14.784462+0000","last_undegraded":"2024-09-15T22:42:14.784462+0000","last_fullsized":"2024-09-15T22:42:14.784462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:05.952973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879409+0000","last_change":"2024-09-15T22:42:11.894379+0000","last_active":"2024-09-15T22:42:14.879409+0000","last_peered":"2024-09-15T22:42:14.879409+0000","last_clean":"2024-09-15T22:42:14.879409+0000","last_became_active":"2024-09-15T22:42:11.894110+0000","last_became_peered":"2024-09-15T22:42:11.894110+0000","last_unstale":"2024-09-15T22:42:14.879409+0000","last_undegraded":"2024-09-15T22:42:14.879409+0000","last_fullsized":"2024-09-15T22:42:14.879409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.122467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879271+0000","last_change":"2024-09-15T22:42:12.893303+0000","last_active":"2024-09-15T22:42:13.879271+0000","last_peered":"2024-09-15T22:42:13.879271+0000","last_clean":"2024-09-15T22:42:13.879271+0000","last_became_active":"2024-09-15T22:42:12.893026+0000","last_became_peered":"2024-09-15T22:42:12.893026+0000","last_unstale":"2024-09-15T22:42:13.879271+0000","last_undegraded":"2024-09-15T22:42:13.879271+0000","last_fullsized":"2024-09-15T22:42:13.879271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:07.989066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879292+0000","last_change":"2024-09-15T22:42:11.891138+0000","last_active":"2024-09-15T22:42:14.879292+0000","last_peered":"2024-09-15T22:42:14.879292+0000","last_clean":"2024-09-15T22:42:14.879292+0000","last_became_active":"2024-09-15T22:42:11.890777+0000","last_became_peered":"2024-09-15T22:42:11.890777+0000","last_unstale":"2024-09-15T22:42:14.879292+0000","last_undegraded":"2024-09-15T22:42:14.879292+0000","last_fullsized":"2024-09-15T22:42:14.879292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:10.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879407+0000","last_change":"2024-09-15T22:42:12.892345+0000","last_active":"2024-09-15T22:42:13.879407+0000","last_peered":"2024-09-15T22:42:13.879407+0000","last_clean":"2024-09-15T22:42:13.879407+0000","last_became_active":"2024-09-15T22:42:12.892074+0000","last_became_peered":"2024-09-15T22:42:12.892074+0000","last_unstale":"2024-09-15T22:42:13.879407+0000","last_undegraded":"2024-09-15T22:42:13.879407+0000","last_fullsized":"2024-09-15T22:42:13.879407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784207+0000","last_change":"2024-09-15T22:42:11.889165+0000","last_active":"2024-09-15T22:42:14.784207+0000","last_peered":"2024-09-15T22:42:14.784207+0000","last_clean":"2024-09-15T22:42:14.784207+0000","last_became_active":"2024-09-15T22:42:11.888868+0000","last_became_peered":"2024-09-15T22:42:11.888868+0000","last_unstale":"2024-09-15T22:42:14.784207+0000","last_undegraded":"2024-09-15T22:42:14.784207+0000","last_fullsized":"2024-09-15T22:42:14.784207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.315288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784238+0000","last_change":"2024-09-15T22:42:12.891097+0000","last_active":"2024-09-15T22:42:14.784238+0000","last_peered":"2024-09-15T22:42:14.784238+0000","last_clean":"2024-09-15T22:42:14.784238+0000","last_became_active":"2024-09-15T22:42:12.890839+0000","last_became_peered":"2024-09-15T22:42:12.890839+0000","last_unstale":"2024-09-15T22:42:14.784238+0000","last_undegraded":"2024-09-15T22:42:14.784238+0000","last_fullsized":"2024-09-15T22:42:14.784238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:01.500931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879334+0000","last_change":"2024-09-15T22:42:11.882504+0000","last_active":"2024-09-15T22:42:13.879334+0000","last_peered":"2024-09-15T22:42:13.879334+0000","last_clean":"2024-09-15T22:42:13.879334+0000","last_became_active":"2024-09-15T22:42:11.881991+0000","last_became_peered":"2024-09-15T22:42:11.881991+0000","last_unstale":"2024-09-15T22:42:13.879334+0000","last_undegraded":"2024-09-15T22:42:13.879334+0000","last_fullsized":"2024-09-15T22:42:13.879334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878186+0000","last_change":"2024-09-15T22:42:12.890997+0000","last_active":"2024-09-15T22:42:13.878186+0000","last_peered":"2024-09-15T22:42:13.878186+0000","last_clean":"2024-09-15T22:42:13.878186+0000","last_became_active":"2024-09-15T22:42:12.890727+0000","last_became_peered":"2024-09-15T22:42:12.890727+0000","last_unstale":"2024-09-15T22:42:13.878186+0000","last_undegraded":"2024-09-15T22:42:13.878186+0000","last_fullsized":"2024-09-15T22:42:13.878186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:26.495173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929288+0000","last_change":"2024-09-15T22:42:11.891839+0000","last_active":"2024-09-15T22:42:14.929288+0000","last_peered":"2024-09-15T22:42:14.929288+0000","last_clean":"2024-09-15T22:42:14.929288+0000","last_became_active":"2024-09-15T22:42:11.891587+0000","last_became_peered":"2024-09-15T22:42:11.891587+0000","last_unstale":"2024-09-15T22:42:14.929288+0000","last_undegraded":"2024-09-15T22:42:14.929288+0000","last_fullsized":"2024-09-15T22:42:14.929288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:54.189602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878427+0000","last_change":"2024-09-15T22:42:12.893296+0000","last_active":"2024-09-15T22:42:13.878427+0000","last_peered":"2024-09-15T22:42:13.878427+0000","last_clean":"2024-09-15T22:42:13.878427+0000","last_became_active":"2024-09-15T22:42:12.891959+0000","last_became_peered":"2024-09-15T22:42:12.891959+0000","last_unstale":"2024-09-15T22:42:13.878427+0000","last_undegraded":"2024-09-15T22:42:13.878427+0000","last_fullsized":"2024-09-15T22:42:13.878427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879441+0000","last_change":"2024-09-15T22:42:11.888988+0000","last_active":"2024-09-15T22:42:13.879441+0000","last_peered":"2024-09-15T22:42:13.879441+0000","last_clean":"2024-09-15T22:42:13.879441+0000","last_became_active":"2024-09-15T22:42:11.888567+0000","last_became_peered":"2024-09-15T22:42:11.888567+0000","last_unstale":"2024-09-15T22:42:13.879441+0000","last_undegraded":"2024-09-15T22:42:13.879441+0000","last_fullsized":"2024-09-15T22:42:13.879441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:54.189602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929308+0000","last_change":"2024-09-15T22:42:12.891344+0000","last_active":"2024-09-15T22:42:14.929308+0000","last_peered":"2024-09-15T22:42:14.929308+0000","last_clean":"2024-09-15T22:42:14.929308+0000","last_became_active":"2024-09-15T22:42:12.890749+0000","last_became_peered":"2024-09-15T22:42:12.890749+0000","last_unstale":"2024-09-15T22:42:14.929308+0000","last_undegraded":"2024-09-15T22:42:14.929308+0000","last_fullsized":"2024-09-15T22:42:14.929308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:52.322401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878033+0000","last_change":"2024-09-15T22:42:11.888004+0000","last_active":"2024-09-15T22:42:13.878033+0000","last_peered":"2024-09-15T22:42:13.878033+0000","last_clean":"2024-09-15T22:42:13.878033+0000","last_became_active":"2024-09-15T22:42:11.887395+0000","last_became_peered":"2024-09-15T22:42:11.887395+0000","last_unstale":"2024-09-15T22:42:13.878033+0000","last_undegraded":"2024-09-15T22:42:13.878033+0000","last_fullsized":"2024-09-15T22:42:13.878033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:36.894242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784282+0000","last_change":"2024-09-15T22:42:12.888194+0000","last_active":"2024-09-15T22:42:14.784282+0000","last_peered":"2024-09-15T22:42:14.784282+0000","last_clean":"2024-09-15T22:42:14.784282+0000","last_became_active":"2024-09-15T22:42:12.887904+0000","last_became_peered":"2024-09-15T22:42:12.887904+0000","last_unstale":"2024-09-15T22:42:14.784282+0000","last_undegraded":"2024-09-15T22:42:14.784282+0000","last_fullsized":"2024-09-15T22:42:14.784282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:28.960857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881323+0000","last_change":"2024-09-15T22:42:11.890327+0000","last_active":"2024-09-15T22:42:14.881323+0000","last_peered":"2024-09-15T22:42:14.881323+0000","last_clean":"2024-09-15T22:42:14.881323+0000","last_became_active":"2024-09-15T22:42:11.889853+0000","last_became_peered":"2024-09-15T22:42:11.889853+0000","last_unstale":"2024-09-15T22:42:14.881323+0000","last_undegraded":"2024-09-15T22:42:14.881323+0000","last_fullsized":"2024-09-15T22:42:14.881323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:34.930390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784539+0000","last_change":"2024-09-15T22:42:12.883805+0000","last_active":"2024-09-15T22:42:14.784539+0000","last_peered":"2024-09-15T22:42:14.784539+0000","last_clean":"2024-09-15T22:42:14.784539+0000","last_became_active":"2024-09-15T22:42:12.883510+0000","last_became_peered":"2024-09-15T22:42:12.883510+0000","last_unstale":"2024-09-15T22:42:14.784539+0000","last_undegraded":"2024-09-15T22:42:14.784539+0000","last_fullsized":"2024-09-15T22:42:14.784539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:26.927237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881732+0000","last_change":"2024-09-15T22:42:11.890938+0000","last_active":"2024-09-15T22:42:14.881732+0000","last_peered":"2024-09-15T22:42:14.881732+0000","last_clean":"2024-09-15T22:42:14.881732+0000","last_became_active":"2024-09-15T22:42:11.890598+0000","last_became_peered":"2024-09-15T22:42:11.890598+0000","last_unstale":"2024-09-15T22:42:14.881732+0000","last_undegraded":"2024-09-15T22:42:14.881732+0000","last_fullsized":"2024-09-15T22:42:14.881732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:21.821850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879402+0000","last_change":"2024-09-15T22:42:12.894308+0000","last_active":"2024-09-15T22:42:13.879402+0000","last_peered":"2024-09-15T22:42:13.879402+0000","last_clean":"2024-09-15T22:42:13.879402+0000","last_became_active":"2024-09-15T22:42:12.894049+0000","last_became_peered":"2024-09-15T22:42:12.894049+0000","last_unstale":"2024-09-15T22:42:13.879402+0000","last_undegraded":"2024-09-15T22:42:13.879402+0000","last_fullsized":"2024-09-15T22:42:13.879402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:07.221039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929371+0000","last_change":"2024-09-15T22:42:11.892516+0000","last_active":"2024-09-15T22:42:14.929371+0000","last_peered":"2024-09-15T22:42:14.929371+0000","last_clean":"2024-09-15T22:42:14.929371+0000","last_became_active":"2024-09-15T22:42:11.892221+0000","last_became_peered":"2024-09-15T22:42:11.892221+0000","last_unstale":"2024-09-15T22:42:14.929371+0000","last_undegraded":"2024-09-15T22:42:14.929371+0000","last_fullsized":"2024-09-15T22:42:14.929371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:44.635047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879243+0000","last_change":"2024-09-15T22:42:12.898710+0000","last_active":"2024-09-15T22:42:14.879243+0000","last_peered":"2024-09-15T22:42:14.879243+0000","last_clean":"2024-09-15T22:42:14.879243+0000","last_became_active":"2024-09-15T22:42:12.898372+0000","last_became_peered":"2024-09-15T22:42:12.898372+0000","last_unstale":"2024-09-15T22:42:14.879243+0000","last_undegraded":"2024-09-15T22:42:14.879243+0000","last_fullsized":"2024-09-15T22:42:14.879243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:48.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784344+0000","last_change":"2024-09-15T22:42:11.891892+0000","last_active":"2024-09-15T22:42:14.784344+0000","last_peered":"2024-09-15T22:42:14.784344+0000","last_clean":"2024-09-15T22:42:14.784344+0000","last_became_active":"2024-09-15T22:42:11.891592+0000","last_became_peered":"2024-09-15T22:42:11.891592+0000","last_unstale":"2024-09-15T22:42:14.784344+0000","last_undegraded":"2024-09-15T22:42:14.784344+0000","last_fullsized":"2024-09-15T22:42:14.784344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:47.569436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881696+0000","last_change":"2024-09-15T22:42:12.894806+0000","last_active":"2024-09-15T22:42:14.881696+0000","last_peered":"2024-09-15T22:42:14.881696+0000","last_clean":"2024-09-15T22:42:14.881696+0000","last_became_active":"2024-09-15T22:42:12.894508+0000","last_became_peered":"2024-09-15T22:42:12.894508+0000","last_unstale":"2024-09-15T22:42:14.881696+0000","last_undegraded":"2024-09-15T22:42:14.881696+0000","last_fullsized":"2024-09-15T22:42:14.881696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:39.873094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929777+0000","last_change":"2024-09-15T22:42:11.882053+0000","last_active":"2024-09-15T22:42:14.929777+0000","last_peered":"2024-09-15T22:42:14.929777+0000","last_clean":"2024-09-15T22:42:14.929777+0000","last_became_active":"2024-09-15T22:42:11.881784+0000","last_became_peered":"2024-09-15T22:42:11.881784+0000","last_unstale":"2024-09-15T22:42:14.929777+0000","last_undegraded":"2024-09-15T22:42:14.929777+0000","last_fullsized":"2024-09-15T22:42:14.929777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:47.851991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878102+0000","last_change":"2024-09-15T22:42:12.899753+0000","last_active":"2024-09-15T22:42:13.878102+0000","last_peered":"2024-09-15T22:42:13.878102+0000","last_clean":"2024-09-15T22:42:13.878102+0000","last_became_active":"2024-09-15T22:42:12.899475+0000","last_became_peered":"2024-09-15T22:42:12.899475+0000","last_unstale":"2024-09-15T22:42:13.878102+0000","last_undegraded":"2024-09-15T22:42:13.878102+0000","last_fullsized":"2024-09-15T22:42:13.878102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:35.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879283+0000","last_change":"2024-09-15T22:42:11.892840+0000","last_active":"2024-09-15T22:42:14.879283+0000","last_peered":"2024-09-15T22:42:14.879283+0000","last_clean":"2024-09-15T22:42:14.879283+0000","last_became_active":"2024-09-15T22:42:11.892493+0000","last_became_peered":"2024-09-15T22:42:11.892493+0000","last_unstale":"2024-09-15T22:42:14.879283+0000","last_undegraded":"2024-09-15T22:42:14.879283+0000","last_fullsized":"2024-09-15T22:42:14.879283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:55.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879319+0000","last_change":"2024-09-15T22:42:12.896684+0000","last_active":"2024-09-15T22:42:14.879319+0000","last_peered":"2024-09-15T22:42:14.879319+0000","last_clean":"2024-09-15T22:42:14.879319+0000","last_became_active":"2024-09-15T22:42:12.896344+0000","last_became_peered":"2024-09-15T22:42:12.896344+0000","last_unstale":"2024-09-15T22:42:14.879319+0000","last_undegraded":"2024-09-15T22:42:14.879319+0000","last_fullsized":"2024-09-15T22:42:14.879319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929685+0000","last_change":"2024-09-15T22:42:11.891344+0000","last_active":"2024-09-15T22:42:14.929685+0000","last_peered":"2024-09-15T22:42:14.929685+0000","last_clean":"2024-09-15T22:42:14.929685+0000","last_became_active":"2024-09-15T22:42:11.891022+0000","last_became_peered":"2024-09-15T22:42:11.891022+0000","last_unstale":"2024-09-15T22:42:14.929685+0000","last_undegraded":"2024-09-15T22:42:14.929685+0000","last_fullsized":"2024-09-15T22:42:14.929685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:38.073397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.877785+0000","last_change":"2024-09-15T22:42:12.894563+0000","last_active":"2024-09-15T22:42:13.877785+0000","last_peered":"2024-09-15T22:42:13.877785+0000","last_clean":"2024-09-15T22:42:13.877785+0000","last_became_active":"2024-09-15T22:42:12.894216+0000","last_became_peered":"2024-09-15T22:42:12.894216+0000","last_unstale":"2024-09-15T22:42:13.877785+0000","last_undegraded":"2024-09-15T22:42:13.877785+0000","last_fullsized":"2024-09-15T22:42:13.877785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:59.153843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879121+0000","last_change":"2024-09-15T22:42:11.893644+0000","last_active":"2024-09-15T22:42:13.879121+0000","last_peered":"2024-09-15T22:42:13.879121+0000","last_clean":"2024-09-15T22:42:13.879121+0000","last_became_active":"2024-09-15T22:42:11.893294+0000","last_became_peered":"2024-09-15T22:42:11.893294+0000","last_unstale":"2024-09-15T22:42:13.879121+0000","last_undegraded":"2024-09-15T22:42:13.879121+0000","last_fullsized":"2024-09-15T22:42:13.879121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:31.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879340+0000","last_change":"2024-09-15T22:42:12.895042+0000","last_active":"2024-09-15T22:42:13.879340+0000","last_peered":"2024-09-15T22:42:13.879340+0000","last_clean":"2024-09-15T22:42:13.879340+0000","last_became_active":"2024-09-15T22:42:12.894758+0000","last_became_peered":"2024-09-15T22:42:12.894758+0000","last_unstale":"2024-09-15T22:42:13.879340+0000","last_undegraded":"2024-09-15T22:42:13.879340+0000","last_fullsized":"2024-09-15T22:42:13.879340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:07.097447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784071+0000","last_change":"2024-09-15T22:42:11.889318+0000","last_active":"2024-09-15T22:42:14.784071+0000","last_peered":"2024-09-15T22:42:14.784071+0000","last_clean":"2024-09-15T22:42:14.784071+0000","last_became_active":"2024-09-15T22:42:11.888871+0000","last_became_peered":"2024-09-15T22:42:11.888871+0000","last_unstale":"2024-09-15T22:42:14.784071+0000","last_undegraded":"2024-09-15T22:42:14.784071+0000","last_fullsized":"2024-09-15T22:42:14.784071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:25.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881875+0000","last_change":"2024-09-15T22:42:12.895781+0000","last_active":"2024-09-15T22:42:14.881875+0000","last_peered":"2024-09-15T22:42:14.881875+0000","last_clean":"2024-09-15T22:42:14.881875+0000","last_became_active":"2024-09-15T22:42:12.894789+0000","last_became_peered":"2024-09-15T22:42:12.894789+0000","last_unstale":"2024-09-15T22:42:14.881875+0000","last_undegraded":"2024-09-15T22:42:14.881875+0000","last_fullsized":"2024-09-15T22:42:14.881875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:55.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879224+0000","last_change":"2024-09-15T22:42:11.886225+0000","last_active":"2024-09-15T22:42:13.879224+0000","last_peered":"2024-09-15T22:42:13.879224+0000","last_clean":"2024-09-15T22:42:13.879224+0000","last_became_active":"2024-09-15T22:42:11.885851+0000","last_became_peered":"2024-09-15T22:42:11.885851+0000","last_unstale":"2024-09-15T22:42:13.879224+0000","last_undegraded":"2024-09-15T22:42:13.879224+0000","last_fullsized":"2024-09-15T22:42:13.879224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:43.788609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784469+0000","last_change":"2024-09-15T22:42:12.886779+0000","last_active":"2024-09-15T22:42:14.784469+0000","last_peered":"2024-09-15T22:42:14.784469+0000","last_clean":"2024-09-15T22:42:14.784469+0000","last_became_active":"2024-09-15T22:42:12.886476+0000","last_became_peered":"2024-09-15T22:42:12.886476+0000","last_unstale":"2024-09-15T22:42:14.784469+0000","last_undegraded":"2024-09-15T22:42:14.784469+0000","last_fullsized":"2024-09-15T22:42:14.784469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:13.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.879424+0000","last_change":"2024-09-15T22:42:11.893175+0000","last_active":"2024-09-15T22:42:14.879424+0000","last_peered":"2024-09-15T22:42:14.879424+0000","last_clean":"2024-09-15T22:42:14.879424+0000","last_became_active":"2024-09-15T22:42:11.892523+0000","last_became_peered":"2024-09-15T22:42:11.892523+0000","last_unstale":"2024-09-15T22:42:14.879424+0000","last_undegraded":"2024-09-15T22:42:14.879424+0000","last_fullsized":"2024-09-15T22:42:14.879424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:10.147343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.881837+0000","last_change":"2024-09-15T22:42:12.892263+0000","last_active":"2024-09-15T22:42:14.881837+0000","last_peered":"2024-09-15T22:42:14.881837+0000","last_clean":"2024-09-15T22:42:14.881837+0000","last_became_active":"2024-09-15T22:42:12.891926+0000","last_became_peered":"2024-09-15T22:42:12.891926+0000","last_unstale":"2024-09-15T22:42:14.881837+0000","last_undegraded":"2024-09-15T22:42:14.881837+0000","last_fullsized":"2024-09-15T22:42:14.881837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:30.705765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879436+0000","last_change":"2024-09-15T22:42:11.887249+0000","last_active":"2024-09-15T22:42:13.879436+0000","last_peered":"2024-09-15T22:42:13.879436+0000","last_clean":"2024-09-15T22:42:13.879436+0000","last_became_active":"2024-09-15T22:42:11.886981+0000","last_became_peered":"2024-09-15T22:42:11.886981+0000","last_unstale":"2024-09-15T22:42:13.879436+0000","last_undegraded":"2024-09-15T22:42:13.879436+0000","last_fullsized":"2024-09-15T22:42:13.879436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:39.307694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929735+0000","last_change":"2024-09-15T22:42:12.898530+0000","last_active":"2024-09-15T22:42:14.929735+0000","last_peered":"2024-09-15T22:42:14.929735+0000","last_clean":"2024-09-15T22:42:14.929735+0000","last_became_active":"2024-09-15T22:42:12.898267+0000","last_became_peered":"2024-09-15T22:42:12.898267+0000","last_unstale":"2024-09-15T22:42:14.929735+0000","last_undegraded":"2024-09-15T22:42:14.929735+0000","last_fullsized":"2024-09-15T22:42:14.929735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878348+0000","last_change":"2024-09-15T22:42:11.888253+0000","last_active":"2024-09-15T22:42:13.878348+0000","last_peered":"2024-09-15T22:42:13.878348+0000","last_clean":"2024-09-15T22:42:13.878348+0000","last_became_active":"2024-09-15T22:42:11.887964+0000","last_became_peered":"2024-09-15T22:42:11.887964+0000","last_unstale":"2024-09-15T22:42:13.878348+0000","last_undegraded":"2024-09-15T22:42:13.878348+0000","last_fullsized":"2024-09-15T22:42:13.878348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:24.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878594+0000","last_change":"2024-09-15T22:42:12.891519+0000","last_active":"2024-09-15T22:42:13.878594+0000","last_peered":"2024-09-15T22:42:13.878594+0000","last_clean":"2024-09-15T22:42:13.878594+0000","last_became_active":"2024-09-15T22:42:12.891237+0000","last_became_peered":"2024-09-15T22:42:12.891237+0000","last_unstale":"2024-09-15T22:42:13.878594+0000","last_undegraded":"2024-09-15T22:42:13.878594+0000","last_fullsized":"2024-09-15T22:42:13.878594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:50.023499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878284+0000","last_change":"2024-09-15T22:42:11.889475+0000","last_active":"2024-09-15T22:42:13.878284+0000","last_peered":"2024-09-15T22:42:13.878284+0000","last_clean":"2024-09-15T22:42:13.878284+0000","last_became_active":"2024-09-15T22:42:11.889160+0000","last_became_peered":"2024-09-15T22:42:11.889160+0000","last_unstale":"2024-09-15T22:42:13.878284+0000","last_undegraded":"2024-09-15T22:42:13.878284+0000","last_fullsized":"2024-09-15T22:42:13.878284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:05.509527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878712+0000","last_change":"2024-09-15T22:42:12.893205+0000","last_active":"2024-09-15T22:42:13.878712+0000","last_peered":"2024-09-15T22:42:13.878712+0000","last_clean":"2024-09-15T22:42:13.878712+0000","last_became_active":"2024-09-15T22:42:12.892852+0000","last_became_peered":"2024-09-15T22:42:12.892852+0000","last_unstale":"2024-09-15T22:42:13.878712+0000","last_undegraded":"2024-09-15T22:42:13.878712+0000","last_fullsized":"2024-09-15T22:42:13.878712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929436+0000","last_change":"2024-09-15T22:42:11.892830+0000","last_active":"2024-09-15T22:42:14.929436+0000","last_peered":"2024-09-15T22:42:14.929436+0000","last_clean":"2024-09-15T22:42:14.929436+0000","last_became_active":"2024-09-15T22:42:11.892432+0000","last_became_peered":"2024-09-15T22:42:11.892432+0000","last_unstale":"2024-09-15T22:42:14.929436+0000","last_undegraded":"2024-09-15T22:42:14.929436+0000","last_fullsized":"2024-09-15T22:42:14.929436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:11.244552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784237+0000","last_change":"2024-09-15T22:42:12.889123+0000","last_active":"2024-09-15T22:42:14.784237+0000","last_peered":"2024-09-15T22:42:14.784237+0000","last_clean":"2024-09-15T22:42:14.784237+0000","last_became_active":"2024-09-15T22:42:12.888817+0000","last_became_peered":"2024-09-15T22:42:12.888817+0000","last_unstale":"2024-09-15T22:42:14.784237+0000","last_undegraded":"2024-09-15T22:42:14.784237+0000","last_fullsized":"2024-09-15T22:42:14.784237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:13.916525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.878744+0000","last_change":"2024-09-15T22:42:11.888059+0000","last_active":"2024-09-15T22:42:13.878744+0000","last_peered":"2024-09-15T22:42:13.878744+0000","last_clean":"2024-09-15T22:42:13.878744+0000","last_became_active":"2024-09-15T22:42:11.887740+0000","last_became_peered":"2024-09-15T22:42:11.887740+0000","last_unstale":"2024-09-15T22:42:13.878744+0000","last_undegraded":"2024-09-15T22:42:13.878744+0000","last_fullsized":"2024-09-15T22:42:13.878744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.698652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.929834+0000","last_change":"2024-09-15T22:42:12.897019+0000","last_active":"2024-09-15T22:42:14.929834+0000","last_peered":"2024-09-15T22:42:14.929834+0000","last_clean":"2024-09-15T22:42:14.929834+0000","last_became_active":"2024-09-15T22:42:12.896756+0000","last_became_peered":"2024-09-15T22:42:12.896756+0000","last_unstale":"2024-09-15T22:42:14.929834+0000","last_undegraded":"2024-09-15T22:42:14.929834+0000","last_fullsized":"2024-09-15T22:42:14.929834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:11.866968+0000","last_clean_scrub_stamp":"2024-09-15T22:42:11.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:13.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:14.784471+0000","last_change":"2024-09-15T22:42:11.889610+0000","last_active":"2024-09-15T22:42:14.784471+0000","last_peered":"2024-09-15T22:42:14.784471+0000","last_clean":"2024-09-15T22:42:14.784471+0000","last_became_active":"2024-09-15T22:42:11.889114+0000","last_became_peered":"2024-09-15T22:42:11.889114+0000","last_unstale":"2024-09-15T22:42:14.784471+0000","last_undegraded":"2024-09-15T22:42:14.784471+0000","last_fullsized":"2024-09-15T22:42:14.784471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:10.859855+0000","last_clean_scrub_stamp":"2024-09-15T22:42:10.859855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:47.130960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-15T22:42:13.879086+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:13.879086+0000","last_peered":"2024-09-15T22:42:13.879086+0000","last_clean":"2024-09-15T22:42:13.879086+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:13.879086+0000","last_undegraded":"2024-09-15T22:42:13.879086+0000","last_fullsized":"2024-09-15T22:42:13.879086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":987136,"data_stored":740700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":151384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":150526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":740188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":145062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:20.511 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:42:20.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:42:20.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.651+0000 7f170f2b7640 1 Processor -- start 2024-09-15T22:42:20.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.651+0000 7f170f2b7640 1 -- start start 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170f2b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f170815b370 0x7f1708072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170f2b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f170806f130 0x7f17080ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170f2b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f170815c970 con 0x7f170815f9f0 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170f2b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f170815fef0 con 0x7f170806f130 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170f2b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f170815bbb0 con 0x7f170815b370 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d854640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f170806f130 0x7f17080ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170c852640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f170815f9f0 0x7f170806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49418/0 (socket says 172.21.15.134:49418) 2024-09-15T22:42:20.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170c852640 1 -- 172.21.15.134:0/3344488804 learned_addr learned my addr 172.21.15.134:0/3344488804 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d053640 1 --2- 172.21.15.134:0/3344488804 >> v2:172.21.15.177:3300/0 conn(0x7f170815b370 0x7f1708072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d854640 1 -- 172.21.15.134:0/3344488804 >> v2:172.21.15.177:3300/0 conn(0x7f170815b370 msgr2=0x7f1708072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d854640 1 --2- 172.21.15.134:0/3344488804 >> v2:172.21.15.177:3300/0 conn(0x7f170815b370 0x7f1708072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d854640 1 -- 172.21.15.134:0/3344488804 >> v1:172.21.15.134:6789/0 conn(0x7f170815f9f0 legacy=0x7f170806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f170d854640 1 -- 172.21.15.134:0/3344488804 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170815be90 con 0x7f170806f130 2024-09-15T22:42:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.652+0000 7f16fffff640 1 -- 172.21.15.134:0/3344488804 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702672216 0 0) 0x7f170815c970 con 0x7f170815f9f0 2024-09-15T22:42:20.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.653+0000 7f170d854640 1 --2- 172.21.15.134:0/3344488804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170806f130 0x7f17080ce490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17080696e0 tx=0x7f170002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c254bd518b895a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.653+0000 7f16fffff640 1 -- 172.21.15.134:0/3344488804 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700007740 con 0x7f170806f130 2024-09-15T22:42:20.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.653+0000 7f16fffff640 1 -- 172.21.15.134:0/3344488804 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17000078e0 con 0x7f170806f130 2024-09-15T22:42:20.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.653+0000 7f16fffff640 1 -- 172.21.15.134:0/3344488804 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700007cb0 con 0x7f170806f130 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 -- 172.21.15.134:0/3344488804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170806f130 msgr2=0x7f17080ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 --2- 172.21.15.134:0/3344488804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170806f130 0x7f17080ce490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17080696e0 tx=0x7f170002a5f0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 -- 172.21.15.134:0/3344488804 shutdown_connections 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 --2- 172.21.15.134:0/3344488804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170806f130 0x7f17080ce490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 --2- 172.21.15.134:0/3344488804 >> v2:172.21.15.177:3300/0 conn(0x7f170815b370 0x7f1708072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 -- 172.21.15.134:0/3344488804 >> 172.21.15.134:0/3344488804 conn(0x7f170806bba0 msgr2=0x7f170806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 -- 172.21.15.134:0/3344488804 shutdown_connections 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.654+0000 7f170f2b7640 1 -- 172.21.15.134:0/3344488804 wait complete. 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.655+0000 7f170f2b7640 1 Processor -- start 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.655+0000 7f170f2b7640 1 -- start start 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170806f130 0x7f170814b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 0x7f17080b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17080731b0 con 0x7f170815b370 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f170815c450 con 0x7f170806f130 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f170815b750 con 0x7f170815f9f0 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51588/0 (socket says 172.21.15.134:51588) 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 -- 172.21.15.134:0/2174204342 learned_addr learned my addr 172.21.15.134:0/2174204342 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170d053640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170806f130 0x7f170814b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170d854640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 0x7f17080b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 -- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 msgr2=0x7f17080b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 0x7f17080b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 -- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170806f130 msgr2=0x7f170814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170806f130 0x7f170814b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 -- 172.21.15.134:0/2174204342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17080b55a0 con 0x7f170815b370 2024-09-15T22:42:20.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170d854640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 0x7f17080b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170c852640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c3c0 tx=0x7f16f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f80074e0 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f80047e0 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8004bd0 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.656+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17080b5880 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.657+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1708153d00 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.658+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1708153f00 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.658+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16f8011070 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.658+0000 7f16fdffb640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 0x7f16ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.658+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f16f808af70 con 0x7f170815b370 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.658+0000 7f170d053640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 0x7f16ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:20.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.659+0000 7f170d053640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 0x7f16ec06e7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:20.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.663+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1708153f00 con 0x7f170815b370 2024-09-15T22:42:20.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.895+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1708072560 con 0x7f170815b370 2024-09-15T22:42:20.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.897+0000 7f16fdffb640 1 -- 172.21.15.134:0/2174204342 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f16f80596e0 con 0x7f170815b370 2024-09-15T22:42:20.898 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:42:20.899 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 msgr2=0x7f16ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 0x7f16ec06e7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704008040 comp rx=0 tx=0).stop 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 msgr2=0x7f17080b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c3c0 tx=0x7f16f800c880 comp rx=0 tx=0).stop 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 shutdown_connections 2024-09-15T22:42:20.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f16ec06c2e0 0x7f16ec06e7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170815f9f0 0x7f17080b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f170815b370 0x7f17080b1bd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 --2- 172.21.15.134:0/2174204342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170806f130 0x7f170814b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 >> 172.21.15.134:0/2174204342 conn(0x7f170806bba0 msgr2=0x7f17080b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 shutdown_connections 2024-09-15T22:42:20.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:20.900+0000 7f170f2b7640 1 -- 172.21.15.134:0/2174204342 wait complete. 2024-09-15T22:42:20.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:20.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:42:20.960 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:42:21.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.016+0000 7fb9d6027640 1 Processor -- start 2024-09-15T22:42:21.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.016+0000 7fb9d6027640 1 -- start start 2024-09-15T22:42:21.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.016+0000 7fb9d6027640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 0x7fb9d00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.016+0000 7fb9d6027640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9d00cef90 0x7fb9d00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9d6027640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d00b7170 con 0x7fb9d015e940 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9d6027640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d00b7aa0 con 0x7fb9d00cef90 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9d6027640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d00d3660 con 0x7fb9d015ed20 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9d00cef90 0x7fb9d00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9d00cef90 0x7fb9d00b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51600/0 (socket says 172.21.15.134:51600) 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 -- 172.21.15.134:0/3023651430 learned_addr learned my addr 172.21.15.134:0/3023651430 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cf7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb9d015e940 0x7fb9d00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49430/0 (socket says 172.21.15.134:49430) 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9c7fff640 1 --2- 172.21.15.134:0/3023651430 >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 0x7fb9d00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 -- 172.21.15.134:0/3023651430 >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 msgr2=0x7fb9d00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 --2- 172.21.15.134:0/3023651430 >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 0x7fb9d00b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 -- 172.21.15.134:0/3023651430 >> v1:172.21.15.134:6789/0 conn(0x7fb9d015e940 legacy=0x7fb9d00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9cffff640 1 -- 172.21.15.134:0/3023651430 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d00d3940 con 0x7fb9d00cef90 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.017+0000 7fb9c7fff640 1 --2- 172.21.15.134:0/3023651430 >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 0x7fb9d00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9cffff640 1 --2- 172.21.15.134:0/3023651430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cef90 0x7fb9d00b3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb9d006e900 tx=0x7fb9c802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c94f677fd300c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9ceffd640 1 -- 172.21.15.134:0/3023651430 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8036070 con 0x7fb9d00cef90 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9ceffd640 1 -- 172.21.15.134:0/3023651430 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8031600 con 0x7fb9d00cef90 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9ceffd640 1 -- 172.21.15.134:0/3023651430 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80319f0 con 0x7fb9d00cef90 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 -- 172.21.15.134:0/3023651430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cef90 msgr2=0x7fb9d00b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 --2- 172.21.15.134:0/3023651430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cef90 0x7fb9d00b3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb9d006e900 tx=0x7fb9c802a7c0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 -- 172.21.15.134:0/3023651430 shutdown_connections 2024-09-15T22:42:21.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 --2- 172.21.15.134:0/3023651430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cef90 0x7fb9d00b3760 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 --2- 172.21.15.134:0/3023651430 >> v2:172.21.15.177:3300/0 conn(0x7fb9d015ed20 0x7fb9d00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 -- 172.21.15.134:0/3023651430 >> 172.21.15.134:0/3023651430 conn(0x7fb9d00b6240 msgr2=0x7fb9d00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 -- 172.21.15.134:0/3023651430 shutdown_connections 2024-09-15T22:42:21.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.018+0000 7fb9d6027640 1 -- 172.21.15.134:0/3023651430 wait complete. 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 Processor -- start 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 -- start start 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d00cef90 0x7fb9d0148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d015ed20 0x7fb9d015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d3310 con 0x7fb9d015e940 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d3f00 con 0x7fb9d015ed20 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9d6027640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d00d1ef0 con 0x7fb9d00cef90 2024-09-15T22:42:21.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51610/0 (socket says 172.21.15.134:51610) 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.020+0000 7fb9c7fff640 1 -- 172.21.15.134:0/1511414004 learned_addr learned my addr 172.21.15.134:0/1511414004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 -- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d00cef90 msgr2=0x7fb9d0148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d00cef90 0x7fb9d0148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 -- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d015ed20 msgr2=0x7fb9d015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9cffff640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d015ed20 0x7fb9d015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d015ed20 0x7fb9d015afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 -- 172.21.15.134:0/1511414004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d00abb40 con 0x7fb9d015e940 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9c7fff640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c7c0 tx=0x7fb9b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8015070 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8007820 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8007bf0 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d00cdf60 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.021+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d01492f0 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.022+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d00d1060 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.022+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb9b8018070 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.023+0000 7fb9ccff9640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 0x7fb9b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.023+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b808b280 con 0x7fb9d015e940 2024-09-15T22:42:21.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.023+0000 7fb9cf7fe640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 0x7fb9b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.023+0000 7fb9cf7fe640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 0x7fb9b006e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f60 tx=0x7fb9c0007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.027+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9d00abb40 con 0x7fb9d015e940 2024-09-15T22:42:21.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.229+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9d01623d0 con 0x7fb9d015e940 2024-09-15T22:42:21.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.229+0000 7fb9ccff9640 1 -- 172.21.15.134:0/1511414004 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5228 (secure 0 0 0) 0x7fb9b8059a80 con 0x7fb9d015e940 2024-09-15T22:42:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:21.231 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":14,"btime":"2024-09-15T22:42:14:903131+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:21.231 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 msgr2=0x7fb9b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 0x7fb9b006e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f60 tx=0x7fb9c0007a00 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 msgr2=0x7fb9d0148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c7c0 tx=0x7fb9b800cc80 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 shutdown_connections 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9b006c2b0 0x7fb9b006e770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d015ed20 0x7fb9d015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d015e940 0x7fb9d0148760 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 --2- 172.21.15.134:0/1511414004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d00cef90 0x7fb9d0148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 >> 172.21.15.134:0/1511414004 conn(0x7fb9d00b6240 msgr2=0x7fb9d015ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 shutdown_connections 2024-09-15T22:42:21.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.231+0000 7fb9d6027640 1 -- 172.21.15.134:0/1511414004 wait complete. 2024-09-15T22:42:21.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:42:12.212154+0000', 'modified': '2024-09-15T22:42:14.231926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4842}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4842': {'gid': 4842, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.134:6837/982036314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6835', 'nonce': 982036314}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 982036314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4842, 'qdb_cluster': [4842]} 2024-09-15T22:42:21.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:42:21.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:42:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.747+0000 7f520158d640 1 Processor -- start 2024-09-15T22:42:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.747+0000 7f520158d640 1 -- start start 2024-09-15T22:42:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f520158d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51fc0b5600 0x7f51fc073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f520158d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51fc073ff0 0x7f51fc06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f520158d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc06e8d0 con 0x7f51fc15e7b0 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f520158d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc06e680 con 0x7f51fc0b5600 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f520158d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc06ebb0 con 0x7f51fc073ff0 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51fc0b5600 0x7f51fc073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51fc0b5600 0x7f51fc073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51622/0 (socket says 172.21.15.134:51622) 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 -- 172.21.15.134:0/1201086810 learned_addr learned my addr 172.21.15.134:0/1201086810 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51faffd640 1 --1- 172.21.15.134:0/1201086810 >> v1:172.21.15.134:6789/0 conn(0x7f51fc15e7b0 0x7f51fc071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49440/0 (socket says 172.21.15.134:49440) 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/1201086810 >> v2:172.21.15.177:3300/0 conn(0x7f51fc073ff0 0x7f51fc06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 -- 172.21.15.134:0/1201086810 >> v2:172.21.15.177:3300/0 conn(0x7f51fc073ff0 msgr2=0x7f51fc06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/1201086810 >> v2:172.21.15.177:3300/0 conn(0x7f51fc073ff0 0x7f51fc06ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.748+0000 7f51fa7fc640 1 -- 172.21.15.134:0/1201086810 >> v1:172.21.15.134:6789/0 conn(0x7f51fc15e7b0 legacy=0x7f51fc071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51fa7fc640 1 -- 172.21.15.134:0/1201086810 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc0732b0 con 0x7f51fc0b5600 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51f9ffb640 1 -- 172.21.15.134:0/1201086810 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433342849 0 0) 0x7f51fc06e8d0 con 0x7f51fc15e7b0 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/1201086810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc073ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0b4df0 tx=0x7f51e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906d93d4d2551a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51f9ffb640 1 -- 172.21.15.134:0/1201086810 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4037070 con 0x7f51fc0b5600 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51f9ffb640 1 -- 172.21.15.134:0/1201086810 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4032440 con 0x7f51fc0b5600 2024-09-15T22:42:21.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.749+0000 7f51f9ffb640 1 -- 172.21.15.134:0/1201086810 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4032810 con 0x7f51fc0b5600 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 -- 172.21.15.134:0/1201086810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 msgr2=0x7f51fc073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 --2- 172.21.15.134:0/1201086810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc073ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0b4df0 tx=0x7f51e402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 -- 172.21.15.134:0/1201086810 shutdown_connections 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 --2- 172.21.15.134:0/1201086810 >> v2:172.21.15.177:3300/0 conn(0x7f51fc073ff0 0x7f51fc06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 --2- 172.21.15.134:0/1201086810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc073ab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 -- 172.21.15.134:0/1201086810 >> 172.21.15.134:0/1201086810 conn(0x7f51fc0b4300 msgr2=0x7f51fc0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 -- 172.21.15.134:0/1201086810 shutdown_connections 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.750+0000 7f520158d640 1 -- 172.21.15.134:0/1201086810 wait complete. 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.751+0000 7f520158d640 1 Processor -- start 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.751+0000 7f520158d640 1 -- start start 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51fc15e7b0 0x7f51fc0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 0x7f51fc1e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc06d370 con 0x7f51fc0b5600 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc06d1f0 con 0x7f51fc0ced00 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f520158d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc06d4f0 con 0x7f51fc15e7b0 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51638/0 (socket says 172.21.15.134:51638) 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 -- 172.21.15.134:0/2740678869 learned_addr learned my addr 172.21.15.134:0/2740678869 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 0x7f51fc1e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51fc15e7b0 0x7f51fc0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 -- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51fc15e7b0 msgr2=0x7f51fc0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51fc15e7b0 0x7f51fc0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 -- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 msgr2=0x7f51fc1e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 0x7f51fc1e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51faffd640 1 -- 172.21.15.134:0/2740678869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc1e9900 con 0x7f51fc0b5600 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.752+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 0x7f51fc1e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f51faffd640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c890 tx=0x7f51ec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f51f37fe640 1 -- 172.21.15.134:0/2740678869 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec018070 con 0x7f51fc0b5600 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f51f37fe640 1 -- 172.21.15.134:0/2740678869 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec00a640 con 0x7f51fc0b5600 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f51f37fe640 1 -- 172.21.15.134:0/2740678869 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00aa30 con 0x7f51fc0b5600 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc1e9620 con 0x7f51fc0b5600 2024-09-15T22:42:21.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.753+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc0cc410 con 0x7f51fc0b5600 2024-09-15T22:42:21.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.754+0000 7f51f37fe640 1 -- 172.21.15.134:0/2740678869 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51ec00abd0 con 0x7f51fc0b5600 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.755+0000 7f51f37fe640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 0x7f51dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.755+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 0x7f51dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.755+0000 7f51f37fe640 1 -- 172.21.15.134:0/2740678869 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f51ec08aa40 con 0x7f51fc0b5600 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.755+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 0x7f51dc06e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f51e4034000 tx=0x7f51e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.756+0000 7f5204400740 1 Processor -- start 2024-09-15T22:42:21.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.756+0000 7f5204400740 1 -- start start 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d924513a80 0x55d9245166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d9245108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d924478520 con 0x55d9245162c0 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9244203e0 con 0x55d924513a80 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55d9244744e0 con 0x55d924517a50 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51648/0 (socket says 172.21.15.134:51648) 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 -- 172.21.15.134:0/29811050 learned_addr learned my addr 172.21.15.134:0/29811050 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d924513a80 0x55d9245166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d9245108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 -- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 msgr2=0x55d9245108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d9245108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 -- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d924513a80 msgr2=0x55d9245166a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d924513a80 0x55d9245166a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 -- 172.21.15.134:0/29811050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d92443b2f0 con 0x55d9245162c0 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d9245108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51faffd640 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51ec088f90 tx=0x7f51ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c42af740b16c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51f0ff9640 1 -- 172.21.15.134:0/29811050 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec061690 con 0x55d9245162c0 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51f0ff9640 1 -- 172.21.15.134:0/29811050 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec056b50 con 0x55d9245162c0 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.757+0000 7f51f0ff9640 1 -- 172.21.15.134:0/29811050 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec055120 con 0x55d9245162c0 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 -- 172.21.15.134:0/29811050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 msgr2=0x55d92455ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51ec088f90 tx=0x7f51ec001250 comp rx=0 tx=0).stop 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 -- 172.21.15.134:0/29811050 shutdown_connections 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d9245108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d924513a80 0x55d9245166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 --2- 172.21.15.134:0/29811050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d9245162c0 0x55d92455ba60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 -- 172.21.15.134:0/29811050 >> 172.21.15.134:0/29811050 conn(0x55d924512a80 msgr2=0x55d92455af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 -- 172.21.15.134:0/29811050 shutdown_connections 2024-09-15T22:42:21.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.758+0000 7f5204400740 1 -- 172.21.15.134:0/29811050 wait complete. 2024-09-15T22:42:21.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.759+0000 7f5204400740 1 -- start start 2024-09-15T22:42:21.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.759+0000 7f5204400740 1 Processor -- start 2024-09-15T22:42:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d924511400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d924526290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d924511f20 con 0x55d924535350 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d924401450 con 0x55d9245162c0 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55d92455c290 con 0x55d924517a50 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 10 client.0 _ll_register_callbacks cb 0x55d92418aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51662/0 (socket says 172.21.15.134:51662) 2024-09-15T22:42:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 -- 172.21.15.134:0/563060843 learned_addr learned my addr 172.21.15.134:0/563060843 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d924526290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51faffd640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d924511400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 -- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 msgr2=0x55d924526290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d924526290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 -- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 msgr2=0x55d924511400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d924511400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 -- 172.21.15.134:0/563060843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92418b2d0 con 0x55d924535350 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4010550 tx=0x7f51f4010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d0e33dbaad87c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f400f040 con 0x55d924535350 2024-09-15T22:42:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f51f4014800 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51ec056b50 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f51f4024050 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 10 client.5049 fetch_fsmap learned FSMap version 14 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.760+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d9242556b0 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec056b50 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f51f4027020 con 0x55d924535350 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 10 client.5049 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 10 client.5049 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 20 client.5049 populate_metadata read hostname 'smithi134' 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92450f980 0x55d92456e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 4 client.5049 mds_command: new command op to 4842 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 --> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d924485c50 con 0x55d92450f980 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f51faffd640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92450f980 0x55d92456e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f51d9ffb640 10 client.5049 ms_handle_connect on v2:172.21.15.134:6835/982036314 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.761+0000 7f51faffd640 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92450f980 0x55d92456e470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc3a0a921c598d1 server_cookie=3d8373cf8c43ac86 in_seq=0 out_seq=0 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f51d9ffb640 1 -- 172.21.15.134:0/563060843 <== mds.0 v2:172.21.15.134:6835/982036314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d924485c50 con 0x55d92450f980 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f51d9ffb640 10 client.5049 handle_command_reply: tid=0 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 client.5049 shutdown 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 msgr2=0x55d9245267d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4010550 tx=0x7f51f4010a10 comp rx=0 tx=0).stop 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 shutdown_connections 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924535350 0x55d9245267d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92450f980 0x55d92456e470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924517a50 0x55d924526290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 --2- 172.21.15.134:0/563060843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d924511400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f51d9ffb640 0 client.5049 ms_handle_reset on v2:172.21.15.134:6835/982036314 2024-09-15T22:42:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 >> 172.21.15.134:0/563060843 conn(0x55d924513a80 msgr2=0x55d924558fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 shutdown_connections 2024-09-15T22:42:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 1 -- 172.21.15.134:0/563060843 wait complete. 2024-09-15T22:42:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.762+0000 7f5204400740 20 client.5049 trim_cache size 0 max 16384 2024-09-15T22:42:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.779+0000 7f5204400740 1 Processor -- start 2024-09-15T22:42:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.779+0000 7f5204400740 1 -- start start 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d92455ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245261b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc1ffa80 con 0x55d924517a50 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0687b0 con 0x55d9245162c0 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc1ff430 con 0x55d924535350 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51676/0 (socket says 172.21.15.134:51676) 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 -- 172.21.15.134:0/2484187795 learned_addr learned my addr 172.21.15.134:0/2484187795 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 -- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 msgr2=0x55d9245261b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 -- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 msgr2=0x55d92455ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d92455ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.780+0000 7f51fa7fc640 1 -- 172.21.15.134:0/2484187795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9245586b0 con 0x55d924517a50 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009960 tx=0x7f51e402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d56c627027bee14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f51dbfff640 1 -- 172.21.15.134:0/2484187795 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4037040 con 0x55d924517a50 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f51dbfff640 1 -- 172.21.15.134:0/2484187795 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4051070 con 0x55d924517a50 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f51dbfff640 1 -- 172.21.15.134:0/2484187795 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e403d470 con 0x55d924517a50 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 -- 172.21.15.134:0/2484187795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 msgr2=0x55d924515080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009960 tx=0x7f51e402c000 comp rx=0 tx=0).stop 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 -- 172.21.15.134:0/2484187795 shutdown_connections 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245261b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924515080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 --2- 172.21.15.134:0/2484187795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d92455ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 -- 172.21.15.134:0/2484187795 >> 172.21.15.134:0/2484187795 conn(0x55d924513a80 msgr2=0x55d92456a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 -- 172.21.15.134:0/2484187795 shutdown_connections 2024-09-15T22:42:21.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.781+0000 7f5204400740 1 -- 172.21.15.134:0/2484187795 wait complete. 2024-09-15T22:42:21.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.782+0000 7f5204400740 1 -- start start 2024-09-15T22:42:21.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.782+0000 7f5204400740 1 Processor -- start 2024-09-15T22:42:21.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d9245d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d924511990 con 0x55d924517a50 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d924538690 con 0x55d9245162c0 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55d92450fd80 con 0x55d924535350 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 10 client.0 _ll_register_callbacks cb 0x7f51f400e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51684/0 (socket says 172.21.15.134:51684) 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 -- 172.21.15.134:0/3699542041 learned_addr learned my addr 172.21.15.134:0/3699542041 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51faffd640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d9245d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 -- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 msgr2=0x55d9245112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 -- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 msgr2=0x55d9245d67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d9245d67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 -- 172.21.15.134:0/3699542041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92453fe00 con 0x55d924517a50 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fb7fe640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51faffd640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d9245d67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51fa7fc640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f51e40090b0 tx=0x7f51e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f232feee1b35455e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4059070 con 0x55d924517a50 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f51e4032c00 con 0x55d924517a50 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e4051070 con 0x55d924517a50 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f51e4064050 con 0x55d924517a50 2024-09-15T22:42:21.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 10 client.5055 fetch_fsmap learned FSMap version 14 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.783+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d9245577c0 con 0x55d924517a50 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4051070 con 0x55d924517a50 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f51e4067020 con 0x55d924517a50 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 10 client.5055 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 10 client.5055 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 20 client.5055 populate_metadata read hostname 'smithi134' 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92456db10 0x55d9245d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 4 client.5055 mds_command: new command op to 4842 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 --> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] -- command(tid 0: {"prefix": "status"}) -- 0x55d92447ffa0 con 0x55d92456db10 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51faffd640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92456db10 0x55d9245d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 10 client.5055 ms_handle_connect on v2:172.21.15.134:6835/982036314 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51faffd640 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92456db10 0x55d9245d9340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea24ab26f2323095 server_cookie=8f1f7401f776ecee in_seq=0 out_seq=0 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 1 -- 172.21.15.134:0/3699542041 <== mds.0 v2:172.21.15.134:6835/982036314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d92447ffa0 con 0x55d92456db10 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 10 client.5055 handle_command_reply: tid=0 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 client.5055 shutdown 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 msgr2=0x55d924510da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f51e40090b0 tx=0x7f51e4004730 comp rx=0 tx=0).stop 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 shutdown_connections 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:6835/982036314,v1:172.21.15.134:6837/982036314] conn(0x55d92456db10 0x55d9245d9340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d924535350 0x55d9245112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d924517a50 0x55d924510da0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f51d9ffb640 0 client.5055 ms_handle_reset on v2:172.21.15.134:6835/982036314 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 --2- 172.21.15.134:0/3699542041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9245162c0 0x55d9245d67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.784+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 >> 172.21.15.134:0/3699542041 conn(0x55d924513a80 msgr2=0x55d92457eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 shutdown_connections 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f5204400740 1 -- 172.21.15.134:0/3699542041 wait complete. 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f5204400740 20 client.5055 trim_cache size 0 max 16384 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4842, 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:42:21.793 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 8.9115691950000002, 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 14, 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 35, 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 35, 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 22.828707815000001 2024-09-15T22:42:21.794 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 msgr2=0x7f51dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 0x7f51dc06e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f51e4034000 tx=0x7f51e402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 msgr2=0x7f51fc14b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c890 tx=0x7f51ec00cd50 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 shutdown_connections 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f51dc06c2b0 0x7f51dc06e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51fc0ced00 0x7f51fc1e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51fc15e7b0 0x7f51fc0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 --2- 172.21.15.134:0/2740678869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51fc0b5600 0x7f51fc14b010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 >> 172.21.15.134:0/2740678869 conn(0x7f51fc0b4300 msgr2=0x7f51fc0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 shutdown_connections 2024-09-15T22:42:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.785+0000 7f520158d640 1 -- 172.21.15.134:0/2740678869 wait complete. 2024-09-15T22:42:21.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:42:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 Processor -- start 2024-09-15T22:42:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 -- start start 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60ac15c250 0x7f60ac15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60ac06e570 0x7f60ac0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac15fbf0 con 0x7f60ac0b6a20 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac0b7870 con 0x7f60ac06e570 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.895+0000 7f60b2fd6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac0708a0 con 0x7f60ac15c250 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60ac06e570 0x7f60ac0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60ac06e570 0x7f60ac0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51696/0 (socket says 172.21.15.134:51696) 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 -- 172.21.15.134:0/1776736863 learned_addr learned my addr 172.21.15.134:0/1776736863 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60b0d72640 1 --2- 172.21.15.134:0/1776736863 >> v2:172.21.15.177:3300/0 conn(0x7f60ac15c250 0x7f60ac15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 -- 172.21.15.134:0/1776736863 >> v2:172.21.15.177:3300/0 conn(0x7f60ac15c250 msgr2=0x7f60ac15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 --2- 172.21.15.134:0/1776736863 >> v2:172.21.15.177:3300/0 conn(0x7f60ac15c250 0x7f60ac15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 -- 172.21.15.134:0/1776736863 >> v1:172.21.15.177:6789/0 conn(0x7f60ac0b6a20 legacy=0x7f60ac0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.896+0000 7f60abfff640 1 -- 172.21.15.134:0/1776736863 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac071830 con 0x7f60ac06e570 2024-09-15T22:42:21.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60abfff640 1 --2- 172.21.15.134:0/1776736863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac06e570 0x7f60ac0712f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f60ac069160 tx=0x7f609c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2be5ed795960c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60ab7fe640 1 -- 172.21.15.134:0/1776736863 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c036070 con 0x7f60ac06e570 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60ab7fe640 1 -- 172.21.15.134:0/1776736863 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c031600 con 0x7f60ac06e570 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60ab7fe640 1 -- 172.21.15.134:0/1776736863 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c0319d0 con 0x7f60ac06e570 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 -- 172.21.15.134:0/1776736863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac06e570 msgr2=0x7f60ac0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/1776736863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac06e570 0x7f60ac0712f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f60ac069160 tx=0x7f609c02a730 comp rx=0 tx=0).stop 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 -- 172.21.15.134:0/1776736863 shutdown_connections 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/1776736863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac06e570 0x7f60ac0712f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/1776736863 >> v2:172.21.15.177:3300/0 conn(0x7f60ac15c250 0x7f60ac15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 -- 172.21.15.134:0/1776736863 >> 172.21.15.134:0/1776736863 conn(0x7f60ac0b4220 msgr2=0x7f60ac0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 -- 172.21.15.134:0/1776736863 shutdown_connections 2024-09-15T22:42:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.897+0000 7f60b2fd6640 1 -- 172.21.15.134:0/1776736863 wait complete. 2024-09-15T22:42:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.898+0000 7f60b2fd6640 1 Processor -- start 2024-09-15T22:42:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 -- start start 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60ac06e570 0x7f60ac15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 0x7f60ac0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac06ecf0 con 0x7f60ac15c250 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac070e60 con 0x7f60ac06e570 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.899+0000 7f60b2fd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac070af0 con 0x7f60ac0b6a20 2024-09-15T22:42:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51706/0 (socket says 172.21.15.134:51706) 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 -- 172.21.15.134:0/621214796 learned_addr learned my addr 172.21.15.134:0/621214796 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b0d72640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60ac06e570 0x7f60ac15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60abfff640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 0x7f60ac0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 -- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 msgr2=0x7f60ac0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 0x7f60ac0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 -- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60ac06e570 msgr2=0x7f60ac15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60ac06e570 0x7f60ac15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 -- 172.21.15.134:0/621214796 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac0cd210 con 0x7f60ac15c250 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60abfff640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 0x7f60ac0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b1573640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6094001eb0 tx=0x7f609400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094017070 con 0x7f60ac15c250 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60940052d0 con 0x7f60ac15c250 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac157bf0 con 0x7f60ac15c250 2024-09-15T22:42:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094003810 con 0x7f60ac15c250 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.900+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac1f8310 con 0x7f60ac15c250 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.901+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac0b7650 con 0x7f60ac15c250 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.902+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f609401a070 con 0x7f60ac15c250 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.902+0000 7f60a97fa640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 0x7f608c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.902+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f609408a730 con 0x7f60ac15c250 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.902+0000 7f60b0d72640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 0x7f608c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.903+0000 7f60b0d72640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 0x7f608c06e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009aa0 tx=0x7f60a4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:21.907+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6094058850 con 0x7f60ac15c250 2024-09-15T22:42:22.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.108+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f60ac071a60 con 0x7f60ac15c250 2024-09-15T22:42:22.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.108+0000 7f60a97fa640 1 -- 172.21.15.134:0/621214796 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f609405cb50 con 0x7f60ac15c250 2024-09-15T22:42:22.110 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 msgr2=0x7f608c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 0x7f608c06e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009aa0 tx=0x7f60a4009190 comp rx=0 tx=0).stop 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 msgr2=0x7f60ac1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6094001eb0 tx=0x7f609400c890 comp rx=0 tx=0).stop 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 shutdown_connections 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608c06c2e0 0x7f608c06e7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60ac15c250 0x7f60ac1576b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60ac0b6a20 0x7f60ac0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:22.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 --2- 172.21.15.134:0/621214796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60ac06e570 0x7f60ac15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:22.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 >> 172.21.15.134:0/621214796 conn(0x7f60ac0b4220 msgr2=0x7f60ac0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:22.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 shutdown_connections 2024-09-15T22:42:22.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22.110+0000 7f60b2fd6640 1 -- 172.21.15.134:0/621214796 wait complete. 2024-09-15T22:42:22.122 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:42:22.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:42:22.123 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:22.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.123 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:42:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42751sec preferred_lft 42751sec 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:42:22.141 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:22.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.143 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:42:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:42:22.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.206 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:42:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:42:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:42:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:42:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:42:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:42:22.263 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:42:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:42:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:22.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.387 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:42:22.402 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:42:22.403 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:42:22.403 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:22.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:42:22.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:22.468 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:22.524 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:22.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:22.524 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:22.579 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:42:22.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:22.663 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:22.663 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:22.671 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:22.672 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:22.672 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:22.672 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:22.672 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:42:22.677 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:42:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:42:22.680 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:42:22.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:22.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:22.746 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:42:22.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:42:22.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:22.845 INFO:teuthology.orchestra.run.smithi134.stdout:client4658 2024-09-15T22:42:22.846 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:22.846 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:22.862 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:42:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.001+0000 7f55859e8640 1 Processor -- start 2024-09-15T22:42:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.001+0000 7f55859e8640 1 -- start start 2024-09-15T22:42:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f55859e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55800cf070 0x7f55800cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f55859e8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 0x7f5580073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f55859e8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55800ce740 con 0x7f558015c180 2024-09-15T22:42:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f55859e8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5580072640 con 0x7f55800cf070 2024-09-15T22:42:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f55859e8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5580072920 con 0x7f5580073120 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f557e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55800cf070 0x7f55800cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f557e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55800cf070 0x7f55800cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51720/0 (socket says 172.21.15.134:51720) 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.002+0000 7f557e7fc640 1 -- 172.21.15.134:0/1053869082 learned_addr learned my addr 172.21.15.134:0/1053869082 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557f7fe640 1 --2- 172.21.15.134:0/1053869082 >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 0x7f5580073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557e7fc640 1 -- 172.21.15.134:0/1053869082 >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 msgr2=0x7f5580073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557e7fc640 1 --2- 172.21.15.134:0/1053869082 >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 0x7f5580073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557e7fc640 1 -- 172.21.15.134:0/1053869082 >> v1:172.21.15.177:6789/0 conn(0x7f558015c180 legacy=0x7f55800cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557e7fc640 1 -- 172.21.15.134:0/1053869082 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5580072c00 con 0x7f55800cf070 2024-09-15T22:42:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557f7fe640 1 --2- 172.21.15.134:0/1053869082 >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 0x7f5580073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.003+0000 7f557e7fc640 1 --2- 172.21.15.134:0/1053869082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55800cf070 0x7f55800cf4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55800cd070 tx=0x7f557402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6178776ad22dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f557dffb640 1 -- 172.21.15.134:0/1053869082 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574037070 con 0x7f55800cf070 2024-09-15T22:42:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f557dffb640 1 -- 172.21.15.134:0/1053869082 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5574032440 con 0x7f55800cf070 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f557dffb640 1 -- 172.21.15.134:0/1053869082 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574032810 con 0x7f55800cf070 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 -- 172.21.15.134:0/1053869082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55800cf070 msgr2=0x7f55800cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 --2- 172.21.15.134:0/1053869082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55800cf070 0x7f55800cf4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55800cd070 tx=0x7f557402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 -- 172.21.15.134:0/1053869082 shutdown_connections 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 --2- 172.21.15.134:0/1053869082 >> v2:172.21.15.177:3300/0 conn(0x7f5580073120 0x7f5580073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 --2- 172.21.15.134:0/1053869082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55800cf070 0x7f55800cf4e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 -- 172.21.15.134:0/1053869082 >> 172.21.15.134:0/1053869082 conn(0x7f5580062cc0 msgr2=0x7f558006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 -- 172.21.15.134:0/1053869082 shutdown_connections 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.004+0000 7f55859e8640 1 -- 172.21.15.134:0/1053869082 wait complete. 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.005+0000 7f55859e8640 1 Processor -- start 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 -- start start 2024-09-15T22:42:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 0x7f55800adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f558015c180 0x7f5580157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55800722f0 con 0x7f5580073120 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55800ced00 con 0x7f558015c180 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f55859e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f558015c560 con 0x7f55800cf070 2024-09-15T22:42:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f557effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f557effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51736/0 (socket says 172.21.15.134:51736) 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.006+0000 7f557effd640 1 -- 172.21.15.134:0/930128232 learned_addr learned my addr 172.21.15.134:0/930128232 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557e7fc640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 0x7f55800adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557f7fe640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f558015c180 0x7f5580157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 -- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 msgr2=0x7f55800adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 0x7f55800adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 -- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f558015c180 msgr2=0x7f5580157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f558015c180 0x7f5580157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 -- 172.21.15.134:0/930128232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55800ae2e0 con 0x7f5580073120 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557e7fc640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 0x7f55800adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f557effd640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f557000b420 tx=0x7f557000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570011830 con 0x7f5580073120 2024-09-15T22:42:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5570016070 con 0x7f5580073120 2024-09-15T22:42:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55800ae5c0 con 0x7f5580073120 2024-09-15T22:42:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570011c10 con 0x7f5580073120 2024-09-15T22:42:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.007+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55800abbf0 con 0x7f5580073120 2024-09-15T22:42:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.008+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55800cf4e0 con 0x7f5580073120 2024-09-15T22:42:23.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.009+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f557001b460 con 0x7f5580073120 2024-09-15T22:42:23.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.009+0000 7f5567fff640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 0x7f556c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.009+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f557008af10 con 0x7f5580073120 2024-09-15T22:42:23.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.009+0000 7f557e7fc640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 0x7f556c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.009+0000 7f557e7fc640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 0x7f556c06e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5574034000 tx=0x7f557402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:23.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.013+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5570020020 con 0x7f5580073120 2024-09-15T22:42:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.210+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55801590d0 con 0x7f5580073120 2024-09-15T22:42:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.211+0000 7f5567fff640 1 -- 172.21.15.134:0/930128232 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f5570059680 con 0x7f5580073120 2024-09-15T22:42:23.212 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:42:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 msgr2=0x7f556c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 0x7f556c06e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5574034000 tx=0x7f557402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 msgr2=0x7f55800ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f557000b420 tx=0x7f557000b8e0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 shutdown_connections 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f556c06c2b0 0x7f556c06e770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f558015c180 0x7f5580157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55800cf070 0x7f55800adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 --2- 172.21.15.134:0/930128232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580073120 0x7f55800ab170 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 >> 172.21.15.134:0/930128232 conn(0x7f5580062cc0 msgr2=0x7f558006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 shutdown_connections 2024-09-15T22:42:23.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:23.213+0000 7f55859e8640 1 -- 172.21.15.134:0/930128232 wait complete. 2024-09-15T22:42:23.225 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:42:23.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:42:23.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:42:23.226 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.226 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:42:23.247 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:42:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:42:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:42:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:23.248 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:42:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:23.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.251 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:42:23.315 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:42:23.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.317 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:42:23.376 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:42:23.376 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:42:23.376 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:42:23.376 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:42:23.376 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:42:23.377 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:42:23.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:42:23.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:23.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.509 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:42:23.525 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:42:23.525 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:42:23.526 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:23.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.526 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:42:23.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:23.591 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:23.647 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:23.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:23.647 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:23.702 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:42:23.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:23.794 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:23.794 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:23.794 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:23.794 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:23.794 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:42:23.800 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:42:23.801 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:42:23.801 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:42:23.801 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:42:23.801 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:42:23.801 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:42:23.802 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:42:23.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:23.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:23.869 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:42:23.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:42:23.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:23.966 INFO:teuthology.orchestra.run.smithi177.stdout:client5070 2024-09-15T22:42:23.966 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:23.967 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:23.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:42:24.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.090+0000 7f61a4ed7640 1 Processor -- start 2024-09-15T22:42:24.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.090+0000 7f61a4ed7640 1 -- start start 2024-09-15T22:42:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f61a4ed7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61a015e770 0x7f61a00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f61a4ed7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00d2320 con 0x7f61a00b6710 2024-09-15T22:42:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f61a4ed7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00d25e0 con 0x7f61a00b3b40 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f61a4ed7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f61a015eb50 con 0x7f61a015e770 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f619dd9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f61a00b6710 0x7f61a00b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49448/0 (socket says 172.21.15.134:49448) 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.091+0000 7f619dd9b640 1 -- 172.21.15.134:0/651759281 learned_addr learned my addr 172.21.15.134:0/651759281 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619e59c640 1 --2- 172.21.15.134:0/651759281 >> v2:172.21.15.177:3300/0 conn(0x7f61a015e770 0x7f61a00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926069797 0 0) 0x7f61a00d2320 con 0x7f61a00b6710 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6188003520 con 0x7f61a00b6710 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290605236 0 0) 0x7f61a00d25e0 con 0x7f61a00b3b40 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a00d2320 con 0x7f61a00b3b40 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619e59c640 1 -- 172.21.15.134:0/651759281 >> v1:172.21.15.177:6789/0 conn(0x7f61a00b3b40 legacy=0x7f61a00d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619e59c640 1 -- 172.21.15.134:0/651759281 >> v1:172.21.15.134:6789/0 conn(0x7f61a00b6710 legacy=0x7f61a00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619e59c640 1 -- 172.21.15.134:0/651759281 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00d28c0 con 0x7f61a015e770 2024-09-15T22:42:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.092+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 265164425 0 0) 0x7f6188003520 con 0x7f61a00b6710 2024-09-15T22:42:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f619e59c640 1 --2- 172.21.15.134:0/651759281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a015e770 0x7f61a00b61d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61900097a0 tx=0x7f619002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=407185d6b84ebc34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190037070 con 0x7f61a015e770 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6190032440 con 0x7f61a015e770 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f619d59a640 1 -- 172.21.15.134:0/651759281 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190032810 con 0x7f61a015e770 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f61a4ed7640 1 -- 172.21.15.134:0/651759281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a015e770 msgr2=0x7f61a00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/651759281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a015e770 0x7f61a00b61d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61900097a0 tx=0x7f619002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f61a4ed7640 1 -- 172.21.15.134:0/651759281 shutdown_connections 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/651759281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a015e770 0x7f61a00b61d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.093+0000 7f61a4ed7640 1 -- 172.21.15.134:0/651759281 >> 172.21.15.134:0/651759281 conn(0x7f61a0062a50 msgr2=0x7f61a0062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.094+0000 7f61a4ed7640 1 -- 172.21.15.134:0/651759281 shutdown_connections 2024-09-15T22:42:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.094+0000 7f61a4ed7640 1 -- 172.21.15.134:0/651759281 wait complete. 2024-09-15T22:42:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.095+0000 7f61a4ed7640 1 Processor -- start 2024-09-15T22:42:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.095+0000 7f61a4ed7640 1 -- start start 2024-09-15T22:42:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a00b6710 0x7f61a015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61a015e770 0x7f61a00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00d2e80 con 0x7f61a00b3b40 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00b6b60 con 0x7f61a00b6710 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00b76a0 con 0x7f61a015e770 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51738/0 (socket says 172.21.15.134:51738) 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 -- 172.21.15.134:0/2008184308 learned_addr learned my addr 172.21.15.134:0/2008184308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:24.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619dd9b640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a00b6710 0x7f61a015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:24.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619ed9d640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61a015e770 0x7f61a00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:24.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 -- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61a015e770 msgr2=0x7f61a00ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61a015e770 0x7f61a00ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 -- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a00b6710 msgr2=0x7f61a015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a00b6710 0x7f61a015ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 -- 172.21.15.134:0/2008184308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a015ef20 con 0x7f61a00b3b40 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f619e59c640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61900098c0 tx=0x7f61900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190041020 con 0x7f61a00b3b40 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619003d6e0 con 0x7f61a00b3b40 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190037040 con 0x7f61a00b3b40 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a015f200 con 0x7f61a00b3b40 2024-09-15T22:42:24.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.096+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a015f7c0 con 0x7f61a00b3b40 2024-09-15T22:42:24.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.097+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a00b61d0 con 0x7f61a00b3b40 2024-09-15T22:42:24.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.098+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6190044020 con 0x7f61a00b3b40 2024-09-15T22:42:24.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.098+0000 7f618effd640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:24.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.098+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f61900abaf0 con 0x7f61a00b3b40 2024-09-15T22:42:24.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.098+0000 7f619dd9b640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:24.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.099+0000 7f619dd9b640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 0x7f618006e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b3aa0 tx=0x7f6194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:24.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.103+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f619004b030 con 0x7f61a00b3b40 2024-09-15T22:42:24.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.303+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f61a00b47c0 con 0x7f61a00b3b40 2024-09-15T22:42:24.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.935+0000 7f618effd640 1 -- 172.21.15.134:0/2008184308 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f6190079c10 con 0x7f61a00b3b40 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 msgr2=0x7f618006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 0x7f618006e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b3aa0 tx=0x7f6194009040 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 msgr2=0x7f61a0158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61900098c0 tx=0x7f61900046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 shutdown_connections 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61a015e770 0x7f61a00ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61a00b6710 0x7f61a015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 --2- 172.21.15.134:0/2008184308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00b3b40 0x7f61a0158eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 >> 172.21.15.134:0/2008184308 conn(0x7f61a0062a50 msgr2=0x7f61a00b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:24.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 shutdown_connections 2024-09-15T22:42:24.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:24.937+0000 7f61a4ed7640 1 -- 172.21.15.134:0/2008184308 wait complete. 2024-09-15T22:42:24.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:42:25.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.050+0000 7f0bc139f640 1 Processor -- start 2024-09-15T22:42:25.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.050+0000 7f0bc139f640 1 -- start start 2024-09-15T22:42:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bc139f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0bbc15eb20 0x7f0bbc0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bc139f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 0x7f0bbc0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bc139f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc06cd50 con 0x7f0bbc073c20 2024-09-15T22:42:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bc139f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0bbc06d610 con 0x7f0bbc15eb20 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bc139f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0bbc0b7840 con 0x7f0bbc0b5690 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bbaffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0bbc15eb20 0x7f0bbc0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bbb7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0bbc073c20 0x7f0bbc0d2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49460/0 (socket says 172.21.15.134:49460) 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bbb7fe640 1 -- 172.21.15.134:0/657031115 learned_addr learned my addr 172.21.15.134:0/657031115 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.051+0000 7f0bba7fc640 1 --2- 172.21.15.134:0/657031115 >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 0x7f0bbc0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bbaffd640 1 -- 172.21.15.134:0/657031115 >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 msgr2=0x7f0bbc0b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bbaffd640 1 --2- 172.21.15.134:0/657031115 >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 0x7f0bbc0b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bbaffd640 1 -- 172.21.15.134:0/657031115 >> v1:172.21.15.134:6789/0 conn(0x7f0bbc073c20 legacy=0x7f0bbc0d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bbaffd640 1 -- 172.21.15.134:0/657031115 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc06cfc0 con 0x7f0bbc15eb20 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bb9ffb640 1 -- 172.21.15.134:0/657031115 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121592584 0 0) 0x7f0bbc06cd50 con 0x7f0bbc073c20 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bba7fc640 1 --2- 172.21.15.134:0/657031115 >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 0x7f0bbc0b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bbaffd640 1 --2- 172.21.15.134:0/657031115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc15eb20 0x7f0bbc0b6dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0b1740 tx=0x7f0bac02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d4467c7d717c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bb9ffb640 1 -- 172.21.15.134:0/657031115 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007740 con 0x7f0bbc15eb20 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bb9ffb640 1 -- 172.21.15.134:0/657031115 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac0078e0 con 0x7f0bbc15eb20 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.052+0000 7f0bb9ffb640 1 -- 172.21.15.134:0/657031115 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007cb0 con 0x7f0bbc15eb20 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 -- 172.21.15.134:0/657031115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc15eb20 msgr2=0x7f0bbc0b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 --2- 172.21.15.134:0/657031115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc15eb20 0x7f0bbc0b6dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0b1740 tx=0x7f0bac02a680 comp rx=0 tx=0).stop 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 -- 172.21.15.134:0/657031115 shutdown_connections 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 --2- 172.21.15.134:0/657031115 >> v2:172.21.15.177:3300/0 conn(0x7f0bbc0b5690 0x7f0bbc0b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 --2- 172.21.15.134:0/657031115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc15eb20 0x7f0bbc0b6dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 -- 172.21.15.134:0/657031115 >> 172.21.15.134:0/657031115 conn(0x7f0bbc062630 msgr2=0x7f0bbc062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 -- 172.21.15.134:0/657031115 shutdown_connections 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.053+0000 7f0bc139f640 1 -- 172.21.15.134:0/657031115 wait complete. 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.054+0000 7f0bc139f640 1 Processor -- start 2024-09-15T22:42:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.054+0000 7f0bc139f640 1 -- start start 2024-09-15T22:42:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bbc0b5690 0x7f0bbc0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bbc15eb20 0x7f0bbc0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc06eab0 con 0x7f0bbc073c20 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc074120 con 0x7f0bbc0b5690 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bc139f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0bbc06ec30 con 0x7f0bbc15eb20 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51764/0 (socket says 172.21.15.134:51764) 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 -- 172.21.15.134:0/3220409480 learned_addr learned my addr 172.21.15.134:0/3220409480 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 -- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bbc15eb20 msgr2=0x7f0bbc0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bbc15eb20 0x7f0bbc0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 -- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bbc0b5690 msgr2=0x7f0bbc0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bbc0b5690 0x7f0bbc0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.055+0000 7f0bbaffd640 1 -- 172.21.15.134:0/3220409480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc15f030 con 0x7f0bbc073c20 2024-09-15T22:42:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0bbaffd640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bac000f80 tx=0x7f0bac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac03f070 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac031c40 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bbc15f2d0 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac044460 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.056+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bbc0d08c0 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.057+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bbc0d1fe0 con 0x7f0bbc073c20 2024-09-15T22:42:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.057+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0bac044600 con 0x7f0bbc073c20 2024-09-15T22:42:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.058+0000 7f0ba37fe640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 0x7f0ba806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.058+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f0bac0acc70 con 0x7f0bbc073c20 2024-09-15T22:42:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.058+0000 7f0bba7fc640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 0x7f0ba806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.058+0000 7f0bba7fc640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 0x7f0ba806e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0006fd0 tx=0x7f0bb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.062+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bac07b470 con 0x7f0bbc073c20 2024-09-15T22:42:25.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.248+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f0bbc0cc070 con 0x7f0ba806c2b0 2024-09-15T22:42:25.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.250+0000 7f0ba37fe640 1 -- 172.21.15.134:0/3220409480 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f0bbc0cc070 con 0x7f0ba806c2b0 2024-09-15T22:42:25.252 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:42:25.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:25.253 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:42:25.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:25.253 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 msgr2=0x7f0ba806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 0x7f0ba806e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0006fd0 tx=0x7f0bb0008040 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 msgr2=0x7f0bbc1491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bac000f80 tx=0x7f0bac004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 shutdown_connections 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0ba806c2b0 0x7f0ba806e770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bbc15eb20 0x7f0bbc0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bbc0b5690 0x7f0bbc0b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 --2- 172.21.15.134:0/3220409480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bbc073c20 0x7f0bbc1491d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 >> 172.21.15.134:0/3220409480 conn(0x7f0bbc062630 msgr2=0x7f0bbc062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 shutdown_connections 2024-09-15T22:42:25.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.252+0000 7f0bc139f640 1 -- 172.21.15.134:0/3220409480 wait complete. 2024-09-15T22:42:25.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:42:25.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.366+0000 7f81486ac640 1 Processor -- start 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.366+0000 7f81486ac640 1 -- start start 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f81486ac640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81400cfa90 0x7f81400cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f81486ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81400cff20 con 0x7f814015c5e0 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f81486ac640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8140070b20 con 0x7f8140071600 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f81486ac640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8140070e00 con 0x7f81400cfa90 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8145c47640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81400cfa90 0x7f81400cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8146448640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f814015c5e0 0x7f81400d23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49476/0 (socket says 172.21.15.134:49476) 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8146448640 1 -- 172.21.15.134:0/2109961937 learned_addr learned my addr 172.21.15.134:0/2109961937 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8145c47640 1 -- 172.21.15.134:0/2109961937 >> v1:172.21.15.177:6789/0 conn(0x7f8140071600 legacy=0x7f81400b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8145c47640 1 -- 172.21.15.134:0/2109961937 >> v1:172.21.15.134:6789/0 conn(0x7f814015c5e0 legacy=0x7f81400d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.367+0000 7f8145c47640 1 -- 172.21.15.134:0/2109961937 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81400710e0 con 0x7f81400cfa90 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f8145c47640 1 --2- 172.21.15.134:0/2109961937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81400cfa90 0x7f81400cefb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81300097d0 tx=0x7f813002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8967d2cfdbca93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f8145446640 1 -- 172.21.15.134:0/2109961937 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130037070 con 0x7f81400cfa90 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f8145446640 1 -- 172.21.15.134:0/2109961937 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130032440 con 0x7f81400cfa90 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f8145446640 1 -- 172.21.15.134:0/2109961937 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130032810 con 0x7f81400cfa90 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f81486ac640 1 -- 172.21.15.134:0/2109961937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81400cfa90 msgr2=0x7f81400cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.368+0000 7f81486ac640 1 --2- 172.21.15.134:0/2109961937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81400cfa90 0x7f81400cefb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81300097d0 tx=0x7f813002a180 comp rx=0 tx=0).stop 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.369+0000 7f81486ac640 1 -- 172.21.15.134:0/2109961937 shutdown_connections 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.369+0000 7f81486ac640 1 --2- 172.21.15.134:0/2109961937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81400cfa90 0x7f81400cefb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.369+0000 7f81486ac640 1 -- 172.21.15.134:0/2109961937 >> 172.21.15.134:0/2109961937 conn(0x7f814006f310 msgr2=0x7f814006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.369+0000 7f81486ac640 1 -- 172.21.15.134:0/2109961937 shutdown_connections 2024-09-15T22:42:25.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.369+0000 7f81486ac640 1 -- 172.21.15.134:0/2109961937 wait complete. 2024-09-15T22:42:25.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 Processor -- start 2024-09-15T22:42:25.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 -- start start 2024-09-15T22:42:25.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8140071600 0x7f814014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f814015c5e0 0x7f814015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.370+0000 7f81486ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81400b1f90 con 0x7f814015ee60 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f81486ac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81400b1e10 con 0x7f8140071600 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f81486ac640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f81400d2ac0 con 0x7f814015c5e0 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51794/0 (socket says 172.21.15.134:51794) 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 -- 172.21.15.134:0/4207619342 learned_addr learned my addr 172.21.15.134:0/4207619342 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146448640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8140071600 0x7f814014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8145c47640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f814015c5e0 0x7f814015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 -- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f814015c5e0 msgr2=0x7f814015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f814015c5e0 0x7f814015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 -- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8140071600 msgr2=0x7f814014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8140071600 0x7f814014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 -- 172.21.15.134:0/4207619342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814015db20 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8146c49640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c410 tx=0x7f813c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c017070 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c007230 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c007660 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814015ddc0 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.371+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814015e380 con 0x7f814015ee60 2024-09-15T22:42:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.372+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81400b76d0 con 0x7f814015ee60 2024-09-15T22:42:25.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.373+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f813c01a070 con 0x7f814015ee60 2024-09-15T22:42:25.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.373+0000 7f8136ffd640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 0x7f812406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.373+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f813c08a650 con 0x7f814015ee60 2024-09-15T22:42:25.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.373+0000 7f8146448640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 0x7f812406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.374+0000 7f8146448640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 0x7f812406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f81380012e0 tx=0x7f8138001990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.378+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f813c058800 con 0x7f814015ee60 2024-09-15T22:42:25.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.544+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f81400b1a30 con 0x7f814015ee60 2024-09-15T22:42:25.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.544+0000 7f8136ffd640 1 -- 172.21.15.134:0/4207619342 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f813c05cb00 con 0x7f814015ee60 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 msgr2=0x7f812406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 0x7f812406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f81380012e0 tx=0x7f8138001990 comp rx=0 tx=0).stop 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 msgr2=0x7f81400b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c410 tx=0x7f813c00c8d0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 shutdown_connections 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f812406c2b0 0x7f812406e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f814015ee60 0x7f81400b5c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f814015c5e0 0x7f814015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 --2- 172.21.15.134:0/4207619342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8140071600 0x7f814014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.546+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 >> 172.21.15.134:0/4207619342 conn(0x7f814006f310 msgr2=0x7f81400b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:25.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.547+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 shutdown_connections 2024-09-15T22:42:25.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.547+0000 7f81486ac640 1 -- 172.21.15.134:0/4207619342 wait complete. 2024-09-15T22:42:25.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:25.560 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp33340/subvol39630) 2024-09-15T22:42:25.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:25.590 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:42:25.646 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:42:25.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:25.647 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp33340/subvol39630) 2024-09-15T22:42:25.733 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:25.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp33340/subvol39630/.meta 2024-09-15T22:42:25.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol39630 subvol_grp33340 2024-09-15T22:42:25.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 Processor -- start 2024-09-15T22:42:25.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 -- start start 2024-09-15T22:42:25.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f511c0b3b00 0x7f511c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f511c0b3540 0x7f511c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c0d20e0 con 0x7f511c0b61e0 2024-09-15T22:42:25.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f511c0d24f0 con 0x7f511c0b3b00 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.901+0000 7f5120827640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f511c0cfa70 con 0x7f511c0b3540 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f511c0b3b00 0x7f511c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f511a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f511c0b61e0 0x7f511c0b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49484/0 (socket says 172.21.15.134:49484) 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f511a59c640 1 -- 172.21.15.134:0/95619915 learned_addr learned my addr 172.21.15.134:0/95619915 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 --2- 172.21.15.134:0/95619915 >> v2:172.21.15.134:3300/0 conn(0x7f511c0b3b00 0x7f511c0d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51808/0 (socket says 172.21.15.134:51808) 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f511ad9d640 1 --2- 172.21.15.134:0/95619915 >> v2:172.21.15.177:3300/0 conn(0x7f511c0b3540 0x7f511c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 -- 172.21.15.134:0/95619915 >> v2:172.21.15.177:3300/0 conn(0x7f511c0b3540 msgr2=0x7f511c0d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 --2- 172.21.15.134:0/95619915 >> v2:172.21.15.177:3300/0 conn(0x7f511c0b3540 0x7f511c0d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 -- 172.21.15.134:0/95619915 >> v1:172.21.15.134:6789/0 conn(0x7f511c0b61e0 legacy=0x7f511c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5119d9b640 1 -- 172.21.15.134:0/95619915 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233088091 0 0) 0x7f511c0d20e0 con 0x7f511c0b61e0 2024-09-15T22:42:25.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.902+0000 7f5113fff640 1 -- 172.21.15.134:0/95619915 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c0cfd50 con 0x7f511c0b3b00 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5113fff640 1 --2- 172.21.15.134:0/95619915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c0d2980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f511c08d930 tx=0x7f510402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355355ef8f111fba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5119d9b640 1 -- 172.21.15.134:0/95619915 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104037070 con 0x7f511c0b3b00 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5119d9b640 1 -- 172.21.15.134:0/95619915 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510402add0 con 0x7f511c0b3b00 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5119d9b640 1 -- 172.21.15.134:0/95619915 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104032660 con 0x7f511c0b3b00 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 -- 172.21.15.134:0/95619915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 msgr2=0x7f511c0d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 --2- 172.21.15.134:0/95619915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c0d2980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f511c08d930 tx=0x7f510402a080 comp rx=0 tx=0).stop 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 -- 172.21.15.134:0/95619915 shutdown_connections 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 --2- 172.21.15.134:0/95619915 >> v2:172.21.15.177:3300/0 conn(0x7f511c0b3540 0x7f511c0d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 --2- 172.21.15.134:0/95619915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c0d2980 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 -- 172.21.15.134:0/95619915 >> 172.21.15.134:0/95619915 conn(0x7f511c0d11e0 msgr2=0x7f511c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:25.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 -- 172.21.15.134:0/95619915 shutdown_connections 2024-09-15T22:42:25.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.903+0000 7f5120827640 1 -- 172.21.15.134:0/95619915 wait complete. 2024-09-15T22:42:25.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.905+0000 7f5120827640 1 Processor -- start 2024-09-15T22:42:25.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.905+0000 7f5120827640 1 -- start start 2024-09-15T22:42:25.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 0x7f511c1ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 0x7f511c0b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f511c15edc0 con 0x7f511c0b3b00 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f511c0d1d00 con 0x7f511c0b61e0 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f511c1e90f0 con 0x7f511c0b3540 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51814/0 (socket says 172.21.15.134:51814) 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 -- 172.21.15.134:0/318267302 learned_addr learned my addr 172.21.15.134:0/318267302 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f511ad9d640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 0x7f511c0b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 -- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 msgr2=0x7f511c1ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f511a59c640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 0x7f511c1ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 0x7f511c1ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 -- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 msgr2=0x7f511c0b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 0x7f511c0b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:25.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 -- 172.21.15.134:0/318267302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c1e87c0 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f511ad9d640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 0x7f511c0b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f511a59c640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 0x7f511c1ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5113fff640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5104035040 tx=0x7f51040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104037050 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5104038040 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c1e8aa0 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104004470 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.906+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c1ea8a0 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.907+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c0b65c0 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.908+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f510402ac90 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.908+0000 7f5112ffd640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 0x7f50fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.908+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f51040abc00 con 0x7f511c0b3b00 2024-09-15T22:42:25.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.908+0000 7f511a59c640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 0x7f50fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:25.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.909+0000 7f511a59c640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 0x7f50fc06e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f60 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:25.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:25.912+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51040b2080 con 0x7f511c0b3b00 2024-09-15T22:42:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.104+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol39630", "group_name": "subvol_grp33340", "target": ["mon-mgr", ""]}) -- 0x7f511c0b6d80 con 0x7f50fc06c2b0 2024-09-15T22:42:26.110 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:26.108+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:26.110 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:26.108+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:26.110 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:26.108+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:26.110 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:26.108+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:26.110 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:26.108+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.143+0000 7f5112ffd640 1 -- 172.21.15.134:0/318267302 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f511c0b6d80 con 0x7f50fc06c2b0 2024-09-15T22:42:26.145 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp33340/subvol39630 2024-09-15T22:42:26.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 msgr2=0x7f50fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 0x7f50fc06e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f60 tx=0x7f510c009040 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 msgr2=0x7f511c152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5104035040 tx=0x7f51040046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 shutdown_connections 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50fc06c2b0 0x7f50fc06e770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f511c0b61e0 0x7f511c0b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f511c0b3b00 0x7f511c152ab0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 --2- 172.21.15.134:0/318267302 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f511c0b3540 0x7f511c1ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 >> 172.21.15.134:0/318267302 conn(0x7f511c0d11e0 msgr2=0x7f511c0d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 shutdown_connections 2024-09-15T22:42:26.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.145+0000 7f5120827640 1 -- 172.21.15.134:0/318267302 wait complete. 2024-09-15T22:42:26.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol39630 subvol_grp33340 2024-09-15T22:42:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.258+0000 7f6a51b0a640 1 Processor -- start 2024-09-15T22:42:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.258+0000 7f6a51b0a640 1 -- start start 2024-09-15T22:42:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a51b0a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6a4c145d90 0x7f6a4c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a51b0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a4c0cfce0 0x7f6a4c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a51b0a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c0b4240 con 0x7f6a4c0cd490 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a51b0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c06d080 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a51b0a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c0b4520 con 0x7f6a4c145d90 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a4c0cfce0 0x7f6a4c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6a4c0cd490 0x7f6a4c0cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49144/0 (socket says 172.21.15.134:49144) 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4affd640 1 -- 172.21.15.134:0/2882516359 learned_addr learned my addr 172.21.15.134:0/2882516359 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4b7fe640 1 --2- 172.21.15.134:0/2882516359 >> v2:172.21.15.177:3300/0 conn(0x7f6a4c145d90 0x7f6a4c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4bfff640 1 -- 172.21.15.134:0/2882516359 >> v2:172.21.15.177:3300/0 conn(0x7f6a4c145d90 msgr2=0x7f6a4c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4bfff640 1 --2- 172.21.15.134:0/2882516359 >> v2:172.21.15.177:3300/0 conn(0x7f6a4c145d90 0x7f6a4c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4bfff640 1 -- 172.21.15.134:0/2882516359 >> v1:172.21.15.134:6789/0 conn(0x7f6a4c0cd490 legacy=0x7f6a4c0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4bfff640 1 -- 172.21.15.134:0/2882516359 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c0b4800 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.259+0000 7f6a4a7fc640 1 -- 172.21.15.134:0/2882516359 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605816733 0 0) 0x7f6a4c0b4240 con 0x7f6a4c0cd490 2024-09-15T22:42:26.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.260+0000 7f6a4bfff640 1 --2- 172.21.15.134:0/2882516359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cfce0 0x7f6a4c06d4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06f430 tx=0x7f6a4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bdd15c2b0194aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:26.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.260+0000 7f6a4a7fc640 1 -- 172.21.15.134:0/2882516359 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.260+0000 7f6a4a7fc640 1 -- 172.21.15.134:0/2882516359 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.260+0000 7f6a4a7fc640 1 -- 172.21.15.134:0/2882516359 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032810 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 -- 172.21.15.134:0/2882516359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cfce0 msgr2=0x7f6a4c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/2882516359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cfce0 0x7f6a4c06d4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06f430 tx=0x7f6a4402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 -- 172.21.15.134:0/2882516359 shutdown_connections 2024-09-15T22:42:26.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/2882516359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cfce0 0x7f6a4c06d4f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/2882516359 >> v2:172.21.15.177:3300/0 conn(0x7f6a4c145d90 0x7f6a4c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 -- 172.21.15.134:0/2882516359 >> 172.21.15.134:0/2882516359 conn(0x7f6a4c06bba0 msgr2=0x7f6a4c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 -- 172.21.15.134:0/2882516359 shutdown_connections 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.261+0000 7f6a51b0a640 1 -- 172.21.15.134:0/2882516359 wait complete. 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.262+0000 7f6a51b0a640 1 Processor -- start 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.262+0000 7f6a51b0a640 1 -- start start 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 0x7f6a4c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 0x7f6a4c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0b5790 con 0x7f6a4c0cd490 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0b5610 con 0x7f6a4c145d90 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a51b0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c146170 con 0x7f6a4c0cfce0 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35156/0 (socket says 172.21.15.134:35156) 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 -- 172.21.15.134:0/1949556738 learned_addr learned my addr 172.21.15.134:0/1949556738 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4bfff640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 0x7f6a4c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4affd640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 0x7f6a4c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 -- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 msgr2=0x7f6a4c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 0x7f6a4c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 -- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 msgr2=0x7f6a4c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 0x7f6a4c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 -- 172.21.15.134:0/1949556738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c1f84f0 con 0x7f6a4c0cd490 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4affd640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 0x7f6a4c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4bfff640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 0x7f6a4c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.263+0000 7f6a4b7fe640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007ef0 tx=0x7f6a3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:26.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.264+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c014620 con 0x7f6a4c0cd490 2024-09-15T22:42:26.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.264+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c019070 con 0x7f6a4c0cd490 2024-09-15T22:42:26.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.264+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c0aea10 con 0x7f6a4c0cd490 2024-09-15T22:42:26.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.264+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c014a00 con 0x7f6a4c0cd490 2024-09-15T22:42:26.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.264+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c0aefd0 con 0x7f6a4c0cd490 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.265+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c0ccf50 con 0x7f6a4c0cd490 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.265+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a3c014ba0 con 0x7f6a4c0cd490 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.265+0000 7f6a33fff640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.266+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3c08bd40 con 0x7f6a4c0cd490 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.266+0000 7f6a4affd640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.266+0000 7f6a4affd640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 0x7f6a3806e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ccb30 tx=0x7f6a40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.270+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a3c05a540 con 0x7f6a4c0cd490 2024-09-15T22:42:26.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.463+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol39630", "group_name": "subvol_grp33340", "target": ["mon-mgr", ""]}) -- 0x7f6a4c13b670 con 0x7f6a3806c2b0 2024-09-15T22:42:26.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.467+0000 7f6a33fff640 1 -- 172.21.15.134:0/1949556738 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6a400012f0 con 0x7f6a3806c2b0 2024-09-15T22:42:26.469 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp33340/subvol39630 2024-09-15T22:42:26.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 msgr2=0x7f6a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 0x7f6a3806e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ccb30 tx=0x7f6a40009040 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 msgr2=0x7f6a4c153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007ef0 tx=0x7f6a3c00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 shutdown_connections 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a4c145d90 0x7f6a4c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a4c0cfce0 0x7f6a4c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 --2- 172.21.15.134:0/1949556738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a4c0cd490 0x7f6a4c153d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 >> 172.21.15.134:0/1949556738 conn(0x7f6a4c06bba0 msgr2=0x7f6a4c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 shutdown_connections 2024-09-15T22:42:26.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:26.469+0000 7f6a51b0a640 1 -- 172.21.15.134:0/1949556738 wait complete. 2024-09-15T22:42:26.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:26.482 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/2192ad0d00be9d64a2d51cd4e0f0b9f7.meta) 2024-09-15T22:42:28.963 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:42:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:42:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:42:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/subvol_grp33340/subvol39630 2024-09-15T22:42:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:42:28.964 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:28.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol39630 subvol_grp33340 2024-09-15T22:42:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.076+0000 7f9543447640 1 Processor -- start 2024-09-15T22:42:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.077+0000 7f9543447640 1 -- start start 2024-09-15T22:42:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.077+0000 7f9543447640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f953c0b61e0 0x7f953c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.077+0000 7f9543447640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f953c0b3b00 0x7f953c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f9543447640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f953c0b6b00 con 0x7f953c0b3540 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f9543447640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f953c0d24f0 con 0x7f953c0b3b00 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f9543447640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f953c0d20e0 con 0x7f953c0b61e0 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f953c0b3b00 0x7f953c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f953c0b3b00 0x7f953c1625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35162/0 (socket says 172.21.15.134:35162) 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 -- 172.21.15.134:0/1915584002 learned_addr learned my addr 172.21.15.134:0/1915584002 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95411e3640 1 --2- 172.21.15.134:0/1915584002 >> v2:172.21.15.177:3300/0 conn(0x7f953c0b61e0 0x7f953c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 -- 172.21.15.134:0/1915584002 >> v2:172.21.15.177:3300/0 conn(0x7f953c0b61e0 msgr2=0x7f953c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 --2- 172.21.15.134:0/1915584002 >> v2:172.21.15.177:3300/0 conn(0x7f953c0b61e0 0x7f953c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 -- 172.21.15.134:0/1915584002 >> v1:172.21.15.177:6789/0 conn(0x7f953c0b3540 legacy=0x7f953c162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:29.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.078+0000 7f95409e2640 1 -- 172.21.15.134:0/1915584002 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c0cfa70 con 0x7f953c0b3b00 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f95409e2640 1 --2- 172.21.15.134:0/1915584002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b3b00 0x7f953c1625d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f953c06be00 tx=0x7f952c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc966d447d6871ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f9533fff640 1 -- 172.21.15.134:0/1915584002 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c037070 con 0x7f953c0b3b00 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f9533fff640 1 -- 172.21.15.134:0/1915584002 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952c032440 con 0x7f953c0b3b00 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f9533fff640 1 -- 172.21.15.134:0/1915584002 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c032810 con 0x7f953c0b3b00 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f9543447640 1 -- 172.21.15.134:0/1915584002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b3b00 msgr2=0x7f953c1625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.079+0000 7f9543447640 1 --2- 172.21.15.134:0/1915584002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b3b00 0x7f953c1625d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f953c06be00 tx=0x7f952c02a150 comp rx=0 tx=0).stop 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 -- 172.21.15.134:0/1915584002 shutdown_connections 2024-09-15T22:42:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 --2- 172.21.15.134:0/1915584002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b3b00 0x7f953c1625d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 --2- 172.21.15.134:0/1915584002 >> v2:172.21.15.177:3300/0 conn(0x7f953c0b61e0 0x7f953c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 -- 172.21.15.134:0/1915584002 >> 172.21.15.134:0/1915584002 conn(0x7f953c0d11e0 msgr2=0x7f953c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 -- 172.21.15.134:0/1915584002 shutdown_connections 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.080+0000 7f9543447640 1 -- 172.21.15.134:0/1915584002 wait complete. 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.081+0000 7f9543447640 1 Processor -- start 2024-09-15T22:42:29.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.081+0000 7f9543447640 1 -- start start 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f953c0b3540 0x7f953c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f953c0b3b00 0x7f953c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f953c15edc0 con 0x7f953c0b61e0 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f953c0d0030 con 0x7f953c0b3540 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f953c0cdb50 con 0x7f953c0b3b00 2024-09-15T22:42:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35174/0 (socket says 172.21.15.134:35174) 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 -- 172.21.15.134:0/1527296026 learned_addr learned my addr 172.21.15.134:0/1527296026 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95411e3640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f953c0b3540 0x7f953c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95409e2640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f953c0b3b00 0x7f953c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 -- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f953c0b3b00 msgr2=0x7f953c0ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f953c0b3b00 0x7f953c0ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 -- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f953c0b3540 msgr2=0x7f953c15dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f953c0b3540 0x7f953c15dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 -- 172.21.15.134:0/1527296026 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c1ea500 con 0x7f953c0b61e0 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f95419e4640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f953400c6b0 tx=0x7f953400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534003b70 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9534003d30 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c1ea7e0 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.082+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534005310 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.083+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c1eada0 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.083+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c0d1d00 con 0x7f953c0b61e0 2024-09-15T22:42:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.084+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f95340054b0 con 0x7f953c0b61e0 2024-09-15T22:42:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.084+0000 7f9531ffb640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 0x7f952006e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.085+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f953408b170 con 0x7f953c0b61e0 2024-09-15T22:42:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.085+0000 7f95411e3640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 0x7f952006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.085+0000 7f95411e3640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 0x7f952006e800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f953c0b9b80 tx=0x7f9538008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.089+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95340592a0 con 0x7f953c0b61e0 2024-09-15T22:42:29.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.277+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol39630", "group_name": "subvol_grp33340", "target": ["mon-mgr", ""]}) -- 0x7f953c0ba6e0 con 0x7f952006c340 2024-09-15T22:42:29.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.289+0000 7f9531ffb640 1 -- 172.21.15.134:0/1527296026 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f953c0ba6e0 con 0x7f952006c340 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 msgr2=0x7f952006e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 0x7f952006e800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f953c0b9b80 tx=0x7f9538008040 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 msgr2=0x7f953c1f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f953400c6b0 tx=0x7f953400cb70 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 shutdown_connections 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f952006c340 0x7f952006e800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0b61e0 0x7f953c1f4f40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f953c0b3b00 0x7f953c0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 --2- 172.21.15.134:0/1527296026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f953c0b3540 0x7f953c15dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 >> 172.21.15.134:0/1527296026 conn(0x7f953c0d11e0 msgr2=0x7f953c1610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 shutdown_connections 2024-09-15T22:42:29.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.291+0000 7f9543447640 1 -- 172.21.15.134:0/1527296026 wait complete. 2024-09-15T22:42:29.294 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.292+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.294 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.292+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.294 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.292+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.294 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.292+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.294 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.292+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.306 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:42:29.307 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.305+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.307 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.305+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.307 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.305+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.307 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.305+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.308 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:29.305+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:29.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:42:29.357 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:42:29.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:29.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp33340 2024-09-15T22:42:29.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 Processor -- start 2024-09-15T22:42:29.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 -- start start 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c78161e30 0x7f8c780d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c780b3d50 0x7f8c7806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8c780b3290 0x7f8c7806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8c780cfcf0 con 0x7f8c780b3d50 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8c780cf9a0 con 0x7f8c780b3290 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.464+0000 7f8c7eddf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8c78162210 con 0x7f8c78161e30 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c780b3d50 0x7f8c7806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c780b3d50 0x7f8c7806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35222/0 (socket says 172.21.15.134:35222) 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 -- 172.21.15.134:0/291139144 learned_addr learned my addr 172.21.15.134:0/291139144 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:29.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c7d37c640 1 --2- 172.21.15.134:0/291139144 >> v2:172.21.15.177:3300/0 conn(0x7f8c780b3290 0x7f8c7806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 -- 172.21.15.134:0/291139144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c78161e30 msgr2=0x7f8c780d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c7cb7b640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c78161e30 0x7f8c780d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c78161e30 0x7f8c780d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 -- 172.21.15.134:0/291139144 >> v2:172.21.15.177:3300/0 conn(0x7f8c780b3290 msgr2=0x7f8c7806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 --2- 172.21.15.134:0/291139144 >> v2:172.21.15.177:3300/0 conn(0x7f8c780b3290 0x7f8c7806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.465+0000 7f8c77fff640 1 -- 172.21.15.134:0/291139144 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c780d5210 con 0x7f8c780b3d50 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c77fff640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c780b3d50 0x7f8c7806d8c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8c7808d8a0 tx=0x7f8c6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c1ba037432eef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c777fe640 1 -- 172.21.15.134:0/291139144 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64037070 con 0x7f8c780b3d50 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c777fe640 1 -- 172.21.15.134:0/291139144 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c64032440 con 0x7f8c780b3d50 2024-09-15T22:42:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c777fe640 1 -- 172.21.15.134:0/291139144 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64032810 con 0x7f8c780b3d50 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 -- 172.21.15.134:0/291139144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c780b3d50 msgr2=0x7f8c7806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c780b3d50 0x7f8c7806d8c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8c7808d8a0 tx=0x7f8c6402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 -- 172.21.15.134:0/291139144 shutdown_connections 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/291139144 >> v2:172.21.15.177:3300/0 conn(0x7f8c780b3290 0x7f8c7806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c780b3d50 0x7f8c7806d8c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/291139144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c78161e30 0x7f8c780d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 -- 172.21.15.134:0/291139144 >> 172.21.15.134:0/291139144 conn(0x7f8c780d1870 msgr2=0x7f8c780d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 -- 172.21.15.134:0/291139144 shutdown_connections 2024-09-15T22:42:29.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.466+0000 7f8c7eddf640 1 -- 172.21.15.134:0/291139144 wait complete. 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.467+0000 7f8c7eddf640 1 Processor -- start 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.467+0000 7f8c7eddf640 1 -- start start 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c780b3290 0x7f8c780b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c780b3d50 0x7f8c781f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c780d39e0 con 0x7f8c78161e30 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c780b3950 con 0x7f8c780b3d50 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7eddf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8c780b62c0 con 0x7f8c780b3290 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.468+0000 7f8c7d37c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35238/0 (socket says 172.21.15.134:35238) 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 -- 172.21.15.134:0/1944027349 learned_addr learned my addr 172.21.15.134:0/1944027349 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c77fff640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c780b3d50 0x7f8c781f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7cb7b640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c780b3290 0x7f8c780b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 -- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c780b3290 msgr2=0x7f8c780b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c780b3290 0x7f8c780b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 -- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c780b3d50 msgr2=0x7f8c781f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c780b3d50 0x7f8c781f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 -- 172.21.15.134:0/1944027349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c78151690 con 0x7f8c78161e30 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7d37c640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c970 tx=0x7f8c7000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70015070 con 0x7f8c78161e30 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c781f8960 con 0x7f8c78161e30 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c780b5990 con 0x7f8c78161e30 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c70003990 con 0x7f8c78161e30 2024-09-15T22:42:29.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.469+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7001f060 con 0x7f8c78161e30 2024-09-15T22:42:29.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.470+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c58005290 con 0x7f8c78161e30 2024-09-15T22:42:29.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.471+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f8c70018070 con 0x7f8c78161e30 2024-09-15T22:42:29.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.471+0000 7f8c757fa640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 0x7f8c5c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:29.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.471+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8c7008afe0 con 0x7f8c78161e30 2024-09-15T22:42:29.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.471+0000 7f8c7cb7b640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 0x7f8c5c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:29.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.472+0000 7f8c7cb7b640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 0x7f8c5c06e800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00aac0 tx=0x7f8c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:29.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.475+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c781f8960 con 0x7f8c78161e30 2024-09-15T22:42:29.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.663+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp33340", "target": ["mon-mgr", ""]}) -- 0x7f8c58000bc0 con 0x7f8c5c06c340 2024-09-15T22:42:29.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.667+0000 7f8c757fa640 1 -- 172.21.15.134:0/1944027349 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8c58000bc0 con 0x7f8c5c06c340 2024-09-15T22:42:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 msgr2=0x7f8c5c06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 0x7f8c5c06e800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00aac0 tx=0x7f8c6c008040 comp rx=0 tx=0).stop 2024-09-15T22:42:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 msgr2=0x7f8c781e73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c970 tx=0x7f8c7000ce30 comp rx=0 tx=0).stop 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 shutdown_connections 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8c5c06c340 0x7f8c5c06e800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c78161e30 0x7f8c781e73a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c780b3d50 0x7f8c781f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 --2- 172.21.15.134:0/1944027349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c780b3290 0x7f8c780b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 >> 172.21.15.134:0/1944027349 conn(0x7f8c780d1870 msgr2=0x7f8c780ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 shutdown_connections 2024-09-15T22:42:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.669+0000 7f8c7eddf640 1 -- 172.21.15.134:0/1944027349 wait complete. 2024-09-15T22:42:29.681 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:42:29.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:42:29.724 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:42:29.786 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:42:29.786 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:42:29.786 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:29.786 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:29.802 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:29.802 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:29.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:42:29.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.997+0000 7f5392853640 1 Processor -- start 2024-09-15T22:42:29.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.997+0000 7f5392853640 1 -- start start 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5392853640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f538c0cdae0 0x7f538c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5392853640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f538c0aff30 0x7f538c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5392853640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c0b0880 con 0x7f538c156880 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5392853640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f538c0b6b00 con 0x7f538c0cdae0 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5392853640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f538c0ce150 con 0x7f538c0aff30 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f538b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f538c0cdae0 0x7f538c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f538bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f538c156880 0x7f538c160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49158/0 (socket says 172.21.15.134:49158) 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f538bfff640 1 -- 172.21.15.134:0/1006717164 learned_addr learned my addr 172.21.15.134:0/1006717164 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:30.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.998+0000 7f5390df0640 1 --2- 172.21.15.134:0/1006717164 >> v2:172.21.15.177:3300/0 conn(0x7f538c0aff30 0x7f538c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538b7fe640 1 -- 172.21.15.134:0/1006717164 >> v2:172.21.15.177:3300/0 conn(0x7f538c0aff30 msgr2=0x7f538c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:30.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538b7fe640 1 --2- 172.21.15.134:0/1006717164 >> v2:172.21.15.177:3300/0 conn(0x7f538c0aff30 0x7f538c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538b7fe640 1 -- 172.21.15.134:0/1006717164 >> v1:172.21.15.134:6789/0 conn(0x7f538c156880 legacy=0x7f538c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538b7fe640 1 -- 172.21.15.134:0/1006717164 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c0ce430 con 0x7f538c0cdae0 2024-09-15T22:42:30.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538affd640 1 -- 172.21.15.134:0/1006717164 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545025136 0 0) 0x7f537c001110 con 0x7f538c156880 2024-09-15T22:42:30.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538b7fe640 1 --2- 172.21.15.134:0/1006717164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c0cdae0 0x7f538c0b65c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f538c062e40 tx=0x7f538002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44458acd525933b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538affd640 1 -- 172.21.15.134:0/1006717164 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380037070 con 0x7f538c0cdae0 2024-09-15T22:42:30.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538affd640 1 -- 172.21.15.134:0/1006717164 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5380032440 con 0x7f538c0cdae0 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:29.999+0000 7f538affd640 1 -- 172.21.15.134:0/1006717164 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380032810 con 0x7f538c0cdae0 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 -- 172.21.15.134:0/1006717164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c0cdae0 msgr2=0x7f538c0b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 --2- 172.21.15.134:0/1006717164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c0cdae0 0x7f538c0b65c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f538c062e40 tx=0x7f538002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 -- 172.21.15.134:0/1006717164 shutdown_connections 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 --2- 172.21.15.134:0/1006717164 >> v2:172.21.15.177:3300/0 conn(0x7f538c0aff30 0x7f538c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 --2- 172.21.15.134:0/1006717164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c0cdae0 0x7f538c0b65c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 -- 172.21.15.134:0/1006717164 >> 172.21.15.134:0/1006717164 conn(0x7f538c06cae0 msgr2=0x7f538c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 -- 172.21.15.134:0/1006717164 shutdown_connections 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.000+0000 7f5392853640 1 -- 172.21.15.134:0/1006717164 wait complete. 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.001+0000 7f5392853640 1 Processor -- start 2024-09-15T22:42:30.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.001+0000 7f5392853640 1 -- start start 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 0x7f538c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538c0cdae0 0x7f538c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f538c156c60 con 0x7f538c156880 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f538c160210 con 0x7f538c0aff30 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5392853640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f538c0ce710 con 0x7f538c0cdae0 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35258/0 (socket says 172.21.15.134:35258) 2024-09-15T22:42:30.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 -- 172.21.15.134:0/3762029634 learned_addr learned my addr 172.21.15.134:0/3762029634 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f538b7fe640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538c0cdae0 0x7f538c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f538bfff640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 0x7f538c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 -- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538c0cdae0 msgr2=0x7f538c154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538c0cdae0 0x7f538c154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 -- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 msgr2=0x7f538c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.002+0000 7f5390df0640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 0x7f538c14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5390df0640 1 -- 172.21.15.134:0/3762029634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c14db90 con 0x7f538c156880 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f538bfff640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 0x7f538c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5390df0640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5384007e40 tx=0x7f538400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384014620 con 0x7f538c156880 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5384019070 con 0x7f538c156880 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c151120 con 0x7f538c156880 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384014a20 con 0x7f538c156880 2024-09-15T22:42:30.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.003+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c1516e0 con 0x7f538c156880 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.004+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c0b0340 con 0x7f538c156880 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.004+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f5384014bc0 con 0x7f538c156880 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.005+0000 7f5388ff9640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 0x7f537806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.005+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f538408bd30 con 0x7f538c156880 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.005+0000 7f538bfff640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 0x7f537806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.005+0000 7f538bfff640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 0x7f537806e830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f60 tx=0x7f537c007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.009+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f538405a430 con 0x7f538c156880 2024-09-15T22:42:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.188+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f538c15e490 con 0x7f538c156880 2024-09-15T22:42:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.188+0000 7f5388ff9640 1 -- 172.21.15.134:0/3762029634 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) ==== 80+0+0 (secure 0 0 0) 0x7f5384059d30 con 0x7f538c156880 2024-09-15T22:42:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:42:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 msgr2=0x7f537806e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 0x7f537806e830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f60 tx=0x7f537c007ca0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 msgr2=0x7f538c155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5384007e40 tx=0x7f538400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 shutdown_connections 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f537806c370 0x7f537806e830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f538c156880 0x7f538c155110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538c0cdae0 0x7f538c154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 --2- 172.21.15.134:0/3762029634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c0aff30 0x7f538c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 >> 172.21.15.134:0/3762029634 conn(0x7f538c06cae0 msgr2=0x7f538c0b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 shutdown_connections 2024-09-15T22:42:30.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.191+0000 7f5392853640 1 -- 172.21.15.134:0/3762029634 wait complete. 2024-09-15T22:42:30.203 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:42:30.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:30.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:30.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:42:30.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:30.250 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:42:30.277 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:42:30.277 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:30.277 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:30.294 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:30.294 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:30.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:42:30.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.449+0000 7fe4938d7640 1 Processor -- start 2024-09-15T22:42:30.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.449+0000 7fe4938d7640 1 -- start start 2024-09-15T22:42:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.450+0000 7fe4938d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 0x7fe48c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.450+0000 7fe4938d7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe48c0b66e0 0x7fe48c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.450+0000 7fe4938d7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c15c9c0 con 0x7fe48c0b6d50 2024-09-15T22:42:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.450+0000 7fe4938d7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c074100 con 0x7fe48c0b66e0 2024-09-15T22:42:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.450+0000 7fe4938d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c0b76d0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491673640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 0x7fe48c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491e74640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe48c0b66e0 0x7fe48c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe490e72640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe48c0b6d50 0x7fe48c1600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:41796/0 (socket says 172.21.15.134:41796) 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe490e72640 1 -- 172.21.15.134:0/3153242263 learned_addr learned my addr 172.21.15.134:0/3153242263 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491e74640 1 -- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 msgr2=0x7fe48c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491e74640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 0x7fe48c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491e74640 1 -- 172.21.15.134:0/3153242263 >> v1:172.21.15.177:6789/0 conn(0x7fe48c0b6d50 legacy=0x7fe48c1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491e74640 1 -- 172.21.15.134:0/3153242263 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c0b1dd0 con 0x7fe48c0b66e0 2024-09-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.451+0000 7fe491673640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 0x7fe48c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe491e74640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c0b7190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe484009d90 tx=0x7fe48402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a44615ab595b7a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe48bfff640 1 -- 172.21.15.134:0/3153242263 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484007740 con 0x7fe48c0b66e0 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe48bfff640 1 -- 172.21.15.134:0/3153242263 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4840078e0 con 0x7fe48c0b66e0 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe48bfff640 1 -- 172.21.15.134:0/3153242263 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484007cb0 con 0x7fe48c0b66e0 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 -- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 msgr2=0x7fe48c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c0b7190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe484009d90 tx=0x7fe48402a660 comp rx=0 tx=0).stop 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 -- 172.21.15.134:0/3153242263 shutdown_connections 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c0b7190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3153242263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c15c5e0 0x7fe48c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.452+0000 7fe4938d7640 1 -- 172.21.15.134:0/3153242263 >> 172.21.15.134:0/3153242263 conn(0x7fe48c0b4220 msgr2=0x7fe48c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.453+0000 7fe4938d7640 1 -- 172.21.15.134:0/3153242263 shutdown_connections 2024-09-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.453+0000 7fe4938d7640 1 -- 172.21.15.134:0/3153242263 wait complete. 2024-09-15T22:42:30.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 Processor -- start 2024-09-15T22:42:30.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 -- start start 2024-09-15T22:42:30.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 0x7fe48c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c073ab0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0737d0 con 0x7fe48c0b66e0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.454+0000 7fe4938d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c073d90 con 0x7fe48c0b6d50 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe490e72640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 0x7fe48c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35262/0 (socket says 172.21.15.134:35262) 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 -- 172.21.15.134:0/3761328406 learned_addr learned my addr 172.21.15.134:0/3761328406 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491673640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 -- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 msgr2=0x7fe48c15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 0x7fe48c15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 -- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 msgr2=0x7fe48c14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 -- 172.21.15.134:0/3761328406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c06cde0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491673640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe490e72640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 0x7fe48c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe491e74640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe484009eb0 tx=0x7fe484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484040070 con 0x7fe48c15c5e0 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe484031bc0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c06d0c0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484009450 con 0x7fe48c15c5e0 2024-09-15T22:42:30.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.455+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c06d680 con 0x7fe48c15c5e0 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.456+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c069190 con 0x7fe48c15c5e0 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.457+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7fe484039040 con 0x7fe48c15c5e0 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.457+0000 7fe489ffb640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 0x7fe47806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.457+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe4840acca0 con 0x7fe48c15c5e0 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.457+0000 7fe491673640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 0x7fe47806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.458+0000 7fe491673640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 0x7fe47806e800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009560 tx=0x7fe47c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.462+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4840b1070 con 0x7fe48c15c5e0 2024-09-15T22:42:30.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.639+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe48c073130 con 0x7fe48c15c5e0 2024-09-15T22:42:30.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.640+0000 7fe489ffb640 1 -- 172.21.15.134:0/3761328406 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) ==== 80+0+0 (secure 0 0 0) 0x7fe48407ad50 con 0x7fe48c15c5e0 2024-09-15T22:42:30.641 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:42:30.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 msgr2=0x7fe47806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 0x7fe47806e800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009560 tx=0x7fe47c009190 comp rx=0 tx=0).stop 2024-09-15T22:42:30.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 msgr2=0x7fe48c15e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe484009eb0 tx=0x7fe484004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 shutdown_connections 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe47806c340 0x7fe47806e800 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe48c15c5e0 0x7fe48c15e630 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0b6d50 0x7fe48c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 --2- 172.21.15.134:0/3761328406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0b66e0 0x7fe48c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 >> 172.21.15.134:0/3761328406 conn(0x7fe48c0b4220 msgr2=0x7fe48c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 shutdown_connections 2024-09-15T22:42:30.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.642+0000 7fe4938d7640 1 -- 172.21.15.134:0/3761328406 wait complete. 2024-09-15T22:42:30.654 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:42:30.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:30.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:30.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:42:30.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:30.687 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:42:30.745 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:42:30.745 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:30.746 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:30.762 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:42:30.762 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:42:30.762 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:30.762 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:30.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:42:30.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:30.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.901+0000 7f025b99f640 1 Processor -- start 2024-09-15T22:42:30.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.901+0000 7f025b99f640 1 -- start start 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025b99f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02540d02a0 0x7f02540d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025b99f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f025415ceb0 0x7f02541594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025b99f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02540d0bc0 con 0x7f025415ca40 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025b99f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f025415d390 con 0x7f025415ceb0 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025b99f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f025415d670 con 0x7f02540d02a0 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0259f3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f025415ceb0 0x7f02541594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0258f3a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f025415ca40 0x7f025415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49166/0 (socket says 172.21.15.134:49166) 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0259f3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f025415ceb0 0x7f02541594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35276/0 (socket says 172.21.15.134:35276) 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0258f3a640 1 -- 172.21.15.134:0/3886898029 learned_addr learned my addr 172.21.15.134:0/3886898029 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f025973b640 1 --2- 172.21.15.134:0/3886898029 >> v2:172.21.15.177:3300/0 conn(0x7f02540d02a0 0x7f02540d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0259f3c640 1 -- 172.21.15.134:0/3886898029 >> v2:172.21.15.177:3300/0 conn(0x7f02540d02a0 msgr2=0x7f02540d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.902+0000 7f0259f3c640 1 --2- 172.21.15.134:0/3886898029 >> v2:172.21.15.177:3300/0 conn(0x7f02540d02a0 0x7f02540d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f0259f3c640 1 -- 172.21.15.134:0/3886898029 >> v1:172.21.15.134:6789/0 conn(0x7f025415ca40 legacy=0x7f025415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f0259f3c640 1 -- 172.21.15.134:0/3886898029 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025415d950 con 0x7f025415ceb0 2024-09-15T22:42:30.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f0259f3c640 1 --2- 172.21.15.134:0/3886898029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025415ceb0 0x7f02541594c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f025406f030 tx=0x7f024c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdae7bee1ddeb4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f024bfff640 1 -- 172.21.15.134:0/3886898029 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c037070 con 0x7f025415ceb0 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f024bfff640 1 -- 172.21.15.134:0/3886898029 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c032440 con 0x7f025415ceb0 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.903+0000 7f024bfff640 1 -- 172.21.15.134:0/3886898029 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c02ae60 con 0x7f025415ceb0 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 -- 172.21.15.134:0/3886898029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025415ceb0 msgr2=0x7f02541594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 --2- 172.21.15.134:0/3886898029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025415ceb0 0x7f02541594c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f025406f030 tx=0x7f024c02a110 comp rx=0 tx=0).stop 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 -- 172.21.15.134:0/3886898029 shutdown_connections 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 --2- 172.21.15.134:0/3886898029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025415ceb0 0x7f02541594c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 --2- 172.21.15.134:0/3886898029 >> v2:172.21.15.177:3300/0 conn(0x7f02540d02a0 0x7f02540d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 -- 172.21.15.134:0/3886898029 >> 172.21.15.134:0/3886898029 conn(0x7f0254062cc0 msgr2=0x7f025406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 -- 172.21.15.134:0/3886898029 shutdown_connections 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.904+0000 7f025b99f640 1 -- 172.21.15.134:0/3886898029 wait complete. 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.905+0000 7f025b99f640 1 Processor -- start 2024-09-15T22:42:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.905+0000 7f025b99f640 1 -- start start 2024-09-15T22:42:30.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 0x7f025414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f025415ceb0 0x7f0254072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f025415eb40 con 0x7f02540d02a0 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f025415df10 con 0x7f025415ceb0 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0254155b90 con 0x7f025415ca40 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35280/0 (socket says 172.21.15.134:35280) 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 -- 172.21.15.134:0/1067174883 learned_addr learned my addr 172.21.15.134:0/1067174883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0259f3c640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f025415ceb0 0x7f0254072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0258f3a640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 0x7f025414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 -- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 msgr2=0x7f025414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 0x7f025414ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 -- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f025415ceb0 msgr2=0x7f0254072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f025415ceb0 0x7f0254072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 -- 172.21.15.134:0/1067174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02541562a0 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0258f3a640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 0x7f025414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025973b640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f025000ce10 tx=0x7f025000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250003b90 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0250003d30 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0254156580 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.906+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250004240 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.907+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0254156b40 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.908+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f025414c790 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.908+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f02500043e0 con 0x7f02540d02a0 2024-09-15T22:42:30.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.909+0000 7f0249ffb640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 0x7f023806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.909+0000 7f0258f3a640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 0x7f023806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.909+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f025008c0e0 con 0x7f02540d02a0 2024-09-15T22:42:30.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.909+0000 7f0258f3a640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 0x7f023806e800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02540d0850 tx=0x7f0244009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:30.913+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f025001d340 con 0x7f02540d02a0 2024-09-15T22:42:31.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.114+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02540b4790 con 0x7f02540d02a0 2024-09-15T22:42:31.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.115+0000 7f0249ffb640 1 -- 172.21.15.134:0/1067174883 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5228 (secure 0 0 0) 0x7f025005a750 con 0x7f02540d02a0 2024-09-15T22:42:31.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:31.116 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":15,"btime":"2024-09-15T22:42:24:934677+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 15 2024-09-15T22:42:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 msgr2=0x7f023806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 0x7f023806e800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02540d0850 tx=0x7f0244009040 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 msgr2=0x7f025414c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f025000ce10 tx=0x7f025000a660 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 shutdown_connections 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f023806c340 0x7f023806e800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f025415ceb0 0x7f0254072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f025415ca40 0x7f025414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 --2- 172.21.15.134:0/1067174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02540d02a0 0x7f025414c190 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 >> 172.21.15.134:0/1067174883 conn(0x7f0254062cc0 msgr2=0x7f02540cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 shutdown_connections 2024-09-15T22:42:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.117+0000 7f025b99f640 1 -- 172.21.15.134:0/1067174883 wait complete. 2024-09-15T22:42:31.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:31.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.226+0000 7f66576ba640 1 Processor -- start 2024-09-15T22:42:31.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.227+0000 7f66576ba640 1 -- start start 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.227+0000 7f66576ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f665015e940 0x7f66500d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.227+0000 7f66576ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 0x7f66500d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.227+0000 7f66576ba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66500b7170 con 0x7f66500cef90 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f66576ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f66500d1ae0 con 0x7f665015e940 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f66576ba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f66500b7aa0 con 0x7f665015ed20 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f665015e940 0x7f66500d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f665015e940 0x7f66500d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35284/0 (socket says 172.21.15.134:35284) 2024-09-15T22:42:31.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 -- 172.21.15.134:0/2032333216 learned_addr learned my addr 172.21.15.134:0/2032333216 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655c57640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f66500cef90 0x7f66500b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49178/0 (socket says 172.21.15.134:49178) 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6654c55640 1 --2- 172.21.15.134:0/2032333216 >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 0x7f66500d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 -- 172.21.15.134:0/2032333216 >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 msgr2=0x7f66500d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 --2- 172.21.15.134:0/2032333216 >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 0x7f66500d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 -- 172.21.15.134:0/2032333216 >> v1:172.21.15.134:6789/0 conn(0x7f66500cef90 legacy=0x7f66500b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6655456640 1 -- 172.21.15.134:0/2032333216 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66500d3660 con 0x7f665015e940 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6647fff640 1 -- 172.21.15.134:0/2032333216 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686234149 0 0) 0x7f6648001490 con 0x7f66500cef90 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.228+0000 7f6654c55640 1 --2- 172.21.15.134:0/2032333216 >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 0x7f66500d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f6655456640 1 --2- 172.21.15.134:0/2032333216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015e940 0x7f66500d1060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f665006e900 tx=0x7f664c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d405308ff1f88b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f6647fff640 1 -- 172.21.15.134:0/2032333216 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c037070 con 0x7f665015e940 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f6647fff640 1 -- 172.21.15.134:0/2032333216 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c02ae50 con 0x7f665015e940 2024-09-15T22:42:31.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f6647fff640 1 -- 172.21.15.134:0/2032333216 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c032860 con 0x7f665015e940 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 -- 172.21.15.134:0/2032333216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015e940 msgr2=0x7f66500d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 --2- 172.21.15.134:0/2032333216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015e940 0x7f66500d1060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f665006e900 tx=0x7f664c02a300 comp rx=0 tx=0).stop 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 -- 172.21.15.134:0/2032333216 shutdown_connections 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 --2- 172.21.15.134:0/2032333216 >> v2:172.21.15.177:3300/0 conn(0x7f665015ed20 0x7f66500d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 --2- 172.21.15.134:0/2032333216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015e940 0x7f66500d1060 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 -- 172.21.15.134:0/2032333216 >> 172.21.15.134:0/2032333216 conn(0x7f66500b6240 msgr2=0x7f66500b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 -- 172.21.15.134:0/2032333216 shutdown_connections 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.229+0000 7f66576ba640 1 -- 172.21.15.134:0/2032333216 wait complete. 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 Processor -- start 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 -- start start 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 0x7f6650146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f665015e940 0x7f66501f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66500d3f00 con 0x7f665015ed20 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f66500d3c20 con 0x7f66500cef90 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f66576ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f66500d3310 con 0x7f665015e940 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f6655c57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f6655c57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35290/0 (socket says 172.21.15.134:35290) 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.231+0000 7f6655c57640 1 -- 172.21.15.134:0/2516184073 learned_addr learned my addr 172.21.15.134:0/2516184073 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655456640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 0x7f6650146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 -- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f665015e940 msgr2=0x7f66501f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6654c55640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f665015e940 0x7f66501f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f665015e940 0x7f66501f8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 -- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 msgr2=0x7f6650146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 0x7f6650146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 -- 172.21.15.134:0/2516184073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66501485e0 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655456640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 0x7f6650146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6655c57640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f664800c700 tx=0x7f664800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648018070 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664800ce10 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66501488c0 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664800a860 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.232+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6650148e80 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.233+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66500d1ef0 con 0x7f665015ed20 2024-09-15T22:42:31.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.234+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f664801b070 con 0x7f665015ed20 2024-09-15T22:42:31.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.234+0000 7f6645ffb640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 0x7f663406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.234+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f664808a950 con 0x7f665015ed20 2024-09-15T22:42:31.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.234+0000 7f6655456640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 0x7f663406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.235+0000 7f6655456640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 0x7f663406e830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f664c034000 tx=0x7f664c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.239+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66500b7170 con 0x7f665015ed20 2024-09-15T22:42:31.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.439+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66500ba6b0 con 0x7f665015ed20 2024-09-15T22:42:31.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.440+0000 7f6645ffb640 1 -- 172.21.15.134:0/2516184073 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5228 (secure 0 0 0) 0x7f6648059160 con 0x7f665015ed20 2024-09-15T22:42:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:31.442 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":15,"btime":"2024-09-15T22:42:24:934677+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:31.442 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 15 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 msgr2=0x7f663406e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 0x7f663406e830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f664c034000 tx=0x7f664c02e000 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 msgr2=0x7f665015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f664800c700 tx=0x7f664800cbc0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 shutdown_connections 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f663406c370 0x7f663406e830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f665015ed20 0x7f665015fc90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f665015e940 0x7f66501f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 --2- 172.21.15.134:0/2516184073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66500cef90 0x7f6650146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 >> 172.21.15.134:0/2516184073 conn(0x7f66500b6240 msgr2=0x7f66500b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 shutdown_connections 2024-09-15T22:42:31.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.442+0000 7f66576ba640 1 -- 172.21.15.134:0/2516184073 wait complete. 2024-09-15T22:42:31.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:31.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.552+0000 7f86dc7bd640 1 Processor -- start 2024-09-15T22:42:31.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.552+0000 7f86dc7bd640 1 -- start start 2024-09-15T22:42:31.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86d415c180 0x7f86d40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d40cf5b0 0x7f86d4073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f86d40ce740 con 0x7f86d40cf5b0 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f86d4072640 con 0x7f86d415c180 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dc7bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f86d4072920 con 0x7f86d40ce230 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d40cf5b0 0x7f86d4073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d40cf5b0 0x7f86d4073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35306/0 (socket says 172.21.15.134:35306) 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 -- 172.21.15.134:0/3735667807 learned_addr learned my addr 172.21.15.134:0/3735667807 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86da559640 1 --2- 172.21.15.134:0/3735667807 >> v2:172.21.15.177:3300/0 conn(0x7f86d415c180 0x7f86d40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86d9d58640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 -- 172.21.15.134:0/3735667807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 msgr2=0x7f86d40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 -- 172.21.15.134:0/3735667807 >> v2:172.21.15.177:3300/0 conn(0x7f86d415c180 msgr2=0x7f86d40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 --2- 172.21.15.134:0/3735667807 >> v2:172.21.15.177:3300/0 conn(0x7f86d415c180 0x7f86d40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.553+0000 7f86dad5a640 1 -- 172.21.15.134:0/3735667807 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d4072c00 con 0x7f86d40cf5b0 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86dad5a640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d40cf5b0 0x7f86d4073120 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f86d406cc10 tx=0x7f86cc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7508c009502ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86d9557640 1 -- 172.21.15.134:0/3735667807 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc036070 con 0x7f86d40cf5b0 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86d9557640 1 -- 172.21.15.134:0/3735667807 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc031600 con 0x7f86d40cf5b0 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86d9557640 1 -- 172.21.15.134:0/3735667807 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0319d0 con 0x7f86d40cf5b0 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86dc7bd640 1 -- 172.21.15.134:0/3735667807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d40cf5b0 msgr2=0x7f86d4073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.554+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d40cf5b0 0x7f86d4073120 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f86d406cc10 tx=0x7f86cc02a610 comp rx=0 tx=0).stop 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 -- 172.21.15.134:0/3735667807 shutdown_connections 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d40cf5b0 0x7f86d4073120 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/3735667807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/3735667807 >> v2:172.21.15.177:3300/0 conn(0x7f86d415c180 0x7f86d40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 -- 172.21.15.134:0/3735667807 >> 172.21.15.134:0/3735667807 conn(0x7f86d4062cc0 msgr2=0x7f86d406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 -- 172.21.15.134:0/3735667807 shutdown_connections 2024-09-15T22:42:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.555+0000 7f86dc7bd640 1 -- 172.21.15.134:0/3735667807 wait complete. 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 Processor -- start 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 -- start start 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86d40cf5b0 0x7f86d40b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86d415c560 con 0x7f86d415c180 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40722f0 con 0x7f86d40cf5b0 2024-09-15T22:42:31.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.556+0000 7f86dc7bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f86d415c6e0 con 0x7f86d40ce230 2024-09-15T22:42:31.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35322/0 (socket says 172.21.15.134:35322) 2024-09-15T22:42:31.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 -- 172.21.15.134:0/4078988238 learned_addr learned my addr 172.21.15.134:0/4078988238 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:31.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86da559640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86d9d58640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86d40cf5b0 0x7f86d40b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 -- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 msgr2=0x7f86d40aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 -- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86d40cf5b0 msgr2=0x7f86d40b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86d40cf5b0 0x7f86d40b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 -- 172.21.15.134:0/4078988238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d41f8070 con 0x7f86d415c180 2024-09-15T22:42:31.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dad5a640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f86cc02ac00 tx=0x7f86cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc03f020 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc037040 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d40b1b70 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc036070 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.557+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d40b2130 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.558+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d40715e0 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.559+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f86cc042020 con 0x7f86d415c180 2024-09-15T22:42:31.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.559+0000 7f86c6ffd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 0x7f86b806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.559+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f86cc0ab9f0 con 0x7f86d415c180 2024-09-15T22:42:31.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.559+0000 7f86da559640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 0x7f86b806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.560+0000 7f86da559640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 0x7f86b806e800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86d41f93a0 tx=0x7f86d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.564+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86d40715e0 con 0x7f86d415c180 2024-09-15T22:42:31.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.731+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86d40cf070 con 0x7f86d415c180 2024-09-15T22:42:31.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.732+0000 7f86c6ffd640 1 -- 172.21.15.134:0/4078988238 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7f86cc07ee20 con 0x7f86d415c180 2024-09-15T22:42:31.734 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:31.734 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":35,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:13.873375+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:09.938942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:11.196490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.734+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 msgr2=0x7f86b806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.734+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 0x7f86b806e800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86d41f93a0 tx=0x7f86d0008040 comp rx=0 tx=0).stop 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.734+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 msgr2=0x7f86d40b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.734+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f86cc02ac00 tx=0x7f86cc004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 shutdown_connections 2024-09-15T22:42:31.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f86b806c340 0x7f86b806e800 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d415c180 0x7f86d40b13f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86d40cf5b0 0x7f86d40b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 --2- 172.21.15.134:0/4078988238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86d40ce230 0x7f86d40aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 >> 172.21.15.134:0/4078988238 conn(0x7f86d4062cc0 msgr2=0x7f86d406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 shutdown_connections 2024-09-15T22:42:31.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.735+0000 7f86dc7bd640 1 -- 172.21.15.134:0/4078988238 wait complete. 2024-09-15T22:42:31.747 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:42:31.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.844+0000 7f9291bed640 1 Processor -- start 2024-09-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.844+0000 7f9291bed640 1 -- start start 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f9291bed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f928c0cdae0 0x7f928c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f9291bed640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f928c0ce150 con 0x7f928c156880 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f9291bed640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f928c0ce430 con 0x7f928c0aff30 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f9291bed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f928c0b6b00 con 0x7f928c0cdae0 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f928b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f928c156880 0x7f928c160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49190/0 (socket says 172.21.15.134:49190) 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f928b7fe640 1 -- 172.21.15.134:0/4163667390 learned_addr learned my addr 172.21.15.134:0/4163667390 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f928affd640 1 --2- 172.21.15.134:0/4163667390 >> v2:172.21.15.177:3300/0 conn(0x7f928c0cdae0 0x7f928c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f928a7fc640 1 -- 172.21.15.134:0/4163667390 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494398654 0 0) 0x7f928c0ce150 con 0x7f928c156880 2024-09-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.845+0000 7f928a7fc640 1 -- 172.21.15.134:0/4163667390 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9274003520 con 0x7f928c156880 2024-09-15T22:42:31.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.846+0000 7f928affd640 1 -- 172.21.15.134:0/4163667390 >> v1:172.21.15.177:6789/0 conn(0x7f928c0aff30 legacy=0x7f928c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.846+0000 7f928affd640 1 -- 172.21.15.134:0/4163667390 >> v1:172.21.15.134:6789/0 conn(0x7f928c156880 legacy=0x7f928c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.846+0000 7f928affd640 1 -- 172.21.15.134:0/4163667390 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c15ff30 con 0x7f928c0cdae0 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.846+0000 7f928affd640 1 --2- 172.21.15.134:0/4163667390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0cdae0 0x7f928c0b65c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92800097a0 tx=0x7f928002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa5080d70d37160b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f928a7fc640 1 -- 172.21.15.134:0/4163667390 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037070 con 0x7f928c0cdae0 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f928a7fc640 1 -- 172.21.15.134:0/4163667390 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280032440 con 0x7f928c0cdae0 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f928a7fc640 1 -- 172.21.15.134:0/4163667390 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280032810 con 0x7f928c0cdae0 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 -- 172.21.15.134:0/4163667390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0cdae0 msgr2=0x7f928c0b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 --2- 172.21.15.134:0/4163667390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0cdae0 0x7f928c0b65c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92800097a0 tx=0x7f928002a230 comp rx=0 tx=0).stop 2024-09-15T22:42:31.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 -- 172.21.15.134:0/4163667390 shutdown_connections 2024-09-15T22:42:31.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 --2- 172.21.15.134:0/4163667390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0cdae0 0x7f928c0b65c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 -- 172.21.15.134:0/4163667390 >> 172.21.15.134:0/4163667390 conn(0x7f928c06cae0 msgr2=0x7f928c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 -- 172.21.15.134:0/4163667390 shutdown_connections 2024-09-15T22:42:31.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.847+0000 7f9291bed640 1 -- 172.21.15.134:0/4163667390 wait complete. 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.848+0000 7f9291bed640 1 Processor -- start 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.848+0000 7f9291bed640 1 -- start start 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 0x7f928c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928c156880 0x7f928c0b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f928c0ce710 con 0x7f928c0cdae0 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f928c156c60 con 0x7f928c0aff30 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f9291bed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f928c15c8a0 con 0x7f928c156880 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f928affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f928affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35334/0 (socket says 172.21.15.134:35334) 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f928affd640 1 -- 172.21.15.134:0/3675379144 learned_addr learned my addr 172.21.15.134:0/3675379144 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f928b7fe640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 0x7f928c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.849+0000 7f928bfff640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928c156880 0x7f928c0b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 -- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928c156880 msgr2=0x7f928c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928c156880 0x7f928c0b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 -- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 msgr2=0x7f928c14e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 0x7f928c14e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 -- 172.21.15.134:0/3675379144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c1572e0 con 0x7f928c0cdae0 2024-09-15T22:42:31.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928b7fe640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 0x7f928c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f928affd640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9280035040 tx=0x7f92800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037040 con 0x7f928c0cdae0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280030500 con 0x7f928c0cdae0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280030910 con 0x7f928c0cdae0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c1575c0 con 0x7f928c0cdae0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.850+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c157e60 con 0x7f928c0cdae0 2024-09-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.851+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c0b65c0 con 0x7f928c0cdae0 2024-09-15T22:42:31.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.851+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 6) ==== 90897+0+0 (secure 0 0 0) 0x7f9280044020 con 0x7f928c0cdae0 2024-09-15T22:42:31.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.852+0000 7f9273fff640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 0x7f927806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.852+0000 7f928b7fe640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 0x7f927806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.852+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f92800ab640 con 0x7f928c0cdae0 2024-09-15T22:42:31.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.852+0000 7f928b7fe640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 0x7f927806e800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f927c001560 tx=0x7f927c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.856+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9280079e50 con 0x7f928c0cdae0 2024-09-15T22:42:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:31.966+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f9280075dc0 con 0x7f928c0cdae0 2024-09-15T22:42:32.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.062+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f928c157950 con 0x7f928c0cdae0 2024-09-15T22:42:32.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.063+0000 7f9273fff640 1 -- 172.21.15.134:0/3675379144 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5228 (secure 0 0 0) 0x7f9280082330 con 0x7f928c0cdae0 2024-09-15T22:42:32.064 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:32.064 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":15,"btime":"2024-09-15T22:42:24:934677+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:32.065 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 15 2024-09-15T22:42:32.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 msgr2=0x7f927806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 0x7f927806e800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f927c001560 tx=0x7f927c009040 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 msgr2=0x7f928c1f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9280035040 tx=0x7f92800046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 shutdown_connections 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f927806c340 0x7f927806e800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928c156880 0x7f928c0b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928c0cdae0 0x7f928c1f2d30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 --2- 172.21.15.134:0/3675379144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f928c0aff30 0x7f928c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 >> 172.21.15.134:0/3675379144 conn(0x7f928c06cae0 msgr2=0x7f928c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 shutdown_connections 2024-09-15T22:42:32.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.065+0000 7f9291bed640 1 -- 172.21.15.134:0/3675379144 wait complete. 2024-09-15T22:42:32.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:32.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.174+0000 7f6a6bbf6640 1 Processor -- start 2024-09-15T22:42:32.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.174+0000 7f6a6bbf6640 1 -- start start 2024-09-15T22:42:32.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a6bbf6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6a640d02a0 0x7f6a640d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a6bbf6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a640d0bc0 con 0x7f6a6415ca40 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a6bbf6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6415d390 con 0x7f6a6415ceb0 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a6bbf6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6415d670 con 0x7f6a640d02a0 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a69191640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6a6415ca40 0x7f6a6415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49206/0 (socket says 172.21.15.134:49206) 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.175+0000 7f6a69191640 1 -- 172.21.15.134:0/3383564727 learned_addr learned my addr 172.21.15.134:0/3383564727 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69992640 1 --2- 172.21.15.134:0/3383564727 >> v2:172.21.15.177:3300/0 conn(0x7f6a640d02a0 0x7f6a640d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262548062 0 0) 0x7f6a640d0bc0 con 0x7f6a6415ca40 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a50003520 con 0x7f6a6415ca40 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4133410697 0 0) 0x7f6a50003520 con 0x7f6a6415ca40 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 >> v2:172.21.15.177:3300/0 conn(0x7f6a640d02a0 msgr2=0x7f6a640d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:32.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 --2- 172.21.15.134:0/3383564727 >> v2:172.21.15.177:3300/0 conn(0x7f6a640d02a0 0x7f6a640d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 >> v1:172.21.15.177:6789/0 conn(0x7f6a6415ceb0 legacy=0x7f6a641594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6415d950 con 0x7f6a6415ca40 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6a54001670 con 0x7f6a6415ca40 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 >> v1:172.21.15.134:6789/0 conn(0x7f6a6415ca40 legacy=0x7f6a6415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6415d670 con 0x7f6a50004800 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5000c160 con 0x7f6a500039b0 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5000c360 con 0x7f6a500051c0 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69992640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a6a193640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 -- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a500051c0 msgr2=0x7f6a5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 -- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a500039b0 msgr2=0x7f6a50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a69191640 1 -- 172.21.15.134:0/3383564727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a50003520 con 0x7f6a50004800 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.176+0000 7f6a6a193640 1 -- 172.21.15.134:0/3383564727 reap_dead start 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.177+0000 7f6a69191640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 0x7f6a50004c80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007fb0 tx=0x7f6a50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e154cd02076f01d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.177+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54034020 con 0x7f6a50004800 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.177+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54005af0 con 0x7f6a50004800 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.177+0000 7f6a68990640 1 -- 172.21.15.134:0/3383564727 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54007d30 con 0x7f6a50004800 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 msgr2=0x7f6a50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 0x7f6a50004c80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007fb0 tx=0x7f6a50005830 comp rx=0 tx=0).stop 2024-09-15T22:42:32.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3383564727 shutdown_connections 2024-09-15T22:42:32.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3383564727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3383564727 >> 172.21.15.134:0/3383564727 conn(0x7f6a64062cc0 msgr2=0x7f6a6406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3383564727 shutdown_connections 2024-09-15T22:42:32.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.178+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3383564727 wait complete. 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.179+0000 7f6a6bbf6640 1 Processor -- start 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.179+0000 7f6a6bbf6640 1 -- start start 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a50004800 0x7f6a64071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a64152830 0x7f6a6414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a64155b90 con 0x7f6a64152cb0 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6415df10 con 0x7f6a64152830 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a64155d10 con 0x7f6a50004800 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35340/0 (socket says 172.21.15.134:35340) 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 -- 172.21.15.134:0/3056615247 learned_addr learned my addr 172.21.15.134:0/3056615247 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a69992640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a50004800 0x7f6a64071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a69191640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a64152830 0x7f6a6414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 -- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a50004800 msgr2=0x7f6a64071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a50004800 0x7f6a64071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 -- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a64152830 msgr2=0x7f6a6414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a64152830 0x7f6a6414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 -- 172.21.15.134:0/3056615247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a64153280 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6a193640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c007fd0 tx=0x7f6a5c00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c003b80 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c018070 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a64153560 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.180+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0050d0 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.181+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a64153b20 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.181+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a640cf710 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.182+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f6a5c005270 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.182+0000 7f6a5a7fc640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 0x7f6a4806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.182+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6a5c08b280 con 0x7f6a64152cb0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.182+0000 7f6a69992640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 0x7f6a4806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.183+0000 7f6a69992640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 0x7f6a4806e920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a640afc70 tx=0x7f6a60009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.186+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a640cf710 con 0x7f6a64152cb0 2024-09-15T22:42:32.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.384+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a6406c720 con 0x7f6a64152cb0 2024-09-15T22:42:32.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.384+0000 7f6a5a7fc640 1 -- 172.21.15.134:0/3056615247 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5228 (secure 0 0 0) 0x7f6a5c059800 con 0x7f6a64152cb0 2024-09-15T22:42:32.386 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:32.386 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":15,"btime":"2024-09-15T22:42:24:934677+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:12.212154+0000","modified":"2024-09-15T22:42:14.231926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4842":{"gid":4842,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6837/982036314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":982036314},{"type":"v1","addr":"172.21.15.134:6837","nonce":982036314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4842,"qdb_cluster":[4842]},"id":2}]} 2024-09-15T22:42:32.386 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 15 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 msgr2=0x7f6a4806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 0x7f6a4806e920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a640afc70 tx=0x7f6a60009190 comp rx=0 tx=0).stop 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 msgr2=0x7f6a6414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c007fd0 tx=0x7f6a5c00ead0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 shutdown_connections 2024-09-15T22:42:32.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6a4806c460 0x7f6a4806e920 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a64152cb0 0x7f6a6414bf50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a64152830 0x7f6a6414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 --2- 172.21.15.134:0/3056615247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a50004800 0x7f6a64071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 >> 172.21.15.134:0/3056615247 conn(0x7f6a64062cc0 msgr2=0x7f6a640b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 shutdown_connections 2024-09-15T22:42:32.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.386+0000 7f6a6bbf6640 1 -- 172.21.15.134:0/3056615247 wait complete. 2024-09-15T22:42:32.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.496+0000 7f52e9511640 1 Processor -- start 2024-09-15T22:42:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.496+0000 7f52e9511640 1 -- start start 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e9511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e9511640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e9511640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e40b7170 con 0x7f52e415e940 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e9511640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f52e40b7aa0 con 0x7f52e40cef90 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e9511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40d3660 con 0x7f52e415ed20 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39310/0 (socket says 172.21.15.134:39310) 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e2ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f52e415e940 0x7f52e40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:41820/0 (socket says 172.21.15.134:41820) 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:46632/0 (socket says 172.21.15.134:46632) 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 -- 172.21.15.134:0/4252730336 learned_addr learned my addr 172.21.15.134:0/4252730336 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 -- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 msgr2=0x7f52e40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 -- 172.21.15.134:0/4252730336 >> v1:172.21.15.177:6789/0 conn(0x7f52e415e940 legacy=0x7f52e40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e37fe640 1 -- 172.21.15.134:0/4252730336 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e40d3940 con 0x7f52e40cef90 2024-09-15T22:42:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.497+0000 7f52e27fc640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.498+0000 7f52e37fe640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e50 tx=0x7f52dc02a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c5399d3781abcb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.498+0000 7f52e1ffb640 1 -- 172.21.15.134:0/4252730336 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc036070 con 0x7f52e40cef90 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.498+0000 7f52e1ffb640 1 -- 172.21.15.134:0/4252730336 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc031600 con 0x7f52e40cef90 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.498+0000 7f52e1ffb640 1 -- 172.21.15.134:0/4252730336 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0319d0 con 0x7f52e40cef90 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 -- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e40cef90 msgr2=0x7f52e40b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e50 tx=0x7f52dc02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 -- 172.21.15.134:0/4252730336 shutdown_connections 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 --2- 172.21.15.134:0/4252730336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 -- 172.21.15.134:0/4252730336 >> 172.21.15.134:0/4252730336 conn(0x7f52e40b6240 msgr2=0x7f52e40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 -- 172.21.15.134:0/4252730336 shutdown_connections 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.499+0000 7f52e9511640 1 -- 172.21.15.134:0/4252730336 wait complete. 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.500+0000 7f52e9511640 1 Processor -- start 2024-09-15T22:42:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.500+0000 7f52e9511640 1 -- start start 2024-09-15T22:42:32.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e40cef90 0x7f52e4155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e415ed20 0x7f52e40cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d3310 con 0x7f52e415e940 2024-09-15T22:42:32.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d3f00 con 0x7f52e415ed20 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e9511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40d1ef0 con 0x7f52e40cef90 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35352/0 (socket says 172.21.15.134:35352) 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 -- 172.21.15.134:0/1020174883 learned_addr learned my addr 172.21.15.134:0/1020174883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e37fe640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e415ed20 0x7f52e40cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e2ffd640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e40cef90 0x7f52e4155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 -- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e40cef90 msgr2=0x7f52e4155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e40cef90 0x7f52e4155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 -- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e415ed20 msgr2=0x7f52e40cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e415ed20 0x7f52e40cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 -- 172.21.15.134:0/1020174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e415b550 con 0x7f52e415e940 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.501+0000 7f52e27fc640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e960 tx=0x7f52d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.502+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8017070 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.502+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d800ca00 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.502+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e41e7570 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.502+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d800cdd0 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.502+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e41590e0 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.503+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e40d1060 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.503+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f52d801a070 con 0x7f52e415e940 2024-09-15T22:42:32.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.503+0000 7f52cb7fe640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 0x7f52d006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.504+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f52d808b880 con 0x7f52e415e940 2024-09-15T22:42:32.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.504+0000 7f52e2ffd640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 0x7f52d006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.504+0000 7f52e2ffd640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 0x7f52d006e920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000f60 tx=0x7f52d4007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.508+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52d80597b0 con 0x7f52e415e940 2024-09-15T22:42:32.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.672+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52e40ba6b0 con 0x7f52e415e940 2024-09-15T22:42:32.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.673+0000 7f52cb7fe640 1 -- 172.21.15.134:0/1020174883 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7f52d805dab0 con 0x7f52e415e940 2024-09-15T22:42:32.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:32.675 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":35,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:13.873375+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:09.938942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:11.196490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:32.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.675+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 msgr2=0x7f52d006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.675+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 0x7f52d006e920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000f60 tx=0x7f52d4007cc0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 msgr2=0x7f52e4158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e960 tx=0x7f52d800ee20 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 shutdown_connections 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52d006c460 0x7f52d006e920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52e415ed20 0x7f52e40cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e415e940 0x7f52e4158ba0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 --2- 172.21.15.134:0/1020174883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52e40cef90 0x7f52e4155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 >> 172.21.15.134:0/1020174883 conn(0x7f52e40b6240 msgr2=0x7f52e40cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 shutdown_connections 2024-09-15T22:42:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.676+0000 7f52e9511640 1 -- 172.21.15.134:0/1020174883 wait complete. 2024-09-15T22:42:32.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:42:32.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.787+0000 7f2678c53640 1 Processor -- start 2024-09-15T22:42:32.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.787+0000 7f2678c53640 1 -- start start 2024-09-15T22:42:32.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2678c53640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f267415ca40 0x7f267415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2678c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 0x7f26741594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2678c53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267415d390 con 0x7f26740d02a0 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2678c53640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f267415d670 con 0x7f267415ca40 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2678c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f267415d950 con 0x7f267415ceb0 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f267415ca40 0x7f267415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f267415ca40 0x7f267415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35354/0 (socket says 172.21.15.134:35354) 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 -- 172.21.15.134:0/59481311 learned_addr learned my addr 172.21.15.134:0/59481311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2672d9d640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 0x7f26741594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 -- 172.21.15.134:0/59481311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 msgr2=0x7f26741594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 0x7f26741594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 -- 172.21.15.134:0/59481311 >> v1:172.21.15.177:6789/0 conn(0x7f26740d02a0 legacy=0x7f26740d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2669d9b640 1 -- 172.21.15.134:0/59481311 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267415dc30 con 0x7f267415ca40 2024-09-15T22:42:32.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.788+0000 7f2672d9d640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 0x7f26741594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:32.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.789+0000 7f2669d9b640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267415ca40 0x7f267415e430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f265c00bb10 tx=0x7f265c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0e04662863d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.789+0000 7f2671d9b640 1 -- 172.21.15.134:0/59481311 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c032790 con 0x7f267415ca40 2024-09-15T22:42:32.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.789+0000 7f2671d9b640 1 -- 172.21.15.134:0/59481311 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c038070 con 0x7f267415ca40 2024-09-15T22:42:32.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.789+0000 7f2671d9b640 1 -- 172.21.15.134:0/59481311 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c032b50 con 0x7f267415ca40 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 -- 172.21.15.134:0/59481311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267415ca40 msgr2=0x7f267415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267415ca40 0x7f267415e430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f265c00bb10 tx=0x7f265c02c890 comp rx=0 tx=0).stop 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 -- 172.21.15.134:0/59481311 shutdown_connections 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ceb0 0x7f26741594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 --2- 172.21.15.134:0/59481311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267415ca40 0x7f267415e430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 -- 172.21.15.134:0/59481311 >> 172.21.15.134:0/59481311 conn(0x7f2674062cc0 msgr2=0x7f267406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:32.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 -- 172.21.15.134:0/59481311 shutdown_connections 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.790+0000 7f2678c53640 1 -- 172.21.15.134:0/59481311 wait complete. 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.791+0000 7f2678c53640 1 Processor -- start 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.791+0000 7f2678c53640 1 -- start start 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 0x7f26740ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f267415ceb0 0x7f267414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2674155d10 con 0x7f26740d02a0 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2674155b90 con 0x7f267415ceb0 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2678c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f26740b4790 con 0x7f267415ca40 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35370/0 (socket says 172.21.15.134:35370) 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 -- 172.21.15.134:0/1350994944 learned_addr learned my addr 172.21.15.134:0/1350994944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:32.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2672d9d640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f267415ceb0 0x7f267414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2669d9b640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 0x7f26740ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 -- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 msgr2=0x7f26740ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 0x7f26740ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 -- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f267415ceb0 msgr2=0x7f267414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f267415ceb0 0x7f267414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 -- 172.21.15.134:0/1350994944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267414b060 con 0x7f26740d02a0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f2669d9b640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 0x7f26740ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.792+0000 7f267259c640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f266400c3c0 tx=0x7f266400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.793+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26640052d0 con 0x7f26740d02a0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.793+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664005490 con 0x7f26740d02a0 2024-09-15T22:42:32.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.793+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26740cd300 con 0x7f26740d02a0 2024-09-15T22:42:32.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.793+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664007260 con 0x7f26740d02a0 2024-09-15T22:42:32.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.793+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26740cd8c0 con 0x7f26740d02a0 2024-09-15T22:42:32.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.794+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26740d0680 con 0x7f26740d02a0 2024-09-15T22:42:32.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.794+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f2664007400 con 0x7f26740d02a0 2024-09-15T22:42:32.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.795+0000 7f266b7fe640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 0x7f265406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:32.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.795+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f266408ab70 con 0x7f26740d02a0 2024-09-15T22:42:32.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.795+0000 7f2669d9b640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 0x7f265406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:32.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.795+0000 7f2669d9b640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 0x7f265406e920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f265c037000 tx=0x7f265c03e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:32.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:32.799+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2664058a20 con 0x7f26740d02a0 2024-09-15T22:42:33.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.000+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f26740760a0 con 0x7f26740d02a0 2024-09-15T22:42:33.002 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:42:33.001+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:42:33.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.002+0000 7f266b7fe640 1 -- 172.21.15.134:0/1350994944 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f266405cd20 con 0x7f26740d02a0 2024-09-15T22:42:33.003 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 msgr2=0x7f265406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 0x7f265406e920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f265c037000 tx=0x7f265c03e040 comp rx=0 tx=0).stop 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 msgr2=0x7f267414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f266400c3c0 tx=0x7f266400c880 comp rx=0 tx=0).stop 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 shutdown_connections 2024-09-15T22:42:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f265406c460 0x7f265406e920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f267415ceb0 0x7f267414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267415ca40 0x7f26740ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 --2- 172.21.15.134:0/1350994944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26740d02a0 0x7f267414ffb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 >> 172.21.15.134:0/1350994944 conn(0x7f2674062cc0 msgr2=0x7f26741548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 shutdown_connections 2024-09-15T22:42:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.005+0000 7f2678c53640 1 -- 172.21.15.134:0/1350994944 wait complete. 2024-09-15T22:42:33.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:42:33.044 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:42:33.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.119+0000 7f727aed2640 1 Processor -- start 2024-09-15T22:42:33.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.119+0000 7f727aed2640 1 -- start start 2024-09-15T22:42:33.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727aed2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f727415c5b0 0x7f72740b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727aed2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 0x7f727406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727aed2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72740d1060 con 0x7f72740b3be0 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727aed2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f72740b4050 con 0x7f727415c5b0 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727aed2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f72740d1340 con 0x7f72740d0a40 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f7278c6e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f727415c5b0 0x7f72740b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727946f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 0x7f727406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f7278c6e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f727415c5b0 0x7f72740b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39344/0 (socket says 172.21.15.134:39344) 2024-09-15T22:42:33.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f726bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f72740b3be0 0x7f72740d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:41844/0 (socket says 172.21.15.134:41844) 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f727946f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 0x7f727406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:46680/0 (socket says 172.21.15.134:46680) 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.120+0000 7f7278c6e640 1 -- 172.21.15.134:0/3553128910 learned_addr learned my addr 172.21.15.134:0/3553128910 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.121+0000 7f7278c6e640 1 -- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 msgr2=0x7f727406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.121+0000 7f7278c6e640 1 --2- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 0x7f727406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.121+0000 7f7278c6e640 1 -- 172.21.15.134:0/3553128910 >> v1:172.21.15.177:6789/0 conn(0x7f72740b3be0 legacy=0x7f72740d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.121+0000 7f7278c6e640 1 -- 172.21.15.134:0/3553128910 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727406e2a0 con 0x7f727415c5b0 2024-09-15T22:42:33.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.121+0000 7f7278c6e640 1 --2- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f727415c5b0 0x7f72740b36a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72700098a0 tx=0x7f727002a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b4b44f0c8247b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:33.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f726b7fe640 1 -- 172.21.15.134:0/3553128910 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270037070 con 0x7f727415c5b0 2024-09-15T22:42:33.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f726b7fe640 1 -- 172.21.15.134:0/3553128910 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270032440 con 0x7f727415c5b0 2024-09-15T22:42:33.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f726b7fe640 1 -- 172.21.15.134:0/3553128910 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270032810 con 0x7f727415c5b0 2024-09-15T22:42:33.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 -- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f727415c5b0 msgr2=0x7f72740b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 --2- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f727415c5b0 0x7f72740b36a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72700098a0 tx=0x7f727002a200 comp rx=0 tx=0).stop 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 -- 172.21.15.134:0/3553128910 shutdown_connections 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 --2- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72740d0a40 0x7f727406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 --2- 172.21.15.134:0/3553128910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f727415c5b0 0x7f72740b36a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 -- 172.21.15.134:0/3553128910 >> 172.21.15.134:0/3553128910 conn(0x7f727406d0d0 msgr2=0x7f727406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:33.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 -- 172.21.15.134:0/3553128910 shutdown_connections 2024-09-15T22:42:33.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.122+0000 7f727aed2640 1 -- 172.21.15.134:0/3553128910 wait complete. 2024-09-15T22:42:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.123+0000 7f727aed2640 1 Processor -- start 2024-09-15T22:42:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.123+0000 7f727aed2640 1 -- start start 2024-09-15T22:42:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72740d0a40 0x7f72741435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727415c5b0 0x7f727415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f727406f2c0 con 0x7f72740b3be0 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f727406e860 con 0x7f72740d0a40 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f727aed2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f727406f440 con 0x7f727415c5b0 2024-09-15T22:42:33.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f7278c6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f7278c6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35384/0 (socket says 172.21.15.134:35384) 2024-09-15T22:42:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.124+0000 7f7278c6e640 1 -- 172.21.15.134:0/1661665621 learned_addr learned my addr 172.21.15.134:0/1661665621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f726bfff640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72740d0a40 0x7f72741435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f727946f640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727415c5b0 0x7f727415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 -- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727415c5b0 msgr2=0x7f727415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727415c5b0 0x7f727415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 -- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72740d0a40 msgr2=0x7f72741435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72740d0a40 0x7f72741435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 -- 172.21.15.134:0/1661665621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7274156fb0 con 0x7f72740b3be0 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f7278c6e640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f72700098a0 tx=0x7f72700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270037040 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270030440 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7274157220 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270030830 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.125+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7274146fc0 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.126+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727406ed80 con 0x7f72740b3be0 2024-09-15T22:42:33.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.127+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f7270044030 con 0x7f72740b3be0 2024-09-15T22:42:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.127+0000 7f72697fa640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 0x7f726006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.127+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f72700ab4e0 con 0x7f72740b3be0 2024-09-15T22:42:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.127+0000 7f726bfff640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 0x7f726006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.128+0000 7f726bfff640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 0x7f726006e920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f727415b790 tx=0x7f7264007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.131+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f727004b060 con 0x7f72740b3be0 2024-09-15T22:42:33.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:33.330+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f72741573f0 con 0x7f72740b3be0 2024-09-15T22:42:34.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.005+0000 7f72697fa640 1 -- 172.21.15.134:0/1661665621 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f72700793b0 con 0x7f72740b3be0 2024-09-15T22:42:34.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 msgr2=0x7f726006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 0x7f726006e920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f727415b790 tx=0x7f7264007e80 comp rx=0 tx=0).stop 2024-09-15T22:42:34.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 msgr2=0x7f7274157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f72700098a0 tx=0x7f72700046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 shutdown_connections 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f726006c460 0x7f726006e920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727415c5b0 0x7f727415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72740d0a40 0x7f72741435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 --2- 172.21.15.134:0/1661665621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72740b3be0 0x7f7274157ce0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 >> 172.21.15.134:0/1661665621 conn(0x7f727406d0d0 msgr2=0x7f72740d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 shutdown_connections 2024-09-15T22:42:34.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.008+0000 7f727aed2640 1 -- 172.21.15.134:0/1661665621 wait complete. 2024-09-15T22:42:34.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:42:34.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.164+0000 7f565e6e6640 1 Processor -- start 2024-09-15T22:42:34.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.164+0000 7f565e6e6640 1 -- start start 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f565e6e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 0x7f5658072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f565e6e6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565815c970 con 0x7f565815b370 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f565e6e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565815bbb0 con 0x7f565815f9f0 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f565e6e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f565815fef0 con 0x7f565806f130 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5657fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f565815b370 0x7f565806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49224/0 (socket says 172.21.15.134:49224) 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5657fff640 1 -- 172.21.15.134:0/2441744060 learned_addr learned my addr 172.21.15.134:0/2441744060 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f56577fe640 1 --2- 172.21.15.134:0/2441744060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 0x7f5658072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778910065 0 0) 0x7f565815c970 con 0x7f565815b370 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5640003520 con 0x7f565815b370 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866021861 0 0) 0x7f565815bbb0 con 0x7f565815f9f0 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f565815c970 con 0x7f565815f9f0 2024-09-15T22:42:34.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116981339 0 0) 0x7f5640003520 con 0x7f565815b370 2024-09-15T22:42:34.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f56577fe640 1 -- 172.21.15.134:0/2441744060 >> v1:172.21.15.177:6789/0 conn(0x7f565815f9f0 legacy=0x7f56580ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f56577fe640 1 -- 172.21.15.134:0/2441744060 >> v1:172.21.15.134:6789/0 conn(0x7f565815b370 legacy=0x7f565806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.165+0000 7f56577fe640 1 -- 172.21.15.134:0/2441744060 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565815be90 con 0x7f565806f130 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.166+0000 7f56577fe640 1 --2- 172.21.15.134:0/2441744060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 0x7f5658072560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097d0 tx=0x7f564c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da45ed4c60a82dff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.166+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c037070 con 0x7f565806f130 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.166+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c02ab90 con 0x7f565806f130 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.166+0000 7f5656ffd640 1 -- 172.21.15.134:0/2441744060 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648001670 con 0x7f565806f130 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 -- 172.21.15.134:0/2441744060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 msgr2=0x7f5658072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 --2- 172.21.15.134:0/2441744060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 0x7f5658072560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097d0 tx=0x7f564c02a100 comp rx=0 tx=0).stop 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 -- 172.21.15.134:0/2441744060 shutdown_connections 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 --2- 172.21.15.134:0/2441744060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565806f130 0x7f5658072560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 -- 172.21.15.134:0/2441744060 >> 172.21.15.134:0/2441744060 conn(0x7f565806bba0 msgr2=0x7f565806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:34.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 -- 172.21.15.134:0/2441744060 shutdown_connections 2024-09-15T22:42:34.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.167+0000 7f565e6e6640 1 -- 172.21.15.134:0/2441744060 wait complete. 2024-09-15T22:42:34.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.168+0000 7f565e6e6640 1 Processor -- start 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.168+0000 7f565e6e6640 1 -- start start 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f565806f130 0x7f5658155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565815b370 0x7f565806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56580731b0 con 0x7f565815f9f0 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f565815c450 con 0x7f565806f130 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565e6e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f565815b750 con 0x7f565815b370 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35396/0 (socket says 172.21.15.134:35396) 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 -- 172.21.15.134:0/3999580929 learned_addr learned my addr 172.21.15.134:0/3999580929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f5657fff640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f565806f130 0x7f5658155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f56577fe640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565815b370 0x7f565806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 -- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565815b370 msgr2=0x7f565806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565815b370 0x7f565806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 -- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f565806f130 msgr2=0x7f5658155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f565806f130 0x7f5658155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.169+0000 7f565cc83640 1 -- 172.21.15.134:0/3999580929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565806de50 con 0x7f565815f9f0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f565cc83640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f565000c730 tx=0x7f565000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650003b70 con 0x7f565815f9f0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5650003d10 con 0x7f565815f9f0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565806e0d0 con 0x7f565815f9f0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500052d0 con 0x7f565815f9f0 2024-09-15T22:42:34.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.170+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5658153880 con 0x7f565815f9f0 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.171+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5658072560 con 0x7f565815f9f0 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.171+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f5650005470 con 0x7f565815f9f0 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.172+0000 7f5654ff9640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 0x7f564406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.172+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f565008b710 con 0x7f565815f9f0 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.172+0000 7f5657fff640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 0x7f564406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.172+0000 7f5657fff640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 0x7f564406e920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f56480011e0 tx=0x7f5648009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:34.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.176+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f565806de50 con 0x7f565815f9f0 2024-09-15T22:42:34.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:34.342+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f56580b3140 con 0x7f565815f9f0 2024-09-15T22:42:35.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.013+0000 7f5654ff9640 1 -- 172.21.15.134:0/3999580929 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7f5650059b10 con 0x7f565815f9f0 2024-09-15T22:42:35.015 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.016+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 msgr2=0x7f564406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.016+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 0x7f564406e920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f56480011e0 tx=0x7f5648009040 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.016+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 msgr2=0x7f5658147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.016+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f565000c730 tx=0x7f565000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 shutdown_connections 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f564406c460 0x7f564406e920 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565815f9f0 0x7f5658147b80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f565815b370 0x7f565806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 --2- 172.21.15.134:0/3999580929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f565806f130 0x7f5658155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 >> 172.21.15.134:0/3999580929 conn(0x7f565806bba0 msgr2=0x7f56580b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:35.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 shutdown_connections 2024-09-15T22:42:35.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.017+0000 7f565e6e6640 1 -- 172.21.15.134:0/3999580929 wait complete. 2024-09-15T22:42:35.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:42:35.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.140+0000 7f15d4877640 1 Processor -- start 2024-09-15T22:42:35.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.140+0000 7f15d4877640 1 -- start start 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15d4877640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15d006f130 0x7f15d0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15d4877640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15d015f9f0 0x7f15d00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15d4877640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d015c970 con 0x7f15d015b370 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15d4877640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f15d015fef0 con 0x7f15d015f9f0 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15d4877640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f15d015bbb0 con 0x7f15d006f130 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15ced9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15d015f9f0 0x7f15d00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15ced9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15d015f9f0 0x7f15d00ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35402/0 (socket says 172.21.15.134:35402) 2024-09-15T22:42:35.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15ced9d640 1 -- 172.21.15.134:0/4047499534 learned_addr learned my addr 172.21.15.134:0/4047499534 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:35.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.141+0000 7f15cdd9b640 1 --2- 172.21.15.134:0/4047499534 >> v2:172.21.15.177:3300/0 conn(0x7f15d006f130 0x7f15d0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.142+0000 7f15ced9d640 1 -- 172.21.15.134:0/4047499534 >> v2:172.21.15.177:3300/0 conn(0x7f15d006f130 msgr2=0x7f15d0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:35.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.142+0000 7f15ced9d640 1 --2- 172.21.15.134:0/4047499534 >> v2:172.21.15.177:3300/0 conn(0x7f15d006f130 0x7f15d0072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.142+0000 7f15ced9d640 1 -- 172.21.15.134:0/4047499534 >> v1:172.21.15.177:6789/0 conn(0x7f15d015b370 legacy=0x7f15d006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.142+0000 7f15ced9d640 1 -- 172.21.15.134:0/4047499534 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d015be90 con 0x7f15d015f9f0 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.142+0000 7f15ced9d640 1 --2- 172.21.15.134:0/4047499534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d00ce490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f15d00d0470 tx=0x7f15c802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94798382996e2f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15cd59a640 1 -- 172.21.15.134:0/4047499534 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c800b2d0 con 0x7f15d015f9f0 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15cd59a640 1 -- 172.21.15.134:0/4047499534 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c800b470 con 0x7f15d015f9f0 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15cd59a640 1 -- 172.21.15.134:0/4047499534 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8009820 con 0x7f15d015f9f0 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 -- 172.21.15.134:0/4047499534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 msgr2=0x7f15d00ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 --2- 172.21.15.134:0/4047499534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d00ce490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f15d00d0470 tx=0x7f15c802c8b0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 -- 172.21.15.134:0/4047499534 shutdown_connections 2024-09-15T22:42:35.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 --2- 172.21.15.134:0/4047499534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d00ce490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 --2- 172.21.15.134:0/4047499534 >> v2:172.21.15.177:3300/0 conn(0x7f15d006f130 0x7f15d0072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 -- 172.21.15.134:0/4047499534 >> 172.21.15.134:0/4047499534 conn(0x7f15d006bba0 msgr2=0x7f15d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:35.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 -- 172.21.15.134:0/4047499534 shutdown_connections 2024-09-15T22:42:35.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.143+0000 7f15d4877640 1 -- 172.21.15.134:0/4047499534 wait complete. 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.144+0000 7f15d4877640 1 Processor -- start 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 -- start start 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15d006f130 0x7f15d0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15d015b370 0x7f15d015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15d00731b0 con 0x7f15d015f9f0 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015c450 con 0x7f15d006f130 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15d4877640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15d015b750 con 0x7f15d015b370 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35416/0 (socket says 172.21.15.134:35416) 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15ced9d640 1 -- 172.21.15.134:0/821695297 learned_addr learned my addr 172.21.15.134:0/821695297 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15cdd9b640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15d015b370 0x7f15d015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.145+0000 7f15ce59c640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15d006f130 0x7f15d0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 -- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15d015b370 msgr2=0x7f15d015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15d015b370 0x7f15d015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 -- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15d006f130 msgr2=0x7f15d0155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15d006f130 0x7f15d0155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 -- 172.21.15.134:0/821695297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d015e890 con 0x7f15d015f9f0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15ced9d640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15c800d210 tx=0x7f15c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8040020 con 0x7f15d015f9f0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8009370 con 0x7f15d015f9f0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d015eb70 con 0x7f15d015f9f0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c800b720 con 0x7f15d015f9f0 2024-09-15T22:42:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.146+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d0158e90 con 0x7f15d015f9f0 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.147+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d0159090 con 0x7f15d015f9f0 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.147+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f15c8043020 con 0x7f15d015f9f0 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.148+0000 7f15beffd640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 0x7f15b006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.148+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5357+0+0 (secure 0 0 0) 0x7f15c80ac250 con 0x7f15d015f9f0 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.148+0000 7f15ce59c640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 0x7f15b006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.148+0000 7f15ce59c640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 0x7f15b006e920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001780 tx=0x7f15c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:35.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.152+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15d0159090 con 0x7f15d015f9f0 2024-09-15T22:42:35.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:35.317+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f15d0072560 con 0x7f15d015f9f0 2024-09-15T22:42:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.014+0000 7f15beffd640 1 -- 172.21.15.134:0/821695297 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7f15c804a030 con 0x7f15d015f9f0 2024-09-15T22:42:36.016 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 msgr2=0x7f15b006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 0x7f15b006e920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001780 tx=0x7f15c0009040 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 msgr2=0x7f15d015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15c800d210 tx=0x7f15c8004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 shutdown_connections 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f15b006c460 0x7f15b006e920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15d015f9f0 0x7f15d015e210 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15d015b370 0x7f15d015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 --2- 172.21.15.134:0/821695297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15d006f130 0x7f15d0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 >> 172.21.15.134:0/821695297 conn(0x7f15d006bba0 msgr2=0x7f15d00cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 shutdown_connections 2024-09-15T22:42:36.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.019+0000 7f15d4877640 1 -- 172.21.15.134:0/821695297 wait complete. 2024-09-15T22:42:36.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:42:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.136+0000 7f19bebbe640 1 Processor -- start 2024-09-15T22:42:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.136+0000 7f19bebbe640 1 -- start start 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 0x7f19b80b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19b80b4b90 0x7f19b80b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19b80ae8e0 0x7f19b80aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f19b80af270 con 0x7f19b80b4b90 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f19b80b5ff0 con 0x7f19b80ae8e0 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bebbe640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19b8148400 con 0x7f19b8148020 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19b7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19b80b4b90 0x7f19b80b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19b7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19b80b4b90 0x7f19b80b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35424/0 (socket says 172.21.15.134:35424) 2024-09-15T22:42:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19b7fff640 1 -- 172.21.15.134:0/1170163892 learned_addr learned my addr 172.21.15.134:0/1170163892 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bd15b640 1 --2- 172.21.15.134:0/1170163892 >> v2:172.21.15.177:3300/0 conn(0x7f19b80ae8e0 0x7f19b80aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19bc95a640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 0x7f19b80b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19b7fff640 1 -- 172.21.15.134:0/1170163892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 msgr2=0x7f19b80b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.137+0000 7f19b7fff640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 0x7f19b80b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b7fff640 1 -- 172.21.15.134:0/1170163892 >> v2:172.21.15.177:3300/0 conn(0x7f19b80ae8e0 msgr2=0x7f19b80aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b7fff640 1 --2- 172.21.15.134:0/1170163892 >> v2:172.21.15.177:3300/0 conn(0x7f19b80ae8e0 0x7f19b80aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b7fff640 1 -- 172.21.15.134:0/1170163892 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b80b53e0 con 0x7f19b80b4b90 2024-09-15T22:42:36.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19bc95a640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 0x7f19b80b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:36.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b7fff640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b80b6480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19b8071fe0 tx=0x7f19ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1b8fe8789ef7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b77fe640 1 -- 172.21.15.134:0/1170163892 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037070 con 0x7f19b80b4b90 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b77fe640 1 -- 172.21.15.134:0/1170163892 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac032440 con 0x7f19b80b4b90 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.138+0000 7f19b77fe640 1 -- 172.21.15.134:0/1170163892 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac032810 con 0x7f19b80b4b90 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 -- 172.21.15.134:0/1170163892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 msgr2=0x7f19b80b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b80b6480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19b8071fe0 tx=0x7f19ac02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 -- 172.21.15.134:0/1170163892 shutdown_connections 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 --2- 172.21.15.134:0/1170163892 >> v2:172.21.15.177:3300/0 conn(0x7f19b80ae8e0 0x7f19b80aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b80b6480 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 --2- 172.21.15.134:0/1170163892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b8148020 0x7f19b80b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 -- 172.21.15.134:0/1170163892 >> 172.21.15.134:0/1170163892 conn(0x7f19b806d0d0 msgr2=0x7f19b806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 -- 172.21.15.134:0/1170163892 shutdown_connections 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.139+0000 7f19bebbe640 1 -- 172.21.15.134:0/1170163892 wait complete. 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.140+0000 7f19bebbe640 1 Processor -- start 2024-09-15T22:42:36.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.140+0000 7f19bebbe640 1 -- start start 2024-09-15T22:42:36.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b80ae8e0 0x7f19b81f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b8148020 0x7f19b81ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80b5c80 con 0x7f19b80b4b90 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80b59a0 con 0x7f19b8148020 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bebbe640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19b80b69c0 con 0x7f19b80ae8e0 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35436/0 (socket says 172.21.15.134:35436) 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 -- 172.21.15.134:0/122792162 learned_addr learned my addr 172.21.15.134:0/122792162 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bd15b640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b8148020 0x7f19b81ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19bc95a640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b80ae8e0 0x7f19b81f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 -- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b80ae8e0 msgr2=0x7f19b81f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b80ae8e0 0x7f19b81f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 -- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b8148020 msgr2=0x7f19b81ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b8148020 0x7f19b81ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.141+0000 7f19b7fff640 1 -- 172.21.15.134:0/122792162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b8141ab0 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19b7fff640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19ac02a220 tx=0x7f19ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac041020 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac0306c0 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037040 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b8141d90 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.142+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b815f240 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.143+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b80b4fd0 con 0x7f19b80b4b90 2024-09-15T22:42:36.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.143+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f19ac044020 con 0x7f19b80b4b90 2024-09-15T22:42:36.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.144+0000 7f19b57fa640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 0x7f19a406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.144+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f19ac0abb30 con 0x7f19b80b4b90 2024-09-15T22:42:36.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.144+0000 7f19bc95a640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 0x7f19a406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.144+0000 7f19bc95a640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 0x7f19a406e920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006e80 tx=0x7f19a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.148+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19ac04b030 con 0x7f19b80b4b90 2024-09-15T22:42:36.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.319+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f19b815f020 con 0x7f19b80b4b90 2024-09-15T22:42:36.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.322+0000 7f19b57fa640 1 -- 172.21.15.134:0/122792162 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f19ac079cd0 con 0x7f19b80b4b90 2024-09-15T22:42:36.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 msgr2=0x7f19a406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 0x7f19a406e920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006e80 tx=0x7f19a8008040 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 msgr2=0x7f19b8143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19ac02a220 tx=0x7f19ac0046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 shutdown_connections 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f19a406c460 0x7f19a406e920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b8148020 0x7f19b81ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b80b4b90 0x7f19b8143670 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 --2- 172.21.15.134:0/122792162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19b80ae8e0 0x7f19b81f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 >> 172.21.15.134:0/122792162 conn(0x7f19b806d0d0 msgr2=0x7f19b806f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 shutdown_connections 2024-09-15T22:42:36.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.325+0000 7f19bebbe640 1 -- 172.21.15.134:0/122792162 wait complete. 2024-09-15T22:42:36.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:42:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.434+0000 7f7b3223c640 1 Processor -- start 2024-09-15T22:42:36.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.434+0000 7f7b3223c640 1 -- start start 2024-09-15T22:42:36.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b3223c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7b2c0d02a0 0x7f7b2c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b3223c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0d0bc0 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b3223c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c15d390 con 0x7f7b2c15ca40 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b3223c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c15d670 con 0x7f7b2c0d02a0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b2bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7b2c15ceb0 0x7f7b2c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40336/0 (socket says 172.21.15.134:40336) 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b2bfff640 1 -- 172.21.15.134:0/4130071099 learned_addr learned my addr 172.21.15.134:0/4130071099 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b2b7fe640 1 --2- 172.21.15.134:0/4130071099 >> v2:172.21.15.177:3300/0 conn(0x7f7b2c0d02a0 0x7f7b2c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709078732 0 0) 0x7f7b2c0d0bc0 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.435+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b14003520 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 328440014 0 0) 0x7f7b14003520 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 >> v2:172.21.15.177:3300/0 conn(0x7f7b2c0d02a0 msgr2=0x7f7b2c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 --2- 172.21.15.134:0/4130071099 >> v2:172.21.15.177:3300/0 conn(0x7f7b2c0d02a0 0x7f7b2c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 >> v1:172.21.15.177:6789/0 conn(0x7f7b2c15ca40 legacy=0x7f7b2c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c15d950 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7b240019f0 con 0x7f7b2c15ceb0 2024-09-15T22:42:36.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 >> v1:172.21.15.134:6789/0 conn(0x7f7b2c15ceb0 legacy=0x7f7b2c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b140039b0 0x7f7b14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b14004800 0x7f7b14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b1400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c15d670 con 0x7f7b140051c0 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1400c160 con 0x7f7b140039b0 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1400c360 con 0x7f7b14004800 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b1400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2b7fe640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b140039b0 0x7f7b14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2affd640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b14004800 0x7f7b14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 -- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b14004800 msgr2=0x7f7b14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b14004800 0x7f7b14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 -- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b140039b0 msgr2=0x7f7b14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:36.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b140039b0 0x7f7b14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.436+0000 7f7b2bfff640 1 -- 172.21.15.134:0/4130071099 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b14003520 con 0x7f7b140051c0 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.437+0000 7f7b2bfff640 1 -- 172.21.15.134:0/4130071099 reap_dead start 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.437+0000 7f7b2bfff640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b1400b9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b24002230 tx=0x7f7b14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d31ea4afb5380df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.437+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400c560 con 0x7f7b140051c0 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.437+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2402f070 con 0x7f7b140051c0 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.437+0000 7f7b2a7fc640 1 -- 172.21.15.134:0/4130071099 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24034690 con 0x7f7b140051c0 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 -- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 msgr2=0x7f7b1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b1400b9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b24002230 tx=0x7f7b14005830 comp rx=0 tx=0).stop 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 -- 172.21.15.134:0/4130071099 shutdown_connections 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 --2- 172.21.15.134:0/4130071099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b1400b9c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 -- 172.21.15.134:0/4130071099 >> 172.21.15.134:0/4130071099 conn(0x7f7b2c062cc0 msgr2=0x7f7b2c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 -- 172.21.15.134:0/4130071099 shutdown_connections 2024-09-15T22:42:36.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.438+0000 7f7b3223c640 1 -- 172.21.15.134:0/4130071099 wait complete. 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.439+0000 7f7b3223c640 1 Processor -- start 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.439+0000 7f7b3223c640 1 -- start start 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 0x7f7b2c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b2c157dc0 0x7f7b2c15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c155b90 con 0x7f7b140051c0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c15df10 con 0x7f7b2c157dc0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b3223c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c155d10 con 0x7f7b2c0affb0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50228/0 (socket says 172.21.15.134:50228) 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 -- 172.21.15.134:0/3062029694 learned_addr learned my addr 172.21.15.134:0/3062029694 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2affd640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 0x7f7b2c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2bfff640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b2c157dc0 0x7f7b2c15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 -- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 msgr2=0x7f7b2c15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 0x7f7b2c15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 -- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b2c157dc0 msgr2=0x7f7b2c15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b2c157dc0 0x7f7b2c15b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 -- 172.21.15.134:0/3062029694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0b0520 con 0x7f7b140051c0 2024-09-15T22:42:36.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2affd640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 0x7f7b2c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b2b7fe640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009ae0 tx=0x7f7b1c00b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.440+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00bd20 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.441+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c020070 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.441+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c0b0800 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.441+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c01b620 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.441+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c0b0dc0 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.442+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c0b4790 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.442+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f7b1c01b7c0 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.443+0000 7f7b13fff640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 0x7f7b1806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.443+0000 7f7b2affd640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 0x7f7b1806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.443+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f7b1c08fa00 con 0x7f7b140051c0 2024-09-15T22:42:36.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.443+0000 7f7b2affd640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 0x7f7b1806e950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000c00 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:36.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.447+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b1c05e280 con 0x7f7b140051c0 2024-09-15T22:42:36.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:36.676+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f7b2c1f1260 con 0x7f7b140051c0 2024-09-15T22:42:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.021+0000 7f7b13fff640 1 -- 172.21.15.134:0/3062029694 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v91) ==== 158+0+0 (secure 0 0 0) 0x7f7b1c05db80 con 0x7f7b140051c0 2024-09-15T22:42:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.023+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 msgr2=0x7f7b1806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.023+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 0x7f7b1806e950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000c00 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2024-09-15T22:42:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.023+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 msgr2=0x7f7b2c149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.023+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009ae0 tx=0x7f7b1c00b140 comp rx=0 tx=0).stop 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 shutdown_connections 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7b1806c490 0x7f7b1806e950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b2c157dc0 0x7f7b2c15b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b2c0affb0 0x7f7b2c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 --2- 172.21.15.134:0/3062029694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b140051c0 0x7f7b2c149d40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 >> 172.21.15.134:0/3062029694 conn(0x7f7b2c062cc0 msgr2=0x7f7b2c15a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 shutdown_connections 2024-09-15T22:42:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.024+0000 7f7b3223c640 1 -- 172.21.15.134:0/3062029694 wait complete. 2024-09-15T22:42:37.037 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-15T22:42:37.038 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:42:37.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:37.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.137+0000 7fdc6a176640 1 Processor -- start 2024-09-15T22:42:37.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.137+0000 7fdc6a176640 1 -- start start 2024-09-15T22:42:37.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc6a176640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc6415c3d0 0x7fdc640b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc6a176640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc640ce910 0x7fdc640b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc6a176640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc640b5a60 con 0x7fdc640b3550 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc6a176640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdc640b3ed0 con 0x7fdc6415c3d0 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc6a176640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdc640b5d00 con 0x7fdc640ce910 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc6415c3d0 0x7fdc640b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc6415c3d0 0x7fdc640b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50232/0 (socket says 172.21.15.134:50232) 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 -- 172.21.15.134:0/321407289 learned_addr learned my addr 172.21.15.134:0/321407289 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc63fff640 1 --2- 172.21.15.134:0/321407289 >> v2:172.21.15.177:3300/0 conn(0x7fdc640ce910 0x7fdc640b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 -- 172.21.15.134:0/321407289 >> v2:172.21.15.177:3300/0 conn(0x7fdc640ce910 msgr2=0x7fdc640b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 --2- 172.21.15.134:0/321407289 >> v2:172.21.15.177:3300/0 conn(0x7fdc640ce910 0x7fdc640b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 -- 172.21.15.134:0/321407289 >> v1:172.21.15.177:6789/0 conn(0x7fdc640b3550 legacy=0x7fdc640ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:37.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.138+0000 7fdc637fe640 1 -- 172.21.15.134:0/321407289 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc640b5fe0 con 0x7fdc6415c3d0 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc637fe640 1 --2- 172.21.15.134:0/321407289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b67e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b51f0 tx=0x7fdc4c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e89036170563fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc627fc640 1 -- 172.21.15.134:0/321407289 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037070 con 0x7fdc6415c3d0 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc627fc640 1 -- 172.21.15.134:0/321407289 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c032440 con 0x7fdc6415c3d0 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc627fc640 1 -- 172.21.15.134:0/321407289 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c032810 con 0x7fdc6415c3d0 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 -- 172.21.15.134:0/321407289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 msgr2=0x7fdc640b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 --2- 172.21.15.134:0/321407289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b67e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b51f0 tx=0x7fdc4c02a200 comp rx=0 tx=0).stop 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 -- 172.21.15.134:0/321407289 shutdown_connections 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 --2- 172.21.15.134:0/321407289 >> v2:172.21.15.177:3300/0 conn(0x7fdc640ce910 0x7fdc640b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 --2- 172.21.15.134:0/321407289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b67e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 -- 172.21.15.134:0/321407289 >> 172.21.15.134:0/321407289 conn(0x7fdc6406ce90 msgr2=0x7fdc6406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.139+0000 7fdc6a176640 1 -- 172.21.15.134:0/321407289 shutdown_connections 2024-09-15T22:42:37.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.140+0000 7fdc6a176640 1 -- 172.21.15.134:0/321407289 wait complete. 2024-09-15T22:42:37.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.141+0000 7fdc6a176640 1 Processor -- start 2024-09-15T22:42:37.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.141+0000 7fdc6a176640 1 -- start start 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc640b3550 0x7fdc640afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc640ce910 0x7fdc6414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc640cef70 con 0x7fdc6415c3d0 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc640b6d20 con 0x7fdc640ce910 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdc640cf0f0 con 0x7fdc640b3550 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50236/0 (socket says 172.21.15.134:50236) 2024-09-15T22:42:37.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 -- 172.21.15.134:0/3494053030 learned_addr learned my addr 172.21.15.134:0/3494053030 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc62ffd640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc640ce910 0x7fdc6414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc637fe640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc640b3550 0x7fdc640afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 -- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc640b3550 msgr2=0x7fdc640afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc640b3550 0x7fdc640afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 -- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc640ce910 msgr2=0x7fdc6414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc640ce910 0x7fdc6414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 -- 172.21.15.134:0/3494053030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc640aed70 con 0x7fdc6415c3d0 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc63fff640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00cda0 tx=0x7fdc5c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c003b90 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5c003d30 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc640af050 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c004240 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.142+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc640af610 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.143+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc640b3970 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.144+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fdc5c0043e0 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.144+0000 7fdc5bfff640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 0x7fdc4406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.144+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdc5c08c0b0 con 0x7fdc6415c3d0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.144+0000 7fdc637fe640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 0x7fdc4406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.145+0000 7fdc637fe640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 0x7fdc4406e920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c034000 tx=0x7fdc4c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.148+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc5c01d340 con 0x7fdc6415c3d0 2024-09-15T22:42:37.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.315+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc640d1290 con 0x7fdc6415c3d0 2024-09-15T22:42:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.316+0000 7fdc5bfff640 1 -- 172.21.15.134:0/3494053030 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13068 (secure 0 0 0) 0x7fdc5c05a7a0 con 0x7fdc6415c3d0 2024-09-15T22:42:37.317 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:37.317 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":38,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:36.014549+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6837/982036314":"2024-09-16T22:42:33.002158+0000","172.21.15.134:6835/982036314":"2024-09-16T22:42:33.002158+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 msgr2=0x7fdc4406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 0x7fdc4406e920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c034000 tx=0x7fdc4c02e000 comp rx=0 tx=0).stop 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 msgr2=0x7fdc640b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00cda0 tx=0x7fdc5c00a660 comp rx=0 tx=0).stop 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 shutdown_connections 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdc4406c460 0x7fdc4406e920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc6415c3d0 0x7fdc640b2c00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc640ce910 0x7fdc6414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 --2- 172.21.15.134:0/3494053030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc640b3550 0x7fdc640afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 >> 172.21.15.134:0/3494053030 conn(0x7fdc6406ce90 msgr2=0x7fdc6415eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 shutdown_connections 2024-09-15T22:42:37.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.318+0000 7fdc6a176640 1 -- 172.21.15.134:0/3494053030 wait complete. 2024-09-15T22:42:37.331 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:42:37.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:42:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.431+0000 7ff509186640 1 Processor -- start 2024-09-15T22:42:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.431+0000 7ff509186640 1 -- start start 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff509186640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 0x7ff5040b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff509186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff509186640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50415c800 con 0x7ff50406ef60 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff509186640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff50406f3d0 con 0x7ff504158e50 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff509186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff5040b43f0 con 0x7ff50415c370 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff502d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 0x7ff5040b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:41396/0 (socket says 172.21.15.134:41396) 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 -- 172.21.15.134:0/245911538 learned_addr learned my addr 172.21.15.134:0/245911538 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 -- 172.21.15.134:0/245911538 >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 msgr2=0x7ff5040b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 --2- 172.21.15.134:0/245911538 >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 0x7ff5040b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 -- 172.21.15.134:0/245911538 >> v1:172.21.15.177:6789/0 conn(0x7ff50406ef60 legacy=0x7ff50415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff4fa59c640 1 -- 172.21.15.134:0/245911538 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5040b3630 con 0x7ff50415c370 2024-09-15T22:42:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.432+0000 7ff502d9d640 1 --2- 172.21.15.134:0/245911538 >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 0x7ff5040b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.433+0000 7ff4fa59c640 1 --2- 172.21.15.134:0/245911538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009850 tx=0x7ff4ec02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=141d9f02f8eed627 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.433+0000 7ff50259c640 1 -- 172.21.15.134:0/245911538 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec004030 con 0x7ff50415c370 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.433+0000 7ff50259c640 1 -- 172.21.15.134:0/245911538 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0041d0 con 0x7ff50415c370 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.433+0000 7ff50259c640 1 -- 172.21.15.134:0/245911538 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec003610 con 0x7ff50415c370 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 -- 172.21.15.134:0/245911538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 msgr2=0x7ff50406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 --2- 172.21.15.134:0/245911538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009850 tx=0x7ff4ec02a230 comp rx=0 tx=0).stop 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 -- 172.21.15.134:0/245911538 shutdown_connections 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 --2- 172.21.15.134:0/245911538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff50415c370 0x7ff50406ea20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 --2- 172.21.15.134:0/245911538 >> v2:172.21.15.177:3300/0 conn(0x7ff504158e50 0x7ff5040b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 -- 172.21.15.134:0/245911538 >> 172.21.15.134:0/245911538 conn(0x7ff50406bba0 msgr2=0x7ff50406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 -- 172.21.15.134:0/245911538 shutdown_connections 2024-09-15T22:42:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.434+0000 7ff509186640 1 -- 172.21.15.134:0/245911538 wait complete. 2024-09-15T22:42:37.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.435+0000 7ff509186640 1 Processor -- start 2024-09-15T22:42:37.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.435+0000 7ff509186640 1 -- start start 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff50406ef60 0x7ff50414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504158e50 0x7ff50414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040b3ed0 con 0x7ff50415c370 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040b3bf0 con 0x7ff50406ef60 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff509186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff504159230 con 0x7ff504158e50 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff50359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff50359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50248/0 (socket says 172.21.15.134:50248) 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff50359e640 1 -- 172.21.15.134:0/2461791157 learned_addr learned my addr 172.21.15.134:0/2461791157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff502d9d640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff50406ef60 0x7ff50414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.436+0000 7ff4fa59c640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504158e50 0x7ff50414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 -- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504158e50 msgr2=0x7ff50414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504158e50 0x7ff50414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 -- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff50406ef60 msgr2=0x7ff50414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff50406ef60 0x7ff50414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 -- 172.21.15.134:0/2461791157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50415a5e0 con 0x7ff50415c370 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff50359e640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7a0 tx=0x7ff4fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc003b70 con 0x7ff50415c370 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc003d30 con 0x7ff50415c370 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00aa90 con 0x7ff50415c370 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50415a8c0 con 0x7ff50415c370 2024-09-15T22:42:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.437+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50415ae80 con 0x7ff50415c370 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.438+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5040cdde0 con 0x7ff50415c370 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.438+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7ff4fc00ac30 con 0x7ff50415c370 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.439+0000 7ff4fbfff640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 0x7ff4e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.439+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ff4fc08b260 con 0x7ff50415c370 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.439+0000 7ff502d9d640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 0x7ff4e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.439+0000 7ff502d9d640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 0x7ff4e406e920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009560 tx=0x7ff4f4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.443+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5040cdde0 con 0x7ff50415c370 2024-09-15T22:42:37.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.607+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff504159500 con 0x7ff50415c370 2024-09-15T22:42:37.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.608+0000 7ff4fbfff640 1 -- 172.21.15.134:0/2461791157 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7ff504159500 con 0x7ff50415c370 2024-09-15T22:42:37.609 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:42:37.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 msgr2=0x7ff4e406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 0x7ff4e406e920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009560 tx=0x7ff4f4009190 comp rx=0 tx=0).stop 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 msgr2=0x7ff504159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7a0 tx=0x7ff4fc00cc60 comp rx=0 tx=0).stop 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 shutdown_connections 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e406c460 0x7ff4e406e920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff50415c370 0x7ff504159820 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504158e50 0x7ff50414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 --2- 172.21.15.134:0/2461791157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff50406ef60 0x7ff50414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 >> 172.21.15.134:0/2461791157 conn(0x7ff50406bba0 msgr2=0x7ff50406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 shutdown_connections 2024-09-15T22:42:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.610+0000 7ff509186640 1 -- 172.21.15.134:0/2461791157 wait complete. 2024-09-15T22:42:37.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-15T22:42:37.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.722+0000 7f2c1a82e640 1 Processor -- start 2024-09-15T22:42:37.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.722+0000 7f2c1a82e640 1 -- start start 2024-09-15T22:42:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c1a82e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c1415c300 0x7f2c140affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c1a82e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 0x7f2c140ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c1a82e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1415ecf0 con 0x7f2c140cd300 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c1a82e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1415c6e0 con 0x7f2c1415c300 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c1a82e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1415efb0 con 0x7f2c1406f1e0 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c1415c300 0x7f2c140affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c1415c300 0x7f2c140affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50262/0 (socket says 172.21.15.134:50262) 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 -- 172.21.15.134:0/3123644400 learned_addr learned my addr 172.21.15.134:0/3123644400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c18dcb640 1 --2- 172.21.15.134:0/3123644400 >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 0x7f2c140ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 -- 172.21.15.134:0/3123644400 >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 msgr2=0x7f2c140ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 --2- 172.21.15.134:0/3123644400 >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 0x7f2c140ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 -- 172.21.15.134:0/3123644400 >> v1:172.21.15.177:6789/0 conn(0x7f2c140cd300 legacy=0x7f2c1406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c13fff640 1 -- 172.21.15.134:0/3123644400 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1415f290 con 0x7f2c1415c300 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.723+0000 7f2c18dcb640 1 --2- 172.21.15.134:0/3123644400 >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 0x7f2c140ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.724+0000 7f2c13fff640 1 --2- 172.21.15.134:0/3123644400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c140affc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c140cd030 tx=0x7f2c0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f35cb44ecb37d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.724+0000 7f2c12ffd640 1 -- 172.21.15.134:0/3123644400 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04037070 con 0x7f2c1415c300 2024-09-15T22:42:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.724+0000 7f2c12ffd640 1 -- 172.21.15.134:0/3123644400 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04032440 con 0x7f2c1415c300 2024-09-15T22:42:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.724+0000 7f2c12ffd640 1 -- 172.21.15.134:0/3123644400 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04032810 con 0x7f2c1415c300 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3123644400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 msgr2=0x7f2c140affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3123644400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c140affc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c140cd030 tx=0x7f2c0402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3123644400 shutdown_connections 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3123644400 >> v2:172.21.15.177:3300/0 conn(0x7f2c1406f1e0 0x7f2c140ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3123644400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c140affc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3123644400 >> 172.21.15.134:0/3123644400 conn(0x7f2c1406cae0 msgr2=0x7f2c1406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3123644400 shutdown_connections 2024-09-15T22:42:37.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.725+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3123644400 wait complete. 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.726+0000 7f2c1a82e640 1 Processor -- start 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.726+0000 7f2c1a82e640 1 -- start start 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c1406f1e0 0x7f2c14156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c140cd300 0x7f2c1415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14071880 con 0x7f2c1415c300 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1415f850 con 0x7f2c140cd300 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c1a82e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140b0500 con 0x7f2c1406f1e0 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50264/0 (socket says 172.21.15.134:50264) 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 -- 172.21.15.134:0/3760414197 learned_addr learned my addr 172.21.15.134:0/3760414197 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c13fff640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c1406f1e0 0x7f2c14156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c137fe640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c140cd300 0x7f2c1415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 -- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c1406f1e0 msgr2=0x7f2c14156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c1406f1e0 0x7f2c14156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 -- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c140cd300 msgr2=0x7f2c1415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c140cd300 0x7f2c1415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 -- 172.21.15.134:0/3760414197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1415cb40 con 0x7f2c1415c300 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.727+0000 7f2c18dcb640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00cd40 tx=0x7f2c0c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.728+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c003b90 con 0x7f2c1415c300 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.728+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c003d50 con 0x7f2c1415c300 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.728+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1415ce20 con 0x7f2c1415c300 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.728+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c004260 con 0x7f2c1415c300 2024-09-15T22:42:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.728+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1415d3e0 con 0x7f2c1415c300 2024-09-15T22:42:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.729+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1415d5e0 con 0x7f2c1415c300 2024-09-15T22:42:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.729+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f2c0c004400 con 0x7f2c1415c300 2024-09-15T22:42:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.729+0000 7f2c10ff9640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 0x7f2c0006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.729+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f2c0c08bf60 con 0x7f2c1415c300 2024-09-15T22:42:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.730+0000 7f2c13fff640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 0x7f2c0006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.730+0000 7f2c13fff640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 0x7f2c0006e950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c04034000 tx=0x7f2c0402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:37.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.734+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c1415d5e0 con 0x7f2c1415c300 2024-09-15T22:42:37.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:37.962+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7f2c14157d50 con 0x7f2c1415c300 2024-09-15T22:42:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.024+0000 7f2c10ff9640 1 -- 172.21.15.134:0/3760414197 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v92) ==== 143+0+0 (secure 0 0 0) 0x7f2c0c014030 con 0x7f2c1415c300 2024-09-15T22:42:38.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 msgr2=0x7f2c0006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 0x7f2c0006e950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c04034000 tx=0x7f2c0402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 msgr2=0x7f2c14161330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00cd40 tx=0x7f2c0c00a650 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 shutdown_connections 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2c0006c490 0x7f2c0006e950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c1415c300 0x7f2c14161330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c140cd300 0x7f2c1415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 --2- 172.21.15.134:0/3760414197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c1406f1e0 0x7f2c14156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 >> 172.21.15.134:0/3760414197 conn(0x7f2c1406cae0 msgr2=0x7f2c14162270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 shutdown_connections 2024-09-15T22:42:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.026+0000 7f2c1a82e640 1 -- 172.21.15.134:0/3760414197 wait complete. 2024-09-15T22:42:38.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:42:38.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.138+0000 7ff2c43e4640 1 Processor -- start 2024-09-15T22:42:38.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.138+0000 7ff2c43e4640 1 -- start start 2024-09-15T22:42:38.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c43e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c43e4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0cf9a0 con 0x7ff2bc161e30 2024-09-15T22:42:38.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c43e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc162210 con 0x7ff2bc0b3d50 2024-09-15T22:42:38.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c43e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0cfcf0 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c2180640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff2bc161e30 0x7ff2bc0d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40342/0 (socket says 172.21.15.134:40342) 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.139+0000 7ff2c2180640 1 -- 172.21.15.134:0/43745981 learned_addr learned my addr 172.21.15.134:0/43745981 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c2981640 1 --2- 172.21.15.134:0/43745981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998434757 0 0) 0x7ff2bc0cf9a0 con 0x7ff2bc161e30 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a4003520 con 0x7ff2bc161e30 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458127229 0 0) 0x7ff2bc162210 con 0x7ff2bc0b3d50 2024-09-15T22:42:38.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc0cf9a0 con 0x7ff2bc0b3d50 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 916056006 0 0) 0x7ff2a4003520 con 0x7ff2bc161e30 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c2981640 1 -- 172.21.15.134:0/43745981 >> v1:172.21.15.177:6789/0 conn(0x7ff2bc0b3d50 legacy=0x7ff2bc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c2981640 1 -- 172.21.15.134:0/43745981 >> v1:172.21.15.134:6789/0 conn(0x7ff2bc161e30 legacy=0x7ff2bc0d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.140+0000 7ff2c2981640 1 -- 172.21.15.134:0/43745981 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0d5210 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c2981640 1 --2- 172.21.15.134:0/43745981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc0b78b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097d0 tx=0x7ff2b402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0438ae6639d90a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4037070 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b402ac30 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c117e640 1 -- 172.21.15.134:0/43745981 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac001a10 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c43e4640 1 -- 172.21.15.134:0/43745981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 msgr2=0x7ff2bc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.141+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/43745981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc0b78b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097d0 tx=0x7ff2b402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.142+0000 7ff2c43e4640 1 -- 172.21.15.134:0/43745981 shutdown_connections 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.142+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/43745981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc0b78b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.142+0000 7ff2c43e4640 1 -- 172.21.15.134:0/43745981 >> 172.21.15.134:0/43745981 conn(0x7ff2bc0d1870 msgr2=0x7ff2bc0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.142+0000 7ff2c43e4640 1 -- 172.21.15.134:0/43745981 shutdown_connections 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.142+0000 7ff2c43e4640 1 -- 172.21.15.134:0/43745981 wait complete. 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 Processor -- start 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 -- start start 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc0b3d50 0x7ff2bc15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b3290 con 0x7ff2bc161e30 2024-09-15T22:42:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b3950 con 0x7ff2bc0b3d50 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.143+0000 7ff2c43e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b3410 con 0x7ff2bc06dfd0 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50276/0 (socket says 172.21.15.134:50276) 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 -- 172.21.15.134:0/1099918761 learned_addr learned my addr 172.21.15.134:0/1099918761 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c197f640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc0b3d50 0x7ff2bc15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2180640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 -- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 msgr2=0x7ff2bc14a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc14a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 -- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc0b3d50 msgr2=0x7ff2bc15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc0b3d50 0x7ff2bc15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 -- 172.21.15.134:0/1099918761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc15a310 con 0x7ff2bc161e30 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c2981640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097d0 tx=0x7ff2b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4042020 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b403d670 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc0b5e40 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4037040 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.144+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc0b6400 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.145+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc06d8c0 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.146+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7ff2b4045020 con 0x7ff2bc161e30 2024-09-15T22:42:38.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.146+0000 7ff2baffd640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 0x7ff2a806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.146+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ff2b40aba30 con 0x7ff2bc161e30 2024-09-15T22:42:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.146+0000 7ff2c2180640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 0x7ff2a806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.147+0000 7ff2c2180640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 0x7ff2a806e920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac007fd0 tx=0x7ff2ac001a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.150+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2b404c030 con 0x7ff2bc161e30 2024-09-15T22:42:38.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.317+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff2bc069190 con 0x7ff2bc161e30 2024-09-15T22:42:38.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.320+0000 7ff2baffd640 1 -- 172.21.15.134:0/1099918761 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7ff2bc15a310 con 0x7ff2bc161e30 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 msgr2=0x7ff2a806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 0x7ff2a806e920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac007fd0 tx=0x7ff2ac001a30 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 msgr2=0x7ff2bc15adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097d0 tx=0x7ff2b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 shutdown_connections 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff2a806c460 0x7ff2a806e920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc161e30 0x7ff2bc15adc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc0b3d50 0x7ff2bc15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 --2- 172.21.15.134:0/1099918761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2bc06dfd0 0x7ff2bc14a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.322+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 >> 172.21.15.134:0/1099918761 conn(0x7ff2bc0d1870 msgr2=0x7ff2bc0d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.323+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 shutdown_connections 2024-09-15T22:42:38.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.323+0000 7ff2c43e4640 1 -- 172.21.15.134:0/1099918761 wait complete. 2024-09-15T22:42:38.335 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:42:38.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:42:38.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:42:38.424 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:42:38.425 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:38.425 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:38.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:42:38.443 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:38.443 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:38.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:42:38.462 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:38.462 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:38.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:42:38.499 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:38.499 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:38.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:42:38.521 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:42:38.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:38.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.635+0000 7fb3abde4640 1 Processor -- start 2024-09-15T22:42:38.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.636+0000 7fb3abde4640 1 -- start start 2024-09-15T22:42:38.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb3a40d02a0 0x7fb3a40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3a415ca40 0x7fb3a415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a40d0bc0 con 0x7fb3a415ca40 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a415d390 con 0x7fb3a40d02a0 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3abde4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a415d670 con 0x7fb3a415ceb0 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3a415ca40 0x7fb3a415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3a415ca40 0x7fb3a415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50278/0 (socket says 172.21.15.134:50278) 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 -- 172.21.15.134:0/218414299 learned_addr learned my addr 172.21.15.134:0/218414299 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a9b80640 1 --2- 172.21.15.134:0/218414299 >> v2:172.21.15.177:3300/0 conn(0x7fb3a40d02a0 0x7fb3a40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3aa381640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 -- 172.21.15.134:0/218414299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 msgr2=0x7fb3a41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 -- 172.21.15.134:0/218414299 >> v2:172.21.15.177:3300/0 conn(0x7fb3a40d02a0 msgr2=0x7fb3a40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 --2- 172.21.15.134:0/218414299 >> v2:172.21.15.177:3300/0 conn(0x7fb3a40d02a0 0x7fb3a40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.637+0000 7fb3a937f640 1 -- 172.21.15.134:0/218414299 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a415d950 con 0x7fb3a415ca40 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3a937f640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a415e430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406f030 tx=0x7fb39802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235d8bf097a72c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3a8b7e640 1 -- 172.21.15.134:0/218414299 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398032700 con 0x7fb3a415ca40 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3a8b7e640 1 -- 172.21.15.134:0/218414299 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3980328a0 con 0x7fb3a415ca40 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3a8b7e640 1 -- 172.21.15.134:0/218414299 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398032c70 con 0x7fb3a415ca40 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 -- 172.21.15.134:0/218414299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 msgr2=0x7fb3a415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a415e430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406f030 tx=0x7fb39802c800 comp rx=0 tx=0).stop 2024-09-15T22:42:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 -- 172.21.15.134:0/218414299 shutdown_connections 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 --2- 172.21.15.134:0/218414299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a415e430 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 --2- 172.21.15.134:0/218414299 >> v2:172.21.15.177:3300/0 conn(0x7fb3a40d02a0 0x7fb3a40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.638+0000 7fb3abde4640 1 -- 172.21.15.134:0/218414299 >> 172.21.15.134:0/218414299 conn(0x7fb3a4062cc0 msgr2=0x7fb3a406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.639+0000 7fb3abde4640 1 -- 172.21.15.134:0/218414299 shutdown_connections 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.639+0000 7fb3abde4640 1 -- 172.21.15.134:0/218414299 wait complete. 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 Processor -- start 2024-09-15T22:42:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 -- start start 2024-09-15T22:42:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a40d02a0 0x7fb3a4144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4155b90 con 0x7fb3a415ca40 2024-09-15T22:42:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415df10 con 0x7fb3a40d02a0 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3abde4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a4155d10 con 0x7fb3a415ceb0 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.640+0000 7fb3a937f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50284/0 (socket says 172.21.15.134:50284) 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 -- 172.21.15.134:0/4176916128 learned_addr learned my addr 172.21.15.134:0/4176916128 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a9b80640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a40d02a0 0x7fb3a4144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3aa381640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 -- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 msgr2=0x7fb3a41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 -- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a40d02a0 msgr2=0x7fb3a4144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a40d02a0 0x7fb3a4144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 -- 172.21.15.134:0/4176916128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41517a0 con 0x7fb3a415ca40 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3aa381640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a937f640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb39802c840 tx=0x7fb398004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398042030 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3980349b0 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a4151a40 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398034d80 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.641+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a4152000 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.642+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40b4790 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.643+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fb398045030 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.643+0000 7fb3a27fc640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 0x7fb39006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.643+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fb3980ae050 con 0x7fb3a415ca40 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.643+0000 7fb3a9b80640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 0x7fb39006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.644+0000 7fb3a9b80640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 0x7fb39006e920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb39c003610 tx=0x7fb39c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.647+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb398031070 con 0x7fb3a415ca40 2024-09-15T22:42:38.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.847+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3a4154470 con 0x7fb3a415ca40 2024-09-15T22:42:38.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.847+0000 7fb3a27fc640 1 -- 172.21.15.134:0/4176916128 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3916 (secure 0 0 0) 0x7fb39807c290 con 0x7fb3a415ca40 2024-09-15T22:42:38.849 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:38.849 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":17,"btime":"2024-09-15T22:42:34:003483+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3498045809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3498045809},{"type":"v1","addr":"172.21.15.177:6835","nonce":3498045809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/135583914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":135583914},{"type":"v1","addr":"172.21.15.177:6833","nonce":135583914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4839,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3702140165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3702140165},{"type":"v1","addr":"172.21.15.134:6836","nonce":3702140165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/997571615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":997571615},{"type":"v1","addr":"172.21.15.134:6837","nonce":997571615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-15T22:42:38.849 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 17 2024-09-15T22:42:38.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 msgr2=0x7fb39006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 0x7fb39006e920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb39c003610 tx=0x7fb39c008040 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 msgr2=0x7fb3a4071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb39802c840 tx=0x7fb398004730 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 shutdown_connections 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb39006c460 0x7fb39006e920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3a415ceb0 0x7fb3a41546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a415ca40 0x7fb3a4071070 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 --2- 172.21.15.134:0/4176916128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a40d02a0 0x7fb3a4144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 >> 172.21.15.134:0/4176916128 conn(0x7fb3a4062cc0 msgr2=0x7fb3a40b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 shutdown_connections 2024-09-15T22:42:38.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:38.849+0000 7fb3abde4640 1 -- 172.21.15.134:0/4176916128 wait complete. 2024-09-15T22:42:38.862 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:42:38.862 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:42:38.862 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:42:38.863 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:42:38.863 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:42:38.863 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:42:38.863 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:42:38.863 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:42:38.863 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:42:38.863 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:42:38.864 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:42:38.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:42:38.864 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:42:38.864 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:42:38.864 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:42:38.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:42:38.874 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:42:38.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:42:38.875 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:42:38.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:42:38.876 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:42:38.877 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:42:38.877 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:42:38.878 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:42:38.918 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:42:38.918 DEBUG:teuthology.parallel:result is None 2024-09-15T22:42:38.919 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:42:38.919 DEBUG:teuthology.parallel:result is None 2024-09-15T22:42:38.921 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:42:38.921 DEBUG:teuthology.parallel:result is None 2024-09-15T22:42:38.921 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:42:38.922 DEBUG:teuthology.parallel:result is None 2024-09-15T22:42:38.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:42:38.994 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:42:38.994 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:42:39.006 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:42:39.006 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:42:39.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.024+0000 7fa80edb7640 1 Processor -- start 2024-09-15T22:42:39.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.024+0000 7fa80edb7640 1 -- start start 2024-09-15T22:42:39.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.025+0000 7fa80edb7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa80815ed20 0x7fa8080b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.025+0000 7fa80edb7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8080cef90 0x7fa8080b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.025+0000 7fa80edb7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8080b7170 con 0x7fa80815e940 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.025+0000 7fa80edb7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080b7aa0 con 0x7fa80815ed20 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.025+0000 7fa80edb7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080d3660 con 0x7fa8080cef90 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8080cef90 0x7fa8080b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8080cef90 0x7fa8080b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:50800/0 (socket says 172.21.15.134:50800) 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 -- 172.21.15.134:0/3576209072 learned_addr learned my addr 172.21.15.134:0/3576209072 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80cb53640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa80815e940 0x7fa8080d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40346/0 (socket says 172.21.15.134:40346) 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa807fff640 1 --2- 172.21.15.134:0/3576209072 >> v2:172.21.15.134:3300/0 conn(0x7fa80815ed20 0x7fa8080b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 -- 172.21.15.134:0/3576209072 >> v2:172.21.15.134:3300/0 conn(0x7fa80815ed20 msgr2=0x7fa8080b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 --2- 172.21.15.134:0/3576209072 >> v2:172.21.15.134:3300/0 conn(0x7fa80815ed20 0x7fa8080b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 -- 172.21.15.134:0/3576209072 >> v1:172.21.15.134:6789/0 conn(0x7fa80815e940 legacy=0x7fa8080d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.026+0000 7fa80d354640 1 -- 172.21.15.134:0/3576209072 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080d3940 con 0x7fa8080cef90 2024-09-15T22:42:39.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.027+0000 7fa80d354640 1 --2- 172.21.15.134:0/3576209072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080b3760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa80806d070 tx=0x7fa80002a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf3719e9d8601eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:39.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.028+0000 7fa8077fe640 1 -- 172.21.15.134:0/3576209072 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800036070 con 0x7fa8080cef90 2024-09-15T22:42:39.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.028+0000 7fa8077fe640 1 -- 172.21.15.134:0/3576209072 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800031600 con 0x7fa8080cef90 2024-09-15T22:42:39.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.028+0000 7fa8077fe640 1 -- 172.21.15.134:0/3576209072 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8000319f0 con 0x7fa8080cef90 2024-09-15T22:42:39.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 -- 172.21.15.134:0/3576209072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 msgr2=0x7fa8080b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3576209072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080b3760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa80806d070 tx=0x7fa80002a7c0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 -- 172.21.15.134:0/3576209072 shutdown_connections 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3576209072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080b3760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3576209072 >> v2:172.21.15.134:3300/0 conn(0x7fa80815ed20 0x7fa8080b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 -- 172.21.15.134:0/3576209072 >> 172.21.15.134:0/3576209072 conn(0x7fa8080b6240 msgr2=0x7fa8080b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 -- 172.21.15.134:0/3576209072 shutdown_connections 2024-09-15T22:42:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.029+0000 7fa80edb7640 1 -- 172.21.15.134:0/3576209072 wait complete. 2024-09-15T22:42:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.031+0000 7fa80edb7640 1 Processor -- start 2024-09-15T22:42:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.031+0000 7fa80edb7640 1 -- start start 2024-09-15T22:42:39.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.031+0000 7fa80edb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80edb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 0x7fa8080acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80edb7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 0x7fa8080adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80edb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d3310 con 0x7fa80815e940 2024-09-15T22:42:39.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80edb7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d3f00 con 0x7fa8080cef90 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80edb7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080d1ef0 con 0x7fa80815ed20 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:50806/0 (socket says 172.21.15.134:50806) 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 -- 172.21.15.134:0/3945652806 learned_addr learned my addr 172.21.15.134:0/3945652806 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80d354640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 0x7fa8080adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa807fff640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 0x7fa8080acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 -- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 msgr2=0x7fa8080adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 0x7fa8080adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 -- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 msgr2=0x7fa8080acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 0x7fa8080acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 -- 172.21.15.134:0/3945652806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080abad0 con 0x7fa8080cef90 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80d354640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 0x7fa8080adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa807fff640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 0x7fa8080acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:39.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.032+0000 7fa80cb53640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c400 tx=0x7fa7fc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.033+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0074e0 con 0x7fa8080cef90 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.033+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc007680 con 0x7fa8080cef90 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.033+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004a00 con 0x7fa8080cef90 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.033+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8080abd50 con 0x7fa8080cef90 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.033+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8080ac310 con 0x7fa8080cef90 2024-09-15T22:42:39.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.034+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8080ac6b0 con 0x7fa8080cef90 2024-09-15T22:42:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.036+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fa7fc01a020 con 0x7fa8080cef90 2024-09-15T22:42:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.036+0000 7fa8057fa640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 0x7fa7ec06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.037+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fa7fc08b340 con 0x7fa8080cef90 2024-09-15T22:42:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.037+0000 7fa807fff640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 0x7fa7ec06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:39.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.037+0000 7fa807fff640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 0x7fa7ec06e920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8080b5c20 tx=0x7fa7f4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:39.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.040+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7fc021070 con 0x7fa8080cef90 2024-09-15T22:42:39.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:39.218+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa8080ba6b0 con 0x7fa8080cef90 2024-09-15T22:42:40.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.045+0000 7fa8057fa640 1 -- 172.21.15.134:0/3945652806 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) ==== 97+0+0 (secure 0 0 0) 0x7fa8080abad0 con 0x7fa8080cef90 2024-09-15T22:42:40.047 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 msgr2=0x7fa7ec06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 0x7fa7ec06e920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8080b5c20 tx=0x7fa7f4009190 comp rx=0 tx=0).stop 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 msgr2=0x7fa8080ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c400 tx=0x7fa7fc00c8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 shutdown_connections 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa7ec06c460 0x7fa7ec06e920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa80815ed20 0x7fa8080adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa80815e940 0x7fa8080acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 --2- 172.21.15.134:0/3945652806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8080cef90 0x7fa8080ab590 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 >> 172.21.15.134:0/3945652806 conn(0x7fa8080b6240 msgr2=0x7fa80815fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 shutdown_connections 2024-09-15T22:42:40.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.048+0000 7fa80edb7640 1 -- 172.21.15.134:0/3945652806 wait complete. 2024-09-15T22:42:40.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:42:40.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.166+0000 7f7a05fdf640 1 Processor -- start 2024-09-15T22:42:40.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.166+0000 7f7a05fdf640 1 -- start start 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f7a05fdf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a000cd300 0x7f7a0006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f7a05fdf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a0006f010 0x7f7a000ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f7a05fdf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0015ecf0 con 0x7f7a0015c300 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f7a05fdf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0006f480 con 0x7f7a000cd300 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f7a05fdf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0015c6e0 con 0x7f7a0006f010 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79feffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a000cd300 0x7f7a0006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79ff7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7a0015c300 0x7f7a000affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40360/0 (socket says 172.21.15.134:40360) 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79ff7fe640 1 -- 172.21.15.134:0/1278836944 learned_addr learned my addr 172.21.15.134:0/1278836944 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79feffd640 1 -- 172.21.15.134:0/1278836944 >> v2:172.21.15.177:3300/0 conn(0x7f7a0006f010 msgr2=0x7f7a000ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79feffd640 1 --2- 172.21.15.134:0/1278836944 >> v2:172.21.15.177:3300/0 conn(0x7f7a0006f010 0x7f7a000ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79feffd640 1 -- 172.21.15.134:0/1278836944 >> v1:172.21.15.134:6789/0 conn(0x7f7a0015c300 legacy=0x7f7a000affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.168+0000 7f79feffd640 1 -- 172.21.15.134:0/1278836944 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0015efb0 con 0x7f7a000cd300 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.167+0000 7f79fe7fc640 1 -- 172.21.15.134:0/1278836944 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390711464 0 0) 0x7f7a0015ecf0 con 0x7f7a0015c300 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.168+0000 7f79feffd640 1 --2- 172.21.15.134:0/1278836944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a0006ead0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a000cd030 tx=0x7f79e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5226f3d42e095225 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.168+0000 7f79fe7fc640 1 -- 172.21.15.134:0/1278836944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8037070 con 0x7f7a000cd300 2024-09-15T22:42:40.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.168+0000 7f79fe7fc640 1 -- 172.21.15.134:0/1278836944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8032440 con 0x7f7a000cd300 2024-09-15T22:42:40.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.168+0000 7f79fe7fc640 1 -- 172.21.15.134:0/1278836944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e802ae60 con 0x7f7a000cd300 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1278836944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 msgr2=0x7f7a0006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1278836944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a0006ead0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a000cd030 tx=0x7f79e802a110 comp rx=0 tx=0).stop 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1278836944 shutdown_connections 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1278836944 >> v2:172.21.15.177:3300/0 conn(0x7f7a0006f010 0x7f7a000ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1278836944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a0006ead0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1278836944 >> 172.21.15.134:0/1278836944 conn(0x7f7a0006cae0 msgr2=0x7f7a0006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1278836944 shutdown_connections 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.169+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1278836944 wait complete. 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.170+0000 7f7a05fdf640 1 Processor -- start 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.170+0000 7f7a05fdf640 1 -- start start 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 0x7f7a0015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 0x7f7a00154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0015f850 con 0x7f7a000cd300 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0015f570 con 0x7f7a0006f010 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f7a05fdf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7a00071880 con 0x7f7a0015c300 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50358/0 (socket says 172.21.15.134:50358) 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 -- 172.21.15.134:0/1181069714 learned_addr learned my addr 172.21.15.134:0/1181069714 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:40.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79ff7fe640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 0x7f7a0015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79fffff640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 0x7f7a00154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 -- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 msgr2=0x7f7a00154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 0x7f7a00154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 -- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 msgr2=0x7f7a0015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 0x7f7a0015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79feffd640 1 -- 172.21.15.134:0/1181069714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0015c990 con 0x7f7a000cd300 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79ff7fe640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 0x7f7a0015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.171+0000 7f79fffff640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 0x7f7a00154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f79feffd640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000c00 tx=0x7f79e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8041070 con 0x7f7a000cd300 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e803c950 con 0x7f7a000cd300 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a001f4910 con 0x7f7a000cd300 2024-09-15T22:42:40.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8037040 con 0x7f7a000cd300 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.172+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0015e880 con 0x7f7a000cd300 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.173+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0006ead0 con 0x7f7a000cd300 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.173+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f79e8044070 con 0x7f7a000cd300 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.174+0000 7f79f7fff640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 0x7f79e006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.174+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f79e80ac050 con 0x7f7a000cd300 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.174+0000 7f79ff7fe640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 0x7f79e006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.174+0000 7f79ff7fe640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 0x7f79e006e920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79f0000f60 tx=0x7f79f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.178+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79e807aa40 con 0x7f7a000cd300 2024-09-15T22:42:40.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.408+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7a001f4ca0 con 0x7f7a000cd300 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.408+0000 7f79f7fff640 1 -- 172.21.15.134:0/1181069714 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f79e807a340 con 0x7f7a000cd300 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:42:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:42:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:42:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:42:40.423 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 msgr2=0x7f79e006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 0x7f79e006e920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79f0000f60 tx=0x7f79f0009040 comp rx=0 tx=0).stop 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 msgr2=0x7f7a000b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000c00 tx=0x7f79e80046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 shutdown_connections 2024-09-15T22:42:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f79e006c460 0x7f79e006e920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a0015c300 0x7f7a00154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a000cd300 0x7f7a000b1de0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 --2- 172.21.15.134:0/1181069714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0006f010 0x7f7a0015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 >> 172.21.15.134:0/1181069714 conn(0x7f7a0006cae0 msgr2=0x7f7a00162270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 shutdown_connections 2024-09-15T22:42:40.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.410+0000 7f7a05fdf640 1 -- 172.21.15.134:0/1181069714 wait complete. 2024-09-15T22:42:40.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:42:40.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.523+0000 7f216bad0640 1 Processor -- start 2024-09-15T22:42:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.523+0000 7f216bad0640 1 -- start start 2024-09-15T22:42:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216bad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 0x7f216415f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216bad0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 0x7f21640b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216bad0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2164162660 con 0x7f216415e3f0 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216bad0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f21640b30d0 con 0x7f2164162110 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216bad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f216415fa90 con 0x7f216406c2b0 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216a06d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 0x7f21640b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216906b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 0x7f216415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216986c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f216415e3f0 0x7f216406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:55870/0 (socket says 172.21.15.134:55870) 2024-09-15T22:42:40.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.524+0000 7f216986c640 1 -- 172.21.15.134:0/2123647799 learned_addr learned my addr 172.21.15.134:0/2123647799 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216886a640 1 -- 172.21.15.134:0/2123647799 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592013076 0 0) 0x7f2164162660 con 0x7f216415e3f0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216886a640 1 -- 172.21.15.134:0/2123647799 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2150003520 con 0x7f216415e3f0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216906b640 1 -- 172.21.15.134:0/2123647799 >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 msgr2=0x7f21640b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216906b640 1 --2- 172.21.15.134:0/2123647799 >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 0x7f21640b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216906b640 1 -- 172.21.15.134:0/2123647799 >> v1:172.21.15.177:6789/0 conn(0x7f216415e3f0 legacy=0x7f216406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216906b640 1 -- 172.21.15.134:0/2123647799 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164162940 con 0x7f216406c2b0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.525+0000 7f216a06d640 1 --2- 172.21.15.134:0/2123647799 >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 0x7f21640b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216906b640 1 --2- 172.21.15.134:0/2123647799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 0x7f216415f550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21540097a0 tx=0x7f215402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494ca618e9282003 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216886a640 1 -- 172.21.15.134:0/2123647799 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154037070 con 0x7f216406c2b0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216886a640 1 -- 172.21.15.134:0/2123647799 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154032440 con 0x7f216406c2b0 2024-09-15T22:42:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216886a640 1 -- 172.21.15.134:0/2123647799 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540327f0 con 0x7f216406c2b0 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 -- 172.21.15.134:0/2123647799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 msgr2=0x7f216415f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 --2- 172.21.15.134:0/2123647799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 0x7f216415f550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21540097a0 tx=0x7f215402a180 comp rx=0 tx=0).stop 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 -- 172.21.15.134:0/2123647799 shutdown_connections 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 --2- 172.21.15.134:0/2123647799 >> v2:172.21.15.177:3300/0 conn(0x7f2164162110 0x7f21640b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 --2- 172.21.15.134:0/2123647799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216406c2b0 0x7f216415f550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 -- 172.21.15.134:0/2123647799 >> 172.21.15.134:0/2123647799 conn(0x7f216406ce90 msgr2=0x7f216406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 -- 172.21.15.134:0/2123647799 shutdown_connections 2024-09-15T22:42:40.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.526+0000 7f216bad0640 1 -- 172.21.15.134:0/2123647799 wait complete. 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 Processor -- start 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 -- start start 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 0x7f21641f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2164162110 0x7f21640b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21640b0380 con 0x7f216415e3f0 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2164162f00 con 0x7f216406c2b0 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216bad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f216415e7d0 con 0x7f2164162110 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216906b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216906b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50368/0 (socket says 172.21.15.134:50368) 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.528+0000 7f216906b640 1 -- 172.21.15.134:0/2416675442 learned_addr learned my addr 172.21.15.134:0/2416675442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:40.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216986c640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 0x7f21641f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216a06d640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2164162110 0x7f21640b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 -- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2164162110 msgr2=0x7f21640b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2164162110 0x7f21640b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 -- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 msgr2=0x7f21641f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 0x7f21641f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 -- 172.21.15.134:0/2416675442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21640b5610 con 0x7f216415e3f0 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216986c640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 0x7f21641f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216906b640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c00 tx=0x7f21540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154037040 con 0x7f216415e3f0 2024-09-15T22:42:40.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154004230 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154006e10 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21640b58f0 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.529+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21640b5eb0 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.530+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216415f550 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.531+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f215403a070 con 0x7f216415e3f0 2024-09-15T22:42:40.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.531+0000 7f215a7fc640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 0x7f214806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.531+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f21540ab8b0 con 0x7f216415e3f0 2024-09-15T22:42:40.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.531+0000 7f216986c640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 0x7f214806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.532+0000 7f216986c640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 0x7f214806e920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2160005880 tx=0x7f2160009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.536+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f215404a030 con 0x7f216415e3f0 2024-09-15T22:42:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.702+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f216415a620 con 0x7f216415e3f0 2024-09-15T22:42:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.703+0000 7f215a7fc640 1 -- 172.21.15.134:0/2416675442 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) ==== 84+0+65 (secure 0 0 0) 0x7f2154041030 con 0x7f216415e3f0 2024-09-15T22:42:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:40.704 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:42:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:42:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:42:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:40.705 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:42:40.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 msgr2=0x7f214806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 0x7f214806e920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2160005880 tx=0x7f2160009040 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 msgr2=0x7f2164148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c00 tx=0x7f21540046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 shutdown_connections 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f214806c460 0x7f214806e920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2164162110 0x7f21640b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216415e3f0 0x7f2164148ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 --2- 172.21.15.134:0/2416675442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f216406c2b0 0x7f21641f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 >> 172.21.15.134:0/2416675442 conn(0x7f216406ce90 msgr2=0x7f216406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 shutdown_connections 2024-09-15T22:42:40.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.705+0000 7f216bad0640 1 -- 172.21.15.134:0/2416675442 wait complete. 2024-09-15T22:42:40.716 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:42:40.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:42:40.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.817+0000 7f00e8718640 1 Processor -- start 2024-09-15T22:42:40.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.818+0000 7f00e8718640 1 -- start start 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e015b370 0x7f00e0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e015f9f0 0x7f00e006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 0x7f00e0071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f00e015fef0 con 0x7f00e015f9f0 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f00e015c970 con 0x7f00e006ef60 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e8718640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f00e015bbb0 con 0x7f00e015b370 2024-09-15T22:42:40.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e015f9f0 0x7f00e006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e015f9f0 0x7f00e006ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50378/0 (socket says 172.21.15.134:50378) 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 -- 172.21.15.134:0/3987396282 learned_addr learned my addr 172.21.15.134:0/3987396282 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e64b4640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e015b370 0x7f00e0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e6cb5640 1 --2- 172.21.15.134:0/3987396282 >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 0x7f00e0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 -- 172.21.15.134:0/3987396282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e015b370 msgr2=0x7f00e0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e015b370 0x7f00e0072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 -- 172.21.15.134:0/3987396282 >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 msgr2=0x7f00e0071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/3987396282 >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 0x7f00e0071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e5cb3640 1 -- 172.21.15.134:0/3987396282 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e015be90 con 0x7f00e015f9f0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.819+0000 7f00e6cb5640 1 --2- 172.21.15.134:0/3987396282 >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 0x7f00e0071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015f9f0 0x7f00e006ea20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f00e0070fd0 tx=0x7f00d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e696bfb1cd354a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e54b2640 1 -- 172.21.15.134:0/3987396282 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037070 con 0x7f00e015f9f0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e54b2640 1 -- 172.21.15.134:0/3987396282 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d4032440 con 0x7f00e015f9f0 2024-09-15T22:42:40.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e54b2640 1 -- 172.21.15.134:0/3987396282 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4032810 con 0x7f00e015f9f0 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e8718640 1 -- 172.21.15.134:0/3987396282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015f9f0 msgr2=0x7f00e006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.820+0000 7f00e8718640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015f9f0 0x7f00e006ea20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f00e0070fd0 tx=0x7f00d402a140 comp rx=0 tx=0).stop 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 -- 172.21.15.134:0/3987396282 shutdown_connections 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 --2- 172.21.15.134:0/3987396282 >> v2:172.21.15.177:3300/0 conn(0x7f00e006ef60 0x7f00e0071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015f9f0 0x7f00e006ea20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 --2- 172.21.15.134:0/3987396282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e015b370 0x7f00e0072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 -- 172.21.15.134:0/3987396282 >> 172.21.15.134:0/3987396282 conn(0x7f00e006bba0 msgr2=0x7f00e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 -- 172.21.15.134:0/3987396282 shutdown_connections 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.821+0000 7f00e8718640 1 -- 172.21.15.134:0/3987396282 wait complete. 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 Processor -- start 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 -- start start 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e006ef60 0x7f00e01509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e015f9f0 0x7f00e00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00731b0 con 0x7f00e015b370 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00e015c450 con 0x7f00e015f9f0 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.822+0000 7f00e8718640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f00e015b750 con 0x7f00e006ef60 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50384/0 (socket says 172.21.15.134:50384) 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 -- 172.21.15.134:0/719503645 learned_addr learned my addr 172.21.15.134:0/719503645 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:40.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e64b4640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e006ef60 0x7f00e01509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e6cb5640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e015f9f0 0x7f00e00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 -- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e006ef60 msgr2=0x7f00e01509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e006ef60 0x7f00e01509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 -- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e015f9f0 msgr2=0x7f00e00b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e015f9f0 0x7f00e00b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 -- 172.21.15.134:0/719503645 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e015cbb0 con 0x7f00e015b370 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e5cb3640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a180 tx=0x7f00d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4041020 con 0x7f00e015b370 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d40306e0 con 0x7f00e015b370 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e015eaa0 con 0x7f00e015b370 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037040 con 0x7f00e015b370 2024-09-15T22:42:40.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.823+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e015d130 con 0x7f00e015b370 2024-09-15T22:42:40.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.824+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e006ea20 con 0x7f00e015b370 2024-09-15T22:42:40.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.825+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f00d4044020 con 0x7f00e015b370 2024-09-15T22:42:40.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.825+0000 7f00deffd640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 0x7f00cc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:40.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.825+0000 7f00e64b4640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 0x7f00cc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:40.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.825+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f00d40abbf0 con 0x7f00e015b370 2024-09-15T22:42:40.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.826+0000 7f00e64b4640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 0x7f00cc06e920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f00d0003b80 tx=0x7f00d00098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:40.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.830+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00d404b030 con 0x7f00e015b370 2024-09-15T22:42:40.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:40.996+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f00e006c300 con 0x7f00e015b370 2024-09-15T22:42:41.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.047+0000 7f00deffd640 1 -- 172.21.15.134:0/719503645 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) ==== 138+0+0 (secure 0 0 0) 0x7f00d4079d50 con 0x7f00e015b370 2024-09-15T22:42:41.048 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:42:41.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 msgr2=0x7f00cc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:41.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 0x7f00cc06e920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f00d0003b80 tx=0x7f00d00098d0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 msgr2=0x7f00e00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a180 tx=0x7f00d40046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 shutdown_connections 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f00cc06c460 0x7f00cc06e920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e015f9f0 0x7f00e00b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e015b370 0x7f00e00b4f70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 --2- 172.21.15.134:0/719503645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00e006ef60 0x7f00e01509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 >> 172.21.15.134:0/719503645 conn(0x7f00e006bba0 msgr2=0x7f00e00b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 shutdown_connections 2024-09-15T22:42:41.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.049+0000 7f00e8718640 1 -- 172.21.15.134:0/719503645 wait complete. 2024-09-15T22:42:41.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:42:41.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.168+0000 7f24dc2c9640 1 Processor -- start 2024-09-15T22:42:41.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.168+0000 7f24dc2c9640 1 -- start start 2024-09-15T22:42:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24dc2c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24d40b3c80 0x7f24d415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24dc2c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d40b4060 0x7f24d413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24dc2c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40720f0 con 0x7f24d4141c40 2024-09-15T22:42:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24dc2c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f24d406d870 con 0x7f24d40b3c80 2024-09-15T22:42:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24dc2c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f24d41421e0 con 0x7f24d40b4060 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24d40b3c80 0x7f24d415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24d40b3c80 0x7f24d415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50396/0 (socket says 172.21.15.134:50396) 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 -- 172.21.15.134:0/2951746560 learned_addr learned my addr 172.21.15.134:0/2951746560 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 -- 172.21.15.134:0/2951746560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d40b4060 msgr2=0x7f24d413fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 --2- 172.21.15.134:0/2951746560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d40b4060 0x7f24d413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 -- 172.21.15.134:0/2951746560 >> v1:172.21.15.177:6789/0 conn(0x7f24d4141c40 legacy=0x7f24d406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.169+0000 7f24da065640 1 -- 172.21.15.134:0/2951746560 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d41424c0 con 0x7f24d40b3c80 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.170+0000 7f24da065640 1 --2- 172.21.15.134:0/2951746560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d40b3c80 0x7f24d415d4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009870 tx=0x7f24d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d890a4019dbfdd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.170+0000 7f24d9063640 1 -- 172.21.15.134:0/2951746560 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0037070 con 0x7f24d40b3c80 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.170+0000 7f24d9063640 1 -- 172.21.15.134:0/2951746560 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0032440 con 0x7f24d40b3c80 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.170+0000 7f24d9063640 1 -- 172.21.15.134:0/2951746560 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0032810 con 0x7f24d40b3c80 2024-09-15T22:42:41.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 -- 172.21.15.134:0/2951746560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d40b3c80 msgr2=0x7f24d415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/2951746560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d40b3c80 0x7f24d415d4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009870 tx=0x7f24d002a210 comp rx=0 tx=0).stop 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 -- 172.21.15.134:0/2951746560 shutdown_connections 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/2951746560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d40b4060 0x7f24d413fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/2951746560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d40b3c80 0x7f24d415d4f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 -- 172.21.15.134:0/2951746560 >> 172.21.15.134:0/2951746560 conn(0x7f24d4062810 msgr2=0x7f24d406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 -- 172.21.15.134:0/2951746560 shutdown_connections 2024-09-15T22:42:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.171+0000 7f24dc2c9640 1 -- 172.21.15.134:0/2951746560 wait complete. 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.172+0000 7f24dc2c9640 1 Processor -- start 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.172+0000 7f24dc2c9640 1 -- start start 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d40b3c80 0x7f24d4156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d4141c40 0x7f24d41ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4140140 con 0x7f24d41f2b20 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4142a80 con 0x7f24d40b3c80 2024-09-15T22:42:41.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f24d41402c0 con 0x7f24d4141c40 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50400/0 (socket says 172.21.15.134:50400) 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 -- 172.21.15.134:0/4261469613 learned_addr learned my addr 172.21.15.134:0/4261469613 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da065640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d40b3c80 0x7f24d4156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24d9864640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d4141c40 0x7f24d41ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 -- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d4141c40 msgr2=0x7f24d41ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d4141c40 0x7f24d41ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 -- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d40b3c80 msgr2=0x7f24d4156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d40b3c80 0x7f24d4156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 -- 172.21.15.134:0/4261469613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4158520 con 0x7f24d41f2b20 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24da866640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00b990 tx=0x7f24cc00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:41.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc019070 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc00caa0 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d4157480 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc014440 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.173+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d4157a40 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.174+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d413fc00 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.175+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f24cc01c070 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.175+0000 7f24caffd640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 0x7f24b806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.175+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5227+0+0 (secure 0 0 0) 0x7f24cc08b170 con 0x7f24d41f2b20 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.175+0000 7f24da065640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 0x7f24b806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:41.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.176+0000 7f24da065640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 0x7f24b806e920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f24d0034000 tx=0x7f24d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:41.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.180+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24cc059200 con 0x7f24d41f2b20 2024-09-15T22:42:41.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:41.345+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f24d4159090 con 0x7f24d41f2b20 2024-09-15T22:42:42.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.049+0000 7f24caffd640 1 -- 172.21.15.134:0/4261469613 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) ==== 170+0+0 (secure 0 0 0) 0x7f24cc05d500 con 0x7f24d41f2b20 2024-09-15T22:42:42.051 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:42:42.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.052+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 msgr2=0x7f24b806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 0x7f24b806e920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f24d0034000 tx=0x7f24d002e000 comp rx=0 tx=0).stop 2024-09-15T22:42:42.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 msgr2=0x7f24d41592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00b990 tx=0x7f24cc00bd90 comp rx=0 tx=0).stop 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 shutdown_connections 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f24b806c460 0x7f24b806e920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d41f2b20 0x7f24d41592b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d4141c40 0x7f24d41ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 --2- 172.21.15.134:0/4261469613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d40b3c80 0x7f24d4156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 >> 172.21.15.134:0/4261469613 conn(0x7f24d4062810 msgr2=0x7f24d415ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 shutdown_connections 2024-09-15T22:42:42.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.053+0000 7f24dc2c9640 1 -- 172.21.15.134:0/4261469613 wait complete. 2024-09-15T22:42:42.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:42:42.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.185+0000 7f3398da6640 1 Processor -- start 2024-09-15T22:42:42.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.185+0000 7f3398da6640 1 -- start start 2024-09-15T22:42:42.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3398da6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f339406f130 0x7f33940b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3398da6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f339415c820 con 0x7f339415c370 2024-09-15T22:42:42.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3398da6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33940b43f0 con 0x7f3394158e50 2024-09-15T22:42:42.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3398da6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f33940b3630 con 0x7f339406f130 2024-09-15T22:42:42.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3392d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f339415c370 0x7f33940ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40362/0 (socket says 172.21.15.134:40362) 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.186+0000 7f3392d9d640 1 -- 172.21.15.134:0/659092221 learned_addr learned my addr 172.21.15.134:0/659092221 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 --2- 172.21.15.134:0/659092221 >> v2:172.21.15.177:3300/0 conn(0x7f339406f130 0x7f33940b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656346587 0 0) 0x7f338c001110 con 0x7f339415c370 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337c003520 con 0x7f339415c370 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3207739352 0 0) 0x7f337c003520 con 0x7f339415c370 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 >> v2:172.21.15.177:3300/0 conn(0x7f339406f130 msgr2=0x7f33940b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 --2- 172.21.15.134:0/659092221 >> v2:172.21.15.177:3300/0 conn(0x7f339406f130 0x7f33940b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 >> v1:172.21.15.177:6789/0 conn(0x7f3394158e50 legacy=0x7f339406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33940b3910 con 0x7f339415c370 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f338c001840 con 0x7f339415c370 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 >> v1:172.21.15.134:6789/0 conn(0x7f339415c370 legacy=0x7f33940ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f337c0039b0 0x7f337c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c0051c0 0x7f337c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33940b3630 con 0x7f337c004800 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f337c00c160 con 0x7f337c0051c0 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f337c00c360 con 0x7f337c0039b0 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f339259c640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f337c0039b0 0x7f337c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3392d9d640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c0051c0 0x7f337c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 -- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f337c0039b0 msgr2=0x7f337c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f337c0039b0 0x7f337c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 -- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c0051c0 msgr2=0x7f337c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:42.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c0051c0 0x7f337c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3391d9b640 1 -- 172.21.15.134:0/659092221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c003520 con 0x7f337c004800 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.187+0000 7f3392d9d640 1 -- 172.21.15.134:0/659092221 reap_dead start 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.188+0000 7f3391d9b640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 0x7f337c004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3388009a80 tx=0x7f337c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc98f6760a61caf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.188+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388036070 con 0x7f337c004800 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.188+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3388005990 con 0x7f337c004800 2024-09-15T22:42:42.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.188+0000 7f339159a640 1 -- 172.21.15.134:0/659092221 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388009680 con 0x7f337c004800 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 -- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 msgr2=0x7f337c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 0x7f337c004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3388009a80 tx=0x7f337c005830 comp rx=0 tx=0).stop 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 -- 172.21.15.134:0/659092221 shutdown_connections 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 --2- 172.21.15.134:0/659092221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 -- 172.21.15.134:0/659092221 >> 172.21.15.134:0/659092221 conn(0x7f339406bba0 msgr2=0x7f339406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:42.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 -- 172.21.15.134:0/659092221 shutdown_connections 2024-09-15T22:42:42.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.189+0000 7f3398da6640 1 -- 172.21.15.134:0/659092221 wait complete. 2024-09-15T22:42:42.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.190+0000 7f3398da6640 1 Processor -- start 2024-09-15T22:42:42.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.190+0000 7f3398da6640 1 -- start start 2024-09-15T22:42:42.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c004800 0x7f3394142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f339415d250 0x7f339415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3394159230 con 0x7f33941593b0 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33940b3ed0 con 0x7f337c004800 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3398da6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f33940b5050 con 0x7f339415d250 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50422/0 (socket says 172.21.15.134:50422) 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 -- 172.21.15.134:0/1538642900 learned_addr learned my addr 172.21.15.134:0/1538642900 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f339259c640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c004800 0x7f3394142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3392d9d640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f339415d250 0x7f339415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 -- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f339415d250 msgr2=0x7f339415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f339415d250 0x7f339415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 -- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c004800 msgr2=0x7f3394142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c004800 0x7f3394142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.191+0000 7f3391d9b640 1 -- 172.21.15.134:0/1538642900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3394150570 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3391d9b640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3388009ba0 tx=0x7f3388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388040020 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3388006660 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33941432a0 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388036040 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.192+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3394154850 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.193+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33940b5380 con 0x7f33941593b0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.194+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f3388043020 con 0x7f33941593b0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.194+0000 7f3382ffd640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 0x7f337406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.194+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5609+0+0 (secure 0 0 0) 0x7f33880ab9a0 con 0x7f33941593b0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.194+0000 7f339259c640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 0x7f337406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.195+0000 7f339259c640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 0x7f337406e950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f33940cc6a0 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.199+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f338804a030 con 0x7f33941593b0 2024-09-15T22:42:42.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:42.399+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3394158100 con 0x7f33941593b0 2024-09-15T22:42:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.069+0000 7f3382ffd640 1 -- 172.21.15.134:0/1538642900 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v19) ==== 172+0+0 (secure 0 0 0) 0x7f3388079930 con 0x7f33941593b0 2024-09-15T22:42:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 6 and data pool 7 2024-09-15T22:42:43.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.077+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 msgr2=0x7f337406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.077+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 0x7f337406e950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f33940cc6a0 tx=0x7f3384009040 comp rx=0 tx=0).stop 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.077+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 msgr2=0x7f339415a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.077+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3388009ba0 tx=0x7f3388004730 comp rx=0 tx=0).stop 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 shutdown_connections 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f337406c490 0x7f337406e950 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f339415d250 0x7f339415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33941593b0 0x7f339415a080 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 --2- 172.21.15.134:0/1538642900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f337c004800 0x7f3394142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.078+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 >> 172.21.15.134:0/1538642900 conn(0x7f339406bba0 msgr2=0x7f3394071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.079+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 shutdown_connections 2024-09-15T22:42:43.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.080+0000 7f3398da6640 1 -- 172.21.15.134:0/1538642900 wait complete. 2024-09-15T22:42:43.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:43.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.202+0000 7f63de72a640 1 Processor -- start 2024-09-15T22:42:43.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.202+0000 7f63de72a640 1 -- start start 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63de72a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63d8151c50 0x7f63d80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63de72a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63d806c1f0 0x7f63d815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63de72a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d80cd5f0 con 0x7f63d806be10 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63de72a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63d80cd8d0 con 0x7f63d806c1f0 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63de72a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f63d80cdbb0 con 0x7f63d8151c50 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63d806c1f0 0x7f63d815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63d806c1f0 0x7f63d815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50428/0 (socket says 172.21.15.134:50428) 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 -- 172.21.15.134:0/393716892 learned_addr learned my addr 172.21.15.134:0/393716892 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63d7fff640 1 --1- 172.21.15.134:0/393716892 >> v1:172.21.15.134:6789/0 conn(0x7f63d806be10 0x7f63d8151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40364/0 (socket says 172.21.15.134:40364) 2024-09-15T22:42:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 -- 172.21.15.134:0/393716892 >> v2:172.21.15.177:3300/0 conn(0x7f63d8151c50 msgr2=0x7f63d80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:43.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 --2- 172.21.15.134:0/393716892 >> v2:172.21.15.177:3300/0 conn(0x7f63d8151c50 0x7f63d80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 -- 172.21.15.134:0/393716892 >> v1:172.21.15.134:6789/0 conn(0x7f63d806be10 legacy=0x7f63d8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63dccc7640 1 -- 172.21.15.134:0/393716892 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80cde90 con 0x7f63d806c1f0 2024-09-15T22:42:43.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.203+0000 7f63d6ffd640 1 -- 172.21.15.134:0/393716892 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168942727 0 0) 0x7f63d80cd5f0 con 0x7f63d806be10 2024-09-15T22:42:43.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63dccc7640 1 --2- 172.21.15.134:0/393716892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d806c1f0 0x7f63d815baa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f63d806ca50 tx=0x7f63d002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2f40661d9f7de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63d6ffd640 1 -- 172.21.15.134:0/393716892 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00335b0 con 0x7f63d806c1f0 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63d6ffd640 1 -- 172.21.15.134:0/393716892 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d0039070 con 0x7f63d806c1f0 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63d6ffd640 1 -- 172.21.15.134:0/393716892 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0033970 con 0x7f63d806c1f0 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63de72a640 1 -- 172.21.15.134:0/393716892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d806c1f0 msgr2=0x7f63d815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.204+0000 7f63de72a640 1 --2- 172.21.15.134:0/393716892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d806c1f0 0x7f63d815baa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f63d806ca50 tx=0x7f63d002c940 comp rx=0 tx=0).stop 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 -- 172.21.15.134:0/393716892 shutdown_connections 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 --2- 172.21.15.134:0/393716892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d806c1f0 0x7f63d815baa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 --2- 172.21.15.134:0/393716892 >> v2:172.21.15.177:3300/0 conn(0x7f63d8151c50 0x7f63d80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 -- 172.21.15.134:0/393716892 >> 172.21.15.134:0/393716892 conn(0x7f63d8062cc0 msgr2=0x7f63d806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 -- 172.21.15.134:0/393716892 shutdown_connections 2024-09-15T22:42:43.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.205+0000 7f63de72a640 1 -- 172.21.15.134:0/393716892 wait complete. 2024-09-15T22:42:43.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.206+0000 7f63de72a640 1 Processor -- start 2024-09-15T22:42:43.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.206+0000 7f63de72a640 1 -- start start 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d806be10 0x7f63d81f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 0x7f63d81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63d80d0310 con 0x7f63d8151c50 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63d80ce690 con 0x7f63d806be10 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63d80d0490 con 0x7f63d806c1f0 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50444/0 (socket says 172.21.15.134:50444) 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 -- 172.21.15.134:0/1549685534 learned_addr learned my addr 172.21.15.134:0/1549685534 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:43.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d7fff640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d806be10 0x7f63d81f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d77fe640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 0x7f63d81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 -- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 msgr2=0x7f63d81566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 0x7f63d81566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 -- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d806be10 msgr2=0x7f63d81f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d806be10 0x7f63d81f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 -- 172.21.15.134:0/1549685534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d8156ef0 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d77fe640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 0x7f63d81566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63dccc7640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d240 tx=0x7f63d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0044070 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d0003bb0 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d81571d0 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0004020 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.207+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d8157790 con 0x7f63d8151c50 2024-09-15T22:42:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.208+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d80d0870 con 0x7f63d8151c50 2024-09-15T22:42:43.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.209+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f63d00041c0 con 0x7f63d8151c50 2024-09-15T22:42:43.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.209+0000 7f63d4ff9640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 0x7f63c406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.209+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f63d00ac200 con 0x7f63d8151c50 2024-09-15T22:42:43.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.209+0000 7f63d7fff640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 0x7f63c406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.210+0000 7f63d7fff640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 0x7f63c406e920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000f60 tx=0x7f63c8007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.214+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63d004d070 con 0x7f63d8151c50 2024-09-15T22:42:43.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.381+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63d8076250 con 0x7f63d8151c50 2024-09-15T22:42:43.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.382+0000 7f63d4ff9640 1 -- 172.21.15.134:0/1549685534 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16718 (secure 0 0 0) 0x7f63d007a5e0 con 0x7f63d8151c50 2024-09-15T22:42:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:43.383 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":46,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:42.400442+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:41.015151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:41.364744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:43.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 msgr2=0x7f63c406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 0x7f63c406e920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000f60 tx=0x7f63c8007b50 comp rx=0 tx=0).stop 2024-09-15T22:42:43.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 msgr2=0x7f63d81f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d240 tx=0x7f63d0004ab0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 shutdown_connections 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f63c406c460 0x7f63c406e920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d8151c50 0x7f63d81f50e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d806c1f0 0x7f63d81566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 --2- 172.21.15.134:0/1549685534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d806be10 0x7f63d81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 >> 172.21.15.134:0/1549685534 conn(0x7f63d8062cc0 msgr2=0x7f63d80b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 shutdown_connections 2024-09-15T22:42:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.384+0000 7f63de72a640 1 -- 172.21.15.134:0/1549685534 wait complete. 2024-09-15T22:42:43.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:43.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.495+0000 7f4be02b7640 1 Processor -- start 2024-09-15T22:42:43.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.495+0000 7f4be02b7640 1 -- start start 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4be02b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4bd806be10 0x7f4bd80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4be02b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bd806c1f0 0x7f4bd815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4be02b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd80cd5f0 con 0x7f4bd8151540 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4be02b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80cd8d0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4be02b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80cdbb0 con 0x7f4bd806be10 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bd806c1f0 0x7f4bd815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bd806c1f0 0x7f4bd815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50452/0 (socket says 172.21.15.134:50452) 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 -- 172.21.15.134:0/46139 learned_addr learned my addr 172.21.15.134:0/46139 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bde053640 1 --2- 172.21.15.134:0/46139 >> v2:172.21.15.177:3300/0 conn(0x7f4bd806be10 0x7f4bd80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 -- 172.21.15.134:0/46139 >> v2:172.21.15.177:3300/0 conn(0x7f4bd806be10 msgr2=0x7f4bd80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:43.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 --2- 172.21.15.134:0/46139 >> v2:172.21.15.177:3300/0 conn(0x7f4bd806be10 0x7f4bd80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 -- 172.21.15.134:0/46139 >> v1:172.21.15.177:6789/0 conn(0x7f4bd8151540 legacy=0x7f4bd8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:43.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.496+0000 7f4bdd852640 1 -- 172.21.15.134:0/46139 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd80cde90 con 0x7f4bd806c1f0 2024-09-15T22:42:43.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.497+0000 7f4bdd852640 1 --2- 172.21.15.134:0/46139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd815baa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806f180 tx=0x7f4bc802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1214f0b21cf6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.497+0000 7f4bdd051640 1 -- 172.21.15.134:0/46139 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8037070 con 0x7f4bd806c1f0 2024-09-15T22:42:43.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.497+0000 7f4bdd051640 1 -- 172.21.15.134:0/46139 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8032440 con 0x7f4bd806c1f0 2024-09-15T22:42:43.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.497+0000 7f4bdd051640 1 -- 172.21.15.134:0/46139 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8032810 con 0x7f4bd806c1f0 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 -- 172.21.15.134:0/46139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 msgr2=0x7f4bd815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 --2- 172.21.15.134:0/46139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd815baa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806f180 tx=0x7f4bc802a230 comp rx=0 tx=0).stop 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 -- 172.21.15.134:0/46139 shutdown_connections 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 --2- 172.21.15.134:0/46139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd815baa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 --2- 172.21.15.134:0/46139 >> v2:172.21.15.177:3300/0 conn(0x7f4bd806be10 0x7f4bd80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 -- 172.21.15.134:0/46139 >> 172.21.15.134:0/46139 conn(0x7f4bd8062cc0 msgr2=0x7f4bd806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 -- 172.21.15.134:0/46139 shutdown_connections 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.498+0000 7f4be02b7640 1 -- 172.21.15.134:0/46139 wait complete. 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.499+0000 7f4be02b7640 1 Processor -- start 2024-09-15T22:42:43.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.499+0000 7f4be02b7640 1 -- start start 2024-09-15T22:42:43.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd806be10 0x7f4bd8147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 0x7f4bd8152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd80d0310 con 0x7f4bd806c1f0 2024-09-15T22:42:43.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd80ce690 con 0x7f4bd806be10 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd80d0490 con 0x7f4bd8151540 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50458/0 (socket says 172.21.15.134:50458) 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 -- 172.21.15.134:0/157867668 learned_addr learned my addr 172.21.15.134:0/157867668 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bde053640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd806be10 0x7f4bd8147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bde854640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 0x7f4bd8152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 -- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 msgr2=0x7f4bd8152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 0x7f4bd8152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 -- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd806be10 msgr2=0x7f4bd8147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd806be10 0x7f4bd8147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 -- 172.21.15.134:0/157867668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd8148ba0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bde854640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 0x7f4bd8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:43.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bdd852640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4bc802a270 tx=0x7f4bc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8041020 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc80306c0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd81484f0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8037040 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.500+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd8149140 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.501+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd80d0850 con 0x7f4bd806c1f0 2024-09-15T22:42:43.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.502+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f4bc8044020 con 0x7f4bd806c1f0 2024-09-15T22:42:43.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.502+0000 7f4bceffd640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 0x7f4bbc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.503+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f4bc80abbb0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.503+0000 7f4bde053640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 0x7f4bbc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.503+0000 7f4bde053640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 0x7f4bbc06e920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4006fd0 tx=0x7f4bd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.507+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bc804b070 con 0x7f4bd806c1f0 2024-09-15T22:42:43.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.672+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bd8158f30 con 0x7f4bd806c1f0 2024-09-15T22:42:43.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.673+0000 7f4bceffd640 1 -- 172.21.15.134:0/157867668 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16718 (secure 0 0 0) 0x7f4bc807a0a0 con 0x7f4bd806c1f0 2024-09-15T22:42:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:43.675 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":46,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:42.400442+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:41.015151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:41.364744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.675+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 msgr2=0x7f4bbc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.675+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 0x7f4bbc06e920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4006fd0 tx=0x7f4bd4008040 comp rx=0 tx=0).stop 2024-09-15T22:42:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.675+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 msgr2=0x7f4bd8142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.675+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4bc802a270 tx=0x7f4bc80046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 shutdown_connections 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4bbc06c460 0x7f4bbc06e920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd8151540 0x7f4bd8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd806c1f0 0x7f4bd8142d40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 --2- 172.21.15.134:0/157867668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd806be10 0x7f4bd8147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 >> 172.21.15.134:0/157867668 conn(0x7f4bd8062cc0 msgr2=0x7f4bd815ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 shutdown_connections 2024-09-15T22:42:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.676+0000 7f4be02b7640 1 -- 172.21.15.134:0/157867668 wait complete. 2024-09-15T22:42:43.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:42:43.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.788+0000 7faca5d9f640 1 Processor -- start 2024-09-15T22:42:43.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.788+0000 7faca5d9f640 1 -- start start 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca5d9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faca015b440 0x7faca00cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca5d9f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faca006dfd0 0x7faca006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca5d9f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca006e930 con 0x7faca015b9d0 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca5d9f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faca015c510 con 0x7faca015b440 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca5d9f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7faca00d04c0 con 0x7faca006dfd0 2024-09-15T22:42:43.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca4d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faca015b440 0x7faca00cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca559e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faca015b9d0 0x7faca015be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40378/0 (socket says 172.21.15.134:40378) 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.789+0000 7faca559e640 1 -- 172.21.15.134:0/1891164527 learned_addr learned my addr 172.21.15.134:0/1891164527 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7fac9ffff640 1 --2- 172.21.15.134:0/1891164527 >> v2:172.21.15.177:3300/0 conn(0x7faca006dfd0 0x7faca006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7faca4d9d640 1 -- 172.21.15.134:0/1891164527 >> v2:172.21.15.177:3300/0 conn(0x7faca006dfd0 msgr2=0x7faca006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7fac9f7fe640 1 -- 172.21.15.134:0/1891164527 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277251130 0 0) 0x7faca006e930 con 0x7faca015b9d0 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7faca4d9d640 1 --2- 172.21.15.134:0/1891164527 >> v2:172.21.15.177:3300/0 conn(0x7faca006dfd0 0x7faca006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7faca4d9d640 1 -- 172.21.15.134:0/1891164527 >> v1:172.21.15.134:6789/0 conn(0x7faca015b9d0 legacy=0x7faca015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7faca4d9d640 1 -- 172.21.15.134:0/1891164527 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca015c790 con 0x7faca015b440 2024-09-15T22:42:43.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.790+0000 7faca4d9d640 1 --2- 172.21.15.134:0/1891164527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca015b440 0x7faca00cff80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faca00cda10 tx=0x7fac9002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c8305bda9fd953 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7fac9f7fe640 1 -- 172.21.15.134:0/1891164527 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037070 con 0x7faca015b440 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7fac9f7fe640 1 -- 172.21.15.134:0/1891164527 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90032440 con 0x7faca015b440 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7fac9f7fe640 1 -- 172.21.15.134:0/1891164527 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90032810 con 0x7faca015b440 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 -- 172.21.15.134:0/1891164527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca015b440 msgr2=0x7faca00cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 --2- 172.21.15.134:0/1891164527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca015b440 0x7faca00cff80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faca00cda10 tx=0x7fac9002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 -- 172.21.15.134:0/1891164527 shutdown_connections 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 --2- 172.21.15.134:0/1891164527 >> v2:172.21.15.177:3300/0 conn(0x7faca006dfd0 0x7faca006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 --2- 172.21.15.134:0/1891164527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca015b440 0x7faca00cff80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 -- 172.21.15.134:0/1891164527 >> 172.21.15.134:0/1891164527 conn(0x7faca00d12c0 msgr2=0x7faca00d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 -- 172.21.15.134:0/1891164527 shutdown_connections 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.791+0000 7faca5d9f640 1 -- 172.21.15.134:0/1891164527 wait complete. 2024-09-15T22:42:43.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.792+0000 7faca5d9f640 1 Processor -- start 2024-09-15T22:42:43.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.792+0000 7faca5d9f640 1 -- start start 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 0x7faca0168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 0x7faca0168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faca00cf780 con 0x7faca006dfd0 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faca00cf4a0 con 0x7faca015b9d0 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca5d9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faca015ca90 con 0x7faca015b440 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca4d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca4d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50472/0 (socket says 172.21.15.134:50472) 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.793+0000 7faca4d9d640 1 -- 172.21.15.134:0/493988547 learned_addr learned my addr 172.21.15.134:0/493988547 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca559e640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 0x7faca0168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7fac9ffff640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 0x7faca0168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 -- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 msgr2=0x7faca0168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 0x7faca0168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 -- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 msgr2=0x7faca0168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 0x7faca0168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 -- 172.21.15.134:0/493988547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca0152480 con 0x7faca006dfd0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca559e640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 0x7faca0168ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7fac9ffff640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 0x7faca0168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca4d9d640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037050 con 0x7faca006dfd0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90038040 con 0x7faca006dfd0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90004450 con 0x7faca006dfd0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca0152760 con 0x7faca006dfd0 2024-09-15T22:42:43.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.794+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca0152d20 con 0x7faca006dfd0 2024-09-15T22:42:43.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.795+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca00cff80 con 0x7faca006dfd0 2024-09-15T22:42:43.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.796+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fac90030980 con 0x7faca006dfd0 2024-09-15T22:42:43.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.796+0000 7fac9d7fa640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 0x7fac8c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:43.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.796+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fac900ac3c0 con 0x7faca006dfd0 2024-09-15T22:42:43.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.796+0000 7fac9ffff640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 0x7fac8c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:43.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.796+0000 7fac9ffff640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 0x7fac8c06e920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faca015ae50 tx=0x7fac94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:43.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:43.800+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac9007aa60 con 0x7faca006dfd0 2024-09-15T22:42:44.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.000+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faca0151a40 con 0x7faca006dfd0 2024-09-15T22:42:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.069+0000 7fac9d7fa640 1 -- 172.21.15.134:0/493988547 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fac9007a360 con 0x7faca006dfd0 2024-09-15T22:42:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.072+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 msgr2=0x7fac8c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.072+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 0x7fac8c06e920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faca015ae50 tx=0x7fac94008040 comp rx=0 tx=0).stop 2024-09-15T22:42:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.072+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 msgr2=0x7faca014ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.072+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac900046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 shutdown_connections 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fac8c06c460 0x7fac8c06e920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca015b9d0 0x7faca0168ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faca015b440 0x7faca0168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 --2- 172.21.15.134:0/493988547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca006dfd0 0x7faca014ab30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 >> 172.21.15.134:0/493988547 conn(0x7faca00d12c0 msgr2=0x7faca00720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 shutdown_connections 2024-09-15T22:42:44.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.073+0000 7faca5d9f640 1 -- 172.21.15.134:0/493988547 wait complete. 2024-09-15T22:42:44.087 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:42:44.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:42:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.188+0000 7fc3607bd640 1 Processor -- start 2024-09-15T22:42:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.188+0000 7fc3607bd640 1 -- start start 2024-09-15T22:42:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc3607bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc35815b090 0x7fc3580b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc3607bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 0x7fc35815b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc3607bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc358071de0 con 0x7fc35815b9b0 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc3607bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc3580720c0 con 0x7fc35815b090 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc3607bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc3580723a0 con 0x7fc3580715b0 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35e559640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc35815b090 0x7fc3580b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35ed5a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc35815b9b0 0x7fc35806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40394/0 (socket says 172.21.15.134:40394) 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35ed5a640 1 -- 172.21.15.134:0/4100593843 learned_addr learned my addr 172.21.15.134:0/4100593843 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35dd58640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 0x7fc35815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35e559640 1 -- 172.21.15.134:0/4100593843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 msgr2=0x7fc35815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35e559640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 0x7fc35815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35e559640 1 -- 172.21.15.134:0/4100593843 >> v1:172.21.15.134:6789/0 conn(0x7fc35815b9b0 legacy=0x7fc35806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35e559640 1 -- 172.21.15.134:0/4100593843 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc358072680 con 0x7fc35815b090 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35d557640 1 -- 172.21.15.134:0/4100593843 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453997510 0 0) 0x7fc358071de0 con 0x7fc35815b9b0 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.189+0000 7fc35dd58640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 0x7fc35815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.190+0000 7fc35e559640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc35815b090 0x7fc3580b5420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc35402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2ce55034559a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.190+0000 7fc35d557640 1 -- 172.21.15.134:0/4100593843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354037070 con 0x7fc35815b090 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.190+0000 7fc35d557640 1 -- 172.21.15.134:0/4100593843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc354032440 con 0x7fc35815b090 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.190+0000 7fc35d557640 1 -- 172.21.15.134:0/4100593843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354032810 con 0x7fc35815b090 2024-09-15T22:42:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 -- 172.21.15.134:0/4100593843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc35815b090 msgr2=0x7fc3580b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc35815b090 0x7fc3580b5420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc35402a180 comp rx=0 tx=0).stop 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 -- 172.21.15.134:0/4100593843 shutdown_connections 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3580715b0 0x7fc35815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 --2- 172.21.15.134:0/4100593843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc35815b090 0x7fc3580b5420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 -- 172.21.15.134:0/4100593843 >> 172.21.15.134:0/4100593843 conn(0x7fc35806bba0 msgr2=0x7fc35806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 -- 172.21.15.134:0/4100593843 shutdown_connections 2024-09-15T22:42:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.191+0000 7fc3607bd640 1 -- 172.21.15.134:0/4100593843 wait complete. 2024-09-15T22:42:44.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.192+0000 7fc3607bd640 1 Processor -- start 2024-09-15T22:42:44.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.192+0000 7fc3607bd640 1 -- start start 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc35815b090 0x7fc3580af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc35815b9b0 0x7fc358148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc35815bd90 con 0x7fc3580715b0 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc358071990 con 0x7fc35815b090 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc3581586e0 con 0x7fc35815b9b0 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50488/0 (socket says 172.21.15.134:50488) 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 -- 172.21.15.134:0/3429326662 learned_addr learned my addr 172.21.15.134:0/3429326662 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35dd58640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc35815b090 0x7fc3580af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35ed5a640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc35815b9b0 0x7fc358148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 -- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc35815b9b0 msgr2=0x7fc358148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc35815b9b0 0x7fc358148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 -- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc35815b090 msgr2=0x7fc3580af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc35815b090 0x7fc3580af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 -- 172.21.15.134:0/3429326662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581589c0 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc35e559640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354037040 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc354004250 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc358158ca0 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354032e20 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.193+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc358158f80 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.194+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35815b470 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.195+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fc354030770 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.195+0000 7fc34effd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 0x7fc33c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.195+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fc3540acb70 con 0x7fc3580715b0 2024-09-15T22:42:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.195+0000 7fc35dd58640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 0x7fc33c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:44.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.196+0000 7fc35dd58640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 0x7fc33c06e950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:44.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.199+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc35407b180 con 0x7fc3580715b0 2024-09-15T22:42:44.331 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-09-15T22:42:44.330+0000 7f0cf3aab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:42:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:44.403+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc35806ea80 con 0x7fc3580715b0 2024-09-15T22:42:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.077+0000 7fc34effd640 1 -- 172.21.15.134:0/3429326662 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7fc35407aa80 con 0x7fc3580715b0 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 msgr2=0x7fc33c06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 0x7fc33c06e950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348008040 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 msgr2=0x7fc358158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc3540046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 shutdown_connections 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc33c06c490 0x7fc33c06e950 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc35815b9b0 0x7fc358148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc35815b090 0x7fc3580af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 --2- 172.21.15.134:0/3429326662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3580715b0 0x7fc358158100 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 >> 172.21.15.134:0/3429326662 conn(0x7fc35806bba0 msgr2=0x7fc3580afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 shutdown_connections 2024-09-15T22:42:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.080+0000 7fc3607bd640 1 -- 172.21.15.134:0/3429326662 wait complete. 2024-09-15T22:42:45.095 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:42:45.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:45.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.196+0000 7f8bdefcf640 1 Processor -- start 2024-09-15T22:42:45.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.196+0000 7f8bdefcf640 1 -- start start 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdefcf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bd806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdefcf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd815ecf0 con 0x7f8bd815c300 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdefcf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd815c6e0 con 0x7f8bd806f010 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdefcf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd815efb0 con 0x7f8bd80cd300 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdcd6b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8bd815c300 0x7f8bd80affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40404/0 (socket says 172.21.15.134:40404) 2024-09-15T22:42:45.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bdcd6b640 1 -- 172.21.15.134:0/2964648874 learned_addr learned my addr 172.21.15.134:0/2964648874 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bd806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785931146 0 0) 0x7f8bd815ecf0 con 0x7f8bd815c300 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.197+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc8003520 con 0x7f8bd815c300 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 750344672 0 0) 0x7f8bc8003520 con 0x7f8bd815c300 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 msgr2=0x7f8bd806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bd806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 >> v1:172.21.15.177:6789/0 conn(0x7f8bd806f010 legacy=0x7f8bd80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd815f290 con 0x7f8bd815c300 2024-09-15T22:42:45.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f8bcc001670 con 0x7f8bd815c300 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 >> v1:172.21.15.134:6789/0 conn(0x7f8bd815c300 legacy=0x7f8bd80affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc80039e0 0x7f8bc8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc8004390 0x7f8bc8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bc8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd815efb0 con 0x7f8bc8004390 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc800baa0 con 0x7f8bc80039e0 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc800bca0 con 0x7f8bd80cd300 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc8004390 0x7f8bc8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bdcd6b640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc80039e0 0x7f8bc8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bdd56c640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bc8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 msgr2=0x7f8bc8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd80cd300 0x7f8bc8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc80039e0 msgr2=0x7f8bc8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc80039e0 0x7f8bc8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.198+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2964648874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc8003520 con 0x7f8bc8004390 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc8004390 0x7f8bc8004860 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80cd740 tx=0x7f8bc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be67bb261ed6d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4036070 con 0x7f8bc8004390 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc4031400 con 0x7f8bc8004390 2024-09-15T22:42:45.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bd77fe640 1 -- 172.21.15.134:0/2964648874 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4009670 con 0x7f8bc8004390 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2964648874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc8004390 msgr2=0x7f8bc8004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2964648874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc8004390 0x7f8bc8004860 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80cd740 tx=0x7f8bc8005830 comp rx=0 tx=0).stop 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdd56c640 1 -- 172.21.15.134:0/2964648874 reap_dead start 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2964648874 shutdown_connections 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2964648874 >> 172.21.15.134:0/2964648874 conn(0x7f8bd806cae0 msgr2=0x7f8bd806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2964648874 shutdown_connections 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.199+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2964648874 wait complete. 2024-09-15T22:42:45.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 Processor -- start 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 -- start start 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc8004390 0x7f8bd815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 0x7f8bd80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.201+0000 7f8bdefcf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8071880 con 0x7f8bd815de40 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdefcf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd815f850 con 0x7f8bc8004390 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdefcf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd806ead0 con 0x7f8bd814d880 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50494/0 (socket says 172.21.15.134:50494) 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2410983811 learned_addr learned my addr 172.21.15.134:0/2410983811 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdcd6b640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc8004390 0x7f8bd815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdd56c640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 0x7f8bd80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 msgr2=0x7f8bd80cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 0x7f8bd80cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc8004390 msgr2=0x7f8bd815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc8004390 0x7f8bd815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 -- 172.21.15.134:0/2410983811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd8161f10 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdd56c640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 0x7f8bd80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402ab40 tx=0x7f8bc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4036040 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc403d680 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd80d0090 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4009670 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.202+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd80d0670 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.203+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd80affc0 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.204+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f8bc4039040 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.204+0000 7f8bd57fa640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 0x7f8bbc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.204+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f8bc40abe00 con 0x7f8bd815de40 2024-09-15T22:42:45.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.204+0000 7f8bdcd6b640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 0x7f8bbc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.205+0000 7f8bdcd6b640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 0x7f8bbc06e920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001cf0 tx=0x7f8bcc001c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.209+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bc4041020 con 0x7f8bd815de40 2024-09-15T22:42:45.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.408+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bd806d120 con 0x7f8bd815de40 2024-09-15T22:42:45.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.408+0000 7f8bd57fa640 1 -- 172.21.15.134:0/2410983811 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5220 (secure 0 0 0) 0x7f8bc4079d50 con 0x7f8bd815de40 2024-09-15T22:42:45.410 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:45.410 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"btime":"2024-09-15T22:42:45:077538+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:42:45.410 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-09-15T22:42:45.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 msgr2=0x7f8bbc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 0x7f8bbc06e920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001cf0 tx=0x7f8bcc001c80 comp rx=0 tx=0).stop 2024-09-15T22:42:45.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 msgr2=0x7f8bd80cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402ab40 tx=0x7f8bc4004730 comp rx=0 tx=0).stop 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 shutdown_connections 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8bbc06c460 0x7f8bbc06e920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd814d880 0x7f8bd80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd815de40 0x7f8bd80cd860 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 --2- 172.21.15.134:0/2410983811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bc8004390 0x7f8bd815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 >> 172.21.15.134:0/2410983811 conn(0x7f8bd806cae0 msgr2=0x7f8bd8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 shutdown_connections 2024-09-15T22:42:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.411+0000 7f8bdefcf640 1 -- 172.21.15.134:0/2410983811 wait complete. 2024-09-15T22:42:45.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:42:45.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.520+0000 7fbfff96d640 1 Processor -- start 2024-09-15T22:42:45.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.520+0000 7fbfff96d640 1 -- start start 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbfff96d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff80d02a0 0x7fbff80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbfff96d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 0x7fbff81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbfff96d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff80d0bc0 con 0x7fbff815ca40 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbfff96d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbff815d390 con 0x7fbff80d02a0 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbfff96d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbff815d670 con 0x7fbff815ceb0 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffd709640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff80d02a0 0x7fbff80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffd709640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff80d02a0 0x7fbff80d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50508/0 (socket says 172.21.15.134:50508) 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffd709640 1 -- 172.21.15.134:0/1989425407 learned_addr learned my addr 172.21.15.134:0/1989425407 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffd709640 1 -- 172.21.15.134:0/1989425407 >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 msgr2=0x7fbff81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffdf0a640 1 --2- 172.21.15.134:0/1989425407 >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 0x7fbff81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.521+0000 7fbffd709640 1 --2- 172.21.15.134:0/1989425407 >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 0x7fbff81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbffd709640 1 -- 172.21.15.134:0/1989425407 >> v1:172.21.15.177:6789/0 conn(0x7fbff815ca40 legacy=0x7fbff815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbffd709640 1 -- 172.21.15.134:0/1989425407 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff815d950 con 0x7fbff80d02a0 2024-09-15T22:42:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbffdf0a640 1 --2- 172.21.15.134:0/1989425407 >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 0x7fbff81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbffd709640 1 --2- 172.21.15.134:0/1989425407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80d02a0 0x7fbff80d0680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbff80b52b0 tx=0x7fbff402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a996c7c1315871 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbfeffff640 1 -- 172.21.15.134:0/1989425407 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4037070 con 0x7fbff80d02a0 2024-09-15T22:42:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbfeffff640 1 -- 172.21.15.134:0/1989425407 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4032440 con 0x7fbff80d02a0 2024-09-15T22:42:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.522+0000 7fbfeffff640 1 -- 172.21.15.134:0/1989425407 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4032810 con 0x7fbff80d02a0 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 -- 172.21.15.134:0/1989425407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80d02a0 msgr2=0x7fbff80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 --2- 172.21.15.134:0/1989425407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80d02a0 0x7fbff80d0680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbff80b52b0 tx=0x7fbff402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 -- 172.21.15.134:0/1989425407 shutdown_connections 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 --2- 172.21.15.134:0/1989425407 >> v2:172.21.15.177:3300/0 conn(0x7fbff815ceb0 0x7fbff81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 --2- 172.21.15.134:0/1989425407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80d02a0 0x7fbff80d0680 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 -- 172.21.15.134:0/1989425407 >> 172.21.15.134:0/1989425407 conn(0x7fbff8062cc0 msgr2=0x7fbff806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 -- 172.21.15.134:0/1989425407 shutdown_connections 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.523+0000 7fbfff96d640 1 -- 172.21.15.134:0/1989425407 wait complete. 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.524+0000 7fbfff96d640 1 Processor -- start 2024-09-15T22:42:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.524+0000 7fbfff96d640 1 -- start start 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 0x7fbff814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815ca40 0x7fbff80aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbff815eb40 con 0x7fbff815ceb0 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbff815df10 con 0x7fbff815ca40 2024-09-15T22:42:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbfff96d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbff8155b90 con 0x7fbff80d02a0 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50520/0 (socket says 172.21.15.134:50520) 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 -- 172.21.15.134:0/2899066121 learned_addr learned my addr 172.21.15.134:0/2899066121 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffcf08640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815ca40 0x7fbff80aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffd709640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 0x7fbff814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 -- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 msgr2=0x7fbff814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 0x7fbff814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 -- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815ca40 msgr2=0x7fbff80aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815ca40 0x7fbff80aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffdf0a640 1 -- 172.21.15.134:0/2899066121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff81f23d0 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.525+0000 7fbffd709640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 0x7fbff814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbffdf0a640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cec0 tx=0x7fbff000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0019020 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff000c0d0 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81f26b0 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000ee60 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.526+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81f2c70 con 0x7fbff815ceb0 2024-09-15T22:42:45.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.527+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff81f2e70 con 0x7fbff815ceb0 2024-09-15T22:42:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.527+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fbff000a470 con 0x7fbff815ceb0 2024-09-15T22:42:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.528+0000 7fbfedffb640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 0x7fbfdc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.528+0000 7fbffd709640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 0x7fbfdc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.528+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fbff008d7d0 con 0x7fbff815ceb0 2024-09-15T22:42:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.528+0000 7fbffd709640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 0x7fbfdc06e920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbff4034000 tx=0x7fbff402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.532+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbff0023060 con 0x7fbff815ceb0 2024-09-15T22:42:45.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.697+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbff80b4790 con 0x7fbff815ceb0 2024-09-15T22:42:45.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.699+0000 7fbfedffb640 1 -- 172.21.15.134:0/2899066121 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16705 (secure 0 0 0) 0x7fbff005bc40 con 0x7fbff815ceb0 2024-09-15T22:42:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:45.700 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:42:44.070026+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:41.015151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:41.364744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:45.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 msgr2=0x7fbfdc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 0x7fbfdc06e920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbff4034000 tx=0x7fbff402e000 comp rx=0 tx=0).stop 2024-09-15T22:42:45.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 msgr2=0x7fbff8073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cec0 tx=0x7fbff000e420 comp rx=0 tx=0).stop 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 shutdown_connections 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfdc06c460 0x7fbfdc06e920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff815ceb0 0x7fbff8073080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815ca40 0x7fbff80aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 --2- 172.21.15.134:0/2899066121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80d02a0 0x7fbff814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 >> 172.21.15.134:0/2899066121 conn(0x7fbff8062cc0 msgr2=0x7fbff80b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 shutdown_connections 2024-09-15T22:42:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.701+0000 7fbfff96d640 1 -- 172.21.15.134:0/2899066121 wait complete. 2024-09-15T22:42:45.713 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:42:45.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:45.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.809+0000 7f0215166640 1 Processor -- start 2024-09-15T22:42:45.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 -- start start 2024-09-15T22:42:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f021015e940 0x7f02100d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02100cef90 0x7f02100d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02100b7170 con 0x7f021015ed20 2024-09-15T22:42:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f02100d1ae0 con 0x7f021015e940 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f0215166640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f02100b7aa0 con 0x7f02100cef90 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.810+0000 7f020ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f021015e940 0x7f02100d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020e59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f021015ed20 0x7f02100b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40416/0 (socket says 172.21.15.134:40416) 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020e59c640 1 -- 172.21.15.134:0/1526119701 learned_addr learned my addr 172.21.15.134:0/1526119701 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020f59e640 1 --2- 172.21.15.134:0/1526119701 >> v2:172.21.15.177:3300/0 conn(0x7f02100cef90 0x7f02100d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020ed9d640 1 -- 172.21.15.134:0/1526119701 >> v2:172.21.15.177:3300/0 conn(0x7f02100cef90 msgr2=0x7f02100d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020ed9d640 1 --2- 172.21.15.134:0/1526119701 >> v2:172.21.15.177:3300/0 conn(0x7f02100cef90 0x7f02100d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020ed9d640 1 -- 172.21.15.134:0/1526119701 >> v1:172.21.15.134:6789/0 conn(0x7f021015ed20 legacy=0x7f02100b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020ed9d640 1 -- 172.21.15.134:0/1526119701 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02100d3660 con 0x7f021015e940 2024-09-15T22:42:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.811+0000 7f020ed9d640 1 --2- 172.21.15.134:0/1526119701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015e940 0x7f02100d1060 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f021006d070 tx=0x7f020802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a47b8780c26592 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f020dd9b640 1 -- 172.21.15.134:0/1526119701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208037070 con 0x7f021015e940 2024-09-15T22:42:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f020dd9b640 1 -- 172.21.15.134:0/1526119701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0208032440 con 0x7f021015e940 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f020dd9b640 1 -- 172.21.15.134:0/1526119701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208032810 con 0x7f021015e940 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 -- 172.21.15.134:0/1526119701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015e940 msgr2=0x7f02100d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 --2- 172.21.15.134:0/1526119701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015e940 0x7f02100d1060 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f021006d070 tx=0x7f020802a230 comp rx=0 tx=0).stop 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 -- 172.21.15.134:0/1526119701 shutdown_connections 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 --2- 172.21.15.134:0/1526119701 >> v2:172.21.15.177:3300/0 conn(0x7f02100cef90 0x7f02100d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 --2- 172.21.15.134:0/1526119701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015e940 0x7f02100d1060 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 -- 172.21.15.134:0/1526119701 >> 172.21.15.134:0/1526119701 conn(0x7f02100b6240 msgr2=0x7f02100b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 -- 172.21.15.134:0/1526119701 shutdown_connections 2024-09-15T22:42:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.812+0000 7f0215166640 1 -- 172.21.15.134:0/1526119701 wait complete. 2024-09-15T22:42:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 Processor -- start 2024-09-15T22:42:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 -- start start 2024-09-15T22:42:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 0x7f02101487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f021015e940 0x7f02100ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02100d3f00 con 0x7f021015ed20 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02100d3c20 con 0x7f021015e940 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f0215166640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f02100d3310 con 0x7f02100cef90 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f020f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f020f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50536/0 (socket says 172.21.15.134:50536) 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.814+0000 7f020f59e640 1 -- 172.21.15.134:0/103536505 learned_addr learned my addr 172.21.15.134:0/103536505 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020e59c640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f021015e940 0x7f02100ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020ed9d640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 0x7f02101487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 -- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 msgr2=0x7f02101487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 0x7f02101487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 -- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f021015e940 msgr2=0x7f02100ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f021015e940 0x7f02100ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 -- 172.21.15.134:0/103536505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0210148d20 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020ed9d640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 0x7f02101487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f020f59e640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0200007e60 tx=0x7f020000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200014420 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0200019070 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200014820 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02101490b0 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.815+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0210149630 con 0x7f021015ed20 2024-09-15T22:42:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.816+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02100d1ef0 con 0x7f021015ed20 2024-09-15T22:42:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.817+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f02000149c0 con 0x7f021015ed20 2024-09-15T22:42:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.817+0000 7f01f77fe640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 0x7f01fc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.817+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f020008bf90 con 0x7f021015ed20 2024-09-15T22:42:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.817+0000 7f020ed9d640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 0x7f01fc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.817+0000 7f020ed9d640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 0x7f01fc06e920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0208034000 tx=0x7f020802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.821+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f020005a480 con 0x7f021015ed20 2024-09-15T22:42:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.986+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02100ba6b0 con 0x7f01fc06c460 2024-09-15T22:42:45.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.991+0000 7f01f77fe640 1 -- 172.21.15.134:0/103536505 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238938 (secure 0 0 0) 0x7f02100ba6b0 con 0x7f01fc06c460 2024-09-15T22:42:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:45.996 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:45.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 msgr2=0x7f01fc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 0x7f01fc06e920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0208034000 tx=0x7f020802e000 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 msgr2=0x7f02100ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0200007e60 tx=0x7f020000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 shutdown_connections 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01fc06c460 0x7f01fc06e920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021015ed20 0x7f02100ab6e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f021015e940 0x7f02100ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 --2- 172.21.15.134:0/103536505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02100cef90 0x7f02101487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 >> 172.21.15.134:0/103536505 conn(0x7f02100b6240 msgr2=0x7f021015f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 shutdown_connections 2024-09-15T22:42:45.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:45.994+0000 7f0215166640 1 -- 172.21.15.134:0/103536505 wait complete. 2024-09-15T22:42:46.006 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-15T22:42:44.962872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221308,"kb_used_data":5040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753412,"statfs":{"total":773094113280,"available":772867493888,"internally_reserved":0,"allocated":5160960,"data_stored":2729622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000754"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075712+0000","last_change":"2024-09-15T22:42:43.070946+0000","last_active":"2024-09-15T22:42:43.075712+0000","last_peered":"2024-09-15T22:42:43.075712+0000","last_clean":"2024-09-15T22:42:43.075712+0000","last_became_active":"2024-09-15T22:42:43.070660+0000","last_became_peered":"2024-09-15T22:42:43.070660+0000","last_unstale":"2024-09-15T22:42:43.075712+0000","last_undegraded":"2024-09-15T22:42:43.075712+0000","last_fullsized":"2024-09-15T22:42:43.075712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:52.691529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091993+0000","last_change":"2024-09-15T22:42:43.088934+0000","last_active":"2024-09-15T22:42:43.091993+0000","last_peered":"2024-09-15T22:42:43.091993+0000","last_clean":"2024-09-15T22:42:43.091993+0000","last_became_active":"2024-09-15T22:42:43.088613+0000","last_became_peered":"2024-09-15T22:42:43.088613+0000","last_unstale":"2024-09-15T22:42:43.091993+0000","last_undegraded":"2024-09-15T22:42:43.091993+0000","last_fullsized":"2024-09-15T22:42:43.091993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:12.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089986+0000","last_change":"2024-09-15T22:42:43.087030+0000","last_active":"2024-09-15T22:42:43.089986+0000","last_peered":"2024-09-15T22:42:43.089986+0000","last_clean":"2024-09-15T22:42:43.089986+0000","last_became_active":"2024-09-15T22:42:43.086710+0000","last_became_peered":"2024-09-15T22:42:43.086710+0000","last_unstale":"2024-09-15T22:42:43.089986+0000","last_undegraded":"2024-09-15T22:42:43.089986+0000","last_fullsized":"2024-09-15T22:42:43.089986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:28.960302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075745+0000","last_change":"2024-09-15T22:42:43.071650+0000","last_active":"2024-09-15T22:42:43.075745+0000","last_peered":"2024-09-15T22:42:43.075745+0000","last_clean":"2024-09-15T22:42:43.075745+0000","last_became_active":"2024-09-15T22:42:43.071348+0000","last_became_peered":"2024-09-15T22:42:43.071348+0000","last_unstale":"2024-09-15T22:42:43.075745+0000","last_undegraded":"2024-09-15T22:42:43.075745+0000","last_fullsized":"2024-09-15T22:42:43.075745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:25.483287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091899+0000","last_change":"2024-09-15T22:42:42.068792+0000","last_active":"2024-09-15T22:42:43.091899+0000","last_peered":"2024-09-15T22:42:43.091899+0000","last_clean":"2024-09-15T22:42:43.091899+0000","last_became_active":"2024-09-15T22:42:42.068512+0000","last_became_peered":"2024-09-15T22:42:42.068512+0000","last_unstale":"2024-09-15T22:42:43.091899+0000","last_undegraded":"2024-09-15T22:42:43.091899+0000","last_fullsized":"2024-09-15T22:42:43.091899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:20.873965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.092102+0000","last_change":"2024-09-15T22:42:42.072466+0000","last_active":"2024-09-15T22:42:43.092102+0000","last_peered":"2024-09-15T22:42:43.092102+0000","last_clean":"2024-09-15T22:42:43.092102+0000","last_became_active":"2024-09-15T22:42:42.072206+0000","last_became_peered":"2024-09-15T22:42:42.072206+0000","last_unstale":"2024-09-15T22:42:43.092102+0000","last_undegraded":"2024-09-15T22:42:43.092102+0000","last_fullsized":"2024-09-15T22:42:43.092102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:44.164192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091392+0000","last_change":"2024-09-15T22:42:42.069587+0000","last_active":"2024-09-15T22:42:43.091392+0000","last_peered":"2024-09-15T22:42:43.091392+0000","last_clean":"2024-09-15T22:42:43.091392+0000","last_became_active":"2024-09-15T22:42:42.069207+0000","last_became_peered":"2024-09-15T22:42:42.069207+0000","last_unstale":"2024-09-15T22:42:43.091392+0000","last_undegraded":"2024-09-15T22:42:43.091392+0000","last_fullsized":"2024-09-15T22:42:43.091392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:54.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065759+0000","last_change":"2024-09-15T22:42:42.062757+0000","last_active":"2024-09-15T22:42:43.065759+0000","last_peered":"2024-09-15T22:42:43.065759+0000","last_clean":"2024-09-15T22:42:43.065759+0000","last_became_active":"2024-09-15T22:42:42.062432+0000","last_became_peered":"2024-09-15T22:42:42.062432+0000","last_unstale":"2024-09-15T22:42:43.065759+0000","last_undegraded":"2024-09-15T22:42:43.065759+0000","last_fullsized":"2024-09-15T22:42:43.065759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:49.387947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065540+0000","last_change":"2024-09-15T22:42:42.063551+0000","last_active":"2024-09-15T22:42:43.065540+0000","last_peered":"2024-09-15T22:42:43.065540+0000","last_clean":"2024-09-15T22:42:43.065540+0000","last_became_active":"2024-09-15T22:42:42.063299+0000","last_became_peered":"2024-09-15T22:42:42.063299+0000","last_unstale":"2024-09-15T22:42:43.065540+0000","last_undegraded":"2024-09-15T22:42:43.065540+0000","last_fullsized":"2024-09-15T22:42:43.065540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.076628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089641+0000","last_change":"2024-09-15T22:42:43.079711+0000","last_active":"2024-09-15T22:42:43.089641+0000","last_peered":"2024-09-15T22:42:43.089641+0000","last_clean":"2024-09-15T22:42:43.089641+0000","last_became_active":"2024-09-15T22:42:43.079435+0000","last_became_peered":"2024-09-15T22:42:43.079435+0000","last_unstale":"2024-09-15T22:42:43.089641+0000","last_undegraded":"2024-09-15T22:42:43.089641+0000","last_fullsized":"2024-09-15T22:42:43.089641+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:24.892136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065645+0000","last_change":"2024-09-15T22:42:42.065936+0000","last_active":"2024-09-15T22:42:43.065645+0000","last_peered":"2024-09-15T22:42:43.065645+0000","last_clean":"2024-09-15T22:42:43.065645+0000","last_became_active":"2024-09-15T22:42:42.065495+0000","last_became_peered":"2024-09-15T22:42:42.065495+0000","last_unstale":"2024-09-15T22:42:43.065645+0000","last_undegraded":"2024-09-15T22:42:43.065645+0000","last_fullsized":"2024-09-15T22:42:43.065645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:18.016844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T22:42:39.045983+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:39.045983+0000","last_peered":"2024-09-15T22:42:39.045983+0000","last_clean":"2024-09-15T22:42:39.045983+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:39.045983+0000","last_undegraded":"2024-09-15T22:42:39.045983+0000","last_fullsized":"2024-09-15T22:42:39.045983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":187971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":212581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:46.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:46.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.145+0000 7f70cad4b640 1 Processor -- start 2024-09-15T22:42:46.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.145+0000 7f70cad4b640 1 -- start start 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70cad4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70c40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70cad4b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70c40aff30 0x7f70c40b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70cad4b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c40ce150 con 0x7f70c4156880 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70cad4b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f70c40b6b00 con 0x7f70c40aff30 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70cad4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40b08c0 con 0x7f70c40cdae0 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c8ae7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f70c4156880 0x7f70c4160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40426/0 (socket says 172.21.15.134:40426) 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c8ae7640 1 -- 172.21.15.134:0/2409954646 learned_addr learned my addr 172.21.15.134:0/2409954646 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c3fff640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70c40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c92e8640 1 --2- 172.21.15.134:0/2409954646 >> v2:172.21.15.177:3300/0 conn(0x7f70c40aff30 0x7f70c40b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164582802 0 0) 0x7f70c40ce150 con 0x7f70c4156880 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b4003520 con 0x7f70c4156880 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3917399997 0 0) 0x7f70b4003520 con 0x7f70c4156880 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 msgr2=0x7f70c40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70c40b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 >> v2:172.21.15.177:3300/0 conn(0x7f70c40aff30 msgr2=0x7f70c40b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 --2- 172.21.15.134:0/2409954646 >> v2:172.21.15.177:3300/0 conn(0x7f70c40aff30 0x7f70c40b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40ce430 con 0x7f70c4156880 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f70b8001670 con 0x7f70c4156880 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 >> v1:172.21.15.134:6789/0 conn(0x7f70c4156880 legacy=0x7f70c4160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b40039b0 0x7f70b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70b4004d40 0x7f70b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40b6b00 con 0x7f70b4004d40 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40b08c0 con 0x7f70b40039b0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.146+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70b400b9c0 con 0x7f70c40cdae0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70b4004d40 0x7f70b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c8ae7640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b40039b0 0x7f70b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c3fff640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 -- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 msgr2=0x7f70b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70c40cdae0 0x7f70b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 -- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b40039b0 msgr2=0x7f70b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b40039b0 0x7f70b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 -- 172.21.15.134:0/2409954646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b4003520 con 0x7f70b4004d40 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.147+0000 7f70c92e8640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70b4004d40 0x7f70b40051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e170 tx=0x7f70b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc963d7164f878b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc034020 con 0x7f70b4004d40 2024-09-15T22:42:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc030430 con 0x7f70b4004d40 2024-09-15T22:42:46.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70c37fe640 1 -- 172.21.15.134:0/2409954646 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc009c10 con 0x7f70b4004d40 2024-09-15T22:42:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 -- 172.21.15.134:0/2409954646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70b4004d40 msgr2=0x7f70b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 --2- 172.21.15.134:0/2409954646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70b4004d40 0x7f70b40051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e170 tx=0x7f70b4005830 comp rx=0 tx=0).stop 2024-09-15T22:42:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70c92e8640 1 -- 172.21.15.134:0/2409954646 reap_dead start 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 -- 172.21.15.134:0/2409954646 shutdown_connections 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 -- 172.21.15.134:0/2409954646 >> 172.21.15.134:0/2409954646 conn(0x7f70c406cae0 msgr2=0x7f70c406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 -- 172.21.15.134:0/2409954646 shutdown_connections 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.148+0000 7f70cad4b640 1 -- 172.21.15.134:0/2409954646 wait complete. 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.149+0000 7f70cad4b640 1 Processor -- start 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.149+0000 7f70cad4b640 1 -- start start 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70b4004d40 0x7f70c41f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70c41551f0 0x7f70c4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4156c60 con 0x7f70c415b1f0 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4160210 con 0x7f70c41551f0 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70cad4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40ce710 con 0x7f70b4004d40 2024-09-15T22:42:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70c92e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70c92e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50540/0 (socket says 172.21.15.134:50540) 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70c92e8640 1 -- 172.21.15.134:0/1072520506 learned_addr learned my addr 172.21.15.134:0/1072520506 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70c3fff640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70c41551f0 0x7f70c4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.150+0000 7f70c8ae7640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70b4004d40 0x7f70c41f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 -- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70b4004d40 msgr2=0x7f70c41f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70b4004d40 0x7f70c41f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 -- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70c41551f0 msgr2=0x7f70c4154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70c41551f0 0x7f70c4154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 -- 172.21.15.134:0/1072520506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40aa650 con 0x7f70c415b1f0 2024-09-15T22:42:46.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c92e8640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e170 tx=0x7f70bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc034040 con 0x7f70c415b1f0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc003b90 con 0x7f70c415b1f0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c40aa930 con 0x7f70c415b1f0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc009c10 con 0x7f70c415b1f0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.151+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c40ab410 con 0x7f70c415b1f0 2024-09-15T22:42:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.152+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c40b0380 con 0x7f70c415b1f0 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.152+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f70bc037020 con 0x7f70c415b1f0 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.153+0000 7f70c17fa640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 0x7f70a806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.153+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f70bc0ac4e0 con 0x7f70c415b1f0 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.153+0000 7f70c8ae7640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 0x7f70a806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.153+0000 7f70c8ae7640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 0x7f70a806e920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b6160 tx=0x7f70b8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.157+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70bc049060 con 0x7f70c415b1f0 2024-09-15T22:42:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.319+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70c406d300 con 0x7f70a806c460 2024-09-15T22:42:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.324+0000 7f70c17fa640 1 -- 172.21.15.134:0/1072520506 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238938 (secure 0 0 0) 0x7f70c406d300 con 0x7f70a806c460 2024-09-15T22:42:46.328 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:46.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 msgr2=0x7f70a806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 0x7f70a806e920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b6160 tx=0x7f70b8007970 comp rx=0 tx=0).stop 2024-09-15T22:42:46.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 msgr2=0x7f70c415b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e170 tx=0x7f70bc009750 comp rx=0 tx=0).stop 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 shutdown_connections 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f70a806c460 0x7f70a806e920 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c415b1f0 0x7f70c415b670 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70c41551f0 0x7f70c4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 --2- 172.21.15.134:0/1072520506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70b4004d40 0x7f70c41f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 >> 172.21.15.134:0/1072520506 conn(0x7f70c406cae0 msgr2=0x7f70c406ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 shutdown_connections 2024-09-15T22:42:46.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.327+0000 7f70cad4b640 1 -- 172.21.15.134:0/1072520506 wait complete. 2024-09-15T22:42:46.339 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-15T22:42:44.962872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221308,"kb_used_data":5040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753412,"statfs":{"total":773094113280,"available":772867493888,"internally_reserved":0,"allocated":5160960,"data_stored":2729622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000754"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075712+0000","last_change":"2024-09-15T22:42:43.070946+0000","last_active":"2024-09-15T22:42:43.075712+0000","last_peered":"2024-09-15T22:42:43.075712+0000","last_clean":"2024-09-15T22:42:43.075712+0000","last_became_active":"2024-09-15T22:42:43.070660+0000","last_became_peered":"2024-09-15T22:42:43.070660+0000","last_unstale":"2024-09-15T22:42:43.075712+0000","last_undegraded":"2024-09-15T22:42:43.075712+0000","last_fullsized":"2024-09-15T22:42:43.075712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:52.691529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091993+0000","last_change":"2024-09-15T22:42:43.088934+0000","last_active":"2024-09-15T22:42:43.091993+0000","last_peered":"2024-09-15T22:42:43.091993+0000","last_clean":"2024-09-15T22:42:43.091993+0000","last_became_active":"2024-09-15T22:42:43.088613+0000","last_became_peered":"2024-09-15T22:42:43.088613+0000","last_unstale":"2024-09-15T22:42:43.091993+0000","last_undegraded":"2024-09-15T22:42:43.091993+0000","last_fullsized":"2024-09-15T22:42:43.091993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:12.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089986+0000","last_change":"2024-09-15T22:42:43.087030+0000","last_active":"2024-09-15T22:42:43.089986+0000","last_peered":"2024-09-15T22:42:43.089986+0000","last_clean":"2024-09-15T22:42:43.089986+0000","last_became_active":"2024-09-15T22:42:43.086710+0000","last_became_peered":"2024-09-15T22:42:43.086710+0000","last_unstale":"2024-09-15T22:42:43.089986+0000","last_undegraded":"2024-09-15T22:42:43.089986+0000","last_fullsized":"2024-09-15T22:42:43.089986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:28.960302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075745+0000","last_change":"2024-09-15T22:42:43.071650+0000","last_active":"2024-09-15T22:42:43.075745+0000","last_peered":"2024-09-15T22:42:43.075745+0000","last_clean":"2024-09-15T22:42:43.075745+0000","last_became_active":"2024-09-15T22:42:43.071348+0000","last_became_peered":"2024-09-15T22:42:43.071348+0000","last_unstale":"2024-09-15T22:42:43.075745+0000","last_undegraded":"2024-09-15T22:42:43.075745+0000","last_fullsized":"2024-09-15T22:42:43.075745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:25.483287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091899+0000","last_change":"2024-09-15T22:42:42.068792+0000","last_active":"2024-09-15T22:42:43.091899+0000","last_peered":"2024-09-15T22:42:43.091899+0000","last_clean":"2024-09-15T22:42:43.091899+0000","last_became_active":"2024-09-15T22:42:42.068512+0000","last_became_peered":"2024-09-15T22:42:42.068512+0000","last_unstale":"2024-09-15T22:42:43.091899+0000","last_undegraded":"2024-09-15T22:42:43.091899+0000","last_fullsized":"2024-09-15T22:42:43.091899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:20.873965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.092102+0000","last_change":"2024-09-15T22:42:42.072466+0000","last_active":"2024-09-15T22:42:43.092102+0000","last_peered":"2024-09-15T22:42:43.092102+0000","last_clean":"2024-09-15T22:42:43.092102+0000","last_became_active":"2024-09-15T22:42:42.072206+0000","last_became_peered":"2024-09-15T22:42:42.072206+0000","last_unstale":"2024-09-15T22:42:43.092102+0000","last_undegraded":"2024-09-15T22:42:43.092102+0000","last_fullsized":"2024-09-15T22:42:43.092102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:44.164192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091392+0000","last_change":"2024-09-15T22:42:42.069587+0000","last_active":"2024-09-15T22:42:43.091392+0000","last_peered":"2024-09-15T22:42:43.091392+0000","last_clean":"2024-09-15T22:42:43.091392+0000","last_became_active":"2024-09-15T22:42:42.069207+0000","last_became_peered":"2024-09-15T22:42:42.069207+0000","last_unstale":"2024-09-15T22:42:43.091392+0000","last_undegraded":"2024-09-15T22:42:43.091392+0000","last_fullsized":"2024-09-15T22:42:43.091392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:54.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065759+0000","last_change":"2024-09-15T22:42:42.062757+0000","last_active":"2024-09-15T22:42:43.065759+0000","last_peered":"2024-09-15T22:42:43.065759+0000","last_clean":"2024-09-15T22:42:43.065759+0000","last_became_active":"2024-09-15T22:42:42.062432+0000","last_became_peered":"2024-09-15T22:42:42.062432+0000","last_unstale":"2024-09-15T22:42:43.065759+0000","last_undegraded":"2024-09-15T22:42:43.065759+0000","last_fullsized":"2024-09-15T22:42:43.065759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:49.387947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065540+0000","last_change":"2024-09-15T22:42:42.063551+0000","last_active":"2024-09-15T22:42:43.065540+0000","last_peered":"2024-09-15T22:42:43.065540+0000","last_clean":"2024-09-15T22:42:43.065540+0000","last_became_active":"2024-09-15T22:42:42.063299+0000","last_became_peered":"2024-09-15T22:42:42.063299+0000","last_unstale":"2024-09-15T22:42:43.065540+0000","last_undegraded":"2024-09-15T22:42:43.065540+0000","last_fullsized":"2024-09-15T22:42:43.065540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.076628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089641+0000","last_change":"2024-09-15T22:42:43.079711+0000","last_active":"2024-09-15T22:42:43.089641+0000","last_peered":"2024-09-15T22:42:43.089641+0000","last_clean":"2024-09-15T22:42:43.089641+0000","last_became_active":"2024-09-15T22:42:43.079435+0000","last_became_peered":"2024-09-15T22:42:43.079435+0000","last_unstale":"2024-09-15T22:42:43.089641+0000","last_undegraded":"2024-09-15T22:42:43.089641+0000","last_fullsized":"2024-09-15T22:42:43.089641+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:24.892136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065645+0000","last_change":"2024-09-15T22:42:42.065936+0000","last_active":"2024-09-15T22:42:43.065645+0000","last_peered":"2024-09-15T22:42:43.065645+0000","last_clean":"2024-09-15T22:42:43.065645+0000","last_became_active":"2024-09-15T22:42:42.065495+0000","last_became_peered":"2024-09-15T22:42:42.065495+0000","last_unstale":"2024-09-15T22:42:43.065645+0000","last_undegraded":"2024-09-15T22:42:43.065645+0000","last_fullsized":"2024-09-15T22:42:43.065645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:18.016844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T22:42:39.045983+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:39.045983+0000","last_peered":"2024-09-15T22:42:39.045983+0000","last_clean":"2024-09-15T22:42:39.045983+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:39.045983+0000","last_undegraded":"2024-09-15T22:42:39.045983+0000","last_fullsized":"2024-09-15T22:42:39.045983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":187971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":212581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:46.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:46.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.477+0000 7f5aa0d11640 1 Processor -- start 2024-09-15T22:42:46.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.477+0000 7f5aa0d11640 1 -- start start 2024-09-15T22:42:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5aa0d11640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a9c15ed20 0x7f5a9c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5aa0d11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a9c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5aa0d11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a9c0b7170 con 0x7f5a9c15e940 2024-09-15T22:42:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5aa0d11640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5a9c0b7aa0 con 0x7f5a9c15ed20 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5aa0d11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9c0d3660 con 0x7f5a9c0cef90 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.478+0000 7f5a9a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5a9c15e940 0x7f5a9c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50326/0 (socket says 172.21.15.134:50326) 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9a59c640 1 -- 172.21.15.134:0/1290806921 learned_addr learned my addr 172.21.15.134:0/1290806921 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a9c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a99d9b640 1 --2- 172.21.15.134:0/1290806921 >> v2:172.21.15.177:3300/0 conn(0x7f5a9c15ed20 0x7f5a9c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768351452 0 0) 0x7f5a8c001110 con 0x7f5a9c15e940 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a84003520 con 0x7f5a9c15e940 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203261777 0 0) 0x7f5a84003520 con 0x7f5a9c15e940 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 msgr2=0x7f5a9c0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a9c0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 >> v2:172.21.15.177:3300/0 conn(0x7f5a9c15ed20 msgr2=0x7f5a9c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 --2- 172.21.15.134:0/1290806921 >> v2:172.21.15.177:3300/0 conn(0x7f5a9c15ed20 0x7f5a9c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9c0d3940 con 0x7f5a9c15e940 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5a8c001840 con 0x7f5a9c15e940 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a9c0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 >> v1:172.21.15.134:6789/0 conn(0x7f5a9c15e940 legacy=0x7f5a9c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a840039b0 0x7f5a84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a84004d40 0x7f5a840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c0b7aa0 con 0x7f5a84004d40 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c0d3660 con 0x7f5a840039b0 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8400b9c0 con 0x7f5a9c0cef90 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a84004d40 0x7f5a840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9a59c640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a840039b0 0x7f5a84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a99d9b640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 msgr2=0x7f5a84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a840039b0 msgr2=0x7f5a84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a840039b0 0x7f5a84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1290806921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a84003520 con 0x7f5a84004d40 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a9a59c640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a840039b0 0x7f5a84003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.479+0000 7f5a99d9b640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9c0cef90 0x7f5a84004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.480+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a84004d40 0x7f5a840051c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e350 tx=0x7f5a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1984be4f4dc20d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.480+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94033070 con 0x7f5a84004d40 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.480+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9402f660 con 0x7f5a84004d40 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.480+0000 7f5a9959a640 1 -- 172.21.15.134:0/1290806921 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94009de0 con 0x7f5a84004d40 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1290806921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a84004d40 msgr2=0x7f5a840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1290806921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a84004d40 0x7f5a840051c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e350 tx=0x7f5a84005830 comp rx=0 tx=0).stop 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1290806921 reap_dead start 2024-09-15T22:42:46.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1290806921 shutdown_connections 2024-09-15T22:42:46.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1290806921 >> 172.21.15.134:0/1290806921 conn(0x7f5a9c0b6240 msgr2=0x7f5a9c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1290806921 shutdown_connections 2024-09-15T22:42:46.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.481+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1290806921 wait complete. 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.482+0000 7f5aa0d11640 1 Processor -- start 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.482+0000 7f5aa0d11640 1 -- start start 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a84004d40 0x7f5a9c1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9c0c8260 0x7f5a9c1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c0d3310 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c0d3f00 con 0x7f5a9c0c8260 2024-09-15T22:42:46.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5aa0d11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9c0d1ef0 con 0x7f5a84004d40 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57964/0 (socket says 172.21.15.134:57964) 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1884912077 learned_addr learned my addr 172.21.15.134:0/1884912077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a99d9b640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9c0c8260 0x7f5a9c1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9a59c640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a84004d40 0x7f5a9c1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a84004d40 msgr2=0x7f5a9c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a84004d40 0x7f5a9c1591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9c0c8260 msgr2=0x7f5a9c1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9c0c8260 0x7f5a9c1619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.483+0000 7f5a9ad9d640 1 -- 172.21.15.134:0/1884912077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9c14f420 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5a9ad9d640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e470 tx=0x7f5a94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94033040 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94009a50 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94009de0 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9c0cb290 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.484+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9c1586e0 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.485+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9c068e90 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.485+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f5a94036070 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.486+0000 7f5a8affd640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 0x7f5a7c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.486+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f5a940ac060 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.486+0000 7f5a9a59c640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 0x7f5a7c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.486+0000 7f5a9a59c640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 0x7f5a7c06e920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000ff0 tx=0x7f5a8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.490+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a9c068e90 con 0x7f5a9c0c86e0 2024-09-15T22:42:46.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.651+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a9c15e2a0 con 0x7f5a7c06c460 2024-09-15T22:42:46.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.657+0000 7f5a8affd640 1 -- 172.21.15.134:0/1884912077 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238938 (secure 0 0 0) 0x7f5a9c15e2a0 con 0x7f5a7c06c460 2024-09-15T22:42:46.660 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:46.661 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:46.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 msgr2=0x7f5a7c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 0x7f5a7c06e920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000ff0 tx=0x7f5a8c009040 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 msgr2=0x7f5a9c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e470 tx=0x7f5a94009750 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 shutdown_connections 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5a7c06c460 0x7f5a7c06e920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9c0c86e0 0x7f5a9c0c8fc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9c0c8260 0x7f5a9c1619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 --2- 172.21.15.134:0/1884912077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a84004d40 0x7f5a9c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.659+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 >> 172.21.15.134:0/1884912077 conn(0x7f5a9c0b6240 msgr2=0x7f5a9c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.660+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 shutdown_connections 2024-09-15T22:42:46.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.660+0000 7f5aa0d11640 1 -- 172.21.15.134:0/1884912077 wait complete. 2024-09-15T22:42:46.671 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-15T22:42:44.962872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221308,"kb_used_data":5040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753412,"statfs":{"total":773094113280,"available":772867493888,"internally_reserved":0,"allocated":5160960,"data_stored":2729622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000754"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075712+0000","last_change":"2024-09-15T22:42:43.070946+0000","last_active":"2024-09-15T22:42:43.075712+0000","last_peered":"2024-09-15T22:42:43.075712+0000","last_clean":"2024-09-15T22:42:43.075712+0000","last_became_active":"2024-09-15T22:42:43.070660+0000","last_became_peered":"2024-09-15T22:42:43.070660+0000","last_unstale":"2024-09-15T22:42:43.075712+0000","last_undegraded":"2024-09-15T22:42:43.075712+0000","last_fullsized":"2024-09-15T22:42:43.075712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:52.691529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091993+0000","last_change":"2024-09-15T22:42:43.088934+0000","last_active":"2024-09-15T22:42:43.091993+0000","last_peered":"2024-09-15T22:42:43.091993+0000","last_clean":"2024-09-15T22:42:43.091993+0000","last_became_active":"2024-09-15T22:42:43.088613+0000","last_became_peered":"2024-09-15T22:42:43.088613+0000","last_unstale":"2024-09-15T22:42:43.091993+0000","last_undegraded":"2024-09-15T22:42:43.091993+0000","last_fullsized":"2024-09-15T22:42:43.091993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:12.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089986+0000","last_change":"2024-09-15T22:42:43.087030+0000","last_active":"2024-09-15T22:42:43.089986+0000","last_peered":"2024-09-15T22:42:43.089986+0000","last_clean":"2024-09-15T22:42:43.089986+0000","last_became_active":"2024-09-15T22:42:43.086710+0000","last_became_peered":"2024-09-15T22:42:43.086710+0000","last_unstale":"2024-09-15T22:42:43.089986+0000","last_undegraded":"2024-09-15T22:42:43.089986+0000","last_fullsized":"2024-09-15T22:42:43.089986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:28.960302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075745+0000","last_change":"2024-09-15T22:42:43.071650+0000","last_active":"2024-09-15T22:42:43.075745+0000","last_peered":"2024-09-15T22:42:43.075745+0000","last_clean":"2024-09-15T22:42:43.075745+0000","last_became_active":"2024-09-15T22:42:43.071348+0000","last_became_peered":"2024-09-15T22:42:43.071348+0000","last_unstale":"2024-09-15T22:42:43.075745+0000","last_undegraded":"2024-09-15T22:42:43.075745+0000","last_fullsized":"2024-09-15T22:42:43.075745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:25.483287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091899+0000","last_change":"2024-09-15T22:42:42.068792+0000","last_active":"2024-09-15T22:42:43.091899+0000","last_peered":"2024-09-15T22:42:43.091899+0000","last_clean":"2024-09-15T22:42:43.091899+0000","last_became_active":"2024-09-15T22:42:42.068512+0000","last_became_peered":"2024-09-15T22:42:42.068512+0000","last_unstale":"2024-09-15T22:42:43.091899+0000","last_undegraded":"2024-09-15T22:42:43.091899+0000","last_fullsized":"2024-09-15T22:42:43.091899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:20.873965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.092102+0000","last_change":"2024-09-15T22:42:42.072466+0000","last_active":"2024-09-15T22:42:43.092102+0000","last_peered":"2024-09-15T22:42:43.092102+0000","last_clean":"2024-09-15T22:42:43.092102+0000","last_became_active":"2024-09-15T22:42:42.072206+0000","last_became_peered":"2024-09-15T22:42:42.072206+0000","last_unstale":"2024-09-15T22:42:43.092102+0000","last_undegraded":"2024-09-15T22:42:43.092102+0000","last_fullsized":"2024-09-15T22:42:43.092102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:44.164192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091392+0000","last_change":"2024-09-15T22:42:42.069587+0000","last_active":"2024-09-15T22:42:43.091392+0000","last_peered":"2024-09-15T22:42:43.091392+0000","last_clean":"2024-09-15T22:42:43.091392+0000","last_became_active":"2024-09-15T22:42:42.069207+0000","last_became_peered":"2024-09-15T22:42:42.069207+0000","last_unstale":"2024-09-15T22:42:43.091392+0000","last_undegraded":"2024-09-15T22:42:43.091392+0000","last_fullsized":"2024-09-15T22:42:43.091392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:54.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065759+0000","last_change":"2024-09-15T22:42:42.062757+0000","last_active":"2024-09-15T22:42:43.065759+0000","last_peered":"2024-09-15T22:42:43.065759+0000","last_clean":"2024-09-15T22:42:43.065759+0000","last_became_active":"2024-09-15T22:42:42.062432+0000","last_became_peered":"2024-09-15T22:42:42.062432+0000","last_unstale":"2024-09-15T22:42:43.065759+0000","last_undegraded":"2024-09-15T22:42:43.065759+0000","last_fullsized":"2024-09-15T22:42:43.065759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:49.387947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065540+0000","last_change":"2024-09-15T22:42:42.063551+0000","last_active":"2024-09-15T22:42:43.065540+0000","last_peered":"2024-09-15T22:42:43.065540+0000","last_clean":"2024-09-15T22:42:43.065540+0000","last_became_active":"2024-09-15T22:42:42.063299+0000","last_became_peered":"2024-09-15T22:42:42.063299+0000","last_unstale":"2024-09-15T22:42:43.065540+0000","last_undegraded":"2024-09-15T22:42:43.065540+0000","last_fullsized":"2024-09-15T22:42:43.065540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.076628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089641+0000","last_change":"2024-09-15T22:42:43.079711+0000","last_active":"2024-09-15T22:42:43.089641+0000","last_peered":"2024-09-15T22:42:43.089641+0000","last_clean":"2024-09-15T22:42:43.089641+0000","last_became_active":"2024-09-15T22:42:43.079435+0000","last_became_peered":"2024-09-15T22:42:43.079435+0000","last_unstale":"2024-09-15T22:42:43.089641+0000","last_undegraded":"2024-09-15T22:42:43.089641+0000","last_fullsized":"2024-09-15T22:42:43.089641+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:24.892136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065645+0000","last_change":"2024-09-15T22:42:42.065936+0000","last_active":"2024-09-15T22:42:43.065645+0000","last_peered":"2024-09-15T22:42:43.065645+0000","last_clean":"2024-09-15T22:42:43.065645+0000","last_became_active":"2024-09-15T22:42:42.065495+0000","last_became_peered":"2024-09-15T22:42:42.065495+0000","last_unstale":"2024-09-15T22:42:43.065645+0000","last_undegraded":"2024-09-15T22:42:43.065645+0000","last_fullsized":"2024-09-15T22:42:43.065645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:18.016844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:42.047934+0000","last_change":"2024-09-15T22:42:42.047934+0000","last_active":"2024-09-15T22:42:42.047934+0000","last_peered":"2024-09-15T22:42:42.047934+0000","last_clean":"2024-09-15T22:42:42.047934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:42.047934+0000","last_undegraded":"2024-09-15T22:42:42.047934+0000","last_fullsized":"2024-09-15T22:42:42.047934+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:42:41.043815+0000","last_change":"2024-09-15T22:42:41.043815+0000","last_active":"2024-09-15T22:42:41.043815+0000","last_peered":"2024-09-15T22:42:41.043815+0000","last_clean":"2024-09-15T22:42:41.043815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:42:41.043815+0000","last_undegraded":"2024-09-15T22:42:41.043815+0000","last_fullsized":"2024-09-15T22:42:41.043815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T22:42:39.045983+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:39.045983+0000","last_peered":"2024-09-15T22:42:39.045983+0000","last_clean":"2024-09-15T22:42:39.045983+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:39.045983+0000","last_undegraded":"2024-09-15T22:42:39.045983+0000","last_fullsized":"2024-09-15T22:42:39.045983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":187971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":778339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":193098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":212581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-15T22:42:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-15T22:42:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-15T22:42:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-15T22:42:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-15T22:42:46.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-15T22:42:46.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-15T22:42:46.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-15T22:42:46.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-15T22:42:46.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-15T22:42:46.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:42.047934+0000', 'last_change': '2024-09-15T22:42:42.047934+0000', 'last_active': '2024-09-15T22:42:42.047934+0000', 'last_peered': '2024-09-15T22:42:42.047934+0000', 'last_clean': '2024-09-15T22:42:42.047934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:42.047934+0000', 'last_undegraded': '2024-09-15T22:42:42.047934+0000', 'last_fullsized': '2024-09-15T22:42:42.047934+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:42.047934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-15T22:42:46.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:42:41.043815+0000', 'last_change': '2024-09-15T22:42:41.043815+0000', 'last_active': '2024-09-15T22:42:41.043815+0000', 'last_peered': '2024-09-15T22:42:41.043815+0000', 'last_clean': '2024-09-15T22:42:41.043815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:42:41.043815+0000', 'last_undegraded': '2024-09-15T22:42:41.043815+0000', 'last_fullsized': '2024-09-15T22:42:41.043815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'last_clean_scrub_stamp': '2024-09-15T22:42:41.043815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:42:46.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:42:46.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.808+0000 7fb2a5a23640 1 Processor -- start 2024-09-15T22:42:46.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.808+0000 7fb2a5a23640 1 -- start start 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb2a5a23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb2a5a23640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a015d390 con 0x7fb2a015ce80 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb2a5a23640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a015d670 con 0x7fb2a00d02a0 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb2a5a23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a015d950 con 0x7fb2a015ca40 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb29f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb2a015ce80 0x7fb2a01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50340/0 (socket says 172.21.15.134:50340) 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb29f7fe640 1 -- 172.21.15.134:0/914698346 learned_addr learned my addr 172.21.15.134:0/914698346 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb2967fc640 1 --2- 172.21.15.134:0/914698346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127652506 0 0) 0x7fb2a015d390 con 0x7fb2a015ce80 2024-09-15T22:42:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.809+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb28c003520 con 0x7fb2a015ce80 2024-09-15T22:42:46.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.810+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3719416892 0 0) 0x7fb28c003520 con 0x7fb2a015ce80 2024-09-15T22:42:46.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.810+0000 7fb2967fc640 1 -- 172.21.15.134:0/914698346 >> v1:172.21.15.177:6789/0 conn(0x7fb2a00d02a0 legacy=0x7fb2a00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.810+0000 7fb2967fc640 1 -- 172.21.15.134:0/914698346 >> v1:172.21.15.134:6789/0 conn(0x7fb2a015ce80 legacy=0x7fb2a01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.810+0000 7fb2967fc640 1 -- 172.21.15.134:0/914698346 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a015dc30 con 0x7fb2a015ca40 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.810+0000 7fb2967fc640 1 --2- 172.21.15.134:0/914698346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a015e430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2880097d0 tx=0x7fb28802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca1d8f0b8d050e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288037070 con 0x7fb2a015ca40 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28802ab90 con 0x7fb2a015ca40 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb29e7fc640 1 -- 172.21.15.134:0/914698346 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980019f0 con 0x7fb2a015ca40 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 -- 172.21.15.134:0/914698346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 msgr2=0x7fb2a015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/914698346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a015e430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2880097d0 tx=0x7fb28802a100 comp rx=0 tx=0).stop 2024-09-15T22:42:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 -- 172.21.15.134:0/914698346 shutdown_connections 2024-09-15T22:42:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/914698346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a015e430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 -- 172.21.15.134:0/914698346 >> 172.21.15.134:0/914698346 conn(0x7fb2a0062cc0 msgr2=0x7fb2a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 -- 172.21.15.134:0/914698346 shutdown_connections 2024-09-15T22:42:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.811+0000 7fb2a5a23640 1 -- 172.21.15.134:0/914698346 wait complete. 2024-09-15T22:42:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.812+0000 7fb2a5a23640 1 Processor -- start 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 -- start start 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 0x7fb2a0150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0155d10 con 0x7fb2a015ce80 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0155b90 con 0x7fb2a00d02a0 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb2a5a23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a00b4790 con 0x7fb2a015ca40 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb29f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb29f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57972/0 (socket says 172.21.15.134:57972) 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.813+0000 7fb29f7fe640 1 -- 172.21.15.134:0/2577118512 learned_addr learned my addr 172.21.15.134:0/2577118512 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb2967fc640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29effd640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 0x7fb2a0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 -- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 msgr2=0x7fb2a014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 -- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 msgr2=0x7fb2a0150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 0x7fb2a0150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 -- 172.21.15.134:0/2577118512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a00737c0 con 0x7fb2a015ce80 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb2967fc640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29effd640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 0x7fb2a0150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29f7fe640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb29800cc00 tx=0x7fb29800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298017070 con 0x7fb2a015ce80 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29800ce10 con 0x7fb2a015ce80 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298012600 con 0x7fb2a015ce80 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a0073a60 con 0x7fb2a015ce80 2024-09-15T22:42:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.814+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a0151c60 con 0x7fb2a015ce80 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.815+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a00d0680 con 0x7fb2a015ce80 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.816+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fb29801a070 con 0x7fb2a015ce80 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.816+0000 7fb29cff9640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 0x7fb28006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.816+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fb29808b550 con 0x7fb2a015ce80 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.816+0000 7fb29effd640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 0x7fb28006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.816+0000 7fb29effd640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 0x7fb28006e920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb290007fd0 tx=0x7fb290009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:46.820+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2980593f0 con 0x7fb2a015ce80 2024-09-15T22:42:47.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.047+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb2a0154fe0 con 0x7fb2a015ce80 2024-09-15T22:42:47.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.048+0000 7fb29cff9640 1 -- 172.21.15.134:0/2577118512 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1677 (secure 0 0 0) 0x7fb29805d6f0 con 0x7fb2a015ce80 2024-09-15T22:42:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:47.050 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":85},{"state_name":"active+clean","count":12}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590950,"bytes_used":226619392,"bytes_avail":772867493888,"bytes_total":773094113280,"unknown_pgs_ratio":0.87628865242004395,"write_bytes_sec":255,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":21,"btime":"2024-09-15T22:42:45:077538+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5283}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T22:42:16.957553+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 msgr2=0x7fb28006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 0x7fb28006e920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb290007fd0 tx=0x7fb290009040 comp rx=0 tx=0).stop 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 msgr2=0x7fb2a0073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb29800cc00 tx=0x7fb29800a430 comp rx=0 tx=0).stop 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 shutdown_connections 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb28006c460 0x7fb28006e920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a015ce80 0x7fb2a0073280 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2a015ca40 0x7fb2a014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 --2- 172.21.15.134:0/2577118512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2a00d02a0 0x7fb2a0150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 >> 172.21.15.134:0/2577118512 conn(0x7fb2a0062cc0 msgr2=0x7fb2a00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:47.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 shutdown_connections 2024-09-15T22:42:47.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.050+0000 7fb2a5a23640 1 -- 172.21.15.134:0/2577118512 wait complete. 2024-09-15T22:42:47.063 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:42:47.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:47.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.171+0000 7fdb13237640 1 Processor -- start 2024-09-15T22:42:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.171+0000 7fdb13237640 1 -- start start 2024-09-15T22:42:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb13237640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdb0c15c3b0 0x7fdb0c073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb13237640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdb0c0d1ee0 0x7fdb0c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb13237640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0c160420 con 0x7fdb0c073b90 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb13237640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0c161030 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb13237640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0c0d0450 con 0x7fdb0c15c3b0 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdb0c0d1ee0 0x7fdb0c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdb0c0d1ee0 0x7fdb0c073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57986/0 (socket says 172.21.15.134:57986) 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 -- 172.21.15.134:0/628716435 learned_addr learned my addr 172.21.15.134:0/628716435 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb10fd3640 1 --2- 172.21.15.134:0/628716435 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c15c3b0 0x7fdb0c073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 -- 172.21.15.134:0/628716435 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c15c3b0 msgr2=0x7fdb0c073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 --2- 172.21.15.134:0/628716435 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c15c3b0 0x7fdb0c073110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 -- 172.21.15.134:0/628716435 >> v1:172.21.15.177:6789/0 conn(0x7fdb0c073b90 legacy=0x7fdb0c070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.172+0000 7fdb03fff640 1 -- 172.21.15.134:0/628716435 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c160700 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb03fff640 1 --2- 172.21.15.134:0/628716435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c0d1ee0 0x7fdb0c073650 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06c780 tx=0x7fdafc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943f1bdea5834d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb037fe640 1 -- 172.21.15.134:0/628716435 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037070 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb037fe640 1 -- 172.21.15.134:0/628716435 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc032440 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb037fe640 1 -- 172.21.15.134:0/628716435 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc032810 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb13237640 1 -- 172.21.15.134:0/628716435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c0d1ee0 msgr2=0x7fdb0c073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.173+0000 7fdb13237640 1 --2- 172.21.15.134:0/628716435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c0d1ee0 0x7fdb0c073650 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06c780 tx=0x7fdafc02a230 comp rx=0 tx=0).stop 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 -- 172.21.15.134:0/628716435 shutdown_connections 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 --2- 172.21.15.134:0/628716435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c0d1ee0 0x7fdb0c073650 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 --2- 172.21.15.134:0/628716435 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c15c3b0 0x7fdb0c073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 -- 172.21.15.134:0/628716435 >> 172.21.15.134:0/628716435 conn(0x7fdb0c0b4300 msgr2=0x7fdb0c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:47.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 -- 172.21.15.134:0/628716435 shutdown_connections 2024-09-15T22:42:47.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.174+0000 7fdb13237640 1 -- 172.21.15.134:0/628716435 wait complete. 2024-09-15T22:42:47.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.175+0000 7fdb13237640 1 Processor -- start 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.175+0000 7fdb13237640 1 -- start start 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0d1ee0 0x7fdb0c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 0x7fdb0c0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c160060 con 0x7fdb0c073b90 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c160cc0 con 0x7fdb0c15c3b0 2024-09-15T22:42:47.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c1601e0 con 0x7fdb0c0d1ee0 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57994/0 (socket says 172.21.15.134:57994) 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 -- 172.21.15.134:0/4136648417 learned_addr learned my addr 172.21.15.134:0/4136648417 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb117d4640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 0x7fdb0c0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb03fff640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0d1ee0 0x7fdb0c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 -- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0d1ee0 msgr2=0x7fdb0c0b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0d1ee0 0x7fdb0c0b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 -- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 msgr2=0x7fdb0c0b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 0x7fdb0c0b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 -- 172.21.15.134:0/4136648417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c146500 con 0x7fdb0c073b90 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb117d4640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 0x7fdb0c0b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb10fd3640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c820 tx=0x7fdb0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08015070 con 0x7fdb0c073b90 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb08004020 con 0x7fdb0c073b90 2024-09-15T22:42:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c15e610 con 0x7fdb0c073b90 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb080043f0 con 0x7fdb0c073b90 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.176+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c15ebd0 con 0x7fdb0c073b90 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.177+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c0ceb30 con 0x7fdb0c073b90 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.178+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fdb08007830 con 0x7fdb0c073b90 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.178+0000 7fdb017fa640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 0x7fdaf806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.178+0000 7fdb03fff640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 0x7fdaf806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:47.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.178+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fdb0808b720 con 0x7fdb0c073b90 2024-09-15T22:42:47.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.179+0000 7fdb03fff640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 0x7fdaf806e920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdafc034000 tx=0x7fdafc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:47.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.183+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb08059a70 con 0x7fdb0c073b90 2024-09-15T22:42:47.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.344+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb0c0cf1f0 con 0x7fdaf806c460 2024-09-15T22:42:47.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.350+0000 7fdb017fa640 1 -- 172.21.15.134:0/4136648417 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7fdafc07f850 con 0x7fdaf806c460 2024-09-15T22:42:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:47.359 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 msgr2=0x7fdaf806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 0x7fdaf806e920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdafc034000 tx=0x7fdafc02e000 comp rx=0 tx=0).stop 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 msgr2=0x7fdb0c145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c820 tx=0x7fdb0800cce0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 shutdown_connections 2024-09-15T22:42:47.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdaf806c460 0x7fdaf806e920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c15c3b0 0x7fdb0c0b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0d1ee0 0x7fdb0c0b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 --2- 172.21.15.134:0/4136648417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb0c073b90 0x7fdb0c145fc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 >> 172.21.15.134:0/4136648417 conn(0x7fdb0c0b4300 msgr2=0x7fdb0c158800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 shutdown_connections 2024-09-15T22:42:47.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:47.354+0000 7fdb13237640 1 -- 172.21.15.134:0/4136648417 wait complete. 2024-09-15T22:42:47.367 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-15T22:42:46.963398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221732,"kb_used_data":5468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752988,"statfs":{"total":773094113280,"available":772867059712,"internally_reserved":0,"allocated":5599232,"data_stored":2925376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.915005"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255149+0000","last_change":"2024-09-15T22:42:43.080936+0000","last_active":"2024-09-15T22:42:44.255149+0000","last_peered":"2024-09-15T22:42:44.255149+0000","last_clean":"2024-09-15T22:42:44.255149+0000","last_became_active":"2024-09-15T22:42:43.080669+0000","last_became_peered":"2024-09-15T22:42:43.080669+0000","last_unstale":"2024-09-15T22:42:44.255149+0000","last_undegraded":"2024-09-15T22:42:44.255149+0000","last_fullsized":"2024-09-15T22:42:44.255149+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:52.075951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254707+0000","last_change":"2024-09-15T22:42:43.093275+0000","last_active":"2024-09-15T22:42:44.254707+0000","last_peered":"2024-09-15T22:42:44.254707+0000","last_clean":"2024-09-15T22:42:44.254707+0000","last_became_active":"2024-09-15T22:42:43.092789+0000","last_became_peered":"2024-09-15T22:42:43.092789+0000","last_unstale":"2024-09-15T22:42:44.254707+0000","last_undegraded":"2024-09-15T22:42:44.254707+0000","last_fullsized":"2024-09-15T22:42:44.254707+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:50.870808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255654+0000","last_change":"2024-09-15T22:42:43.089611+0000","last_active":"2024-09-15T22:42:44.255654+0000","last_peered":"2024-09-15T22:42:44.255654+0000","last_clean":"2024-09-15T22:42:44.255654+0000","last_became_active":"2024-09-15T22:42:43.089106+0000","last_became_peered":"2024-09-15T22:42:43.089106+0000","last_unstale":"2024-09-15T22:42:44.255654+0000","last_undegraded":"2024-09-15T22:42:44.255654+0000","last_fullsized":"2024-09-15T22:42:44.255654+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.434965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257710+0000","last_change":"2024-09-15T22:42:43.089329+0000","last_active":"2024-09-15T22:42:44.257710+0000","last_peered":"2024-09-15T22:42:44.257710+0000","last_clean":"2024-09-15T22:42:44.257710+0000","last_became_active":"2024-09-15T22:42:43.088945+0000","last_became_peered":"2024-09-15T22:42:43.088945+0000","last_unstale":"2024-09-15T22:42:44.257710+0000","last_undegraded":"2024-09-15T22:42:44.257710+0000","last_fullsized":"2024-09-15T22:42:44.257710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:05.795762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255044+0000","last_change":"2024-09-15T22:42:43.078396+0000","last_active":"2024-09-15T22:42:44.255044+0000","last_peered":"2024-09-15T22:42:44.255044+0000","last_clean":"2024-09-15T22:42:44.255044+0000","last_became_active":"2024-09-15T22:42:43.077813+0000","last_became_peered":"2024-09-15T22:42:43.077813+0000","last_unstale":"2024-09-15T22:42:44.255044+0000","last_undegraded":"2024-09-15T22:42:44.255044+0000","last_fullsized":"2024-09-15T22:42:44.255044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075712+0000","last_change":"2024-09-15T22:42:43.070946+0000","last_active":"2024-09-15T22:42:43.075712+0000","last_peered":"2024-09-15T22:42:43.075712+0000","last_clean":"2024-09-15T22:42:43.075712+0000","last_became_active":"2024-09-15T22:42:43.070660+0000","last_became_peered":"2024-09-15T22:42:43.070660+0000","last_unstale":"2024-09-15T22:42:43.075712+0000","last_undegraded":"2024-09-15T22:42:43.075712+0000","last_fullsized":"2024-09-15T22:42:43.075712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:52.691529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083278+0000","last_change":"2024-09-15T22:42:43.085721+0000","last_active":"2024-09-15T22:42:44.083278+0000","last_peered":"2024-09-15T22:42:44.083278+0000","last_clean":"2024-09-15T22:42:44.083278+0000","last_became_active":"2024-09-15T22:42:43.085353+0000","last_became_peered":"2024-09-15T22:42:43.085353+0000","last_unstale":"2024-09-15T22:42:44.083278+0000","last_undegraded":"2024-09-15T22:42:44.083278+0000","last_fullsized":"2024-09-15T22:42:44.083278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:10.759280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.256918+0000","last_change":"2024-09-15T22:42:43.077884+0000","last_active":"2024-09-15T22:42:44.256918+0000","last_peered":"2024-09-15T22:42:44.256918+0000","last_clean":"2024-09-15T22:42:44.256918+0000","last_became_active":"2024-09-15T22:42:43.077010+0000","last_became_peered":"2024-09-15T22:42:43.077010+0000","last_unstale":"2024-09-15T22:42:44.256918+0000","last_undegraded":"2024-09-15T22:42:44.256918+0000","last_fullsized":"2024-09-15T22:42:44.256918+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091993+0000","last_change":"2024-09-15T22:42:43.088934+0000","last_active":"2024-09-15T22:42:43.091993+0000","last_peered":"2024-09-15T22:42:43.091993+0000","last_clean":"2024-09-15T22:42:43.091993+0000","last_became_active":"2024-09-15T22:42:43.088613+0000","last_became_peered":"2024-09-15T22:42:43.088613+0000","last_unstale":"2024-09-15T22:42:43.091993+0000","last_undegraded":"2024-09-15T22:42:43.091993+0000","last_fullsized":"2024-09-15T22:42:43.091993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:12.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084934+0000","last_change":"2024-09-15T22:42:43.092600+0000","last_active":"2024-09-15T22:42:44.084934+0000","last_peered":"2024-09-15T22:42:44.084934+0000","last_clean":"2024-09-15T22:42:44.084934+0000","last_became_active":"2024-09-15T22:42:43.092237+0000","last_became_peered":"2024-09-15T22:42:43.092237+0000","last_unstale":"2024-09-15T22:42:44.084934+0000","last_undegraded":"2024-09-15T22:42:44.084934+0000","last_fullsized":"2024-09-15T22:42:44.084934+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.822681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257920+0000","last_change":"2024-09-15T22:42:43.077120+0000","last_active":"2024-09-15T22:42:44.257920+0000","last_peered":"2024-09-15T22:42:44.257920+0000","last_clean":"2024-09-15T22:42:44.257920+0000","last_became_active":"2024-09-15T22:42:43.076820+0000","last_became_peered":"2024-09-15T22:42:43.076820+0000","last_unstale":"2024-09-15T22:42:44.257920+0000","last_undegraded":"2024-09-15T22:42:44.257920+0000","last_fullsized":"2024-09-15T22:42:44.257920+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:50.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254660+0000","last_change":"2024-09-15T22:42:43.080211+0000","last_active":"2024-09-15T22:42:44.254660+0000","last_peered":"2024-09-15T22:42:44.254660+0000","last_clean":"2024-09-15T22:42:44.254660+0000","last_became_active":"2024-09-15T22:42:43.079934+0000","last_became_peered":"2024-09-15T22:42:43.079934+0000","last_unstale":"2024-09-15T22:42:44.254660+0000","last_undegraded":"2024-09-15T22:42:44.254660+0000","last_fullsized":"2024-09-15T22:42:44.254660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:17.475271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089986+0000","last_change":"2024-09-15T22:42:43.087030+0000","last_active":"2024-09-15T22:42:43.089986+0000","last_peered":"2024-09-15T22:42:43.089986+0000","last_clean":"2024-09-15T22:42:43.089986+0000","last_became_active":"2024-09-15T22:42:43.086710+0000","last_became_peered":"2024-09-15T22:42:43.086710+0000","last_unstale":"2024-09-15T22:42:43.089986+0000","last_undegraded":"2024-09-15T22:42:43.089986+0000","last_fullsized":"2024-09-15T22:42:43.089986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:28.960302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257538+0000","last_change":"2024-09-15T22:42:43.087774+0000","last_active":"2024-09-15T22:42:44.257538+0000","last_peered":"2024-09-15T22:42:44.257538+0000","last_clean":"2024-09-15T22:42:44.257538+0000","last_became_active":"2024-09-15T22:42:43.087470+0000","last_became_peered":"2024-09-15T22:42:43.087470+0000","last_unstale":"2024-09-15T22:42:44.257538+0000","last_undegraded":"2024-09-15T22:42:44.257538+0000","last_fullsized":"2024-09-15T22:42:44.257538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:14.365396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257223+0000","last_change":"2024-09-15T22:42:43.081284+0000","last_active":"2024-09-15T22:42:44.257223+0000","last_peered":"2024-09-15T22:42:44.257223+0000","last_clean":"2024-09-15T22:42:44.257223+0000","last_became_active":"2024-09-15T22:42:43.080785+0000","last_became_peered":"2024-09-15T22:42:43.080785+0000","last_unstale":"2024-09-15T22:42:44.257223+0000","last_undegraded":"2024-09-15T22:42:44.257223+0000","last_fullsized":"2024-09-15T22:42:44.257223+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254381+0000","last_change":"2024-09-15T22:42:43.076638+0000","last_active":"2024-09-15T22:42:44.254381+0000","last_peered":"2024-09-15T22:42:44.254381+0000","last_clean":"2024-09-15T22:42:44.254381+0000","last_became_active":"2024-09-15T22:42:43.076332+0000","last_became_peered":"2024-09-15T22:42:43.076332+0000","last_unstale":"2024-09-15T22:42:44.254381+0000","last_undegraded":"2024-09-15T22:42:44.254381+0000","last_fullsized":"2024-09-15T22:42:44.254381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:50.870808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254978+0000","last_change":"2024-09-15T22:42:43.077291+0000","last_active":"2024-09-15T22:42:44.254978+0000","last_peered":"2024-09-15T22:42:44.254978+0000","last_clean":"2024-09-15T22:42:44.254978+0000","last_became_active":"2024-09-15T22:42:43.076792+0000","last_became_peered":"2024-09-15T22:42:43.076792+0000","last_unstale":"2024-09-15T22:42:44.254978+0000","last_undegraded":"2024-09-15T22:42:44.254978+0000","last_fullsized":"2024-09-15T22:42:44.254978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255729+0000","last_change":"2024-09-15T22:42:43.075562+0000","last_active":"2024-09-15T22:42:44.255729+0000","last_peered":"2024-09-15T22:42:44.255729+0000","last_clean":"2024-09-15T22:42:44.255729+0000","last_became_active":"2024-09-15T22:42:43.075268+0000","last_became_peered":"2024-09-15T22:42:43.075268+0000","last_unstale":"2024-09-15T22:42:44.255729+0000","last_undegraded":"2024-09-15T22:42:44.255729+0000","last_fullsized":"2024-09-15T22:42:44.255729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:42.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254925+0000","last_change":"2024-09-15T22:42:43.077053+0000","last_active":"2024-09-15T22:42:44.254925+0000","last_peered":"2024-09-15T22:42:44.254925+0000","last_clean":"2024-09-15T22:42:44.254925+0000","last_became_active":"2024-09-15T22:42:43.076388+0000","last_became_peered":"2024-09-15T22:42:43.076388+0000","last_unstale":"2024-09-15T22:42:44.254925+0000","last_undegraded":"2024-09-15T22:42:44.254925+0000","last_fullsized":"2024-09-15T22:42:44.254925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084611+0000","last_change":"2024-09-15T22:42:43.094379+0000","last_active":"2024-09-15T22:42:44.084611+0000","last_peered":"2024-09-15T22:42:44.084611+0000","last_clean":"2024-09-15T22:42:44.084611+0000","last_became_active":"2024-09-15T22:42:43.093989+0000","last_became_peered":"2024-09-15T22:42:43.093989+0000","last_unstale":"2024-09-15T22:42:44.084611+0000","last_undegraded":"2024-09-15T22:42:44.084611+0000","last_fullsized":"2024-09-15T22:42:44.084611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:07.773123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257661+0000","last_change":"2024-09-15T22:42:43.083726+0000","last_active":"2024-09-15T22:42:44.257661+0000","last_peered":"2024-09-15T22:42:44.257661+0000","last_clean":"2024-09-15T22:42:44.257661+0000","last_became_active":"2024-09-15T22:42:43.083446+0000","last_became_peered":"2024-09-15T22:42:43.083446+0000","last_unstale":"2024-09-15T22:42:44.257661+0000","last_undegraded":"2024-09-15T22:42:44.257661+0000","last_fullsized":"2024-09-15T22:42:44.257661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.872170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085107+0000","last_change":"2024-09-15T22:42:43.073930+0000","last_active":"2024-09-15T22:42:44.085107+0000","last_peered":"2024-09-15T22:42:44.085107+0000","last_clean":"2024-09-15T22:42:44.085107+0000","last_became_active":"2024-09-15T22:42:43.073647+0000","last_became_peered":"2024-09-15T22:42:43.073647+0000","last_unstale":"2024-09-15T22:42:44.085107+0000","last_undegraded":"2024-09-15T22:42:44.085107+0000","last_fullsized":"2024-09-15T22:42:44.085107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:42.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083571+0000","last_change":"2024-09-15T22:42:43.072740+0000","last_active":"2024-09-15T22:42:44.083571+0000","last_peered":"2024-09-15T22:42:44.083571+0000","last_clean":"2024-09-15T22:42:44.083571+0000","last_became_active":"2024-09-15T22:42:43.072420+0000","last_became_peered":"2024-09-15T22:42:43.072420+0000","last_unstale":"2024-09-15T22:42:44.083571+0000","last_undegraded":"2024-09-15T22:42:44.083571+0000","last_fullsized":"2024-09-15T22:42:44.083571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:12.995012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254321+0000","last_change":"2024-09-15T22:42:43.086588+0000","last_active":"2024-09-15T22:42:44.254321+0000","last_peered":"2024-09-15T22:42:44.254321+0000","last_clean":"2024-09-15T22:42:44.254321+0000","last_became_active":"2024-09-15T22:42:43.086132+0000","last_became_peered":"2024-09-15T22:42:43.086132+0000","last_unstale":"2024-09-15T22:42:44.254321+0000","last_undegraded":"2024-09-15T22:42:44.254321+0000","last_fullsized":"2024-09-15T22:42:44.254321+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:13.118400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255158+0000","last_change":"2024-09-15T22:42:43.079813+0000","last_active":"2024-09-15T22:42:44.255158+0000","last_peered":"2024-09-15T22:42:44.255158+0000","last_clean":"2024-09-15T22:42:44.255158+0000","last_became_active":"2024-09-15T22:42:43.079233+0000","last_became_peered":"2024-09-15T22:42:43.079233+0000","last_unstale":"2024-09-15T22:42:44.255158+0000","last_undegraded":"2024-09-15T22:42:44.255158+0000","last_fullsized":"2024-09-15T22:42:44.255158+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:14.365396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257935+0000","last_change":"2024-09-15T22:42:43.082902+0000","last_active":"2024-09-15T22:42:44.257935+0000","last_peered":"2024-09-15T22:42:44.257935+0000","last_clean":"2024-09-15T22:42:44.257935+0000","last_became_active":"2024-09-15T22:42:43.082581+0000","last_became_peered":"2024-09-15T22:42:43.082581+0000","last_unstale":"2024-09-15T22:42:44.257935+0000","last_undegraded":"2024-09-15T22:42:44.257935+0000","last_fullsized":"2024-09-15T22:42:44.257935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:06.205872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083401+0000","last_change":"2024-09-15T22:42:43.076167+0000","last_active":"2024-09-15T22:42:44.083401+0000","last_peered":"2024-09-15T22:42:44.083401+0000","last_clean":"2024-09-15T22:42:44.083401+0000","last_became_active":"2024-09-15T22:42:43.075921+0000","last_became_peered":"2024-09-15T22:42:43.075921+0000","last_unstale":"2024-09-15T22:42:44.083401+0000","last_undegraded":"2024-09-15T22:42:44.083401+0000","last_fullsized":"2024-09-15T22:42:44.083401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:47.198030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083329+0000","last_change":"2024-09-15T22:42:43.077175+0000","last_active":"2024-09-15T22:42:44.083329+0000","last_peered":"2024-09-15T22:42:44.083329+0000","last_clean":"2024-09-15T22:42:44.083329+0000","last_became_active":"2024-09-15T22:42:43.076911+0000","last_became_peered":"2024-09-15T22:42:43.076911+0000","last_unstale":"2024-09-15T22:42:44.083329+0000","last_undegraded":"2024-09-15T22:42:44.083329+0000","last_fullsized":"2024-09-15T22:42:44.083329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:16.127564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255130+0000","last_change":"2024-09-15T22:42:43.087180+0000","last_active":"2024-09-15T22:42:44.255130+0000","last_peered":"2024-09-15T22:42:44.255130+0000","last_clean":"2024-09-15T22:42:44.255130+0000","last_became_active":"2024-09-15T22:42:43.086833+0000","last_became_peered":"2024-09-15T22:42:43.086833+0000","last_unstale":"2024-09-15T22:42:44.255130+0000","last_undegraded":"2024-09-15T22:42:44.255130+0000","last_fullsized":"2024-09-15T22:42:44.255130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254349+0000","last_change":"2024-09-15T22:42:43.075816+0000","last_active":"2024-09-15T22:42:44.254349+0000","last_peered":"2024-09-15T22:42:44.254349+0000","last_clean":"2024-09-15T22:42:44.254349+0000","last_became_active":"2024-09-15T22:42:43.075474+0000","last_became_peered":"2024-09-15T22:42:43.075474+0000","last_unstale":"2024-09-15T22:42:44.254349+0000","last_undegraded":"2024-09-15T22:42:44.254349+0000","last_fullsized":"2024-09-15T22:42:44.254349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:41.204167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075745+0000","last_change":"2024-09-15T22:42:43.071650+0000","last_active":"2024-09-15T22:42:43.075745+0000","last_peered":"2024-09-15T22:42:43.075745+0000","last_clean":"2024-09-15T22:42:43.075745+0000","last_became_active":"2024-09-15T22:42:43.071348+0000","last_became_peered":"2024-09-15T22:42:43.071348+0000","last_unstale":"2024-09-15T22:42:43.075745+0000","last_undegraded":"2024-09-15T22:42:43.075745+0000","last_fullsized":"2024-09-15T22:42:43.075745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:25.483287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257195+0000","last_change":"2024-09-15T22:42:43.077308+0000","last_active":"2024-09-15T22:42:44.257195+0000","last_peered":"2024-09-15T22:42:44.257195+0000","last_clean":"2024-09-15T22:42:44.257195+0000","last_became_active":"2024-09-15T22:42:43.075436+0000","last_became_peered":"2024-09-15T22:42:43.075436+0000","last_unstale":"2024-09-15T22:42:44.257195+0000","last_undegraded":"2024-09-15T22:42:44.257195+0000","last_fullsized":"2024-09-15T22:42:44.257195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085272+0000","last_change":"2024-09-15T22:42:43.093467+0000","last_active":"2024-09-15T22:42:44.085272+0000","last_peered":"2024-09-15T22:42:44.085272+0000","last_clean":"2024-09-15T22:42:44.085272+0000","last_became_active":"2024-09-15T22:42:43.093189+0000","last_became_peered":"2024-09-15T22:42:43.093189+0000","last_unstale":"2024-09-15T22:42:44.085272+0000","last_undegraded":"2024-09-15T22:42:44.085272+0000","last_fullsized":"2024-09-15T22:42:44.085272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:38.170032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091899+0000","last_change":"2024-09-15T22:42:42.068792+0000","last_active":"2024-09-15T22:42:43.091899+0000","last_peered":"2024-09-15T22:42:43.091899+0000","last_clean":"2024-09-15T22:42:43.091899+0000","last_became_active":"2024-09-15T22:42:42.068512+0000","last_became_peered":"2024-09-15T22:42:42.068512+0000","last_unstale":"2024-09-15T22:42:43.091899+0000","last_undegraded":"2024-09-15T22:42:43.091899+0000","last_fullsized":"2024-09-15T22:42:43.091899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:20.873965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255289+0000","last_change":"2024-09-15T22:42:43.077709+0000","last_active":"2024-09-15T22:42:44.255289+0000","last_peered":"2024-09-15T22:42:44.255289+0000","last_clean":"2024-09-15T22:42:44.255289+0000","last_became_active":"2024-09-15T22:42:43.076961+0000","last_became_peered":"2024-09-15T22:42:43.076961+0000","last_unstale":"2024-09-15T22:42:44.255289+0000","last_undegraded":"2024-09-15T22:42:44.255289+0000","last_fullsized":"2024-09-15T22:42:44.255289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:31.420019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083489+0000","last_change":"2024-09-15T22:42:42.068956+0000","last_active":"2024-09-15T22:42:44.083489+0000","last_peered":"2024-09-15T22:42:44.083489+0000","last_clean":"2024-09-15T22:42:44.083489+0000","last_became_active":"2024-09-15T22:42:42.068666+0000","last_became_peered":"2024-09-15T22:42:42.068666+0000","last_unstale":"2024-09-15T22:42:44.083489+0000","last_undegraded":"2024-09-15T22:42:44.083489+0000","last_fullsized":"2024-09-15T22:42:44.083489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:19.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254799+0000","last_change":"2024-09-15T22:42:43.095142+0000","last_active":"2024-09-15T22:42:44.254799+0000","last_peered":"2024-09-15T22:42:44.254799+0000","last_clean":"2024-09-15T22:42:44.254799+0000","last_became_active":"2024-09-15T22:42:43.094841+0000","last_became_peered":"2024-09-15T22:42:43.094841+0000","last_unstale":"2024-09-15T22:42:44.254799+0000","last_undegraded":"2024-09-15T22:42:44.254799+0000","last_fullsized":"2024-09-15T22:42:44.254799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.092102+0000","last_change":"2024-09-15T22:42:42.072466+0000","last_active":"2024-09-15T22:42:43.092102+0000","last_peered":"2024-09-15T22:42:43.092102+0000","last_clean":"2024-09-15T22:42:43.092102+0000","last_became_active":"2024-09-15T22:42:42.072206+0000","last_became_peered":"2024-09-15T22:42:42.072206+0000","last_unstale":"2024-09-15T22:42:43.092102+0000","last_undegraded":"2024-09-15T22:42:43.092102+0000","last_fullsized":"2024-09-15T22:42:43.092102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:44.164192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257947+0000","last_change":"2024-09-15T22:42:43.088709+0000","last_active":"2024-09-15T22:42:44.257947+0000","last_peered":"2024-09-15T22:42:44.257947+0000","last_clean":"2024-09-15T22:42:44.257947+0000","last_became_active":"2024-09-15T22:42:43.088438+0000","last_became_peered":"2024-09-15T22:42:43.088438+0000","last_unstale":"2024-09-15T22:42:44.257947+0000","last_undegraded":"2024-09-15T22:42:44.257947+0000","last_fullsized":"2024-09-15T22:42:44.257947+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.822681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083460+0000","last_change":"2024-09-15T22:42:42.068968+0000","last_active":"2024-09-15T22:42:44.083460+0000","last_peered":"2024-09-15T22:42:44.083460+0000","last_clean":"2024-09-15T22:42:44.083460+0000","last_became_active":"2024-09-15T22:42:42.068690+0000","last_became_peered":"2024-09-15T22:42:42.068690+0000","last_unstale":"2024-09-15T22:42:44.083460+0000","last_undegraded":"2024-09-15T22:42:44.083460+0000","last_fullsized":"2024-09-15T22:42:44.083460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:06.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083294+0000","last_change":"2024-09-15T22:42:43.072942+0000","last_active":"2024-09-15T22:42:44.083294+0000","last_peered":"2024-09-15T22:42:44.083294+0000","last_clean":"2024-09-15T22:42:44.083294+0000","last_became_active":"2024-09-15T22:42:43.072667+0000","last_became_peered":"2024-09-15T22:42:43.072667+0000","last_unstale":"2024-09-15T22:42:44.083294+0000","last_undegraded":"2024-09-15T22:42:44.083294+0000","last_fullsized":"2024-09-15T22:42:44.083294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:52.117719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091392+0000","last_change":"2024-09-15T22:42:42.069587+0000","last_active":"2024-09-15T22:42:43.091392+0000","last_peered":"2024-09-15T22:42:43.091392+0000","last_clean":"2024-09-15T22:42:43.091392+0000","last_became_active":"2024-09-15T22:42:42.069207+0000","last_became_peered":"2024-09-15T22:42:42.069207+0000","last_unstale":"2024-09-15T22:42:43.091392+0000","last_undegraded":"2024-09-15T22:42:43.091392+0000","last_fullsized":"2024-09-15T22:42:43.091392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:54.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084614+0000","last_change":"2024-09-15T22:42:43.091144+0000","last_active":"2024-09-15T22:42:44.084614+0000","last_peered":"2024-09-15T22:42:44.084614+0000","last_clean":"2024-09-15T22:42:44.084614+0000","last_became_active":"2024-09-15T22:42:43.090818+0000","last_became_peered":"2024-09-15T22:42:43.090818+0000","last_unstale":"2024-09-15T22:42:44.084614+0000","last_undegraded":"2024-09-15T22:42:44.084614+0000","last_fullsized":"2024-09-15T22:42:44.084614+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:05.795762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083177+0000","last_change":"2024-09-15T22:42:42.072430+0000","last_active":"2024-09-15T22:42:44.083177+0000","last_peered":"2024-09-15T22:42:44.083177+0000","last_clean":"2024-09-15T22:42:44.083177+0000","last_became_active":"2024-09-15T22:42:42.072152+0000","last_became_peered":"2024-09-15T22:42:42.072152+0000","last_unstale":"2024-09-15T22:42:44.083177+0000","last_undegraded":"2024-09-15T22:42:44.083177+0000","last_fullsized":"2024-09-15T22:42:44.083177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:09.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084222+0000","last_change":"2024-09-15T22:42:43.092675+0000","last_active":"2024-09-15T22:42:44.084222+0000","last_peered":"2024-09-15T22:42:44.084222+0000","last_clean":"2024-09-15T22:42:44.084222+0000","last_became_active":"2024-09-15T22:42:43.092366+0000","last_became_peered":"2024-09-15T22:42:43.092366+0000","last_unstale":"2024-09-15T22:42:44.084222+0000","last_undegraded":"2024-09-15T22:42:44.084222+0000","last_fullsized":"2024-09-15T22:42:44.084222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:20.505149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254871+0000","last_change":"2024-09-15T22:42:42.071098+0000","last_active":"2024-09-15T22:42:44.254871+0000","last_peered":"2024-09-15T22:42:44.254871+0000","last_clean":"2024-09-15T22:42:44.254871+0000","last_became_active":"2024-09-15T22:42:42.070813+0000","last_became_peered":"2024-09-15T22:42:42.070813+0000","last_unstale":"2024-09-15T22:42:44.254871+0000","last_undegraded":"2024-09-15T22:42:44.254871+0000","last_fullsized":"2024-09-15T22:42:44.254871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:35.129820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083133+0000","last_change":"2024-09-15T22:42:43.073717+0000","last_active":"2024-09-15T22:42:44.083133+0000","last_peered":"2024-09-15T22:42:44.083133+0000","last_clean":"2024-09-15T22:42:44.083133+0000","last_became_active":"2024-09-15T22:42:43.073452+0000","last_became_peered":"2024-09-15T22:42:43.073452+0000","last_unstale":"2024-09-15T22:42:44.083133+0000","last_undegraded":"2024-09-15T22:42:44.083133+0000","last_fullsized":"2024-09-15T22:42:44.083133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:07:10.804663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084038+0000","last_change":"2024-09-15T22:42:42.070355+0000","last_active":"2024-09-15T22:42:44.084038+0000","last_peered":"2024-09-15T22:42:44.084038+0000","last_clean":"2024-09-15T22:42:44.084038+0000","last_became_active":"2024-09-15T22:42:42.070165+0000","last_became_peered":"2024-09-15T22:42:42.070165+0000","last_unstale":"2024-09-15T22:42:44.084038+0000","last_undegraded":"2024-09-15T22:42:44.084038+0000","last_fullsized":"2024-09-15T22:42:44.084038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:11.710177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255858+0000","last_change":"2024-09-15T22:42:43.071059+0000","last_active":"2024-09-15T22:42:44.255858+0000","last_peered":"2024-09-15T22:42:44.255858+0000","last_clean":"2024-09-15T22:42:44.255858+0000","last_became_active":"2024-09-15T22:42:43.070779+0000","last_became_peered":"2024-09-15T22:42:43.070779+0000","last_unstale":"2024-09-15T22:42:44.255858+0000","last_undegraded":"2024-09-15T22:42:44.255858+0000","last_fullsized":"2024-09-15T22:42:44.255858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:49.210136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255643+0000","last_change":"2024-09-15T22:42:42.061536+0000","last_active":"2024-09-15T22:42:44.255643+0000","last_peered":"2024-09-15T22:42:44.255643+0000","last_clean":"2024-09-15T22:42:44.255643+0000","last_became_active":"2024-09-15T22:42:42.061246+0000","last_became_peered":"2024-09-15T22:42:42.061246+0000","last_unstale":"2024-09-15T22:42:44.255643+0000","last_undegraded":"2024-09-15T22:42:44.255643+0000","last_fullsized":"2024-09-15T22:42:44.255643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:40.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255592+0000","last_change":"2024-09-15T22:42:43.072786+0000","last_active":"2024-09-15T22:42:44.255592+0000","last_peered":"2024-09-15T22:42:44.255592+0000","last_clean":"2024-09-15T22:42:44.255592+0000","last_became_active":"2024-09-15T22:42:43.072470+0000","last_became_peered":"2024-09-15T22:42:43.072470+0000","last_unstale":"2024-09-15T22:42:44.255592+0000","last_undegraded":"2024-09-15T22:42:44.255592+0000","last_fullsized":"2024-09-15T22:42:44.255592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.815981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085138+0000","last_change":"2024-09-15T22:42:42.067535+0000","last_active":"2024-09-15T22:42:44.085138+0000","last_peered":"2024-09-15T22:42:44.085138+0000","last_clean":"2024-09-15T22:42:44.085138+0000","last_became_active":"2024-09-15T22:42:42.067250+0000","last_became_peered":"2024-09-15T22:42:42.067250+0000","last_unstale":"2024-09-15T22:42:44.085138+0000","last_undegraded":"2024-09-15T22:42:44.085138+0000","last_fullsized":"2024-09-15T22:42:44.085138+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.471152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257799+0000","last_change":"2024-09-15T22:42:43.095237+0000","last_active":"2024-09-15T22:42:44.257799+0000","last_peered":"2024-09-15T22:42:44.257799+0000","last_clean":"2024-09-15T22:42:44.257799+0000","last_became_active":"2024-09-15T22:42:43.094920+0000","last_became_peered":"2024-09-15T22:42:43.094920+0000","last_unstale":"2024-09-15T22:42:44.257799+0000","last_undegraded":"2024-09-15T22:42:44.257799+0000","last_fullsized":"2024-09-15T22:42:44.257799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:07.773123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254487+0000","last_change":"2024-09-15T22:42:42.072518+0000","last_active":"2024-09-15T22:42:44.254487+0000","last_peered":"2024-09-15T22:42:44.254487+0000","last_clean":"2024-09-15T22:42:44.254487+0000","last_became_active":"2024-09-15T22:42:42.072128+0000","last_became_peered":"2024-09-15T22:42:42.072128+0000","last_unstale":"2024-09-15T22:42:44.254487+0000","last_undegraded":"2024-09-15T22:42:44.254487+0000","last_fullsized":"2024-09-15T22:42:44.254487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083360+0000","last_change":"2024-09-15T22:42:43.082589+0000","last_active":"2024-09-15T22:42:44.083360+0000","last_peered":"2024-09-15T22:42:44.083360+0000","last_clean":"2024-09-15T22:42:44.083360+0000","last_became_active":"2024-09-15T22:42:43.082136+0000","last_became_peered":"2024-09-15T22:42:43.082136+0000","last_unstale":"2024-09-15T22:42:44.083360+0000","last_undegraded":"2024-09-15T22:42:44.083360+0000","last_fullsized":"2024-09-15T22:42:44.083360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:42.328669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084739+0000","last_change":"2024-09-15T22:42:42.065819+0000","last_active":"2024-09-15T22:42:44.084739+0000","last_peered":"2024-09-15T22:42:44.084739+0000","last_clean":"2024-09-15T22:42:44.084739+0000","last_became_active":"2024-09-15T22:42:42.065462+0000","last_became_peered":"2024-09-15T22:42:42.065462+0000","last_unstale":"2024-09-15T22:42:44.084739+0000","last_undegraded":"2024-09-15T22:42:44.084739+0000","last_fullsized":"2024-09-15T22:42:44.084739+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:40.200048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255468+0000","last_change":"2024-09-15T22:42:43.075537+0000","last_active":"2024-09-15T22:42:44.255468+0000","last_peered":"2024-09-15T22:42:44.255468+0000","last_clean":"2024-09-15T22:42:44.255468+0000","last_became_active":"2024-09-15T22:42:43.075250+0000","last_became_peered":"2024-09-15T22:42:43.075250+0000","last_unstale":"2024-09-15T22:42:44.255468+0000","last_undegraded":"2024-09-15T22:42:44.255468+0000","last_fullsized":"2024-09-15T22:42:44.255468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:43.872832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085086+0000","last_change":"2024-09-15T22:42:42.065034+0000","last_active":"2024-09-15T22:42:44.085086+0000","last_peered":"2024-09-15T22:42:44.085086+0000","last_clean":"2024-09-15T22:42:44.085086+0000","last_became_active":"2024-09-15T22:42:42.064710+0000","last_became_peered":"2024-09-15T22:42:42.064710+0000","last_unstale":"2024-09-15T22:42:44.085086+0000","last_undegraded":"2024-09-15T22:42:44.085086+0000","last_fullsized":"2024-09-15T22:42:44.085086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.306426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084952+0000","last_change":"2024-09-15T22:42:43.076531+0000","last_active":"2024-09-15T22:42:44.084952+0000","last_peered":"2024-09-15T22:42:44.084952+0000","last_clean":"2024-09-15T22:42:44.084952+0000","last_became_active":"2024-09-15T22:42:43.076169+0000","last_became_peered":"2024-09-15T22:42:43.076169+0000","last_unstale":"2024-09-15T22:42:44.084952+0000","last_undegraded":"2024-09-15T22:42:44.084952+0000","last_fullsized":"2024-09-15T22:42:44.084952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.815981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254686+0000","last_change":"2024-09-15T22:42:42.070251+0000","last_active":"2024-09-15T22:42:44.254686+0000","last_peered":"2024-09-15T22:42:44.254686+0000","last_clean":"2024-09-15T22:42:44.254686+0000","last_became_active":"2024-09-15T22:42:42.069996+0000","last_became_peered":"2024-09-15T22:42:42.069996+0000","last_unstale":"2024-09-15T22:42:44.254686+0000","last_undegraded":"2024-09-15T22:42:44.254686+0000","last_fullsized":"2024-09-15T22:42:44.254686+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:42.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084672+0000","last_change":"2024-09-15T22:42:43.094353+0000","last_active":"2024-09-15T22:42:44.084672+0000","last_peered":"2024-09-15T22:42:44.084672+0000","last_clean":"2024-09-15T22:42:44.084672+0000","last_became_active":"2024-09-15T22:42:43.094086+0000","last_became_peered":"2024-09-15T22:42:43.094086+0000","last_unstale":"2024-09-15T22:42:44.084672+0000","last_undegraded":"2024-09-15T22:42:44.084672+0000","last_fullsized":"2024-09-15T22:42:44.084672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:43.872832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065759+0000","last_change":"2024-09-15T22:42:42.062757+0000","last_active":"2024-09-15T22:42:43.065759+0000","last_peered":"2024-09-15T22:42:43.065759+0000","last_clean":"2024-09-15T22:42:43.065759+0000","last_became_active":"2024-09-15T22:42:42.062432+0000","last_became_peered":"2024-09-15T22:42:42.062432+0000","last_unstale":"2024-09-15T22:42:43.065759+0000","last_undegraded":"2024-09-15T22:42:43.065759+0000","last_fullsized":"2024-09-15T22:42:43.065759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:49.387947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254400+0000","last_change":"2024-09-15T22:42:43.078577+0000","last_active":"2024-09-15T22:42:44.254400+0000","last_peered":"2024-09-15T22:42:44.254400+0000","last_clean":"2024-09-15T22:42:44.254400+0000","last_became_active":"2024-09-15T22:42:43.078300+0000","last_became_peered":"2024-09-15T22:42:43.078300+0000","last_unstale":"2024-09-15T22:42:44.254400+0000","last_undegraded":"2024-09-15T22:42:44.254400+0000","last_fullsized":"2024-09-15T22:42:44.254400+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:12.714297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084217+0000","last_change":"2024-09-15T22:42:42.062990+0000","last_active":"2024-09-15T22:42:44.084217+0000","last_peered":"2024-09-15T22:42:44.084217+0000","last_clean":"2024-09-15T22:42:44.084217+0000","last_became_active":"2024-09-15T22:42:42.062718+0000","last_became_peered":"2024-09-15T22:42:42.062718+0000","last_unstale":"2024-09-15T22:42:44.084217+0000","last_undegraded":"2024-09-15T22:42:44.084217+0000","last_fullsized":"2024-09-15T22:42:44.084217+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:48.823862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085421+0000","last_change":"2024-09-15T22:42:43.074946+0000","last_active":"2024-09-15T22:42:44.085421+0000","last_peered":"2024-09-15T22:42:44.085421+0000","last_clean":"2024-09-15T22:42:44.085421+0000","last_became_active":"2024-09-15T22:42:43.074681+0000","last_became_peered":"2024-09-15T22:42:43.074681+0000","last_unstale":"2024-09-15T22:42:44.085421+0000","last_undegraded":"2024-09-15T22:42:44.085421+0000","last_fullsized":"2024-09-15T22:42:44.085421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:49.210136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257981+0000","last_change":"2024-09-15T22:42:42.069570+0000","last_active":"2024-09-15T22:42:44.257981+0000","last_peered":"2024-09-15T22:42:44.257981+0000","last_clean":"2024-09-15T22:42:44.257981+0000","last_became_active":"2024-09-15T22:42:42.069291+0000","last_became_peered":"2024-09-15T22:42:42.069291+0000","last_unstale":"2024-09-15T22:42:44.257981+0000","last_undegraded":"2024-09-15T22:42:44.257981+0000","last_fullsized":"2024-09-15T22:42:44.257981+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085048+0000","last_change":"2024-09-15T22:42:43.092837+0000","last_active":"2024-09-15T22:42:44.085048+0000","last_peered":"2024-09-15T22:42:44.085048+0000","last_clean":"2024-09-15T22:42:44.085048+0000","last_became_active":"2024-09-15T22:42:43.092505+0000","last_became_peered":"2024-09-15T22:42:43.092505+0000","last_unstale":"2024-09-15T22:42:44.085048+0000","last_undegraded":"2024-09-15T22:42:44.085048+0000","last_fullsized":"2024-09-15T22:42:44.085048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.434965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255925+0000","last_change":"2024-09-15T22:42:42.065863+0000","last_active":"2024-09-15T22:42:44.255925+0000","last_peered":"2024-09-15T22:42:44.255925+0000","last_clean":"2024-09-15T22:42:44.255925+0000","last_became_active":"2024-09-15T22:42:42.065572+0000","last_became_peered":"2024-09-15T22:42:42.065572+0000","last_unstale":"2024-09-15T22:42:44.255925+0000","last_undegraded":"2024-09-15T22:42:44.255925+0000","last_fullsized":"2024-09-15T22:42:44.255925+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.306426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254929+0000","last_change":"2024-09-15T22:42:43.082172+0000","last_active":"2024-09-15T22:42:44.254929+0000","last_peered":"2024-09-15T22:42:44.254929+0000","last_clean":"2024-09-15T22:42:44.254929+0000","last_became_active":"2024-09-15T22:42:43.081805+0000","last_became_peered":"2024-09-15T22:42:43.081805+0000","last_unstale":"2024-09-15T22:42:44.254929+0000","last_undegraded":"2024-09-15T22:42:44.254929+0000","last_fullsized":"2024-09-15T22:42:44.254929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255857+0000","last_change":"2024-09-15T22:42:42.062527+0000","last_active":"2024-09-15T22:42:44.255857+0000","last_peered":"2024-09-15T22:42:44.255857+0000","last_clean":"2024-09-15T22:42:44.255857+0000","last_became_active":"2024-09-15T22:42:42.062259+0000","last_became_peered":"2024-09-15T22:42:42.062259+0000","last_unstale":"2024-09-15T22:42:44.255857+0000","last_undegraded":"2024-09-15T22:42:44.255857+0000","last_fullsized":"2024-09-15T22:42:44.255857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255773+0000","last_change":"2024-09-15T22:42:43.089387+0000","last_active":"2024-09-15T22:42:44.255773+0000","last_peered":"2024-09-15T22:42:44.255773+0000","last_clean":"2024-09-15T22:42:44.255773+0000","last_became_active":"2024-09-15T22:42:43.088623+0000","last_became_peered":"2024-09-15T22:42:43.088623+0000","last_unstale":"2024-09-15T22:42:44.255773+0000","last_undegraded":"2024-09-15T22:42:44.255773+0000","last_fullsized":"2024-09-15T22:42:44.255773+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:38.170032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065540+0000","last_change":"2024-09-15T22:42:42.063551+0000","last_active":"2024-09-15T22:42:43.065540+0000","last_peered":"2024-09-15T22:42:43.065540+0000","last_clean":"2024-09-15T22:42:43.065540+0000","last_became_active":"2024-09-15T22:42:42.063299+0000","last_became_peered":"2024-09-15T22:42:42.063299+0000","last_unstale":"2024-09-15T22:42:43.065540+0000","last_undegraded":"2024-09-15T22:42:43.065540+0000","last_fullsized":"2024-09-15T22:42:43.065540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.076628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084647+0000","last_change":"2024-09-15T22:42:43.086377+0000","last_active":"2024-09-15T22:42:44.084647+0000","last_peered":"2024-09-15T22:42:44.084647+0000","last_clean":"2024-09-15T22:42:44.084647+0000","last_became_active":"2024-09-15T22:42:43.086095+0000","last_became_peered":"2024-09-15T22:42:43.086095+0000","last_unstale":"2024-09-15T22:42:44.084647+0000","last_undegraded":"2024-09-15T22:42:44.084647+0000","last_fullsized":"2024-09-15T22:42:44.084647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:50.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084559+0000","last_change":"2024-09-15T22:42:42.067256+0000","last_active":"2024-09-15T22:42:44.084559+0000","last_peered":"2024-09-15T22:42:44.084559+0000","last_clean":"2024-09-15T22:42:44.084559+0000","last_became_active":"2024-09-15T22:42:42.067007+0000","last_became_peered":"2024-09-15T22:42:42.067007+0000","last_unstale":"2024-09-15T22:42:44.084559+0000","last_undegraded":"2024-09-15T22:42:44.084559+0000","last_fullsized":"2024-09-15T22:42:44.084559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:31.254765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089641+0000","last_change":"2024-09-15T22:42:43.079711+0000","last_active":"2024-09-15T22:42:43.089641+0000","last_peered":"2024-09-15T22:42:43.089641+0000","last_clean":"2024-09-15T22:42:43.089641+0000","last_became_active":"2024-09-15T22:42:43.079435+0000","last_became_peered":"2024-09-15T22:42:43.079435+0000","last_unstale":"2024-09-15T22:42:43.089641+0000","last_undegraded":"2024-09-15T22:42:43.089641+0000","last_fullsized":"2024-09-15T22:42:43.089641+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:24.892136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254767+0000","last_change":"2024-09-15T22:42:42.072411+0000","last_active":"2024-09-15T22:42:44.254767+0000","last_peered":"2024-09-15T22:42:44.254767+0000","last_clean":"2024-09-15T22:42:44.254767+0000","last_became_active":"2024-09-15T22:42:42.072089+0000","last_became_peered":"2024-09-15T22:42:42.072089+0000","last_unstale":"2024-09-15T22:42:44.254767+0000","last_undegraded":"2024-09-15T22:42:44.254767+0000","last_fullsized":"2024-09-15T22:42:44.254767+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:56.104083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257579+0000","last_change":"2024-09-15T22:42:43.084322+0000","last_active":"2024-09-15T22:42:44.257579+0000","last_peered":"2024-09-15T22:42:44.257579+0000","last_clean":"2024-09-15T22:42:44.257579+0000","last_became_active":"2024-09-15T22:42:43.079448+0000","last_became_peered":"2024-09-15T22:42:43.079448+0000","last_unstale":"2024-09-15T22:42:44.257579+0000","last_undegraded":"2024-09-15T22:42:44.257579+0000","last_fullsized":"2024-09-15T22:42:44.257579+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:31.420019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084050+0000","last_change":"2024-09-15T22:42:42.067428+0000","last_active":"2024-09-15T22:42:44.084050+0000","last_peered":"2024-09-15T22:42:44.084050+0000","last_clean":"2024-09-15T22:42:44.084050+0000","last_became_active":"2024-09-15T22:42:42.067152+0000","last_became_peered":"2024-09-15T22:42:42.067152+0000","last_unstale":"2024-09-15T22:42:44.084050+0000","last_undegraded":"2024-09-15T22:42:44.084050+0000","last_fullsized":"2024-09-15T22:42:44.084050+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:12.114281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257385+0000","last_change":"2024-09-15T22:42:43.093162+0000","last_active":"2024-09-15T22:42:44.257385+0000","last_peered":"2024-09-15T22:42:44.257385+0000","last_clean":"2024-09-15T22:42:44.257385+0000","last_became_active":"2024-09-15T22:42:43.092501+0000","last_became_peered":"2024-09-15T22:42:43.092501+0000","last_unstale":"2024-09-15T22:42:44.257385+0000","last_undegraded":"2024-09-15T22:42:44.257385+0000","last_fullsized":"2024-09-15T22:42:44.257385+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:52.075951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083053+0000","last_change":"2024-09-15T22:42:42.063666+0000","last_active":"2024-09-15T22:42:44.083053+0000","last_peered":"2024-09-15T22:42:44.083053+0000","last_clean":"2024-09-15T22:42:44.083053+0000","last_became_active":"2024-09-15T22:42:42.063382+0000","last_became_peered":"2024-09-15T22:42:42.063382+0000","last_unstale":"2024-09-15T22:42:44.083053+0000","last_undegraded":"2024-09-15T22:42:44.083053+0000","last_fullsized":"2024-09-15T22:42:44.083053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:13.361276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083345+0000","last_change":"2024-09-15T22:42:43.071063+0000","last_active":"2024-09-15T22:42:44.083345+0000","last_peered":"2024-09-15T22:42:44.083345+0000","last_clean":"2024-09-15T22:42:44.083345+0000","last_became_active":"2024-09-15T22:42:43.070765+0000","last_became_peered":"2024-09-15T22:42:43.070765+0000","last_unstale":"2024-09-15T22:42:44.083345+0000","last_undegraded":"2024-09-15T22:42:44.083345+0000","last_fullsized":"2024-09-15T22:42:44.083345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:54.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.258025+0000","last_change":"2024-09-15T22:42:42.070148+0000","last_active":"2024-09-15T22:42:44.258025+0000","last_peered":"2024-09-15T22:42:44.258025+0000","last_clean":"2024-09-15T22:42:44.258025+0000","last_became_active":"2024-09-15T22:42:42.069826+0000","last_became_peered":"2024-09-15T22:42:42.069826+0000","last_unstale":"2024-09-15T22:42:44.258025+0000","last_undegraded":"2024-09-15T22:42:44.258025+0000","last_fullsized":"2024-09-15T22:42:44.258025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:56.445574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084745+0000","last_change":"2024-09-15T22:42:43.094516+0000","last_active":"2024-09-15T22:42:44.084745+0000","last_peered":"2024-09-15T22:42:44.084745+0000","last_clean":"2024-09-15T22:42:44.084745+0000","last_became_active":"2024-09-15T22:42:43.093536+0000","last_became_peered":"2024-09-15T22:42:43.093536+0000","last_unstale":"2024-09-15T22:42:44.084745+0000","last_undegraded":"2024-09-15T22:42:44.084745+0000","last_fullsized":"2024-09-15T22:42:44.084745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:06.205872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254878+0000","last_change":"2024-09-15T22:42:42.074314+0000","last_active":"2024-09-15T22:42:44.254878+0000","last_peered":"2024-09-15T22:42:44.254878+0000","last_clean":"2024-09-15T22:42:44.254878+0000","last_became_active":"2024-09-15T22:42:42.074020+0000","last_became_peered":"2024-09-15T22:42:42.074020+0000","last_unstale":"2024-09-15T22:42:44.254878+0000","last_undegraded":"2024-09-15T22:42:44.254878+0000","last_fullsized":"2024-09-15T22:42:44.254878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:26.794194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083525+0000","last_change":"2024-09-15T22:42:43.082746+0000","last_active":"2024-09-15T22:42:44.083525+0000","last_peered":"2024-09-15T22:42:44.083525+0000","last_clean":"2024-09-15T22:42:44.083525+0000","last_became_active":"2024-09-15T22:42:43.082487+0000","last_became_peered":"2024-09-15T22:42:43.082487+0000","last_unstale":"2024-09-15T22:42:44.083525+0000","last_undegraded":"2024-09-15T22:42:44.083525+0000","last_fullsized":"2024-09-15T22:42:44.083525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:54.145129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085171+0000","last_change":"2024-09-15T22:42:42.068455+0000","last_active":"2024-09-15T22:42:44.085171+0000","last_peered":"2024-09-15T22:42:44.085171+0000","last_clean":"2024-09-15T22:42:44.085171+0000","last_became_active":"2024-09-15T22:42:42.068086+0000","last_became_peered":"2024-09-15T22:42:42.068086+0000","last_unstale":"2024-09-15T22:42:44.085171+0000","last_undegraded":"2024-09-15T22:42:44.085171+0000","last_fullsized":"2024-09-15T22:42:44.085171+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:45.504405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084447+0000","last_change":"2024-09-15T22:42:43.085325+0000","last_active":"2024-09-15T22:42:44.084447+0000","last_peered":"2024-09-15T22:42:44.084447+0000","last_clean":"2024-09-15T22:42:44.084447+0000","last_became_active":"2024-09-15T22:42:43.084992+0000","last_became_peered":"2024-09-15T22:42:43.084992+0000","last_unstale":"2024-09-15T22:42:44.084447+0000","last_undegraded":"2024-09-15T22:42:44.084447+0000","last_fullsized":"2024-09-15T22:42:44.084447+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.872170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255142+0000","last_change":"2024-09-15T22:42:42.073188+0000","last_active":"2024-09-15T22:42:44.255142+0000","last_peered":"2024-09-15T22:42:44.255142+0000","last_clean":"2024-09-15T22:42:44.255142+0000","last_became_active":"2024-09-15T22:42:42.072903+0000","last_became_peered":"2024-09-15T22:42:42.072903+0000","last_unstale":"2024-09-15T22:42:44.255142+0000","last_undegraded":"2024-09-15T22:42:44.255142+0000","last_fullsized":"2024-09-15T22:42:44.255142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.417328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257657+0000","last_change":"2024-09-15T22:42:43.083724+0000","last_active":"2024-09-15T22:42:44.257657+0000","last_peered":"2024-09-15T22:42:44.257657+0000","last_clean":"2024-09-15T22:42:44.257657+0000","last_became_active":"2024-09-15T22:42:43.082753+0000","last_became_peered":"2024-09-15T22:42:43.082753+0000","last_unstale":"2024-09-15T22:42:44.257657+0000","last_undegraded":"2024-09-15T22:42:44.257657+0000","last_fullsized":"2024-09-15T22:42:44.257657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:20.505149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083268+0000","last_change":"2024-09-15T22:42:42.064223+0000","last_active":"2024-09-15T22:42:44.083268+0000","last_peered":"2024-09-15T22:42:44.083268+0000","last_clean":"2024-09-15T22:42:44.083268+0000","last_became_active":"2024-09-15T22:42:42.063968+0000","last_became_peered":"2024-09-15T22:42:42.063968+0000","last_unstale":"2024-09-15T22:42:44.083268+0000","last_undegraded":"2024-09-15T22:42:44.083268+0000","last_fullsized":"2024-09-15T22:42:44.083268+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:04.791643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255159+0000","last_change":"2024-09-15T22:42:43.074767+0000","last_active":"2024-09-15T22:42:44.255159+0000","last_peered":"2024-09-15T22:42:44.255159+0000","last_clean":"2024-09-15T22:42:44.255159+0000","last_became_active":"2024-09-15T22:42:43.074514+0000","last_became_peered":"2024-09-15T22:42:43.074514+0000","last_unstale":"2024-09-15T22:42:44.255159+0000","last_undegraded":"2024-09-15T22:42:44.255159+0000","last_fullsized":"2024-09-15T22:42:44.255159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:20.204465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065645+0000","last_change":"2024-09-15T22:42:42.065936+0000","last_active":"2024-09-15T22:42:43.065645+0000","last_peered":"2024-09-15T22:42:43.065645+0000","last_clean":"2024-09-15T22:42:43.065645+0000","last_became_active":"2024-09-15T22:42:42.065495+0000","last_became_peered":"2024-09-15T22:42:42.065495+0000","last_unstale":"2024-09-15T22:42:43.065645+0000","last_undegraded":"2024-09-15T22:42:43.065645+0000","last_fullsized":"2024-09-15T22:42:43.065645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:18.016844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254548+0000","last_change":"2024-09-15T22:42:43.076389+0000","last_active":"2024-09-15T22:42:44.254548+0000","last_peered":"2024-09-15T22:42:44.254548+0000","last_clean":"2024-09-15T22:42:44.254548+0000","last_became_active":"2024-09-15T22:42:43.076111+0000","last_became_peered":"2024-09-15T22:42:43.076111+0000","last_unstale":"2024-09-15T22:42:44.254548+0000","last_undegraded":"2024-09-15T22:42:44.254548+0000","last_fullsized":"2024-09-15T22:42:44.254548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:49.827981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084801+0000","last_change":"2024-09-15T22:42:42.064210+0000","last_active":"2024-09-15T22:42:44.084801+0000","last_peered":"2024-09-15T22:42:44.084801+0000","last_clean":"2024-09-15T22:42:44.084801+0000","last_became_active":"2024-09-15T22:42:42.063846+0000","last_became_peered":"2024-09-15T22:42:42.063846+0000","last_unstale":"2024-09-15T22:42:44.084801+0000","last_undegraded":"2024-09-15T22:42:44.084801+0000","last_fullsized":"2024-09-15T22:42:44.084801+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:31.899917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257955+0000","last_change":"2024-09-15T22:42:43.081934+0000","last_active":"2024-09-15T22:42:44.257955+0000","last_peered":"2024-09-15T22:42:44.257955+0000","last_clean":"2024-09-15T22:42:44.257955+0000","last_became_active":"2024-09-15T22:42:43.081670+0000","last_became_peered":"2024-09-15T22:42:43.081670+0000","last_unstale":"2024-09-15T22:42:44.257955+0000","last_undegraded":"2024-09-15T22:42:44.257955+0000","last_fullsized":"2024-09-15T22:42:44.257955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:40.342656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083436+0000","last_change":"2024-09-15T22:42:42.070506+0000","last_active":"2024-09-15T22:42:44.083436+0000","last_peered":"2024-09-15T22:42:44.083436+0000","last_clean":"2024-09-15T22:42:44.083436+0000","last_became_active":"2024-09-15T22:42:42.070239+0000","last_became_peered":"2024-09-15T22:42:42.070239+0000","last_unstale":"2024-09-15T22:42:44.083436+0000","last_undegraded":"2024-09-15T22:42:44.083436+0000","last_fullsized":"2024-09-15T22:42:44.083436+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:30.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":211,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255194+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:44.255194+0000","last_peered":"2024-09-15T22:42:44.255194+0000","last_clean":"2024-09-15T22:42:44.255194+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:44.255194+0000","last_undegraded":"2024-09-15T22:42:44.255194+0000","last_fullsized":"2024-09-15T22:42:44.255194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":218299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1142784,"data_stored":808655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":565248,"data_stored":219969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":219877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":218355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1142784,"data_stored":808703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":552960,"data_stored":218937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":212581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:50.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:42:50.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.482+0000 7f953361e640 1 Processor -- start 2024-09-15T22:42:50.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.483+0000 7f953361e640 1 -- start start 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.483+0000 7f953361e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f952c0b7190 0x7f952c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.483+0000 7f953361e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c15c9c0 con 0x7f952c15c5e0 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.483+0000 7f953361e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c0b1dd0 con 0x7f952c0b6d50 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.483+0000 7f953361e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f952c074100 con 0x7f952c0b7190 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f95313ba640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f952c15c5e0 0x7f952c0712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50354/0 (socket says 172.21.15.134:50354) 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f95313ba640 1 -- 172.21.15.134:0/3217001303 learned_addr learned my addr 172.21.15.134:0/3217001303 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9531bbb640 1 --2- 172.21.15.134:0/3217001303 >> v2:172.21.15.177:3300/0 conn(0x7f952c0b7190 0x7f952c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745896214 0 0) 0x7f952c15c9c0 con 0x7f952c15c5e0 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9518003520 con 0x7f952c15c5e0 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132728138 0 0) 0x7f9518003520 con 0x7f952c15c5e0 2024-09-15T22:42:50.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 >> v2:172.21.15.177:3300/0 conn(0x7f952c0b7190 msgr2=0x7f952c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 --2- 172.21.15.134:0/3217001303 >> v2:172.21.15.177:3300/0 conn(0x7f952c0b7190 0x7f952c0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 >> v1:172.21.15.177:6789/0 conn(0x7f952c0b6d50 legacy=0x7f952c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0734f0 con 0x7f952c15c5e0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f9524001670 con 0x7f952c15c5e0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 >> v1:172.21.15.134:6789/0 conn(0x7f952c15c5e0 legacy=0x7f952c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95180039b0 0x7f9518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9518004800 0x7f9518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 0x7f951800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f952c074100 con 0x7f95180051c0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f951800c060 con 0x7f9518004800 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f951800c260 con 0x7f95180039b0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9531bbb640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 0x7f951800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f95313ba640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95180039b0 0x7f9518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.484+0000 7f9530bb9640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9518004800 0x7f9518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 -- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95180039b0 msgr2=0x7f9518003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95180039b0 0x7f9518003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 -- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9518004800 msgr2=0x7f9518004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9518004800 0x7f9518004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 -- 172.21.15.134:0/3217001303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9518003520 con 0x7f95180051c0 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 -- 172.21.15.134:0/3217001303 reap_dead start 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9531bbb640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 0x7f951800b9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9528009fc0 tx=0x7f9518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3ca30ae6f82cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528035020 con 0x7f95180051c0 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9528003bd0 con 0x7f95180051c0 2024-09-15T22:42:50.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.485+0000 7f9523fff640 1 -- 172.21.15.134:0/3217001303 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528009c10 con 0x7f95180051c0 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 -- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 msgr2=0x7f951800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 0x7f951800b9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9528009fc0 tx=0x7f9518005830 comp rx=0 tx=0).stop 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 -- 172.21.15.134:0/3217001303 shutdown_connections 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 --2- 172.21.15.134:0/3217001303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95180051c0 0x7f951800b9c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 -- 172.21.15.134:0/3217001303 >> 172.21.15.134:0/3217001303 conn(0x7f952c0b4220 msgr2=0x7f952c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 -- 172.21.15.134:0/3217001303 shutdown_connections 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.486+0000 7f953361e640 1 -- 172.21.15.134:0/3217001303 wait complete. 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.487+0000 7f953361e640 1 Processor -- start 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.487+0000 7f953361e640 1 -- start start 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95180051c0 0x7f952c15ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 0x7f952c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f952c073d90 con 0x7f952c15dba0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f952c073ab0 con 0x7f95180051c0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f953361e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f952c0b7600 con 0x7f952c1604d0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f9531bbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f9531bbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58016/0 (socket says 172.21.15.134:58016) 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f9531bbb640 1 -- 172.21.15.134:0/1692948862 learned_addr learned my addr 172.21.15.134:0/1692948862 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f9530bb9640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 0x7f952c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.488+0000 7f95313ba640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95180051c0 0x7f952c15ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 -- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 msgr2=0x7f952c15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 0x7f952c15ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 -- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95180051c0 msgr2=0x7f952c15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95180051c0 0x7f952c15ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 -- 172.21.15.134:0/1692948862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c1561f0 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9530bb9640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 0x7f952c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9531bbb640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f952800e230 tx=0x7f9528009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528035030 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9528043070 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c15e080 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952802d070 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.489+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c15e640 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.490+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c0d3660 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.491+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f9528005d10 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.491+0000 7f9521ffb640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 0x7f951006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.491+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f95280ac610 con 0x7f952c15dba0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.491+0000 7f95313ba640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 0x7f951006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.491+0000 7f95313ba640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 0x7f951006e920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9524001eb0 tx=0x7f9524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.495+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f952807ab10 con 0x7f952c15dba0 2024-09-15T22:42:50.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.659+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f952c0691f0 con 0x7f951006c460 2024-09-15T22:42:50.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.664+0000 7f9521ffb640 1 -- 172.21.15.134:0/1692948862 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f9524007720 con 0x7f951006c460 2024-09-15T22:42:50.670 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:50.671 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:42:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 msgr2=0x7f951006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 0x7f951006e920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9524001eb0 tx=0x7f9524009040 comp rx=0 tx=0).stop 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 msgr2=0x7f952c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f952800e230 tx=0x7f9528009750 comp rx=0 tx=0).stop 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 shutdown_connections 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f951006c460 0x7f951006e920 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f952c15dba0 0x7f952c15f450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f952c1604d0 0x7f952c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 --2- 172.21.15.134:0/1692948862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95180051c0 0x7f952c15ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 >> 172.21.15.134:0/1692948862 conn(0x7f952c0b4220 msgr2=0x7f952c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:50.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 shutdown_connections 2024-09-15T22:42:50.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.668+0000 7f953361e640 1 -- 172.21.15.134:0/1692948862 wait complete. 2024-09-15T22:42:50.680 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-15T22:42:48.963846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221732,"kb_used_data":5468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752988,"statfs":{"total":773094113280,"available":772867059712,"internally_reserved":0,"allocated":5599232,"data_stored":2925376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.912957"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255149+0000","last_change":"2024-09-15T22:42:43.080936+0000","last_active":"2024-09-15T22:42:44.255149+0000","last_peered":"2024-09-15T22:42:44.255149+0000","last_clean":"2024-09-15T22:42:44.255149+0000","last_became_active":"2024-09-15T22:42:43.080669+0000","last_became_peered":"2024-09-15T22:42:43.080669+0000","last_unstale":"2024-09-15T22:42:44.255149+0000","last_undegraded":"2024-09-15T22:42:44.255149+0000","last_fullsized":"2024-09-15T22:42:44.255149+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:52.075951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254707+0000","last_change":"2024-09-15T22:42:43.093275+0000","last_active":"2024-09-15T22:42:44.254707+0000","last_peered":"2024-09-15T22:42:44.254707+0000","last_clean":"2024-09-15T22:42:44.254707+0000","last_became_active":"2024-09-15T22:42:43.092789+0000","last_became_peered":"2024-09-15T22:42:43.092789+0000","last_unstale":"2024-09-15T22:42:44.254707+0000","last_undegraded":"2024-09-15T22:42:44.254707+0000","last_fullsized":"2024-09-15T22:42:44.254707+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:50.870808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255654+0000","last_change":"2024-09-15T22:42:43.089611+0000","last_active":"2024-09-15T22:42:44.255654+0000","last_peered":"2024-09-15T22:42:44.255654+0000","last_clean":"2024-09-15T22:42:44.255654+0000","last_became_active":"2024-09-15T22:42:43.089106+0000","last_became_peered":"2024-09-15T22:42:43.089106+0000","last_unstale":"2024-09-15T22:42:44.255654+0000","last_undegraded":"2024-09-15T22:42:44.255654+0000","last_fullsized":"2024-09-15T22:42:44.255654+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.434965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257710+0000","last_change":"2024-09-15T22:42:43.089329+0000","last_active":"2024-09-15T22:42:44.257710+0000","last_peered":"2024-09-15T22:42:44.257710+0000","last_clean":"2024-09-15T22:42:44.257710+0000","last_became_active":"2024-09-15T22:42:43.088945+0000","last_became_peered":"2024-09-15T22:42:43.088945+0000","last_unstale":"2024-09-15T22:42:44.257710+0000","last_undegraded":"2024-09-15T22:42:44.257710+0000","last_fullsized":"2024-09-15T22:42:44.257710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:05.795762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255044+0000","last_change":"2024-09-15T22:42:43.078396+0000","last_active":"2024-09-15T22:42:44.255044+0000","last_peered":"2024-09-15T22:42:44.255044+0000","last_clean":"2024-09-15T22:42:44.255044+0000","last_became_active":"2024-09-15T22:42:43.077813+0000","last_became_peered":"2024-09-15T22:42:43.077813+0000","last_unstale":"2024-09-15T22:42:44.255044+0000","last_undegraded":"2024-09-15T22:42:44.255044+0000","last_fullsized":"2024-09-15T22:42:44.255044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075712+0000","last_change":"2024-09-15T22:42:43.070946+0000","last_active":"2024-09-15T22:42:43.075712+0000","last_peered":"2024-09-15T22:42:43.075712+0000","last_clean":"2024-09-15T22:42:43.075712+0000","last_became_active":"2024-09-15T22:42:43.070660+0000","last_became_peered":"2024-09-15T22:42:43.070660+0000","last_unstale":"2024-09-15T22:42:43.075712+0000","last_undegraded":"2024-09-15T22:42:43.075712+0000","last_fullsized":"2024-09-15T22:42:43.075712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:52.691529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083278+0000","last_change":"2024-09-15T22:42:43.085721+0000","last_active":"2024-09-15T22:42:44.083278+0000","last_peered":"2024-09-15T22:42:44.083278+0000","last_clean":"2024-09-15T22:42:44.083278+0000","last_became_active":"2024-09-15T22:42:43.085353+0000","last_became_peered":"2024-09-15T22:42:43.085353+0000","last_unstale":"2024-09-15T22:42:44.083278+0000","last_undegraded":"2024-09-15T22:42:44.083278+0000","last_fullsized":"2024-09-15T22:42:44.083278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:10.759280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.256918+0000","last_change":"2024-09-15T22:42:43.077884+0000","last_active":"2024-09-15T22:42:44.256918+0000","last_peered":"2024-09-15T22:42:44.256918+0000","last_clean":"2024-09-15T22:42:44.256918+0000","last_became_active":"2024-09-15T22:42:43.077010+0000","last_became_peered":"2024-09-15T22:42:43.077010+0000","last_unstale":"2024-09-15T22:42:44.256918+0000","last_undegraded":"2024-09-15T22:42:44.256918+0000","last_fullsized":"2024-09-15T22:42:44.256918+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091993+0000","last_change":"2024-09-15T22:42:43.088934+0000","last_active":"2024-09-15T22:42:43.091993+0000","last_peered":"2024-09-15T22:42:43.091993+0000","last_clean":"2024-09-15T22:42:43.091993+0000","last_became_active":"2024-09-15T22:42:43.088613+0000","last_became_peered":"2024-09-15T22:42:43.088613+0000","last_unstale":"2024-09-15T22:42:43.091993+0000","last_undegraded":"2024-09-15T22:42:43.091993+0000","last_fullsized":"2024-09-15T22:42:43.091993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:12.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084934+0000","last_change":"2024-09-15T22:42:43.092600+0000","last_active":"2024-09-15T22:42:44.084934+0000","last_peered":"2024-09-15T22:42:44.084934+0000","last_clean":"2024-09-15T22:42:44.084934+0000","last_became_active":"2024-09-15T22:42:43.092237+0000","last_became_peered":"2024-09-15T22:42:43.092237+0000","last_unstale":"2024-09-15T22:42:44.084934+0000","last_undegraded":"2024-09-15T22:42:44.084934+0000","last_fullsized":"2024-09-15T22:42:44.084934+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.822681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257920+0000","last_change":"2024-09-15T22:42:43.077120+0000","last_active":"2024-09-15T22:42:44.257920+0000","last_peered":"2024-09-15T22:42:44.257920+0000","last_clean":"2024-09-15T22:42:44.257920+0000","last_became_active":"2024-09-15T22:42:43.076820+0000","last_became_peered":"2024-09-15T22:42:43.076820+0000","last_unstale":"2024-09-15T22:42:44.257920+0000","last_undegraded":"2024-09-15T22:42:44.257920+0000","last_fullsized":"2024-09-15T22:42:44.257920+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:50.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254660+0000","last_change":"2024-09-15T22:42:43.080211+0000","last_active":"2024-09-15T22:42:44.254660+0000","last_peered":"2024-09-15T22:42:44.254660+0000","last_clean":"2024-09-15T22:42:44.254660+0000","last_became_active":"2024-09-15T22:42:43.079934+0000","last_became_peered":"2024-09-15T22:42:43.079934+0000","last_unstale":"2024-09-15T22:42:44.254660+0000","last_undegraded":"2024-09-15T22:42:44.254660+0000","last_fullsized":"2024-09-15T22:42:44.254660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:17.475271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089986+0000","last_change":"2024-09-15T22:42:43.087030+0000","last_active":"2024-09-15T22:42:43.089986+0000","last_peered":"2024-09-15T22:42:43.089986+0000","last_clean":"2024-09-15T22:42:43.089986+0000","last_became_active":"2024-09-15T22:42:43.086710+0000","last_became_peered":"2024-09-15T22:42:43.086710+0000","last_unstale":"2024-09-15T22:42:43.089986+0000","last_undegraded":"2024-09-15T22:42:43.089986+0000","last_fullsized":"2024-09-15T22:42:43.089986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:28.960302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257538+0000","last_change":"2024-09-15T22:42:43.087774+0000","last_active":"2024-09-15T22:42:44.257538+0000","last_peered":"2024-09-15T22:42:44.257538+0000","last_clean":"2024-09-15T22:42:44.257538+0000","last_became_active":"2024-09-15T22:42:43.087470+0000","last_became_peered":"2024-09-15T22:42:43.087470+0000","last_unstale":"2024-09-15T22:42:44.257538+0000","last_undegraded":"2024-09-15T22:42:44.257538+0000","last_fullsized":"2024-09-15T22:42:44.257538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:14.365396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257223+0000","last_change":"2024-09-15T22:42:43.081284+0000","last_active":"2024-09-15T22:42:44.257223+0000","last_peered":"2024-09-15T22:42:44.257223+0000","last_clean":"2024-09-15T22:42:44.257223+0000","last_became_active":"2024-09-15T22:42:43.080785+0000","last_became_peered":"2024-09-15T22:42:43.080785+0000","last_unstale":"2024-09-15T22:42:44.257223+0000","last_undegraded":"2024-09-15T22:42:44.257223+0000","last_fullsized":"2024-09-15T22:42:44.257223+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254381+0000","last_change":"2024-09-15T22:42:43.076638+0000","last_active":"2024-09-15T22:42:44.254381+0000","last_peered":"2024-09-15T22:42:44.254381+0000","last_clean":"2024-09-15T22:42:44.254381+0000","last_became_active":"2024-09-15T22:42:43.076332+0000","last_became_peered":"2024-09-15T22:42:43.076332+0000","last_unstale":"2024-09-15T22:42:44.254381+0000","last_undegraded":"2024-09-15T22:42:44.254381+0000","last_fullsized":"2024-09-15T22:42:44.254381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:50.870808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254978+0000","last_change":"2024-09-15T22:42:43.077291+0000","last_active":"2024-09-15T22:42:44.254978+0000","last_peered":"2024-09-15T22:42:44.254978+0000","last_clean":"2024-09-15T22:42:44.254978+0000","last_became_active":"2024-09-15T22:42:43.076792+0000","last_became_peered":"2024-09-15T22:42:43.076792+0000","last_unstale":"2024-09-15T22:42:44.254978+0000","last_undegraded":"2024-09-15T22:42:44.254978+0000","last_fullsized":"2024-09-15T22:42:44.254978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255729+0000","last_change":"2024-09-15T22:42:43.075562+0000","last_active":"2024-09-15T22:42:44.255729+0000","last_peered":"2024-09-15T22:42:44.255729+0000","last_clean":"2024-09-15T22:42:44.255729+0000","last_became_active":"2024-09-15T22:42:43.075268+0000","last_became_peered":"2024-09-15T22:42:43.075268+0000","last_unstale":"2024-09-15T22:42:44.255729+0000","last_undegraded":"2024-09-15T22:42:44.255729+0000","last_fullsized":"2024-09-15T22:42:44.255729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:42.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254925+0000","last_change":"2024-09-15T22:42:43.077053+0000","last_active":"2024-09-15T22:42:44.254925+0000","last_peered":"2024-09-15T22:42:44.254925+0000","last_clean":"2024-09-15T22:42:44.254925+0000","last_became_active":"2024-09-15T22:42:43.076388+0000","last_became_peered":"2024-09-15T22:42:43.076388+0000","last_unstale":"2024-09-15T22:42:44.254925+0000","last_undegraded":"2024-09-15T22:42:44.254925+0000","last_fullsized":"2024-09-15T22:42:44.254925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084611+0000","last_change":"2024-09-15T22:42:43.094379+0000","last_active":"2024-09-15T22:42:44.084611+0000","last_peered":"2024-09-15T22:42:44.084611+0000","last_clean":"2024-09-15T22:42:44.084611+0000","last_became_active":"2024-09-15T22:42:43.093989+0000","last_became_peered":"2024-09-15T22:42:43.093989+0000","last_unstale":"2024-09-15T22:42:44.084611+0000","last_undegraded":"2024-09-15T22:42:44.084611+0000","last_fullsized":"2024-09-15T22:42:44.084611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:07.773123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257661+0000","last_change":"2024-09-15T22:42:43.083726+0000","last_active":"2024-09-15T22:42:44.257661+0000","last_peered":"2024-09-15T22:42:44.257661+0000","last_clean":"2024-09-15T22:42:44.257661+0000","last_became_active":"2024-09-15T22:42:43.083446+0000","last_became_peered":"2024-09-15T22:42:43.083446+0000","last_unstale":"2024-09-15T22:42:44.257661+0000","last_undegraded":"2024-09-15T22:42:44.257661+0000","last_fullsized":"2024-09-15T22:42:44.257661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.872170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085107+0000","last_change":"2024-09-15T22:42:43.073930+0000","last_active":"2024-09-15T22:42:44.085107+0000","last_peered":"2024-09-15T22:42:44.085107+0000","last_clean":"2024-09-15T22:42:44.085107+0000","last_became_active":"2024-09-15T22:42:43.073647+0000","last_became_peered":"2024-09-15T22:42:43.073647+0000","last_unstale":"2024-09-15T22:42:44.085107+0000","last_undegraded":"2024-09-15T22:42:44.085107+0000","last_fullsized":"2024-09-15T22:42:44.085107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:42.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083571+0000","last_change":"2024-09-15T22:42:43.072740+0000","last_active":"2024-09-15T22:42:44.083571+0000","last_peered":"2024-09-15T22:42:44.083571+0000","last_clean":"2024-09-15T22:42:44.083571+0000","last_became_active":"2024-09-15T22:42:43.072420+0000","last_became_peered":"2024-09-15T22:42:43.072420+0000","last_unstale":"2024-09-15T22:42:44.083571+0000","last_undegraded":"2024-09-15T22:42:44.083571+0000","last_fullsized":"2024-09-15T22:42:44.083571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:12.995012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254321+0000","last_change":"2024-09-15T22:42:43.086588+0000","last_active":"2024-09-15T22:42:44.254321+0000","last_peered":"2024-09-15T22:42:44.254321+0000","last_clean":"2024-09-15T22:42:44.254321+0000","last_became_active":"2024-09-15T22:42:43.086132+0000","last_became_peered":"2024-09-15T22:42:43.086132+0000","last_unstale":"2024-09-15T22:42:44.254321+0000","last_undegraded":"2024-09-15T22:42:44.254321+0000","last_fullsized":"2024-09-15T22:42:44.254321+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:13.118400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255158+0000","last_change":"2024-09-15T22:42:43.079813+0000","last_active":"2024-09-15T22:42:44.255158+0000","last_peered":"2024-09-15T22:42:44.255158+0000","last_clean":"2024-09-15T22:42:44.255158+0000","last_became_active":"2024-09-15T22:42:43.079233+0000","last_became_peered":"2024-09-15T22:42:43.079233+0000","last_unstale":"2024-09-15T22:42:44.255158+0000","last_undegraded":"2024-09-15T22:42:44.255158+0000","last_fullsized":"2024-09-15T22:42:44.255158+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:14.365396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257935+0000","last_change":"2024-09-15T22:42:43.082902+0000","last_active":"2024-09-15T22:42:44.257935+0000","last_peered":"2024-09-15T22:42:44.257935+0000","last_clean":"2024-09-15T22:42:44.257935+0000","last_became_active":"2024-09-15T22:42:43.082581+0000","last_became_peered":"2024-09-15T22:42:43.082581+0000","last_unstale":"2024-09-15T22:42:44.257935+0000","last_undegraded":"2024-09-15T22:42:44.257935+0000","last_fullsized":"2024-09-15T22:42:44.257935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:06.205872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083401+0000","last_change":"2024-09-15T22:42:43.076167+0000","last_active":"2024-09-15T22:42:44.083401+0000","last_peered":"2024-09-15T22:42:44.083401+0000","last_clean":"2024-09-15T22:42:44.083401+0000","last_became_active":"2024-09-15T22:42:43.075921+0000","last_became_peered":"2024-09-15T22:42:43.075921+0000","last_unstale":"2024-09-15T22:42:44.083401+0000","last_undegraded":"2024-09-15T22:42:44.083401+0000","last_fullsized":"2024-09-15T22:42:44.083401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:47.198030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083329+0000","last_change":"2024-09-15T22:42:43.077175+0000","last_active":"2024-09-15T22:42:44.083329+0000","last_peered":"2024-09-15T22:42:44.083329+0000","last_clean":"2024-09-15T22:42:44.083329+0000","last_became_active":"2024-09-15T22:42:43.076911+0000","last_became_peered":"2024-09-15T22:42:43.076911+0000","last_unstale":"2024-09-15T22:42:44.083329+0000","last_undegraded":"2024-09-15T22:42:44.083329+0000","last_fullsized":"2024-09-15T22:42:44.083329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:16.127564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255130+0000","last_change":"2024-09-15T22:42:43.087180+0000","last_active":"2024-09-15T22:42:44.255130+0000","last_peered":"2024-09-15T22:42:44.255130+0000","last_clean":"2024-09-15T22:42:44.255130+0000","last_became_active":"2024-09-15T22:42:43.086833+0000","last_became_peered":"2024-09-15T22:42:43.086833+0000","last_unstale":"2024-09-15T22:42:44.255130+0000","last_undegraded":"2024-09-15T22:42:44.255130+0000","last_fullsized":"2024-09-15T22:42:44.255130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.257838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254349+0000","last_change":"2024-09-15T22:42:43.075816+0000","last_active":"2024-09-15T22:42:44.254349+0000","last_peered":"2024-09-15T22:42:44.254349+0000","last_clean":"2024-09-15T22:42:44.254349+0000","last_became_active":"2024-09-15T22:42:43.075474+0000","last_became_peered":"2024-09-15T22:42:43.075474+0000","last_unstale":"2024-09-15T22:42:44.254349+0000","last_undegraded":"2024-09-15T22:42:44.254349+0000","last_fullsized":"2024-09-15T22:42:44.254349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:41.204167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.075745+0000","last_change":"2024-09-15T22:42:43.071650+0000","last_active":"2024-09-15T22:42:43.075745+0000","last_peered":"2024-09-15T22:42:43.075745+0000","last_clean":"2024-09-15T22:42:43.075745+0000","last_became_active":"2024-09-15T22:42:43.071348+0000","last_became_peered":"2024-09-15T22:42:43.071348+0000","last_unstale":"2024-09-15T22:42:43.075745+0000","last_undegraded":"2024-09-15T22:42:43.075745+0000","last_fullsized":"2024-09-15T22:42:43.075745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:25.483287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257195+0000","last_change":"2024-09-15T22:42:43.077308+0000","last_active":"2024-09-15T22:42:44.257195+0000","last_peered":"2024-09-15T22:42:44.257195+0000","last_clean":"2024-09-15T22:42:44.257195+0000","last_became_active":"2024-09-15T22:42:43.075436+0000","last_became_peered":"2024-09-15T22:42:43.075436+0000","last_unstale":"2024-09-15T22:42:44.257195+0000","last_undegraded":"2024-09-15T22:42:44.257195+0000","last_fullsized":"2024-09-15T22:42:44.257195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085272+0000","last_change":"2024-09-15T22:42:43.093467+0000","last_active":"2024-09-15T22:42:44.085272+0000","last_peered":"2024-09-15T22:42:44.085272+0000","last_clean":"2024-09-15T22:42:44.085272+0000","last_became_active":"2024-09-15T22:42:43.093189+0000","last_became_peered":"2024-09-15T22:42:43.093189+0000","last_unstale":"2024-09-15T22:42:44.085272+0000","last_undegraded":"2024-09-15T22:42:44.085272+0000","last_fullsized":"2024-09-15T22:42:44.085272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:38.170032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091899+0000","last_change":"2024-09-15T22:42:42.068792+0000","last_active":"2024-09-15T22:42:43.091899+0000","last_peered":"2024-09-15T22:42:43.091899+0000","last_clean":"2024-09-15T22:42:43.091899+0000","last_became_active":"2024-09-15T22:42:42.068512+0000","last_became_peered":"2024-09-15T22:42:42.068512+0000","last_unstale":"2024-09-15T22:42:43.091899+0000","last_undegraded":"2024-09-15T22:42:43.091899+0000","last_fullsized":"2024-09-15T22:42:43.091899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:20.873965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255289+0000","last_change":"2024-09-15T22:42:43.077709+0000","last_active":"2024-09-15T22:42:44.255289+0000","last_peered":"2024-09-15T22:42:44.255289+0000","last_clean":"2024-09-15T22:42:44.255289+0000","last_became_active":"2024-09-15T22:42:43.076961+0000","last_became_peered":"2024-09-15T22:42:43.076961+0000","last_unstale":"2024-09-15T22:42:44.255289+0000","last_undegraded":"2024-09-15T22:42:44.255289+0000","last_fullsized":"2024-09-15T22:42:44.255289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:31.420019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083489+0000","last_change":"2024-09-15T22:42:42.068956+0000","last_active":"2024-09-15T22:42:44.083489+0000","last_peered":"2024-09-15T22:42:44.083489+0000","last_clean":"2024-09-15T22:42:44.083489+0000","last_became_active":"2024-09-15T22:42:42.068666+0000","last_became_peered":"2024-09-15T22:42:42.068666+0000","last_unstale":"2024-09-15T22:42:44.083489+0000","last_undegraded":"2024-09-15T22:42:44.083489+0000","last_fullsized":"2024-09-15T22:42:44.083489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:19.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254799+0000","last_change":"2024-09-15T22:42:43.095142+0000","last_active":"2024-09-15T22:42:44.254799+0000","last_peered":"2024-09-15T22:42:44.254799+0000","last_clean":"2024-09-15T22:42:44.254799+0000","last_became_active":"2024-09-15T22:42:43.094841+0000","last_became_peered":"2024-09-15T22:42:43.094841+0000","last_unstale":"2024-09-15T22:42:44.254799+0000","last_undegraded":"2024-09-15T22:42:44.254799+0000","last_fullsized":"2024-09-15T22:42:44.254799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:51.652879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.092102+0000","last_change":"2024-09-15T22:42:42.072466+0000","last_active":"2024-09-15T22:42:43.092102+0000","last_peered":"2024-09-15T22:42:43.092102+0000","last_clean":"2024-09-15T22:42:43.092102+0000","last_became_active":"2024-09-15T22:42:42.072206+0000","last_became_peered":"2024-09-15T22:42:42.072206+0000","last_unstale":"2024-09-15T22:42:43.092102+0000","last_undegraded":"2024-09-15T22:42:43.092102+0000","last_fullsized":"2024-09-15T22:42:43.092102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:44.164192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257947+0000","last_change":"2024-09-15T22:42:43.088709+0000","last_active":"2024-09-15T22:42:44.257947+0000","last_peered":"2024-09-15T22:42:44.257947+0000","last_clean":"2024-09-15T22:42:44.257947+0000","last_became_active":"2024-09-15T22:42:43.088438+0000","last_became_peered":"2024-09-15T22:42:43.088438+0000","last_unstale":"2024-09-15T22:42:44.257947+0000","last_undegraded":"2024-09-15T22:42:44.257947+0000","last_fullsized":"2024-09-15T22:42:44.257947+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.822681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083460+0000","last_change":"2024-09-15T22:42:42.068968+0000","last_active":"2024-09-15T22:42:44.083460+0000","last_peered":"2024-09-15T22:42:44.083460+0000","last_clean":"2024-09-15T22:42:44.083460+0000","last_became_active":"2024-09-15T22:42:42.068690+0000","last_became_peered":"2024-09-15T22:42:42.068690+0000","last_unstale":"2024-09-15T22:42:44.083460+0000","last_undegraded":"2024-09-15T22:42:44.083460+0000","last_fullsized":"2024-09-15T22:42:44.083460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:06.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083294+0000","last_change":"2024-09-15T22:42:43.072942+0000","last_active":"2024-09-15T22:42:44.083294+0000","last_peered":"2024-09-15T22:42:44.083294+0000","last_clean":"2024-09-15T22:42:44.083294+0000","last_became_active":"2024-09-15T22:42:43.072667+0000","last_became_peered":"2024-09-15T22:42:43.072667+0000","last_unstale":"2024-09-15T22:42:44.083294+0000","last_undegraded":"2024-09-15T22:42:44.083294+0000","last_fullsized":"2024-09-15T22:42:44.083294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:52.117719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.091392+0000","last_change":"2024-09-15T22:42:42.069587+0000","last_active":"2024-09-15T22:42:43.091392+0000","last_peered":"2024-09-15T22:42:43.091392+0000","last_clean":"2024-09-15T22:42:43.091392+0000","last_became_active":"2024-09-15T22:42:42.069207+0000","last_became_peered":"2024-09-15T22:42:42.069207+0000","last_unstale":"2024-09-15T22:42:43.091392+0000","last_undegraded":"2024-09-15T22:42:43.091392+0000","last_fullsized":"2024-09-15T22:42:43.091392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:54.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084614+0000","last_change":"2024-09-15T22:42:43.091144+0000","last_active":"2024-09-15T22:42:44.084614+0000","last_peered":"2024-09-15T22:42:44.084614+0000","last_clean":"2024-09-15T22:42:44.084614+0000","last_became_active":"2024-09-15T22:42:43.090818+0000","last_became_peered":"2024-09-15T22:42:43.090818+0000","last_unstale":"2024-09-15T22:42:44.084614+0000","last_undegraded":"2024-09-15T22:42:44.084614+0000","last_fullsized":"2024-09-15T22:42:44.084614+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:05.795762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083177+0000","last_change":"2024-09-15T22:42:42.072430+0000","last_active":"2024-09-15T22:42:44.083177+0000","last_peered":"2024-09-15T22:42:44.083177+0000","last_clean":"2024-09-15T22:42:44.083177+0000","last_became_active":"2024-09-15T22:42:42.072152+0000","last_became_peered":"2024-09-15T22:42:42.072152+0000","last_unstale":"2024-09-15T22:42:44.083177+0000","last_undegraded":"2024-09-15T22:42:44.083177+0000","last_fullsized":"2024-09-15T22:42:44.083177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:09.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084222+0000","last_change":"2024-09-15T22:42:43.092675+0000","last_active":"2024-09-15T22:42:44.084222+0000","last_peered":"2024-09-15T22:42:44.084222+0000","last_clean":"2024-09-15T22:42:44.084222+0000","last_became_active":"2024-09-15T22:42:43.092366+0000","last_became_peered":"2024-09-15T22:42:43.092366+0000","last_unstale":"2024-09-15T22:42:44.084222+0000","last_undegraded":"2024-09-15T22:42:44.084222+0000","last_fullsized":"2024-09-15T22:42:44.084222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:20.505149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254871+0000","last_change":"2024-09-15T22:42:42.071098+0000","last_active":"2024-09-15T22:42:44.254871+0000","last_peered":"2024-09-15T22:42:44.254871+0000","last_clean":"2024-09-15T22:42:44.254871+0000","last_became_active":"2024-09-15T22:42:42.070813+0000","last_became_peered":"2024-09-15T22:42:42.070813+0000","last_unstale":"2024-09-15T22:42:44.254871+0000","last_undegraded":"2024-09-15T22:42:44.254871+0000","last_fullsized":"2024-09-15T22:42:44.254871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:35.129820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083133+0000","last_change":"2024-09-15T22:42:43.073717+0000","last_active":"2024-09-15T22:42:44.083133+0000","last_peered":"2024-09-15T22:42:44.083133+0000","last_clean":"2024-09-15T22:42:44.083133+0000","last_became_active":"2024-09-15T22:42:43.073452+0000","last_became_peered":"2024-09-15T22:42:43.073452+0000","last_unstale":"2024-09-15T22:42:44.083133+0000","last_undegraded":"2024-09-15T22:42:44.083133+0000","last_fullsized":"2024-09-15T22:42:44.083133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:07:10.804663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084038+0000","last_change":"2024-09-15T22:42:42.070355+0000","last_active":"2024-09-15T22:42:44.084038+0000","last_peered":"2024-09-15T22:42:44.084038+0000","last_clean":"2024-09-15T22:42:44.084038+0000","last_became_active":"2024-09-15T22:42:42.070165+0000","last_became_peered":"2024-09-15T22:42:42.070165+0000","last_unstale":"2024-09-15T22:42:44.084038+0000","last_undegraded":"2024-09-15T22:42:44.084038+0000","last_fullsized":"2024-09-15T22:42:44.084038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:11.710177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255858+0000","last_change":"2024-09-15T22:42:43.071059+0000","last_active":"2024-09-15T22:42:44.255858+0000","last_peered":"2024-09-15T22:42:44.255858+0000","last_clean":"2024-09-15T22:42:44.255858+0000","last_became_active":"2024-09-15T22:42:43.070779+0000","last_became_peered":"2024-09-15T22:42:43.070779+0000","last_unstale":"2024-09-15T22:42:44.255858+0000","last_undegraded":"2024-09-15T22:42:44.255858+0000","last_fullsized":"2024-09-15T22:42:44.255858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:49.210136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255643+0000","last_change":"2024-09-15T22:42:42.061536+0000","last_active":"2024-09-15T22:42:44.255643+0000","last_peered":"2024-09-15T22:42:44.255643+0000","last_clean":"2024-09-15T22:42:44.255643+0000","last_became_active":"2024-09-15T22:42:42.061246+0000","last_became_peered":"2024-09-15T22:42:42.061246+0000","last_unstale":"2024-09-15T22:42:44.255643+0000","last_undegraded":"2024-09-15T22:42:44.255643+0000","last_fullsized":"2024-09-15T22:42:44.255643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:40.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255592+0000","last_change":"2024-09-15T22:42:43.072786+0000","last_active":"2024-09-15T22:42:44.255592+0000","last_peered":"2024-09-15T22:42:44.255592+0000","last_clean":"2024-09-15T22:42:44.255592+0000","last_became_active":"2024-09-15T22:42:43.072470+0000","last_became_peered":"2024-09-15T22:42:43.072470+0000","last_unstale":"2024-09-15T22:42:44.255592+0000","last_undegraded":"2024-09-15T22:42:44.255592+0000","last_fullsized":"2024-09-15T22:42:44.255592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.815981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085138+0000","last_change":"2024-09-15T22:42:42.067535+0000","last_active":"2024-09-15T22:42:44.085138+0000","last_peered":"2024-09-15T22:42:44.085138+0000","last_clean":"2024-09-15T22:42:44.085138+0000","last_became_active":"2024-09-15T22:42:42.067250+0000","last_became_peered":"2024-09-15T22:42:42.067250+0000","last_unstale":"2024-09-15T22:42:44.085138+0000","last_undegraded":"2024-09-15T22:42:44.085138+0000","last_fullsized":"2024-09-15T22:42:44.085138+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.471152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257799+0000","last_change":"2024-09-15T22:42:43.095237+0000","last_active":"2024-09-15T22:42:44.257799+0000","last_peered":"2024-09-15T22:42:44.257799+0000","last_clean":"2024-09-15T22:42:44.257799+0000","last_became_active":"2024-09-15T22:42:43.094920+0000","last_became_peered":"2024-09-15T22:42:43.094920+0000","last_unstale":"2024-09-15T22:42:44.257799+0000","last_undegraded":"2024-09-15T22:42:44.257799+0000","last_fullsized":"2024-09-15T22:42:44.257799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:07.773123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254487+0000","last_change":"2024-09-15T22:42:42.072518+0000","last_active":"2024-09-15T22:42:44.254487+0000","last_peered":"2024-09-15T22:42:44.254487+0000","last_clean":"2024-09-15T22:42:44.254487+0000","last_became_active":"2024-09-15T22:42:42.072128+0000","last_became_peered":"2024-09-15T22:42:42.072128+0000","last_unstale":"2024-09-15T22:42:44.254487+0000","last_undegraded":"2024-09-15T22:42:44.254487+0000","last_fullsized":"2024-09-15T22:42:44.254487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083360+0000","last_change":"2024-09-15T22:42:43.082589+0000","last_active":"2024-09-15T22:42:44.083360+0000","last_peered":"2024-09-15T22:42:44.083360+0000","last_clean":"2024-09-15T22:42:44.083360+0000","last_became_active":"2024-09-15T22:42:43.082136+0000","last_became_peered":"2024-09-15T22:42:43.082136+0000","last_unstale":"2024-09-15T22:42:44.083360+0000","last_undegraded":"2024-09-15T22:42:44.083360+0000","last_fullsized":"2024-09-15T22:42:44.083360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:42.328669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084739+0000","last_change":"2024-09-15T22:42:42.065819+0000","last_active":"2024-09-15T22:42:44.084739+0000","last_peered":"2024-09-15T22:42:44.084739+0000","last_clean":"2024-09-15T22:42:44.084739+0000","last_became_active":"2024-09-15T22:42:42.065462+0000","last_became_peered":"2024-09-15T22:42:42.065462+0000","last_unstale":"2024-09-15T22:42:44.084739+0000","last_undegraded":"2024-09-15T22:42:44.084739+0000","last_fullsized":"2024-09-15T22:42:44.084739+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:40.200048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255468+0000","last_change":"2024-09-15T22:42:43.075537+0000","last_active":"2024-09-15T22:42:44.255468+0000","last_peered":"2024-09-15T22:42:44.255468+0000","last_clean":"2024-09-15T22:42:44.255468+0000","last_became_active":"2024-09-15T22:42:43.075250+0000","last_became_peered":"2024-09-15T22:42:43.075250+0000","last_unstale":"2024-09-15T22:42:44.255468+0000","last_undegraded":"2024-09-15T22:42:44.255468+0000","last_fullsized":"2024-09-15T22:42:44.255468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:43.872832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085086+0000","last_change":"2024-09-15T22:42:42.065034+0000","last_active":"2024-09-15T22:42:44.085086+0000","last_peered":"2024-09-15T22:42:44.085086+0000","last_clean":"2024-09-15T22:42:44.085086+0000","last_became_active":"2024-09-15T22:42:42.064710+0000","last_became_peered":"2024-09-15T22:42:42.064710+0000","last_unstale":"2024-09-15T22:42:44.085086+0000","last_undegraded":"2024-09-15T22:42:44.085086+0000","last_fullsized":"2024-09-15T22:42:44.085086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.306426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084952+0000","last_change":"2024-09-15T22:42:43.076531+0000","last_active":"2024-09-15T22:42:44.084952+0000","last_peered":"2024-09-15T22:42:44.084952+0000","last_clean":"2024-09-15T22:42:44.084952+0000","last_became_active":"2024-09-15T22:42:43.076169+0000","last_became_peered":"2024-09-15T22:42:43.076169+0000","last_unstale":"2024-09-15T22:42:44.084952+0000","last_undegraded":"2024-09-15T22:42:44.084952+0000","last_fullsized":"2024-09-15T22:42:44.084952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.815981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254686+0000","last_change":"2024-09-15T22:42:42.070251+0000","last_active":"2024-09-15T22:42:44.254686+0000","last_peered":"2024-09-15T22:42:44.254686+0000","last_clean":"2024-09-15T22:42:44.254686+0000","last_became_active":"2024-09-15T22:42:42.069996+0000","last_became_peered":"2024-09-15T22:42:42.069996+0000","last_unstale":"2024-09-15T22:42:44.254686+0000","last_undegraded":"2024-09-15T22:42:44.254686+0000","last_fullsized":"2024-09-15T22:42:44.254686+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:42.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084672+0000","last_change":"2024-09-15T22:42:43.094353+0000","last_active":"2024-09-15T22:42:44.084672+0000","last_peered":"2024-09-15T22:42:44.084672+0000","last_clean":"2024-09-15T22:42:44.084672+0000","last_became_active":"2024-09-15T22:42:43.094086+0000","last_became_peered":"2024-09-15T22:42:43.094086+0000","last_unstale":"2024-09-15T22:42:44.084672+0000","last_undegraded":"2024-09-15T22:42:44.084672+0000","last_fullsized":"2024-09-15T22:42:44.084672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:43.872832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065759+0000","last_change":"2024-09-15T22:42:42.062757+0000","last_active":"2024-09-15T22:42:43.065759+0000","last_peered":"2024-09-15T22:42:43.065759+0000","last_clean":"2024-09-15T22:42:43.065759+0000","last_became_active":"2024-09-15T22:42:42.062432+0000","last_became_peered":"2024-09-15T22:42:42.062432+0000","last_unstale":"2024-09-15T22:42:43.065759+0000","last_undegraded":"2024-09-15T22:42:43.065759+0000","last_fullsized":"2024-09-15T22:42:43.065759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:49.387947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254400+0000","last_change":"2024-09-15T22:42:43.078577+0000","last_active":"2024-09-15T22:42:44.254400+0000","last_peered":"2024-09-15T22:42:44.254400+0000","last_clean":"2024-09-15T22:42:44.254400+0000","last_became_active":"2024-09-15T22:42:43.078300+0000","last_became_peered":"2024-09-15T22:42:43.078300+0000","last_unstale":"2024-09-15T22:42:44.254400+0000","last_undegraded":"2024-09-15T22:42:44.254400+0000","last_fullsized":"2024-09-15T22:42:44.254400+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:12.714297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084217+0000","last_change":"2024-09-15T22:42:42.062990+0000","last_active":"2024-09-15T22:42:44.084217+0000","last_peered":"2024-09-15T22:42:44.084217+0000","last_clean":"2024-09-15T22:42:44.084217+0000","last_became_active":"2024-09-15T22:42:42.062718+0000","last_became_peered":"2024-09-15T22:42:42.062718+0000","last_unstale":"2024-09-15T22:42:44.084217+0000","last_undegraded":"2024-09-15T22:42:44.084217+0000","last_fullsized":"2024-09-15T22:42:44.084217+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:48.823862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085421+0000","last_change":"2024-09-15T22:42:43.074946+0000","last_active":"2024-09-15T22:42:44.085421+0000","last_peered":"2024-09-15T22:42:44.085421+0000","last_clean":"2024-09-15T22:42:44.085421+0000","last_became_active":"2024-09-15T22:42:43.074681+0000","last_became_peered":"2024-09-15T22:42:43.074681+0000","last_unstale":"2024-09-15T22:42:44.085421+0000","last_undegraded":"2024-09-15T22:42:44.085421+0000","last_fullsized":"2024-09-15T22:42:44.085421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:49.210136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257981+0000","last_change":"2024-09-15T22:42:42.069570+0000","last_active":"2024-09-15T22:42:44.257981+0000","last_peered":"2024-09-15T22:42:44.257981+0000","last_clean":"2024-09-15T22:42:44.257981+0000","last_became_active":"2024-09-15T22:42:42.069291+0000","last_became_peered":"2024-09-15T22:42:42.069291+0000","last_unstale":"2024-09-15T22:42:44.257981+0000","last_undegraded":"2024-09-15T22:42:44.257981+0000","last_fullsized":"2024-09-15T22:42:44.257981+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:36.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085048+0000","last_change":"2024-09-15T22:42:43.092837+0000","last_active":"2024-09-15T22:42:44.085048+0000","last_peered":"2024-09-15T22:42:44.085048+0000","last_clean":"2024-09-15T22:42:44.085048+0000","last_became_active":"2024-09-15T22:42:43.092505+0000","last_became_peered":"2024-09-15T22:42:43.092505+0000","last_unstale":"2024-09-15T22:42:44.085048+0000","last_undegraded":"2024-09-15T22:42:44.085048+0000","last_fullsized":"2024-09-15T22:42:44.085048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.434965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255925+0000","last_change":"2024-09-15T22:42:42.065863+0000","last_active":"2024-09-15T22:42:44.255925+0000","last_peered":"2024-09-15T22:42:44.255925+0000","last_clean":"2024-09-15T22:42:44.255925+0000","last_became_active":"2024-09-15T22:42:42.065572+0000","last_became_peered":"2024-09-15T22:42:42.065572+0000","last_unstale":"2024-09-15T22:42:44.255925+0000","last_undegraded":"2024-09-15T22:42:44.255925+0000","last_fullsized":"2024-09-15T22:42:44.255925+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.306426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254929+0000","last_change":"2024-09-15T22:42:43.082172+0000","last_active":"2024-09-15T22:42:44.254929+0000","last_peered":"2024-09-15T22:42:44.254929+0000","last_clean":"2024-09-15T22:42:44.254929+0000","last_became_active":"2024-09-15T22:42:43.081805+0000","last_became_peered":"2024-09-15T22:42:43.081805+0000","last_unstale":"2024-09-15T22:42:44.254929+0000","last_undegraded":"2024-09-15T22:42:44.254929+0000","last_fullsized":"2024-09-15T22:42:44.254929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.243318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255857+0000","last_change":"2024-09-15T22:42:42.062527+0000","last_active":"2024-09-15T22:42:44.255857+0000","last_peered":"2024-09-15T22:42:44.255857+0000","last_clean":"2024-09-15T22:42:44.255857+0000","last_became_active":"2024-09-15T22:42:42.062259+0000","last_became_peered":"2024-09-15T22:42:42.062259+0000","last_unstale":"2024-09-15T22:42:44.255857+0000","last_undegraded":"2024-09-15T22:42:44.255857+0000","last_fullsized":"2024-09-15T22:42:44.255857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255773+0000","last_change":"2024-09-15T22:42:43.089387+0000","last_active":"2024-09-15T22:42:44.255773+0000","last_peered":"2024-09-15T22:42:44.255773+0000","last_clean":"2024-09-15T22:42:44.255773+0000","last_became_active":"2024-09-15T22:42:43.088623+0000","last_became_peered":"2024-09-15T22:42:43.088623+0000","last_unstale":"2024-09-15T22:42:44.255773+0000","last_undegraded":"2024-09-15T22:42:44.255773+0000","last_fullsized":"2024-09-15T22:42:44.255773+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:38.170032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065540+0000","last_change":"2024-09-15T22:42:42.063551+0000","last_active":"2024-09-15T22:42:43.065540+0000","last_peered":"2024-09-15T22:42:43.065540+0000","last_clean":"2024-09-15T22:42:43.065540+0000","last_became_active":"2024-09-15T22:42:42.063299+0000","last_became_peered":"2024-09-15T22:42:42.063299+0000","last_unstale":"2024-09-15T22:42:43.065540+0000","last_undegraded":"2024-09-15T22:42:43.065540+0000","last_fullsized":"2024-09-15T22:42:43.065540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.076628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084647+0000","last_change":"2024-09-15T22:42:43.086377+0000","last_active":"2024-09-15T22:42:44.084647+0000","last_peered":"2024-09-15T22:42:44.084647+0000","last_clean":"2024-09-15T22:42:44.084647+0000","last_became_active":"2024-09-15T22:42:43.086095+0000","last_became_peered":"2024-09-15T22:42:43.086095+0000","last_unstale":"2024-09-15T22:42:44.084647+0000","last_undegraded":"2024-09-15T22:42:44.084647+0000","last_fullsized":"2024-09-15T22:42:44.084647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:50.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084559+0000","last_change":"2024-09-15T22:42:42.067256+0000","last_active":"2024-09-15T22:42:44.084559+0000","last_peered":"2024-09-15T22:42:44.084559+0000","last_clean":"2024-09-15T22:42:44.084559+0000","last_became_active":"2024-09-15T22:42:42.067007+0000","last_became_peered":"2024-09-15T22:42:42.067007+0000","last_unstale":"2024-09-15T22:42:44.084559+0000","last_undegraded":"2024-09-15T22:42:44.084559+0000","last_fullsized":"2024-09-15T22:42:44.084559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:31.254765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.089641+0000","last_change":"2024-09-15T22:42:43.079711+0000","last_active":"2024-09-15T22:42:43.089641+0000","last_peered":"2024-09-15T22:42:43.089641+0000","last_clean":"2024-09-15T22:42:43.089641+0000","last_became_active":"2024-09-15T22:42:43.079435+0000","last_became_peered":"2024-09-15T22:42:43.079435+0000","last_unstale":"2024-09-15T22:42:43.089641+0000","last_undegraded":"2024-09-15T22:42:43.089641+0000","last_fullsized":"2024-09-15T22:42:43.089641+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:24.892136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254767+0000","last_change":"2024-09-15T22:42:42.072411+0000","last_active":"2024-09-15T22:42:44.254767+0000","last_peered":"2024-09-15T22:42:44.254767+0000","last_clean":"2024-09-15T22:42:44.254767+0000","last_became_active":"2024-09-15T22:42:42.072089+0000","last_became_peered":"2024-09-15T22:42:42.072089+0000","last_unstale":"2024-09-15T22:42:44.254767+0000","last_undegraded":"2024-09-15T22:42:44.254767+0000","last_fullsized":"2024-09-15T22:42:44.254767+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:56.104083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257579+0000","last_change":"2024-09-15T22:42:43.084322+0000","last_active":"2024-09-15T22:42:44.257579+0000","last_peered":"2024-09-15T22:42:44.257579+0000","last_clean":"2024-09-15T22:42:44.257579+0000","last_became_active":"2024-09-15T22:42:43.079448+0000","last_became_peered":"2024-09-15T22:42:43.079448+0000","last_unstale":"2024-09-15T22:42:44.257579+0000","last_undegraded":"2024-09-15T22:42:44.257579+0000","last_fullsized":"2024-09-15T22:42:44.257579+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:31.420019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084050+0000","last_change":"2024-09-15T22:42:42.067428+0000","last_active":"2024-09-15T22:42:44.084050+0000","last_peered":"2024-09-15T22:42:44.084050+0000","last_clean":"2024-09-15T22:42:44.084050+0000","last_became_active":"2024-09-15T22:42:42.067152+0000","last_became_peered":"2024-09-15T22:42:42.067152+0000","last_unstale":"2024-09-15T22:42:44.084050+0000","last_undegraded":"2024-09-15T22:42:44.084050+0000","last_fullsized":"2024-09-15T22:42:44.084050+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:12.114281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257385+0000","last_change":"2024-09-15T22:42:43.093162+0000","last_active":"2024-09-15T22:42:44.257385+0000","last_peered":"2024-09-15T22:42:44.257385+0000","last_clean":"2024-09-15T22:42:44.257385+0000","last_became_active":"2024-09-15T22:42:43.092501+0000","last_became_peered":"2024-09-15T22:42:43.092501+0000","last_unstale":"2024-09-15T22:42:44.257385+0000","last_undegraded":"2024-09-15T22:42:44.257385+0000","last_fullsized":"2024-09-15T22:42:44.257385+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:52.075951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083053+0000","last_change":"2024-09-15T22:42:42.063666+0000","last_active":"2024-09-15T22:42:44.083053+0000","last_peered":"2024-09-15T22:42:44.083053+0000","last_clean":"2024-09-15T22:42:44.083053+0000","last_became_active":"2024-09-15T22:42:42.063382+0000","last_became_peered":"2024-09-15T22:42:42.063382+0000","last_unstale":"2024-09-15T22:42:44.083053+0000","last_undegraded":"2024-09-15T22:42:44.083053+0000","last_fullsized":"2024-09-15T22:42:44.083053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:13.361276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083345+0000","last_change":"2024-09-15T22:42:43.071063+0000","last_active":"2024-09-15T22:42:44.083345+0000","last_peered":"2024-09-15T22:42:44.083345+0000","last_clean":"2024-09-15T22:42:44.083345+0000","last_became_active":"2024-09-15T22:42:43.070765+0000","last_became_peered":"2024-09-15T22:42:43.070765+0000","last_unstale":"2024-09-15T22:42:44.083345+0000","last_undegraded":"2024-09-15T22:42:44.083345+0000","last_fullsized":"2024-09-15T22:42:44.083345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:54.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.258025+0000","last_change":"2024-09-15T22:42:42.070148+0000","last_active":"2024-09-15T22:42:44.258025+0000","last_peered":"2024-09-15T22:42:44.258025+0000","last_clean":"2024-09-15T22:42:44.258025+0000","last_became_active":"2024-09-15T22:42:42.069826+0000","last_became_peered":"2024-09-15T22:42:42.069826+0000","last_unstale":"2024-09-15T22:42:44.258025+0000","last_undegraded":"2024-09-15T22:42:44.258025+0000","last_fullsized":"2024-09-15T22:42:44.258025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:56.445574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084745+0000","last_change":"2024-09-15T22:42:43.094516+0000","last_active":"2024-09-15T22:42:44.084745+0000","last_peered":"2024-09-15T22:42:44.084745+0000","last_clean":"2024-09-15T22:42:44.084745+0000","last_became_active":"2024-09-15T22:42:43.093536+0000","last_became_peered":"2024-09-15T22:42:43.093536+0000","last_unstale":"2024-09-15T22:42:44.084745+0000","last_undegraded":"2024-09-15T22:42:44.084745+0000","last_fullsized":"2024-09-15T22:42:44.084745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:06.205872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254878+0000","last_change":"2024-09-15T22:42:42.074314+0000","last_active":"2024-09-15T22:42:44.254878+0000","last_peered":"2024-09-15T22:42:44.254878+0000","last_clean":"2024-09-15T22:42:44.254878+0000","last_became_active":"2024-09-15T22:42:42.074020+0000","last_became_peered":"2024-09-15T22:42:42.074020+0000","last_unstale":"2024-09-15T22:42:44.254878+0000","last_undegraded":"2024-09-15T22:42:44.254878+0000","last_fullsized":"2024-09-15T22:42:44.254878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:26.794194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083525+0000","last_change":"2024-09-15T22:42:43.082746+0000","last_active":"2024-09-15T22:42:44.083525+0000","last_peered":"2024-09-15T22:42:44.083525+0000","last_clean":"2024-09-15T22:42:44.083525+0000","last_became_active":"2024-09-15T22:42:43.082487+0000","last_became_peered":"2024-09-15T22:42:43.082487+0000","last_unstale":"2024-09-15T22:42:44.083525+0000","last_undegraded":"2024-09-15T22:42:44.083525+0000","last_fullsized":"2024-09-15T22:42:44.083525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:54.145129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.085171+0000","last_change":"2024-09-15T22:42:42.068455+0000","last_active":"2024-09-15T22:42:44.085171+0000","last_peered":"2024-09-15T22:42:44.085171+0000","last_clean":"2024-09-15T22:42:44.085171+0000","last_became_active":"2024-09-15T22:42:42.068086+0000","last_became_peered":"2024-09-15T22:42:42.068086+0000","last_unstale":"2024-09-15T22:42:44.085171+0000","last_undegraded":"2024-09-15T22:42:44.085171+0000","last_fullsized":"2024-09-15T22:42:44.085171+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:45.504405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084447+0000","last_change":"2024-09-15T22:42:43.085325+0000","last_active":"2024-09-15T22:42:44.084447+0000","last_peered":"2024-09-15T22:42:44.084447+0000","last_clean":"2024-09-15T22:42:44.084447+0000","last_became_active":"2024-09-15T22:42:43.084992+0000","last_became_peered":"2024-09-15T22:42:43.084992+0000","last_unstale":"2024-09-15T22:42:44.084447+0000","last_undegraded":"2024-09-15T22:42:44.084447+0000","last_fullsized":"2024-09-15T22:42:44.084447+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.872170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255142+0000","last_change":"2024-09-15T22:42:42.073188+0000","last_active":"2024-09-15T22:42:44.255142+0000","last_peered":"2024-09-15T22:42:44.255142+0000","last_clean":"2024-09-15T22:42:44.255142+0000","last_became_active":"2024-09-15T22:42:42.072903+0000","last_became_peered":"2024-09-15T22:42:42.072903+0000","last_unstale":"2024-09-15T22:42:44.255142+0000","last_undegraded":"2024-09-15T22:42:44.255142+0000","last_fullsized":"2024-09-15T22:42:44.255142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.417328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257657+0000","last_change":"2024-09-15T22:42:43.083724+0000","last_active":"2024-09-15T22:42:44.257657+0000","last_peered":"2024-09-15T22:42:44.257657+0000","last_clean":"2024-09-15T22:42:44.257657+0000","last_became_active":"2024-09-15T22:42:43.082753+0000","last_became_peered":"2024-09-15T22:42:43.082753+0000","last_unstale":"2024-09-15T22:42:44.257657+0000","last_undegraded":"2024-09-15T22:42:44.257657+0000","last_fullsized":"2024-09-15T22:42:44.257657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:20.505149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083268+0000","last_change":"2024-09-15T22:42:42.064223+0000","last_active":"2024-09-15T22:42:44.083268+0000","last_peered":"2024-09-15T22:42:44.083268+0000","last_clean":"2024-09-15T22:42:44.083268+0000","last_became_active":"2024-09-15T22:42:42.063968+0000","last_became_peered":"2024-09-15T22:42:42.063968+0000","last_unstale":"2024-09-15T22:42:44.083268+0000","last_undegraded":"2024-09-15T22:42:44.083268+0000","last_fullsized":"2024-09-15T22:42:44.083268+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:04.791643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255159+0000","last_change":"2024-09-15T22:42:43.074767+0000","last_active":"2024-09-15T22:42:44.255159+0000","last_peered":"2024-09-15T22:42:44.255159+0000","last_clean":"2024-09-15T22:42:44.255159+0000","last_became_active":"2024-09-15T22:42:43.074514+0000","last_became_peered":"2024-09-15T22:42:43.074514+0000","last_unstale":"2024-09-15T22:42:44.255159+0000","last_undegraded":"2024-09-15T22:42:44.255159+0000","last_fullsized":"2024-09-15T22:42:44.255159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:20.204465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T22:42:43.065645+0000","last_change":"2024-09-15T22:42:42.065936+0000","last_active":"2024-09-15T22:42:43.065645+0000","last_peered":"2024-09-15T22:42:43.065645+0000","last_clean":"2024-09-15T22:42:43.065645+0000","last_became_active":"2024-09-15T22:42:42.065495+0000","last_became_peered":"2024-09-15T22:42:42.065495+0000","last_unstale":"2024-09-15T22:42:43.065645+0000","last_undegraded":"2024-09-15T22:42:43.065645+0000","last_fullsized":"2024-09-15T22:42:43.065645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:18.016844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.254548+0000","last_change":"2024-09-15T22:42:43.076389+0000","last_active":"2024-09-15T22:42:44.254548+0000","last_peered":"2024-09-15T22:42:44.254548+0000","last_clean":"2024-09-15T22:42:44.254548+0000","last_became_active":"2024-09-15T22:42:43.076111+0000","last_became_peered":"2024-09-15T22:42:43.076111+0000","last_unstale":"2024-09-15T22:42:44.254548+0000","last_undegraded":"2024-09-15T22:42:44.254548+0000","last_fullsized":"2024-09-15T22:42:44.254548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:49.827981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.084801+0000","last_change":"2024-09-15T22:42:42.064210+0000","last_active":"2024-09-15T22:42:44.084801+0000","last_peered":"2024-09-15T22:42:44.084801+0000","last_clean":"2024-09-15T22:42:44.084801+0000","last_became_active":"2024-09-15T22:42:42.063846+0000","last_became_peered":"2024-09-15T22:42:42.063846+0000","last_unstale":"2024-09-15T22:42:44.084801+0000","last_undegraded":"2024-09-15T22:42:44.084801+0000","last_fullsized":"2024-09-15T22:42:44.084801+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:31.899917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.257955+0000","last_change":"2024-09-15T22:42:43.081934+0000","last_active":"2024-09-15T22:42:44.257955+0000","last_peered":"2024-09-15T22:42:44.257955+0000","last_clean":"2024-09-15T22:42:44.257955+0000","last_became_active":"2024-09-15T22:42:43.081670+0000","last_became_peered":"2024-09-15T22:42:43.081670+0000","last_unstale":"2024-09-15T22:42:44.257955+0000","last_undegraded":"2024-09-15T22:42:44.257955+0000","last_fullsized":"2024-09-15T22:42:44.257955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:42.047934+0000","last_clean_scrub_stamp":"2024-09-15T22:42:42.047934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:40.342656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.083436+0000","last_change":"2024-09-15T22:42:42.070506+0000","last_active":"2024-09-15T22:42:44.083436+0000","last_peered":"2024-09-15T22:42:44.083436+0000","last_clean":"2024-09-15T22:42:44.083436+0000","last_became_active":"2024-09-15T22:42:42.070239+0000","last_became_peered":"2024-09-15T22:42:42.070239+0000","last_unstale":"2024-09-15T22:42:44.083436+0000","last_undegraded":"2024-09-15T22:42:44.083436+0000","last_fullsized":"2024-09-15T22:42:44.083436+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:41.043815+0000","last_clean_scrub_stamp":"2024-09-15T22:42:41.043815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:30.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":211,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-15T22:42:44.255194+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:42:44.255194+0000","last_peered":"2024-09-15T22:42:44.255194+0000","last_clean":"2024-09-15T22:42:44.255194+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:42:44.255194+0000","last_undegraded":"2024-09-15T22:42:44.255194+0000","last_fullsized":"2024-09-15T22:42:44.255194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":218299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1142784,"data_stored":808655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":565248,"data_stored":219969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":219877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":218355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1142784,"data_stored":808703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":552960,"data_stored":218937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":212581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:42:50.684 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:42:50.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:42:50.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.826+0000 7fdf14333640 1 Processor -- start 2024-09-15T22:42:50.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.826+0000 7fdf14333640 1 -- start start 2024-09-15T22:42:50.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf14333640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf14333640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 0x7fdf0c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf14333640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c0711a0 con 0x7fdf0c0d24f0 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf14333640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c0b5be0 con 0x7fdf0c15eb10 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf14333640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c06e5d0 con 0x7fdf0c070d30 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58022/0 (socket says 172.21.15.134:58022) 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 -- 172.21.15.134:0/1038001592 learned_addr learned my addr 172.21.15.134:0/1038001592 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf118ce640 1 --2- 172.21.15.134:0/1038001592 >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 0x7fdf0c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 -- 172.21.15.134:0/1038001592 >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 msgr2=0x7fdf0c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 --2- 172.21.15.134:0/1038001592 >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 0x7fdf0c0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 -- 172.21.15.134:0/1038001592 >> v1:172.21.15.177:6789/0 conn(0x7fdf0c0d24f0 legacy=0x7fdf0c0d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:50.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf120cf640 1 -- 172.21.15.134:0/1038001592 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c071760 con 0x7fdf0c15eb10 2024-09-15T22:42:50.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.827+0000 7fdf118ce640 1 --2- 172.21.15.134:0/1038001592 >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 0x7fdf0c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf120cf640 1 --2- 172.21.15.134:0/1038001592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c070c10 tx=0x7fdf0802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f91cfd69d9257a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf110cd640 1 -- 172.21.15.134:0/1038001592 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08037070 con 0x7fdf0c15eb10 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf110cd640 1 -- 172.21.15.134:0/1038001592 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf08032440 con 0x7fdf0c15eb10 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf110cd640 1 -- 172.21.15.134:0/1038001592 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08032810 con 0x7fdf0c15eb10 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf14333640 1 -- 172.21.15.134:0/1038001592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c15eb10 msgr2=0x7fdf0c06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.828+0000 7fdf14333640 1 --2- 172.21.15.134:0/1038001592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c070c10 tx=0x7fdf0802a230 comp rx=0 tx=0).stop 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 -- 172.21.15.134:0/1038001592 shutdown_connections 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 --2- 172.21.15.134:0/1038001592 >> v2:172.21.15.177:3300/0 conn(0x7fdf0c070d30 0x7fdf0c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 --2- 172.21.15.134:0/1038001592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c15eb10 0x7fdf0c06ccb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 -- 172.21.15.134:0/1038001592 >> 172.21.15.134:0/1038001592 conn(0x7fdf0c06f370 msgr2=0x7fdf0c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:50.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 -- 172.21.15.134:0/1038001592 shutdown_connections 2024-09-15T22:42:50.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.829+0000 7fdf14333640 1 -- 172.21.15.134:0/1038001592 wait complete. 2024-09-15T22:42:50.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 Processor -- start 2024-09-15T22:42:50.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 -- start start 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c0d24f0 0x7fdf0c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf0c15eb10 0x7fdf0c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c06eb00 con 0x7fdf0c070d30 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c06e820 con 0x7fdf0c0d24f0 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.830+0000 7fdf14333640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c15f210 con 0x7fdf0c15eb10 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58028/0 (socket says 172.21.15.134:58028) 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 -- 172.21.15.134:0/2303992624 learned_addr learned my addr 172.21.15.134:0/2303992624 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 -- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf0c15eb10 msgr2=0x7fdf0c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf0c15eb10 0x7fdf0c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 -- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c0d24f0 msgr2=0x7fdf0c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c0d24f0 0x7fdf0c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 -- 172.21.15.134:0/2303992624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c159d70 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf120cf640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf08000c00 tx=0x7fdf080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08041020 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf08030970 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c15a050 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08037040 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.831+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c15a610 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.832+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c0b56a0 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.832+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fdf08044020 con 0x7fdf0c070d30 2024-09-15T22:42:50.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.833+0000 7fdf02ffd640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 0x7fdef006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:50.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.833+0000 7fdf118ce640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 0x7fdef006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:50.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.833+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fdf080ac100 con 0x7fdf0c070d30 2024-09-15T22:42:50.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.833+0000 7fdf118ce640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 0x7fdef006e920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdefc006fd0 tx=0x7fdefc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:50.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:50.837+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf0804b030 con 0x7fdf0c070d30 2024-09-15T22:42:51.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.067+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdf0c06e110 con 0x7fdf0c070d30 2024-09-15T22:42:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.069+0000 7fdf02ffd640 1 -- 172.21.15.134:0/2303992624 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fdf0807a680 con 0x7fdf0c070d30 2024-09-15T22:42:51.070 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:42:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:42:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:42:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:42:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:42:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:42:51.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 msgr2=0x7fdef006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 0x7fdef006e920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdefc006fd0 tx=0x7fdefc008040 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 msgr2=0x7fdf0c14c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf08000c00 tx=0x7fdf080046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 shutdown_connections 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fdef006c460 0x7fdef006e920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf0c15eb10 0x7fdf0c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c0d24f0 0x7fdf0c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 --2- 172.21.15.134:0/2303992624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c070d30 0x7fdf0c14c0e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 >> 172.21.15.134:0/2303992624 conn(0x7fdf0c06f370 msgr2=0x7fdf0c0b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 shutdown_connections 2024-09-15T22:42:51.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.072+0000 7fdf14333640 1 -- 172.21.15.134:0/2303992624 wait complete. 2024-09-15T22:42:51.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:51.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:42:51.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:42:51.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.185+0000 7fbff7778640 1 Processor -- start 2024-09-15T22:42:51.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.185+0000 7fbff7778640 1 -- start start 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 0x7fbff00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 0x7fbff00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff00cef90 0x7fbff00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbff00d1ae0 con 0x7fbff00cef90 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbff00b7170 con 0x7fbff015e940 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff7778640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbff00b7aa0 con 0x7fbff015ed20 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5d15640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff00cef90 0x7fbff00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5d15640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbff00cef90 0x7fbff00b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58034/0 (socket says 172.21.15.134:58034) 2024-09-15T22:42:51.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5d15640 1 -- 172.21.15.134:0/2505540225 learned_addr learned my addr 172.21.15.134:0/2505540225 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff4d13640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 0x7fbff00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5514640 1 --2- 172.21.15.134:0/2505540225 >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 0x7fbff00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5d15640 1 -- 172.21.15.134:0/2505540225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 msgr2=0x7fbff00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.186+0000 7fbff5d15640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 0x7fbff00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff5d15640 1 -- 172.21.15.134:0/2505540225 >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 msgr2=0x7fbff00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff5d15640 1 --2- 172.21.15.134:0/2505540225 >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 0x7fbff00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff5d15640 1 -- 172.21.15.134:0/2505540225 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff00d3660 con 0x7fbff00cef90 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff5514640 1 --2- 172.21.15.134:0/2505540225 >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 0x7fbff00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:51.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff4d13640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 0x7fbff00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbff5d15640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff00cef90 0x7fbff00b3220 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbff00509d0 tx=0x7fbfe802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8897d263ac8e12ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbfe7fff640 1 -- 172.21.15.134:0/2505540225 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8036070 con 0x7fbff00cef90 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbfe7fff640 1 -- 172.21.15.134:0/2505540225 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8031600 con 0x7fbff00cef90 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.187+0000 7fbfe7fff640 1 -- 172.21.15.134:0/2505540225 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80319d0 con 0x7fbff00cef90 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 -- 172.21.15.134:0/2505540225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff00cef90 msgr2=0x7fbff00b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff00cef90 0x7fbff00b3220 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbff00509d0 tx=0x7fbfe802a730 comp rx=0 tx=0).stop 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 -- 172.21.15.134:0/2505540225 shutdown_connections 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff00cef90 0x7fbff00b3220 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 --2- 172.21.15.134:0/2505540225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff015ed20 0x7fbff00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 --2- 172.21.15.134:0/2505540225 >> v2:172.21.15.177:3300/0 conn(0x7fbff015e940 0x7fbff00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 -- 172.21.15.134:0/2505540225 >> 172.21.15.134:0/2505540225 conn(0x7fbff00b6240 msgr2=0x7fbff00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 -- 172.21.15.134:0/2505540225 shutdown_connections 2024-09-15T22:42:51.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.188+0000 7fbff7778640 1 -- 172.21.15.134:0/2505540225 wait complete. 2024-09-15T22:42:51.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.189+0000 7fbff7778640 1 Processor -- start 2024-09-15T22:42:51.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.189+0000 7fbff7778640 1 -- start start 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff00cef90 0x7fbff01f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff015e940 0x7fbff01e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbff00d3f00 con 0x7fbff015ed20 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbff00d3c20 con 0x7fbff015e940 2024-09-15T22:42:51.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff7778640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbff00d1ef0 con 0x7fbff00cef90 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58040/0 (socket says 172.21.15.134:58040) 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 -- 172.21.15.134:0/1491435535 learned_addr learned my addr 172.21.15.134:0/1491435535 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5514640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff00cef90 0x7fbff01f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff4d13640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff015e940 0x7fbff01e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 -- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff00cef90 msgr2=0x7fbff01f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff00cef90 0x7fbff01f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 -- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff015e940 msgr2=0x7fbff01e7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff015e940 0x7fbff01e7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 -- 172.21.15.134:0/1491435535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff00cc850 con 0x7fbff015ed20 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.190+0000 7fbff5d15640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009f40 tx=0x7fbfe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.191+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8036050 con 0x7fbff015ed20 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.191+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8042070 con 0x7fbff015ed20 2024-09-15T22:42:51.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.191+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff00ccb30 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.191+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8009510 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.191+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff00cd0f0 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.192+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff00d1060 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.192+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fbfe8007bf0 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.193+0000 7fbfe5ffb640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 0x7fbfd406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.193+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fbfe80ac660 con 0x7fbff015ed20 2024-09-15T22:42:51.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.193+0000 7fbff5514640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 0x7fbfd406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.193+0000 7fbff5514640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 0x7fbfd406e920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbfec006fd0 tx=0x7fbfec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.197+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfe807aad0 con 0x7fbff015ed20 2024-09-15T22:42:51.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.396+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbff00ba6b0 con 0x7fbff015ed20 2024-09-15T22:42:51.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.397+0000 7fbfe5ffb640 1 -- 172.21.15.134:0/1491435535 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5220 (secure 0 0 0) 0x7fbfe807a3d0 con 0x7fbff015ed20 2024-09-15T22:42:51.398 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:51.398 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"btime":"2024-09-15T22:42:45:077538+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:42:51.398 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-09-15T22:42:51.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 msgr2=0x7fbfd406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 0x7fbfd406e920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbfec006fd0 tx=0x7fbfec008040 comp rx=0 tx=0).stop 2024-09-15T22:42:51.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 msgr2=0x7fbff0157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009f40 tx=0x7fbfe8004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 shutdown_connections 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbfd406c460 0x7fbfd406e920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff015ed20 0x7fbff0157820 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff015e940 0x7fbff01e7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 --2- 172.21.15.134:0/1491435535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff00cef90 0x7fbff01f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 >> 172.21.15.134:0/1491435535 conn(0x7fbff00b6240 msgr2=0x7fbff0160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 shutdown_connections 2024-09-15T22:42:51.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.399+0000 7fbff7778640 1 -- 172.21.15.134:0/1491435535 wait complete. 2024-09-15T22:42:51.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:42:42.400760+0000', 'modified': '2024-09-15T22:42:44.404846+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6834/248034527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 248034527}, {'type': 'v1', 'addr': '172.21.15.177:6834', 'nonce': 248034527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5283, 'qdb_cluster': [5283]} 2024-09-15T22:42:51.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:42:51.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T22:42:51.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.915+0000 7f1598be4640 1 Processor -- start 2024-09-15T22:42:51.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.915+0000 7f1598be4640 1 -- start start 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1598be4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15940cf070 0x7f15940cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1598be4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15940ce740 con 0x7f159415c180 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1598be4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1594072640 con 0x7f1594073120 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1598be4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1594072920 con 0x7f15940cf070 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f159259c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f159415c180 0x7f15940cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50364/0 (socket says 172.21.15.134:50364) 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f159259c640 1 -- 172.21.15.134:0/3376292356 learned_addr learned my addr 172.21.15.134:0/3376292356 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799366659 0 0) 0x7f15940ce740 con 0x7f159415c180 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1580003520 con 0x7f159415c180 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3376292356 >> v2:172.21.15.177:3300/0 conn(0x7f15940cf070 0x7f15940cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3592758724 0 0) 0x7f1580003520 con 0x7f159415c180 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 >> v2:172.21.15.177:3300/0 conn(0x7f15940cf070 msgr2=0x7f15940cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 --2- 172.21.15.134:0/3376292356 >> v2:172.21.15.177:3300/0 conn(0x7f15940cf070 0x7f15940cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 >> v1:172.21.15.177:6789/0 conn(0x7f1594073120 legacy=0x7f159406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1594072c00 con 0x7f159415c180 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f1584001670 con 0x7f159415c180 2024-09-15T22:42:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 >> v1:172.21.15.134:6789/0 conn(0x7f159415c180 legacy=0x7f15940cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15800039b0 0x7f1580003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 0x7f1580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15800051c0 0x7f158000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1594072920 con 0x7f1580004800 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f158000c160 con 0x7f15800051c0 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f158000c360 con 0x7f15800039b0 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.916+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 0x7f1580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f159259c640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15800039b0 0x7f1580003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1592d9d640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15800051c0 0x7f158000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 -- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15800039b0 msgr2=0x7f1580003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15800039b0 0x7f1580003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 -- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15800051c0 msgr2=0x7f158000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15800051c0 0x7f158000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1592d9d640 1 -- 172.21.15.134:0/3376292356 reap_dead start 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 -- 172.21.15.134:0/3376292356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1580003520 con 0x7f1580004800 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 0x7f1580004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f157c009a90 tx=0x7f1580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a24d86609636e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c036070 con 0x7f1580004800 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c031400 con 0x7f1580004800 2024-09-15T22:42:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.917+0000 7f1591d9b640 1 -- 172.21.15.134:0/3376292356 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c009690 con 0x7f1580004800 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 -- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 msgr2=0x7f1580004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 0x7f1580004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f157c009a90 tx=0x7f1580005830 comp rx=0 tx=0).stop 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 -- 172.21.15.134:0/3376292356 shutdown_connections 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 --2- 172.21.15.134:0/3376292356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580004800 0x7f1580004c80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 -- 172.21.15.134:0/3376292356 >> 172.21.15.134:0/3376292356 conn(0x7f1594062cc0 msgr2=0x7f159406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 -- 172.21.15.134:0/3376292356 shutdown_connections 2024-09-15T22:42:51.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.918+0000 7f1598be4640 1 -- 172.21.15.134:0/3376292356 wait complete. 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.919+0000 7f1598be4640 1 Processor -- start 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 -- start start 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1580004800 0x7f1594155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 0x7f159415f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f159415c560 con 0x7f15940ac0e0 2024-09-15T22:42:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15940722f0 con 0x7f1580004800 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1598be4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f159415c6e0 con 0x7f159415f0d0 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58060/0 (socket says 172.21.15.134:58060) 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1592d9d640 1 -- 172.21.15.134:0/2299687015 learned_addr learned my addr 172.21.15.134:0/2299687015 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f1589d9b640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 0x7f159415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.920+0000 7f159259c640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1580004800 0x7f1594155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 -- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 msgr2=0x7f159415f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 0x7f159415f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 -- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1580004800 msgr2=0x7f1594155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1580004800 0x7f1594155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 -- 172.21.15.134:0/2299687015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15941563b0 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1589d9b640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 0x7f159415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1592d9d640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15940b3100 tx=0x7f158c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f158b7fe640 1 -- 172.21.15.134:0/2299687015 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c019070 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f158b7fe640 1 -- 172.21.15.134:0/2299687015 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c006d60 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15940aece0 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f158b7fe640 1 -- 172.21.15.134:0/2299687015 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c003b90 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.921+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15940af2a0 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.922+0000 7f158b7fe640 1 -- 172.21.15.134:0/2299687015 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f158c01c070 con 0x7f15940ac0e0 2024-09-15T22:42:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.923+0000 7f158b7fe640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 0x7f157406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.923+0000 7f158b7fe640 1 -- 172.21.15.134:0/2299687015 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f158c08ac50 con 0x7f15940ac0e0 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.923+0000 7f159259c640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 0x7f157406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.923+0000 7f159259c640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 0x7f157406e920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1584000ff0 tx=0x7f1584007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.924+0000 7f159ba56740 1 Processor -- start 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.924+0000 7f159ba56740 1 -- start start 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa41a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639f9f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55639f95e520 con 0x55639f9f9a80 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55639f9063e0 con 0x55639f9fda50 2024-09-15T22:42:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55639f95a4e0 con 0x55639f9fc2c0 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58068/0 (socket says 172.21.15.134:58068) 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 -- 172.21.15.134:0/1689257616 learned_addr learned my addr 172.21.15.134:0/1689257616 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f159259c640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa41a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1592d9d640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639f9f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 -- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 msgr2=0x55639fa41a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa41a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 -- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 msgr2=0x55639f9f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639f9f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 -- 172.21.15.134:0/1689257616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639f9212f0 con 0x55639f9f9a80 2024-09-15T22:42:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1592d9d640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639f9f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f157c009b80 tx=0x7f157c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb5178c176830d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.925+0000 7f1573fff640 1 -- 172.21.15.134:0/1689257616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c036040 con 0x55639f9f9a80 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f1573fff640 1 -- 172.21.15.134:0/1689257616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c031740 con 0x55639f9f9a80 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f1573fff640 1 -- 172.21.15.134:0/1689257616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c031af0 con 0x55639f9f9a80 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 -- 172.21.15.134:0/1689257616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 msgr2=0x55639f9fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f157c009b80 tx=0x7f157c02e000 comp rx=0 tx=0).stop 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 -- 172.21.15.134:0/1689257616 shutdown_connections 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639f9f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9f9a80 0x55639f9fc6a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 --2- 172.21.15.134:0/1689257616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa41a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 -- 172.21.15.134:0/1689257616 >> 172.21.15.134:0/1689257616 conn(0x55639f9f8a80 msgr2=0x55639fa40f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 -- 172.21.15.134:0/1689257616 shutdown_connections 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.926+0000 7f159ba56740 1 -- 172.21.15.134:0/1689257616 wait complete. 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.927+0000 7f159ba56740 1 -- start start 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.927+0000 7f159ba56740 1 Processor -- start 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa1d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 0x55639f9f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55639f9f7f20 con 0x55639f9fc2c0 2024-09-15T22:42:51.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55639f8e7450 con 0x55639f9fda50 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55639fa42290 con 0x55639fa1d880 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 10 client.0 _ll_register_callbacks cb 0x55639f670ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58080/0 (socket says 172.21.15.134:58080) 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 -- 172.21.15.134:0/1496545003 learned_addr learned my addr 172.21.15.134:0/1496545003 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f1592d9d640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 0x55639f9f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa1d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 -- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 msgr2=0x55639f9f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 0x55639f9f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 -- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 msgr2=0x55639fa1d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa1d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 -- 172.21.15.134:0/1496545003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639f6712d0 con 0x55639f9fc2c0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f1592d9d640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 0x55639f9f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159259c640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1584004d60 tx=0x7f1594072dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60738ae101ad853 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f15717fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584029060 con 0x55639f9fc2c0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f1584024ab0 con 0x55639f9fc2c0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.928+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157c031740 con 0x55639f9fc2c0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f158401b030 con 0x55639f9fc2c0 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 10 client.5430 fetch_fsmap learned FSMap version 21 2024-09-15T22:42:51.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55639f73b6b0 con 0x55639f9fc2c0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c031740 con 0x55639f9fc2c0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f1584024cb0 con 0x55639f9fc2c0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 10 client.5430 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 10 client.5430 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 20 client.5430 populate_metadata read hostname 'smithi134' 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa1b8f0 0x55639fa25ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 4 client.5430 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 --> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55639f96bc50 con 0x55639fa1b8f0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.929+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa1b8f0 0x55639fa25ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.930+0000 7f15717fa640 10 client.5430 ms_handle_connect on v2:172.21.15.177:6832/248034527 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.930+0000 7f1589d9b640 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa1b8f0 0x55639fa25ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc55ed5a6986e31 server_cookie=7028a49f37feae40 in_seq=0 out_seq=0 2024-09-15T22:42:51.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.930+0000 7f15717fa640 1 -- 172.21.15.134:0/1496545003 <== mds.0 v2:172.21.15.177:6832/248034527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55639f96bc50 con 0x55639fa1b8f0 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.930+0000 7f15717fa640 10 client.5430 handle_command_reply: tid=0 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.930+0000 7f159ba56740 1 client.5430 shutdown 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 msgr2=0x55639fa17a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1584004d60 tx=0x7f1594072dd0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 shutdown_connections 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa1b8f0 0x55639fa25ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639fa1d880 0x55639f9f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa1d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f15717fa640 0 client.5430 ms_handle_reset on v2:172.21.15.177:6832/248034527 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 --2- 172.21.15.134:0/1496545003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639f9fc2c0 0x55639fa17a10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 >> 172.21.15.134:0/1496545003 conn(0x55639f9f9a80 msgr2=0x55639fa44440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 shutdown_connections 2024-09-15T22:42:51.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 1 -- 172.21.15.134:0/1496545003 wait complete. 2024-09-15T22:42:51.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.931+0000 7f159ba56740 20 client.5430 trim_cache size 0 max 16384 2024-09-15T22:42:51.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 Processor -- start 2024-09-15T22:42:51.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 -- start start 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa26010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15941ff040 con 0x55639fa1d880 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15941fe020 con 0x55639f9fda50 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f159415d520 con 0x55639f9fc2c0 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58082/0 (socket says 172.21.15.134:58082) 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.949+0000 7f1592d9d640 1 -- 172.21.15.134:0/3564761282 learned_addr learned my addr 172.21.15.134:0/3564761282 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 -- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 msgr2=0x55639fa443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f159259c640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa26010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 -- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 msgr2=0x55639fa26010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa26010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 -- 172.21.15.134:0/3564761282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639f9f21d0 con 0x55639fa1d880 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1589d9b640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa26010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f1592d9d640 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f158c088ee0 tx=0x7f158c054ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cea3056b2a4b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f15737fe640 1 -- 172.21.15.134:0/3564761282 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c061620 con 0x55639fa1d880 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f15737fe640 1 -- 172.21.15.134:0/3564761282 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c055160 con 0x55639fa1d880 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.950+0000 7f15737fe640 1 -- 172.21.15.134:0/3564761282 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c05f0c0 con 0x55639fa1d880 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- 172.21.15.134:0/3564761282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 msgr2=0x55639fa65230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f158c088ee0 tx=0x7f158c054ec0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- 172.21.15.134:0/3564761282 shutdown_connections 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa65230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fda50 0x55639fa26010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 --2- 172.21.15.134:0/3564761282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fc2c0 0x55639fa443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- 172.21.15.134:0/3564761282 >> 172.21.15.134:0/3564761282 conn(0x55639f9f9a80 msgr2=0x55639fa41420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- 172.21.15.134:0/3564761282 shutdown_connections 2024-09-15T22:42:51.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- 172.21.15.134:0/3564761282 wait complete. 2024-09-15T22:42:51.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 -- start start 2024-09-15T22:42:51.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.951+0000 7f159ba56740 1 Processor -- start 2024-09-15T22:42:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fc2c0 0x55639fabefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fda50 0x55639fa3f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55639fa26d30 con 0x55639fa1d880 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f159415db70 con 0x55639f9fc2c0 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55639fa1bdc0 con 0x55639f9fda50 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159ba56740 10 client.0 _ll_register_callbacks cb 0x7f1584018040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58086/0 (socket says 172.21.15.134:58086) 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 -- 172.21.15.134:0/825842979 learned_addr learned my addr 172.21.15.134:0/825842979 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:51.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1589d9b640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fda50 0x55639fa3f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f159259c640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fc2c0 0x55639fabefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 -- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fda50 msgr2=0x55639fa3f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fda50 0x55639fa3f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 -- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fc2c0 msgr2=0x55639fabefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fc2c0 0x55639fabefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.952+0000 7f1592d9d640 1 -- 172.21.15.134:0/825842979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639fabf510 con 0x55639fa1d880 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f1592d9d640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f158c056da0 tx=0x7f158c001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d51ca46943e20d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c05f2c0 con 0x55639fa1d880 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f158c057f40 con 0x55639fa1d880 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f158c055160 con 0x55639fa1d880 2024-09-15T22:42:51.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f158c0892f0 con 0x55639fa1d880 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 10 client.5436 fetch_fsmap learned FSMap version 21 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55639fa1a540 con 0x55639fa1d880 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c055160 con 0x55639fa1d880 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f158c054840 con 0x55639fa1d880 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 10 client.5436 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 10 client.5436 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 20 client.5436 populate_metadata read hostname 'smithi134' 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa5b0d0 0x55639f9f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 4 client.5436 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 --> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] -- command(tid 0: {"prefix": "status"}) -- 0x55639f965fa0 con 0x55639fa5b0d0 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.953+0000 7f159259c640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa5b0d0 0x55639f9f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f15717fa640 10 client.5436 ms_handle_connect on v2:172.21.15.177:6832/248034527 2024-09-15T22:42:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159259c640 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa5b0d0 0x55639f9f57d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe4dd97b58decd7 server_cookie=7541fbec28fe56bd in_seq=0 out_seq=0 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f15717fa640 1 -- 172.21.15.134:0/825842979 <== mds.0 v2:172.21.15.177:6832/248034527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55639f965fa0 con 0x55639fa5b0d0 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f15717fa640 10 client.5436 handle_command_reply: tid=0 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 client.5436 shutdown 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 msgr2=0x55639fa3fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f158c056da0 tx=0x7f158c001510 comp rx=0 tx=0).stop 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 shutdown_connections 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:6832/248034527,v1:172.21.15.177:6834/248034527] conn(0x55639fa5b0d0 0x55639f9f57d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55639fa1d880 0x55639fa3fd60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f15717fa640 0 client.5436 ms_handle_reset on v2:172.21.15.177:6832/248034527 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55639f9fda50 0x55639fa3f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 --2- 172.21.15.134:0/825842979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55639f9fc2c0 0x55639fabefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 >> 172.21.15.134:0/825842979 conn(0x55639f9f9a80 msgr2=0x55639fa42a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 shutdown_connections 2024-09-15T22:42:51.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 1 -- 172.21.15.134:0/825842979 wait complete. 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.954+0000 7f159ba56740 20 client.5436 trim_cache size 0 max 16384 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 5283, 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 8.8844767390000001, 2024-09-15T22:42:51.965 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 21, 2024-09-15T22:42:51.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 47, 2024-09-15T22:42:51.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 47, 2024-09-15T22:42:51.966 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 12.948080014 2024-09-15T22:42:51.966 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:42:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 msgr2=0x7f157406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 0x7f157406e920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1584000ff0 tx=0x7f1584007040 comp rx=0 tx=0).stop 2024-09-15T22:42:51.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 msgr2=0x7f15940ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15940b3100 tx=0x7f158c00ea00 comp rx=0 tx=0).stop 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 shutdown_connections 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f157406c460 0x7f157406e920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15940ac0e0 0x7f15940ac560 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f159415f0d0 0x7f159415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 --2- 172.21.15.134:0/2299687015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1580004800 0x7f1594155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 >> 172.21.15.134:0/2299687015 conn(0x7f1594062cc0 msgr2=0x7f159415aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 shutdown_connections 2024-09-15T22:42:51.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:51.955+0000 7f1598be4640 1 -- 172.21.15.134:0/2299687015 wait complete. 2024-09-15T22:42:51.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:42:52.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 Processor -- start 2024-09-15T22:42:52.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 -- start start 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb93415e860 0x7fb9340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9340b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9340b6b50 con 0x7fb93406c070 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb9340d34d0 con 0x7fb93415e860 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.066+0000 7fb93961e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9340d3790 con 0x7fb9340b61f0 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9337fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb93406c070 0x7fb93406c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50380/0 (socket says 172.21.15.134:50380) 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9337fe640 1 -- 172.21.15.134:0/1807320356 learned_addr learned my addr 172.21.15.134:0/1807320356 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786688816 0 0) 0x7fb9340b6b50 con 0x7fb93406c070 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb932ffd640 1 --2- 172.21.15.134:0/1807320356 >> v2:172.21.15.177:3300/0 conn(0x7fb93415e860 0x7fb9340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb920003520 con 0x7fb93406c070 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9340b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3814272189 0 0) 0x7fb920003520 con 0x7fb93406c070 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 msgr2=0x7fb9340b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9340b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 >> v2:172.21.15.177:3300/0 conn(0x7fb93415e860 msgr2=0x7fb9340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 --2- 172.21.15.134:0/1807320356 >> v2:172.21.15.177:3300/0 conn(0x7fb93415e860 0x7fb9340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340d3a70 con 0x7fb93406c070 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb92c0019f0 con 0x7fb93406c070 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 >> v1:172.21.15.134:6789/0 conn(0x7fb93406c070 legacy=0x7fb93406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9200039b0 0x7fb920003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb920004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340d34d0 con 0x7fb920004800 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340d3790 con 0x7fb9200039b0 2024-09-15T22:42:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb92000b9f0 con 0x7fb9340b61f0 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb920004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.067+0000 7fb932ffd640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9200039b0 0x7fb920003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb9337fe640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 -- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 msgr2=0x7fb9200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340b61f0 0x7fb9200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 -- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9200039b0 msgr2=0x7fb920003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9200039b0 0x7fb920003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 -- 172.21.15.134:0/1807320356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920003520 con 0x7fb920004800 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb932ffd640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9200039b0 0x7fb920003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb920004c80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009ac0 tx=0x7fb920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647149db818c5b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.068+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c036070 con 0x7fb920004800 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c031400 con 0x7fb920004800 2024-09-15T22:42:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb9327fc640 1 -- 172.21.15.134:0/1807320356 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009690 con 0x7fb920004800 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 -- 172.21.15.134:0/1807320356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 msgr2=0x7fb920004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 --2- 172.21.15.134:0/1807320356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb920004c80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009ac0 tx=0x7fb920005830 comp rx=0 tx=0).stop 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb9337fe640 1 -- 172.21.15.134:0/1807320356 reap_dead start 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 -- 172.21.15.134:0/1807320356 shutdown_connections 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 -- 172.21.15.134:0/1807320356 >> 172.21.15.134:0/1807320356 conn(0x7fb934062c60 msgr2=0x7fb9340d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 -- 172.21.15.134:0/1807320356 shutdown_connections 2024-09-15T22:42:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.069+0000 7fb93961e640 1 -- 172.21.15.134:0/1807320356 wait complete. 2024-09-15T22:42:52.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.070+0000 7fb93961e640 1 Processor -- start 2024-09-15T22:42:52.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 -- start start 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb934153b90 0x7fb9340cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 0x7fb9340ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340d4310 con 0x7fb920004800 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340d4030 con 0x7fb934153b90 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb93961e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb93415ec40 con 0x7fb9340ce180 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58096/0 (socket says 172.21.15.134:58096) 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.071+0000 7fb932ffd640 1 -- 172.21.15.134:0/2562784733 learned_addr learned my addr 172.21.15.134:0/2562784733 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb934153b90 0x7fb9340cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb9337fe640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 0x7fb9340ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 -- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 msgr2=0x7fb9340ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 0x7fb9340ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 -- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb934153b90 msgr2=0x7fb9340cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb934153b90 0x7fb9340cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 -- 172.21.15.134:0/2562784733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9341f56e0 con 0x7fb920004800 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb9337fe640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 0x7fb9340ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb932ffd640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb924011730 tx=0x7fb924011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92400f970 con 0x7fb920004800 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92400fb10 con 0x7fb920004800 2024-09-15T22:42:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924015460 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9340ccba0 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.072+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9340cd160 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.073+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9340b3ad0 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.074+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fb924015600 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.074+0000 7fb92bfff640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 0x7fb91406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.074+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fb92408c150 con 0x7fb920004800 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.074+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 0x7fb91406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.074+0000 7fb92a7fc640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 0x7fb91406e950 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb91c033000 tx=0x7fb91c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.078+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb924019030 con 0x7fb920004800 2024-09-15T22:42:52.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.276+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb9340d2700 con 0x7fb920004800 2024-09-15T22:42:52.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.276+0000 7fb92bfff640 1 -- 172.21.15.134:0/2562784733 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7fb92405a640 con 0x7fb920004800 2024-09-15T22:42:52.278 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:42:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 msgr2=0x7fb91406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 0x7fb91406e950 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb91c033000 tx=0x7fb91c008030 comp rx=0 tx=0).stop 2024-09-15T22:42:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 msgr2=0x7fb9341f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb924011730 tx=0x7fb924011bf0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 shutdown_connections 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb91406c490 0x7fb91406e950 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9340ce180 0x7fb9340ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb934153b90 0x7fb9340cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 --2- 172.21.15.134:0/2562784733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb920004800 0x7fb9341f51a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.278+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 >> 172.21.15.134:0/2562784733 conn(0x7fb934062c60 msgr2=0x7fb9340b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.279+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 shutdown_connections 2024-09-15T22:42:52.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52.279+0000 7fb93961e640 1 -- 172.21.15.134:0/2562784733 wait complete. 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:42:52.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:42:52.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:42:52.292 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:52.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.292 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:42:52.315 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:42:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:42:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42721sec preferred_lft 42721sec 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:42:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:52.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.318 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:42:52.381 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:42:52.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.383 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:42:52.440 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:42:52.440 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:42:52.440 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:42:52.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:42:52.440 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:42:52.441 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:42:52.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:52.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.567 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:42:52.583 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:42:52.583 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:42:52.583 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:52.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:42:52.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:52.650 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:52.706 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:42:52.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:52.706 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:52.764 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:42:52.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:52.847 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:52.847 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:52.847 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:52.856 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:52.856 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:52.856 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:52.857 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:52.857 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:52.862 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:42:52.862 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:42:52.862 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:42:52.862 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:52.862 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:52.863 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:42:52.863 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:42:52.863 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:42:52.863 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:42:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:42:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:42:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:42:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:42:52.865 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:42:52.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:52.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:52.937 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:42:53.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:42:53.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:53.039 INFO:teuthology.orchestra.run.smithi134.stdout:client5445 2024-09-15T22:42:53.039 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:53.039 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:53.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:42:53.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.192+0000 7fda0d511640 1 Processor -- start 2024-09-15T22:42:53.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.192+0000 7fda0d511640 1 -- start start 2024-09-15T22:42:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0815e940 0x7fda080d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fda0815ed20 0x7fda080d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda080cef90 0x7fda080b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fda080d1ae0 con 0x7fda080cef90 2024-09-15T22:42:53.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fda080b7170 con 0x7fda0815ed20 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda0d511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fda080b7aa0 con 0x7fda0815e940 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda080cef90 0x7fda080b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda080cef90 0x7fda080b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58108/0 (socket says 172.21.15.134:58108) 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 -- 172.21.15.134:0/2782582 learned_addr learned my addr 172.21.15.134:0/2782582 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 -- 172.21.15.134:0/2782582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0815e940 msgr2=0x7fda080d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 --2- 172.21.15.134:0/2782582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0815e940 0x7fda080d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 -- 172.21.15.134:0/2782582 >> v2:172.21.15.177:3300/0 conn(0x7fda0815ed20 msgr2=0x7fda080d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:53.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 --2- 172.21.15.134:0/2782582 >> v2:172.21.15.177:3300/0 conn(0x7fda0815ed20 0x7fda080d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.193+0000 7fda077fe640 1 -- 172.21.15.134:0/2782582 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda080d3660 con 0x7fda080cef90 2024-09-15T22:42:53.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda077fe640 1 --2- 172.21.15.134:0/2782582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda080cef90 0x7fda080b3220 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda080d5830 tx=0x7fda0002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6156edc19ef678e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:53.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda067fc640 1 -- 172.21.15.134:0/2782582 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00036070 con 0x7fda080cef90 2024-09-15T22:42:53.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda067fc640 1 -- 172.21.15.134:0/2782582 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda00031600 con 0x7fda080cef90 2024-09-15T22:42:53.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda067fc640 1 -- 172.21.15.134:0/2782582 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000319d0 con 0x7fda080cef90 2024-09-15T22:42:53.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 -- 172.21.15.134:0/2782582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda080cef90 msgr2=0x7fda080b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:53.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 --2- 172.21.15.134:0/2782582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda080cef90 0x7fda080b3220 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda080d5830 tx=0x7fda0002a730 comp rx=0 tx=0).stop 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 -- 172.21.15.134:0/2782582 shutdown_connections 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 --2- 172.21.15.134:0/2782582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda080cef90 0x7fda080b3220 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 --2- 172.21.15.134:0/2782582 >> v2:172.21.15.177:3300/0 conn(0x7fda0815ed20 0x7fda080d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 --2- 172.21.15.134:0/2782582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0815e940 0x7fda080d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.194+0000 7fda0d511640 1 -- 172.21.15.134:0/2782582 >> 172.21.15.134:0/2782582 conn(0x7fda080b6240 msgr2=0x7fda080b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.195+0000 7fda0d511640 1 -- 172.21.15.134:0/2782582 shutdown_connections 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.195+0000 7fda0d511640 1 -- 172.21.15.134:0/2782582 wait complete. 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.196+0000 7fda0d511640 1 Processor -- start 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.196+0000 7fda0d511640 1 -- start start 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda080cef90 0x7fda08155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0815e940 0x7fda080c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda080d3f00 con 0x7fda0815ed20 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda080d3c20 con 0x7fda0815e940 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fda080d1ef0 con 0x7fda080cef90 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58112/0 (socket says 172.21.15.134:58112) 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 -- 172.21.15.134:0/504684798 learned_addr learned my addr 172.21.15.134:0/504684798 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda06ffd640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda080cef90 0x7fda08155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fd9fe7fc640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0815e940 0x7fda080c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 -- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda080cef90 msgr2=0x7fda08155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda080cef90 0x7fda08155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 -- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0815e940 msgr2=0x7fda080c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0815e940 0x7fda080c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 -- 172.21.15.134:0/504684798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda080c9730 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda077fe640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda00009f40 tx=0x7fda00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00041020 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda000077a0 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda080c9a10 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00036040 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.197+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda080c9fd0 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.198+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda08158820 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.199+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fda00044020 con 0x7fda0815ed20 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.199+0000 7fd9fffff640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 0x7fd9e806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:53.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.199+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fda000ac710 con 0x7fda0815ed20 2024-09-15T22:42:53.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.199+0000 7fda06ffd640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 0x7fd9e806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:53.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.200+0000 7fda06ffd640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 0x7fd9e806e920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009990 tx=0x7fd9f8009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:53.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.204+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda0004b020 con 0x7fda0815ed20 2024-09-15T22:42:53.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.401+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda080d1060 con 0x7fda0815ed20 2024-09-15T22:42:53.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.402+0000 7fd9fffff640 1 -- 172.21.15.134:0/504684798 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7fda0007ac10 con 0x7fda0815ed20 2024-09-15T22:42:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:42:53.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 msgr2=0x7fd9e806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:53.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 0x7fd9e806e920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009990 tx=0x7fd9f8009110 comp rx=0 tx=0).stop 2024-09-15T22:42:53.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 msgr2=0x7fda0815fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda00009f40 tx=0x7fda00004a40 comp rx=0 tx=0).stop 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 shutdown_connections 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd9e806c460 0x7fd9e806e920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0815ed20 0x7fda0815fbe0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0815e940 0x7fda080c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 --2- 172.21.15.134:0/504684798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda080cef90 0x7fda08155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 >> 172.21.15.134:0/504684798 conn(0x7fda080b6240 msgr2=0x7fda080d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 shutdown_connections 2024-09-15T22:42:53.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:53.404+0000 7fda0d511640 1 -- 172.21.15.134:0/504684798 wait complete. 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:42:53.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:53.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.418 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:42:53.437 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:53.438 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:42:53.439 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:42:53.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.440 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:42:53.505 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:42:53.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.507 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:42:53.565 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:42:53.566 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:42:53.566 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:42:53.566 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:42:53.566 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:42:53.566 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:42:53.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:42:53.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:53.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.701 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:42:53.717 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:42:53.717 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:42:53.717 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:53.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:42:53.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:53.783 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:42:53.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:42:53.838 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:53.893 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:42:53.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:42:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:42:53.991 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:42:53.991 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:42:53.991 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:42:53.991 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:42:53.992 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:42:53.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:53.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:54.057 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:42:54.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:42:54.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:42:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:42:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:client5161 2024-09-15T22:42:54.153 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:54.153 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:54.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:42:54.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.273+0000 7f9963931640 1 Processor -- start 2024-09-15T22:42:54.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 -- start start 2024-09-15T22:42:54.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f995c06fa40 0x7f995c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f995c15fed0 0x7f995c1602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c0b5890 con 0x7f995c0b4f70 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f995c06e9a0 con 0x7f995c06fa40 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.274+0000 7f9963931640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f995c06ec80 con 0x7f995c15fed0 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f995c06fa40 0x7f995c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f995c06fa40 0x7f995c0b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58114/0 (socket says 172.21.15.134:58114) 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 -- 172.21.15.134:0/4206390739 learned_addr learned my addr 172.21.15.134:0/4206390739 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9961ece640 1 --2- 172.21.15.134:0/4206390739 >> v2:172.21.15.177:3300/0 conn(0x7f995c15fed0 0x7f995c1602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 -- 172.21.15.134:0/4206390739 >> v2:172.21.15.177:3300/0 conn(0x7f995c15fed0 msgr2=0x7f995c1602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 --2- 172.21.15.134:0/4206390739 >> v2:172.21.15.177:3300/0 conn(0x7f995c15fed0 0x7f995c1602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 -- 172.21.15.134:0/4206390739 >> v1:172.21.15.177:6789/0 conn(0x7f995c0b4f70 legacy=0x7f995c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.275+0000 7f9960ecc640 1 -- 172.21.15.134:0/4206390739 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c06ef60 con 0x7f995c06fa40 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9960ecc640 1 --2- 172.21.15.134:0/4206390739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c06fa40 0x7f995c0b5350 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f995c06d570 tx=0x7f994c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d073ad9d7365982 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9953fff640 1 -- 172.21.15.134:0/4206390739 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c037070 con 0x7f995c06fa40 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9953fff640 1 -- 172.21.15.134:0/4206390739 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c02ae50 con 0x7f995c06fa40 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9953fff640 1 -- 172.21.15.134:0/4206390739 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c032860 con 0x7f995c06fa40 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 -- 172.21.15.134:0/4206390739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c06fa40 msgr2=0x7f995c0b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 --2- 172.21.15.134:0/4206390739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c06fa40 0x7f995c0b5350 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f995c06d570 tx=0x7f994c02a300 comp rx=0 tx=0).stop 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 -- 172.21.15.134:0/4206390739 shutdown_connections 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 --2- 172.21.15.134:0/4206390739 >> v2:172.21.15.177:3300/0 conn(0x7f995c15fed0 0x7f995c1602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 --2- 172.21.15.134:0/4206390739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c06fa40 0x7f995c0b5350 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 -- 172.21.15.134:0/4206390739 >> 172.21.15.134:0/4206390739 conn(0x7f995c062810 msgr2=0x7f995c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 -- 172.21.15.134:0/4206390739 shutdown_connections 2024-09-15T22:42:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.276+0000 7f9963931640 1 -- 172.21.15.134:0/4206390739 wait complete. 2024-09-15T22:42:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 Processor -- start 2024-09-15T22:42:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 -- start start 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c06fa40 0x7f995c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0b4f70 0x7f995c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f995c06e620 con 0x7f995c15fed0 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f995c06f520 con 0x7f995c0b4f70 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9963931640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f995c06fe90 con 0x7f995c06fa40 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9961ece640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9961ece640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58116/0 (socket says 172.21.15.134:58116) 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9961ece640 1 -- 172.21.15.134:0/4228152937 learned_addr learned my addr 172.21.15.134:0/4228152937 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.278+0000 7f9960ecc640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0b4f70 0x7f995c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f99616cd640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c06fa40 0x7f995c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 -- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c06fa40 msgr2=0x7f995c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c06fa40 0x7f995c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 -- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0b4f70 msgr2=0x7f995c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0b4f70 0x7f995c1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 -- 172.21.15.134:0/4228152937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c1e6c10 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9961ece640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f995400efc0 tx=0x7f995400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954018020 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9954014480 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c1e6f30 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954014870 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.279+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c1e7770 con 0x7f995c15fed0 2024-09-15T22:42:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.280+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995c06bd50 con 0x7f995c15fed0 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.281+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f9954005d10 con 0x7f995c15fed0 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.281+0000 7f9951ffb640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 0x7f994006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.281+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f995408c1c0 con 0x7f995c15fed0 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.281+0000 7f99616cd640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 0x7f994006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.282+0000 7f99616cd640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 0x7f994006e920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99580016e0 tx=0x7f9958009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.286+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9954022070 con 0x7f995c15fed0 2024-09-15T22:42:54.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:54.484+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f995c145a30 con 0x7f995c15fed0 2024-09-15T22:42:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.110+0000 7f9951ffb640 1 -- 172.21.15.134:0/4228152937 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v22) ==== 136+0+0 (secure 0 0 0) 0x7f995c1e6f30 con 0x7f995c15fed0 2024-09-15T22:42:55.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 msgr2=0x7f994006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 0x7f994006e920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99580016e0 tx=0x7f9958009040 comp rx=0 tx=0).stop 2024-09-15T22:42:55.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 msgr2=0x7f995c140460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f995400efc0 tx=0x7f995400c490 comp rx=0 tx=0).stop 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 shutdown_connections 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f994006c460 0x7f994006e920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c15fed0 0x7f995c140460 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0b4f70 0x7f995c1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 --2- 172.21.15.134:0/4228152937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c06fa40 0x7f995c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 >> 172.21.15.134:0/4228152937 conn(0x7f995c062810 msgr2=0x7f995c145f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 shutdown_connections 2024-09-15T22:42:55.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.113+0000 7f9963931640 1 -- 172.21.15.134:0/4228152937 wait complete. 2024-09-15T22:42:55.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:42:55.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.226+0000 7f71a409b640 1 Processor -- start 2024-09-15T22:42:55.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.226+0000 7f71a409b640 1 -- start start 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a409b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f719c06c1f0 0x7f719c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a409b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0cd5f0 con 0x7f719c151c50 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a409b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0cd8d0 con 0x7f719c06be10 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a409b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f719c0cdbb0 con 0x7f719c06c1f0 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a1636640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f719c151c50 0x7f719c162740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50390/0 (socket says 172.21.15.134:50390) 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a1636640 1 -- 172.21.15.134:0/1372753691 learned_addr learned my addr 172.21.15.134:0/1372753691 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a2638640 1 --2- 172.21.15.134:0/1372753691 >> v2:172.21.15.177:3300/0 conn(0x7f719c06c1f0 0x7f719c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490133177 0 0) 0x7f719c0cd5f0 con 0x7f719c151c50 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7188003520 con 0x7f719c151c50 2024-09-15T22:42:55.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1144347410 0 0) 0x7f7188003520 con 0x7f719c151c50 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 >> v2:172.21.15.177:3300/0 conn(0x7f719c06c1f0 msgr2=0x7f719c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 --2- 172.21.15.134:0/1372753691 >> v2:172.21.15.177:3300/0 conn(0x7f719c06c1f0 0x7f719c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.227+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 >> v1:172.21.15.177:6789/0 conn(0x7f719c06be10 legacy=0x7f719c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c0cde90 con 0x7f719c151c50 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f718c001670 con 0x7f719c151c50 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 >> v1:172.21.15.134:6789/0 conn(0x7f719c151c50 legacy=0x7f719c162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 0x7f718800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f719c0cdbb0 con 0x7f71880051c0 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f718800c060 con 0x7f7188004800 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f718800c260 con 0x7f71880039b0 2024-09-15T22:42:55.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 0x7f718800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a1636640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a1e37640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 -- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71880039b0 msgr2=0x7f7188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 -- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7188004800 msgr2=0x7f7188004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a2638640 1 -- 172.21.15.134:0/1372753691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7188003520 con 0x7f71880051c0 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.228+0000 7f71a1e37640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a2638640 1 -- 172.21.15.134:0/1372753691 reap_dead start 2024-09-15T22:42:55.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a2638640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 0x7f718800b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7194009fc0 tx=0x7f7188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408fba0eb5c27c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194035020 con 0x7f71880051c0 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194003bd0 con 0x7f71880051c0 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a0e35640 1 -- 172.21.15.134:0/1372753691 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194009c10 con 0x7f71880051c0 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 -- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 msgr2=0x7f718800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 0x7f718800b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7194009fc0 tx=0x7f7188005830 comp rx=0 tx=0).stop 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 -- 172.21.15.134:0/1372753691 shutdown_connections 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 --2- 172.21.15.134:0/1372753691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71880051c0 0x7f718800b9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 -- 172.21.15.134:0/1372753691 >> 172.21.15.134:0/1372753691 conn(0x7f719c062cc0 msgr2=0x7f719c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 -- 172.21.15.134:0/1372753691 shutdown_connections 2024-09-15T22:42:55.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.229+0000 7f71a409b640 1 -- 172.21.15.134:0/1372753691 wait complete. 2024-09-15T22:42:55.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 Processor -- start 2024-09-15T22:42:55.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 -- start start 2024-09-15T22:42:55.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 0x7f719c149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 0x7f719c165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f719c0cd010 con 0x7f719c154a60 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f719c0ce690 con 0x7f71880051c0 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a409b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f719c0cd190 con 0x7f719c153000 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.231+0000 7f71a1636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58128/0 (socket says 172.21.15.134:58128) 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 -- 172.21.15.134:0/963885477 learned_addr learned my addr 172.21.15.134:0/963885477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1e37640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 0x7f719c149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a2638640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 0x7f719c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 -- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 msgr2=0x7f719c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 0x7f719c165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 -- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 msgr2=0x7f719c149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 0x7f719c149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 -- 172.21.15.134:0/963885477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c1539c0 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a2638640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 0x7f719c165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1e37640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 0x7f719c149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a1636640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f718c004ec0 tx=0x7f718c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c00f7b0 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c018070 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c153ca0 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c00fbb0 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.232+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c154260 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.233+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c15baa0 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.234+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f718c00fd50 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.234+0000 7f71927fc640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 0x7f718006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.234+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f718c08b740 con 0x7f719c154a60 2024-09-15T22:42:55.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.234+0000 7f71a1e37640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 0x7f718006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.234+0000 7f71a1e37640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 0x7f718006e920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7198007fd0 tx=0x7f7198009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.238+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f718c059c30 con 0x7f719c154a60 2024-09-15T22:42:55.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.424+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f719c153410 con 0x7f718006c460 2024-09-15T22:42:55.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.425+0000 7f71927fc640 1 -- 172.21.15.134:0/963885477 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f71980013b0 con 0x7f718006c460 2024-09-15T22:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 msgr2=0x7f718006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 0x7f718006e920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7198007fd0 tx=0x7f7198009040 comp rx=0 tx=0).stop 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 msgr2=0x7f719c152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f718c004ec0 tx=0x7f718c007430 comp rx=0 tx=0).stop 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 shutdown_connections 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f718006c460 0x7f718006e920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f719c153000 0x7f719c165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f719c154a60 0x7f719c152ac0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 --2- 172.21.15.134:0/963885477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71880051c0 0x7f719c149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 >> 172.21.15.134:0/963885477 conn(0x7f719c062cc0 msgr2=0x7f719c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.427+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 shutdown_connections 2024-09-15T22:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.428+0000 7f71a409b640 1 -- 172.21.15.134:0/963885477 wait complete. 2024-09-15T22:42:55.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:42:55.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.539+0000 7f55559e4640 1 Processor -- start 2024-09-15T22:42:55.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 -- start start 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f555015d3b0 0x7f5550071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55500cf320 0x7f55500cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55500715c0 con 0x7f555015d790 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f555006da30 con 0x7f55500cf320 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.540+0000 7f55559e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f555006d700 con 0x7f555015d3b0 2024-09-15T22:42:55.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55500cf320 0x7f55500cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55500cf320 0x7f55500cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58136/0 (socket says 172.21.15.134:58136) 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 -- 172.21.15.134:0/2076288155 learned_addr learned my addr 172.21.15.134:0/2076288155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554effd640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f555015d3b0 0x7f5550071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 -- 172.21.15.134:0/2076288155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f555015d3b0 msgr2=0x7f5550071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f555015d3b0 0x7f5550071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 -- 172.21.15.134:0/2076288155 >> v1:172.21.15.177:6789/0 conn(0x7f555015d790 legacy=0x7f55500cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.541+0000 7f554f7fe640 1 -- 172.21.15.134:0/2076288155 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55500cde80 con 0x7f55500cf320 2024-09-15T22:42:55.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f554f7fe640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500cf320 0x7f55500cf730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e50 tx=0x7f554802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae283b1eee1faef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f554dffb640 1 -- 172.21.15.134:0/2076288155 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548036070 con 0x7f55500cf320 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f554dffb640 1 -- 172.21.15.134:0/2076288155 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5548031600 con 0x7f55500cf320 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f554dffb640 1 -- 172.21.15.134:0/2076288155 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480319d0 con 0x7f55500cf320 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 -- 172.21.15.134:0/2076288155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500cf320 msgr2=0x7f55500cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500cf320 0x7f55500cf730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e50 tx=0x7f554802a710 comp rx=0 tx=0).stop 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 -- 172.21.15.134:0/2076288155 shutdown_connections 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500cf320 0x7f55500cf730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 --2- 172.21.15.134:0/2076288155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f555015d3b0 0x7f5550071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 -- 172.21.15.134:0/2076288155 >> 172.21.15.134:0/2076288155 conn(0x7f555006bba0 msgr2=0x7f555006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 -- 172.21.15.134:0/2076288155 shutdown_connections 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.542+0000 7f55559e4640 1 -- 172.21.15.134:0/2076288155 wait complete. 2024-09-15T22:42:55.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.543+0000 7f55559e4640 1 Processor -- start 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 -- start start 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55500cf320 0x7f55500b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5550150550 0x7f55501f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55500cd580 con 0x7f555015d3b0 2024-09-15T22:42:55.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55500cdba0 con 0x7f55500cf320 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f55559e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f55500cfc70 con 0x7f5550150550 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.544+0000 7f554e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58142/0 (socket says 172.21.15.134:58142) 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 -- 172.21.15.134:0/36179838 learned_addr learned my addr 172.21.15.134:0/36179838 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554effd640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55500cf320 0x7f55500b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554f7fe640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5550150550 0x7f55501f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 -- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5550150550 msgr2=0x7f55501f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5550150550 0x7f55501f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 -- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55500cf320 msgr2=0x7f55500b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55500cf320 0x7f55500b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 -- 172.21.15.134:0/36179838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5550150c60 con 0x7f555015d3b0 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f554e7fc640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f554400c400 tx=0x7f554400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440052d0 con 0x7f555015d3b0 2024-09-15T22:42:55.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55440054b0 con 0x7f555015d3b0 2024-09-15T22:42:55.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5550150300 con 0x7f555015d3b0 2024-09-15T22:42:55.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544006a60 con 0x7f555015d3b0 2024-09-15T22:42:55.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.545+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55500b1c00 con 0x7f555015d3b0 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.546+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555015cbf0 con 0x7f555015d3b0 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.547+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f5544006c00 con 0x7f555015d3b0 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.547+0000 7f5537fff640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 0x7f553c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.547+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f554408aa90 con 0x7f555015d3b0 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.547+0000 7f554effd640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 0x7f553c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.548+0000 7f554effd640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 0x7f553c06e920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5540006fd0 tx=0x7f5540008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.551+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5550150c60 con 0x7f555015d3b0 2024-09-15T22:42:55.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.717+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f55500ccab0 con 0x7f555015d3b0 2024-09-15T22:42:55.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.717+0000 7f5537fff640 1 -- 172.21.15.134:0/36179838 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f55440589e0 con 0x7f555015d3b0 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 msgr2=0x7f553c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 0x7f553c06e920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5540006fd0 tx=0x7f5540008040 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 msgr2=0x7f555014fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f554400c400 tx=0x7f554400c8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 shutdown_connections 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f553c06c460 0x7f553c06e920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5550150550 0x7f55501f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555015d3b0 0x7f555014fdc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 --2- 172.21.15.134:0/36179838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55500cf320 0x7f55500b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 >> 172.21.15.134:0/36179838 conn(0x7f555006bba0 msgr2=0x7f555015f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 shutdown_connections 2024-09-15T22:42:55.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.719+0000 7f55559e4640 1 -- 172.21.15.134:0/36179838 wait complete. 2024-09-15T22:42:55.731 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:55.732 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:55.747 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:42:55.747 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:55.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:42:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.941+0000 7ff6105fd640 1 Processor -- start 2024-09-15T22:42:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.941+0000 7ff6105fd640 1 -- start start 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff6105fd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff608073830 0x7ff6080cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff6105fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6080ce740 con 0x7ff6080cf070 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff6105fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff608072640 con 0x7ff60815c180 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff6105fd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff608072920 con 0x7ff608073830 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff60db98640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff6080cf070 0x7ff608073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50394/0 (socket says 172.21.15.134:50394) 2024-09-15T22:42:55.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff60db98640 1 -- 172.21.15.134:0/2989731454 learned_addr learned my addr 172.21.15.134:0/2989731454 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff60eb9a640 1 --2- 172.21.15.134:0/2989731454 >> v2:172.21.15.177:3300/0 conn(0x7ff608073830 0x7ff6080cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522256155 0 0) 0x7ff6080ce740 con 0x7ff6080cf070 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.942+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f4003520 con 0x7ff6080cf070 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.943+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 338595813 0 0) 0x7ff5f4003520 con 0x7ff6080cf070 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.943+0000 7ff60eb9a640 1 -- 172.21.15.134:0/2989731454 >> v1:172.21.15.177:6789/0 conn(0x7ff60815c180 legacy=0x7ff6080cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.943+0000 7ff60eb9a640 1 -- 172.21.15.134:0/2989731454 >> v1:172.21.15.134:6789/0 conn(0x7ff6080cf070 legacy=0x7ff608073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.943+0000 7ff60eb9a640 1 -- 172.21.15.134:0/2989731454 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608072c00 con 0x7ff608073830 2024-09-15T22:42:55.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.943+0000 7ff60eb9a640 1 --2- 172.21.15.134:0/2989731454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608073830 0x7ff6080cf4e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff600009d90 tx=0x7ff60002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b117d11c610c7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8001670 con 0x7ff608073830 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600007540 con 0x7ff608073830 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff60d397640 1 -- 172.21.15.134:0/2989731454 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600007910 con 0x7ff608073830 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 -- 172.21.15.134:0/2989731454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608073830 msgr2=0x7ff6080cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2989731454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608073830 0x7ff6080cf4e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff600009d90 tx=0x7ff60002a5f0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 -- 172.21.15.134:0/2989731454 shutdown_connections 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2989731454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608073830 0x7ff6080cf4e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 -- 172.21.15.134:0/2989731454 >> 172.21.15.134:0/2989731454 conn(0x7ff608062cc0 msgr2=0x7ff60806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 -- 172.21.15.134:0/2989731454 shutdown_connections 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.944+0000 7ff6105fd640 1 -- 172.21.15.134:0/2989731454 wait complete. 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.945+0000 7ff6105fd640 1 Processor -- start 2024-09-15T22:42:55.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.945+0000 7ff6105fd640 1 -- start start 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6080cf070 0x7ff60814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff60815c180 0x7ff6080b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6080722f0 con 0x7ff608073830 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6080ced00 con 0x7ff6080cf070 2024-09-15T22:42:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff6105fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff60815c560 con 0x7ff60815c180 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58156/0 (socket says 172.21.15.134:58156) 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 -- 172.21.15.134:0/2667637108 learned_addr learned my addr 172.21.15.134:0/2667637108 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60db98640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6080cf070 0x7ff60814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 -- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff60815c180 msgr2=0x7ff6080b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff60815c180 0x7ff6080b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 -- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6080cf070 msgr2=0x7ff60814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6080cf070 0x7ff60814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.946+0000 7ff60e399640 1 -- 172.21.15.134:0/2667637108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6080b50f0 con 0x7ff608073830 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff60e399640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c400 tx=0x7ff60400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604017070 con 0x7ff608073830 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6040052d0 con 0x7ff608073830 2024-09-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6080b4b30 con 0x7ff608073830 2024-09-15T22:42:55.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604003830 con 0x7ff608073830 2024-09-15T22:42:55.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.947+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60815d9b0 con 0x7ff608073830 2024-09-15T22:42:55.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.948+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff60815f4e0 con 0x7ff608073830 2024-09-15T22:42:55.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.948+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7ff60401a070 con 0x7ff608073830 2024-09-15T22:42:55.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.949+0000 7ff5feffd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 0x7ff5ec06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:55.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.949+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7ff60408ab00 con 0x7ff608073830 2024-09-15T22:42:55.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.949+0000 7ff60db98640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 0x7ff5ec06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:55.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.949+0000 7ff60db98640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 0x7ff5ec06e950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8001eb0 tx=0x7ff5f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:55.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:55.953+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff604058f70 con 0x7ff608073830 2024-09-15T22:42:56.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.131+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff60815b6e0 con 0x7ff608073830 2024-09-15T22:42:56.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.131+0000 7ff5feffd640 1 -- 172.21.15.134:0/2667637108 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7ff604058870 con 0x7ff608073830 2024-09-15T22:42:56.133 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 msgr2=0x7ff5ec06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 0x7ff5ec06e950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8001eb0 tx=0x7ff5f8009040 comp rx=0 tx=0).stop 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 msgr2=0x7ff6080b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c400 tx=0x7ff60400c8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 shutdown_connections 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff5ec06c490 0x7ff5ec06e950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff60815c180 0x7ff6080b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6080cf070 0x7ff60814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.133+0000 7ff6105fd640 1 --2- 172.21.15.134:0/2667637108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff608073830 0x7ff6080b3e50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.134+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 >> 172.21.15.134:0/2667637108 conn(0x7ff608062cc0 msgr2=0x7ff6081606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.134+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 shutdown_connections 2024-09-15T22:42:56.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.134+0000 7ff6105fd640 1 -- 172.21.15.134:0/2667637108 wait complete. 2024-09-15T22:42:56.146 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:42:56.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:56.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:42:56.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:42:56.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:56.175 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:42:56.231 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:56.231 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:56.251 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:42:56.251 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:42:56.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:42:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.408+0000 7fbb4748b640 1 Processor -- start 2024-09-15T22:42:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.408+0000 7fbb4748b640 1 -- start start 2024-09-15T22:42:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb4748b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 0x7fbb400b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb4748b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb400aff30 0x7fbb400b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb4748b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb400b0880 con 0x7fbb40156880 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb4748b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbb400b6b00 con 0x7fbb400aff30 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb4748b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbb400ce150 con 0x7fbb400cdae0 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb400aff30 0x7fbb400b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb400aff30 0x7fbb400b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36352/0 (socket says 172.21.15.134:36352) 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 -- 172.21.15.134:0/1932954314 learned_addr learned my addr 172.21.15.134:0/1932954314 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb44a26640 1 --2- 172.21.15.134:0/1932954314 >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 0x7fbb400b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 -- 172.21.15.134:0/1932954314 >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 msgr2=0x7fbb400b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 --2- 172.21.15.134:0/1932954314 >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 0x7fbb400b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 -- 172.21.15.134:0/1932954314 >> v1:172.21.15.177:6789/0 conn(0x7fbb40156880 legacy=0x7fbb40160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb45a28640 1 -- 172.21.15.134:0/1932954314 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400ce430 con 0x7fbb400aff30 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.409+0000 7fbb44a26640 1 --2- 172.21.15.134:0/1932954314 >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 0x7fbb400b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.410+0000 7fbb45a28640 1 --2- 172.21.15.134:0/1932954314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400aff30 0x7fbb400b0340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb400cfa40 tx=0x7fbb3802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561957e9db51868e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.410+0000 7fbb37fff640 1 -- 172.21.15.134:0/1932954314 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38036070 con 0x7fbb400aff30 2024-09-15T22:42:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.410+0000 7fbb37fff640 1 -- 172.21.15.134:0/1932954314 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb38031600 con 0x7fbb400aff30 2024-09-15T22:42:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.410+0000 7fbb37fff640 1 -- 172.21.15.134:0/1932954314 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380319d0 con 0x7fbb400aff30 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 -- 172.21.15.134:0/1932954314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400aff30 msgr2=0x7fbb400b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 --2- 172.21.15.134:0/1932954314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400aff30 0x7fbb400b0340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb400cfa40 tx=0x7fbb3802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 -- 172.21.15.134:0/1932954314 shutdown_connections 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 --2- 172.21.15.134:0/1932954314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400aff30 0x7fbb400b0340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 --2- 172.21.15.134:0/1932954314 >> v2:172.21.15.177:3300/0 conn(0x7fbb400cdae0 0x7fbb400b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 -- 172.21.15.134:0/1932954314 >> 172.21.15.134:0/1932954314 conn(0x7fbb4006cae0 msgr2=0x7fbb4006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 -- 172.21.15.134:0/1932954314 shutdown_connections 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.411+0000 7fbb4748b640 1 -- 172.21.15.134:0/1932954314 wait complete. 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.412+0000 7fbb4748b640 1 Processor -- start 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.412+0000 7fbb4748b640 1 -- start start 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb400aff30 0x7fbb4014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb40156880 0x7fbb4015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40156c60 con 0x7fbb400cdae0 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40160210 con 0x7fbb400aff30 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbb400ce710 con 0x7fbb40156880 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36360/0 (socket says 172.21.15.134:36360) 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 -- 172.21.15.134:0/3617688525 learned_addr learned my addr 172.21.15.134:0/3617688525 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:56.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb45227640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb400aff30 0x7fbb4014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb45a28640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb40156880 0x7fbb4015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 -- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb40156880 msgr2=0x7fbb4015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb40156880 0x7fbb4015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 -- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb400aff30 msgr2=0x7fbb4014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb400aff30 0x7fbb4014aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 -- 172.21.15.134:0/3617688525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400b4f00 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb44a26640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c7f0 tx=0x7fbb3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30015070 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb300079d0 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30007da0 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.413+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4014ea40 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.414+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb400b5b70 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.415+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb400b0340 con 0x7fbb400cdae0 2024-09-15T22:42:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.415+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7fbb30018070 con 0x7fbb400cdae0 2024-09-15T22:42:56.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.415+0000 7fbb35ffb640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 0x7fbb2406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.415+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fbb3008b640 con 0x7fbb400cdae0 2024-09-15T22:42:56.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.415+0000 7fbb45227640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 0x7fbb2406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.416+0000 7fbb45227640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 0x7fbb2406e920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.420+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb400b4f00 con 0x7fbb400cdae0 2024-09-15T22:42:56.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.598+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbb400b2910 con 0x7fbb400cdae0 2024-09-15T22:42:56.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.598+0000 7fbb35ffb640 1 -- 172.21.15.134:0/3617688525 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7fbb30059460 con 0x7fbb400cdae0 2024-09-15T22:42:56.599 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 msgr2=0x7fbb2406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 0x7fbb2406e920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c009060 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 msgr2=0x7fbb40153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c7f0 tx=0x7fbb3000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 shutdown_connections 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbb2406c460 0x7fbb2406e920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb40156880 0x7fbb4015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400cdae0 0x7fbb40153830 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 --2- 172.21.15.134:0/3617688525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb400aff30 0x7fbb4014aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 >> 172.21.15.134:0/3617688525 conn(0x7fbb4006cae0 msgr2=0x7fbb4006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 shutdown_connections 2024-09-15T22:42:56.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.600+0000 7fbb4748b640 1 -- 172.21.15.134:0/3617688525 wait complete. 2024-09-15T22:42:56.613 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:42:56.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:56.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:42:56.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:42:56.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:42:56.646 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:42:56.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.802+0000 7ff1ee5a6640 1 Processor -- start 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.802+0000 7ff1ee5a6640 1 -- start start 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.802+0000 7ff1ee5a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ee5a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff1e80b65c0 0x7ff1e8160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ee5a6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e80ce150 con 0x7ff1e80aff30 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ee5a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e80ce430 con 0x7ff1e80b65c0 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ee5a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e815ff30 con 0x7ff1e8156880 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1e77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff1e80b65c0 0x7ff1e8160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ecb43640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff1e80aff30 0x7ff1e815c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:55054/0 (socket says 172.21.15.134:55054) 2024-09-15T22:42:56.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1ecb43640 1 -- 172.21.15.134:0/2986620052 learned_addr learned my addr 172.21.15.134:0/2986620052 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1e6ffd640 1 -- 172.21.15.134:0/2986620052 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750438080 0 0) 0x7ff1e80ce150 con 0x7ff1e80aff30 2024-09-15T22:42:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.803+0000 7ff1e7fff640 1 -- 172.21.15.134:0/2986620052 >> v2:172.21.15.177:3300/0 conn(0x7ff1e80b65c0 msgr2=0x7ff1e8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e7fff640 1 --2- 172.21.15.134:0/2986620052 >> v2:172.21.15.177:3300/0 conn(0x7ff1e80b65c0 0x7ff1e8160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e7fff640 1 -- 172.21.15.134:0/2986620052 >> v1:172.21.15.177:6789/0 conn(0x7ff1e80aff30 legacy=0x7ff1e815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e7fff640 1 -- 172.21.15.134:0/2986620052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e8160210 con 0x7ff1e8156880 2024-09-15T22:42:56.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e7fff640 1 --2- 172.21.15.134:0/2986620052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80cdae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80097a0 tx=0x7ff1d802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b942e23ac73db7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e6ffd640 1 -- 172.21.15.134:0/2986620052 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8037070 con 0x7ff1e8156880 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e6ffd640 1 -- 172.21.15.134:0/2986620052 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d802ae50 con 0x7ff1e8156880 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.804+0000 7ff1e6ffd640 1 -- 172.21.15.134:0/2986620052 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8032660 con 0x7ff1e8156880 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/2986620052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 msgr2=0x7ff1e80cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/2986620052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80cdae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80097a0 tx=0x7ff1d802a100 comp rx=0 tx=0).stop 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/2986620052 shutdown_connections 2024-09-15T22:42:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/2986620052 >> v2:172.21.15.177:3300/0 conn(0x7ff1e80b65c0 0x7ff1e8160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/2986620052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80cdae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/2986620052 >> 172.21.15.134:0/2986620052 conn(0x7ff1e806cae0 msgr2=0x7ff1e806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/2986620052 shutdown_connections 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.805+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/2986620052 wait complete. 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.806+0000 7ff1ee5a6640 1 Processor -- start 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.806+0000 7ff1ee5a6640 1 -- start start 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1e80aff30 0x7ff1e8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8160c70 con 0x7ff1e80b65c0 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e80b6a00 con 0x7ff1e80aff30 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ee5a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e80ce710 con 0x7ff1e8156880 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36374/0 (socket says 172.21.15.134:36374) 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 -- 172.21.15.134:0/3480564870 learned_addr learned my addr 172.21.15.134:0/3480564870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e7fff640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1e80aff30 0x7ff1e8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1ecb43640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 -- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 msgr2=0x7ff1e80adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 -- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1e80aff30 msgr2=0x7ff1e8155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1e80aff30 0x7ff1e8155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.807+0000 7ff1e77fe640 1 -- 172.21.15.134:0/3480564870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e81f25e0 con 0x7ff1e80b65c0 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1e77fe640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000e9e0 tx=0x7ff1d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0017070 con 0x7ff1e80b65c0 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d000c970 con 0x7ff1e80b65c0 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e81f28c0 con 0x7ff1e80b65c0 2024-09-15T22:42:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000cd60 con 0x7ff1e80b65c0 2024-09-15T22:42:56.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.808+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e81f2e80 con 0x7ff1e80b65c0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.809+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e8160730 con 0x7ff1e80b65c0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.809+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7ff1d001a070 con 0x7ff1e80b65c0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.810+0000 7ff1e4ff9640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 0x7ff1c806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.810+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7ff1d008bad0 con 0x7ff1e80b65c0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.810+0000 7ff1e7fff640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 0x7ff1c806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.810+0000 7ff1e7fff640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 0x7ff1c806e920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8034000 tx=0x7ff1d802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:56.814+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1d0059fc0 con 0x7ff1e80b65c0 2024-09-15T22:42:57.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.014+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1e8071ee0 con 0x7ff1e80b65c0 2024-09-15T22:42:57.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.015+0000 7ff1e4ff9640 1 -- 172.21.15.134:0/3480564870 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7ff1d00598c0 con 0x7ff1e80b65c0 2024-09-15T22:42:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:57.016 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:42:57.017 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:42:57.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 msgr2=0x7ff1c806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 0x7ff1c806e920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8034000 tx=0x7ff1d802e000 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 msgr2=0x7ff1e80ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000e9e0 tx=0x7ff1d000eea0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 shutdown_connections 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff1c806c460 0x7ff1c806e920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1e8156880 0x7ff1e80adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80b65c0 0x7ff1e80ac630 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 --2- 172.21.15.134:0/3480564870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1e80aff30 0x7ff1e8155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 >> 172.21.15.134:0/3480564870 conn(0x7ff1e806cae0 msgr2=0x7ff1e815ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 shutdown_connections 2024-09-15T22:42:57.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.017+0000 7ff1ee5a6640 1 -- 172.21.15.134:0/3480564870 wait complete. 2024-09-15T22:42:57.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:42:57.161 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-09-15T22:42:57.162 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-15T22:42:57.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol64310 2024-09-15T22:42:57.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.263+0000 7f87eed2c640 1 Processor -- start 2024-09-15T22:42:57.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.263+0000 7f87eed2c640 1 -- start start 2024-09-15T22:42:57.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87eed2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87eed2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87e80729a0 0x7f87e80b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87eed2c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e806dc40 con 0x7f87e80b57d0 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87eed2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f87e806e570 con 0x7f87e80729a0 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87eed2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f87e806df20 con 0x7f87e8161cc0 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87e80729a0 0x7f87e80b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87e80729a0 0x7f87e80b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36386/0 (socket says 172.21.15.134:36386) 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 -- 172.21.15.134:0/1412046587 learned_addr learned my addr 172.21.15.134:0/1412046587 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ecac8640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 -- 172.21.15.134:0/1412046587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 msgr2=0x7f87e80aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e80aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 -- 172.21.15.134:0/1412046587 >> v1:172.21.15.177:6789/0 conn(0x7f87e80b57d0 legacy=0x7f87e8072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ed2c9640 1 -- 172.21.15.134:0/1412046587 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e806e200 con 0x7f87e80729a0 2024-09-15T22:42:57.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.264+0000 7f87ecac8640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87ed2c9640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e80b5c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009e50 tx=0x7f87e002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651cf14789d70521 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87e77fe640 1 -- 172.21.15.134:0/1412046587 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0036070 con 0x7f87e80729a0 2024-09-15T22:42:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87e77fe640 1 -- 172.21.15.134:0/1412046587 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e0031600 con 0x7f87e80729a0 2024-09-15T22:42:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87e77fe640 1 -- 172.21.15.134:0/1412046587 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e00319d0 con 0x7f87e80729a0 2024-09-15T22:42:57.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 -- 172.21.15.134:0/1412046587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 msgr2=0x7f87e80b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e80b5c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009e50 tx=0x7f87e002a710 comp rx=0 tx=0).stop 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 -- 172.21.15.134:0/1412046587 shutdown_connections 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e80b5c10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1412046587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 -- 172.21.15.134:0/1412046587 >> 172.21.15.134:0/1412046587 conn(0x7f87e806bba0 msgr2=0x7f87e806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 -- 172.21.15.134:0/1412046587 shutdown_connections 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.265+0000 7f87eed2c640 1 -- 172.21.15.134:0/1412046587 wait complete. 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 Processor -- start 2024-09-15T22:42:57.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 -- start start 2024-09-15T22:42:57.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87e80b57d0 0x7f87e81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87e80b4be0 con 0x7f87e80729a0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f87e80b4a60 con 0x7f87e80b57d0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.267+0000 7f87eed2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f87e806ea00 con 0x7f87e8161cc0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36394/0 (socket says 172.21.15.134:36394) 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 -- 172.21.15.134:0/1173611424 learned_addr learned my addr 172.21.15.134:0/1173611424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87e7fff640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87e80b57d0 0x7f87e81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ed2c9640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 -- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 msgr2=0x7f87e8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 -- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87e80b57d0 msgr2=0x7f87e81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87e80b57d0 0x7f87e81575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 -- 172.21.15.134:0/1173611424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e80afdf0 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87ecac8640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00d7d0 tx=0x7f87dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc004030 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87dc0041d0 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e80b00d0 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0096a0 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.268+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e80b0690 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.269+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e8050050 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.270+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f87dc009840 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.270+0000 7f87e57fa640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 0x7f87cc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.270+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f87dc08b870 con 0x7f87e80729a0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.270+0000 7f87e7fff640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 0x7f87cc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.271+0000 7f87e7fff640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 0x7f87cc06e920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87e815e380 tx=0x7f87d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.274+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87e8050050 con 0x7f87e80729a0 2024-09-15T22:42:57.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.464+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol64310", "target": ["mon-mgr", ""]}) -- 0x7f87e80b5c10 con 0x7f87cc06c460 2024-09-15T22:42:57.470 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:57.469+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:57.470 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:57.469+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:57.470 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:57.469+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:57.470 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:57.469+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:57.470 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:42:57.469+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:42:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.497+0000 7f87e57fa640 1 -- 172.21.15.134:0/1173611424 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f87e80b5c10 con 0x7f87cc06c460 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 msgr2=0x7f87cc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 0x7f87cc06e920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87e815e380 tx=0x7f87d4009040 comp rx=0 tx=0).stop 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 msgr2=0x7f87e814a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00d7d0 tx=0x7f87dc00dc90 comp rx=0 tx=0).stop 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 shutdown_connections 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f87cc06c460 0x7f87cc06e920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87e8161cc0 0x7f87e8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87e80b57d0 0x7f87e81575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 --2- 172.21.15.134:0/1173611424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e80729a0 0x7f87e814a6e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 >> 172.21.15.134:0/1173611424 conn(0x7f87e806bba0 msgr2=0x7f87e80cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:57.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 shutdown_connections 2024-09-15T22:42:57.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.499+0000 7f87eed2c640 1 -- 172.21.15.134:0/1173611424 wait complete. 2024-09-15T22:42:57.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:57.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.608+0000 7f8a37a65640 1 Processor -- start 2024-09-15T22:42:57.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.608+0000 7f8a37a65640 1 -- start start 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a300d02a0 0x7f8a300d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a3015ca40 0x7f8a3015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a3015ceb0 0x7f8a301594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8a300d0bc0 con 0x7f8a3015ca40 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3015d390 con 0x7f8a300d02a0 2024-09-15T22:42:57.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a37a65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3015d670 con 0x7f8a3015ceb0 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a35000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a3015ca40 0x7f8a3015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a35000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a3015ca40 0x7f8a3015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36434/0 (socket says 172.21.15.134:36434) 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.609+0000 7f8a35000640 1 -- 172.21.15.134:0/4196710029 learned_addr learned my addr 172.21.15.134:0/4196710029 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a36002640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a3015ceb0 0x7f8a301594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35801640 1 --2- 172.21.15.134:0/4196710029 >> v2:172.21.15.177:3300/0 conn(0x7f8a300d02a0 0x7f8a300d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 -- 172.21.15.134:0/4196710029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a3015ceb0 msgr2=0x7f8a301594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a3015ceb0 0x7f8a301594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 -- 172.21.15.134:0/4196710029 >> v2:172.21.15.177:3300/0 conn(0x7f8a300d02a0 msgr2=0x7f8a300d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 --2- 172.21.15.134:0/4196710029 >> v2:172.21.15.177:3300/0 conn(0x7f8a300d02a0 0x7f8a300d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 -- 172.21.15.134:0/4196710029 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3015d950 con 0x7f8a3015ca40 2024-09-15T22:42:57.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.610+0000 7f8a35000640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ca40 0x7f8a3015e430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006f030 tx=0x7f8a2002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bc7a1042f4d80b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a27fff640 1 -- 172.21.15.134:0/4196710029 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20037070 con 0x7f8a3015ca40 2024-09-15T22:42:57.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a27fff640 1 -- 172.21.15.134:0/4196710029 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a20032440 con 0x7f8a3015ca40 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a27fff640 1 -- 172.21.15.134:0/4196710029 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20032810 con 0x7f8a3015ca40 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 -- 172.21.15.134:0/4196710029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ca40 msgr2=0x7f8a3015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ca40 0x7f8a3015e430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006f030 tx=0x7f8a2002a140 comp rx=0 tx=0).stop 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 -- 172.21.15.134:0/4196710029 shutdown_connections 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a3015ceb0 0x7f8a301594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 --2- 172.21.15.134:0/4196710029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ca40 0x7f8a3015e430 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 --2- 172.21.15.134:0/4196710029 >> v2:172.21.15.177:3300/0 conn(0x7f8a300d02a0 0x7f8a300d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 -- 172.21.15.134:0/4196710029 >> 172.21.15.134:0/4196710029 conn(0x7f8a30062cc0 msgr2=0x7f8a3006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 -- 172.21.15.134:0/4196710029 shutdown_connections 2024-09-15T22:42:57.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.611+0000 7f8a37a65640 1 -- 172.21.15.134:0/4196710029 wait complete. 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 Processor -- start 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 -- start start 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a300d02a0 0x7f8a30149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a3015ca40 0x7f8a301520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30155b90 con 0x7f8a3015ceb0 2024-09-15T22:42:57.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3015df10 con 0x7f8a3015ca40 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.613+0000 7f8a37a65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8a30155d10 con 0x7f8a300d02a0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36438/0 (socket says 172.21.15.134:36438) 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 -- 172.21.15.134:0/2765083639 learned_addr learned my addr 172.21.15.134:0/2765083639 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a35801640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a300d02a0 0x7f8a30149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a35000640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a3015ca40 0x7f8a301520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 -- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a300d02a0 msgr2=0x7f8a30149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a300d02a0 0x7f8a30149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 -- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a3015ca40 msgr2=0x7f8a301520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a3015ca40 0x7f8a301520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 -- 172.21.15.134:0/2765083639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a301510f0 con 0x7f8a3015ceb0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a36002640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a28007d40 tx=0x7f8a2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28014420 con 0x7f8a3015ceb0 2024-09-15T22:42:57.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28019070 con 0x7f8a3015ceb0 2024-09-15T22:42:57.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28014820 con 0x7f8a3015ceb0 2024-09-15T22:42:57.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a301513d0 con 0x7f8a3015ceb0 2024-09-15T22:42:57.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.614+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a30151990 con 0x7f8a3015ceb0 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.615+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a300b4790 con 0x7f8a3015ceb0 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.616+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f8a280149c0 con 0x7f8a3015ceb0 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.616+0000 7f8a25ffb640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 0x7f8a1406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.616+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f8a2808be40 con 0x7f8a3015ceb0 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.616+0000 7f8a35801640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 0x7f8a1406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:57.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.617+0000 7f8a35801640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 0x7f8a1406e920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c003610 tx=0x7f8a2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:57.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.620+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a28059ce0 con 0x7f8a3015ceb0 2024-09-15T22:42:57.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.817+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a30154330 con 0x7f8a3015ceb0 2024-09-15T22:42:57.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.818+0000 7f8a25ffb640 1 -- 172.21.15.134:0/2765083639 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f8a2805dfe0 con 0x7f8a3015ceb0 2024-09-15T22:42:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:57.820 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:42:57.821 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:42:57.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 msgr2=0x7f8a1406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 0x7f8a1406e920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c003610 tx=0x7f8a2c008040 comp rx=0 tx=0).stop 2024-09-15T22:42:57.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 msgr2=0x7f8a300725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:57.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a28007d40 tx=0x7f8a2800e4b0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 shutdown_connections 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8a1406c460 0x7f8a1406e920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a3015ceb0 0x7f8a300725b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a3015ca40 0x7f8a301520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 --2- 172.21.15.134:0/2765083639 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a300d02a0 0x7f8a30149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 >> 172.21.15.134:0/2765083639 conn(0x7f8a30062cc0 msgr2=0x7f8a30154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 shutdown_connections 2024-09-15T22:42:57.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:57.820+0000 7f8a37a65640 1 -- 172.21.15.134:0/2765083639 wait complete. 2024-09-15T22:42:57.832 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:42:57.962 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.47998651599999997,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.976116243456229,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:42:57.963 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.97611624345623 }, "state": "open", "uptime": 0.479986516 } ] 2024-09-15T22:42:57.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:42:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.060+0000 7f3fdef03640 1 Processor -- start 2024-09-15T22:42:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.060+0000 7f3fdef03640 1 -- start start 2024-09-15T22:42:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdef03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 0x7f3fd80cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdef03640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 0x7f3fd8073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdef03640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd80ce740 con 0x7f3fd815c180 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdef03640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd8072640 con 0x7f3fd8073120 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdef03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd8072920 con 0x7f3fd80cf070 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdcc9f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3fd815c180 0x7f3fd80cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:55062/0 (socket says 172.21.15.134:55062) 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdcc9f640 1 -- 172.21.15.134:0/1709594526 learned_addr learned my addr 172.21.15.134:0/1709594526 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdd4a0640 1 --2- 172.21.15.134:0/1709594526 >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 0x7f3fd8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/1709594526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 0x7f3fd80cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd7fff640 1 -- 172.21.15.134:0/1709594526 >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 msgr2=0x7f3fd8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/1709594526 >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 0x7f3fd8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd7fff640 1 -- 172.21.15.134:0/1709594526 >> v1:172.21.15.177:6789/0 conn(0x7f3fd815c180 legacy=0x7f3fd80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd7fff640 1 -- 172.21.15.134:0/1709594526 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd8072c00 con 0x7f3fd80cf070 2024-09-15T22:42:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fd77fe640 1 -- 172.21.15.134:0/1709594526 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595296378 0 0) 0x7f3fd80ce740 con 0x7f3fd815c180 2024-09-15T22:42:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.061+0000 7f3fdd4a0640 1 --2- 172.21.15.134:0/1709594526 >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 0x7f3fd8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.062+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/1709594526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 0x7f3fd80cf4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40097a0 tx=0x7f3fc402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f572cb65b147cb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.062+0000 7f3fd77fe640 1 -- 172.21.15.134:0/1709594526 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4037070 con 0x7f3fd80cf070 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.062+0000 7f3fd77fe640 1 -- 172.21.15.134:0/1709594526 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc402ae50 con 0x7f3fd80cf070 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.062+0000 7f3fd77fe640 1 -- 172.21.15.134:0/1709594526 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4032660 con 0x7f3fd80cf070 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 -- 172.21.15.134:0/1709594526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 msgr2=0x7f3fd80cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 --2- 172.21.15.134:0/1709594526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 0x7f3fd80cf4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40097a0 tx=0x7f3fc402a100 comp rx=0 tx=0).stop 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 -- 172.21.15.134:0/1709594526 shutdown_connections 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 --2- 172.21.15.134:0/1709594526 >> v2:172.21.15.177:3300/0 conn(0x7f3fd8073120 0x7f3fd8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 --2- 172.21.15.134:0/1709594526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd80cf070 0x7f3fd80cf4b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 -- 172.21.15.134:0/1709594526 >> 172.21.15.134:0/1709594526 conn(0x7f3fd8062cc0 msgr2=0x7f3fd806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 -- 172.21.15.134:0/1709594526 shutdown_connections 2024-09-15T22:42:58.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.063+0000 7f3fdef03640 1 -- 172.21.15.134:0/1709594526 wait complete. 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.064+0000 7f3fdef03640 1 Processor -- start 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.064+0000 7f3fdef03640 1 -- start start 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 0x7f3fd814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80722f0 con 0x7f3fd80cf070 2024-09-15T22:42:58.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80ced00 con 0x7f3fd815c180 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdef03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd815c560 con 0x7f3fd8073120 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdcc9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdd4a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 0x7f3fd814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36448/0 (socket says 172.21.15.134:36448) 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fdcc9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:42802/0 (socket says 172.21.15.134:42802) 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.065+0000 7f3fd7fff640 1 -- 172.21.15.134:0/803758346 learned_addr learned my addr 172.21.15.134:0/803758346 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 -- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 msgr2=0x7f3fd814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 -- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 msgr2=0x7f3fd814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 0x7f3fd814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 -- 172.21.15.134:0/803758346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd815e630 con 0x7f3fd80cf070 2024-09-15T22:42:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fdd4a0640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 0x7f3fd814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fdcc9f640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd7fff640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4035040 tx=0x7f3fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4041070 con 0x7f3fd80cf070 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc403c460 con 0x7f3fd80cf070 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4037040 con 0x7f3fd80cf070 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd815d870 con 0x7f3fd80cf070 2024-09-15T22:42:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.066+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd815de30 con 0x7f3fd80cf070 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.067+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd80cf4b0 con 0x7f3fd80cf070 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.068+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) ==== 90999+0+0 (secure 0 0 0) 0x7f3fc403a070 con 0x7f3fd80cf070 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.068+0000 7f3fd57fa640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 0x7f3fbc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.068+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f3fc40ab800 con 0x7f3fd80cf070 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.068+0000 7f3fdcc9f640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 0x7f3fbc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.069+0000 7f3fdcc9f640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 0x7f3fbc06e920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f60 tx=0x7f3fcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.073+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fc4079730 con 0x7f3fd80cf070 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.274+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fd80d00e0 con 0x7f3fd80cf070 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.275+0000 7f3fd57fa640 1 -- 172.21.15.134:0/803758346 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f3fc407da30 con 0x7f3fd80cf070 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 msgr2=0x7f3fbc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 0x7f3fbc06e920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f60 tx=0x7f3fcc009040 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 msgr2=0x7f3fd8150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4035040 tx=0x7f3fc40046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 shutdown_connections 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3fbc06c460 0x7f3fbc06e920 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fd815c180 0x7f3fd814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd80cf070 0x7f3fd8150ce0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 --2- 172.21.15.134:0/803758346 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fd8073120 0x7f3fd814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 >> 172.21.15.134:0/803758346 conn(0x7f3fd8062cc0 msgr2=0x7f3fd8159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 shutdown_connections 2024-09-15T22:42:58.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:42:58.277+0000 7f3fdef03640 1 -- 172.21.15.134:0/803758346 wait complete. 2024-09-15T22:42:58.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:42:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.92897390199999996,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.953330455845645,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:42:58.413 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.953330455845645 }, "state": "open", "uptime": 0.928973902 } ] 2024-09-15T22:42:58.413 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:03.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:03.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.524+0000 7f4b79b0a640 1 Processor -- start 2024-09-15T22:43:03.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.524+0000 7f4b79b0a640 1 -- start start 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b79b0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4b7415c180 0x7f4b740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b79b0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b74073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b79b0a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b740ce740 con 0x7f4b740ce230 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b79b0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4b74072640 con 0x7f4b7415c180 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b79b0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4b74072920 con 0x7f4b74073120 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4b7415c180 0x7f4b740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4b7415c180 0x7f4b740cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36452/0 (socket says 172.21.15.134:36452) 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 -- 172.21.15.134:0/339479850 learned_addr learned my addr 172.21.15.134:0/339479850 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 -- 172.21.15.134:0/339479850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 msgr2=0x7f4b74073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b73fff640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b74073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b74073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 -- 172.21.15.134:0/339479850 >> v1:172.21.15.177:6789/0 conn(0x7f4b740ce230 legacy=0x7f4b740cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b737fe640 1 -- 172.21.15.134:0/339479850 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b74072c00 con 0x7f4b7415c180 2024-09-15T22:43:03.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.525+0000 7f4b73fff640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b74073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:03.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.526+0000 7f4b737fe640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b7415c180 0x7f4b740cdcf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009e50 tx=0x7f4b6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c075c3bde5baee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.526+0000 7f4b727fc640 1 -- 172.21.15.134:0/339479850 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64036070 con 0x7f4b7415c180 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.526+0000 7f4b727fc640 1 -- 172.21.15.134:0/339479850 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64031600 con 0x7f4b7415c180 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.526+0000 7f4b727fc640 1 -- 172.21.15.134:0/339479850 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640319d0 con 0x7f4b7415c180 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 -- 172.21.15.134:0/339479850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b7415c180 msgr2=0x7f4b740cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b7415c180 0x7f4b740cdcf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009e50 tx=0x7f4b6402a680 comp rx=0 tx=0).stop 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 -- 172.21.15.134:0/339479850 shutdown_connections 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b74073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/339479850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b7415c180 0x7f4b740cdcf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 -- 172.21.15.134:0/339479850 >> 172.21.15.134:0/339479850 conn(0x7f4b74062cc0 msgr2=0x7f4b7406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:03.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 -- 172.21.15.134:0/339479850 shutdown_connections 2024-09-15T22:43:03.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.527+0000 7f4b79b0a640 1 -- 172.21.15.134:0/339479850 wait complete. 2024-09-15T22:43:03.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.528+0000 7f4b79b0a640 1 Processor -- start 2024-09-15T22:43:03.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.528+0000 7f4b79b0a640 1 -- start start 2024-09-15T22:43:03.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b741509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b7415c180 0x7f4b741e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b740cf780 con 0x7f4b740ce230 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b740722f0 con 0x7f4b7415c180 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b79b0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7415c560 con 0x7f4b74073120 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b72ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b72ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36466/0 (socket says 172.21.15.134:36466) 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.529+0000 7f4b72ffd640 1 -- 172.21.15.134:0/1369071630 learned_addr learned my addr 172.21.15.134:0/1369071630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 -- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 msgr2=0x7f4b741509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b741509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 -- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b7415c180 msgr2=0x7f4b741e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b7415c180 0x7f4b741e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 -- 172.21.15.134:0/1369071630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7415a8b0 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b72ffd640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c340 tx=0x7f4b6800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68017070 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b680052d0 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68003850 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b74151380 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.530+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7415ae10 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.531+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b740cdcf0 con 0x7f4b740ce230 2024-09-15T22:43:03.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.532+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f4b6801a070 con 0x7f4b740ce230 2024-09-15T22:43:03.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.532+0000 7f4b5bfff640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 0x7f4b6006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.532+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f4b6808aa70 con 0x7f4b740ce230 2024-09-15T22:43:03.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.532+0000 7f4b737fe640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 0x7f4b6006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.532+0000 7f4b737fe640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 0x7f4b6006e9b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b64033000 tx=0x7f4b6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:03.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.536+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b7415a8b0 con 0x7f4b740ce230 2024-09-15T22:43:03.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.734+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b7415b6e0 con 0x7f4b740ce230 2024-09-15T22:43:03.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.735+0000 7f4b5bfff640 1 -- 172.21.15.134:0/1369071630 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f4b6805de20 con 0x7f4b740ce230 2024-09-15T22:43:03.736 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:03.736 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:03.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 msgr2=0x7f4b6006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 0x7f4b6006e9b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b64033000 tx=0x7f4b6402e000 comp rx=0 tx=0).stop 2024-09-15T22:43:03.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 msgr2=0x7f4b741e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c340 tx=0x7f4b6800c800 comp rx=0 tx=0).stop 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 shutdown_connections 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4b6006c4f0 0x7f4b6006e9b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b7415c180 0x7f4b741e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b740ce230 0x7f4b741e81a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 --2- 172.21.15.134:0/1369071630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b74073120 0x7f4b741509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 >> 172.21.15.134:0/1369071630 conn(0x7f4b74062cc0 msgr2=0x7f4b740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 shutdown_connections 2024-09-15T22:43:03.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:03.737+0000 7f4b79b0a640 1 -- 172.21.15.134:0/1369071630 wait complete. 2024-09-15T22:43:03.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:03.881 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.39882024,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.67762946666252,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:03.881 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.67762946666252 }, "state": "open", "uptime": 6.39882024 } ] 2024-09-15T22:43:03.882 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:08.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:08.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.994+0000 7fc72d398640 1 Processor -- start 2024-09-15T22:43:08.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.994+0000 7fc72d398640 1 -- start start 2024-09-15T22:43:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc72d398640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc72815e7b0 0x7fc728071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc72d398640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc728071880 con 0x7fc72806ccb0 2024-09-15T22:43:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc72d398640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7280741c0 con 0x7fc7280b5600 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc72d398640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc72806e680 con 0x7fc72815e7b0 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc726ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc72815e7b0 0x7fc728071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc7277fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc72806ccb0 0x7fc72806d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35618/0 (socket says 172.21.15.134:35618) 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.995+0000 7fc7277fe640 1 -- 172.21.15.134:0/3492221718 learned_addr learned my addr 172.21.15.134:0/3492221718 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc726ffd640 1 -- 172.21.15.134:0/3492221718 >> v1:172.21.15.177:6789/0 conn(0x7fc7280b5600 legacy=0x7fc728073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc726ffd640 1 -- 172.21.15.134:0/3492221718 >> v1:172.21.15.134:6789/0 conn(0x7fc72806ccb0 legacy=0x7fc72806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc726ffd640 1 -- 172.21.15.134:0/3492221718 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72806e8d0 con 0x7fc72815e7b0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc725ffb640 1 -- 172.21.15.134:0/3492221718 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676836740 0 0) 0x7fc720001110 con 0x7fc72806ccb0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc726ffd640 1 --2- 172.21.15.134:0/3492221718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc728071340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d90 tx=0x7fc71802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e4257a1f45558 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc725ffb640 1 -- 172.21.15.134:0/3492221718 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718007740 con 0x7fc72815e7b0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.996+0000 7fc725ffb640 1 -- 172.21.15.134:0/3492221718 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7180078e0 con 0x7fc72815e7b0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc725ffb640 1 -- 172.21.15.134:0/3492221718 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718007cb0 con 0x7fc72815e7b0 2024-09-15T22:43:09.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 -- 172.21.15.134:0/3492221718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 msgr2=0x7fc728071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 --2- 172.21.15.134:0/3492221718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc728071340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d90 tx=0x7fc71802a660 comp rx=0 tx=0).stop 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 -- 172.21.15.134:0/3492221718 shutdown_connections 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 --2- 172.21.15.134:0/3492221718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc728071340 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 -- 172.21.15.134:0/3492221718 >> 172.21.15.134:0/3492221718 conn(0x7fc7280b4300 msgr2=0x7fc7280b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 -- 172.21.15.134:0/3492221718 shutdown_connections 2024-09-15T22:43:09.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.997+0000 7fc72d398640 1 -- 172.21.15.134:0/3492221718 wait complete. 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.998+0000 7fc72d398640 1 Processor -- start 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 -- start start 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 0x7fc728158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 0x7fc728158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc728073590 con 0x7fc72815e7b0 2024-09-15T22:43:09.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7280732b0 con 0x7fc7280b5600 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc72d398640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc7280b6ce0 con 0x7fc72806ccb0 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc7277fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc7277fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40546/0 (socket says 172.21.15.134:40546) 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc7277fe640 1 -- 172.21.15.134:0/154194998 learned_addr learned my addr 172.21.15.134:0/154194998 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:08.999+0000 7fc726ffd640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 0x7fc728158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7267fc640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 0x7fc728158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:09.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 -- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 msgr2=0x7fc728158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 0x7fc728158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 -- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 msgr2=0x7fc728158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 0x7fc728158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 -- 172.21.15.134:0/154194998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7280d09a0 con 0x7fc72815e7b0 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7267fc640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 0x7fc728158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:09.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc726ffd640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 0x7fc728158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc7277fe640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc72000c780 tx=0x7fc72000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720018070 con 0x7fc72815e7b0 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7200070d0 con 0x7fc72815e7b0 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7280d0c80 con 0x7fc72815e7b0 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7200074c0 con 0x7fc72815e7b0 2024-09-15T22:43:09.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.000+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7280d1240 con 0x7fc72815e7b0 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.001+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc728071340 con 0x7fc72815e7b0 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.001+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7fc72001b070 con 0x7fc72815e7b0 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.002+0000 7fc70f7fe640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 0x7fc71406e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.002+0000 7fc726ffd640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 0x7fc71406e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.002+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fc72008aa50 con 0x7fc72815e7b0 2024-09-15T22:43:09.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.003+0000 7fc726ffd640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 0x7fc71406e9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc718034000 tx=0x7fc718033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:09.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.007+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc728071880 con 0x7fc72815e7b0 2024-09-15T22:43:09.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.207+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7280b1a90 con 0x7fc72815e7b0 2024-09-15T22:43:09.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.208+0000 7fc70f7fe640 1 -- 172.21.15.134:0/154194998 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fc720058e60 con 0x7fc72815e7b0 2024-09-15T22:43:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:09.210 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:09.211 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 msgr2=0x7fc71406e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 0x7fc71406e9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc718034000 tx=0x7fc718033040 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 msgr2=0x7fc72814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc72000c780 tx=0x7fc72000cc40 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 shutdown_connections 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc71406c520 0x7fc71406e9e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc72815e7b0 0x7fc72814acc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7280b5600 0x7fc728158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 --2- 172.21.15.134:0/154194998 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc72806ccb0 0x7fc728158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 >> 172.21.15.134:0/154194998 conn(0x7fc7280b4300 msgr2=0x7fc72815f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 shutdown_connections 2024-09-15T22:43:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:09.210+0000 7fc72d398640 1 -- 172.21.15.134:0/154194998 wait complete. 2024-09-15T22:43:09.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:09.352 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":11.869666544999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.405341414200191,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:09.352 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.40534141420019 }, "state": "open", "uptime": 11.869666545 } ] 2024-09-15T22:43:09.352 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:14.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.463+0000 7f9ba5e53640 1 Processor -- start 2024-09-15T22:43:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.463+0000 7f9ba5e53640 1 -- start start 2024-09-15T22:43:14.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9ba5e53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 0x7f9ba015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9ba5e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9ba5e53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba015d390 con 0x7f9ba00d02a0 2024-09-15T22:43:14.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9ba5e53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba015d670 con 0x7f9ba015ca40 2024-09-15T22:43:14.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9ba5e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba015d950 con 0x7f9ba015ceb0 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9effd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 0x7f9ba015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9f7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9ba00d02a0 0x7f9ba00d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:38822/0 (socket says 172.21.15.134:38822) 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9f7fe640 1 -- 172.21.15.134:0/3296303277 learned_addr learned my addr 172.21.15.134:0/3296303277 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9ffff640 1 --2- 172.21.15.134:0/3296303277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9e7fc640 1 -- 172.21.15.134:0/3296303277 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949471640 0 0) 0x7f9ba015d390 con 0x7f9ba00d02a0 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9e7fc640 1 -- 172.21.15.134:0/3296303277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b8c003520 con 0x7f9ba00d02a0 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9ffff640 1 -- 172.21.15.134:0/3296303277 >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 msgr2=0x7f9ba015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9ffff640 1 --2- 172.21.15.134:0/3296303277 >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 0x7f9ba015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9ffff640 1 -- 172.21.15.134:0/3296303277 >> v1:172.21.15.177:6789/0 conn(0x7f9ba00d02a0 legacy=0x7f9ba00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9ffff640 1 -- 172.21.15.134:0/3296303277 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba015dc30 con 0x7f9ba015ceb0 2024-09-15T22:43:14.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.464+0000 7f9b9effd640 1 --2- 172.21.15.134:0/3296303277 >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 0x7f9ba015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.465+0000 7f9b9ffff640 1 --2- 172.21.15.134:0/3296303277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba01594c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009d90 tx=0x7f9b9802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd66f89af12addc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.465+0000 7f9b9e7fc640 1 -- 172.21.15.134:0/3296303277 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98031600 con 0x7f9ba015ceb0 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.465+0000 7f9b9e7fc640 1 -- 172.21.15.134:0/3296303277 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b980317a0 con 0x7f9ba015ceb0 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.465+0000 7f9b9e7fc640 1 -- 172.21.15.134:0/3296303277 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98031b50 con 0x7f9ba015ceb0 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 -- 172.21.15.134:0/3296303277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 msgr2=0x7f9ba01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/3296303277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba01594c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009d90 tx=0x7f9b9802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 -- 172.21.15.134:0/3296303277 shutdown_connections 2024-09-15T22:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/3296303277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba01594c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/3296303277 >> v2:172.21.15.177:3300/0 conn(0x7f9ba015ca40 0x7f9ba015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 -- 172.21.15.134:0/3296303277 >> 172.21.15.134:0/3296303277 conn(0x7f9ba0062cc0 msgr2=0x7f9ba006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 -- 172.21.15.134:0/3296303277 shutdown_connections 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.466+0000 7f9ba5e53640 1 -- 172.21.15.134:0/3296303277 wait complete. 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.467+0000 7f9ba5e53640 1 Processor -- start 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.467+0000 7f9ba5e53640 1 -- start start 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba00d02a0 0x7f9ba014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0155d10 con 0x7f9ba015ca40 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0155b90 con 0x7f9ba00d02a0 2024-09-15T22:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9ba5e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba00b4790 con 0x7f9ba015ceb0 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9b9effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9b9effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40550/0 (socket says 172.21.15.134:40550) 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9b9effd640 1 -- 172.21.15.134:0/2927808300 learned_addr learned my addr 172.21.15.134:0/2927808300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9b9f7fe640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba00d02a0 0x7f9ba014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.468+0000 7f9b9ffff640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 -- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 msgr2=0x7f9ba015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba015bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 -- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba00d02a0 msgr2=0x7f9ba014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba00d02a0 0x7f9ba014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 -- 172.21.15.134:0/2927808300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba0157e20 con 0x7f9ba015ca40 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b9effd640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e990 tx=0x7f9b8800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88017070 con 0x7f9ba015ca40 2024-09-15T22:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8800c9e0 con 0x7f9ba015ca40 2024-09-15T22:43:14.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba0157060 con 0x7f9ba015ca40 2024-09-15T22:43:14.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800cdb0 con 0x7f9ba015ca40 2024-09-15T22:43:14.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.469+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba0157620 con 0x7f9ba015ca40 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.470+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba00d0680 con 0x7f9ba015ca40 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.471+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f9b8801a070 con 0x7f9ba015ca40 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.471+0000 7f9b97fff640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 0x7f9b8006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.471+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f9b8808b6b0 con 0x7f9ba015ca40 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.471+0000 7f9b9f7fe640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 0x7f9b8006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:14.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.472+0000 7f9b9f7fe640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 0x7f9b8006e9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b90005880 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.476+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b88059470 con 0x7f9ba015ca40 2024-09-15T22:43:14.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.674+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ba00b28f0 con 0x7f9ba015ca40 2024-09-15T22:43:14.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.674+0000 7f9b97fff640 1 -- 172.21.15.134:0/2927808300 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f9b8805d770 con 0x7f9ba015ca40 2024-09-15T22:43:14.676 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:14.676 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:14.676 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 msgr2=0x7f9b8006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 0x7f9b8006e9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b90005880 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 msgr2=0x7f9ba015b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e990 tx=0x7f9b8800ee50 comp rx=0 tx=0).stop 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 shutdown_connections 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b8006c4f0 0x7f9b8006e9b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ba015ceb0 0x7f9ba015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba015ca40 0x7f9ba015b880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 --2- 172.21.15.134:0/2927808300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba00d02a0 0x7f9ba014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 >> 172.21.15.134:0/2927808300 conn(0x7f9ba0062cc0 msgr2=0x7f9ba00b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 shutdown_connections 2024-09-15T22:43:14.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:14.676+0000 7f9ba5e53640 1 -- 172.21.15.134:0/2927808300 wait complete. 2024-09-15T22:43:14.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:14.818 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.335512589,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.136717705814974,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:14.818 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.136717705814974 }, "state": "open", "uptime": 17.335512589 } ] 2024-09-15T22:43:14.819 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:19.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:19.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.929+0000 7f3a9c50c640 1 Processor -- start 2024-09-15T22:43:19.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.930+0000 7f3a9c50c640 1 -- start start 2024-09-15T22:43:19.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.930+0000 7f3a9c50c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a940d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9c50c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a9415ed20 0x7f3a940d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9c50c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a940b7170 con 0x7f3a940cef90 2024-09-15T22:43:19.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9c50c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3a940d1ae0 con 0x7f3a9415ed20 2024-09-15T22:43:19.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9c50c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940b7aa0 con 0x7f3a9415e940 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9aaa9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3a940cef90 0x7f3a940b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:53284/0 (socket says 172.21.15.134:53284) 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a99aa7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a9415ed20 0x7f3a940d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9aaa9640 1 -- 172.21.15.134:0/4222557499 learned_addr learned my addr 172.21.15.134:0/4222557499 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a9a2a8640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a940d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a99aa7640 1 -- 172.21.15.134:0/4222557499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 msgr2=0x7f3a940d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a99aa7640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a940d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a99aa7640 1 -- 172.21.15.134:0/4222557499 >> v1:172.21.15.134:6789/0 conn(0x7f3a940cef90 legacy=0x7f3a940b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a992a6640 1 -- 172.21.15.134:0/4222557499 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739515724 0 0) 0x7f3a84001490 con 0x7f3a940cef90 2024-09-15T22:43:19.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.931+0000 7f3a99aa7640 1 -- 172.21.15.134:0/4222557499 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a940d3660 con 0x7f3a9415ed20 2024-09-15T22:43:19.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a99aa7640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a940d15a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097a0 tx=0x7f3a8802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b199dd4f164251 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:19.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a992a6640 1 -- 172.21.15.134:0/4222557499 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88037070 con 0x7f3a9415ed20 2024-09-15T22:43:19.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a992a6640 1 -- 172.21.15.134:0/4222557499 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88032440 con 0x7f3a9415ed20 2024-09-15T22:43:19.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a992a6640 1 -- 172.21.15.134:0/4222557499 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88032810 con 0x7f3a9415ed20 2024-09-15T22:43:19.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a9c50c640 1 -- 172.21.15.134:0/4222557499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 msgr2=0x7f3a940d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.932+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a940d15a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097a0 tx=0x7f3a8802a210 comp rx=0 tx=0).stop 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 -- 172.21.15.134:0/4222557499 shutdown_connections 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a940d15a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/4222557499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a940d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 -- 172.21.15.134:0/4222557499 >> 172.21.15.134:0/4222557499 conn(0x7f3a940b6240 msgr2=0x7f3a940b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 -- 172.21.15.134:0/4222557499 shutdown_connections 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.933+0000 7f3a9c50c640 1 -- 172.21.15.134:0/4222557499 wait complete. 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.934+0000 7f3a9c50c640 1 Processor -- start 2024-09-15T22:43:19.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.934+0000 7f3a9c50c640 1 -- start start 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 0x7f3a9414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a9415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940d3f00 con 0x7f3a9415ed20 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940d3c20 con 0x7f3a940cef90 2024-09-15T22:43:19.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940d3310 con 0x7f3a9415e940 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53784/0 (socket says 172.21.15.134:53784) 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 -- 172.21.15.134:0/3360296382 learned_addr learned my addr 172.21.15.134:0/3360296382 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9a2a8640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 0x7f3a9414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a99aa7640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a9415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 -- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 msgr2=0x7f3a9415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a9415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 -- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 msgr2=0x7f3a9414b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 0x7f3a9414b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 -- 172.21.15.134:0/3360296382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9414bcd0 con 0x7f3a9415ed20 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9a2a8640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 0x7f3a9414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9aaa9640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c700 tx=0x7f3a8400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:19.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84018070 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8400ce10 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a94158db0 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400a860 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.935+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a94158ad0 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.937+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a940d1f80 con 0x7f3a9415ed20 2024-09-15T22:43:19.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.937+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f3a8401b070 con 0x7f3a9415ed20 2024-09-15T22:43:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.937+0000 7f3a92ffd640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 0x7f3a8006e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.938+0000 7f3a9a2a8640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 0x7f3a8006e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.938+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f3a8408ad30 con 0x7f3a9415ed20 2024-09-15T22:43:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.938+0000 7f3a9a2a8640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 0x7f3a8006e9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c009b90 tx=0x7f3a8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:19.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:19.942+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a940b7170 con 0x7f3a9415ed20 2024-09-15T22:43:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.141+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a940ba6b0 con 0x7f3a9415ed20 2024-09-15T22:43:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.141+0000 7f3a92ffd640 1 -- 172.21.15.134:0/3360296382 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f3a84058af0 con 0x7f3a9415ed20 2024-09-15T22:43:20.143 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:20.144 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 msgr2=0x7f3a8006e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 0x7f3a8006e9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c009b90 tx=0x7f3a8c008040 comp rx=0 tx=0).stop 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 msgr2=0x7f3a9415a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c700 tx=0x7f3a8400cbc0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 shutdown_connections 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3a8006c520 0x7f3a8006e9e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a9415ed20 0x7f3a9415a2d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a9415e940 0x7f3a9415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 --2- 172.21.15.134:0/3360296382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a940cef90 0x7f3a9414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 >> 172.21.15.134:0/3360296382 conn(0x7f3a940b6240 msgr2=0x7f3a940b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 shutdown_connections 2024-09-15T22:43:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:20.143+0000 7f3a9c50c640 1 -- 172.21.15.134:0/3360296382 wait complete. 2024-09-15T22:43:20.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:20.286 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":22.804358494999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.871320394917007,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:20.286 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.871320394917007 }, "state": "open", "uptime": 22.804358495 } ] 2024-09-15T22:43:20.287 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:21.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:43:21.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:43:25.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:25.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.398+0000 7f3b93f86640 1 Processor -- start 2024-09-15T22:43:25.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.398+0000 7f3b93f86640 1 -- start start 2024-09-15T22:43:25.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b93f86640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b8c15ca40 0x7f3b8c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b93f86640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b8c15ceb0 0x7f3b8c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b93f86640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c15d390 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b93f86640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c15d670 con 0x7f3b8c15ca40 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b93f86640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c15d950 con 0x7f3b8c15ceb0 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b8c15ca40 0x7f3b8c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b8c15ca40 0x7f3b8c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53800/0 (socket says 172.21.15.134:53800) 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 -- 172.21.15.134:0/3519999233 learned_addr learned my addr 172.21.15.134:0/3519999233 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b92523640 1 --2- 172.21.15.134:0/3519999233 >> v2:172.21.15.177:3300/0 conn(0x7f3b8c15ceb0 0x7f3b8c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 -- 172.21.15.134:0/3519999233 >> v2:172.21.15.177:3300/0 conn(0x7f3b8c15ceb0 msgr2=0x7f3b8c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 --2- 172.21.15.134:0/3519999233 >> v2:172.21.15.177:3300/0 conn(0x7f3b8c15ceb0 0x7f3b8c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 -- 172.21.15.134:0/3519999233 >> v1:172.21.15.177:6789/0 conn(0x7f3b8c0d02a0 legacy=0x7f3b8c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.399+0000 7f3b91521640 1 -- 172.21.15.134:0/3519999233 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c15dc30 con 0x7f3b8c15ca40 2024-09-15T22:43:25.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.400+0000 7f3b91521640 1 --2- 172.21.15.134:0/3519999233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c15e430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0b4be0 tx=0x7f3b7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dbb012489ac348 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.400+0000 7f3b90d20640 1 -- 172.21.15.134:0/3519999233 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c037070 con 0x7f3b8c15ca40 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.400+0000 7f3b90d20640 1 -- 172.21.15.134:0/3519999233 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c032440 con 0x7f3b8c15ca40 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.400+0000 7f3b90d20640 1 -- 172.21.15.134:0/3519999233 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c032810 con 0x7f3b8c15ca40 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 -- 172.21.15.134:0/3519999233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c15ca40 msgr2=0x7f3b8c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 --2- 172.21.15.134:0/3519999233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c15e430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0b4be0 tx=0x7f3b7c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 -- 172.21.15.134:0/3519999233 shutdown_connections 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 --2- 172.21.15.134:0/3519999233 >> v2:172.21.15.177:3300/0 conn(0x7f3b8c15ceb0 0x7f3b8c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 --2- 172.21.15.134:0/3519999233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c15e430 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 -- 172.21.15.134:0/3519999233 >> 172.21.15.134:0/3519999233 conn(0x7f3b8c062cc0 msgr2=0x7f3b8c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 -- 172.21.15.134:0/3519999233 shutdown_connections 2024-09-15T22:43:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.401+0000 7f3b93f86640 1 -- 172.21.15.134:0/3519999233 wait complete. 2024-09-15T22:43:25.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.402+0000 7f3b93f86640 1 Processor -- start 2024-09-15T22:43:25.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.402+0000 7f3b93f86640 1 -- start start 2024-09-15T22:43:25.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 0x7f3b8c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c155d10 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c155b90 con 0x7f3b8c15ca40 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b93f86640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0b4790 con 0x7f3b8c15ceb0 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53802/0 (socket says 172.21.15.134:53802) 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 -- 172.21.15.134:0/2765953753 learned_addr learned my addr 172.21.15.134:0/2765953753 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91521640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b92523640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 0x7f3b8c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 -- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 msgr2=0x7f3b8c15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 0x7f3b8c15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 -- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b8c15ca40 msgr2=0x7f3b8c1470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c1470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 -- 172.21.15.134:0/2765953753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0724a0 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b92523640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 0x7f3b8c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b91d22640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c460 tx=0x7f3b8800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.403+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88011790 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.404+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b88017070 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.404+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c072760 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.404+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88011bb0 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.404+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c072d20 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.405+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c0d0680 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.405+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f3b8801c460 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.406+0000 7f3b827fc640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 0x7f3b7006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.406+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f3b8808b600 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.406+0000 7f3b91521640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 0x7f3b7006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.406+0000 7f3b91521640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 0x7f3b7006e9b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c034000 tx=0x7f3b7c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.410+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b88059a50 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.610+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b8c0ceac0 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.610+0000 7f3b827fc640 1 -- 172.21.15.134:0/2765953753 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f3b88059350 con 0x7f3b8c0d02a0 2024-09-15T22:43:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:25.612 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:25.612 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:25.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 msgr2=0x7f3b7006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 0x7f3b7006e9b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c034000 tx=0x7f3b7c02e000 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 msgr2=0x7f3b8c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c460 tx=0x7f3b8800c920 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 shutdown_connections 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f3b7006c4f0 0x7f3b7006e9b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b8c15ceb0 0x7f3b8c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b8c15ca40 0x7f3b8c1470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 --2- 172.21.15.134:0/2765953753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b8c0d02a0 0x7f3b8c071980 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 >> 172.21.15.134:0/2765953753 conn(0x7f3b8c062cc0 msgr2=0x7f3b8c1549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 shutdown_connections 2024-09-15T22:43:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:25.612+0000 7f3b93f86640 1 -- 172.21.15.134:0/2765953753 wait complete. 2024-09-15T22:43:25.625 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":28.273204400000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.60925547150789,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:25.755 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.60925547150789 }, "state": "open", "uptime": 28.2732044 } ] 2024-09-15T22:43:25.755 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:30.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:30.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.867+0000 7f0482378640 1 Processor -- start 2024-09-15T22:43:30.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.867+0000 7f0482378640 1 -- start start 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0482378640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c0d02a0 0x7f047c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0482378640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f047c15ce80 0x7f047c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0482378640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047c0d0bc0 con 0x7f047c15ca40 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0482378640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f047c15d390 con 0x7f047c15ce80 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0482378640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f047c15d670 con 0x7f047c0d02a0 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0480915640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f047c15ce80 0x7f047c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0480915640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f047c15ce80 0x7f047c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57058/0 (socket says 172.21.15.134:57058) 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f0480915640 1 -- 172.21.15.134:0/2086098188 learned_addr learned my addr 172.21.15.134:0/2086098188 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.868+0000 7f047b7fe640 1 --1- 172.21.15.134:0/2086098188 >> v1:172.21.15.134:6789/0 conn(0x7f047c15ca40 0x7f047c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47428/0 (socket says 172.21.15.134:47428) 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f0480915640 1 -- 172.21.15.134:0/2086098188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c0d02a0 msgr2=0x7f047c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:30.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f047bfff640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c0d02a0 0x7f047c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f0480915640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c0d02a0 0x7f047c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f0480915640 1 -- 172.21.15.134:0/2086098188 >> v1:172.21.15.134:6789/0 conn(0x7f047c15ca40 legacy=0x7f047c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f047affd640 1 -- 172.21.15.134:0/2086098188 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306309957 0 0) 0x7f047c0d0bc0 con 0x7f047c15ca40 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f0480915640 1 -- 172.21.15.134:0/2086098188 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c15d950 con 0x7f047c15ce80 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.869+0000 7f0480915640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1594c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0474009e50 tx=0x7f047402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2193d9745d03dd45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f047affd640 1 -- 172.21.15.134:0/2086098188 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474039070 con 0x7f047c15ce80 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f047affd640 1 -- 172.21.15.134:0/2086098188 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474034680 con 0x7f047c15ce80 2024-09-15T22:43:30.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f047affd640 1 -- 172.21.15.134:0/2086098188 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474034a50 con 0x7f047c15ce80 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 -- 172.21.15.134:0/2086098188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 msgr2=0x7f047c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1594c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0474009e50 tx=0x7f047402c890 comp rx=0 tx=0).stop 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 -- 172.21.15.134:0/2086098188 shutdown_connections 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1594c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 --2- 172.21.15.134:0/2086098188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c0d02a0 0x7f047c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 -- 172.21.15.134:0/2086098188 >> 172.21.15.134:0/2086098188 conn(0x7f047c062cc0 msgr2=0x7f047c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 -- 172.21.15.134:0/2086098188 shutdown_connections 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.870+0000 7f0482378640 1 -- 172.21.15.134:0/2086098188 wait complete. 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.871+0000 7f0482378640 1 Processor -- start 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 -- start start 2024-09-15T22:43:30.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047c0d02a0 0x7f047c0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c15ca40 0x7f047c145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f047c15eb40 con 0x7f047c15ce80 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f047c15df10 con 0x7f047c0d02a0 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0482378640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f047c155b90 con 0x7f047c15ca40 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.872+0000 7f0480915640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57068/0 (socket says 172.21.15.134:57068) 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 -- 172.21.15.134:0/1129055746 learned_addr learned my addr 172.21.15.134:0/1129055746 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f047b7fe640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c15ca40 0x7f047c145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f047bfff640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047c0d02a0 0x7f047c0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 -- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c15ca40 msgr2=0x7f047c145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c15ca40 0x7f047c145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 -- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047c0d02a0 msgr2=0x7f047c0731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047c0d02a0 0x7f047c0731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 -- 172.21.15.134:0/1129055746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c073710 con 0x7f047c15ce80 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0480915640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0474037040 tx=0x7f0474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474039040 con 0x7f047c15ce80 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474042070 con 0x7f047c15ce80 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c072130 con 0x7f047c15ce80 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047403d420 con 0x7f047c15ce80 2024-09-15T22:43:30.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.873+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c0726f0 con 0x7f047c15ce80 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.874+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c0b4790 con 0x7f047c15ce80 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.875+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f0474034540 con 0x7f047c15ce80 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.875+0000 7f0478ff9640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 0x7f046806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.875+0000 7f047bfff640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 0x7f046806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.875+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f04740ab5f0 con 0x7f047c15ce80 2024-09-15T22:43:30.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.876+0000 7f047bfff640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 0x7f046806e9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f046c006fd0 tx=0x7f046c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:30.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:30.880+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f047404b020 con 0x7f047c15ce80 2024-09-15T22:43:31.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.083+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f047c0b54a0 con 0x7f047c15ce80 2024-09-15T22:43:31.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.083+0000 7f0478ff9640 1 -- 172.21.15.134:0/1129055746 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f04740798f0 con 0x7f047c15ce80 2024-09-15T22:43:31.085 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:31.085 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:31.085 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 msgr2=0x7f046806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 0x7f046806e9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f046c006fd0 tx=0x7f046c008040 comp rx=0 tx=0).stop 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 msgr2=0x7f047c1587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0474037040 tx=0x7f0474004a40 comp rx=0 tx=0).stop 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 shutdown_connections 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f046806c520 0x7f046806e9e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f047c15ce80 0x7f047c1587f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:31.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f047c15ca40 0x7f047c145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:31.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.085+0000 7f0482378640 1 --2- 172.21.15.134:0/1129055746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047c0d02a0 0x7f047c0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:31.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.086+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 >> 172.21.15.134:0/1129055746 conn(0x7f047c062cc0 msgr2=0x7f047c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:31.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.086+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 shutdown_connections 2024-09-15T22:43:31.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:31.086+0000 7f0482378640 1 -- 172.21.15.134:0/1129055746 wait complete. 2024-09-15T22:43:31.098 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:31.224 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":33.742050302999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.350481093437768,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:31.225 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.350481093437768 }, "state": "open", "uptime": 33.742050303 } ] 2024-09-15T22:43:31.225 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:36.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:36.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.335+0000 7f23a5afa640 1 Processor -- start 2024-09-15T22:43:36.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.335+0000 7f23a5afa640 1 -- start start 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f23a5afa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23a00d02a0 0x7f23a00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f23a5afa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f23a01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f23a5afa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a00d0bc0 con 0x7f23a015ca40 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f23a5afa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f23a015d390 con 0x7f23a00d02a0 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f23a5afa640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f23a015d670 con 0x7f23a015ceb0 2024-09-15T22:43:36.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f23a015ca40 0x7f23a015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51922/0 (socket says 172.21.15.134:51922) 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239effd640 1 -- 172.21.15.134:0/3622918051 learned_addr learned my addr 172.21.15.134:0/3622918051 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239f7fe640 1 --2- 172.21.15.134:0/3622918051 >> v2:172.21.15.177:3300/0 conn(0x7f23a00d02a0 0x7f23a00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f23a01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183454047 0 0) 0x7f23a00d0bc0 con 0x7f23a015ca40 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2388003520 con 0x7f23a015ca40 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3652898571 0 0) 0x7f2388003520 con 0x7f23a015ca40 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 msgr2=0x7f23a01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f23a01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 >> v2:172.21.15.177:3300/0 conn(0x7f23a00d02a0 msgr2=0x7f23a00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 --2- 172.21.15.134:0/3622918051 >> v2:172.21.15.177:3300/0 conn(0x7f23a00d02a0 0x7f23a00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a015d950 con 0x7f23a015ca40 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f2394001670 con 0x7f23a015ca40 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f23a01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:36.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239f7fe640 1 --2- 172.21.15.134:0/3622918051 >> v2:172.21.15.177:3300/0 conn(0x7f23a00d02a0 0x7f23a00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 >> v1:172.21.15.134:6789/0 conn(0x7f23a015ca40 legacy=0x7f23a015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23880039b0 0x7f2388003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f2388004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2388004d40 0x7f23880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23a015d390 con 0x7f2388004d40 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23a015d670 con 0x7f23880039b0 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.336+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f238800b9c0 con 0x7f23a015ceb0 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2388004d40 0x7f23880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239f7fe640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23880039b0 0x7f2388003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239effd640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f2388004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 -- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 msgr2=0x7f2388004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ceb0 0x7f2388004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 -- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23880039b0 msgr2=0x7f2388003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23880039b0 0x7f2388003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.337+0000 7f239ffff640 1 -- 172.21.15.134:0/3622918051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2388003520 con 0x7f2388004d40 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f239ffff640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2388004d40 0x7f23880051c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23a00b4c00 tx=0x7f2388005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29405843d9ed81c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398033070 con 0x7f2388004d40 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2398003990 con 0x7f2388004d40 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f239e7fc640 1 -- 172.21.15.134:0/3622918051 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398009de0 con 0x7f2388004d40 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 -- 172.21.15.134:0/3622918051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2388004d40 msgr2=0x7f23880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 --2- 172.21.15.134:0/3622918051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2388004d40 0x7f23880051c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23a00b4c00 tx=0x7f2388005830 comp rx=0 tx=0).stop 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f239ffff640 1 -- 172.21.15.134:0/3622918051 reap_dead start 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 -- 172.21.15.134:0/3622918051 shutdown_connections 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 -- 172.21.15.134:0/3622918051 >> 172.21.15.134:0/3622918051 conn(0x7f23a0062cc0 msgr2=0x7f23a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 -- 172.21.15.134:0/3622918051 shutdown_connections 2024-09-15T22:43:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.338+0000 7f23a5afa640 1 -- 172.21.15.134:0/3622918051 wait complete. 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.339+0000 7f23a5afa640 1 Processor -- start 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 -- start start 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a0150af0 0x7f23a01f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ad30 0x7f23a015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23a015eb40 con 0x7f23a0151160 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23a015df10 con 0x7f23a0150af0 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f23a5afa640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f23a0155b90 con 0x7f23a015ad30 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.340+0000 7f239effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37704/0 (socket says 172.21.15.134:37704) 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 -- 172.21.15.134:0/359089868 learned_addr learned my addr 172.21.15.134:0/359089868 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239f7fe640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a0150af0 0x7f23a01f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239ffff640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ad30 0x7f23a015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 -- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ad30 msgr2=0x7f23a015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ad30 0x7f23a015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 -- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a0150af0 msgr2=0x7f23a01f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a0150af0 0x7f23a01f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 -- 172.21.15.134:0/359089868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a015b6f0 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f239effd640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2394007320 tx=0x7f23940077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401a070 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239400f9a0 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239400fd70 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a00af990 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.341+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a00715e0 con 0x7f23a0151160 2024-09-15T22:43:36.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.342+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a00b4790 con 0x7f23a0151160 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.343+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f239401d070 con 0x7f23a0151160 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.343+0000 7f2387fff640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 0x7f238c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.343+0000 7f239f7fe640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 0x7f238c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.343+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f239408b220 con 0x7f23a0151160 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.344+0000 7f239f7fe640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 0x7f238c06e9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23a00aefe0 tx=0x7f2390009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:36.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.348+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23a015b6f0 con 0x7f23a0151160 2024-09-15T22:43:36.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.546+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23a0074260 con 0x7f23a0151160 2024-09-15T22:43:36.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.547+0000 7f2387fff640 1 -- 172.21.15.134:0/359089868 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f2394058f50 con 0x7f23a0151160 2024-09-15T22:43:36.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:36.549 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:36.549 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:36.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 msgr2=0x7f238c06e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 0x7f238c06e9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23a00aefe0 tx=0x7f2390009190 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 msgr2=0x7f23a00af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2394007320 tx=0x7f23940077e0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 shutdown_connections 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f238c06c520 0x7f238c06e9e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a015ad30 0x7f23a015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a0151160 0x7f23a00af220 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 --2- 172.21.15.134:0/359089868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a0150af0 0x7f23a01f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 >> 172.21.15.134:0/359089868 conn(0x7f23a0062cc0 msgr2=0x7f23a0154360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 shutdown_connections 2024-09-15T22:43:36.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:36.549+0000 7f23a5afa640 1 -- 172.21.15.134:0/359089868 wait complete. 2024-09-15T22:43:36.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:36.690 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":39.208896260000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.095048799916114,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:36.690 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.095048799916114 }, "state": "open", "uptime": 39.20889626 } ] 2024-09-15T22:43:36.691 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:41.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:41.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.801+0000 7f12fecf8640 1 Processor -- start 2024-09-15T22:43:41.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.801+0000 7f12fecf8640 1 -- start start 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f12f80ce230 0x7f12f80cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12f80cf5b0 0x7f12f8073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f12f80ce740 con 0x7f12f80cf5b0 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f12f8072640 con 0x7f12f80ce230 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fecf8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f12f8072920 con 0x7f12f815c180 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fd295640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12f80cf5b0 0x7f12f8073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fd295640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12f80cf5b0 0x7f12f8073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37720/0 (socket says 172.21.15.134:37720) 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.802+0000 7f12fd295640 1 -- 172.21.15.134:0/2694658215 learned_addr learned my addr 172.21.15.134:0/2694658215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fca94640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12f7fff640 1 --2- 172.21.15.134:0/2694658215 >> v2:172.21.15.177:3300/0 conn(0x7f12f80ce230 0x7f12f80cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 -- 172.21.15.134:0/2694658215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 msgr2=0x7f12f80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 -- 172.21.15.134:0/2694658215 >> v2:172.21.15.177:3300/0 conn(0x7f12f80ce230 msgr2=0x7f12f80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 --2- 172.21.15.134:0/2694658215 >> v2:172.21.15.177:3300/0 conn(0x7f12f80ce230 0x7f12f80cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 -- 172.21.15.134:0/2694658215 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f8072c00 con 0x7f12f80cf5b0 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.803+0000 7f12fd295640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8073120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f12f80b5940 tx=0x7f12f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702d40959522e706 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12f77fe640 1 -- 172.21.15.134:0/2694658215 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0036070 con 0x7f12f80cf5b0 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12f77fe640 1 -- 172.21.15.134:0/2694658215 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0031600 con 0x7f12f80cf5b0 2024-09-15T22:43:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12f77fe640 1 -- 172.21.15.134:0/2694658215 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00319d0 con 0x7f12f80cf5b0 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 -- 172.21.15.134:0/2694658215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 msgr2=0x7f12f8073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8073120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f12f80b5940 tx=0x7f12f002a610 comp rx=0 tx=0).stop 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 -- 172.21.15.134:0/2694658215 shutdown_connections 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8073120 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 --2- 172.21.15.134:0/2694658215 >> v2:172.21.15.177:3300/0 conn(0x7f12f80ce230 0x7f12f80cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 --2- 172.21.15.134:0/2694658215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 -- 172.21.15.134:0/2694658215 >> 172.21.15.134:0/2694658215 conn(0x7f12f8062cc0 msgr2=0x7f12f806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 -- 172.21.15.134:0/2694658215 shutdown_connections 2024-09-15T22:43:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.804+0000 7f12fecf8640 1 -- 172.21.15.134:0/2694658215 wait complete. 2024-09-15T22:43:41.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.805+0000 7f12fecf8640 1 Processor -- start 2024-09-15T22:43:41.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 -- start start 2024-09-15T22:43:41.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 0x7f12f815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f8148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12f815c560 con 0x7f12f80cf5b0 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80722f0 con 0x7f12f80ce230 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.806+0000 7f12fecf8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f12f815c6e0 con 0x7f12f815c180 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37732/0 (socket says 172.21.15.134:37732) 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 -- 172.21.15.134:0/990700485 learned_addr learned my addr 172.21.15.134:0/990700485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12fca94640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 0x7f12f815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12fd295640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f8148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 -- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 msgr2=0x7f12f8148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f8148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 -- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 msgr2=0x7f12f815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 0x7f12f815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 -- 172.21.15.134:0/990700485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f815df00 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12fca94640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 0x7f12f815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f7fff640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f12e400d5d0 tx=0x7f12e400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4004240 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e40043e0 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f815e1e0 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4003830 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.807+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f80b3a00 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.808+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f80cf070 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.809+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7f12e40039d0 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.809+0000 7f12f57fa640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 0x7f12dc06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.809+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f12e408bb50 con 0x7f12f80cf5b0 2024-09-15T22:43:41.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.809+0000 7f12fca94640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 0x7f12dc06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.810+0000 7f12fca94640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 0x7f12dc06e9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006fd0 tx=0x7f12ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:41.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:41.814+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12e4059e40 con 0x7f12f80cf5b0 2024-09-15T22:43:42.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.014+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12f80b0c90 con 0x7f12f80cf5b0 2024-09-15T22:43:42.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.014+0000 7f12f57fa640 1 -- 172.21.15.134:0/990700485 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f12e4059740 con 0x7f12f80cf5b0 2024-09-15T22:43:42.016 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:42.016 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:42.016 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 msgr2=0x7f12dc06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 0x7f12dc06e9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006fd0 tx=0x7f12ec008040 comp rx=0 tx=0).stop 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 msgr2=0x7f12f8157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f12e400d5d0 tx=0x7f12e400da90 comp rx=0 tx=0).stop 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 shutdown_connections 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f12dc06c4f0 0x7f12dc06e9b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12f815c180 0x7f12f8148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f80cf5b0 0x7f12f8157110 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 --2- 172.21.15.134:0/990700485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12f80ce230 0x7f12f815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 >> 172.21.15.134:0/990700485 conn(0x7f12f8062cc0 msgr2=0x7f12f80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:42.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.016+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 shutdown_connections 2024-09-15T22:43:42.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:42.017+0000 7f12fecf8640 1 -- 172.21.15.134:0/990700485 wait complete. 2024-09-15T22:43:42.029 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:42.157 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":44.674742248000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.842868450656287,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:42.157 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.842868450656287 }, "state": "open", "uptime": 44.674742248 } ] 2024-09-15T22:43:42.157 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:47.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.269+0000 7fecd7d18640 1 Processor -- start 2024-09-15T22:43:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.269+0000 7fecd7d18640 1 -- start start 2024-09-15T22:43:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd7d18640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd7d18640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd7d18640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd00ce740 con 0x7fecd015c180 2024-09-15T22:43:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd7d18640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fecd0072640 con 0x7fecd0073120 2024-09-15T22:43:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd7d18640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fecd0072920 con 0x7fecd00cf070 2024-09-15T22:43:47.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd62b5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd62b5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53372/0 (socket says 172.21.15.134:53372) 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd5ab4640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fecd015c180 0x7fecd00cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:43532/0 (socket says 172.21.15.134:43532) 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:59158/0 (socket says 172.21.15.134:59158) 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd62b5640 1 -- 172.21.15.134:0/1353409943 learned_addr learned my addr 172.21.15.134:0/1353409943 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 -- 172.21.15.134:0/1353409943 >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 msgr2=0x7fecd0073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 --2- 172.21.15.134:0/1353409943 >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 -- 172.21.15.134:0/1353409943 >> v1:172.21.15.177:6789/0 conn(0x7fecd015c180 legacy=0x7fecd00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd52b3640 1 -- 172.21.15.134:0/1353409943 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd0072c00 con 0x7fecd00cf070 2024-09-15T22:43:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.270+0000 7fecd62b5640 1 --2- 172.21.15.134:0/1353409943 >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.271+0000 7fecd52b3640 1 --2- 172.21.15.134:0/1353409943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097a0 tx=0x7fecc402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf7e64bba84e91e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.271+0000 7fecd4ab2640 1 -- 172.21.15.134:0/1353409943 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4037070 con 0x7fecd00cf070 2024-09-15T22:43:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.271+0000 7fecd4ab2640 1 -- 172.21.15.134:0/1353409943 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc402ae50 con 0x7fecd00cf070 2024-09-15T22:43:47.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.271+0000 7fecd4ab2640 1 -- 172.21.15.134:0/1353409943 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4032660 con 0x7fecd00cf070 2024-09-15T22:43:47.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 -- 172.21.15.134:0/1353409943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 msgr2=0x7fecd00cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 --2- 172.21.15.134:0/1353409943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097a0 tx=0x7fecc402a100 comp rx=0 tx=0).stop 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 -- 172.21.15.134:0/1353409943 shutdown_connections 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 --2- 172.21.15.134:0/1353409943 >> v2:172.21.15.177:3300/0 conn(0x7fecd0073120 0x7fecd0073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 --2- 172.21.15.134:0/1353409943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd00cf070 0x7fecd00cf4b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 -- 172.21.15.134:0/1353409943 >> 172.21.15.134:0/1353409943 conn(0x7fecd0062cc0 msgr2=0x7fecd006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 -- 172.21.15.134:0/1353409943 shutdown_connections 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.272+0000 7fecd7d18640 1 -- 172.21.15.134:0/1353409943 wait complete. 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.273+0000 7fecd7d18640 1 Processor -- start 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.273+0000 7fecd7d18640 1 -- start start 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd0073120 0x7fecd0159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecd015c180 0x7fecd0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00722f0 con 0x7fecd00cf070 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00ced00 con 0x7fecd015c180 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd7d18640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fecd015c560 con 0x7fecd0073120 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd52b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd52b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52512/0 (socket says 172.21.15.134:52512) 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd52b3640 1 -- 172.21.15.134:0/4049089393 learned_addr learned my addr 172.21.15.134:0/4049089393 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd5ab4640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd0073120 0x7fecd0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.274+0000 7fecd62b5640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecd015c180 0x7fecd0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 -- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd0073120 msgr2=0x7fecd0159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd0073120 0x7fecd0159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 -- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecd015c180 msgr2=0x7fecd0150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecd015c180 0x7fecd0150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 -- 172.21.15.134:0/4049089393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd015e460 con 0x7fecd00cf070 2024-09-15T22:43:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd52b3640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fecc4035040 tx=0x7fecc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4041070 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc403c460 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd015e740 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4037040 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.275+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd00b39f0 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.276+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd00b3bf0 con 0x7fecd00cf070 2024-09-15T22:43:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.277+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7fecc403a070 con 0x7fecd00cf070 2024-09-15T22:43:47.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.277+0000 7fecce7fc640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 0x7fecbc06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.277+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fecc40abb80 con 0x7fecd00cf070 2024-09-15T22:43:47.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.277+0000 7fecd5ab4640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 0x7fecbc06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.278+0000 7fecd5ab4640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 0x7fecbc06e9b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecc8000f60 tx=0x7fecc8007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.282+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecd00b3bf0 con 0x7fecd00cf070 2024-09-15T22:43:47.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.481+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecd00cf4b0 con 0x7fecd00cf070 2024-09-15T22:43:47.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.481+0000 7fecce7fc640 1 -- 172.21.15.134:0/4049089393 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fecc4079f00 con 0x7fecd00cf070 2024-09-15T22:43:47.483 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:47.483 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:47.483 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 msgr2=0x7fecbc06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 0x7fecbc06e9b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecc8000f60 tx=0x7fecc8007c40 comp rx=0 tx=0).stop 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 msgr2=0x7fecd015dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fecc4035040 tx=0x7fecc40046c0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 shutdown_connections 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fecbc06c4f0 0x7fecbc06e9b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecd015c180 0x7fecd0150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecd00cf070 0x7fecd015dc10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 --2- 172.21.15.134:0/4049089393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecd0073120 0x7fecd0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.483+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 >> 172.21.15.134:0/4049089393 conn(0x7fecd0062cc0 msgr2=0x7fecd00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:47.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.484+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 shutdown_connections 2024-09-15T22:43:47.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:47.484+0000 7fecd7d18640 1 -- 172.21.15.134:0/4049089393 wait complete. 2024-09-15T22:43:47.496 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:47.625 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":50.143588152,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.593716997782231,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:47.626 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.59371699778223 }, "state": "open", "uptime": 50.143588152 } ] 2024-09-15T22:43:47.626 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:51.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:43:51.319 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:43:52.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:52.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.737+0000 7ff7af731640 1 Processor -- start 2024-09-15T22:43:52.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.737+0000 7ff7af731640 1 -- start start 2024-09-15T22:43:52.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7af731640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7a80d02a0 0x7ff7a80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7af731640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7a815ceb0 0x7ff7a81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7af731640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a80d0bc0 con 0x7ff7a815ca40 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7af731640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a815d390 con 0x7ff7a815ceb0 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7af731640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a815d670 con 0x7ff7a80d02a0 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7a815ceb0 0x7ff7a81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7acccc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff7a815ca40 0x7ff7a815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42906/0 (socket says 172.21.15.134:42906) 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7a815ceb0 0x7ff7a81594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52524/0 (socket says 172.21.15.134:52524) 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7acccc640 1 -- 172.21.15.134:0/3498176803 learned_addr learned my addr 172.21.15.134:0/3498176803 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7ad4cd640 1 --2- 172.21.15.134:0/3498176803 >> v2:172.21.15.177:3300/0 conn(0x7ff7a80d02a0 0x7ff7a80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 -- 172.21.15.134:0/3498176803 >> v2:172.21.15.177:3300/0 conn(0x7ff7a80d02a0 msgr2=0x7ff7a80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 --2- 172.21.15.134:0/3498176803 >> v2:172.21.15.177:3300/0 conn(0x7ff7a80d02a0 0x7ff7a80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 -- 172.21.15.134:0/3498176803 >> v1:172.21.15.134:6789/0 conn(0x7ff7a815ca40 legacy=0x7ff7a815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.738+0000 7ff7adcce640 1 -- 172.21.15.134:0/3498176803 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a815d950 con 0x7ff7a815ceb0 2024-09-15T22:43:52.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.739+0000 7ff7adcce640 1 --2- 172.21.15.134:0/3498176803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ceb0 0x7ff7a81594c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff7a806f030 tx=0x7ff7a002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb929758dbec3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.739+0000 7ff79ffff640 1 -- 172.21.15.134:0/3498176803 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0007740 con 0x7ff7a815ceb0 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.739+0000 7ff79ffff640 1 -- 172.21.15.134:0/3498176803 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00078e0 con 0x7ff7a815ceb0 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.739+0000 7ff79ffff640 1 -- 172.21.15.134:0/3498176803 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0007cb0 con 0x7ff7a815ceb0 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 -- 172.21.15.134:0/3498176803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ceb0 msgr2=0x7ff7a81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 --2- 172.21.15.134:0/3498176803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ceb0 0x7ff7a81594c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff7a806f030 tx=0x7ff7a002c800 comp rx=0 tx=0).stop 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 -- 172.21.15.134:0/3498176803 shutdown_connections 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 --2- 172.21.15.134:0/3498176803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ceb0 0x7ff7a81594c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 --2- 172.21.15.134:0/3498176803 >> v2:172.21.15.177:3300/0 conn(0x7ff7a80d02a0 0x7ff7a80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 -- 172.21.15.134:0/3498176803 >> 172.21.15.134:0/3498176803 conn(0x7ff7a8062cc0 msgr2=0x7ff7a806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 -- 172.21.15.134:0/3498176803 shutdown_connections 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.740+0000 7ff7af731640 1 -- 172.21.15.134:0/3498176803 wait complete. 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.741+0000 7ff7af731640 1 Processor -- start 2024-09-15T22:43:52.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.741+0000 7ff7af731640 1 -- start start 2024-09-15T22:43:52.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a80d02a0 0x7ff7a8146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a815ceb0 0x7ff7a80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a815eb40 con 0x7ff7a815ca40 2024-09-15T22:43:52.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a815df10 con 0x7ff7a815ceb0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7af731640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a8155b90 con 0x7ff7a80d02a0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52536/0 (socket says 172.21.15.134:52536) 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 -- 172.21.15.134:0/1605312259 learned_addr learned my addr 172.21.15.134:0/1605312259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7ad4cd640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a80d02a0 0x7ff7a8146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7adcce640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a815ceb0 0x7ff7a80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 -- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a80d02a0 msgr2=0x7ff7a8146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a80d02a0 0x7ff7a8146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 -- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a815ceb0 msgr2=0x7ff7a80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a815ceb0 0x7ff7a80ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.742+0000 7ff7acccc640 1 -- 172.21.15.134:0/1605312259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a80b2420 con 0x7ff7a815ca40 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff7acccc640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c400 tx=0x7ff79800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:52.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798017070 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798005ce0 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a80b0c30 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980072f0 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.743+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a80b1400 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.744+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a80b4790 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.744+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7ff79801a070 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.745+0000 7ff79dffb640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 0x7ff78c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.745+0000 7ff7ad4cd640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 0x7ff78c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.745+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7ff79808ac70 con 0x7ff7a815ca40 2024-09-15T22:43:52.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.746+0000 7ff7ad4cd640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 0x7ff78c06e9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4006fd0 tx=0x7ff7a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:52.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.750+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff798059080 con 0x7ff7a815ca40 2024-09-15T22:43:52.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.947+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7a8150610 con 0x7ff7a815ca40 2024-09-15T22:43:52.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.947+0000 7ff79dffb640 1 -- 172.21.15.134:0/1605312259 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7ff798058980 con 0x7ff7a815ca40 2024-09-15T22:43:52.950 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:52.950 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:52.950 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:52.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 msgr2=0x7ff78c06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 0x7ff78c06e9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4006fd0 tx=0x7ff7a4008040 comp rx=0 tx=0).stop 2024-09-15T22:43:52.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 msgr2=0x7ff7a80b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c400 tx=0x7ff79800c8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 shutdown_connections 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff78c06c4f0 0x7ff78c06e9b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a815ceb0 0x7ff7a80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a815ca40 0x7ff7a80b1ee0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 --2- 172.21.15.134:0/1605312259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a80d02a0 0x7ff7a8146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 >> 172.21.15.134:0/1605312259 conn(0x7ff7a8062cc0 msgr2=0x7ff7a80cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 shutdown_connections 2024-09-15T22:43:52.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:52.950+0000 7ff7af731640 1 -- 172.21.15.134:0/1605312259 wait complete. 2024-09-15T22:43:52.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:53.093 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":55.611434082999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.34773864726494,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:53.094 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.34773864726494 }, "state": "open", "uptime": 55.611434083 } ] 2024-09-15T22:43:53.094 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:43:58.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:43:58.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.206+0000 7fe8a1f6f640 1 Processor -- start 2024-09-15T22:43:58.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.206+0000 7fe8a1f6f640 1 -- start start 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe8a1f6f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe89c15ca40 0x7fe89c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe8a1f6f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c15d390 con 0x7fe89c15ceb0 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe8a1f6f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c15d670 con 0x7fe89c0d02a0 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe8a1f6f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe89c15d950 con 0x7fe89c15ca40 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe89bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe89c15ceb0 0x7fe89c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36698/0 (socket says 172.21.15.134:36698) 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe89bfff640 1 -- 172.21.15.134:0/2007522871 learned_addr learned my addr 172.21.15.134:0/2007522871 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe89affd640 1 --2- 172.21.15.134:0/2007522871 >> v2:172.21.15.177:3300/0 conn(0x7fe89c15ca40 0x7fe89c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738971901 0 0) 0x7fe89c15d390 con 0x7fe89c15ceb0 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.207+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe884003520 con 0x7fe89c15ceb0 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3044501643 0 0) 0x7fe884003520 con 0x7fe89c15ceb0 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 >> v2:172.21.15.177:3300/0 conn(0x7fe89c15ca40 msgr2=0x7fe89c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 --2- 172.21.15.134:0/2007522871 >> v2:172.21.15.177:3300/0 conn(0x7fe89c15ca40 0x7fe89c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 >> v1:172.21.15.177:6789/0 conn(0x7fe89c0d02a0 legacy=0x7fe89c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c15dc30 con 0x7fe89c15ceb0 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fe8940019f0 con 0x7fe89c15ceb0 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 >> v1:172.21.15.134:6789/0 conn(0x7fe89c15ceb0 legacy=0x7fe89c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 0x7fe884003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe884005210 0x7fe88400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c15d950 con 0x7fe884003a00 2024-09-15T22:43:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe88400c160 con 0x7fe884005210 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe88400c360 con 0x7fe884004800 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 0x7fe884003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89bfff640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe884005210 0x7fe88400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89affd640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 -- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884004800 msgr2=0x7fe884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 -- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe884005210 msgr2=0x7fe88400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe884005210 0x7fe88400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89b7fe640 1 -- 172.21.15.134:0/2007522871 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe884003520 con 0x7fe884003a00 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89bfff640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe884005210 0x7fe88400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.208+0000 7fe89bfff640 1 -- 172.21.15.134:0/2007522871 reap_dead start 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 0x7fe884003e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe88c001720 tx=0x7fe884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadb0c08bab7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c001370 con 0x7fe884003a00 2024-09-15T22:43:58.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88c0052d0 con 0x7fe884003a00 2024-09-15T22:43:58.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe89a7fc640 1 -- 172.21.15.134:0/2007522871 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c02ab70 con 0x7fe884003a00 2024-09-15T22:43:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 msgr2=0x7fe884003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 0x7fe884003e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe88c001720 tx=0x7fe884005830 comp rx=0 tx=0).stop 2024-09-15T22:43:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2007522871 shutdown_connections 2024-09-15T22:43:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2007522871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe884003a00 0x7fe884003e20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2007522871 >> 172.21.15.134:0/2007522871 conn(0x7fe89c062cc0 msgr2=0x7fe89c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2007522871 shutdown_connections 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.209+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2007522871 wait complete. 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.211+0000 7fe8a1f6f640 1 Processor -- start 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.211+0000 7fe8a1f6f640 1 -- start start 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.211+0000 7fe8a1f6f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884003a00 0x7fe89c14d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.211+0000 7fe8a1f6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.211+0000 7fe8a1f6f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c158ac0 0x7fe89c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe8a1f6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c155d10 con 0x7fe89c072690 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe8a1f6f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c155b90 con 0x7fe89c158ac0 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe8a1f6f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe89c0b4790 con 0x7fe884003a00 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49108/0 (socket says 172.21.15.134:49108) 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 -- 172.21.15.134:0/2624700040 learned_addr learned my addr 172.21.15.134:0/2624700040 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884003a00 0x7fe89c14d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89bfff640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c158ac0 0x7fe89c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 -- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884003a00 msgr2=0x7fe89c14d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884003a00 0x7fe89c14d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 -- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c158ac0 msgr2=0x7fe89c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c158ac0 0x7fe89c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 -- 172.21.15.134:0/2624700040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c072d20 con 0x7fe89c072690 2024-09-15T22:43:58.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe89affd640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe8900116d0 tx=0x7fe890011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890015870 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe890015a10 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c073000 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890015dc0 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.212+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c0735c0 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.213+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89c0d0680 con 0x7fe89c072690 2024-09-15T22:43:58.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.214+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7fe890013400 con 0x7fe89c072690 2024-09-15T22:43:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.214+0000 7fe883fff640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 0x7fe88806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.215+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 0x7fe88806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.215+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fe89008c030 con 0x7fe89c072690 2024-09-15T22:43:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.215+0000 7fe89b7fe640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 0x7fe88806e9e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe88c032000 tx=0x7fe88c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:58.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.219+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe890019030 con 0x7fe89c072690 2024-09-15T22:43:58.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.418+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe89c0ccfd0 con 0x7fe89c072690 2024-09-15T22:43:58.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.419+0000 7fe883fff640 1 -- 172.21.15.134:0/2624700040 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fe89005a3c0 con 0x7fe89c072690 2024-09-15T22:43:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:43:58.420 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:43:58.420 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.420+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 msgr2=0x7fe88806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.420+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 0x7fe88806e9e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe88c032000 tx=0x7fe88c02e000 comp rx=0 tx=0).stop 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 msgr2=0x7fe89c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe8900116d0 tx=0x7fe890011ad0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 shutdown_connections 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe88806c520 0x7fe88806e9e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c158ac0 0x7fe89c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe89c072690 0x7fe89c073dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 --2- 172.21.15.134:0/2624700040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe884003a00 0x7fe89c14d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 >> 172.21.15.134:0/2624700040 conn(0x7fe89c062cc0 msgr2=0x7fe89c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 shutdown_connections 2024-09-15T22:43:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:43:58.421+0000 7fe8a1f6f640 1 -- 172.21.15.134:0/2624700040 wait complete. 2024-09-15T22:43:58.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:43:58.561 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":61.079280011000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.104848294370797,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:43:58.561 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.104848294370797 }, "state": "open", "uptime": 61.079280011 } ] 2024-09-15T22:43:58.561 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:44:03.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.671+0000 7fe73723c640 1 Processor -- start 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.671+0000 7fe73723c640 1 -- start start 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe73723c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe73015ca40 0x7fe73015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe73723c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 0x7fe7301594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe73723c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73015d390 con 0x7fe7300d02a0 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe73723c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe73015d670 con 0x7fe73015ca40 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe73723c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe73015d950 con 0x7fe73015ceb0 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe727fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe73015ca40 0x7fe73015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe727fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe73015ca40 0x7fe73015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49110/0 (socket says 172.21.15.134:49110) 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.672+0000 7fe727fff640 1 -- 172.21.15.134:0/3224245326 learned_addr learned my addr 172.21.15.134:0/3224245326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe7357d9640 1 --2- 172.21.15.134:0/3224245326 >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 0x7fe7301594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe727fff640 1 -- 172.21.15.134:0/3224245326 >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 msgr2=0x7fe7301594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe727fff640 1 --2- 172.21.15.134:0/3224245326 >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 0x7fe7301594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe727fff640 1 -- 172.21.15.134:0/3224245326 >> v1:172.21.15.177:6789/0 conn(0x7fe7300d02a0 legacy=0x7fe7300d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe727fff640 1 -- 172.21.15.134:0/3224245326 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73015dc30 con 0x7fe73015ca40 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe7357d9640 1 --2- 172.21.15.134:0/3224245326 >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 0x7fe7301594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe727fff640 1 --2- 172.21.15.134:0/3224245326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73015ca40 0x7fe73015e430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe7300b4be0 tx=0x7fe72002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d3093142b98f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.673+0000 7fe7277fe640 1 -- 172.21.15.134:0/3224245326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720037070 con 0x7fe73015ca40 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe7277fe640 1 -- 172.21.15.134:0/3224245326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720032440 con 0x7fe73015ca40 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe7277fe640 1 -- 172.21.15.134:0/3224245326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720032810 con 0x7fe73015ca40 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 -- 172.21.15.134:0/3224245326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73015ca40 msgr2=0x7fe73015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 --2- 172.21.15.134:0/3224245326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73015ca40 0x7fe73015e430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe7300b4be0 tx=0x7fe72002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 -- 172.21.15.134:0/3224245326 shutdown_connections 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 --2- 172.21.15.134:0/3224245326 >> v2:172.21.15.177:3300/0 conn(0x7fe73015ceb0 0x7fe7301594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 --2- 172.21.15.134:0/3224245326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73015ca40 0x7fe73015e430 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 -- 172.21.15.134:0/3224245326 >> 172.21.15.134:0/3224245326 conn(0x7fe730062cc0 msgr2=0x7fe73006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 -- 172.21.15.134:0/3224245326 shutdown_connections 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.674+0000 7fe73723c640 1 -- 172.21.15.134:0/3224245326 wait complete. 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.675+0000 7fe73723c640 1 Processor -- start 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.675+0000 7fe73723c640 1 -- start start 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe73015ca40 0x7fe7300ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe73015ceb0 0x7fe730073880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe730155d10 con 0x7fe7300d02a0 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe730155b90 con 0x7fe73015ceb0 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe73723c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe7300b4790 con 0x7fe73015ca40 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe734fd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe734fd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49120/0 (socket says 172.21.15.134:49120) 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.676+0000 7fe734fd8640 1 -- 172.21.15.134:0/212220111 learned_addr learned my addr 172.21.15.134:0/212220111 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe727fff640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe73015ca40 0x7fe7300ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe7357d9640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe73015ceb0 0x7fe730073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 -- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe73015ca40 msgr2=0x7fe7300ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe73015ca40 0x7fe7300ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 -- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe73015ceb0 msgr2=0x7fe730073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe73015ceb0 0x7fe730073880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 -- 172.21.15.134:0/212220111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7300ceac0 con 0x7fe7300d02a0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe734fd8640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c430 tx=0x7fe72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c011790 con 0x7fe7300d02a0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c017070 con 0x7fe7300d02a0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7300713e0 con 0x7fe7300d02a0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c011bb0 con 0x7fe7300d02a0 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.677+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe730073080 con 0x7fe7300d02a0 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.678+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe730071900 con 0x7fe7300d02a0 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.679+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7fe72c01c460 con 0x7fe7300d02a0 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.679+0000 7fe7257fa640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 0x7fe71c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.679+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fe72c08b700 con 0x7fe7300d02a0 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.679+0000 7fe727fff640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 0x7fe71c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.680+0000 7fe727fff640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 0x7fe71c06e9b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe720034000 tx=0x7fe72002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.684+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe72c059b50 con 0x7fe7300d02a0 2024-09-15T22:44:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.882+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7300d0680 con 0x7fe7300d02a0 2024-09-15T22:44:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.882+0000 7fe7257fa640 1 -- 172.21.15.134:0/212220111 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fe72c059450 con 0x7fe7300d02a0 2024-09-15T22:44:03.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:03.884 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:03.884 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 msgr2=0x7fe71c06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 0x7fe71c06e9b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe720034000 tx=0x7fe72002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 msgr2=0x7fe730149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c430 tx=0x7fe72c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 shutdown_connections 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe71c06c4f0 0x7fe71c06e9b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe73015ceb0 0x7fe730073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe73015ca40 0x7fe7300ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 --2- 172.21.15.134:0/212220111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7300d02a0 0x7fe730149f40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.884+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 >> 172.21.15.134:0/212220111 conn(0x7fe730062cc0 msgr2=0x7fe7300b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.885+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 shutdown_connections 2024-09-15T22:44:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:03.885+0000 7fe73723c640 1 -- 172.21.15.134:0/212220111 wait complete. 2024-09-15T22:44:03.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:44:04.027 INFO:teuthology.orchestra.run.smithi177.stdout:[{"id":5496,"entity":{"name":{"type":"client","num":5496},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":3122221863}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":66.545125999999996,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.865094344814501,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5496 172.21.15.134:0/3122221863","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:44:04.027 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 3122221863, "type": "any" }, "name": { "num": 5496, "type": "client" } }, "id": 5496, "inst": "client.5496 172.21.15.134:0/3122221863", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.8650943448145 }, "state": "open", "uptime": 66.545126 } ] 2024-09-15T22:44:04.028 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-15T22:44:09.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:09.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.140+0000 7fb26947b640 1 Processor -- start 2024-09-15T22:44:09.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.140+0000 7fb26947b640 1 -- start start 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb26947b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2640b8f90 0x7fb2640b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb26947b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2640b7170 con 0x7fb26415e940 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb26947b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2640b7aa0 con 0x7fb26415ed20 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb26947b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640d3660 con 0x7fb2640b8f90 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb2637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2640b8f90 0x7fb2640b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb262ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb26415e940 0x7fb2640d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42346/0 (socket says 172.21.15.134:42346) 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb262ffd640 1 -- 172.21.15.134:0/4103143179 learned_addr learned my addr 172.21.15.134:0/4103143179 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:09.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb2637fe640 1 -- 172.21.15.134:0/4103143179 >> v1:172.21.15.177:6789/0 conn(0x7fb26415ed20 legacy=0x7fb2640b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:09.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb2637fe640 1 -- 172.21.15.134:0/4103143179 >> v1:172.21.15.134:6789/0 conn(0x7fb26415e940 legacy=0x7fb2640d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb2637fe640 1 -- 172.21.15.134:0/4103143179 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640d3940 con 0x7fb2640b8f90 2024-09-15T22:44:09.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.141+0000 7fb261ffb640 1 -- 172.21.15.134:0/4103143179 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965112391 0 0) 0x7fb254001110 con 0x7fb26415e940 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.142+0000 7fb2637fe640 1 --2- 172.21.15.134:0/4103143179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb2640b3930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2159c9f9164f727c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.142+0000 7fb261ffb640 1 -- 172.21.15.134:0/4103143179 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007740 con 0x7fb2640b8f90 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.142+0000 7fb261ffb640 1 -- 172.21.15.134:0/4103143179 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c0078e0 con 0x7fb2640b8f90 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.142+0000 7fb261ffb640 1 -- 172.21.15.134:0/4103143179 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007cb0 con 0x7fb2640b8f90 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 -- 172.21.15.134:0/4103143179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 msgr2=0x7fb2640b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 --2- 172.21.15.134:0/4103143179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb2640b3930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c02a730 comp rx=0 tx=0).stop 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 -- 172.21.15.134:0/4103143179 shutdown_connections 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 --2- 172.21.15.134:0/4103143179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb2640b3930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 -- 172.21.15.134:0/4103143179 >> 172.21.15.134:0/4103143179 conn(0x7fb2640b6240 msgr2=0x7fb2640b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:09.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 -- 172.21.15.134:0/4103143179 shutdown_connections 2024-09-15T22:44:09.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.143+0000 7fb26947b640 1 -- 172.21.15.134:0/4103143179 wait complete. 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.144+0000 7fb26947b640 1 Processor -- start 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.144+0000 7fb26947b640 1 -- start start 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb26415e940 0x7fb264154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb26415ed20 0x7fb2640ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2640d3310 con 0x7fb2640b8f90 2024-09-15T22:44:09.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2640d3f00 con 0x7fb26415ed20 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb26947b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2640d1ef0 con 0x7fb26415e940 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb262ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb262ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49710/0 (socket says 172.21.15.134:49710) 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.145+0000 7fb262ffd640 1 -- 172.21.15.134:0/2677946394 learned_addr learned my addr 172.21.15.134:0/2677946394 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb2637fe640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb26415ed20 0x7fb2640ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 -- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb26415e940 msgr2=0x7fb264154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb26415e940 0x7fb264154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 -- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb26415ed20 msgr2=0x7fb2640ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb26415ed20 0x7fb2640ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 -- 172.21.15.134:0/2677946394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb264155950 con 0x7fb2640b8f90 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb262ffd640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c7b0 tx=0x7fb25400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254018070 con 0x7fb2640b8f90 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540072d0 con 0x7fb2640b8f90 2024-09-15T22:44:09.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2641e9450 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540047e0 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.146+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2641e9a10 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.147+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2640d0b80 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.147+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) ==== 91050+0+0 (secure 0 0 0) 0x7fb25401b070 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.148+0000 7fb24b7fe640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 0x7fb25006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.148+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fb25408ab20 con 0x7fb2640b8f90 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.148+0000 7fb2627fc640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 0x7fb25006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.148+0000 7fb2627fc640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 0x7fb25006e9b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2641f8160 tx=0x7fb258006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.152+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2640d0b80 con 0x7fb2640b8f90 2024-09-15T22:44:09.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.278+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fb254054ea0 con 0x7fb2640b8f90 2024-09-15T22:44:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.353+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2640cef90 con 0x7fb2640b8f90 2024-09-15T22:44:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.353+0000 7fb24b7fe640 1 -- 172.21.15.134:0/2677946394 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fb2640b7170 con 0x7fb2640b8f90 2024-09-15T22:44:09.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:09.355 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:09.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.355+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 msgr2=0x7fb25006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.355+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 0x7fb25006e9b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2641f8160 tx=0x7fb258006ba0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.355+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 msgr2=0x7fb264155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.355+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c7b0 tx=0x7fb25400cc70 comp rx=0 tx=0).stop 2024-09-15T22:44:09.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 shutdown_connections 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb25006c4f0 0x7fb25006e9b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb26415ed20 0x7fb2640ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb26415e940 0x7fb264154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 --2- 172.21.15.134:0/2677946394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2640b8f90 0x7fb264155410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 >> 172.21.15.134:0/2677946394 conn(0x7fb2640b6240 msgr2=0x7fb264161c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 shutdown_connections 2024-09-15T22:44:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.356+0000 7fb26947b640 1 -- 172.21.15.134:0/2677946394 wait complete. 2024-09-15T22:44:09.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-15T22:44:09.494 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-09-15T22:44:09.494 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-15T22:44:09.494 DEBUG:tasks.ceph_test_case:wait_until_true: success in 65s and 0 retries 2024-09-15T22:44:09.494 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:44:09.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:09.539 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:09.579 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:44:09.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:09.580 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:09.580 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:09.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:09.596 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:09.597 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:09.597 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:09.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:09.636 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:09.637 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:09.637 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:09.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:09.653 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:09.653 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:09.653 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:09.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:09.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.790+0000 7f4e1b3f8640 1 Processor -- start 2024-09-15T22:44:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.790+0000 7f4e1b3f8640 1 -- start start 2024-09-15T22:44:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e1b3f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4e1415ca40 0x7f4e1415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e1b3f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e1415ceb0 0x7f4e141594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e1b3f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1415d390 con 0x7f4e140d02a0 2024-09-15T22:44:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e1b3f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4e1415d670 con 0x7f4e1415ca40 2024-09-15T22:44:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e1b3f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1415d950 con 0x7f4e1415ceb0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e19194640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4e140d02a0 0x7f4e140d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42362/0 (socket says 172.21.15.134:42362) 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e19194640 1 -- 172.21.15.134:0/2817397193 learned_addr learned my addr 172.21.15.134:0/2817397193 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396164323 0 0) 0x7f4e1415d390 con 0x7f4e140d02a0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e00003520 con 0x7f4e140d02a0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e19995640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e1415ceb0 0x7f4e141594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> v2:172.21.15.177:3300/0 conn(0x7f4e1415ca40 0x7f4e1415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3872558801 0 0) 0x7f4e00003520 con 0x7f4e140d02a0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e1415ceb0 msgr2=0x7f4e141594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e1415ceb0 0x7f4e141594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 >> v2:172.21.15.177:3300/0 conn(0x7f4e1415ca40 msgr2=0x7f4e1415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 --2- 172.21.15.134:0/2817397193 >> v2:172.21.15.177:3300/0 conn(0x7f4e1415ca40 0x7f4e1415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1415dc30 con 0x7f4e140d02a0 2024-09-15T22:44:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f4e10001670 con 0x7f4e140d02a0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 >> v1:172.21.15.134:6789/0 conn(0x7f4e140d02a0 legacy=0x7f4e140d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e000039b0 0x7f4e00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e00004800 0x7f4e00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e000051c0 0x7f4e0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1415d670 con 0x7f4e00004800 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1415d950 con 0x7f4e000051c0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0000c090 con 0x7f4e000039b0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> v2:172.21.15.177:3300/0 conn(0x7f4e1415ca40 0x7f4e1415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.791+0000 7f4e19995640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e1415ceb0 0x7f4e141594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e19194640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e000039b0 0x7f4e00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e00004800 0x7f4e00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e19995640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e000051c0 0x7f4e0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 -- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e000039b0 msgr2=0x7f4e00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e000039b0 0x7f4e00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 -- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e000051c0 msgr2=0x7f4e0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e000051c0 0x7f4e0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e18993640 1 -- 172.21.15.134:0/2817397193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e00003520 con 0x7f4e00004800 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.792+0000 7f4e19194640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e000039b0 0x7f4e00003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e18993640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e00004800 0x7f4e00004c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098a0 tx=0x7f4e00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04c30f293159356 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037070 con 0x7f4e00004800 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0402ad20 con 0x7f4e00004800 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e0bfff640 1 -- 172.21.15.134:0/2817397193 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f040 con 0x7f4e00004800 2024-09-15T22:44:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/2817397193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e00004800 msgr2=0x7f4e00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/2817397193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e00004800 0x7f4e00004c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098a0 tx=0x7f4e00005830 comp rx=0 tx=0).stop 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e19995640 1 -- 172.21.15.134:0/2817397193 reap_dead start 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/2817397193 shutdown_connections 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/2817397193 >> 172.21.15.134:0/2817397193 conn(0x7f4e14062cc0 msgr2=0x7f4e1406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/2817397193 shutdown_connections 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.793+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/2817397193 wait complete. 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.794+0000 7f4e1b3f8640 1 Processor -- start 2024-09-15T22:44:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 -- start start 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e00004800 0x7f4e14073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 0x7f4e140aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14155d10 con 0x7f4e1414c270 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14155b90 con 0x7f4e00004800 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e1b3f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4e140b4790 con 0x7f4e140ae8e0 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e18993640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e18993640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49736/0 (socket says 172.21.15.134:49736) 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e18993640 1 -- 172.21.15.134:0/3175934957 learned_addr learned my addr 172.21.15.134:0/3175934957 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e19194640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e00004800 0x7f4e14073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.795+0000 7f4e19995640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 0x7f4e140aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 -- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 msgr2=0x7f4e140aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 0x7f4e140aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 -- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e00004800 msgr2=0x7f4e14073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e00004800 0x7f4e14073e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 -- 172.21.15.134:0/3175934957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e14072580 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e19995640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 0x7f4e140aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e18993640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e04035040 tx=0x7f4e04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04040020 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e04038040 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e14072860 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037070 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.796+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e14072e20 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.797+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e140d0680 con 0x7f4e1414c270 2024-09-15T22:44:09.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.798+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f4e04043020 con 0x7f4e1414c270 2024-09-15T22:44:09.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.798+0000 7f4e09ffb640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 0x7f4df806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.798+0000 7f4e19194640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 0x7f4df806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.798+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f4e040ab770 con 0x7f4e1414c270 2024-09-15T22:44:09.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.799+0000 7f4e19194640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 0x7f4df806e920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4e140af4f0 tx=0x7f4e100078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:09.803+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e0404a030 con 0x7f4e1414c270 2024-09-15T22:44:10.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.001+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e14158c50 con 0x7f4e1414c270 2024-09-15T22:44:10.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.002+0000 7f4e09ffb640 1 -- 172.21.15.134:0/3175934957 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f4e0400f000 con 0x7f4e1414c270 2024-09-15T22:44:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:10.003 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:10.004 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 msgr2=0x7f4df806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 0x7f4df806e920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4e140af4f0 tx=0x7f4e100078f0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 msgr2=0x7f4e1414aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e04035040 tx=0x7f4e04004730 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 shutdown_connections 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4df806c460 0x7f4df806e920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e140ae8e0 0x7f4e140aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1414c270 0x7f4e1414aa90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 --2- 172.21.15.134:0/3175934957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e00004800 0x7f4e14073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 >> 172.21.15.134:0/3175934957 conn(0x7f4e14062cc0 msgr2=0x7f4e140b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 shutdown_connections 2024-09-15T22:44:10.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.004+0000 7f4e1b3f8640 1 -- 172.21.15.134:0/3175934957 wait complete. 2024-09-15T22:44:10.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:10.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.115+0000 7f081636f640 1 Processor -- start 2024-09-15T22:44:10.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.115+0000 7f081636f640 1 -- start start 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081636f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f081015e860 0x7f08100cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081636f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 0x7f08100b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081636f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08100b6b50 con 0x7f081006c070 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081636f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f08100d34d0 con 0x7f081015e860 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081636f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f08100d3790 con 0x7f08100b61f0 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081490c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f081006c070 0x7f081006c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42376/0 (socket says 172.21.15.134:42376) 2024-09-15T22:44:10.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f081490c640 1 -- 172.21.15.134:0/205194352 learned_addr learned my addr 172.21.15.134:0/205194352 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f080ffff640 1 --2- 172.21.15.134:0/205194352 >> v2:172.21.15.177:3300/0 conn(0x7f081015e860 0x7f08100cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f080f7fe640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 0x7f08100b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f080effd640 1 -- 172.21.15.134:0/205194352 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573491858 0 0) 0x7f08100b6b50 con 0x7f081006c070 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.116+0000 7f080effd640 1 -- 172.21.15.134:0/205194352 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07fc003520 con 0x7f081006c070 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080ffff640 1 -- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 msgr2=0x7f08100b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080ffff640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 0x7f08100b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080ffff640 1 -- 172.21.15.134:0/205194352 >> v1:172.21.15.134:6789/0 conn(0x7f081006c070 legacy=0x7f081006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080ffff640 1 -- 172.21.15.134:0/205194352 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100d3a70 con 0x7f081015e860 2024-09-15T22:44:10.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080f7fe640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 0x7f08100b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080ffff640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081015e860 0x7f08100cf720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08000097a0 tx=0x7f080002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c6f76f7c23e97f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080effd640 1 -- 172.21.15.134:0/205194352 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800037070 con 0x7f081015e860 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.117+0000 7f080effd640 1 -- 172.21.15.134:0/205194352 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0800032440 con 0x7f081015e860 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f080effd640 1 -- 172.21.15.134:0/205194352 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000327f0 con 0x7f081015e860 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 -- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081015e860 msgr2=0x7f08100cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081015e860 0x7f08100cf720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08000097a0 tx=0x7f080002a210 comp rx=0 tx=0).stop 2024-09-15T22:44:10.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 -- 172.21.15.134:0/205194352 shutdown_connections 2024-09-15T22:44:10.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08100b61f0 0x7f08100b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 --2- 172.21.15.134:0/205194352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081015e860 0x7f08100cf720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 -- 172.21.15.134:0/205194352 >> 172.21.15.134:0/205194352 conn(0x7f0810062c60 msgr2=0x7f08100d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 -- 172.21.15.134:0/205194352 shutdown_connections 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.118+0000 7f081636f640 1 -- 172.21.15.134:0/205194352 wait complete. 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.119+0000 7f081636f640 1 Processor -- start 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.119+0000 7f081636f640 1 -- start start 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 0x7f0810157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 0x7f08101f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08100d4310 con 0x7f08100b61f0 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f08100d4030 con 0x7f081006c070 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081636f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f081015ec40 con 0x7f081015e860 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49752/0 (socket says 172.21.15.134:49752) 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080f7fe640 1 -- 172.21.15.134:0/1979827736 learned_addr learned my addr 172.21.15.134:0/1979827736 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:10.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080ffff640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 0x7f0810157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080f7fe640 1 -- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 msgr2=0x7f08101f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f081490c640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 0x7f08101f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.120+0000 7f080f7fe640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 0x7f08101f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080f7fe640 1 -- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 msgr2=0x7f0810157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080f7fe640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 0x7f0810157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080f7fe640 1 -- 172.21.15.134:0/1979827736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100cb950 con 0x7f08100b61f0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080ffff640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 0x7f0810157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f081490c640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 0x7f08101f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080f7fe640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ebe0 tx=0x7f07f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8017070 con 0x7f08100b61f0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f800cc30 con 0x7f08100b61f0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8013470 con 0x7f08100b61f0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08100cbc30 con 0x7f08100b61f0 2024-09-15T22:44:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.121+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08100cc710 con 0x7f08100b61f0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.122+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08100b3ad0 con 0x7f08100b61f0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.122+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f07f801a070 con 0x7f08100b61f0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.123+0000 7f080cff9640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 0x7f07f006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.123+0000 7f080ffff640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 0x7f07f006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.123+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f07f808b790 con 0x7f08100b61f0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.123+0000 7f080ffff640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 0x7f07f006e920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0800034000 tx=0x7f080002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.127+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07f8059bf0 con 0x7f08100b61f0 2024-09-15T22:44:10.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.327+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08100d2700 con 0x7f08100b61f0 2024-09-15T22:44:10.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.328+0000 7f080cff9640 1 -- 172.21.15.134:0/1979827736 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f07f80594f0 con 0x7f08100b61f0 2024-09-15T22:44:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:10.329 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:10.330 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:10.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 msgr2=0x7f07f006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 0x7f07f006e920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0800034000 tx=0x7f080002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:10.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 msgr2=0x7f08100ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ebe0 tx=0x7f07f800c520 comp rx=0 tx=0).stop 2024-09-15T22:44:10.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 shutdown_connections 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f07f006c460 0x7f07f006e920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081015e860 0x7f08101f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08100b61f0 0x7f08100ceb30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 --2- 172.21.15.134:0/1979827736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f081006c070 0x7f0810157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 >> 172.21.15.134:0/1979827736 conn(0x7f0810062c60 msgr2=0x7f08100caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 shutdown_connections 2024-09-15T22:44:10.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.330+0000 7f081636f640 1 -- 172.21.15.134:0/1979827736 wait complete. 2024-09-15T22:44:10.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.439+0000 7fd37980e640 1 Processor -- start 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.439+0000 7fd37980e640 1 -- start start 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd37980e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd37415e860 0x7fd3740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd37980e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd3740b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd37980e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3740d34d0 con 0x7fd3740b61f0 2024-09-15T22:44:10.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd37980e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd3740b6b80 con 0x7fd37415e860 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd37980e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd3740d3790 con 0x7fd3740b8ab0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd3727fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd3740b61f0 0x7fd37406c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42382/0 (socket says 172.21.15.134:42382) 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd3727fc640 1 -- 172.21.15.134:0/881568459 learned_addr learned my addr 172.21.15.134:0/881568459 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd372ffd640 1 --2- 172.21.15.134:0/881568459 >> v2:172.21.15.177:3300/0 conn(0x7fd37415e860 0x7fd3740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd3737fe640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd3740b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925616612 0 0) 0x7fd3740d34d0 con 0x7fd3740b61f0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd35c003520 con 0x7fd3740b61f0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4219294399 0 0) 0x7fd35c003520 con 0x7fd3740b61f0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 msgr2=0x7fd3740b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd3740b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 >> v2:172.21.15.177:3300/0 conn(0x7fd37415e860 msgr2=0x7fd3740cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 --2- 172.21.15.134:0/881568459 >> v2:172.21.15.177:3300/0 conn(0x7fd37415e860 0x7fd3740cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3740d3a70 con 0x7fd3740b61f0 2024-09-15T22:44:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd368001690 con 0x7fd3740b61f0 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 >> v1:172.21.15.134:6789/0 conn(0x7fd3740b61f0 legacy=0x7fd37406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd35c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.440+0000 7fd371ffb640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd35c003f30 0x7fd35c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd35c003f30 0x7fd35c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd372ffd640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd35c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd371ffb640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c004d40 0x7fd35c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740b6b80 con 0x7fd35c003f30 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740d3790 con 0x7fd35c004d40 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c00b9f0 con 0x7fd3740b8ab0 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3737fe640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c004d40 0x7fd35c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 -- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 msgr2=0x7fd35c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd35c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 -- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c004d40 msgr2=0x7fd35c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c004d40 0x7fd35c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd3727fc640 1 -- 172.21.15.134:0/881568459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c003520 con 0x7fd35c003f30 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.441+0000 7fd372ffd640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740b8ab0 0x7fd35c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd3727fc640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd35c003f30 0x7fd35c004800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c210 tx=0x7fd35c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129988317113078a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368007d60 con 0x7fd35c003f30 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd368005af0 con 0x7fd35c003f30 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd371ffb640 1 -- 172.21.15.134:0/881568459 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368007070 con 0x7fd35c003f30 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 -- 172.21.15.134:0/881568459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd35c003f30 msgr2=0x7fd35c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 --2- 172.21.15.134:0/881568459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd35c003f30 0x7fd35c004800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c210 tx=0x7fd35c005830 comp rx=0 tx=0).stop 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd3737fe640 1 -- 172.21.15.134:0/881568459 reap_dead start 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 -- 172.21.15.134:0/881568459 shutdown_connections 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 -- 172.21.15.134:0/881568459 >> 172.21.15.134:0/881568459 conn(0x7fd374062c60 msgr2=0x7fd3740d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 -- 172.21.15.134:0/881568459 shutdown_connections 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.442+0000 7fd37980e640 1 -- 172.21.15.134:0/881568459 wait complete. 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.443+0000 7fd37980e640 1 Processor -- start 2024-09-15T22:44:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 -- start start 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c003f30 0x7fd3740ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740cecd0 0x7fd3740b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740d4310 con 0x7fd3740ce8b0 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740d4030 con 0x7fd35c003f30 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd37980e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd37415ec40 con 0x7fd3740cecd0 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd3727fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd3727fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49774/0 (socket says 172.21.15.134:49774) 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.444+0000 7fd3727fc640 1 -- 172.21.15.134:0/2899113215 learned_addr learned my addr 172.21.15.134:0/2899113215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd372ffd640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c003f30 0x7fd3740ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3737fe640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740cecd0 0x7fd3740b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 -- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740cecd0 msgr2=0x7fd3740b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740cecd0 0x7fd3740b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 -- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c003f30 msgr2=0x7fd3740ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c003f30 0x7fd3740ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 -- 172.21.15.134:0/2899113215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3740cd320 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd3727fc640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c330 tx=0x7fd3740b77f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368042070 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd368007480 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368001ca0 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3740cd040 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.445+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3741e7de0 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.446+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3740b3ad0 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.447+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fd368045070 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.447+0000 7fd35bfff640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 0x7fd36006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.447+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fd3680ac230 con 0x7fd3740ce8b0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.447+0000 7fd372ffd640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 0x7fd36006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.447+0000 7fd372ffd640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 0x7fd36006e950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd364009660 tx=0x7fd364009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.451+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd36804c030 con 0x7fd3740ce8b0 2024-09-15T22:44:10.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.619+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3740d2700 con 0x7fd3740ce8b0 2024-09-15T22:44:10.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.620+0000 7fd35bfff640 1 -- 172.21.15.134:0/2899113215 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16941 (secure 0 0 0) 0x7fd368005ac0 con 0x7fd3740ce8b0 2024-09-15T22:44:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:10.625 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":49,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:43:08.144161+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:41.015151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:41.364744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.8","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:10.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.622+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 msgr2=0x7fd36006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.622+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 0x7fd36006e950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd364009660 tx=0x7fd364009190 comp rx=0 tx=0).stop 2024-09-15T22:44:10.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.622+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 msgr2=0x7fd3740b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.622+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c330 tx=0x7fd3740b77f0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.622+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 shutdown_connections 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd36006c490 0x7fd36006e950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3740cecd0 0x7fd3740b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3740ce8b0 0x7fd3740b94d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 --2- 172.21.15.134:0/2899113215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd35c003f30 0x7fd3740ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 >> 172.21.15.134:0/2899113215 conn(0x7fd374062c60 msgr2=0x7fd3740b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 shutdown_connections 2024-09-15T22:44:10.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.623+0000 7fd37980e640 1 -- 172.21.15.134:0/2899113215 wait complete. 2024-09-15T22:44:10.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:44:10.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:10.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.732+0000 7fc56ae74640 1 Processor -- start 2024-09-15T22:44:10.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.732+0000 7fc56ae74640 1 -- start start 2024-09-15T22:44:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc56ae74640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5640d02a0 0x7fc5640d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc56ae74640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc56415ca40 0x7fc56415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc56ae74640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5640d0bc0 con 0x7fc56415ce80 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc56ae74640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc56415d390 con 0x7fc56415ca40 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc56ae74640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc56415d670 con 0x7fc5640d02a0 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc56415ca40 0x7fc56415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc56415ca40 0x7fc56415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49776/0 (socket says 172.21.15.134:49776) 2024-09-15T22:44:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 -- 172.21.15.134:0/255132259 learned_addr learned my addr 172.21.15.134:0/255132259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc568c10640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5640d02a0 0x7fc5640d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 -- 172.21.15.134:0/255132259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5640d02a0 msgr2=0x7fc5640d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5640d02a0 0x7fc5640d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 -- 172.21.15.134:0/255132259 >> v1:172.21.15.177:6789/0 conn(0x7fc56415ce80 legacy=0x7fc5641594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.733+0000 7fc55bfff640 1 -- 172.21.15.134:0/255132259 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56415d950 con 0x7fc56415ca40 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.734+0000 7fc55bfff640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56415ca40 0x7fc56415e430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc554009870 tx=0x7fc55402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5445d16c965a6be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.734+0000 7fc55b7fe640 1 -- 172.21.15.134:0/255132259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554037070 con 0x7fc56415ca40 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.734+0000 7fc55b7fe640 1 -- 172.21.15.134:0/255132259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554032440 con 0x7fc56415ca40 2024-09-15T22:44:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.734+0000 7fc55b7fe640 1 -- 172.21.15.134:0/255132259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554032810 con 0x7fc56415ca40 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 -- 172.21.15.134:0/255132259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56415ca40 msgr2=0x7fc56415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56415ca40 0x7fc56415e430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc554009870 tx=0x7fc55402a180 comp rx=0 tx=0).stop 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 -- 172.21.15.134:0/255132259 shutdown_connections 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56415ca40 0x7fc56415e430 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 --2- 172.21.15.134:0/255132259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5640d02a0 0x7fc5640d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 -- 172.21.15.134:0/255132259 >> 172.21.15.134:0/255132259 conn(0x7fc564062cc0 msgr2=0x7fc56406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 -- 172.21.15.134:0/255132259 shutdown_connections 2024-09-15T22:44:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.735+0000 7fc56ae74640 1 -- 172.21.15.134:0/255132259 wait complete. 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.736+0000 7fc56ae74640 1 Processor -- start 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.736+0000 7fc56ae74640 1 -- start start 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc56415ca40 0x7fc5641f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc56415ce80 0x7fc5641406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc564155b90 con 0x7fc5640d02a0 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc56415df10 con 0x7fc56415ca40 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc56ae74640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc564155d10 con 0x7fc56415ce80 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49786/0 (socket says 172.21.15.134:49786) 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 -- 172.21.15.134:0/2642284790 learned_addr learned my addr 172.21.15.134:0/2642284790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 -- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc56415ce80 msgr2=0x7fc5641406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc56415ce80 0x7fc5641406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 -- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc56415ca40 msgr2=0x7fc5641f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc56415ca40 0x7fc5641f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 -- 172.21.15.134:0/2642284790 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5641f5b50 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.737+0000 7fc568c10640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc56000ea70 tx=0x7fc56000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.738+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560004220 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.738+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5600043c0 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.738+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc564140be0 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.738+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560007b70 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.738+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56415bde0 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.739+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56415c6b0 con 0x7fc5640d02a0 2024-09-15T22:44:10.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.739+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fc56000b030 con 0x7fc5640d02a0 2024-09-15T22:44:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.740+0000 7fc5597fa640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 0x7fc55006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.740+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7fc56008dbf0 con 0x7fc5640d02a0 2024-09-15T22:44:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.740+0000 7fc55bfff640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 0x7fc55006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.740+0000 7fc55bfff640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 0x7fc55006e920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc554034000 tx=0x7fc55402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.744+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5641f5b50 con 0x7fc5640d02a0 2024-09-15T22:44:10.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.943+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5640b4790 con 0x7fc5640d02a0 2024-09-15T22:44:10.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.944+0000 7fc5597fa640 1 -- 172.21.15.134:0/2642284790 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fc56005bf40 con 0x7fc5640d02a0 2024-09-15T22:44:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:10.946 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:10.946 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 msgr2=0x7fc55006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 0x7fc55006e920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc554034000 tx=0x7fc55402c000 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 msgr2=0x7fc56415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc56000ea70 tx=0x7fc56000ef30 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 shutdown_connections 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc55006c460 0x7fc55006e920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc56415ce80 0x7fc5641406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc56415ca40 0x7fc5641f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 --2- 172.21.15.134:0/2642284790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5640d02a0 0x7fc56415b420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 >> 172.21.15.134:0/2642284790 conn(0x7fc564062cc0 msgr2=0x7fc5640b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 shutdown_connections 2024-09-15T22:44:10.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:10.946+0000 7fc56ae74640 1 -- 172.21.15.134:0/2642284790 wait complete. 2024-09-15T22:44:10.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.056+0000 7f01e93e8640 1 Processor -- start 2024-09-15T22:44:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.056+0000 7f01e93e8640 1 -- start start 2024-09-15T22:44:11.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e93e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01e415e940 0x7f01e40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e93e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e40cef90 0x7f01e40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e93e8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e40b7170 con 0x7f01e415ed20 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e93e8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f01e40d1ae0 con 0x7f01e415e940 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e93e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f01e40b7aa0 con 0x7f01e40cef90 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01e415e940 0x7f01e40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e27fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f01e415ed20 0x7f01e40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42396/0 (socket says 172.21.15.134:42396) 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e27fc640 1 -- 172.21.15.134:0/316873454 learned_addr learned my addr 172.21.15.134:0/316873454 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e2ffd640 1 -- 172.21.15.134:0/316873454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e40cef90 msgr2=0x7f01e40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/316873454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e40cef90 0x7f01e40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e2ffd640 1 -- 172.21.15.134:0/316873454 >> v1:172.21.15.134:6789/0 conn(0x7f01e415ed20 legacy=0x7f01e40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e1ffb640 1 -- 172.21.15.134:0/316873454 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084806770 0 0) 0x7f01cc001110 con 0x7f01e415ed20 2024-09-15T22:44:11.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.057+0000 7f01e2ffd640 1 -- 172.21.15.134:0/316873454 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e40d3660 con 0x7f01e415e940 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/316873454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e40d1060 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009d90 tx=0x7f01dc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fce32a2d584c074 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e1ffb640 1 -- 172.21.15.134:0/316873454 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007740 con 0x7f01e415e940 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e1ffb640 1 -- 172.21.15.134:0/316873454 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc0078e0 con 0x7f01e415e940 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e1ffb640 1 -- 172.21.15.134:0/316873454 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007cb0 con 0x7f01e415e940 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 -- 172.21.15.134:0/316873454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 msgr2=0x7f01e40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 --2- 172.21.15.134:0/316873454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e40d1060 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009d90 tx=0x7f01dc02a6f0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 -- 172.21.15.134:0/316873454 shutdown_connections 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 --2- 172.21.15.134:0/316873454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e40cef90 0x7f01e40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 --2- 172.21.15.134:0/316873454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e40d1060 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.058+0000 7f01e93e8640 1 -- 172.21.15.134:0/316873454 >> 172.21.15.134:0/316873454 conn(0x7f01e40b6240 msgr2=0x7f01e40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.059+0000 7f01e93e8640 1 -- 172.21.15.134:0/316873454 shutdown_connections 2024-09-15T22:44:11.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.059+0000 7f01e93e8640 1 -- 172.21.15.134:0/316873454 wait complete. 2024-09-15T22:44:11.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.060+0000 7f01e93e8640 1 Processor -- start 2024-09-15T22:44:11.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.060+0000 7f01e93e8640 1 -- start start 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 0x7f01e4154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e415ed20 0x7f01e415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01e40d3f00 con 0x7f01e415e940 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01e40d3c20 con 0x7f01e40cef90 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f01e40d3310 con 0x7f01e415ed20 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49798/0 (socket says 172.21.15.134:49798) 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 -- 172.21.15.134:0/1131071979 learned_addr learned my addr 172.21.15.134:0/1131071979 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:11.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 0x7f01e4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e37fe640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e415ed20 0x7f01e415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 -- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e415ed20 msgr2=0x7f01e415aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e415ed20 0x7f01e415aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 -- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 msgr2=0x7f01e4154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 0x7f01e4154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 -- 172.21.15.134:0/1131071979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e40c8f70 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 0x7f01e4154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e27fc640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c780 tx=0x7f01cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc018070 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01cc0072d0 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0047e0 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e40c9250 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.061+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e40ccb90 con 0x7f01e415e940 2024-09-15T22:44:11.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.062+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e40d1ef0 con 0x7f01e415e940 2024-09-15T22:44:11.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.063+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f01cc01b070 con 0x7f01e415e940 2024-09-15T22:44:11.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.063+0000 7f01db7fe640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 0x7f01c406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.063+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 0x7f01c406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.063+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f01cc08aa90 con 0x7f01e415e940 2024-09-15T22:44:11.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.064+0000 7f01e2ffd640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 0x7f01c406e920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f01dc034000 tx=0x7f01dc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.068+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01e40b7170 con 0x7f01e415e940 2024-09-15T22:44:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.269+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01e40ba6b0 con 0x7f01e415e940 2024-09-15T22:44:11.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.270+0000 7f01db7fe640 1 -- 172.21.15.134:0/1131071979 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f01cc0588a0 con 0x7f01e415e940 2024-09-15T22:44:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:11.271 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"btime":"2024-09-15T22:42:55:107030+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:42.400760+0000","modified":"2024-09-15T22:42:44.404846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6834/248034527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":248034527},{"type":"v1","addr":"172.21.15.177:6834","nonce":248034527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-15T22:44:11.271 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-09-15T22:44:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 msgr2=0x7f01c406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 0x7f01c406e920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f01dc034000 tx=0x7f01dc02f000 comp rx=0 tx=0).stop 2024-09-15T22:44:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 msgr2=0x7f01e4158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c780 tx=0x7f01cc00cc40 comp rx=0 tx=0).stop 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 shutdown_connections 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f01c406c460 0x7f01c406e920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01e415ed20 0x7f01e415aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e415e940 0x7f01e4158060 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 --2- 172.21.15.134:0/1131071979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01e40cef90 0x7f01e4154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 >> 172.21.15.134:0/1131071979 conn(0x7f01e40b6240 msgr2=0x7f01e4161b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 shutdown_connections 2024-09-15T22:44:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.272+0000 7f01e93e8640 1 -- 172.21.15.134:0/1131071979 wait complete. 2024-09-15T22:44:11.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:11.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.381+0000 7f87c0077640 1 Processor -- start 2024-09-15T22:44:11.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 -- start start 2024-09-15T22:44:11.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f87b815e940 0x7f87b80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87b815ed20 0x7f87b80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b80b7170 con 0x7f87b80cef90 2024-09-15T22:44:11.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f87b80d1ae0 con 0x7f87b815ed20 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.382+0000 7f87c0077640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f87b80b7aa0 con 0x7f87b815e940 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87b815ed20 0x7f87b80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87b815ed20 0x7f87b80d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49806/0 (socket says 172.21.15.134:49806) 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 -- 172.21.15.134:0/2860389688 learned_addr learned my addr 172.21.15.134:0/2860389688 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bde13640 1 --2- 172.21.15.134:0/2860389688 >> v2:172.21.15.177:3300/0 conn(0x7f87b815e940 0x7f87b80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 -- 172.21.15.134:0/2860389688 >> v2:172.21.15.177:3300/0 conn(0x7f87b815e940 msgr2=0x7f87b80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 --2- 172.21.15.134:0/2860389688 >> v2:172.21.15.177:3300/0 conn(0x7f87b815e940 0x7f87b80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 -- 172.21.15.134:0/2860389688 >> v1:172.21.15.177:6789/0 conn(0x7f87b80cef90 legacy=0x7f87b80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.383+0000 7f87bd612640 1 -- 172.21.15.134:0/2860389688 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b80d3660 con 0x7f87b815ed20 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87bd612640 1 --2- 172.21.15.134:0/2860389688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b815ed20 0x7f87b80d15a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f87b80509d0 tx=0x7f87ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ec7e58230648ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87bce11640 1 -- 172.21.15.134:0/2860389688 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac037070 con 0x7f87b815ed20 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87bce11640 1 -- 172.21.15.134:0/2860389688 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac02ae50 con 0x7f87b815ed20 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87bce11640 1 -- 172.21.15.134:0/2860389688 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac032860 con 0x7f87b815ed20 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 -- 172.21.15.134:0/2860389688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b815ed20 msgr2=0x7f87b80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 --2- 172.21.15.134:0/2860389688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b815ed20 0x7f87b80d15a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f87b80509d0 tx=0x7f87ac02a300 comp rx=0 tx=0).stop 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 -- 172.21.15.134:0/2860389688 shutdown_connections 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 --2- 172.21.15.134:0/2860389688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b815ed20 0x7f87b80d15a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 --2- 172.21.15.134:0/2860389688 >> v2:172.21.15.177:3300/0 conn(0x7f87b815e940 0x7f87b80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 -- 172.21.15.134:0/2860389688 >> 172.21.15.134:0/2860389688 conn(0x7f87b80b6240 msgr2=0x7f87b80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 -- 172.21.15.134:0/2860389688 shutdown_connections 2024-09-15T22:44:11.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.384+0000 7f87c0077640 1 -- 172.21.15.134:0/2860389688 wait complete. 2024-09-15T22:44:11.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 Processor -- start 2024-09-15T22:44:11.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 -- start start 2024-09-15T22:44:11.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b815e940 0x7f87b80ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 0x7f87b80afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80d3f00 con 0x7f87b80cef90 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80d3c20 con 0x7f87b815ed20 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87c0077640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f87b80d3310 con 0x7f87b815e940 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87bde13640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87bde13640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49818/0 (socket says 172.21.15.134:49818) 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.386+0000 7f87bde13640 1 -- 172.21.15.134:0/3206047118 learned_addr learned my addr 172.21.15.134:0/3206047118 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bd612640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b815e940 0x7f87b80ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87be614640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 0x7f87b80afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 -- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b815e940 msgr2=0x7f87b80ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b815e940 0x7f87b80ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 -- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 msgr2=0x7f87b80afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 0x7f87b80afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 -- 172.21.15.134:0/3206047118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b80ae4c0 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87be614640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 0x7f87b80afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87bde13640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f87b400d830 tx=0x7f87b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400b6c0 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4019070 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b80ae7a0 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400ba80 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.387+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b80aed60 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.388+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b80d1ef0 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.388+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f87b400bc20 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.389+0000 7f87aa7fc640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 0x7f879c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.389+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f87b408bb70 con 0x7f87b80cef90 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.389+0000 7f87bd612640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 0x7f879c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.389+0000 7f87bd612640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 0x7f879c06e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.393+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87b405a060 con 0x7f87b80cef90 2024-09-15T22:44:11.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.559+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87b80ba6b0 con 0x7f87b80cef90 2024-09-15T22:44:11.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.560+0000 7f87aa7fc640 1 -- 172.21.15.134:0/3206047118 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16941 (secure 0 0 0) 0x7f87b4059960 con 0x7f87b80cef90 2024-09-15T22:44:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:11.562 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":49,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:43:08.144161+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:41.015151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:41.364744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.8","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 msgr2=0x7f879c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 0x7f879c06e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 msgr2=0x7f87b8153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f87b400d830 tx=0x7f87b400dcf0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 shutdown_connections 2024-09-15T22:44:11.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f879c06c460 0x7f879c06e920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b815ed20 0x7f87b80afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b815e940 0x7f87b80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 --2- 172.21.15.134:0/3206047118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87b80cef90 0x7f87b8153c10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.562+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 >> 172.21.15.134:0/3206047118 conn(0x7f87b80b6240 msgr2=0x7f87b80b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.563+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 shutdown_connections 2024-09-15T22:44:11.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.563+0000 7f87c0077640 1 -- 172.21.15.134:0/3206047118 wait complete. 2024-09-15T22:44:11.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:44:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.672+0000 7f7b1c4af640 1 Processor -- start 2024-09-15T22:44:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.672+0000 7f7b1c4af640 1 -- start start 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1c4af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406be10 0x7f7b140cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1c4af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b14151c50 0x7f7b1415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1c4af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b140cd5f0 con 0x7f7b1406c1f0 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1c4af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7b140cd8d0 con 0x7f7b14151c50 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1c4af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b140cdbb0 con 0x7f7b1406be10 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1aa4c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b14151c50 0x7f7b1415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b19a4a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7b1406c1f0 0x7f7b14151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42408/0 (socket says 172.21.15.134:42408) 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b19a4a640 1 -- 172.21.15.134:0/1279391738 learned_addr learned my addr 172.21.15.134:0/1279391738 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.673+0000 7f7b1a24b640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406be10 0x7f7b140cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b1aa4c640 1 -- 172.21.15.134:0/1279391738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406be10 msgr2=0x7f7b140cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b1aa4c640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406be10 0x7f7b140cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b1aa4c640 1 -- 172.21.15.134:0/1279391738 >> v1:172.21.15.134:6789/0 conn(0x7f7b1406c1f0 legacy=0x7f7b14151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b19249640 1 -- 172.21.15.134:0/1279391738 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088722108 0 0) 0x7f7b140cd5f0 con 0x7f7b1406c1f0 2024-09-15T22:44:11.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b1aa4c640 1 -- 172.21.15.134:0/1279391738 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b140cde90 con 0x7f7b14151c50 2024-09-15T22:44:11.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b1aa4c640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b14151c50 0x7f7b1415baa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00bfa0 tx=0x7f7b0c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdccb7753f1564d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b19249640 1 -- 172.21.15.134:0/1279391738 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c03b070 con 0x7f7b14151c50 2024-09-15T22:44:11.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b19249640 1 -- 172.21.15.134:0/1279391738 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0336d0 con 0x7f7b14151c50 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.674+0000 7f7b19249640 1 -- 172.21.15.134:0/1279391738 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c033aa0 con 0x7f7b14151c50 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 -- 172.21.15.134:0/1279391738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b14151c50 msgr2=0x7f7b1415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b14151c50 0x7f7b1415baa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00bfa0 tx=0x7f7b0c02c860 comp rx=0 tx=0).stop 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 -- 172.21.15.134:0/1279391738 shutdown_connections 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b14151c50 0x7f7b1415baa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/1279391738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406be10 0x7f7b140cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 -- 172.21.15.134:0/1279391738 >> 172.21.15.134:0/1279391738 conn(0x7f7b14062cc0 msgr2=0x7f7b1406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 -- 172.21.15.134:0/1279391738 shutdown_connections 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.675+0000 7f7b1c4af640 1 -- 172.21.15.134:0/1279391738 wait complete. 2024-09-15T22:44:11.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.676+0000 7f7b1c4af640 1 Processor -- start 2024-09-15T22:44:11.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.676+0000 7f7b1c4af640 1 -- start start 2024-09-15T22:44:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406c1f0 0x7f7b14155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b14151c50 0x7f7b14158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b140d0310 con 0x7f7b1406be10 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b140ce690 con 0x7f7b14151c50 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1c4af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b140d0490 con 0x7f7b1406c1f0 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49826/0 (socket says 172.21.15.134:49826) 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 -- 172.21.15.134:0/2444561316 learned_addr learned my addr 172.21.15.134:0/2444561316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 -- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406c1f0 msgr2=0x7f7b14155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406c1f0 0x7f7b14155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 -- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b14151c50 msgr2=0x7f7b14158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b14151c50 0x7f7b14158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.677+0000 7f7b1a24b640 1 -- 172.21.15.134:0/2444561316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b14155b90 con 0x7f7b1406be10 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b1a24b640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000d800 tx=0x7f7b1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000b660 con 0x7f7b1406be10 2024-09-15T22:44:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b10019070 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b14157520 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000ba20 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.678+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b14157ae0 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.679+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b140d0890 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.679+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f7b1000bbc0 con 0x7f7b1406be10 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.679+0000 7f7b0affd640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 0x7f7af806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.680+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5854+0+0 (secure 0 0 0) 0x7f7b1008bc10 con 0x7f7b1406be10 2024-09-15T22:44:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.680+0000 7f7b19a4a640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 0x7f7af806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.680+0000 7f7b19a4a640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 0x7f7af806e920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cc800 tx=0x7f7b04007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.684+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b1005a070 con 0x7f7b1406be10 2024-09-15T22:44:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.883+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7b1415abc0 con 0x7f7b1406be10 2024-09-15T22:44:11.885 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:44:11.884+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:11.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.885+0000 7f7b0affd640 1 -- 172.21.15.134:0/2444561316 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7f7b10059970 con 0x7f7b1406be10 2024-09-15T22:44:11.886 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:44:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 msgr2=0x7f7af806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 0x7f7af806e920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cc800 tx=0x7f7b04007940 comp rx=0 tx=0).stop 2024-09-15T22:44:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 msgr2=0x7f7b141efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000d800 tx=0x7f7b1000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 shutdown_connections 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7af806c460 0x7f7af806e920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b14151c50 0x7f7b14158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b1406c1f0 0x7f7b14155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 --2- 172.21.15.134:0/2444561316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b1406be10 0x7f7b141efd60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 >> 172.21.15.134:0/2444561316 conn(0x7f7b14062cc0 msgr2=0x7f7b1415a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 shutdown_connections 2024-09-15T22:44:11.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.887+0000 7f7b1c4af640 1 -- 172.21.15.134:0/2444561316 wait complete. 2024-09-15T22:44:11.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:44:11.929 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:44:12.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:11.999+0000 7f317f3bd640 1 Processor -- start 2024-09-15T22:44:12.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 -- start start 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31780b3d50 0x7f317806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f31780b3290 0x7f317806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31780cf9a0 con 0x7f3178161e30 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f31780cfcf0 con 0x7f31780b3d50 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.000+0000 7f317f3bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3178162210 con 0x7f31780b3290 2024-09-15T22:44:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31780b3d50 0x7f317806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317d159640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3178161e30 0x7f31780d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42422/0 (socket says 172.21.15.134:42422) 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317d159640 1 -- 172.21.15.134:0/1761638682 learned_addr learned my addr 172.21.15.134:0/1761638682 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31780b3d50 0x7f317806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49834/0 (socket says 172.21.15.134:49834) 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317d95a640 1 --2- 172.21.15.134:0/1761638682 >> v2:172.21.15.177:3300/0 conn(0x7f31780b3290 0x7f317806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 -- 172.21.15.134:0/1761638682 >> v2:172.21.15.177:3300/0 conn(0x7f31780b3290 msgr2=0x7f317806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 --2- 172.21.15.134:0/1761638682 >> v2:172.21.15.177:3300/0 conn(0x7f31780b3290 0x7f317806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 -- 172.21.15.134:0/1761638682 >> v1:172.21.15.134:6789/0 conn(0x7f3178161e30 legacy=0x7f31780d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f3177fff640 1 -- 172.21.15.134:0/1761638682 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907179624 0 0) 0x7f31780cf9a0 con 0x7f3178161e30 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.001+0000 7f317c958640 1 -- 172.21.15.134:0/1761638682 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31780d5210 con 0x7f31780b3d50 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317c958640 1 --2- 172.21.15.134:0/1761638682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3d50 0x7f317806d8c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f31780b3ce0 tx=0x7f316c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facbfc5b611d9857 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f3177fff640 1 -- 172.21.15.134:0/1761638682 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c037070 con 0x7f31780b3d50 2024-09-15T22:44:12.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f3177fff640 1 -- 172.21.15.134:0/1761638682 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c032440 con 0x7f31780b3d50 2024-09-15T22:44:12.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f3177fff640 1 -- 172.21.15.134:0/1761638682 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c032810 con 0x7f31780b3d50 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 -- 172.21.15.134:0/1761638682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3d50 msgr2=0x7f317806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 --2- 172.21.15.134:0/1761638682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3d50 0x7f317806d8c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f31780b3ce0 tx=0x7f316c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 -- 172.21.15.134:0/1761638682 shutdown_connections 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 --2- 172.21.15.134:0/1761638682 >> v2:172.21.15.177:3300/0 conn(0x7f31780b3290 0x7f317806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 --2- 172.21.15.134:0/1761638682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3d50 0x7f317806d8c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 -- 172.21.15.134:0/1761638682 >> 172.21.15.134:0/1761638682 conn(0x7f31780d1870 msgr2=0x7f31780d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 -- 172.21.15.134:0/1761638682 shutdown_connections 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.002+0000 7f317f3bd640 1 -- 172.21.15.134:0/1761638682 wait complete. 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 Processor -- start 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 -- start start 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31780b3d50 0x7f3178154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3178161e30 0x7f31781607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f31780b78b0 con 0x7f31780b3290 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31780b3950 con 0x7f31780b3d50 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317f3bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f31780b7a30 con 0x7f3178161e30 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317d159640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:12.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317d159640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49838/0 (socket says 172.21.15.134:49838) 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.004+0000 7f317d159640 1 -- 172.21.15.134:0/795023686 learned_addr learned my addr 172.21.15.134:0/795023686 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 -- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3178161e30 msgr2=0x7f31781607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3178161e30 0x7f31781607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 -- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31780b3d50 msgr2=0x7f3178154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31780b3d50 0x7f3178154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 -- 172.21.15.134:0/795023686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31780cd9a0 con 0x7f31780b3290 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317d159640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f316800c460 tx=0x7f316800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31680074e0 con 0x7f31780b3290 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31680047e0 con 0x7f31780b3290 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31780cdc80 con 0x7f31780b3290 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168004bd0 con 0x7f31780b3290 2024-09-15T22:44:12.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.005+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31780ce520 con 0x7f31780b3290 2024-09-15T22:44:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.006+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31780cde50 con 0x7f31780b3290 2024-09-15T22:44:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.006+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f3168011070 con 0x7f31780b3290 2024-09-15T22:44:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.007+0000 7f3175ffb640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 0x7f316406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.007+0000 7f317c958640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 0x7f316406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.007+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5940+0+0 (secure 0 0 0) 0x7f316808b470 con 0x7f31780b3290 2024-09-15T22:44:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.007+0000 7f317c958640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 0x7f316406e920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.011+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f316800e280 con 0x7f31780b3290 2024-09-15T22:44:12.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.210+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31780d3480 con 0x7f31780b3290 2024-09-15T22:44:12.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.887+0000 7f3175ffb640 1 -- 172.21.15.134:0/795023686 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f3168059870 con 0x7f31780b3290 2024-09-15T22:44:12.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 msgr2=0x7f316406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 0x7f316406e920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c02c000 comp rx=0 tx=0).stop 2024-09-15T22:44:12.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 msgr2=0x7f3178158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:12.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f316800c460 tx=0x7f316800c920 comp rx=0 tx=0).stop 2024-09-15T22:44:12.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 shutdown_connections 2024-09-15T22:44:12.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f316406c460 0x7f316406e920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3178161e30 0x7f31781607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31780b3d50 0x7f3178154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 --2- 172.21.15.134:0/795023686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31780b3290 0x7f3178158b70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:12.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 >> 172.21.15.134:0/795023686 conn(0x7f31780d1870 msgr2=0x7f31780b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:12.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 shutdown_connections 2024-09-15T22:44:12.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:12.889+0000 7f317f3bd640 1 -- 172.21.15.134:0/795023686 wait complete. 2024-09-15T22:44:12.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:44:13.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.013+0000 7f6cb57b7640 1 Processor -- start 2024-09-15T22:44:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.013+0000 7f6cb57b7640 1 -- start start 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6cb57b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b3b00 0x7f6cb00d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6cb57b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cb00b3540 0x7f6cb00d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6cb57b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb00d20e0 con 0x7f6cb00b61e0 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6cb57b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb00d24f0 con 0x7f6cb00b3540 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6cb57b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb00cfa70 con 0x7f6cb00b3b00 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cb00b3540 0x7f6cb00d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cb00b3540 0x7f6cb00d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49846/0 (socket says 172.21.15.134:49846) 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 -- 172.21.15.134:0/3424829276 learned_addr learned my addr 172.21.15.134:0/3424829276 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6ca7fff640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b3b00 0x7f6cb00d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 -- 172.21.15.134:0/3424829276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b3b00 msgr2=0x7f6cb00d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b3b00 0x7f6cb00d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 -- 172.21.15.134:0/3424829276 >> v1:172.21.15.177:6789/0 conn(0x7f6cb00b61e0 legacy=0x7f6cb00b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.014+0000 7f6caf7fe640 1 -- 172.21.15.134:0/3424829276 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb00cfd50 con 0x7f6cb00b3540 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.015+0000 7f6caf7fe640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3540 0x7f6cb00d2ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009e50 tx=0x7f6ca802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b954ff26136786 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.015+0000 7f6cae7fc640 1 -- 172.21.15.134:0/3424829276 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8036070 con 0x7f6cb00b3540 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.015+0000 7f6cae7fc640 1 -- 172.21.15.134:0/3424829276 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8031600 con 0x7f6cb00b3540 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.015+0000 7f6cae7fc640 1 -- 172.21.15.134:0/3424829276 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80319d0 con 0x7f6cb00b3540 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 -- 172.21.15.134:0/3424829276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3540 msgr2=0x7f6cb00d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3540 0x7f6cb00d2ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009e50 tx=0x7f6ca802a5f0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 -- 172.21.15.134:0/3424829276 shutdown_connections 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3540 0x7f6cb00d2ec0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/3424829276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b3b00 0x7f6cb00d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 -- 172.21.15.134:0/3424829276 >> 172.21.15.134:0/3424829276 conn(0x7f6cb00d11e0 msgr2=0x7f6cb00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 -- 172.21.15.134:0/3424829276 shutdown_connections 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.016+0000 7f6cb57b7640 1 -- 172.21.15.134:0/3424829276 wait complete. 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.017+0000 7f6cb57b7640 1 Processor -- start 2024-09-15T22:44:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.017+0000 7f6cb57b7640 1 -- start start 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cb00b3540 0x7f6cb01f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b61e0 0x7f6cb01f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb015edc0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb00d1d00 con 0x7f6cb00b3540 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb01f6800 con 0x7f6cb00b61e0 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49848/0 (socket says 172.21.15.134:49848) 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 -- 172.21.15.134:0/4244475382 learned_addr learned my addr 172.21.15.134:0/4244475382 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:13.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6caeffd640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cb00b3540 0x7f6cb01f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6caf7fe640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b61e0 0x7f6cb01f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 -- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b61e0 msgr2=0x7f6cb01f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b61e0 0x7f6cb01f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 -- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cb00b3540 msgr2=0x7f6cb01f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cb00b3540 0x7f6cb01f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 -- 172.21.15.134:0/4244475382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb01f5bf0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca7fff640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d5d0 tx=0x7f6c9800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004240 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980043e0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb01f5ed0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003830 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.018+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01f6490 con 0x7f6cb00b3b00 2024-09-15T22:44:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.019+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb00b65c0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.020+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f6c980039d0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.020+0000 7f6ca77fe640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 0x7f6c9006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:13.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.020+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5940+0+0 (secure 0 0 0) 0x7f6c9808ba10 con 0x7f6cb00b3b00 2024-09-15T22:44:13.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.020+0000 7f6caeffd640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 0x7f6c9006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:13.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.021+0000 7f6caeffd640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 0x7f6c9006e920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00b6c40 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:13.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.024+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c980597c0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.191+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6cb00ba6e0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.894+0000 7f6ca77fe640 1 -- 172.21.15.134:0/4244475382 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) ==== 181+0+0 (secure 0 0 0) 0x7f6c9805dac0 con 0x7f6cb00b3b00 2024-09-15T22:44:13.896 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:44:13.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.897+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 msgr2=0x7f6c9006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:13.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.897+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 0x7f6c9006e920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00b6c40 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2024-09-15T22:44:13.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.897+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 msgr2=0x7f6cb015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:13.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.897+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d5d0 tx=0x7f6c9800da90 comp rx=0 tx=0).stop 2024-09-15T22:44:13.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 shutdown_connections 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c9006c460 0x7f6c9006e920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cb00b61e0 0x7f6cb01f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00b3b00 0x7f6cb015be00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 --2- 172.21.15.134:0/4244475382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cb00b3540 0x7f6cb01f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 >> 172.21.15.134:0/4244475382 conn(0x7f6cb00d11e0 msgr2=0x7f6cb00b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 shutdown_connections 2024-09-15T22:44:13.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:13.898+0000 7f6cb57b7640 1 -- 172.21.15.134:0/4244475382 wait complete. 2024-09-15T22:44:13.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:44:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 Processor -- start 2024-09-15T22:44:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 -- start start 2024-09-15T22:44:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73100d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73100d20e0 con 0x7f73100b61e0 2024-09-15T22:44:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73100cfa70 con 0x7f73100b3540 2024-09-15T22:44:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.019+0000 7f73170d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f73100d24f0 con 0x7f73100b3b00 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f7314e6c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f73100b61e0 0x7f73100b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42428/0 (socket says 172.21.15.134:42428) 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f7314e6c640 1 -- 172.21.15.134:0/4144828246 learned_addr learned my addr 172.21.15.134:0/4144828246 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737076551 0 0) 0x7f73100d20e0 con 0x7f73100b61e0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7300003520 con 0x7f73100b61e0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73100d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954544840 0 0) 0x7f7300003520 con 0x7f73100b61e0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 msgr2=0x7f73100d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73100d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 >> v1:172.21.15.177:6789/0 conn(0x7f73100b3540 legacy=0x7f73100d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100cfd50 con 0x7f73100b61e0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73100d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7304001670 con 0x7f73100b61e0 2024-09-15T22:44:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 >> v1:172.21.15.134:6789/0 conn(0x7f73100b61e0 legacy=0x7f73100b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73000039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7300003fd0 0x7f7300004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300004d40 0x7f73000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73100d24f0 con 0x7f7300003fd0 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f730000bc50 con 0x7f7300004d40 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f730000be50 con 0x7f73100b3b00 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7300003fd0 0x7f7300004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f7314e6c640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73000039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f731566d640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300004d40 0x7f73000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 -- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 msgr2=0x7f73000039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73100b3b00 0x7f73000039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 -- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300004d40 msgr2=0x7f73000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300004d40 0x7f73000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.020+0000 7f730ffff640 1 -- 172.21.15.134:0/4144828246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7300003520 con 0x7f7300003fd0 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.021+0000 7f730ffff640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7300003fd0 0x7f7300004800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7310163690 tx=0x7f7300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e059eb6f5d7b9359 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.021+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc037070 con 0x7f7300003fd0 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.021+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc02aca0 con 0x7f7300003fd0 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.021+0000 7f730f7fe640 1 -- 172.21.15.134:0/4144828246 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00f040 con 0x7f7300003fd0 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 -- 172.21.15.134:0/4144828246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7300003fd0 msgr2=0x7f7300004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 --2- 172.21.15.134:0/4144828246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7300003fd0 0x7f7300004800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7310163690 tx=0x7f7300005830 comp rx=0 tx=0).stop 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f731566d640 1 -- 172.21.15.134:0/4144828246 reap_dead start 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 -- 172.21.15.134:0/4144828246 shutdown_connections 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 -- 172.21.15.134:0/4144828246 >> 172.21.15.134:0/4144828246 conn(0x7f73100d11e0 msgr2=0x7f73100d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 -- 172.21.15.134:0/4144828246 shutdown_connections 2024-09-15T22:44:14.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.022+0000 7f73170d0640 1 -- 172.21.15.134:0/4144828246 wait complete. 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.023+0000 7f73170d0640 1 Processor -- start 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.023+0000 7f73170d0640 1 -- start start 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300003fd0 0x7f731014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7310161680 0x7f7310161b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f731015edc0 con 0x7f73100cd0c0 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73100d1d00 con 0x7f7300003fd0 2024-09-15T22:44:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f73170d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f73100cb830 con 0x7f7310161680 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49860/0 (socket says 172.21.15.134:49860) 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 -- 172.21.15.134:0/2088786877 learned_addr learned my addr 172.21.15.134:0/2088786877 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f730ffff640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7310161680 0x7f7310161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f7314e6c640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300003fd0 0x7f731014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 -- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7310161680 msgr2=0x7f7310161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7310161680 0x7f7310161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 -- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300003fd0 msgr2=0x7f731014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300003fd0 0x7f731014f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.024+0000 7f731566d640 1 -- 172.21.15.134:0/2088786877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100cbb10 con 0x7f73100cd0c0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f731566d640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f731008d570 tx=0x7f730800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308003970 con 0x7f73100cd0c0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7308018070 con 0x7f73100cd0c0 2024-09-15T22:44:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73100cbdf0 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308003d50 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.025+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73100cc3b0 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.026+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73100b65c0 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.026+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f73080050d0 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.027+0000 7f730d7fa640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 0x7f72f406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.027+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5502+0+0 (secure 0 0 0) 0x7f730808b270 con 0x7f73100cd0c0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.027+0000 7f7314e6c640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 0x7f72f406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.027+0000 7f7314e6c640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 0x7f72f406e950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73040010e0 tx=0x7f7304001c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.031+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73080591e0 con 0x7f73100cd0c0 2024-09-15T22:44:14.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.195+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73100d1810 con 0x7f73100cd0c0 2024-09-15T22:44:14.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.896+0000 7f730d7fa640 1 -- 172.21.15.134:0/2088786877 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) ==== 169+0+0 (secure 0 0 0) 0x7f730805d4e0 con 0x7f73100cd0c0 2024-09-15T22:44:14.897 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:44:14.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 msgr2=0x7f72f406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 0x7f72f406e950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73040010e0 tx=0x7f7304001c10 comp rx=0 tx=0).stop 2024-09-15T22:44:14.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 msgr2=0x7f73100cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f731008d570 tx=0x7f730800ec10 comp rx=0 tx=0).stop 2024-09-15T22:44:14.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 shutdown_connections 2024-09-15T22:44:14.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f72f406c490 0x7f72f406e950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100cd0c0 0x7f73100cd540 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7310161680 0x7f7310161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 --2- 172.21.15.134:0/2088786877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7300003fd0 0x7f731014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.899+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 >> 172.21.15.134:0/2088786877 conn(0x7f73100d11e0 msgr2=0x7f73100b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.900+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 shutdown_connections 2024-09-15T22:44:14.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:14.900+0000 7f73170d0640 1 -- 172.21.15.134:0/2088786877 wait complete. 2024-09-15T22:44:14.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:44:15.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.018+0000 7f31d359f640 1 Processor -- start 2024-09-15T22:44:15.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.018+0000 7f31d359f640 1 -- start start 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d359f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31cc0b1da0 0x7f31cc15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d359f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f31cc073150 0x7f31cc0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d359f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31cc15d9d0 con 0x7f31cc0d1ed0 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d359f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f31cc070c80 con 0x7f31cc0b1da0 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d359f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f31cc070930 con 0x7f31cc073150 2024-09-15T22:44:15.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d133b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31cc0b1da0 0x7f31cc15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.019+0000 7f31d133b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31cc0b1da0 0x7f31cc15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49874/0 (socket says 172.21.15.134:49874) 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 -- 172.21.15.134:0/2224853042 learned_addr learned my addr 172.21.15.134:0/2224853042 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d1b3c640 1 --2- 172.21.15.134:0/2224853042 >> v2:172.21.15.177:3300/0 conn(0x7f31cc073150 0x7f31cc0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 -- 172.21.15.134:0/2224853042 >> v2:172.21.15.177:3300/0 conn(0x7f31cc073150 msgr2=0x7f31cc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 --2- 172.21.15.134:0/2224853042 >> v2:172.21.15.177:3300/0 conn(0x7f31cc073150 0x7f31cc0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 -- 172.21.15.134:0/2224853042 >> v1:172.21.15.177:6789/0 conn(0x7f31cc0d1ed0 legacy=0x7f31cc0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:15.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 -- 172.21.15.134:0/2224853042 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc0b71d0 con 0x7f31cc0b1da0 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.020+0000 7f31d133b640 1 --2- 172.21.15.134:0/2224853042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc15d490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b4f30 tx=0x7f31c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4830d51d5b2cc207 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31c3fff640 1 -- 172.21.15.134:0/2224853042 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8037070 con 0x7f31cc0b1da0 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31c3fff640 1 -- 172.21.15.134:0/2224853042 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8032440 con 0x7f31cc0b1da0 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31c3fff640 1 -- 172.21.15.134:0/2224853042 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8032810 con 0x7f31cc0b1da0 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 -- 172.21.15.134:0/2224853042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 msgr2=0x7f31cc15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 --2- 172.21.15.134:0/2224853042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc15d490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b4f30 tx=0x7f31c802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 -- 172.21.15.134:0/2224853042 shutdown_connections 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 --2- 172.21.15.134:0/2224853042 >> v2:172.21.15.177:3300/0 conn(0x7f31cc073150 0x7f31cc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 --2- 172.21.15.134:0/2224853042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc15d490 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 -- 172.21.15.134:0/2224853042 >> 172.21.15.134:0/2224853042 conn(0x7f31cc0b4290 msgr2=0x7f31cc0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:15.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 -- 172.21.15.134:0/2224853042 shutdown_connections 2024-09-15T22:44:15.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.021+0000 7f31d359f640 1 -- 172.21.15.134:0/2224853042 wait complete. 2024-09-15T22:44:15.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.022+0000 7f31d359f640 1 Processor -- start 2024-09-15T22:44:15.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.022+0000 7f31d359f640 1 -- start start 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc073150 0x7f31cc1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 0x7f31cc14a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0d0b50 con 0x7f31cc0b1da0 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0b7790 con 0x7f31cc073150 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d359f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc071110 con 0x7f31cc0d1ed0 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d0b3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d0b3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49890/0 (socket says 172.21.15.134:49890) 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d0b3a640 1 -- 172.21.15.134:0/2942468849 learned_addr learned my addr 172.21.15.134:0/2942468849 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d133b640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc073150 0x7f31cc1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.023+0000 7f31d1b3c640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 0x7f31cc14a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 -- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 msgr2=0x7f31cc14a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 0x7f31cc14a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 -- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc073150 msgr2=0x7f31cc1f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc073150 0x7f31cc1f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 -- 172.21.15.134:0/2942468849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc14aee0 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d1b3c640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 0x7f31cc14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d0b3a640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00b420 tx=0x7f31bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011830 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc016070 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc14b1c0 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011c10 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.024+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc14b780 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.025+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc15d490 con 0x7f31cc0b1da0 2024-09-15T22:44:15.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.025+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f31bc01b460 con 0x7f31cc0b1da0 2024-09-15T22:44:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.026+0000 7f31c1ffb640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 0x7f31b006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.026+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f31bc08ae60 con 0x7f31cc0b1da0 2024-09-15T22:44:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.026+0000 7f31d133b640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 0x7f31b006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.026+0000 7f31d133b640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 0x7f31b006e920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31c8034000 tx=0x7f31c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.030+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31bc020020 con 0x7f31cc0b1da0 2024-09-15T22:44:15.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.194+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f31cc0b3490 con 0x7f31cc0b1da0 2024-09-15T22:44:15.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.198+0000 7f31c1ffb640 1 -- 172.21.15.134:0/2942468849 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f31bc059650 con 0x7f31cc0b1da0 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 msgr2=0x7f31b006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 0x7f31b006e920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31c8034000 tx=0x7f31c802e000 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 msgr2=0x7f31cc1f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00b420 tx=0x7f31bc00b8e0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 shutdown_connections 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f31b006c460 0x7f31b006e920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31cc0d1ed0 0x7f31cc14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31cc0b1da0 0x7f31cc1f21e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 --2- 172.21.15.134:0/2942468849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc073150 0x7f31cc1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 >> 172.21.15.134:0/2942468849 conn(0x7f31cc0b4290 msgr2=0x7f31cc0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 shutdown_connections 2024-09-15T22:44:15.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.200+0000 7f31d359f640 1 -- 172.21.15.134:0/2942468849 wait complete. 2024-09-15T22:44:15.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-15T22:44:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.309+0000 7fa2ac0d0640 1 Processor -- start 2024-09-15T22:44:15.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.309+0000 7fa2ac0d0640 1 -- start start 2024-09-15T22:44:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2ac0d0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2a415e500 0x7fa2a40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2ac0d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a4073cb0 0x7fa2a40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2ac0d0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4074200 con 0x7fa2a415e8e0 2024-09-15T22:44:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2ac0d0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a40b6e80 con 0x7fa2a4073cb0 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2ac0d0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a40b7160 con 0x7fa2a415e500 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a4073cb0 0x7fa2a40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2a4073cb0 0x7fa2a40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49900/0 (socket says 172.21.15.134:49900) 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 -- 172.21.15.134:0/1158119447 learned_addr learned my addr 172.21.15.134:0/1158119447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 -- 172.21.15.134:0/1158119447 >> v2:172.21.15.177:3300/0 conn(0x7fa2a415e500 msgr2=0x7fa2a40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 --2- 172.21.15.134:0/1158119447 >> v2:172.21.15.177:3300/0 conn(0x7fa2a415e500 0x7fa2a40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.310+0000 7fa2aa66d640 1 -- 172.21.15.134:0/1158119447 >> v1:172.21.15.177:6789/0 conn(0x7fa2a415e8e0 legacy=0x7fa2a41622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.311+0000 7fa2aa66d640 1 -- 172.21.15.134:0/1158119447 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40b7440 con 0x7fa2a4073cb0 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.311+0000 7fa2aa66d640 1 --2- 172.21.15.134:0/1158119447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a4073cb0 0x7fa2a40b49a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009e50 tx=0x7fa29c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec9dc9f524017e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.311+0000 7fa2a8e6a640 1 -- 172.21.15.134:0/1158119447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c036070 con 0x7fa2a4073cb0 2024-09-15T22:44:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.311+0000 7fa2a8e6a640 1 -- 172.21.15.134:0/1158119447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29c031600 con 0x7fa2a4073cb0 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.311+0000 7fa2a8e6a640 1 -- 172.21.15.134:0/1158119447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c02ae60 con 0x7fa2a4073cb0 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/1158119447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a4073cb0 msgr2=0x7fa2a40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/1158119447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a4073cb0 0x7fa2a40b49a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009e50 tx=0x7fa29c02a680 comp rx=0 tx=0).stop 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/1158119447 shutdown_connections 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/1158119447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a4073cb0 0x7fa2a40b49a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/1158119447 >> v2:172.21.15.177:3300/0 conn(0x7fa2a415e500 0x7fa2a40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/1158119447 >> 172.21.15.134:0/1158119447 conn(0x7fa2a4062810 msgr2=0x7fa2a4062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/1158119447 shutdown_connections 2024-09-15T22:44:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.312+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/1158119447 wait complete. 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.313+0000 7fa2ac0d0640 1 Processor -- start 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.313+0000 7fa2ac0d0640 1 -- start start 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a4073cb0 0x7fa2a41507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a415e8e0 0x7fa2a41e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a406ce30 con 0x7fa2a415e500 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a406ccb0 con 0x7fa2a415e8e0 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2ac0d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a40d1cf0 con 0x7fa2a4073cb0 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49910/0 (socket says 172.21.15.134:49910) 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 -- 172.21.15.134:0/375585667 learned_addr learned my addr 172.21.15.134:0/375585667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 -- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a4073cb0 msgr2=0x7fa2a41507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a9e6c640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a4073cb0 0x7fa2a41507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2aa66d640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a415e8e0 0x7fa2a41e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a4073cb0 0x7fa2a41507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 -- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a415e8e0 msgr2=0x7fa2a41e5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a415e8e0 0x7fa2a41e5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.314+0000 7fa2a966b640 1 -- 172.21.15.134:0/375585667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a415b720 con 0x7fa2a415e500 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa2a966b640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa294009fd0 tx=0x7fa29400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294015020 con 0x7fa2a415e500 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294011830 con 0x7fa2a415e500 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a415a680 con 0x7fa2a415e500 2024-09-15T22:44:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294011c00 con 0x7fa2a415e500 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.315+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a415ac40 con 0x7fa2a415e500 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.316+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a40b4460 con 0x7fa2a415e500 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.316+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fa294018020 con 0x7fa2a415e500 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.316+0000 7fa29a7fc640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 0x7fa28806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.317+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fa29408b2f0 con 0x7fa2a415e500 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.317+0000 7fa2a9e6c640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 0x7fa28806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.317+0000 7fa2a9e6c640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 0x7fa28806e920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000a810 tx=0x7fa2a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.321+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa29401f020 con 0x7fa2a415e500 2024-09-15T22:44:15.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.552+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fa2a41eaec0 con 0x7fa2a415e500 2024-09-15T22:44:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.908+0000 7fa29a7fc640 1 -- 172.21.15.134:0/375585667 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v160) ==== 140+0+0 (secure 0 0 0) 0x7fa2940172c0 con 0x7fa2a415e500 2024-09-15T22:44:15.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 msgr2=0x7fa28806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 0x7fa28806e920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000a810 tx=0x7fa2a0008040 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 msgr2=0x7fa2a414ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa294009fd0 tx=0x7fa29400b870 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 shutdown_connections 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa28806c460 0x7fa28806e920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2a415e8e0 0x7fa2a41e5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2a415e500 0x7fa2a414ebc0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 --2- 172.21.15.134:0/375585667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2a4073cb0 0x7fa2a41507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 >> 172.21.15.134:0/375585667 conn(0x7fa2a4062810 msgr2=0x7fa2a40d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 shutdown_connections 2024-09-15T22:44:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:15.911+0000 7fa2ac0d0640 1 -- 172.21.15.134:0/375585667 wait complete. 2024-09-15T22:44:15.923 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-15T22:44:15.923 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-15T22:44:15.924 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:44:15.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:16.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.021+0000 7f2ac70dd640 1 Processor -- start 2024-09-15T22:44:16.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.021+0000 7f2ac70dd640 1 -- start start 2024-09-15T22:44:16.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ac70dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ac0151c50 0x7f2ac00cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ac70dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac00cd5f0 con 0x7f2ac006be10 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ac70dd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac00cd8d0 con 0x7f2ac006c1f0 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ac70dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac00cdbb0 con 0x7f2ac0151c50 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ac0151c50 0x7f2ac00cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ac0151c50 0x7f2ac00cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49924/0 (socket says 172.21.15.134:49924) 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ac4e79640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2ac006be10 0x7f2ac0151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42432/0 (socket says 172.21.15.134:42432) 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 -- 172.21.15.134:0/3764729326 learned_addr learned my addr 172.21.15.134:0/3764729326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 -- 172.21.15.134:0/3764729326 >> v1:172.21.15.177:6789/0 conn(0x7f2ac006c1f0 legacy=0x7f2ac0164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 -- 172.21.15.134:0/3764729326 >> v1:172.21.15.134:6789/0 conn(0x7f2ac006be10 legacy=0x7f2ac0151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.022+0000 7f2ab7fff640 1 -- 172.21.15.134:0/3764729326 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac00cde90 con 0x7f2ac0151c50 2024-09-15T22:44:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.023+0000 7f2ab7fff640 1 --2- 172.21.15.134:0/3764729326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac00cd010 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bb10 tx=0x7f2ab002c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6fdece6d5ad375 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.023+0000 7f2ab77fe640 1 -- 172.21.15.134:0/3764729326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0036020 con 0x7f2ac0151c50 2024-09-15T22:44:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.023+0000 7f2ab77fe640 1 -- 172.21.15.134:0/3764729326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0032820 con 0x7f2ac0151c50 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.023+0000 7f2ab77fe640 1 -- 172.21.15.134:0/3764729326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0032bf0 con 0x7f2ac0151c50 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 -- 172.21.15.134:0/3764729326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 msgr2=0x7f2ac00cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/3764729326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac00cd010 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bb10 tx=0x7f2ab002c960 comp rx=0 tx=0).stop 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 -- 172.21.15.134:0/3764729326 shutdown_connections 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/3764729326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac00cd010 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 -- 172.21.15.134:0/3764729326 >> 172.21.15.134:0/3764729326 conn(0x7f2ac0062cc0 msgr2=0x7f2ac006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 -- 172.21.15.134:0/3764729326 shutdown_connections 2024-09-15T22:44:16.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.024+0000 7f2ac70dd640 1 -- 172.21.15.134:0/3764729326 wait complete. 2024-09-15T22:44:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.025+0000 7f2ac70dd640 1 Processor -- start 2024-09-15T22:44:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.025+0000 7f2ac70dd640 1 -- start start 2024-09-15T22:44:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 0x7f2ac014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac006c1f0 0x7f2ac0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac015baa0 con 0x7f2ac0151c50 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac00ce690 con 0x7f2ac006c1f0 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac015bc20 con 0x7f2ac006be10 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49930/0 (socket says 172.21.15.134:49930) 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 -- 172.21.15.134:0/1799826756 learned_addr learned my addr 172.21.15.134:0/1799826756 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ab7fff640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac006c1f0 0x7f2ac0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac4e79640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 0x7f2ac014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 -- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 msgr2=0x7f2ac014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 0x7f2ac014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 -- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac006c1f0 msgr2=0x7f2ac0154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac006c1f0 0x7f2ac0154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 -- 172.21.15.134:0/1799826756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac00725c0 con 0x7f2ac0151c50 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac4e79640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 0x7f2ac014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac567a640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c780 tx=0x7f2ab800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8004b60 con 0x7f2ac0151c50 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab8004d00 con 0x7f2ac0151c50 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800aa90 con 0x7f2ac0151c50 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac00728a0 con 0x7f2ac0151c50 2024-09-15T22:44:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.026+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac0073140 con 0x7f2ac0151c50 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.027+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac00cd010 con 0x7f2ac0151c50 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.028+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f2ab800ac30 con 0x7f2ac0151c50 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.028+0000 7f2ab57fa640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 0x7f2aac06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.028+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f2ab808b750 con 0x7f2ac0151c50 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.028+0000 7f2ac4e79640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 0x7f2aac06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.029+0000 7f2ac4e79640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 0x7f2aac06e920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000f60 tx=0x7f2abc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.032+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ab8020070 con 0x7f2ac0151c50 2024-09-15T22:44:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.197+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ac0072a70 con 0x7f2ac0151c50 2024-09-15T22:44:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.197+0000 7f2ab57fa640 1 -- 172.21.15.134:0/1799826756 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13068 (secure 0 0 0) 0x7f2ab8059f40 con 0x7f2ac0151c50 2024-09-15T22:44:16.199 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:16.199 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":52,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:14.895531+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6834/248034527":"2024-09-16T22:44:11.884818+0000","172.21.15.177:6832/248034527":"2024-09-16T22:44:11.884818+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 msgr2=0x7f2aac06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 0x7f2aac06e920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000f60 tx=0x7f2abc009040 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 msgr2=0x7f2ac01f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c780 tx=0x7f2ab800cc40 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 shutdown_connections 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2aac06c460 0x7f2aac06e920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ac0151c50 0x7f2ac01f4270 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac006c1f0 0x7f2ac0154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 --2- 172.21.15.134:0/1799826756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac006be10 0x7f2ac014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 >> 172.21.15.134:0/1799826756 conn(0x7f2ac0062cc0 msgr2=0x7f2ac00b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 shutdown_connections 2024-09-15T22:44:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.199+0000 7f2ac70dd640 1 -- 172.21.15.134:0/1799826756 wait complete. 2024-09-15T22:44:16.212 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:44:16.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:44:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.311+0000 7f7c034e6640 1 Processor -- start 2024-09-15T22:44:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.311+0000 7f7c034e6640 1 -- start start 2024-09-15T22:44:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c034e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7bfc158e50 0x7f7bfc0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c034e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7bfc15c370 0x7f7bfc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c034e6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc15c800 con 0x7f7bfc06ef60 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c034e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0b43f0 con 0x7f7bfc15c370 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c034e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0b3630 con 0x7f7bfc158e50 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7bfc15c370 0x7f7bfc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7bfc15c370 0x7f7bfc06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40898/0 (socket says 172.21.15.134:40898) 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c01a83640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7bfc06ef60 0x7f7bfc15ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34916/0 (socket says 172.21.15.134:34916) 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 -- 172.21.15.134:0/1247341444 learned_addr learned my addr 172.21.15.134:0/1247341444 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 -- 172.21.15.134:0/1247341444 >> v2:172.21.15.177:3300/0 conn(0x7f7bfc158e50 msgr2=0x7f7bfc0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c01282640 1 --2- 172.21.15.134:0/1247341444 >> v2:172.21.15.177:3300/0 conn(0x7f7bfc158e50 0x7f7bfc0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 --2- 172.21.15.134:0/1247341444 >> v2:172.21.15.177:3300/0 conn(0x7f7bfc158e50 0x7f7bfc0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 -- 172.21.15.134:0/1247341444 >> v1:172.21.15.134:6789/0 conn(0x7f7bfc06ef60 legacy=0x7f7bfc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7bf3fff640 1 -- 172.21.15.134:0/1247341444 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186871024 0 0) 0x7f7bfc15c800 con 0x7f7bfc06ef60 2024-09-15T22:44:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.312+0000 7f7c00a81640 1 -- 172.21.15.134:0/1247341444 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc0b3910 con 0x7f7bfc15c370 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.313+0000 7f7c00a81640 1 --2- 172.21.15.134:0/1247341444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc15c370 0x7f7bfc06ea20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc069580 tx=0x7f7bec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cacd1987939f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.313+0000 7f7bf3fff640 1 -- 172.21.15.134:0/1247341444 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec004030 con 0x7f7bfc15c370 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.313+0000 7f7bf3fff640 1 -- 172.21.15.134:0/1247341444 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec0041d0 con 0x7f7bfc15c370 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.313+0000 7f7bf3fff640 1 -- 172.21.15.134:0/1247341444 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec003610 con 0x7f7bfc15c370 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 -- 172.21.15.134:0/1247341444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc15c370 msgr2=0x7f7bfc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 --2- 172.21.15.134:0/1247341444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc15c370 0x7f7bfc06ea20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc069580 tx=0x7f7bec02a270 comp rx=0 tx=0).stop 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 -- 172.21.15.134:0/1247341444 shutdown_connections 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 --2- 172.21.15.134:0/1247341444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc15c370 0x7f7bfc06ea20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 --2- 172.21.15.134:0/1247341444 >> v2:172.21.15.177:3300/0 conn(0x7f7bfc158e50 0x7f7bfc0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 -- 172.21.15.134:0/1247341444 >> 172.21.15.134:0/1247341444 conn(0x7f7bfc06bba0 msgr2=0x7f7bfc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 -- 172.21.15.134:0/1247341444 shutdown_connections 2024-09-15T22:44:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.314+0000 7f7c034e6640 1 -- 172.21.15.134:0/1247341444 wait complete. 2024-09-15T22:44:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.315+0000 7f7c034e6640 1 Processor -- start 2024-09-15T22:44:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.315+0000 7f7c034e6640 1 -- start start 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bfc158e50 0x7f7bfc151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bfc15c370 0x7f7bfc1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc159230 con 0x7f7bfc06ef60 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b3ed0 con 0x7f7bfc15c370 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc0cf210 con 0x7f7bfc158e50 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40912/0 (socket says 172.21.15.134:40912) 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 -- 172.21.15.134:0/3989957637 learned_addr learned my addr 172.21.15.134:0/3989957637 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 -- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bfc158e50 msgr2=0x7f7bfc151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bfc158e50 0x7f7bfc151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 -- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bfc15c370 msgr2=0x7f7bfc1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01a83640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bfc15c370 0x7f7bfc1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bfc15c370 0x7f7bfc1528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 -- 172.21.15.134:0/3989957637 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc15ae70 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c01282640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c7f0 tx=0x7f7bf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8015070 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf8004240 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc15b150 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.316+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8007620 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.317+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc159830 con 0x7f7bfc06ef60 2024-09-15T22:44:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.317+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc06ea20 con 0x7f7bfc06ef60 2024-09-15T22:44:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.318+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f7bf80079d0 con 0x7f7bfc06ef60 2024-09-15T22:44:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.318+0000 7f7bf1ffb640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 0x7f7be006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.319+0000 7f7c00a81640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 0x7f7be006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.319+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f7bf808ba00 con 0x7f7bfc06ef60 2024-09-15T22:44:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.319+0000 7f7c00a81640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 0x7f7be006e920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7bec033000 tx=0x7f7bec02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.323+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bf805a0e0 con 0x7f7bfc06ef60 2024-09-15T22:44:16.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.485+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7bfc0727b0 con 0x7f7bfc06ef60 2024-09-15T22:44:16.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.486+0000 7f7bf1ffb640 1 -- 172.21.15.134:0/3989957637 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) ==== 93+0+10 (secure 0 0 0) 0x7f7bf80599e0 con 0x7f7bfc06ef60 2024-09-15T22:44:16.487 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:44:16.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 msgr2=0x7f7be006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 0x7f7be006e920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7bec033000 tx=0x7f7bec02c000 comp rx=0 tx=0).stop 2024-09-15T22:44:16.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 msgr2=0x7f7bfc159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c7f0 tx=0x7f7bf800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 shutdown_connections 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f7be006c460 0x7f7be006e920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bfc15c370 0x7f7bfc1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bfc158e50 0x7f7bfc151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 --2- 172.21.15.134:0/3989957637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bfc06ef60 0x7f7bfc159d50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 >> 172.21.15.134:0/3989957637 conn(0x7f7bfc06bba0 msgr2=0x7f7bfc0cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 shutdown_connections 2024-09-15T22:44:16.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.488+0000 7f7c034e6640 1 -- 172.21.15.134:0/3989957637 wait complete. 2024-09-15T22:44:16.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:44:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.600+0000 7f334bb6d640 1 Processor -- start 2024-09-15T22:44:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.600+0000 7f334bb6d640 1 -- start start 2024-09-15T22:44:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334bb6d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f33440d02a0 0x7f33440d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334bb6d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f334415ca40 0x7f334415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334bb6d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33440d0bc0 con 0x7f334415ceb0 2024-09-15T22:44:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334bb6d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f334415d390 con 0x7f334415ca40 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334bb6d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f334415d670 con 0x7f33440d02a0 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f334415ca40 0x7f334415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f334415ca40 0x7f334415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40922/0 (socket says 172.21.15.134:40922) 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f334a10a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f334415ceb0 0x7f33441594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34926/0 (socket says 172.21.15.134:34926) 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 -- 172.21.15.134:0/109126141 learned_addr learned my addr 172.21.15.134:0/109126141 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349909640 1 --2- 172.21.15.134:0/109126141 >> v2:172.21.15.177:3300/0 conn(0x7f33440d02a0 0x7f33440d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 -- 172.21.15.134:0/109126141 >> v2:172.21.15.177:3300/0 conn(0x7f33440d02a0 msgr2=0x7f33440d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 --2- 172.21.15.134:0/109126141 >> v2:172.21.15.177:3300/0 conn(0x7f33440d02a0 0x7f33440d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 -- 172.21.15.134:0/109126141 >> v1:172.21.15.134:6789/0 conn(0x7f334415ceb0 legacy=0x7f33441594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3348907640 1 -- 172.21.15.134:0/109126141 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576616385 0 0) 0x7f33440d0bc0 con 0x7f334415ceb0 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.601+0000 7f3349108640 1 -- 172.21.15.134:0/109126141 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334415d950 con 0x7f334415ca40 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.602+0000 7f3349108640 1 --2- 172.21.15.134:0/109126141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ca40 0x7f334415e430 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f334406f030 tx=0x7f333402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234a0bdb177925cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.602+0000 7f3348907640 1 -- 172.21.15.134:0/109126141 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334037070 con 0x7f334415ca40 2024-09-15T22:44:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.602+0000 7f3348907640 1 -- 172.21.15.134:0/109126141 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3334032440 con 0x7f334415ca40 2024-09-15T22:44:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.602+0000 7f3348907640 1 -- 172.21.15.134:0/109126141 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334032810 con 0x7f334415ca40 2024-09-15T22:44:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 -- 172.21.15.134:0/109126141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ca40 msgr2=0x7f334415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 --2- 172.21.15.134:0/109126141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ca40 0x7f334415e430 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f334406f030 tx=0x7f333402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 -- 172.21.15.134:0/109126141 shutdown_connections 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 --2- 172.21.15.134:0/109126141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ca40 0x7f334415e430 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 --2- 172.21.15.134:0/109126141 >> v2:172.21.15.177:3300/0 conn(0x7f33440d02a0 0x7f33440d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 -- 172.21.15.134:0/109126141 >> 172.21.15.134:0/109126141 conn(0x7f3344062cc0 msgr2=0x7f334406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 -- 172.21.15.134:0/109126141 shutdown_connections 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.603+0000 7f334bb6d640 1 -- 172.21.15.134:0/109126141 wait complete. 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.604+0000 7f334bb6d640 1 Processor -- start 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.604+0000 7f334bb6d640 1 -- start start 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33440d02a0 0x7f3344143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334415ca40 0x7f33440ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3344155b90 con 0x7f334415ceb0 2024-09-15T22:44:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f334415df10 con 0x7f334415ca40 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3344155d10 con 0x7f33440d02a0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40924/0 (socket says 172.21.15.134:40924) 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 -- 172.21.15.134:0/278652607 learned_addr learned my addr 172.21.15.134:0/278652607 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f3349108640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334415ca40 0x7f33440ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f3349909640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33440d02a0 0x7f3344143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 -- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33440d02a0 msgr2=0x7f3344143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33440d02a0 0x7f3344143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 -- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334415ca40 msgr2=0x7f33440ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334415ca40 0x7f33440ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 -- 172.21.15.134:0/278652607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3344156b30 con 0x7f334415ceb0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334a10a640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c6d0 tx=0x7f333c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c018070 con 0x7f334415ceb0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c004d60 con 0x7f334415ceb0 2024-09-15T22:44:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33440cdc00 con 0x7f334415ceb0 2024-09-15T22:44:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c00a820 con 0x7f334415ceb0 2024-09-15T22:44:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.605+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33440ce1c0 con 0x7f334415ceb0 2024-09-15T22:44:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.606+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33440b4790 con 0x7f334415ceb0 2024-09-15T22:44:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.607+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f333c01b070 con 0x7f334415ceb0 2024-09-15T22:44:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.607+0000 7f333a7fc640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 0x7f332806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.607+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f333c08a8a0 con 0x7f334415ceb0 2024-09-15T22:44:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.607+0000 7f3349909640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 0x7f332806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.608+0000 7f3349909640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 0x7f332806e920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3340006fd0 tx=0x7f3340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.611+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f333c058ad0 con 0x7f334415ceb0 2024-09-15T22:44:16.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.845+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f33440cc6b0 con 0x7f334415ceb0 2024-09-15T22:44:16.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.910+0000 7f333a7fc640 1 -- 172.21.15.134:0/278652607 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v161) ==== 164+0+0 (secure 0 0 0) 0x7f333c05cdd0 con 0x7f334415ceb0 2024-09-15T22:44:16.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 msgr2=0x7f332806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 0x7f332806e920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3340006fd0 tx=0x7f3340008040 comp rx=0 tx=0).stop 2024-09-15T22:44:16.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 msgr2=0x7f33440aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c6d0 tx=0x7f333c00cb90 comp rx=0 tx=0).stop 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 shutdown_connections 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f332806c460 0x7f332806e920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f334415ceb0 0x7f33440aee20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334415ca40 0x7f33440ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 --2- 172.21.15.134:0/278652607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33440d02a0 0x7f3344143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 >> 172.21.15.134:0/278652607 conn(0x7f3344062cc0 msgr2=0x7f3344154650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 shutdown_connections 2024-09-15T22:44:16.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:16.912+0000 7f334bb6d640 1 -- 172.21.15.134:0/278652607 wait complete. 2024-09-15T22:44:16.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:44:17.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 Processor -- start 2024-09-15T22:44:17.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 -- start start 2024-09-15T22:44:17.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc1c15e860 0x7efc1c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc1c06d130 con 0x7efc1c0b7190 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efc1c06d410 con 0x7efc1c15e860 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.025+0000 7efc21e7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc1c06d6f0 con 0x7efc1c073150 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc1c15e860 0x7efc1c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc1c15e860 0x7efc1c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40940/0 (socket says 172.21.15.134:40940) 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 -- 172.21.15.134:0/3224467545 learned_addr learned my addr 172.21.15.134:0/3224467545 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc12ffd640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 -- 172.21.15.134:0/3224467545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 msgr2=0x7efc1c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 -- 172.21.15.134:0/3224467545 >> v1:172.21.15.177:6789/0 conn(0x7efc1c0b7190 legacy=0x7efc1c06e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.026+0000 7efc1b7fe640 1 -- 172.21.15.134:0/3224467545 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c06d9d0 con 0x7efc1c15e860 2024-09-15T22:44:17.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc1b7fe640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c15ec40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b1198705432694 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc1affd640 1 -- 172.21.15.134:0/3224467545 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c037070 con 0x7efc1c15e860 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc1affd640 1 -- 172.21.15.134:0/3224467545 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0c032440 con 0x7efc1c15e860 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc1affd640 1 -- 172.21.15.134:0/3224467545 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c032810 con 0x7efc1c15e860 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 -- 172.21.15.134:0/3224467545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 msgr2=0x7efc1c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c15ec40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c02a210 comp rx=0 tx=0).stop 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 -- 172.21.15.134:0/3224467545 shutdown_connections 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3224467545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c15ec40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 -- 172.21.15.134:0/3224467545 >> 172.21.15.134:0/3224467545 conn(0x7efc1c0b4290 msgr2=0x7efc1c0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 -- 172.21.15.134:0/3224467545 shutdown_connections 2024-09-15T22:44:17.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.027+0000 7efc21e7b640 1 -- 172.21.15.134:0/3224467545 wait complete. 2024-09-15T22:44:17.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 Processor -- start 2024-09-15T22:44:17.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 -- start start 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c1f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc1c0b7190 0x7efc1c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c06cd50 con 0x7efc1c15e860 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c0b7620 con 0x7efc1c0b7190 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.029+0000 7efc21e7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc1c06ced0 con 0x7efc1c073150 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40956/0 (socket says 172.21.15.134:40956) 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 -- 172.21.15.134:0/3583459356 learned_addr learned my addr 172.21.15.134:0/3583459356 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc12ffd640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc1c0b7190 0x7efc1c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1b7fe640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c1f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 -- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 msgr2=0x7efc1c1f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c1f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 -- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc1c0b7190 msgr2=0x7efc1c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc1c0b7190 0x7efc1c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 -- 172.21.15.134:0/3583459356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c1f5280 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc1bfff640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c7b0 tx=0x7efc1400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14004b60 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc14004d00 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1c1f5560 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1400aa30 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.030+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1c1f82e0 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.031+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1c1f84e0 con 0x7efc1c15e860 2024-09-15T22:44:17.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.032+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7efc1400abd0 con 0x7efc1c15e860 2024-09-15T22:44:17.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.032+0000 7efc18ff9640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 0x7efbfc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.032+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7efc1408b630 con 0x7efc1c15e860 2024-09-15T22:44:17.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.032+0000 7efc1b7fe640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 0x7efbfc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.033+0000 7efc1b7fe640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 0x7efbfc06e920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc0c034000 tx=0x7efc0c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.036+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc1c1f84e0 con 0x7efc1c15e860 2024-09-15T22:44:17.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.203+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc1c0b6c50 con 0x7efc1c15e860 2024-09-15T22:44:17.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.207+0000 7efc18ff9640 1 -- 172.21.15.134:0/3583459356 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7efc14020070 con 0x7efc1c15e860 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 msgr2=0x7efbfc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 0x7efbfc06e920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc0c034000 tx=0x7efc0c02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 msgr2=0x7efc1c1f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c7b0 tx=0x7efc1400cc70 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 shutdown_connections 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7efbfc06c460 0x7efbfc06e920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc1c15e860 0x7efc1c1f4720 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc1c0b7190 0x7efc1c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 --2- 172.21.15.134:0/3583459356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc1c073150 0x7efc1c1f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 >> 172.21.15.134:0/3583459356 conn(0x7efc1c0b4290 msgr2=0x7efc1c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 shutdown_connections 2024-09-15T22:44:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.209+0000 7efc21e7b640 1 -- 172.21.15.134:0/3583459356 wait complete. 2024-09-15T22:44:17.221 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:44:17.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:17.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:17.313 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:44:17.313 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:17.313 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:17.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:17.329 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:17.329 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:17.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:17.371 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:17.371 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:17.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:17.387 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:17.387 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:17.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:17.428 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:44:17.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:17.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.525+0000 7ff4552af640 1 Processor -- start 2024-09-15T22:44:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.525+0000 7ff4552af640 1 -- start start 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff4552af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff45015ed20 0x7ff4500b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff4552af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4500b7170 con 0x7ff45015e940 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff4552af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4500b7aa0 con 0x7ff4500cef90 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff4552af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff4500d3660 con 0x7ff45015ed20 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff44effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff45015e940 0x7ff4500d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34936/0 (socket says 172.21.15.134:34936) 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff44effd640 1 -- 172.21.15.134:0/919432258 learned_addr learned my addr 172.21.15.134:0/919432258 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/919432258 >> v2:172.21.15.177:3300/0 conn(0x7ff45015ed20 0x7ff4500b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287007931 0 0) 0x7ff440001110 con 0x7ff45015e940 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.526+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff438003520 con 0x7ff45015e940 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3637555173 0 0) 0x7ff438003520 con 0x7ff45015e940 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 >> v2:172.21.15.177:3300/0 conn(0x7ff45015ed20 msgr2=0x7ff4500b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 --2- 172.21.15.134:0/919432258 >> v2:172.21.15.177:3300/0 conn(0x7ff45015ed20 0x7ff4500b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 >> v1:172.21.15.177:6789/0 conn(0x7ff4500cef90 legacy=0x7ff4500b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4500d3940 con 0x7ff45015e940 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7ff440001840 con 0x7ff45015e940 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 >> v1:172.21.15.134:6789/0 conn(0x7ff45015e940 legacy=0x7ff4500d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380039b0 0x7ff438003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4380051c0 0x7ff43800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500d3660 con 0x7ff438004800 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff43800c070 con 0x7ff4380039b0 2024-09-15T22:44:17.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff43800c270 con 0x7ff4380051c0 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44effd640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380039b0 0x7ff438003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44f7fe640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4380051c0 0x7ff43800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 -- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4380051c0 msgr2=0x7ff43800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4380051c0 0x7ff43800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 -- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380039b0 msgr2=0x7ff438003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380039b0 0x7ff438003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44e7fc640 1 -- 172.21.15.134:0/919432258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff438003520 con 0x7ff438004800 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44f7fe640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4380051c0 0x7ff43800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.527+0000 7ff44f7fe640 1 -- 172.21.15.134:0/919432258 reap_dead start 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff438004c80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff444009a90 tx=0x7ff438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ebf059f4334624 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444036070 con 0x7ff438004800 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff444031400 con 0x7ff438004800 2024-09-15T22:44:17.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff44dffb640 1 -- 172.21.15.134:0/919432258 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444009690 con 0x7ff438004800 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 -- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 msgr2=0x7ff438004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff438004c80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff444009a90 tx=0x7ff438005830 comp rx=0 tx=0).stop 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 -- 172.21.15.134:0/919432258 shutdown_connections 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 --2- 172.21.15.134:0/919432258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff438004c80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 -- 172.21.15.134:0/919432258 >> 172.21.15.134:0/919432258 conn(0x7ff4500b6240 msgr2=0x7ff4500b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 -- 172.21.15.134:0/919432258 shutdown_connections 2024-09-15T22:44:17.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.528+0000 7ff4552af640 1 -- 172.21.15.134:0/919432258 wait complete. 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.530+0000 7ff4552af640 1 Processor -- start 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.530+0000 7ff4552af640 1 -- start start 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.530+0000 7ff4552af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4500cb060 0x7ff4501579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff45015ad50 0x7ff45015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500d1ef0 con 0x7ff438004800 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500d3f00 con 0x7ff4500cb060 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff4500d2070 con 0x7ff45015ad50 2024-09-15T22:44:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40980/0 (socket says 172.21.15.134:40980) 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 -- 172.21.15.134:0/2643420032 learned_addr learned my addr 172.21.15.134:0/2643420032 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44f7fe640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff45015ad50 0x7ff45015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4500cb060 0x7ff4501579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 -- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff45015ad50 msgr2=0x7ff45015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff45015ad50 0x7ff45015b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 -- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4500cb060 msgr2=0x7ff4501579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4500cb060 0x7ff4501579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 -- 172.21.15.134:0/2643420032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4501588a0 con 0x7ff438004800 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff44effd640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff4400019b0 tx=0x7ff4400074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440007740 con 0x7ff438004800 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440018070 con 0x7ff438004800 2024-09-15T22:44:17.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff450158e20 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44000fc00 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.531+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4501592d0 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.532+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4500d1060 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.533+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7ff44001d460 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.533+0000 7ff4377fe640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 0x7ff43c06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.533+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7ff44008b410 con 0x7ff438004800 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.533+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 0x7ff43c06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.534+0000 7ff44e7fc640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 0x7ff43c06eaf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff444033000 tx=0x7ff444008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.537+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4500b7170 con 0x7ff438004800 2024-09-15T22:44:17.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.737+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4500ba6b0 con 0x7ff438004800 2024-09-15T22:44:17.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.738+0000 7ff4377fe640 1 -- 172.21.15.134:0/2643420032 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3908 (secure 0 0 0) 0x7ff440059c90 con 0x7ff438004800 2024-09-15T22:44:17.739 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:17.739 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":24,"btime":"2024-09-15T22:44:12:886408+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/17499512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":17499512},{"type":"v1","addr":"172.21.15.177:6835","nonce":17499512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/366971107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":366971107},{"type":"v1","addr":"172.21.15.134:6836","nonce":366971107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/442502736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":442502736},{"type":"v1","addr":"172.21.15.134:6837","nonce":442502736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/612374675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":612374675},{"type":"v1","addr":"172.21.15.177:6834","nonce":612374675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-09-15T22:44:17.739 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 24 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 msgr2=0x7ff43c06eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 0x7ff43c06eaf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff444033000 tx=0x7ff444008030 comp rx=0 tx=0).stop 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 msgr2=0x7ff4501f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff4400019b0 tx=0x7ff4400074f0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 shutdown_connections 2024-09-15T22:44:17.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff43c06c630 0x7ff43c06eaf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff45015ad50 0x7ff45015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4500cb060 0x7ff4501579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.739+0000 7ff4552af640 1 --2- 172.21.15.134:0/2643420032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff438004800 0x7ff4501f8c80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.740+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 >> 172.21.15.134:0/2643420032 conn(0x7ff4500b6240 msgr2=0x7ff4500cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.740+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 shutdown_connections 2024-09-15T22:44:17.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.740+0000 7ff4552af640 1 -- 172.21.15.134:0/2643420032 wait complete. 2024-09-15T22:44:17.752 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:44:17.752 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:44:17.752 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:44:17.752 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:17.753 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:44:17.753 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:44:17.753 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:44:17.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:17.753 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:44:17.753 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:44:17.753 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:44:17.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:17.754 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:44:17.754 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:44:17.754 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:44:17.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:17.762 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:44:17.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:44:17.764 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:44:17.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:44:17.765 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:44:17.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:44:17.767 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:44:17.767 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:44:17.805 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:44:17.805 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:17.806 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:44:17.806 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:17.808 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:44:17.808 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:17.809 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:44:17.809 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:17.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:44:17.880 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:44:17.880 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:44:17.889 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:44:17.889 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:44:17.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.910+0000 7f5108181640 1 Processor -- start 2024-09-15T22:44:17.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.910+0000 7f5108181640 1 -- start start 2024-09-15T22:44:17.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 0x7f51000cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51000b65c0 0x7f5100160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51000aff30 0x7f51000b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f51000b08a0 con 0x7f51000aff30 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f51000ce150 con 0x7f51000b65c0 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5108181640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51000ce430 con 0x7f5100156880 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f5105f1d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 0x7f51000cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51000b65c0 0x7f5100160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51000b65c0 0x7f5100160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37496/0 (socket says 172.21.15.134:37496) 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 -- 172.21.15.134:0/3450820565 learned_addr learned my addr 172.21.15.134:0/3450820565 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:17.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510671e640 1 --2- 172.21.15.134:0/3450820565 >> v2:172.21.15.134:3300/0 conn(0x7f51000aff30 0x7f51000b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 -- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 msgr2=0x7f51000cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 0x7f51000cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 -- 172.21.15.134:0/3450820565 >> v2:172.21.15.134:3300/0 conn(0x7f51000aff30 msgr2=0x7f51000b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 --2- 172.21.15.134:0/3450820565 >> v2:172.21.15.134:3300/0 conn(0x7f51000aff30 0x7f51000b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.911+0000 7f510571c640 1 -- 172.21.15.134:0/3450820565 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510015ff30 con 0x7f51000b65c0 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.912+0000 7f5105f1d640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 0x7f51000cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:17.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.912+0000 7f510571c640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51000b65c0 0x7f5100160730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5100069700 tx=0x7f50f002e550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26296650378f2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.913+0000 7f5104f1b640 1 -- 172.21.15.134:0/3450820565 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f003a070 con 0x7f51000b65c0 2024-09-15T22:44:17.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.913+0000 7f5104f1b640 1 -- 172.21.15.134:0/3450820565 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0033710 con 0x7f51000b65c0 2024-09-15T22:44:17.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.913+0000 7f5104f1b640 1 -- 172.21.15.134:0/3450820565 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0033ae0 con 0x7f51000b65c0 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 -- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51000b65c0 msgr2=0x7f5100160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51000b65c0 0x7f5100160730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5100069700 tx=0x7f50f002e550 comp rx=0 tx=0).stop 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 -- 172.21.15.134:0/3450820565 shutdown_connections 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 --2- 172.21.15.134:0/3450820565 >> v2:172.21.15.134:3300/0 conn(0x7f51000aff30 0x7f51000b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51000b65c0 0x7f5100160730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 --2- 172.21.15.134:0/3450820565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5100156880 0x7f51000cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 -- 172.21.15.134:0/3450820565 >> 172.21.15.134:0/3450820565 conn(0x7f510006cae0 msgr2=0x7f510006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 -- 172.21.15.134:0/3450820565 shutdown_connections 2024-09-15T22:44:17.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.914+0000 7f5108181640 1 -- 172.21.15.134:0/3450820565 wait complete. 2024-09-15T22:44:17.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 Processor -- start 2024-09-15T22:44:17.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 -- start start 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 0x7f510014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 0x7f5100072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51000b6a00 con 0x7f51000b65c0 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5100156c60 con 0x7f5100156880 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.916+0000 7f5108181640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5100160c70 con 0x7f51000aff30 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f5105f1d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 0x7f510014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510671e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 0x7f5100072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41010/0 (socket says 172.21.15.134:41010) 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 -- 172.21.15.134:0/1212972524 learned_addr learned my addr 172.21.15.134:0/1212972524 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:17.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 -- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 msgr2=0x7f510014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 0x7f510014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 -- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 msgr2=0x7f5100072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 0x7f5100072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 -- 172.21.15.134:0/1212972524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100150320 con 0x7f51000b65c0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510671e640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 0x7f5100072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f5105f1d640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 0x7f510014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f510571c640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c00 tx=0x7f50f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0044020 con 0x7f51000b65c0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f003f870 con 0x7f51000b65c0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f003a040 con 0x7f51000b65c0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510014f340 con 0x7f51000b65c0 2024-09-15T22:44:17.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.917+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510014f5e0 con 0x7f51000b65c0 2024-09-15T22:44:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.918+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5100153920 con 0x7f51000b65c0 2024-09-15T22:44:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.919+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f50f0047020 con 0x7f51000b65c0 2024-09-15T22:44:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.919+0000 7f50f67fc640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 0x7f50e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.919+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f50f00afcf0 con 0x7f51000b65c0 2024-09-15T22:44:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.919+0000 7f5105f1d640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 0x7f50e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.920+0000 7f5105f1d640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 0x7f50e406e920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009dd0 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:17.924+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5100153920 con 0x7f51000b65c0 2024-09-15T22:44:18.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.108+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f510015f340 con 0x7f51000b65c0 2024-09-15T22:44:18.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.934+0000 7f50f67fc640 1 -- 172.21.15.134:0/1212972524 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7f50f00b4070 con 0x7f51000b65c0 2024-09-15T22:44:18.936 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:44:18.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 msgr2=0x7f50e406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 0x7f50e406e920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009dd0 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 msgr2=0x7f510014d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c00 tx=0x7f50f00046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 shutdown_connections 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f50e406c460 0x7f50e406e920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100156880 0x7f5100072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51000b65c0 0x7f510014d020 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 --2- 172.21.15.134:0/1212972524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000aff30 0x7f510014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 >> 172.21.15.134:0/1212972524 conn(0x7f510006cae0 msgr2=0x7f5100153210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 shutdown_connections 2024-09-15T22:44:18.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:18.937+0000 7f5108181640 1 -- 172.21.15.134:0/1212972524 wait complete. 2024-09-15T22:44:18.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:44:19.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.049+0000 7f636f28b640 1 Processor -- start 2024-09-15T22:44:19.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.049+0000 7f636f28b640 1 -- start start 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63680d0a50 0x7f63681620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63680b4930 0x7f63680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f636815f620 0x7f636815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63680b52d0 con 0x7f636815f620 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f63681625f0 con 0x7f63680d0a50 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636f28b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6368162870 con 0x7f63680b4930 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f636815f620 0x7f636815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f636815f620 0x7f636815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41018/0 (socket says 172.21.15.134:41018) 2024-09-15T22:44:19.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 -- 172.21.15.134:0/2720174701 learned_addr learned my addr 172.21.15.134:0/2720174701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d027640 1 --2- 172.21.15.134:0/2720174701 >> v2:172.21.15.177:3300/0 conn(0x7f63680d0a50 0x7f63681620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636c826640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63680b4930 0x7f63680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 -- 172.21.15.134:0/2720174701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63680b4930 msgr2=0x7f63680b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63680b4930 0x7f63680b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 -- 172.21.15.134:0/2720174701 >> v2:172.21.15.177:3300/0 conn(0x7f63680d0a50 msgr2=0x7f63681620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 --2- 172.21.15.134:0/2720174701 >> v2:172.21.15.177:3300/0 conn(0x7f63680d0a50 0x7f63681620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.050+0000 7f636d828640 1 -- 172.21.15.134:0/2720174701 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368162b50 con 0x7f636815f620 2024-09-15T22:44:19.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.051+0000 7f636d828640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636815f620 0x7f636815fab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f636806cc40 tx=0x7f636002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6149aea253ab0cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.051+0000 7f635ffff640 1 -- 172.21.15.134:0/2720174701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360037070 con 0x7f636815f620 2024-09-15T22:44:19.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.051+0000 7f635ffff640 1 -- 172.21.15.134:0/2720174701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6360032440 con 0x7f636815f620 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.051+0000 7f635ffff640 1 -- 172.21.15.134:0/2720174701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360032810 con 0x7f636815f620 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 -- 172.21.15.134:0/2720174701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636815f620 msgr2=0x7f636815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636815f620 0x7f636815fab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f636806cc40 tx=0x7f636002a140 comp rx=0 tx=0).stop 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 -- 172.21.15.134:0/2720174701 shutdown_connections 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636815f620 0x7f636815fab0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 --2- 172.21.15.134:0/2720174701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63680b4930 0x7f63680b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 --2- 172.21.15.134:0/2720174701 >> v2:172.21.15.177:3300/0 conn(0x7f63680d0a50 0x7f63681620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 -- 172.21.15.134:0/2720174701 >> 172.21.15.134:0/2720174701 conn(0x7f6368062cc0 msgr2=0x7f636806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 -- 172.21.15.134:0/2720174701 shutdown_connections 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.052+0000 7f636f28b640 1 -- 172.21.15.134:0/2720174701 wait complete. 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.053+0000 7f636f28b640 1 Processor -- start 2024-09-15T22:44:19.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.053+0000 7f636f28b640 1 -- start start 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 0x7f6368144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6368070f40 0x7f63680713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63680b3620 con 0x7f63680b4930 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63680b3340 con 0x7f6368070f40 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f636815fff0 con 0x7f636815f620 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41028/0 (socket says 172.21.15.134:41028) 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 -- 172.21.15.134:0/2149357903 learned_addr learned my addr 172.21.15.134:0/2149357903 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:19.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d828640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6368070f40 0x7f63680713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636c826640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 0x7f6368144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 -- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 msgr2=0x7f6368144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 0x7f6368144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 -- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6368070f40 msgr2=0x7f63680713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6368070f40 0x7f63680713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 -- 172.21.15.134:0/2149357903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636815aa40 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636c826640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 0x7f6368144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636d027640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6364007e70 tx=0x7f636400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364014620 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6364019070 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63681f5500 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.054+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364014a00 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.055+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6368073020 con 0x7f63680b4930 2024-09-15T22:44:19.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.056+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63681620b0 con 0x7f63680b4930 2024-09-15T22:44:19.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.056+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f6364014ba0 con 0x7f63680b4930 2024-09-15T22:44:19.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.056+0000 7f635dffb640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 0x7f634c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.057+0000 7f636c826640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 0x7f634c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.057+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7f636408bc90 con 0x7f63680b4930 2024-09-15T22:44:19.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.057+0000 7f636c826640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 0x7f634c06e920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.061+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f636815aa40 con 0x7f63680b4930 2024-09-15T22:44:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.289+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f63680b1db0 con 0x7f63680b4930 2024-09-15T22:44:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.290+0000 7f635dffb640 1 -- 172.21.15.134:0/2149357903 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f636405a4d0 con 0x7f63680b4930 2024-09-15T22:44:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:44:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:44:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:44:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:44:19.305 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:44:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 msgr2=0x7f634c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 0x7f634c06e920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).stop 2024-09-15T22:44:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 msgr2=0x7f6368073b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6364007e70 tx=0x7f636400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 shutdown_connections 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f634c06c460 0x7f634c06e920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6368070f40 0x7f63680713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f636815f620 0x7f6368144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 --2- 172.21.15.134:0/2149357903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63680b4930 0x7f6368073b00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 >> 172.21.15.134:0/2149357903 conn(0x7f6368062cc0 msgr2=0x7f636806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 shutdown_connections 2024-09-15T22:44:19.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.292+0000 7f636f28b640 1 -- 172.21.15.134:0/2149357903 wait complete. 2024-09-15T22:44:19.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:44:19.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.403+0000 7f81b843c640 1 Processor -- start 2024-09-15T22:44:19.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.403+0000 7f81b843c640 1 -- start start 2024-09-15T22:44:19.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.404+0000 7f81b843c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f81b00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.404+0000 7f81b843c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b00b7170 con 0x7f81b015ed20 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.404+0000 7f81b843c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b00b7aa0 con 0x7f81b00cef90 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.404+0000 7f81b843c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00d3660 con 0x7f81b015e940 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b59d7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f81b015ed20 0x7f81b00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34944/0 (socket says 172.21.15.134:34944) 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b59d7640 1 -- 172.21.15.134:0/2383489234 learned_addr learned my addr 172.21.15.134:0/2383489234 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b61d8640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f81b00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902321468 0 0) 0x7f81a4001110 con 0x7f81b015ed20 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819c003520 con 0x7f81b015ed20 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2135589215 0 0) 0x7f819c003520 con 0x7f81b015ed20 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 msgr2=0x7f81b00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f81b00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 >> v1:172.21.15.177:6789/0 conn(0x7f81b00cef90 legacy=0x7f81b00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00d3940 con 0x7f81b015ed20 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f81a4001840 con 0x7f81b015ed20 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 >> v1:172.21.15.134:6789/0 conn(0x7f81b015ed20 legacy=0x7f81b00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f819c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f819c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f819c004d40 0x7f819c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00d3660 con 0x7f819c0039e0 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f819c00b9c0 con 0x7f819c004d40 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f819c00bbc0 con 0x7f81b015e940 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b61d8640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f819c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b59d7640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f819c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.405+0000 7f81b69d9640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f819c004d40 0x7f819c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 -- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 msgr2=0x7f819c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f819c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 -- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f819c004d40 msgr2=0x7f819c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f819c004d40 0x7f819c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 -- 172.21.15.134:0/2383489234 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c003520 con 0x7f819c0039e0 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b59d7640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b015e940 0x7f819c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b61d8640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f819c003dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009ac0 tx=0x7f819c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b178b08e0fda61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac036070 con 0x7f819c0039e0 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac031400 con 0x7f819c0039e0 2024-09-15T22:44:19.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.406+0000 7f81b51d6640 1 -- 172.21.15.134:0/2383489234 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009690 con 0x7f819c0039e0 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 -- 172.21.15.134:0/2383489234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 msgr2=0x7f819c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 --2- 172.21.15.134:0/2383489234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f819c003dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009ac0 tx=0x7f819c005830 comp rx=0 tx=0).stop 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b69d9640 1 -- 172.21.15.134:0/2383489234 reap_dead start 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 -- 172.21.15.134:0/2383489234 shutdown_connections 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 -- 172.21.15.134:0/2383489234 >> 172.21.15.134:0/2383489234 conn(0x7f81b00b6240 msgr2=0x7f81b00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 -- 172.21.15.134:0/2383489234 shutdown_connections 2024-09-15T22:44:19.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.407+0000 7f81b843c640 1 -- 172.21.15.134:0/2383489234 wait complete. 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.408+0000 7f81b843c640 1 Processor -- start 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.408+0000 7f81b843c640 1 -- start start 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 0x7f81b0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 0x7f81b00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00d3310 con 0x7f819c0039e0 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00d3f00 con 0x7f81b0155380 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b843c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00d1ef0 con 0x7f81b00b54d0 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41042/0 (socket says 172.21.15.134:41042) 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 -- 172.21.15.134:0/4016775181 learned_addr learned my addr 172.21.15.134:0/4016775181 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:19.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b59d7640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 0x7f81b0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b69d9640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 0x7f81b00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 -- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 msgr2=0x7f81b00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 0x7f81b00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 -- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 msgr2=0x7f81b0155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 0x7f81b0155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 -- 172.21.15.134:0/4016775181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b01468d0 con 0x7f819c0039e0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b59d7640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 0x7f81b0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b69d9640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 0x7f81b00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.409+0000 7f81b61d8640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009ac0 tx=0x7f81ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.410+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac040020 con 0x7f819c0039e0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.410+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac003bc0 con 0x7f819c0039e0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.410+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b0146bb0 con 0x7f819c0039e0 2024-09-15T22:44:19.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.410+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac036040 con 0x7f819c0039e0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.410+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b0147170 con 0x7f819c0039e0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.411+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b00d1060 con 0x7f819c0039e0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.411+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f81ac043020 con 0x7f819c0039e0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.412+0000 7f81a2ffd640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 0x7f819406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.412+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7f81ac0aaef0 con 0x7f819c0039e0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.412+0000 7f81b59d7640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 0x7f819406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.412+0000 7f81b59d7640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 0x7f819406e920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81a4001d50 tx=0x7f81a4001cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.416+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81ac0044e0 con 0x7f819c0039e0 2024-09-15T22:44:19.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.583+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f81b00ba6b0 con 0x7f819c0039e0 2024-09-15T22:44:19.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.583+0000 7f81a2ffd640 1 -- 172.21.15.134:0/4016775181 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) ==== 84+0+65 (secure 0 0 0) 0x7f81ac079730 con 0x7f819c0039e0 2024-09-15T22:44:19.584 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:19.584 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:44:19.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:19.585 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:44:19.585 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:44:19.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:19.585 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 msgr2=0x7f819406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 0x7f819406e920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81a4001d50 tx=0x7f81a4001cc0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 msgr2=0x7f81b0154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009ac0 tx=0x7f81ac004730 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 shutdown_connections 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f819406c460 0x7f819406e920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81b00b54d0 0x7f81b00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81b0155380 0x7f81b0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 --2- 172.21.15.134:0/4016775181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f819c0039e0 0x7f81b0154970 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 >> 172.21.15.134:0/4016775181 conn(0x7f81b00b6240 msgr2=0x7f81b00b92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 shutdown_connections 2024-09-15T22:44:19.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.585+0000 7f81b843c640 1 -- 172.21.15.134:0/4016775181 wait complete. 2024-09-15T22:44:19.597 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:44:19.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:44:19.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.698+0000 7fe588f59640 1 Processor -- start 2024-09-15T22:44:19.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.698+0000 7fe588f59640 1 -- start start 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe588f59640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5840b4f70 0x7fe58415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe588f59640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe58406fa40 0x7fe5840b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe588f59640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe58415fcd0 con 0x7fe58415fed0 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe588f59640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe5840b5890 con 0x7fe58406fa40 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe588f59640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe58406e9a0 con 0x7fe5840b4f70 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe582d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe58415fed0 0x7fe584160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34950/0 (socket says 172.21.15.134:34950) 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe582d9d640 1 -- 172.21.15.134:0/3503769343 learned_addr learned my addr 172.21.15.134:0/3503769343 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe58259c640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5840b4f70 0x7fe58415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe581d9b640 1 --2- 172.21.15.134:0/3503769343 >> v2:172.21.15.177:3300/0 conn(0x7fe58406fa40 0x7fe5840b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775221355 0 0) 0x7fe57c001490 con 0x7fe58415fed0 2024-09-15T22:44:19.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe56c003520 con 0x7fe58415fed0 2024-09-15T22:44:19.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577189689 0 0) 0x7fe56c003520 con 0x7fe58415fed0 2024-09-15T22:44:19.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe581d9b640 1 -- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5840b4f70 msgr2=0x7fe58415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:19.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe581d9b640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5840b4f70 0x7fe58415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe581d9b640 1 -- 172.21.15.134:0/3503769343 >> v1:172.21.15.134:6789/0 conn(0x7fe58415fed0 legacy=0x7fe584160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.699+0000 7fe581d9b640 1 -- 172.21.15.134:0/3503769343 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58406ec80 con 0x7fe58406fa40 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.700+0000 7fe581d9b640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58406fa40 0x7fe5840b5350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097a0 tx=0x7fe57802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f800b8220e72705a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.700+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578037070 con 0x7fe58406fa40 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.700+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57802ac30 con 0x7fe58406fa40 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.700+0000 7fe58159a640 1 -- 172.21.15.134:0/3503769343 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c001bc0 con 0x7fe58406fa40 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 -- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58406fa40 msgr2=0x7fe5840b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58406fa40 0x7fe5840b5350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097a0 tx=0x7fe57802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 -- 172.21.15.134:0/3503769343 shutdown_connections 2024-09-15T22:44:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58406fa40 0x7fe5840b5350 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 --2- 172.21.15.134:0/3503769343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5840b4f70 0x7fe58415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 -- 172.21.15.134:0/3503769343 >> 172.21.15.134:0/3503769343 conn(0x7fe584062810 msgr2=0x7fe58406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 -- 172.21.15.134:0/3503769343 shutdown_connections 2024-09-15T22:44:19.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.701+0000 7fe588f59640 1 -- 172.21.15.134:0/3503769343 wait complete. 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.702+0000 7fe588f59640 1 Processor -- start 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.702+0000 7fe588f59640 1 -- start start 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe58406fa40 0x7fe5840cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58415fed0 0x7fe584136f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe58406f520 con 0x7fe5840b4f70 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe58406f240 con 0x7fe58415fed0 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe588f59640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe584160a50 con 0x7fe58406fa40 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41056/0 (socket says 172.21.15.134:41056) 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 -- 172.21.15.134:0/6305764 learned_addr learned my addr 172.21.15.134:0/6305764 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 -- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe58406fa40 msgr2=0x7fe5840cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe58406fa40 0x7fe5840cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 -- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58415fed0 msgr2=0x7fe584136f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58415fed0 0x7fe584136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.703+0000 7fe581d9b640 1 -- 172.21.15.134:0/6305764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584135f10 con 0x7fe5840b4f70 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe581d9b640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe578035040 tx=0x7fe5780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578037050 con 0x7fe5840b4f70 2024-09-15T22:44:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe578043070 con 0x7fe5840b4f70 2024-09-15T22:44:19.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841361d0 con 0x7fe5840b4f70 2024-09-15T22:44:19.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578006e10 con 0x7fe5840b4f70 2024-09-15T22:44:19.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.704+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe584136790 con 0x7fe5840b4f70 2024-09-15T22:44:19.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.705+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58415e730 con 0x7fe5840b4f70 2024-09-15T22:44:19.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.705+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fe57803e670 con 0x7fe5840b4f70 2024-09-15T22:44:19.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.706+0000 7fe572ffd640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 0x7fe56406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:19.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.706+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7fe5780abd50 con 0x7fe5840b4f70 2024-09-15T22:44:19.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.706+0000 7fe58259c640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 0x7fe56406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:19.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.706+0000 7fe58259c640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 0x7fe56406e920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe574006a90 tx=0x7fe574006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:19.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.710+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5780af030 con 0x7fe5840b4f70 2024-09-15T22:44:19.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.874+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe5840008d0 con 0x7fe5840b4f70 2024-09-15T22:44:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.940+0000 7fe572ffd640 1 -- 172.21.15.134:0/6305764 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) ==== 138+0+0 (secure 0 0 0) 0x7fe57807a630 con 0x7fe5840b4f70 2024-09-15T22:44:19.941 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:44:19.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 msgr2=0x7fe56406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 0x7fe56406e920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe574006a90 tx=0x7fe574006a20 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 msgr2=0x7fe5840c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe578035040 tx=0x7fe5780046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 shutdown_connections 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe56406c460 0x7fe56406e920 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe58415fed0 0x7fe584136f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5840b4f70 0x7fe5840c9500 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 --2- 172.21.15.134:0/6305764 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe58406fa40 0x7fe5840cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 >> 172.21.15.134:0/6305764 conn(0x7fe584062810 msgr2=0x7fe5840b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 shutdown_connections 2024-09-15T22:44:19.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:19.942+0000 7fe588f59640 1 -- 172.21.15.134:0/6305764 wait complete. 2024-09-15T22:44:19.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:44:20.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.062+0000 7ffa54d9d640 1 Processor -- start 2024-09-15T22:44:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.062+0000 7ffa54d9d640 1 -- start start 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa54d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa500ce090 0x7ffa500ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa54d9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5015b5b0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa54d9d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa500b4800 con 0x7ffa50070eb0 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa54d9d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffa500cea40 con 0x7ffa500ce090 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa500ce090 0x7ffa500ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffa5015b1d0 0x7ffa500b3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34966/0 (socket says 172.21.15.134:34966) 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa500ce090 0x7ffa500ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41072/0 (socket says 172.21.15.134:41072) 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4f7fe640 1 -- 172.21.15.134:0/1645957452 learned_addr learned my addr 172.21.15.134:0/1645957452 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4effd640 1 -- 172.21.15.134:0/1645957452 >> v1:172.21.15.177:6789/0 conn(0x7ffa50070eb0 legacy=0x7ffa50071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4effd640 1 -- 172.21.15.134:0/1645957452 >> v1:172.21.15.134:6789/0 conn(0x7ffa5015b1d0 legacy=0x7ffa500b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4effd640 1 -- 172.21.15.134:0/1645957452 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa500b4ae0 con 0x7ffa500ce090 2024-09-15T22:44:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.063+0000 7ffa4e7fc640 1 -- 172.21.15.134:0/1645957452 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293186107 0 0) 0x7ffa5015b5b0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.064+0000 7ffa4effd640 1 --2- 172.21.15.134:0/1645957452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa500ce090 0x7ffa500ce500 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa440097a0 tx=0x7ffa4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a11610f6db25ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.064+0000 7ffa4e7fc640 1 -- 172.21.15.134:0/1645957452 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44037070 con 0x7ffa500ce090 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.064+0000 7ffa4e7fc640 1 -- 172.21.15.134:0/1645957452 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4402ae50 con 0x7ffa500ce090 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.064+0000 7ffa4e7fc640 1 -- 172.21.15.134:0/1645957452 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44032660 con 0x7ffa500ce090 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 -- 172.21.15.134:0/1645957452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa500ce090 msgr2=0x7ffa500ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/1645957452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa500ce090 0x7ffa500ce500 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa440097a0 tx=0x7ffa4402a140 comp rx=0 tx=0).stop 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 -- 172.21.15.134:0/1645957452 shutdown_connections 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/1645957452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa500ce090 0x7ffa500ce500 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 -- 172.21.15.134:0/1645957452 >> 172.21.15.134:0/1645957452 conn(0x7ffa5006bba0 msgr2=0x7ffa5006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 -- 172.21.15.134:0/1645957452 shutdown_connections 2024-09-15T22:44:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.065+0000 7ffa54d9d640 1 -- 172.21.15.134:0/1645957452 wait complete. 2024-09-15T22:44:20.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.066+0000 7ffa54d9d640 1 Processor -- start 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.066+0000 7ffa54d9d640 1 -- start start 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa50070eb0 0x7ffa5014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500ce090 0x7ffa5014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500b50a0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500b5380 con 0x7ffa500ce090 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa54d9d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffa500b4440 con 0x7ffa50070eb0 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41074/0 (socket says 172.21.15.134:41074) 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 -- 172.21.15.134:0/556845585 learned_addr learned my addr 172.21.15.134:0/556845585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4f7fe640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa50070eb0 0x7ffa5014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4effd640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500ce090 0x7ffa5014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 -- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa50070eb0 msgr2=0x7ffa5014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa50070eb0 0x7ffa5014c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 -- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500ce090 msgr2=0x7ffa5014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500ce090 0x7ffa5014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.067+0000 7ffa4ffff640 1 -- 172.21.15.134:0/556845585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5015cd00 con 0x7ffa5015b1d0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa4ffff640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c780 tx=0x7ffa4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48017070 con 0x7ffa5015b1d0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5015e730 con 0x7ffa5015b1d0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48003da0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa480052b0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.068+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5014cce0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.069+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa500ce500 con 0x7ffa5015b1d0 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.069+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7ffa48005450 con 0x7ffa5015b1d0 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.070+0000 7ffa37fff640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 0x7ffa3c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.070+0000 7ffa4f7fe640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 0x7ffa3c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.070+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5227+0+0 (secure 0 0 0) 0x7ffa4808ab10 con 0x7ffa5015b1d0 2024-09-15T22:44:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.070+0000 7ffa4f7fe640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 0x7ffa3c06e920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffa40007fd0 tx=0x7ffa40007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.074+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa48058b20 con 0x7ffa5015b1d0 2024-09-15T22:44:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.239+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffa50154ac0 con 0x7ffa5015b1d0 2024-09-15T22:44:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.945+0000 7ffa37fff640 1 -- 172.21.15.134:0/556845585 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) ==== 170+0+0 (secure 0 0 0) 0x7ffa4805ce20 con 0x7ffa5015b1d0 2024-09-15T22:44:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:44:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 msgr2=0x7ffa3c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 0x7ffa3c06e920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffa40007fd0 tx=0x7ffa40007de0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 msgr2=0x7ffa5015c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c780 tx=0x7ffa4800cc40 comp rx=0 tx=0).stop 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 shutdown_connections 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.949+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffa3c06c460 0x7ffa3c06e920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.950+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa5015b1d0 0x7ffa5015c300 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.950+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500ce090 0x7ffa5014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.950+0000 7ffa54d9d640 1 --2- 172.21.15.134:0/556845585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa50070eb0 0x7ffa5014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.950+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 >> 172.21.15.134:0/556845585 conn(0x7ffa5006bba0 msgr2=0x7ffa500732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.952+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 shutdown_connections 2024-09-15T22:44:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:20.953+0000 7ffa54d9d640 1 -- 172.21.15.134:0/556845585 wait complete. 2024-09-15T22:44:20.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:44:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.079+0000 7f922aa0e640 1 Processor -- start 2024-09-15T22:44:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.079+0000 7f922aa0e640 1 -- start start 2024-09-15T22:44:21.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f922aa0e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f922406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f922aa0e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240cf9a0 con 0x7f9224161e30 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f922aa0e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9224162210 con 0x7f92240b3290 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f922aa0e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f92240cfcf0 con 0x7f92240b3d50 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f9223fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9224161e30 0x7f92240d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34976/0 (socket says 172.21.15.134:34976) 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.080+0000 7f9223fff640 1 -- 172.21.15.134:0/747581679 learned_addr learned my addr 172.21.15.134:0/747581679 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f922406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338589409 0 0) 0x7f92240cf9a0 con 0x7f9224161e30 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003520 con 0x7f9224161e30 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2156081739 0 0) 0x7f920c003520 con 0x7f9224161e30 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 msgr2=0x7f922406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f922406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 >> v1:172.21.15.177:6789/0 conn(0x7f92240b3290 legacy=0x7f92240b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:21.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92240d5210 con 0x7f9224161e30 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f9214001670 con 0x7f9224161e30 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f922406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 >> v1:172.21.15.134:6789/0 conn(0x7f9224161e30 legacy=0x7f92240d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f920c0039e0 0x7f920c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c004800 0x7f920c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f920c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92240cfcf0 con 0x7f920c004800 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f920c00ba20 con 0x7f920c0039e0 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f920c00bc20 con 0x7f92240b3d50 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c004800 0x7f920c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9223fff640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f920c0039e0 0x7f920c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9228fab640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f920c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 -- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 msgr2=0x7f920c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f920c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 -- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f920c0039e0 msgr2=0x7f920c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f920c0039e0 0x7f920c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f92237fe640 1 -- 172.21.15.134:0/747581679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c003520 con 0x7f920c004800 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.081+0000 7f9228fab640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92240b3d50 0x7f920c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.082+0000 7f92237fe640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c004800 0x7f920c004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f92240ba8f0 tx=0x7f920c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c9f77574035dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.082+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218009860 con 0x7f920c004800 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.082+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218004020 con 0x7f920c004800 2024-09-15T22:44:21.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.082+0000 7f9222ffd640 1 -- 172.21.15.134:0/747581679 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180043f0 con 0x7f920c004800 2024-09-15T22:44:21.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 -- 172.21.15.134:0/747581679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c004800 msgr2=0x7f920c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 --2- 172.21.15.134:0/747581679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c004800 0x7f920c004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f92240ba8f0 tx=0x7f920c005830 comp rx=0 tx=0).stop 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f9228fab640 1 -- 172.21.15.134:0/747581679 reap_dead start 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 -- 172.21.15.134:0/747581679 shutdown_connections 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 -- 172.21.15.134:0/747581679 >> 172.21.15.134:0/747581679 conn(0x7f92240d1870 msgr2=0x7f92240d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 -- 172.21.15.134:0/747581679 shutdown_connections 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.083+0000 7f922aa0e640 1 -- 172.21.15.134:0/747581679 wait complete. 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.084+0000 7f922aa0e640 1 Processor -- start 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.084+0000 7f922aa0e640 1 -- start start 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f920c004800 0x7f922414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 0x7f92240b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92240b7fc0 con 0x7f92241f53c0 2024-09-15T22:44:21.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92240b3950 con 0x7f92240b56e0 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f922aa0e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f92240b8140 con 0x7f920c004800 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41106/0 (socket says 172.21.15.134:41106) 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 -- 172.21.15.134:0/2397107929 learned_addr learned my addr 172.21.15.134:0/2397107929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f9223fff640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f920c004800 0x7f922414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f9228fab640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 0x7f92240b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 -- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f920c004800 msgr2=0x7f922414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f920c004800 0x7f922414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 -- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 msgr2=0x7f92240b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 0x7f92240b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 -- 172.21.15.134:0/2397107929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92240ca320 con 0x7f92241f53c0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f9228fab640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 0x7f92240b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.085+0000 7f92237fe640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9218009d50 tx=0x7f9218004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.086+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218040070 con 0x7f92241f53c0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.086+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92180093e0 con 0x7f92241f53c0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.086+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92240ca600 con 0x7f92241f53c0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.086+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218003830 con 0x7f92241f53c0 2024-09-15T22:44:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.086+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92240cbae0 con 0x7f92241f53c0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.087+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224162210 con 0x7f92241f53c0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.087+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f9218043070 con 0x7f92241f53c0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.087+0000 7f9220ff9640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 0x7f921006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.088+0000 7f9223fff640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 0x7f921006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.088+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5609+0+0 (secure 0 0 0) 0x7f92180abe10 con 0x7f92241f53c0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.088+0000 7f9223fff640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 0x7f921006e950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9214007d90 tx=0x7f9214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.092+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f921807a360 con 0x7f92241f53c0 2024-09-15T22:44:21.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.289+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f92240cf040 con 0x7f92241f53c0 2024-09-15T22:44:21.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:44:21.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:44:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.947+0000 7f9220ff9640 1 -- 172.21.15.134:0/2397107929 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) ==== 172+0+0 (secure 0 0 0) 0x7f9218079c60 con 0x7f92241f53c0 2024-09-15T22:44:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 8 and data pool 9 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.950+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 msgr2=0x7f921006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.950+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 0x7f921006e950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9214007d90 tx=0x7f9214009040 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.950+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 msgr2=0x7f92240c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.950+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9218009d50 tx=0x7f9218004730 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 shutdown_connections 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f921006c490 0x7f921006e950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92240b56e0 0x7f92240b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92241f53c0 0x7f92240c9a80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 --2- 172.21.15.134:0/2397107929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f920c004800 0x7f922414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 >> 172.21.15.134:0/2397107929 conn(0x7f92240d1870 msgr2=0x7f922415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:21.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 shutdown_connections 2024-09-15T22:44:21.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:21.951+0000 7f922aa0e640 1 -- 172.21.15.134:0/2397107929 wait complete. 2024-09-15T22:44:21.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:22.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.079+0000 7fcb2255f640 1 Processor -- start 2024-09-15T22:44:22.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.079+0000 7fcb2255f640 1 -- start start 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb2255f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb2255f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb1c0d0bc0 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb2255f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb1c15d390 con 0x7fcb1c15ca40 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb2255f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcb1c15d670 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb1bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb20afc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fcb1c15ceb0 0x7fcb1c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34990/0 (socket says 172.21.15.134:34990) 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb1bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41118/0 (socket says 172.21.15.134:41118) 2024-09-15T22:44:22.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.080+0000 7fcb20afc640 1 -- 172.21.15.134:0/2770017298 learned_addr learned my addr 172.21.15.134:0/2770017298 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:22.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1bfff640 1 -- 172.21.15.134:0/2770017298 >> v1:172.21.15.177:6789/0 conn(0x7fcb1c15ca40 legacy=0x7fcb1c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:22.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1bfff640 1 -- 172.21.15.134:0/2770017298 >> v1:172.21.15.134:6789/0 conn(0x7fcb1c15ceb0 legacy=0x7fcb1c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1affd640 1 -- 172.21.15.134:0/2770017298 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166010238 0 0) 0x7fcb1c0d0bc0 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1bfff640 1 -- 172.21.15.134:0/2770017298 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c15d950 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1bfff640 1 --2- 172.21.15.134:0/2770017298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0097a0 tx=0x7fcb0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92e41d2f3116f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.081+0000 7fcb1affd640 1 -- 172.21.15.134:0/2770017298 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c037070 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb1affd640 1 -- 172.21.15.134:0/2770017298 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0c032440 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb1affd640 1 -- 172.21.15.134:0/2770017298 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c032810 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 -- 172.21.15.134:0/2770017298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c0d02a0 msgr2=0x7fcb1c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 --2- 172.21.15.134:0/2770017298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0097a0 tx=0x7fcb0c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 -- 172.21.15.134:0/2770017298 shutdown_connections 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 --2- 172.21.15.134:0/2770017298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c0d0680 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 -- 172.21.15.134:0/2770017298 >> 172.21.15.134:0/2770017298 conn(0x7fcb1c062cc0 msgr2=0x7fcb1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 -- 172.21.15.134:0/2770017298 shutdown_connections 2024-09-15T22:44:22.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.082+0000 7fcb2255f640 1 -- 172.21.15.134:0/2770017298 wait complete. 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.083+0000 7fcb2255f640 1 Processor -- start 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.083+0000 7fcb2255f640 1 -- start start 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c1e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 0x7fcb1c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c15eb40 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c15df10 con 0x7fcb1c0d02a0 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb2255f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1c155b90 con 0x7fcb1c15ca40 2024-09-15T22:44:22.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb20afc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb20afc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41128/0 (socket says 172.21.15.134:41128) 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb20afc640 1 -- 172.21.15.134:0/1303577415 learned_addr learned my addr 172.21.15.134:0/1303577415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb1bfff640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c1e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.084+0000 7fcb1b7fe640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 0x7fcb1c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 -- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 msgr2=0x7fcb1c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 0x7fcb1c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 -- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c0d02a0 msgr2=0x7fcb1c1e5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c1e5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 -- 172.21.15.134:0/1303577415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c1e5a70 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb1b7fe640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 0x7fcb1c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb20afc640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c7b0 tx=0x7fcb1400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14018070 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1400a640 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400aa70 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c1e5d50 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.085+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1e6310 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.086+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c0b4790 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.087+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fcb1401b070 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.087+0000 7fcb18ff9640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 0x7fcb0806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.087+0000 7fcb1bfff640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 0x7fcb0806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.087+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fcb1408abe0 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.088+0000 7fcb1bfff640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 0x7fcb0806e950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c034000 tx=0x7fcb0c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.091+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb14058b10 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.257+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb1c1e3c80 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.258+0000 7fcb18ff9640 1 -- 172.21.15.134:0/1303577415 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16774 (secure 0 0 0) 0x7fcb1405ce10 con 0x7fcb1c15ceb0 2024-09-15T22:44:22.260 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:22.260 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":60,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:21.291186+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:19.893552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:20.258562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 msgr2=0x7fcb0806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 0x7fcb0806e950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c034000 tx=0x7fcb0c02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 msgr2=0x7fcb1c158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c7b0 tx=0x7fcb1400cc70 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 shutdown_connections 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fcb0806c490 0x7fcb0806e950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c15ceb0 0x7fcb1c158650 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcb1c15ca40 0x7fcb1c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 --2- 172.21.15.134:0/1303577415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c0d02a0 0x7fcb1c1e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 >> 172.21.15.134:0/1303577415 conn(0x7fcb1c062cc0 msgr2=0x7fcb1c15b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 shutdown_connections 2024-09-15T22:44:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.260+0000 7fcb2255f640 1 -- 172.21.15.134:0/1303577415 wait complete. 2024-09-15T22:44:22.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.369+0000 7f0d891d8640 1 Processor -- start 2024-09-15T22:44:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.369+0000 7f0d891d8640 1 -- start start 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d891d8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d8415c180 0x7f0d840cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d891d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84073120 0x7f0d84073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d891d8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d840ce740 con 0x7f0d840ce230 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d891d8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0d84072640 con 0x7f0d8415c180 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d891d8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0d84072920 con 0x7f0d84073120 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d8415c180 0x7f0d840cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d8415c180 0x7f0d840cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37642/0 (socket says 172.21.15.134:37642) 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 -- 172.21.15.134:0/1035046316 learned_addr learned my addr 172.21.15.134:0/1035046316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d8359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84073120 0x7f0d84073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 -- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84073120 msgr2=0x7f0d84073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 --2- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84073120 0x7f0d84073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 -- 172.21.15.134:0/1035046316 >> v1:172.21.15.177:6789/0 conn(0x7f0d840ce230 legacy=0x7f0d840cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d8259c640 1 -- 172.21.15.134:0/1035046316 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259269313 0 0) 0x7f0d840ce740 con 0x7f0d840ce230 2024-09-15T22:44:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.370+0000 7f0d82d9d640 1 -- 172.21.15.134:0/1035046316 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d84072c00 con 0x7f0d8415c180 2024-09-15T22:44:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.371+0000 7f0d82d9d640 1 --2- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d8415c180 0x7f0d840cdcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d7402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18cf3fb1398098e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.371+0000 7f0d8259c640 1 -- 172.21.15.134:0/1035046316 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74037070 con 0x7f0d8415c180 2024-09-15T22:44:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d8259c640 1 -- 172.21.15.134:0/1035046316 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d74032440 con 0x7f0d8415c180 2024-09-15T22:44:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d8259c640 1 -- 172.21.15.134:0/1035046316 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74032810 con 0x7f0d8415c180 2024-09-15T22:44:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 -- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d8415c180 msgr2=0x7f0d840cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 --2- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d8415c180 0x7f0d840cdcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d7402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 -- 172.21.15.134:0/1035046316 shutdown_connections 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 --2- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84073120 0x7f0d84073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 --2- 172.21.15.134:0/1035046316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d8415c180 0x7f0d840cdcf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 -- 172.21.15.134:0/1035046316 >> 172.21.15.134:0/1035046316 conn(0x7f0d84062cc0 msgr2=0x7f0d8406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 -- 172.21.15.134:0/1035046316 shutdown_connections 2024-09-15T22:44:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.372+0000 7f0d891d8640 1 -- 172.21.15.134:0/1035046316 wait complete. 2024-09-15T22:44:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.373+0000 7f0d891d8640 1 Processor -- start 2024-09-15T22:44:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.373+0000 7f0d891d8640 1 -- start start 2024-09-15T22:44:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840ce230 0x7f0d84152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d8415c180 0x7f0d840b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840cf780 con 0x7f0d84073120 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840722f0 con 0x7f0d840ce230 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d891d8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8415c560 con 0x7f0d8415c180 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d82d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d82d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41144/0 (socket says 172.21.15.134:41144) 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d82d9d640 1 -- 172.21.15.134:0/3098795380 learned_addr learned my addr 172.21.15.134:0/3098795380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d8359e640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d8415c180 0x7f0d840b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.374+0000 7f0d7bfff640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840ce230 0x7f0d84152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 -- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d8415c180 msgr2=0x7f0d840b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d8415c180 0x7f0d840b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 -- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840ce230 msgr2=0x7f0d84152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840ce230 0x7f0d84152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 -- 172.21.15.134:0/3098795380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d841531c0 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d82d9d640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0d74035040 tx=0x7f0d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74037040 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d74004230 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d840cb0e0 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74003610 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.375+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d840cb6a0 con 0x7f0d84073120 2024-09-15T22:44:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.376+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d840cdcf0 con 0x7f0d84073120 2024-09-15T22:44:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.377+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f0d7402ad10 con 0x7f0d84073120 2024-09-15T22:44:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.377+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 0x7f0d6406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.377+0000 7f0d7bfff640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 0x7f0d6406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.377+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0d740ac090 con 0x7f0d84073120 2024-09-15T22:44:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.378+0000 7f0d7bfff640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 0x7f0d6406e920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d840cca50 tx=0x7f0d6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.382+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d74079fd0 con 0x7f0d84073120 2024-09-15T22:44:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.546+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d8406f150 con 0x7f0d84073120 2024-09-15T22:44:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.547+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/3098795380 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16774 (secure 0 0 0) 0x7f0d7407e2d0 con 0x7f0d84073120 2024-09-15T22:44:22.549 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:22.549 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":60,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:21.291186+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:19.893552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:20.258562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 msgr2=0x7f0d6406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 0x7f0d6406e920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d840cca50 tx=0x7f0d6c009040 comp rx=0 tx=0).stop 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 msgr2=0x7f0d840b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0d74035040 tx=0x7f0d740046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 shutdown_connections 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0d6406c460 0x7f0d6406e920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d8415c180 0x7f0d840b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840ce230 0x7f0d84152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 --2- 172.21.15.134:0/3098795380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d84073120 0x7f0d840b4530 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 >> 172.21.15.134:0/3098795380 conn(0x7f0d84062cc0 msgr2=0x7f0d8406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 shutdown_connections 2024-09-15T22:44:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.549+0000 7f0d891d8640 1 -- 172.21.15.134:0/3098795380 wait complete. 2024-09-15T22:44:22.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:44:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.662+0000 7f74a9d98640 1 Processor -- start 2024-09-15T22:44:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.662+0000 7f74a9d98640 1 -- start start 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.663+0000 7f74a9d98640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 0x7f74a40714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.663+0000 7f74a9d98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.663+0000 7f74a9d98640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a415ee60 con 0x7f74a4070c40 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.663+0000 7f74a9d98640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f74a4162670 con 0x7f74a40d1230 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.663+0000 7f74a9d98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f74a4162950 con 0x7f74a40b7570 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 0x7f74a40714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:34136/0 (socket says 172.21.15.134:34136) 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 -- 172.21.15.134:0/2081325964 learned_addr learned my addr 172.21.15.134:0/2081325964 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 -- 172.21.15.134:0/2081325964 >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 msgr2=0x7f74a40714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 --2- 172.21.15.134:0/2081325964 >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 0x7f74a40714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 -- 172.21.15.134:0/2081325964 >> v1:172.21.15.177:6789/0 conn(0x7f74a4070c40 legacy=0x7f74a40b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a3fff640 1 -- 172.21.15.134:0/2081325964 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a4162c30 con 0x7f74a40b7570 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a27fc640 1 -- 172.21.15.134:0/2081325964 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759953006 0 0) 0x7f74a415ee60 con 0x7f74a4070c40 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.664+0000 7f74a37fe640 1 --2- 172.21.15.134:0/2081325964 >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 0x7f74a40714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:22.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a3fff640 1 --2- 172.21.15.134:0/2081325964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f749c009e50 tx=0x7f749c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40392f69d3cbf978 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a27fc640 1 -- 172.21.15.134:0/2081325964 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c036070 con 0x7f74a40b7570 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a27fc640 1 -- 172.21.15.134:0/2081325964 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c031600 con 0x7f74a40b7570 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a27fc640 1 -- 172.21.15.134:0/2081325964 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0319d0 con 0x7f74a40b7570 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 -- 172.21.15.134:0/2081325964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 msgr2=0x7f74a406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 --2- 172.21.15.134:0/2081325964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f749c009e50 tx=0x7f749c02a680 comp rx=0 tx=0).stop 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 -- 172.21.15.134:0/2081325964 shutdown_connections 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 --2- 172.21.15.134:0/2081325964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40b7570 0x7f74a406ccb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 --2- 172.21.15.134:0/2081325964 >> v2:172.21.15.177:3300/0 conn(0x7f74a40d1230 0x7f74a40714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.665+0000 7f74a9d98640 1 -- 172.21.15.134:0/2081325964 >> 172.21.15.134:0/2081325964 conn(0x7f74a406f370 msgr2=0x7f74a406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.666+0000 7f74a9d98640 1 -- 172.21.15.134:0/2081325964 shutdown_connections 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.666+0000 7f74a9d98640 1 -- 172.21.15.134:0/2081325964 wait complete. 2024-09-15T22:44:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.667+0000 7f74a9d98640 1 Processor -- start 2024-09-15T22:44:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.667+0000 7f74a9d98640 1 -- start start 2024-09-15T22:44:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.667+0000 7f74a9d98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4070c40 0x7f74a40cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40d1230 0x7f74a41f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74a4071a30 con 0x7f74a40b7570 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74a40d1610 con 0x7f74a4070c40 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f74a415a820 con 0x7f74a40d1230 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41156/0 (socket says 172.21.15.134:41156) 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 -- 172.21.15.134:0/569360855 learned_addr learned my addr 172.21.15.134:0/569360855 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a37fe640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4070c40 0x7f74a40cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a3fff640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40d1230 0x7f74a41f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 -- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40d1230 msgr2=0x7f74a41f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40d1230 0x7f74a41f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 -- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4070c40 msgr2=0x7f74a40cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4070c40 0x7f74a40cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 -- 172.21.15.134:0/569360855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a40cc9b0 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a2ffd640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f749800c550 tx=0x7f749800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498017070 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74980035f0 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a40ccc90 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74980039e0 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.668+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a40cd250 con 0x7f74a40b7570 2024-09-15T22:44:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.669+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a4071bb0 con 0x7f74a40b7570 2024-09-15T22:44:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.670+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f749801a070 con 0x7f74a40b7570 2024-09-15T22:44:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.670+0000 7f748bfff640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 0x7f749006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.670+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f749808aac0 con 0x7f74a40b7570 2024-09-15T22:44:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.670+0000 7f74a37fe640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 0x7f749006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.671+0000 7f74a37fe640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 0x7f749006e920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74a406fc10 tx=0x7f7494009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.675+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7498058a20 con 0x7f74a40b7570 2024-09-15T22:44:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:22.876+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f74a406f960 con 0x7f74a40b7570 2024-09-15T22:44:23.215 INFO:tasks.ceph.mds.c.smithi134.stderr:2024-09-15T22:44:23.214+0000 7f00576e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:44:23.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.725+0000 7f748bfff640 1 -- 172.21.15.134:0/569360855 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f749805cd20 con 0x7f74a40b7570 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 msgr2=0x7f749006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 0x7f749006e920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74a406fc10 tx=0x7f7494009190 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 msgr2=0x7f74a41f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f749800c550 tx=0x7f749800ca10 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 shutdown_connections 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f749006c460 0x7f749006e920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40d1230 0x7f74a41f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a40b7570 0x7f74a41f42a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 --2- 172.21.15.134:0/569360855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4070c40 0x7f74a40cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 >> 172.21.15.134:0/569360855 conn(0x7f74a406f370 msgr2=0x7f74a406cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:23.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 shutdown_connections 2024-09-15T22:44:23.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.728+0000 7f74a9d98640 1 -- 172.21.15.134:0/569360855 wait complete. 2024-09-15T22:44:23.744 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:44:23.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:44:23.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.850+0000 7fd44a7e4640 1 Processor -- start 2024-09-15T22:44:23.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 -- start start 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd444158e50 0x7fd4440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd44415c370 0x7fd44406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44406ef60 0x7fd44415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd44415c800 con 0x7fd44415c370 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440b43f0 con 0x7fd444158e50 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.851+0000 7fd44a7e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b3630 con 0x7fd44406ef60 2024-09-15T22:44:23.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd44415c370 0x7fd44406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd44415c370 0x7fd44406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41170/0 (socket says 172.21.15.134:41170) 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 -- 172.21.15.134:0/531945264 learned_addr learned my addr 172.21.15.134:0/531945264 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd443fff640 1 --2- 172.21.15.134:0/531945264 >> v2:172.21.15.177:3300/0 conn(0x7fd444158e50 0x7fd4440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd448d81640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44406ef60 0x7fd44415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 -- 172.21.15.134:0/531945264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44406ef60 msgr2=0x7fd44415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44406ef60 0x7fd44415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 -- 172.21.15.134:0/531945264 >> v2:172.21.15.177:3300/0 conn(0x7fd444158e50 msgr2=0x7fd4440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 --2- 172.21.15.134:0/531945264 >> v2:172.21.15.177:3300/0 conn(0x7fd444158e50 0x7fd4440b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.852+0000 7fd4437fe640 1 -- 172.21.15.134:0/531945264 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440b3910 con 0x7fd44415c370 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd4437fe640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd44415c370 0x7fd44406ea20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd444069580 tx=0x7fd43802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762f8219f950aafd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd442ffd640 1 -- 172.21.15.134:0/531945264 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438004230 con 0x7fd44415c370 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd442ffd640 1 -- 172.21.15.134:0/531945264 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4380043d0 con 0x7fd44415c370 2024-09-15T22:44:23.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd442ffd640 1 -- 172.21.15.134:0/531945264 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438003810 con 0x7fd44415c370 2024-09-15T22:44:23.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 -- 172.21.15.134:0/531945264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd44415c370 msgr2=0x7fd44406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd44415c370 0x7fd44406ea20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd444069580 tx=0x7fd43802c870 comp rx=0 tx=0).stop 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 -- 172.21.15.134:0/531945264 shutdown_connections 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44406ef60 0x7fd44415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/531945264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd44415c370 0x7fd44406ea20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/531945264 >> v2:172.21.15.177:3300/0 conn(0x7fd444158e50 0x7fd4440b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.853+0000 7fd44a7e4640 1 -- 172.21.15.134:0/531945264 >> 172.21.15.134:0/531945264 conn(0x7fd44406bba0 msgr2=0x7fd44406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.854+0000 7fd44a7e4640 1 -- 172.21.15.134:0/531945264 shutdown_connections 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.854+0000 7fd44a7e4640 1 -- 172.21.15.134:0/531945264 wait complete. 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.855+0000 7fd44a7e4640 1 Processor -- start 2024-09-15T22:44:23.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.855+0000 7fd44a7e4640 1 -- start start 2024-09-15T22:44:23.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 0x7fd44415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44415c370 0x7fd4440aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd444159230 con 0x7fd444158e50 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b3ed0 con 0x7fd44406ef60 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd44415f390 con 0x7fd44415c370 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41176/0 (socket says 172.21.15.134:41176) 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 -- 172.21.15.134:0/2182632586 learned_addr learned my addr 172.21.15.134:0/2182632586 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd443fff640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 0x7fd44415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd448d81640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44415c370 0x7fd4440aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 -- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44415c370 msgr2=0x7fd4440aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44415c370 0x7fd4440aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 -- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 msgr2=0x7fd44415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 0x7fd44415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 -- 172.21.15.134:0/2182632586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44415cf50 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd443fff640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 0x7fd44415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd4437fe640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd43800bbe0 tx=0x7fd4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438003e50 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd438005e10 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438006260 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.856+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44415d230 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.857+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44415d7f0 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.857+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44415ee50 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.858+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fd438032070 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.858+0000 7fd440ff9640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 0x7fd43006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.858+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fd4380ae7c0 con 0x7fd444158e50 2024-09-15T22:44:23.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.858+0000 7fd443fff640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 0x7fd43006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.859+0000 7fd443fff640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 0x7fd43006eaf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ac0 tx=0x7fd434008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:23.863+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd438041030 con 0x7fd444158e50 2024-09-15T22:44:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.067+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd4440b1700 con 0x7fd444158e50 2024-09-15T22:44:24.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.969+0000 7fd440ff9640 1 -- 172.21.15.134:0/2182632586 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7fd43807cc30 con 0x7fd444158e50 2024-09-15T22:44:24.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 msgr2=0x7fd43006eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 0x7fd43006eaf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ac0 tx=0x7fd434008040 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 msgr2=0x7fd444145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd43800bbe0 tx=0x7fd4380046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 shutdown_connections 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd43006c630 0x7fd43006eaf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44415c370 0x7fd4440aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444158e50 0x7fd444145510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 --2- 172.21.15.134:0/2182632586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44406ef60 0x7fd44415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 >> 172.21.15.134:0/2182632586 conn(0x7fd44406bba0 msgr2=0x7fd444071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 shutdown_connections 2024-09-15T22:44:24.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:24.972+0000 7fd44a7e4640 1 -- 172.21.15.134:0/2182632586 wait complete. 2024-09-15T22:44:24.987 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:44:24.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:25.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.089+0000 7f06e4786640 1 Processor -- start 2024-09-15T22:44:25.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.089+0000 7f06e4786640 1 -- start start 2024-09-15T22:44:25.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.090+0000 7f06e4786640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f06dc0d02a0 0x7f06dc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.090+0000 7f06e4786640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06dc0d0bc0 con 0x7f06dc15ceb0 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.090+0000 7f06e4786640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06dc15d390 con 0x7f06dc15ca40 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.090+0000 7f06e4786640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f06dc15d670 con 0x7f06dc0d02a0 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.090+0000 7f06e2d23640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f06dc15ceb0 0x7f06dc1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35002/0 (socket says 172.21.15.134:35002) 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2d23640 1 -- 172.21.15.134:0/3144255723 learned_addr learned my addr 172.21.15.134:0/3144255723 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2522640 1 --2- 172.21.15.134:0/3144255723 >> v2:172.21.15.177:3300/0 conn(0x7f06dc0d02a0 0x7f06dc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583575058 0 0) 0x7f06dc0d0bc0 con 0x7f06dc15ceb0 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c4003520 con 0x7f06dc15ceb0 2024-09-15T22:44:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2987542564 0 0) 0x7f06c4003520 con 0x7f06dc15ceb0 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 >> v2:172.21.15.177:3300/0 conn(0x7f06dc0d02a0 msgr2=0x7f06dc0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 --2- 172.21.15.134:0/3144255723 >> v2:172.21.15.177:3300/0 conn(0x7f06dc0d02a0 0x7f06dc0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 >> v1:172.21.15.177:6789/0 conn(0x7f06dc15ca40 legacy=0x7f06dc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc15d950 con 0x7f06dc15ceb0 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f06cc001670 con 0x7f06dc15ceb0 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 >> v1:172.21.15.134:6789/0 conn(0x7f06dc15ceb0 legacy=0x7f06dc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c40039b0 0x7f06c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06c40051c0 0x7f06c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc15d670 con 0x7f06c4004800 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f06c400c160 con 0x7f06c40039b0 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f06c400c360 con 0x7f06c40051c0 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2522640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c40039b0 0x7f06c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2d23640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06c40051c0 0x7f06c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 -- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06c40051c0 msgr2=0x7f06c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06c40051c0 0x7f06c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 -- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c40039b0 msgr2=0x7f06c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c40039b0 0x7f06c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e1d21640 1 -- 172.21.15.134:0/3144255723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c4003520 con 0x7f06c4004800 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2d23640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06c40051c0 0x7f06c400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.091+0000 7f06e2d23640 1 -- 172.21.15.134:0/3144255723 reap_dead start 2024-09-15T22:44:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.092+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001e50 tx=0x7f06c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b657412b5bc246 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.092+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0001a70 con 0x7f06c4004800 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.092+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d002ae40 con 0x7f06c4004800 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.092+0000 7f06e1520640 1 -- 172.21.15.134:0/3144255723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0003bb0 con 0x7f06c4004800 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 -- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 msgr2=0x7f06c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001e50 tx=0x7f06c4005830 comp rx=0 tx=0).stop 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 -- 172.21.15.134:0/3144255723 shutdown_connections 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 --2- 172.21.15.134:0/3144255723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 -- 172.21.15.134:0/3144255723 >> 172.21.15.134:0/3144255723 conn(0x7f06dc062cc0 msgr2=0x7f06dc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 -- 172.21.15.134:0/3144255723 shutdown_connections 2024-09-15T22:44:25.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.093+0000 7f06e4786640 1 -- 172.21.15.134:0/3144255723 wait complete. 2024-09-15T22:44:25.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.094+0000 7f06e4786640 1 Processor -- start 2024-09-15T22:44:25.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.094+0000 7f06e4786640 1 -- start start 2024-09-15T22:44:25.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c4004800 0x7f06dc148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06dc158910 0x7f06dc154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc155b90 con 0x7f06dc157360 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc15df10 con 0x7f06c4004800 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e4786640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f06dc155d10 con 0x7f06dc158910 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41194/0 (socket says 172.21.15.134:41194) 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 -- 172.21.15.134:0/3287243684 learned_addr learned my addr 172.21.15.134:0/3287243684 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 -- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06dc158910 msgr2=0x7f06dc154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06dc158910 0x7f06dc154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 -- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c4004800 msgr2=0x7f06dc148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c4004800 0x7f06dc148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 -- 172.21.15.134:0/3287243684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc148b40 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.095+0000 7f06e1d21640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f80 tx=0x7f06d00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.096+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0040030 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.096+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d002ac40 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.096+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc157870 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.096+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0037040 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.096+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc157e30 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.097+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc0b4790 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.097+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f06d0043070 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.097+0000 7f06daffd640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 0x7f06c806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.098+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f06d00ab630 con 0x7f06dc157360 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.098+0000 7f06e2522640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 0x7f06c806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.098+0000 7f06e2522640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 0x7f06c806e950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006e80 tx=0x7f06d4006df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.102+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06dc148b40 con 0x7f06dc157360 2024-09-15T22:44:25.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.299+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06dc0b1120 con 0x7f06dc157360 2024-09-15T22:44:25.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.300+0000 7f06daffd640 1 -- 172.21.15.134:0/3287243684 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5235 (secure 0 0 0) 0x7f06d0079b20 con 0x7f06dc157360 2024-09-15T22:44:25.302 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:25.302 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":29,"btime":"2024-09-15T22:44:24:969038+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:25.302 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 29 2024-09-15T22:44:25.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 msgr2=0x7f06c806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 0x7f06c806e950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006e80 tx=0x7f06d4006df0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 msgr2=0x7f06dc145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f80 tx=0x7f06d00014a0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 shutdown_connections 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f06c806c490 0x7f06c806e950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06dc158910 0x7f06dc154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06dc157360 0x7f06dc145220 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 --2- 172.21.15.134:0/3287243684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06c4004800 0x7f06dc148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 >> 172.21.15.134:0/3287243684 conn(0x7f06dc062cc0 msgr2=0x7f06dc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 shutdown_connections 2024-09-15T22:44:25.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.302+0000 7f06e4786640 1 -- 172.21.15.134:0/3287243684 wait complete. 2024-09-15T22:44:25.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.411+0000 7f0344f11640 1 Processor -- start 2024-09-15T22:44:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.411+0000 7f0344f11640 1 -- start start 2024-09-15T22:44:25.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f0344f11640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f034015c180 0x7f03400cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f0344f11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 0x7f0340073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f0344f11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03400ce740 con 0x7f03400ce230 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f0344f11640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0340072640 con 0x7f034015c180 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f0344f11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0340072920 con 0x7f0340073120 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033dd9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f03400ce230 0x7f03400cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35004/0 (socket says 172.21.15.134:35004) 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033dd9b640 1 -- 172.21.15.134:0/3992869777 learned_addr learned my addr 172.21.15.134:0/3992869777 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033e59c640 1 --2- 172.21.15.134:0/3992869777 >> v2:172.21.15.177:3300/0 conn(0x7f034015c180 0x7f03400cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033ed9d640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 0x7f0340073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899714249 0 0) 0x7f03400ce740 con 0x7f03400ce230 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0328003520 con 0x7f03400ce230 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1160635801 0 0) 0x7f0328003520 con 0x7f03400ce230 2024-09-15T22:44:25.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033e59c640 1 -- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 msgr2=0x7f0340073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033e59c640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 0x7f0340073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033e59c640 1 -- 172.21.15.134:0/3992869777 >> v1:172.21.15.134:6789/0 conn(0x7f03400ce230 legacy=0x7f03400cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033e59c640 1 -- 172.21.15.134:0/3992869777 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0340072c00 con 0x7f034015c180 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.412+0000 7f033ed9d640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 0x7f0340073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.413+0000 7f033e59c640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f03400cdcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03300097a0 tx=0x7f033002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=243ac8f68dd4e337 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.413+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037070 con 0x7f034015c180 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.413+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033002ab10 con 0x7f034015c180 2024-09-15T22:44:25.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.413+0000 7f033d59a640 1 -- 172.21.15.134:0/3992869777 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0334001690 con 0x7f034015c180 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 -- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 msgr2=0x7f03400cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f03400cdcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03300097a0 tx=0x7f033002a080 comp rx=0 tx=0).stop 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 -- 172.21.15.134:0/3992869777 shutdown_connections 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0340073120 0x7f0340073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 --2- 172.21.15.134:0/3992869777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f03400cdcf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 -- 172.21.15.134:0/3992869777 >> 172.21.15.134:0/3992869777 conn(0x7f0340062cc0 msgr2=0x7f034006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 -- 172.21.15.134:0/3992869777 shutdown_connections 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.414+0000 7f0344f11640 1 -- 172.21.15.134:0/3992869777 wait complete. 2024-09-15T22:44:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.415+0000 7f0344f11640 1 Processor -- start 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.415+0000 7f0344f11640 1 -- start start 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03400ce230 0x7f03401521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f0340157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03400cf780 con 0x7f0340073120 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03400722f0 con 0x7f034015c180 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f0344f11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f034015c560 con 0x7f03400ce230 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41196/0 (socket says 172.21.15.134:41196) 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 -- 172.21.15.134:0/666738246 learned_addr learned my addr 172.21.15.134:0/666738246 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 -- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03400ce230 msgr2=0x7f03401521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033dd9b640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03400ce230 0x7f03401521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03400ce230 0x7f03401521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033e59c640 1 -- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 msgr2=0x7f0340157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.416+0000 7f033ed9d640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f0340157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f033e59c640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f0340157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f033e59c640 1 -- 172.21.15.134:0/666738246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03401570c0 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f033ed9d640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f0340157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f033e59c640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f03300098c0 tx=0x7f03300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037050 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330043070 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03401e6d80 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330006e10 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.417+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03401e7340 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.418+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03400cdcf0 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.418+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f033003ca10 con 0x7f0340073120 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.419+0000 7f032effd640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 0x7f032006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.419+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f03300ac190 con 0x7f0340073120 2024-09-15T22:44:25.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.419+0000 7f033dd9b640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 0x7f032006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.419+0000 7f033dd9b640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 0x7f032006e950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0334001eb0 tx=0x7f0334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.423+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0330030e20 con 0x7f0340073120 2024-09-15T22:44:25.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.588+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f034015f6e0 con 0x7f0340073120 2024-09-15T22:44:25.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.589+0000 7f032effd640 1 -- 172.21.15.134:0/666738246 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7f033007a830 con 0x7f0340073120 2024-09-15T22:44:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:25.597 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":61,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:22.956255+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:19.893552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:20.258562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 msgr2=0x7f032006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 0x7f032006e950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0334001eb0 tx=0x7f0334009040 comp rx=0 tx=0).stop 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 msgr2=0x7f03401e6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f03300098c0 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 shutdown_connections 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f032006c490 0x7f032006e950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f034015c180 0x7f0340157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03400ce230 0x7f03401521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 --2- 172.21.15.134:0/666738246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0340073120 0x7f03401e6680 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 >> 172.21.15.134:0/666738246 conn(0x7f0340062cc0 msgr2=0x7f03400cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.591+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 shutdown_connections 2024-09-15T22:44:25.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.592+0000 7f0344f11640 1 -- 172.21.15.134:0/666738246 wait complete. 2024-09-15T22:44:25.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:44:25.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:44:25.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.707+0000 7fa66c427640 1 Processor -- start 2024-09-15T22:44:25.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.707+0000 7fa66c427640 1 -- start start 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa66415c180 0x7fa6640cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa6640cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6640cf5b0 0x7fa664073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa6640ce740 con 0x7fa6640cf5b0 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa664072640 con 0x7fa66415c180 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66c427640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa664072920 con 0x7fa6640ce230 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6640cf5b0 0x7fa664073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6640cf5b0 0x7fa664073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41208/0 (socket says 172.21.15.134:41208) 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 -- 172.21.15.134:0/1028570774 learned_addr learned my addr 172.21.15.134:0/1028570774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a1c3640 1 --2- 172.21.15.134:0/1028570774 >> v2:172.21.15.177:3300/0 conn(0x7fa66415c180 0x7fa6640cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa6699c2640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa6640cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 -- 172.21.15.134:0/1028570774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 msgr2=0x7fa6640cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa6640cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 -- 172.21.15.134:0/1028570774 >> v2:172.21.15.177:3300/0 conn(0x7fa66415c180 msgr2=0x7fa6640cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:25.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 --2- 172.21.15.134:0/1028570774 >> v2:172.21.15.177:3300/0 conn(0x7fa66415c180 0x7fa6640cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.708+0000 7fa66a9c4640 1 -- 172.21.15.134:0/1028570774 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa664072c00 con 0x7fa6640cf5b0 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.709+0000 7fa66a9c4640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa664073120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa66406cc10 tx=0x7fa65c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44647b61302f99ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.709+0000 7fa6691c1640 1 -- 172.21.15.134:0/1028570774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c036070 con 0x7fa6640cf5b0 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.709+0000 7fa6691c1640 1 -- 172.21.15.134:0/1028570774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c031600 con 0x7fa6640cf5b0 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.709+0000 7fa6691c1640 1 -- 172.21.15.134:0/1028570774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0319d0 con 0x7fa6640cf5b0 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 -- 172.21.15.134:0/1028570774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 msgr2=0x7fa664073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa664073120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa66406cc10 tx=0x7fa65c02a610 comp rx=0 tx=0).stop 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 -- 172.21.15.134:0/1028570774 shutdown_connections 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa664073120 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 --2- 172.21.15.134:0/1028570774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa6640cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 --2- 172.21.15.134:0/1028570774 >> v2:172.21.15.177:3300/0 conn(0x7fa66415c180 0x7fa6640cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 -- 172.21.15.134:0/1028570774 >> 172.21.15.134:0/1028570774 conn(0x7fa664062cc0 msgr2=0x7fa66406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 -- 172.21.15.134:0/1028570774 shutdown_connections 2024-09-15T22:44:25.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.710+0000 7fa66c427640 1 -- 172.21.15.134:0/1028570774 wait complete. 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.711+0000 7fa66c427640 1 Processor -- start 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.711+0000 7fa66c427640 1 -- start start 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa664149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 0x7fa664156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa66415c560 con 0x7fa6640cf5b0 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6640722f0 con 0x7fa66415c180 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66c427640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa66415c6e0 con 0x7fa6640ce230 2024-09-15T22:44:25.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41210/0 (socket says 172.21.15.134:41210) 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 -- 172.21.15.134:0/2718275185 learned_addr learned my addr 172.21.15.134:0/2718275185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66a1c3640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa664149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66a9c4640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 0x7fa664156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 -- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 msgr2=0x7fa664149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa664149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 -- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 msgr2=0x7fa664156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 0x7fa664156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 -- 172.21.15.134:0/2718275185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa664154060 con 0x7fa6640cf5b0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa66a9c4640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 0x7fa664156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.712+0000 7fa6699c2640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa65400d5d0 tx=0x7fa65400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.713+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654004240 con 0x7fa6640cf5b0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.713+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540043e0 con 0x7fa6640cf5b0 2024-09-15T22:44:25.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.713+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654003830 con 0x7fa6640cf5b0 2024-09-15T22:44:25.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.713+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66415adf0 con 0x7fa6640cf5b0 2024-09-15T22:44:25.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.713+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6641607e0 con 0x7fa6640cf5b0 2024-09-15T22:44:25.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.714+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66415e410 con 0x7fa6640cf5b0 2024-09-15T22:44:25.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.714+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fa6540039d0 con 0x7fa6640cf5b0 2024-09-15T22:44:25.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.715+0000 7fa65affd640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 0x7fa64806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.715+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fa65408b950 con 0x7fa6640cf5b0 2024-09-15T22:44:25.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.715+0000 7fa66a1c3640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 0x7fa64806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.715+0000 7fa66a1c3640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 0x7fa64806e920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.719+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa664154060 con 0x7fa6640cf5b0 2024-09-15T22:44:25.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.881+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6640cf070 con 0x7fa64806c460 2024-09-15T22:44:25.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.887+0000 7fa65affd640 1 -- 172.21.15.134:0/2718275185 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247544 (secure 0 0 0) 0x7fa6640cf070 con 0x7fa64806c460 2024-09-15T22:44:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:25.894 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:44:25.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 msgr2=0x7fa64806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 0x7fa64806e920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660008040 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 msgr2=0x7fa6640aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa65400d5d0 tx=0x7fa65400da90 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 shutdown_connections 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa64806c460 0x7fa64806e920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa66415c180 0x7fa664156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640cf5b0 0x7fa6640aa4d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 --2- 172.21.15.134:0/2718275185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6640ce230 0x7fa664149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 >> 172.21.15.134:0/2718275185 conn(0x7fa664062cc0 msgr2=0x7fa6640b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 shutdown_connections 2024-09-15T22:44:25.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:25.891+0000 7fa66c427640 1 -- 172.21.15.134:0/2718275185 wait complete. 2024-09-15T22:44:25.904 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-15T22:44:24.987135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227020,"kb_used_data":6576,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747700,"statfs":{"total":773094113280,"available":772861644800,"internally_reserved":0,"allocated":6733824,"data_stored":3440764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044199"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971718+0000","last_change":"2024-09-15T22:44:21.964019+0000","last_active":"2024-09-15T22:44:22.971718+0000","last_peered":"2024-09-15T22:44:22.971718+0000","last_clean":"2024-09-15T22:44:22.971718+0000","last_became_active":"2024-09-15T22:44:21.963745+0000","last_became_peered":"2024-09-15T22:44:21.963745+0000","last_unstale":"2024-09-15T22:44:22.971718+0000","last_undegraded":"2024-09-15T22:44:22.971718+0000","last_fullsized":"2024-09-15T22:44:22.971718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:08.177048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955211+0000","last_change":"2024-09-15T22:44:20.955211+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955211+0000","last_undegraded":"2024-09-15T22:44:20.955211+0000","last_fullsized":"2024-09-15T22:44:20.955211+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955662+0000","last_change":"2024-09-15T22:44:20.955662+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955662+0000","last_undegraded":"2024-09-15T22:44:20.955662+0000","last_fullsized":"2024-09-15T22:44:20.955662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953143+0000","last_change":"2024-09-15T22:44:20.953143+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953143+0000","last_undegraded":"2024-09-15T22:44:20.953143+0000","last_fullsized":"2024-09-15T22:44:20.953143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971364+0000","last_change":"2024-09-15T22:44:21.969484+0000","last_active":"2024-09-15T22:44:22.971364+0000","last_peered":"2024-09-15T22:44:22.971364+0000","last_clean":"2024-09-15T22:44:22.971364+0000","last_became_active":"2024-09-15T22:44:21.969069+0000","last_became_peered":"2024-09-15T22:44:21.969069+0000","last_unstale":"2024-09-15T22:44:22.971364+0000","last_undegraded":"2024-09-15T22:44:22.971364+0000","last_fullsized":"2024-09-15T22:44:22.971364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:55.828144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971290+0000","last_change":"2024-09-15T22:44:21.976008+0000","last_active":"2024-09-15T22:44:22.971290+0000","last_peered":"2024-09-15T22:44:22.971290+0000","last_clean":"2024-09-15T22:44:22.971290+0000","last_became_active":"2024-09-15T22:44:21.975743+0000","last_became_peered":"2024-09-15T22:44:21.975743+0000","last_unstale":"2024-09-15T22:44:22.971290+0000","last_undegraded":"2024-09-15T22:44:22.971290+0000","last_fullsized":"2024-09-15T22:44:22.971290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:25.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953874+0000","last_change":"2024-09-15T22:44:20.953874+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953874+0000","last_undegraded":"2024-09-15T22:44:20.953874+0000","last_fullsized":"2024-09-15T22:44:20.953874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954377+0000","last_change":"2024-09-15T22:44:20.954377+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954377+0000","last_undegraded":"2024-09-15T22:44:20.954377+0000","last_fullsized":"2024-09-15T22:44:20.954377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952054+0000","last_change":"2024-09-15T22:44:20.952054+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952054+0000","last_undegraded":"2024-09-15T22:44:20.952054+0000","last_fullsized":"2024-09-15T22:44:20.952054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971583+0000","last_change":"2024-09-15T22:44:21.964323+0000","last_active":"2024-09-15T22:44:22.971583+0000","last_peered":"2024-09-15T22:44:22.971583+0000","last_clean":"2024-09-15T22:44:22.971583+0000","last_became_active":"2024-09-15T22:44:21.964031+0000","last_became_peered":"2024-09-15T22:44:21.964031+0000","last_unstale":"2024-09-15T22:44:22.971583+0000","last_undegraded":"2024-09-15T22:44:22.971583+0000","last_fullsized":"2024-09-15T22:44:22.971583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:46.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950446+0000","last_change":"2024-09-15T22:44:20.950446+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950446+0000","last_undegraded":"2024-09-15T22:44:20.950446+0000","last_fullsized":"2024-09-15T22:44:20.950446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951705+0000","last_change":"2024-09-15T22:44:20.951705+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951705+0000","last_undegraded":"2024-09-15T22:44:20.951705+0000","last_fullsized":"2024-09-15T22:44:20.951705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952497+0000","last_change":"2024-09-15T22:44:20.952497+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952497+0000","last_undegraded":"2024-09-15T22:44:20.952497+0000","last_fullsized":"2024-09-15T22:44:20.952497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954831+0000","last_change":"2024-09-15T22:44:20.954831+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954831+0000","last_undegraded":"2024-09-15T22:44:20.954831+0000","last_fullsized":"2024-09-15T22:44:20.954831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952498+0000","last_change":"2024-09-15T22:44:20.952498+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952498+0000","last_undegraded":"2024-09-15T22:44:20.952498+0000","last_fullsized":"2024-09-15T22:44:20.952498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970162+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.969875+0000","last_became_peered":"2024-09-15T22:44:21.969875+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.172394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971765+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:22.971765+0000","last_peered":"2024-09-15T22:44:22.971765+0000","last_clean":"2024-09-15T22:44:22.971765+0000","last_became_active":"2024-09-15T22:44:21.961717+0000","last_became_peered":"2024-09-15T22:44:21.961717+0000","last_unstale":"2024-09-15T22:44:22.971765+0000","last_undegraded":"2024-09-15T22:44:22.971765+0000","last_fullsized":"2024-09-15T22:44:22.971765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:35.936792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956339+0000","last_change":"2024-09-15T22:44:20.956339+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956339+0000","last_undegraded":"2024-09-15T22:44:20.956339+0000","last_fullsized":"2024-09-15T22:44:20.956339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954600+0000","last_change":"2024-09-15T22:44:20.954600+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954600+0000","last_undegraded":"2024-09-15T22:44:20.954600+0000","last_fullsized":"2024-09-15T22:44:20.954600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950521+0000","last_change":"2024-09-15T22:44:20.950521+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950521+0000","last_undegraded":"2024-09-15T22:44:20.950521+0000","last_fullsized":"2024-09-15T22:44:20.950521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952010+0000","last_change":"2024-09-15T22:44:20.952010+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952010+0000","last_undegraded":"2024-09-15T22:44:20.952010+0000","last_fullsized":"2024-09-15T22:44:20.952010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949379+0000","last_change":"2024-09-15T22:44:20.949379+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949379+0000","last_undegraded":"2024-09-15T22:44:20.949379+0000","last_fullsized":"2024-09-15T22:44:20.949379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953465+0000","last_change":"2024-09-15T22:44:20.953465+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953465+0000","last_undegraded":"2024-09-15T22:44:20.953465+0000","last_fullsized":"2024-09-15T22:44:20.953465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952976+0000","last_change":"2024-09-15T22:44:20.952976+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952976+0000","last_undegraded":"2024-09-15T22:44:20.952976+0000","last_fullsized":"2024-09-15T22:44:20.952976+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955140+0000","last_change":"2024-09-15T22:44:20.955140+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955140+0000","last_undegraded":"2024-09-15T22:44:20.955140+0000","last_fullsized":"2024-09-15T22:44:20.955140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951412+0000","last_change":"2024-09-15T22:44:20.951412+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951412+0000","last_undegraded":"2024-09-15T22:44:20.951412+0000","last_fullsized":"2024-09-15T22:44:20.951412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954184+0000","last_change":"2024-09-15T22:44:20.954184+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954184+0000","last_undegraded":"2024-09-15T22:44:20.954184+0000","last_fullsized":"2024-09-15T22:44:20.954184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953978+0000","last_change":"2024-09-15T22:44:20.953978+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953978+0000","last_undegraded":"2024-09-15T22:44:20.953978+0000","last_fullsized":"2024-09-15T22:44:20.953978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954614+0000","last_change":"2024-09-15T22:44:20.954614+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954614+0000","last_undegraded":"2024-09-15T22:44:20.954614+0000","last_fullsized":"2024-09-15T22:44:20.954614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954332+0000","last_change":"2024-09-15T22:44:20.954332+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954332+0000","last_undegraded":"2024-09-15T22:44:20.954332+0000","last_fullsized":"2024-09-15T22:44:20.954332+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952789+0000","last_change":"2024-09-15T22:44:20.952789+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952789+0000","last_undegraded":"2024-09-15T22:44:20.952789+0000","last_fullsized":"2024-09-15T22:44:20.952789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950008+0000","last_change":"2024-09-15T22:44:20.950008+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950008+0000","last_undegraded":"2024-09-15T22:44:20.950008+0000","last_fullsized":"2024-09-15T22:44:20.950008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971645+0000","last_change":"2024-09-15T22:44:21.966181+0000","last_active":"2024-09-15T22:44:22.971645+0000","last_peered":"2024-09-15T22:44:22.971645+0000","last_clean":"2024-09-15T22:44:22.971645+0000","last_became_active":"2024-09-15T22:44:21.965759+0000","last_became_peered":"2024-09-15T22:44:21.965759+0000","last_unstale":"2024-09-15T22:44:22.971645+0000","last_undegraded":"2024-09-15T22:44:22.971645+0000","last_fullsized":"2024-09-15T22:44:22.971645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:16.195412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961751+0000","last_change":"2024-09-15T22:44:20.959633+0000","last_active":"2024-09-15T22:44:20.961751+0000","last_peered":"2024-09-15T22:44:20.961751+0000","last_clean":"2024-09-15T22:44:20.961751+0000","last_became_active":"2024-09-15T22:44:20.959320+0000","last_became_peered":"2024-09-15T22:44:20.959320+0000","last_unstale":"2024-09-15T22:44:20.961751+0000","last_undegraded":"2024-09-15T22:44:20.961751+0000","last_fullsized":"2024-09-15T22:44:20.961751+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971803+0000","last_change":"2024-09-15T22:44:21.972701+0000","last_active":"2024-09-15T22:44:22.971803+0000","last_peered":"2024-09-15T22:44:22.971803+0000","last_clean":"2024-09-15T22:44:22.971803+0000","last_became_active":"2024-09-15T22:44:21.972403+0000","last_became_peered":"2024-09-15T22:44:21.972403+0000","last_unstale":"2024-09-15T22:44:22.971803+0000","last_undegraded":"2024-09-15T22:44:22.971803+0000","last_fullsized":"2024-09-15T22:44:22.971803+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:38.902404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966768+0000","last_change":"2024-09-15T22:44:20.965481+0000","last_active":"2024-09-15T22:44:20.966768+0000","last_peered":"2024-09-15T22:44:20.966768+0000","last_clean":"2024-09-15T22:44:20.966768+0000","last_became_active":"2024-09-15T22:44:20.965218+0000","last_became_peered":"2024-09-15T22:44:20.965218+0000","last_unstale":"2024-09-15T22:44:20.966768+0000","last_undegraded":"2024-09-15T22:44:20.966768+0000","last_fullsized":"2024-09-15T22:44:20.966768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953461+0000","last_change":"2024-09-15T22:44:20.953461+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953461+0000","last_undegraded":"2024-09-15T22:44:20.953461+0000","last_fullsized":"2024-09-15T22:44:20.953461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971591+0000","last_change":"2024-09-15T22:44:20.963289+0000","last_active":"2024-09-15T22:44:22.971591+0000","last_peered":"2024-09-15T22:44:22.971591+0000","last_clean":"2024-09-15T22:44:22.971591+0000","last_became_active":"2024-09-15T22:44:20.963013+0000","last_became_peered":"2024-09-15T22:44:20.963013+0000","last_unstale":"2024-09-15T22:44:22.971591+0000","last_undegraded":"2024-09-15T22:44:22.971591+0000","last_fullsized":"2024-09-15T22:44:22.971591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:26.208450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971501+0000","last_change":"2024-09-15T22:44:21.970159+0000","last_active":"2024-09-15T22:44:22.971501+0000","last_peered":"2024-09-15T22:44:22.971501+0000","last_clean":"2024-09-15T22:44:22.971501+0000","last_became_active":"2024-09-15T22:44:21.969890+0000","last_became_peered":"2024-09-15T22:44:21.969890+0000","last_unstale":"2024-09-15T22:44:22.971501+0000","last_undegraded":"2024-09-15T22:44:22.971501+0000","last_fullsized":"2024-09-15T22:44:22.971501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:11.500124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967704+0000","last_change":"2024-09-15T22:44:20.965106+0000","last_active":"2024-09-15T22:44:20.967704+0000","last_peered":"2024-09-15T22:44:20.967704+0000","last_clean":"2024-09-15T22:44:20.967704+0000","last_became_active":"2024-09-15T22:44:20.964830+0000","last_became_peered":"2024-09-15T22:44:20.964830+0000","last_unstale":"2024-09-15T22:44:20.967704+0000","last_undegraded":"2024-09-15T22:44:20.967704+0000","last_fullsized":"2024-09-15T22:44:20.967704+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:17.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953623+0000","last_change":"2024-09-15T22:44:20.953623+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953623+0000","last_undegraded":"2024-09-15T22:44:20.953623+0000","last_fullsized":"2024-09-15T22:44:20.953623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.969270+0000","last_change":"2024-09-15T22:44:20.967792+0000","last_active":"2024-09-15T22:44:20.969270+0000","last_peered":"2024-09-15T22:44:20.969270+0000","last_clean":"2024-09-15T22:44:20.969270+0000","last_became_active":"2024-09-15T22:44:20.967471+0000","last_became_peered":"2024-09-15T22:44:20.967471+0000","last_unstale":"2024-09-15T22:44:20.969270+0000","last_undegraded":"2024-09-15T22:44:20.969270+0000","last_fullsized":"2024-09-15T22:44:20.969270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.655871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949945+0000","last_change":"2024-09-15T22:44:20.949945+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949945+0000","last_undegraded":"2024-09-15T22:44:20.949945+0000","last_fullsized":"2024-09-15T22:44:20.949945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971435+0000","last_change":"2024-09-15T22:44:20.965421+0000","last_active":"2024-09-15T22:44:22.971435+0000","last_peered":"2024-09-15T22:44:22.971435+0000","last_clean":"2024-09-15T22:44:22.971435+0000","last_became_active":"2024-09-15T22:44:20.965146+0000","last_became_peered":"2024-09-15T22:44:20.965146+0000","last_unstale":"2024-09-15T22:44:22.971435+0000","last_undegraded":"2024-09-15T22:44:22.971435+0000","last_fullsized":"2024-09-15T22:44:22.971435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:46.174738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954042+0000","last_change":"2024-09-15T22:44:20.954042+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954042+0000","last_undegraded":"2024-09-15T22:44:20.954042+0000","last_fullsized":"2024-09-15T22:44:20.954042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961018+0000","last_change":"2024-09-15T22:44:20.958649+0000","last_active":"2024-09-15T22:44:20.961018+0000","last_peered":"2024-09-15T22:44:20.961018+0000","last_clean":"2024-09-15T22:44:20.961018+0000","last_became_active":"2024-09-15T22:44:20.958340+0000","last_became_peered":"2024-09-15T22:44:20.958340+0000","last_unstale":"2024-09-15T22:44:20.961018+0000","last_undegraded":"2024-09-15T22:44:20.961018+0000","last_fullsized":"2024-09-15T22:44:20.961018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:48.760192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970842+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.970583+0000","last_became_peered":"2024-09-15T22:44:21.970583+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:51.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.957529+0000","last_change":"2024-09-15T22:44:20.954064+0000","last_active":"2024-09-15T22:44:20.957529+0000","last_peered":"2024-09-15T22:44:20.957529+0000","last_clean":"2024-09-15T22:44:20.957529+0000","last_became_active":"2024-09-15T22:44:20.953807+0000","last_became_peered":"2024-09-15T22:44:20.953807+0000","last_unstale":"2024-09-15T22:44:20.957529+0000","last_undegraded":"2024-09-15T22:44:20.957529+0000","last_fullsized":"2024-09-15T22:44:20.957529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.287896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950882+0000","last_change":"2024-09-15T22:44:20.950882+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950882+0000","last_undegraded":"2024-09-15T22:44:20.950882+0000","last_fullsized":"2024-09-15T22:44:20.950882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.963178+0000","last_change":"2024-09-15T22:44:20.959186+0000","last_active":"2024-09-15T22:44:20.963178+0000","last_peered":"2024-09-15T22:44:20.963178+0000","last_clean":"2024-09-15T22:44:20.963178+0000","last_became_active":"2024-09-15T22:44:20.958905+0000","last_became_peered":"2024-09-15T22:44:20.958905+0000","last_unstale":"2024-09-15T22:44:20.963178+0000","last_undegraded":"2024-09-15T22:44:20.963178+0000","last_fullsized":"2024-09-15T22:44:20.963178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955958+0000","last_change":"2024-09-15T22:44:20.955958+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955958+0000","last_undegraded":"2024-09-15T22:44:20.955958+0000","last_fullsized":"2024-09-15T22:44:20.955958+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965079+0000","last_change":"2024-09-15T22:44:20.963252+0000","last_active":"2024-09-15T22:44:20.965079+0000","last_peered":"2024-09-15T22:44:20.965079+0000","last_clean":"2024-09-15T22:44:20.965079+0000","last_became_active":"2024-09-15T22:44:20.962903+0000","last_became_peered":"2024-09-15T22:44:20.962903+0000","last_unstale":"2024-09-15T22:44:20.965079+0000","last_undegraded":"2024-09-15T22:44:20.965079+0000","last_fullsized":"2024-09-15T22:44:20.965079+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:47.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952920+0000","last_change":"2024-09-15T22:44:20.952920+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952920+0000","last_undegraded":"2024-09-15T22:44:20.952920+0000","last_fullsized":"2024-09-15T22:44:20.952920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967745+0000","last_change":"2024-09-15T22:44:20.965734+0000","last_active":"2024-09-15T22:44:20.967745+0000","last_peered":"2024-09-15T22:44:20.967745+0000","last_clean":"2024-09-15T22:44:20.967745+0000","last_became_active":"2024-09-15T22:44:20.965475+0000","last_became_peered":"2024-09-15T22:44:20.965475+0000","last_unstale":"2024-09-15T22:44:20.967745+0000","last_undegraded":"2024-09-15T22:44:20.967745+0000","last_fullsized":"2024-09-15T22:44:20.967745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:32.592300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954960+0000","last_change":"2024-09-15T22:44:20.954960+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954960+0000","last_undegraded":"2024-09-15T22:44:20.954960+0000","last_fullsized":"2024-09-15T22:44:20.954960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965064+0000","last_change":"2024-09-15T22:44:20.963930+0000","last_active":"2024-09-15T22:44:20.965064+0000","last_peered":"2024-09-15T22:44:20.965064+0000","last_clean":"2024-09-15T22:44:20.965064+0000","last_became_active":"2024-09-15T22:44:20.963655+0000","last_became_peered":"2024-09-15T22:44:20.963655+0000","last_unstale":"2024-09-15T22:44:20.965064+0000","last_undegraded":"2024-09-15T22:44:20.965064+0000","last_fullsized":"2024-09-15T22:44:20.965064+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:44.797569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952619+0000","last_change":"2024-09-15T22:44:20.952619+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952619+0000","last_undegraded":"2024-09-15T22:44:20.952619+0000","last_fullsized":"2024-09-15T22:44:20.952619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965008+0000","last_change":"2024-09-15T22:44:20.963287+0000","last_active":"2024-09-15T22:44:20.965008+0000","last_peered":"2024-09-15T22:44:20.965008+0000","last_clean":"2024-09-15T22:44:20.965008+0000","last_became_active":"2024-09-15T22:44:20.962848+0000","last_became_peered":"2024-09-15T22:44:20.962848+0000","last_unstale":"2024-09-15T22:44:20.965008+0000","last_undegraded":"2024-09-15T22:44:20.965008+0000","last_fullsized":"2024-09-15T22:44:20.965008+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.449490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956121+0000","last_change":"2024-09-15T22:44:20.956121+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956121+0000","last_undegraded":"2024-09-15T22:44:20.956121+0000","last_fullsized":"2024-09-15T22:44:20.956121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966482+0000","last_change":"2024-09-15T22:44:20.963978+0000","last_active":"2024-09-15T22:44:20.966482+0000","last_peered":"2024-09-15T22:44:20.966482+0000","last_clean":"2024-09-15T22:44:20.966482+0000","last_became_active":"2024-09-15T22:44:20.963698+0000","last_became_peered":"2024-09-15T22:44:20.963698+0000","last_unstale":"2024-09-15T22:44:20.966482+0000","last_undegraded":"2024-09-15T22:44:20.966482+0000","last_fullsized":"2024-09-15T22:44:20.966482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:26.366026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952315+0000","last_change":"2024-09-15T22:44:20.952315+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952315+0000","last_undegraded":"2024-09-15T22:44:20.952315+0000","last_fullsized":"2024-09-15T22:44:20.952315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961610+0000","last_change":"2024-09-15T22:44:20.959952+0000","last_active":"2024-09-15T22:44:20.961610+0000","last_peered":"2024-09-15T22:44:20.961610+0000","last_clean":"2024-09-15T22:44:20.961610+0000","last_became_active":"2024-09-15T22:44:20.959667+0000","last_became_peered":"2024-09-15T22:44:20.959667+0000","last_unstale":"2024-09-15T22:44:20.961610+0000","last_undegraded":"2024-09-15T22:44:20.961610+0000","last_fullsized":"2024-09-15T22:44:20.961610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:29.532785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953076+0000","last_change":"2024-09-15T22:44:20.953076+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953076+0000","last_undegraded":"2024-09-15T22:44:20.953076+0000","last_fullsized":"2024-09-15T22:44:20.953076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.962787+0000","last_change":"2024-09-15T22:44:20.960790+0000","last_active":"2024-09-15T22:44:20.962787+0000","last_peered":"2024-09-15T22:44:20.962787+0000","last_clean":"2024-09-15T22:44:20.962787+0000","last_became_active":"2024-09-15T22:44:20.960509+0000","last_became_peered":"2024-09-15T22:44:20.960509+0000","last_unstale":"2024-09-15T22:44:20.962787+0000","last_undegraded":"2024-09-15T22:44:20.962787+0000","last_fullsized":"2024-09-15T22:44:20.962787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:52.822369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955910+0000","last_change":"2024-09-15T22:44:20.955910+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955910+0000","last_undegraded":"2024-09-15T22:44:20.955910+0000","last_fullsized":"2024-09-15T22:44:20.955910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968659+0000","last_change":"2024-09-15T22:44:20.967358+0000","last_active":"2024-09-15T22:44:20.968659+0000","last_peered":"2024-09-15T22:44:20.968659+0000","last_clean":"2024-09-15T22:44:20.968659+0000","last_became_active":"2024-09-15T22:44:20.966982+0000","last_became_peered":"2024-09-15T22:44:20.966982+0000","last_unstale":"2024-09-15T22:44:20.968659+0000","last_undegraded":"2024-09-15T22:44:20.968659+0000","last_fullsized":"2024-09-15T22:44:20.968659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955223+0000","last_change":"2024-09-15T22:44:20.955223+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955223+0000","last_undegraded":"2024-09-15T22:44:20.955223+0000","last_fullsized":"2024-09-15T22:44:20.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966258+0000","last_change":"2024-09-15T22:44:20.963170+0000","last_active":"2024-09-15T22:44:20.966258+0000","last_peered":"2024-09-15T22:44:20.966258+0000","last_clean":"2024-09-15T22:44:20.966258+0000","last_became_active":"2024-09-15T22:44:20.962837+0000","last_became_peered":"2024-09-15T22:44:20.962837+0000","last_unstale":"2024-09-15T22:44:20.966258+0000","last_undegraded":"2024-09-15T22:44:20.966258+0000","last_fullsized":"2024-09-15T22:44:20.966258+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953715+0000","last_change":"2024-09-15T22:44:20.953715+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953715+0000","last_undegraded":"2024-09-15T22:44:20.953715+0000","last_fullsized":"2024-09-15T22:44:20.953715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965391+0000","last_change":"2024-09-15T22:44:20.963980+0000","last_active":"2024-09-15T22:44:20.965391+0000","last_peered":"2024-09-15T22:44:20.965391+0000","last_clean":"2024-09-15T22:44:20.965391+0000","last_became_active":"2024-09-15T22:44:20.963718+0000","last_became_peered":"2024-09-15T22:44:20.963718+0000","last_unstale":"2024-09-15T22:44:20.965391+0000","last_undegraded":"2024-09-15T22:44:20.965391+0000","last_fullsized":"2024-09-15T22:44:20.965391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.705907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954597+0000","last_change":"2024-09-15T22:44:20.954597+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954597+0000","last_undegraded":"2024-09-15T22:44:20.954597+0000","last_fullsized":"2024-09-15T22:44:20.954597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967623+0000","last_change":"2024-09-15T22:44:20.964846+0000","last_active":"2024-09-15T22:44:20.967623+0000","last_peered":"2024-09-15T22:44:20.967623+0000","last_clean":"2024-09-15T22:44:20.967623+0000","last_became_active":"2024-09-15T22:44:20.964581+0000","last_became_peered":"2024-09-15T22:44:20.964581+0000","last_unstale":"2024-09-15T22:44:20.967623+0000","last_undegraded":"2024-09-15T22:44:20.967623+0000","last_fullsized":"2024-09-15T22:44:20.967623+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:11.524812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952202+0000","last_change":"2024-09-15T22:44:20.952202+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952202+0000","last_undegraded":"2024-09-15T22:44:20.952202+0000","last_fullsized":"2024-09-15T22:44:20.952202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961268+0000","last_change":"2024-09-15T22:44:20.955951+0000","last_active":"2024-09-15T22:44:20.961268+0000","last_peered":"2024-09-15T22:44:20.961268+0000","last_clean":"2024-09-15T22:44:20.961268+0000","last_became_active":"2024-09-15T22:44:20.955657+0000","last_became_peered":"2024-09-15T22:44:20.955657+0000","last_unstale":"2024-09-15T22:44:20.961268+0000","last_undegraded":"2024-09-15T22:44:20.961268+0000","last_fullsized":"2024-09-15T22:44:20.961268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954193+0000","last_change":"2024-09-15T22:44:20.954193+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954193+0000","last_undegraded":"2024-09-15T22:44:20.954193+0000","last_fullsized":"2024-09-15T22:44:20.954193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965026+0000","last_change":"2024-09-15T22:44:20.963436+0000","last_active":"2024-09-15T22:44:20.965026+0000","last_peered":"2024-09-15T22:44:20.965026+0000","last_clean":"2024-09-15T22:44:20.965026+0000","last_became_active":"2024-09-15T22:44:20.962857+0000","last_became_peered":"2024-09-15T22:44:20.962857+0000","last_unstale":"2024-09-15T22:44:20.965026+0000","last_undegraded":"2024-09-15T22:44:20.965026+0000","last_fullsized":"2024-09-15T22:44:20.965026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:35.783303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952815+0000","last_change":"2024-09-15T22:44:20.952815+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952815+0000","last_undegraded":"2024-09-15T22:44:20.952815+0000","last_fullsized":"2024-09-15T22:44:20.952815+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966857+0000","last_change":"2024-09-15T22:44:20.965332+0000","last_active":"2024-09-15T22:44:20.966857+0000","last_peered":"2024-09-15T22:44:20.966857+0000","last_clean":"2024-09-15T22:44:20.966857+0000","last_became_active":"2024-09-15T22:44:20.965024+0000","last_became_peered":"2024-09-15T22:44:20.965024+0000","last_unstale":"2024-09-15T22:44:20.966857+0000","last_undegraded":"2024-09-15T22:44:20.966857+0000","last_fullsized":"2024-09-15T22:44:20.966857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955437+0000","last_change":"2024-09-15T22:44:20.955437+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955437+0000","last_undegraded":"2024-09-15T22:44:20.955437+0000","last_fullsized":"2024-09-15T22:44:20.955437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966197+0000","last_change":"2024-09-15T22:44:20.964770+0000","last_active":"2024-09-15T22:44:20.966197+0000","last_peered":"2024-09-15T22:44:20.966197+0000","last_clean":"2024-09-15T22:44:20.966197+0000","last_became_active":"2024-09-15T22:44:20.964468+0000","last_became_peered":"2024-09-15T22:44:20.964468+0000","last_unstale":"2024-09-15T22:44:20.966197+0000","last_undegraded":"2024-09-15T22:44:20.966197+0000","last_fullsized":"2024-09-15T22:44:20.966197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954757+0000","last_change":"2024-09-15T22:44:20.954757+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954757+0000","last_undegraded":"2024-09-15T22:44:20.954757+0000","last_fullsized":"2024-09-15T22:44:20.954757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971699+0000","last_change":"2024-09-15T22:44:20.964367+0000","last_active":"2024-09-15T22:44:22.971699+0000","last_peered":"2024-09-15T22:44:22.971699+0000","last_clean":"2024-09-15T22:44:22.971699+0000","last_became_active":"2024-09-15T22:44:20.964060+0000","last_became_peered":"2024-09-15T22:44:20.964060+0000","last_unstale":"2024-09-15T22:44:22.971699+0000","last_undegraded":"2024-09-15T22:44:22.971699+0000","last_fullsized":"2024-09-15T22:44:22.971699+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:15.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953263+0000","last_change":"2024-09-15T22:44:20.953263+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953263+0000","last_undegraded":"2024-09-15T22:44:20.953263+0000","last_fullsized":"2024-09-15T22:44:20.953263+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965323+0000","last_change":"2024-09-15T22:44:20.962967+0000","last_active":"2024-09-15T22:44:20.965323+0000","last_peered":"2024-09-15T22:44:20.965323+0000","last_clean":"2024-09-15T22:44:20.965323+0000","last_became_active":"2024-09-15T22:44:20.962621+0000","last_became_peered":"2024-09-15T22:44:20.962621+0000","last_unstale":"2024-09-15T22:44:20.965323+0000","last_undegraded":"2024-09-15T22:44:20.965323+0000","last_fullsized":"2024-09-15T22:44:20.965323+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953112+0000","last_change":"2024-09-15T22:44:20.953112+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953112+0000","last_undegraded":"2024-09-15T22:44:20.953112+0000","last_fullsized":"2024-09-15T22:44:20.953112+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967962+0000","last_change":"2024-09-15T22:44:20.966571+0000","last_active":"2024-09-15T22:44:20.967962+0000","last_peered":"2024-09-15T22:44:20.967962+0000","last_clean":"2024-09-15T22:44:20.967962+0000","last_became_active":"2024-09-15T22:44:20.966183+0000","last_became_peered":"2024-09-15T22:44:20.966183+0000","last_unstale":"2024-09-15T22:44:20.967962+0000","last_undegraded":"2024-09-15T22:44:20.967962+0000","last_fullsized":"2024-09-15T22:44:20.967962+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:42.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971326+0000","last_change":"2024-09-15T22:44:21.975311+0000","last_active":"2024-09-15T22:44:22.971326+0000","last_peered":"2024-09-15T22:44:22.971326+0000","last_clean":"2024-09-15T22:44:22.971326+0000","last_became_active":"2024-09-15T22:44:21.975052+0000","last_became_peered":"2024-09-15T22:44:21.975052+0000","last_unstale":"2024-09-15T22:44:22.971326+0000","last_undegraded":"2024-09-15T22:44:22.971326+0000","last_fullsized":"2024-09-15T22:44:22.971326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:03.634300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968671+0000","last_change":"2024-09-15T22:44:20.967962+0000","last_active":"2024-09-15T22:44:20.968671+0000","last_peered":"2024-09-15T22:44:20.968671+0000","last_clean":"2024-09-15T22:44:20.968671+0000","last_became_active":"2024-09-15T22:44:20.967669+0000","last_became_peered":"2024-09-15T22:44:20.967669+0000","last_unstale":"2024-09-15T22:44:20.968671+0000","last_undegraded":"2024-09-15T22:44:20.968671+0000","last_fullsized":"2024-09-15T22:44:20.968671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:44.093894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951537+0000","last_change":"2024-09-15T22:44:20.951537+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951537+0000","last_undegraded":"2024-09-15T22:44:20.951537+0000","last_fullsized":"2024-09-15T22:44:20.951537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964290+0000","last_change":"2024-09-15T22:44:20.962150+0000","last_active":"2024-09-15T22:44:20.964290+0000","last_peered":"2024-09-15T22:44:20.964290+0000","last_clean":"2024-09-15T22:44:20.964290+0000","last_became_active":"2024-09-15T22:44:20.961861+0000","last_became_peered":"2024-09-15T22:44:20.961861+0000","last_unstale":"2024-09-15T22:44:20.964290+0000","last_undegraded":"2024-09-15T22:44:20.964290+0000","last_fullsized":"2024-09-15T22:44:20.964290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:07.460468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953886+0000","last_change":"2024-09-15T22:44:20.953886+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953886+0000","last_undegraded":"2024-09-15T22:44:20.953886+0000","last_fullsized":"2024-09-15T22:44:20.953886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971148+0000","last_change":"2024-09-15T22:44:20.962947+0000","last_active":"2024-09-15T22:44:22.971148+0000","last_peered":"2024-09-15T22:44:22.971148+0000","last_clean":"2024-09-15T22:44:22.971148+0000","last_became_active":"2024-09-15T22:44:20.962625+0000","last_became_peered":"2024-09-15T22:44:20.962625+0000","last_unstale":"2024-09-15T22:44:22.971148+0000","last_undegraded":"2024-09-15T22:44:22.971148+0000","last_fullsized":"2024-09-15T22:44:22.971148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:03.363102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952329+0000","last_change":"2024-09-15T22:44:20.952329+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952329+0000","last_undegraded":"2024-09-15T22:44:20.952329+0000","last_fullsized":"2024-09-15T22:44:20.952329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964098+0000","last_change":"2024-09-15T22:44:20.961177+0000","last_active":"2024-09-15T22:44:20.964098+0000","last_peered":"2024-09-15T22:44:20.964098+0000","last_clean":"2024-09-15T22:44:20.964098+0000","last_became_active":"2024-09-15T22:44:20.960859+0000","last_became_peered":"2024-09-15T22:44:20.960859+0000","last_unstale":"2024-09-15T22:44:20.964098+0000","last_undegraded":"2024-09-15T22:44:20.964098+0000","last_fullsized":"2024-09-15T22:44:20.964098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952588+0000","last_change":"2024-09-15T22:44:20.952588+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952588+0000","last_undegraded":"2024-09-15T22:44:20.952588+0000","last_fullsized":"2024-09-15T22:44:20.952588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.960629+0000","last_change":"2024-09-15T22:44:20.959715+0000","last_active":"2024-09-15T22:44:20.960629+0000","last_peered":"2024-09-15T22:44:20.960629+0000","last_clean":"2024-09-15T22:44:20.960629+0000","last_became_active":"2024-09-15T22:44:20.957914+0000","last_became_peered":"2024-09-15T22:44:20.957914+0000","last_unstale":"2024-09-15T22:44:20.960629+0000","last_undegraded":"2024-09-15T22:44:20.960629+0000","last_fullsized":"2024-09-15T22:44:20.960629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:30.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.953258+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:20.953258+0000","last_peered":"2024-09-15T22:44:20.953258+0000","last_clean":"2024-09-15T22:44:20.953258+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:20.953258+0000","last_undegraded":"2024-09-15T22:44:20.953258+0000","last_fullsized":"2024-09-15T22:44:20.953258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":299454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:25.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:44:26.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.044+0000 7f4d72ef1640 1 Processor -- start 2024-09-15T22:44:26.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.044+0000 7f4d72ef1640 1 -- start start 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d72ef1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d72ef1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d72ef1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c0b7170 con 0x7f4d6c15ed20 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d72ef1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c0d1ae0 con 0x7f4d6c0cef90 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d72ef1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b7aa0 con 0x7f4d6c15e940 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d6bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4d6c15ed20 0x7f4d6c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35012/0 (socket says 172.21.15.134:35012) 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41214/0 (socket says 172.21.15.134:41214) 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d6bfff640 1 -- 172.21.15.134:0/1228719871 learned_addr learned my addr 172.21.15.134:0/1228719871 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d70c8d640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 -- 172.21.15.134:0/1228719871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 msgr2=0x7f4d6c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 -- 172.21.15.134:0/1228719871 >> v1:172.21.15.134:6789/0 conn(0x7f4d6c15ed20 legacy=0x7f4d6c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d7148e640 1 -- 172.21.15.134:0/1228719871 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0d3660 con 0x7f4d6c0cef90 2024-09-15T22:44:26.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.045+0000 7f4d70c8d640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.046+0000 7f4d7148e640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770b2eee22411d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.046+0000 7f4d6b7fe640 1 -- 172.21.15.134:0/1228719871 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007740 con 0x7f4d6c0cef90 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.046+0000 7f4d6b7fe640 1 -- 172.21.15.134:0/1228719871 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d640078e0 con 0x7f4d6c0cef90 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.046+0000 7f4d6b7fe640 1 -- 172.21.15.134:0/1228719871 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007cb0 con 0x7f4d6c0cef90 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 -- 172.21.15.134:0/1228719871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c0cef90 msgr2=0x7f4d6c0d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a6f0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 -- 172.21.15.134:0/1228719871 shutdown_connections 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0d15a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/1228719871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 -- 172.21.15.134:0/1228719871 >> 172.21.15.134:0/1228719871 conn(0x7f4d6c0b6240 msgr2=0x7f4d6c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 -- 172.21.15.134:0/1228719871 shutdown_connections 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.047+0000 7f4d72ef1640 1 -- 172.21.15.134:0/1228719871 wait complete. 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.048+0000 7f4d72ef1640 1 Processor -- start 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.048+0000 7f4d72ef1640 1 -- start start 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0d3f00 con 0x7f4d6c15ed20 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0d3c20 con 0x7f4d6c0cef90 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0d3310 con 0x7f4d6c15e940 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41216/0 (socket says 172.21.15.134:41216) 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 -- 172.21.15.134:0/2606930831 learned_addr learned my addr 172.21.15.134:0/2606930831 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:26.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d6bfff640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d70c8d640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 -- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 msgr2=0x7f4d6c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 -- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0cef90 msgr2=0x7f4d6c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 -- 172.21.15.134:0/2606930831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0ccde0 con 0x7f4d6c15ed20 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d6bfff640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d7148e640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4d6402ace0 tx=0x7f4d64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6403f070 con 0x7f4d6c15ed20 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d64031bc0 con 0x7f4d6c15ed20 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c0cd0c0 con 0x7f4d6c15ed20 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64044460 con 0x7f4d6c15ed20 2024-09-15T22:44:26.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.049+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c0cd680 con 0x7f4d6c15ed20 2024-09-15T22:44:26.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.051+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c0d1f80 con 0x7f4d6c15ed20 2024-09-15T22:44:26.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.051+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f4d64007790 con 0x7f4d6c15ed20 2024-09-15T22:44:26.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.051+0000 7f4d697fa640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 0x7f4d5006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.051+0000 7f4d70c8d640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 0x7f4d5006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.052+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f4d640acfd0 con 0x7f4d6c15ed20 2024-09-15T22:44:26.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.052+0000 7f4d70c8d640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 0x7f4d5006e920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d60006fd0 tx=0x7f4d60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.056+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d6407b440 con 0x7f4d6c15ed20 2024-09-15T22:44:26.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.217+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d6c0ba6b0 con 0x7f4d5006c460 2024-09-15T22:44:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.223+0000 7f4d697fa640 1 -- 172.21.15.134:0/2606930831 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247544 (secure 0 0 0) 0x7f4d6c0ba6b0 con 0x7f4d5006c460 2024-09-15T22:44:26.227 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:26.228 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:44:26.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 msgr2=0x7f4d5006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 0x7f4d5006e920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d60006fd0 tx=0x7f4d60008040 comp rx=0 tx=0).stop 2024-09-15T22:44:26.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 msgr2=0x7f4d6c14b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4d6402ace0 tx=0x7f4d64004a40 comp rx=0 tx=0).stop 2024-09-15T22:44:26.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 shutdown_connections 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f4d5006c460 0x7f4d5006e920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c15ed20 0x7f4d6c14b3e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15e940 0x7f4d6c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 --2- 172.21.15.134:0/2606930831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0cef90 0x7f4d6c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 >> 172.21.15.134:0/2606930831 conn(0x7f4d6c0b6240 msgr2=0x7f4d6c15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 shutdown_connections 2024-09-15T22:44:26.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.226+0000 7f4d72ef1640 1 -- 172.21.15.134:0/2606930831 wait complete. 2024-09-15T22:44:26.238 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-15T22:44:24.987135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227020,"kb_used_data":6576,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747700,"statfs":{"total":773094113280,"available":772861644800,"internally_reserved":0,"allocated":6733824,"data_stored":3440764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044199"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971718+0000","last_change":"2024-09-15T22:44:21.964019+0000","last_active":"2024-09-15T22:44:22.971718+0000","last_peered":"2024-09-15T22:44:22.971718+0000","last_clean":"2024-09-15T22:44:22.971718+0000","last_became_active":"2024-09-15T22:44:21.963745+0000","last_became_peered":"2024-09-15T22:44:21.963745+0000","last_unstale":"2024-09-15T22:44:22.971718+0000","last_undegraded":"2024-09-15T22:44:22.971718+0000","last_fullsized":"2024-09-15T22:44:22.971718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:08.177048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955211+0000","last_change":"2024-09-15T22:44:20.955211+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955211+0000","last_undegraded":"2024-09-15T22:44:20.955211+0000","last_fullsized":"2024-09-15T22:44:20.955211+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955662+0000","last_change":"2024-09-15T22:44:20.955662+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955662+0000","last_undegraded":"2024-09-15T22:44:20.955662+0000","last_fullsized":"2024-09-15T22:44:20.955662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953143+0000","last_change":"2024-09-15T22:44:20.953143+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953143+0000","last_undegraded":"2024-09-15T22:44:20.953143+0000","last_fullsized":"2024-09-15T22:44:20.953143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971364+0000","last_change":"2024-09-15T22:44:21.969484+0000","last_active":"2024-09-15T22:44:22.971364+0000","last_peered":"2024-09-15T22:44:22.971364+0000","last_clean":"2024-09-15T22:44:22.971364+0000","last_became_active":"2024-09-15T22:44:21.969069+0000","last_became_peered":"2024-09-15T22:44:21.969069+0000","last_unstale":"2024-09-15T22:44:22.971364+0000","last_undegraded":"2024-09-15T22:44:22.971364+0000","last_fullsized":"2024-09-15T22:44:22.971364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:55.828144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971290+0000","last_change":"2024-09-15T22:44:21.976008+0000","last_active":"2024-09-15T22:44:22.971290+0000","last_peered":"2024-09-15T22:44:22.971290+0000","last_clean":"2024-09-15T22:44:22.971290+0000","last_became_active":"2024-09-15T22:44:21.975743+0000","last_became_peered":"2024-09-15T22:44:21.975743+0000","last_unstale":"2024-09-15T22:44:22.971290+0000","last_undegraded":"2024-09-15T22:44:22.971290+0000","last_fullsized":"2024-09-15T22:44:22.971290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:25.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953874+0000","last_change":"2024-09-15T22:44:20.953874+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953874+0000","last_undegraded":"2024-09-15T22:44:20.953874+0000","last_fullsized":"2024-09-15T22:44:20.953874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954377+0000","last_change":"2024-09-15T22:44:20.954377+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954377+0000","last_undegraded":"2024-09-15T22:44:20.954377+0000","last_fullsized":"2024-09-15T22:44:20.954377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952054+0000","last_change":"2024-09-15T22:44:20.952054+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952054+0000","last_undegraded":"2024-09-15T22:44:20.952054+0000","last_fullsized":"2024-09-15T22:44:20.952054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971583+0000","last_change":"2024-09-15T22:44:21.964323+0000","last_active":"2024-09-15T22:44:22.971583+0000","last_peered":"2024-09-15T22:44:22.971583+0000","last_clean":"2024-09-15T22:44:22.971583+0000","last_became_active":"2024-09-15T22:44:21.964031+0000","last_became_peered":"2024-09-15T22:44:21.964031+0000","last_unstale":"2024-09-15T22:44:22.971583+0000","last_undegraded":"2024-09-15T22:44:22.971583+0000","last_fullsized":"2024-09-15T22:44:22.971583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:46.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950446+0000","last_change":"2024-09-15T22:44:20.950446+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950446+0000","last_undegraded":"2024-09-15T22:44:20.950446+0000","last_fullsized":"2024-09-15T22:44:20.950446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951705+0000","last_change":"2024-09-15T22:44:20.951705+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951705+0000","last_undegraded":"2024-09-15T22:44:20.951705+0000","last_fullsized":"2024-09-15T22:44:20.951705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952497+0000","last_change":"2024-09-15T22:44:20.952497+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952497+0000","last_undegraded":"2024-09-15T22:44:20.952497+0000","last_fullsized":"2024-09-15T22:44:20.952497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954831+0000","last_change":"2024-09-15T22:44:20.954831+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954831+0000","last_undegraded":"2024-09-15T22:44:20.954831+0000","last_fullsized":"2024-09-15T22:44:20.954831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952498+0000","last_change":"2024-09-15T22:44:20.952498+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952498+0000","last_undegraded":"2024-09-15T22:44:20.952498+0000","last_fullsized":"2024-09-15T22:44:20.952498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970162+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.969875+0000","last_became_peered":"2024-09-15T22:44:21.969875+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.172394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971765+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:22.971765+0000","last_peered":"2024-09-15T22:44:22.971765+0000","last_clean":"2024-09-15T22:44:22.971765+0000","last_became_active":"2024-09-15T22:44:21.961717+0000","last_became_peered":"2024-09-15T22:44:21.961717+0000","last_unstale":"2024-09-15T22:44:22.971765+0000","last_undegraded":"2024-09-15T22:44:22.971765+0000","last_fullsized":"2024-09-15T22:44:22.971765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:35.936792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956339+0000","last_change":"2024-09-15T22:44:20.956339+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956339+0000","last_undegraded":"2024-09-15T22:44:20.956339+0000","last_fullsized":"2024-09-15T22:44:20.956339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954600+0000","last_change":"2024-09-15T22:44:20.954600+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954600+0000","last_undegraded":"2024-09-15T22:44:20.954600+0000","last_fullsized":"2024-09-15T22:44:20.954600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950521+0000","last_change":"2024-09-15T22:44:20.950521+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950521+0000","last_undegraded":"2024-09-15T22:44:20.950521+0000","last_fullsized":"2024-09-15T22:44:20.950521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952010+0000","last_change":"2024-09-15T22:44:20.952010+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952010+0000","last_undegraded":"2024-09-15T22:44:20.952010+0000","last_fullsized":"2024-09-15T22:44:20.952010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949379+0000","last_change":"2024-09-15T22:44:20.949379+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949379+0000","last_undegraded":"2024-09-15T22:44:20.949379+0000","last_fullsized":"2024-09-15T22:44:20.949379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953465+0000","last_change":"2024-09-15T22:44:20.953465+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953465+0000","last_undegraded":"2024-09-15T22:44:20.953465+0000","last_fullsized":"2024-09-15T22:44:20.953465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952976+0000","last_change":"2024-09-15T22:44:20.952976+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952976+0000","last_undegraded":"2024-09-15T22:44:20.952976+0000","last_fullsized":"2024-09-15T22:44:20.952976+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955140+0000","last_change":"2024-09-15T22:44:20.955140+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955140+0000","last_undegraded":"2024-09-15T22:44:20.955140+0000","last_fullsized":"2024-09-15T22:44:20.955140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951412+0000","last_change":"2024-09-15T22:44:20.951412+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951412+0000","last_undegraded":"2024-09-15T22:44:20.951412+0000","last_fullsized":"2024-09-15T22:44:20.951412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954184+0000","last_change":"2024-09-15T22:44:20.954184+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954184+0000","last_undegraded":"2024-09-15T22:44:20.954184+0000","last_fullsized":"2024-09-15T22:44:20.954184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953978+0000","last_change":"2024-09-15T22:44:20.953978+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953978+0000","last_undegraded":"2024-09-15T22:44:20.953978+0000","last_fullsized":"2024-09-15T22:44:20.953978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954614+0000","last_change":"2024-09-15T22:44:20.954614+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954614+0000","last_undegraded":"2024-09-15T22:44:20.954614+0000","last_fullsized":"2024-09-15T22:44:20.954614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954332+0000","last_change":"2024-09-15T22:44:20.954332+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954332+0000","last_undegraded":"2024-09-15T22:44:20.954332+0000","last_fullsized":"2024-09-15T22:44:20.954332+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952789+0000","last_change":"2024-09-15T22:44:20.952789+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952789+0000","last_undegraded":"2024-09-15T22:44:20.952789+0000","last_fullsized":"2024-09-15T22:44:20.952789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950008+0000","last_change":"2024-09-15T22:44:20.950008+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950008+0000","last_undegraded":"2024-09-15T22:44:20.950008+0000","last_fullsized":"2024-09-15T22:44:20.950008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971645+0000","last_change":"2024-09-15T22:44:21.966181+0000","last_active":"2024-09-15T22:44:22.971645+0000","last_peered":"2024-09-15T22:44:22.971645+0000","last_clean":"2024-09-15T22:44:22.971645+0000","last_became_active":"2024-09-15T22:44:21.965759+0000","last_became_peered":"2024-09-15T22:44:21.965759+0000","last_unstale":"2024-09-15T22:44:22.971645+0000","last_undegraded":"2024-09-15T22:44:22.971645+0000","last_fullsized":"2024-09-15T22:44:22.971645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:16.195412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961751+0000","last_change":"2024-09-15T22:44:20.959633+0000","last_active":"2024-09-15T22:44:20.961751+0000","last_peered":"2024-09-15T22:44:20.961751+0000","last_clean":"2024-09-15T22:44:20.961751+0000","last_became_active":"2024-09-15T22:44:20.959320+0000","last_became_peered":"2024-09-15T22:44:20.959320+0000","last_unstale":"2024-09-15T22:44:20.961751+0000","last_undegraded":"2024-09-15T22:44:20.961751+0000","last_fullsized":"2024-09-15T22:44:20.961751+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971803+0000","last_change":"2024-09-15T22:44:21.972701+0000","last_active":"2024-09-15T22:44:22.971803+0000","last_peered":"2024-09-15T22:44:22.971803+0000","last_clean":"2024-09-15T22:44:22.971803+0000","last_became_active":"2024-09-15T22:44:21.972403+0000","last_became_peered":"2024-09-15T22:44:21.972403+0000","last_unstale":"2024-09-15T22:44:22.971803+0000","last_undegraded":"2024-09-15T22:44:22.971803+0000","last_fullsized":"2024-09-15T22:44:22.971803+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:38.902404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966768+0000","last_change":"2024-09-15T22:44:20.965481+0000","last_active":"2024-09-15T22:44:20.966768+0000","last_peered":"2024-09-15T22:44:20.966768+0000","last_clean":"2024-09-15T22:44:20.966768+0000","last_became_active":"2024-09-15T22:44:20.965218+0000","last_became_peered":"2024-09-15T22:44:20.965218+0000","last_unstale":"2024-09-15T22:44:20.966768+0000","last_undegraded":"2024-09-15T22:44:20.966768+0000","last_fullsized":"2024-09-15T22:44:20.966768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953461+0000","last_change":"2024-09-15T22:44:20.953461+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953461+0000","last_undegraded":"2024-09-15T22:44:20.953461+0000","last_fullsized":"2024-09-15T22:44:20.953461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971591+0000","last_change":"2024-09-15T22:44:20.963289+0000","last_active":"2024-09-15T22:44:22.971591+0000","last_peered":"2024-09-15T22:44:22.971591+0000","last_clean":"2024-09-15T22:44:22.971591+0000","last_became_active":"2024-09-15T22:44:20.963013+0000","last_became_peered":"2024-09-15T22:44:20.963013+0000","last_unstale":"2024-09-15T22:44:22.971591+0000","last_undegraded":"2024-09-15T22:44:22.971591+0000","last_fullsized":"2024-09-15T22:44:22.971591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:26.208450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971501+0000","last_change":"2024-09-15T22:44:21.970159+0000","last_active":"2024-09-15T22:44:22.971501+0000","last_peered":"2024-09-15T22:44:22.971501+0000","last_clean":"2024-09-15T22:44:22.971501+0000","last_became_active":"2024-09-15T22:44:21.969890+0000","last_became_peered":"2024-09-15T22:44:21.969890+0000","last_unstale":"2024-09-15T22:44:22.971501+0000","last_undegraded":"2024-09-15T22:44:22.971501+0000","last_fullsized":"2024-09-15T22:44:22.971501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:11.500124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967704+0000","last_change":"2024-09-15T22:44:20.965106+0000","last_active":"2024-09-15T22:44:20.967704+0000","last_peered":"2024-09-15T22:44:20.967704+0000","last_clean":"2024-09-15T22:44:20.967704+0000","last_became_active":"2024-09-15T22:44:20.964830+0000","last_became_peered":"2024-09-15T22:44:20.964830+0000","last_unstale":"2024-09-15T22:44:20.967704+0000","last_undegraded":"2024-09-15T22:44:20.967704+0000","last_fullsized":"2024-09-15T22:44:20.967704+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:17.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953623+0000","last_change":"2024-09-15T22:44:20.953623+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953623+0000","last_undegraded":"2024-09-15T22:44:20.953623+0000","last_fullsized":"2024-09-15T22:44:20.953623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.969270+0000","last_change":"2024-09-15T22:44:20.967792+0000","last_active":"2024-09-15T22:44:20.969270+0000","last_peered":"2024-09-15T22:44:20.969270+0000","last_clean":"2024-09-15T22:44:20.969270+0000","last_became_active":"2024-09-15T22:44:20.967471+0000","last_became_peered":"2024-09-15T22:44:20.967471+0000","last_unstale":"2024-09-15T22:44:20.969270+0000","last_undegraded":"2024-09-15T22:44:20.969270+0000","last_fullsized":"2024-09-15T22:44:20.969270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.655871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949945+0000","last_change":"2024-09-15T22:44:20.949945+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949945+0000","last_undegraded":"2024-09-15T22:44:20.949945+0000","last_fullsized":"2024-09-15T22:44:20.949945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971435+0000","last_change":"2024-09-15T22:44:20.965421+0000","last_active":"2024-09-15T22:44:22.971435+0000","last_peered":"2024-09-15T22:44:22.971435+0000","last_clean":"2024-09-15T22:44:22.971435+0000","last_became_active":"2024-09-15T22:44:20.965146+0000","last_became_peered":"2024-09-15T22:44:20.965146+0000","last_unstale":"2024-09-15T22:44:22.971435+0000","last_undegraded":"2024-09-15T22:44:22.971435+0000","last_fullsized":"2024-09-15T22:44:22.971435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:46.174738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954042+0000","last_change":"2024-09-15T22:44:20.954042+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954042+0000","last_undegraded":"2024-09-15T22:44:20.954042+0000","last_fullsized":"2024-09-15T22:44:20.954042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961018+0000","last_change":"2024-09-15T22:44:20.958649+0000","last_active":"2024-09-15T22:44:20.961018+0000","last_peered":"2024-09-15T22:44:20.961018+0000","last_clean":"2024-09-15T22:44:20.961018+0000","last_became_active":"2024-09-15T22:44:20.958340+0000","last_became_peered":"2024-09-15T22:44:20.958340+0000","last_unstale":"2024-09-15T22:44:20.961018+0000","last_undegraded":"2024-09-15T22:44:20.961018+0000","last_fullsized":"2024-09-15T22:44:20.961018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:48.760192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970842+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.970583+0000","last_became_peered":"2024-09-15T22:44:21.970583+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:51.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.957529+0000","last_change":"2024-09-15T22:44:20.954064+0000","last_active":"2024-09-15T22:44:20.957529+0000","last_peered":"2024-09-15T22:44:20.957529+0000","last_clean":"2024-09-15T22:44:20.957529+0000","last_became_active":"2024-09-15T22:44:20.953807+0000","last_became_peered":"2024-09-15T22:44:20.953807+0000","last_unstale":"2024-09-15T22:44:20.957529+0000","last_undegraded":"2024-09-15T22:44:20.957529+0000","last_fullsized":"2024-09-15T22:44:20.957529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.287896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950882+0000","last_change":"2024-09-15T22:44:20.950882+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950882+0000","last_undegraded":"2024-09-15T22:44:20.950882+0000","last_fullsized":"2024-09-15T22:44:20.950882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.963178+0000","last_change":"2024-09-15T22:44:20.959186+0000","last_active":"2024-09-15T22:44:20.963178+0000","last_peered":"2024-09-15T22:44:20.963178+0000","last_clean":"2024-09-15T22:44:20.963178+0000","last_became_active":"2024-09-15T22:44:20.958905+0000","last_became_peered":"2024-09-15T22:44:20.958905+0000","last_unstale":"2024-09-15T22:44:20.963178+0000","last_undegraded":"2024-09-15T22:44:20.963178+0000","last_fullsized":"2024-09-15T22:44:20.963178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955958+0000","last_change":"2024-09-15T22:44:20.955958+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955958+0000","last_undegraded":"2024-09-15T22:44:20.955958+0000","last_fullsized":"2024-09-15T22:44:20.955958+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965079+0000","last_change":"2024-09-15T22:44:20.963252+0000","last_active":"2024-09-15T22:44:20.965079+0000","last_peered":"2024-09-15T22:44:20.965079+0000","last_clean":"2024-09-15T22:44:20.965079+0000","last_became_active":"2024-09-15T22:44:20.962903+0000","last_became_peered":"2024-09-15T22:44:20.962903+0000","last_unstale":"2024-09-15T22:44:20.965079+0000","last_undegraded":"2024-09-15T22:44:20.965079+0000","last_fullsized":"2024-09-15T22:44:20.965079+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:47.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952920+0000","last_change":"2024-09-15T22:44:20.952920+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952920+0000","last_undegraded":"2024-09-15T22:44:20.952920+0000","last_fullsized":"2024-09-15T22:44:20.952920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967745+0000","last_change":"2024-09-15T22:44:20.965734+0000","last_active":"2024-09-15T22:44:20.967745+0000","last_peered":"2024-09-15T22:44:20.967745+0000","last_clean":"2024-09-15T22:44:20.967745+0000","last_became_active":"2024-09-15T22:44:20.965475+0000","last_became_peered":"2024-09-15T22:44:20.965475+0000","last_unstale":"2024-09-15T22:44:20.967745+0000","last_undegraded":"2024-09-15T22:44:20.967745+0000","last_fullsized":"2024-09-15T22:44:20.967745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:32.592300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954960+0000","last_change":"2024-09-15T22:44:20.954960+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954960+0000","last_undegraded":"2024-09-15T22:44:20.954960+0000","last_fullsized":"2024-09-15T22:44:20.954960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965064+0000","last_change":"2024-09-15T22:44:20.963930+0000","last_active":"2024-09-15T22:44:20.965064+0000","last_peered":"2024-09-15T22:44:20.965064+0000","last_clean":"2024-09-15T22:44:20.965064+0000","last_became_active":"2024-09-15T22:44:20.963655+0000","last_became_peered":"2024-09-15T22:44:20.963655+0000","last_unstale":"2024-09-15T22:44:20.965064+0000","last_undegraded":"2024-09-15T22:44:20.965064+0000","last_fullsized":"2024-09-15T22:44:20.965064+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:44.797569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952619+0000","last_change":"2024-09-15T22:44:20.952619+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952619+0000","last_undegraded":"2024-09-15T22:44:20.952619+0000","last_fullsized":"2024-09-15T22:44:20.952619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965008+0000","last_change":"2024-09-15T22:44:20.963287+0000","last_active":"2024-09-15T22:44:20.965008+0000","last_peered":"2024-09-15T22:44:20.965008+0000","last_clean":"2024-09-15T22:44:20.965008+0000","last_became_active":"2024-09-15T22:44:20.962848+0000","last_became_peered":"2024-09-15T22:44:20.962848+0000","last_unstale":"2024-09-15T22:44:20.965008+0000","last_undegraded":"2024-09-15T22:44:20.965008+0000","last_fullsized":"2024-09-15T22:44:20.965008+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.449490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956121+0000","last_change":"2024-09-15T22:44:20.956121+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956121+0000","last_undegraded":"2024-09-15T22:44:20.956121+0000","last_fullsized":"2024-09-15T22:44:20.956121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966482+0000","last_change":"2024-09-15T22:44:20.963978+0000","last_active":"2024-09-15T22:44:20.966482+0000","last_peered":"2024-09-15T22:44:20.966482+0000","last_clean":"2024-09-15T22:44:20.966482+0000","last_became_active":"2024-09-15T22:44:20.963698+0000","last_became_peered":"2024-09-15T22:44:20.963698+0000","last_unstale":"2024-09-15T22:44:20.966482+0000","last_undegraded":"2024-09-15T22:44:20.966482+0000","last_fullsized":"2024-09-15T22:44:20.966482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:26.366026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952315+0000","last_change":"2024-09-15T22:44:20.952315+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952315+0000","last_undegraded":"2024-09-15T22:44:20.952315+0000","last_fullsized":"2024-09-15T22:44:20.952315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961610+0000","last_change":"2024-09-15T22:44:20.959952+0000","last_active":"2024-09-15T22:44:20.961610+0000","last_peered":"2024-09-15T22:44:20.961610+0000","last_clean":"2024-09-15T22:44:20.961610+0000","last_became_active":"2024-09-15T22:44:20.959667+0000","last_became_peered":"2024-09-15T22:44:20.959667+0000","last_unstale":"2024-09-15T22:44:20.961610+0000","last_undegraded":"2024-09-15T22:44:20.961610+0000","last_fullsized":"2024-09-15T22:44:20.961610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:29.532785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953076+0000","last_change":"2024-09-15T22:44:20.953076+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953076+0000","last_undegraded":"2024-09-15T22:44:20.953076+0000","last_fullsized":"2024-09-15T22:44:20.953076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.962787+0000","last_change":"2024-09-15T22:44:20.960790+0000","last_active":"2024-09-15T22:44:20.962787+0000","last_peered":"2024-09-15T22:44:20.962787+0000","last_clean":"2024-09-15T22:44:20.962787+0000","last_became_active":"2024-09-15T22:44:20.960509+0000","last_became_peered":"2024-09-15T22:44:20.960509+0000","last_unstale":"2024-09-15T22:44:20.962787+0000","last_undegraded":"2024-09-15T22:44:20.962787+0000","last_fullsized":"2024-09-15T22:44:20.962787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:52.822369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955910+0000","last_change":"2024-09-15T22:44:20.955910+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955910+0000","last_undegraded":"2024-09-15T22:44:20.955910+0000","last_fullsized":"2024-09-15T22:44:20.955910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968659+0000","last_change":"2024-09-15T22:44:20.967358+0000","last_active":"2024-09-15T22:44:20.968659+0000","last_peered":"2024-09-15T22:44:20.968659+0000","last_clean":"2024-09-15T22:44:20.968659+0000","last_became_active":"2024-09-15T22:44:20.966982+0000","last_became_peered":"2024-09-15T22:44:20.966982+0000","last_unstale":"2024-09-15T22:44:20.968659+0000","last_undegraded":"2024-09-15T22:44:20.968659+0000","last_fullsized":"2024-09-15T22:44:20.968659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955223+0000","last_change":"2024-09-15T22:44:20.955223+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955223+0000","last_undegraded":"2024-09-15T22:44:20.955223+0000","last_fullsized":"2024-09-15T22:44:20.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966258+0000","last_change":"2024-09-15T22:44:20.963170+0000","last_active":"2024-09-15T22:44:20.966258+0000","last_peered":"2024-09-15T22:44:20.966258+0000","last_clean":"2024-09-15T22:44:20.966258+0000","last_became_active":"2024-09-15T22:44:20.962837+0000","last_became_peered":"2024-09-15T22:44:20.962837+0000","last_unstale":"2024-09-15T22:44:20.966258+0000","last_undegraded":"2024-09-15T22:44:20.966258+0000","last_fullsized":"2024-09-15T22:44:20.966258+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953715+0000","last_change":"2024-09-15T22:44:20.953715+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953715+0000","last_undegraded":"2024-09-15T22:44:20.953715+0000","last_fullsized":"2024-09-15T22:44:20.953715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965391+0000","last_change":"2024-09-15T22:44:20.963980+0000","last_active":"2024-09-15T22:44:20.965391+0000","last_peered":"2024-09-15T22:44:20.965391+0000","last_clean":"2024-09-15T22:44:20.965391+0000","last_became_active":"2024-09-15T22:44:20.963718+0000","last_became_peered":"2024-09-15T22:44:20.963718+0000","last_unstale":"2024-09-15T22:44:20.965391+0000","last_undegraded":"2024-09-15T22:44:20.965391+0000","last_fullsized":"2024-09-15T22:44:20.965391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.705907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954597+0000","last_change":"2024-09-15T22:44:20.954597+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954597+0000","last_undegraded":"2024-09-15T22:44:20.954597+0000","last_fullsized":"2024-09-15T22:44:20.954597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967623+0000","last_change":"2024-09-15T22:44:20.964846+0000","last_active":"2024-09-15T22:44:20.967623+0000","last_peered":"2024-09-15T22:44:20.967623+0000","last_clean":"2024-09-15T22:44:20.967623+0000","last_became_active":"2024-09-15T22:44:20.964581+0000","last_became_peered":"2024-09-15T22:44:20.964581+0000","last_unstale":"2024-09-15T22:44:20.967623+0000","last_undegraded":"2024-09-15T22:44:20.967623+0000","last_fullsized":"2024-09-15T22:44:20.967623+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:11.524812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952202+0000","last_change":"2024-09-15T22:44:20.952202+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952202+0000","last_undegraded":"2024-09-15T22:44:20.952202+0000","last_fullsized":"2024-09-15T22:44:20.952202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961268+0000","last_change":"2024-09-15T22:44:20.955951+0000","last_active":"2024-09-15T22:44:20.961268+0000","last_peered":"2024-09-15T22:44:20.961268+0000","last_clean":"2024-09-15T22:44:20.961268+0000","last_became_active":"2024-09-15T22:44:20.955657+0000","last_became_peered":"2024-09-15T22:44:20.955657+0000","last_unstale":"2024-09-15T22:44:20.961268+0000","last_undegraded":"2024-09-15T22:44:20.961268+0000","last_fullsized":"2024-09-15T22:44:20.961268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954193+0000","last_change":"2024-09-15T22:44:20.954193+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954193+0000","last_undegraded":"2024-09-15T22:44:20.954193+0000","last_fullsized":"2024-09-15T22:44:20.954193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965026+0000","last_change":"2024-09-15T22:44:20.963436+0000","last_active":"2024-09-15T22:44:20.965026+0000","last_peered":"2024-09-15T22:44:20.965026+0000","last_clean":"2024-09-15T22:44:20.965026+0000","last_became_active":"2024-09-15T22:44:20.962857+0000","last_became_peered":"2024-09-15T22:44:20.962857+0000","last_unstale":"2024-09-15T22:44:20.965026+0000","last_undegraded":"2024-09-15T22:44:20.965026+0000","last_fullsized":"2024-09-15T22:44:20.965026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:35.783303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952815+0000","last_change":"2024-09-15T22:44:20.952815+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952815+0000","last_undegraded":"2024-09-15T22:44:20.952815+0000","last_fullsized":"2024-09-15T22:44:20.952815+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966857+0000","last_change":"2024-09-15T22:44:20.965332+0000","last_active":"2024-09-15T22:44:20.966857+0000","last_peered":"2024-09-15T22:44:20.966857+0000","last_clean":"2024-09-15T22:44:20.966857+0000","last_became_active":"2024-09-15T22:44:20.965024+0000","last_became_peered":"2024-09-15T22:44:20.965024+0000","last_unstale":"2024-09-15T22:44:20.966857+0000","last_undegraded":"2024-09-15T22:44:20.966857+0000","last_fullsized":"2024-09-15T22:44:20.966857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955437+0000","last_change":"2024-09-15T22:44:20.955437+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955437+0000","last_undegraded":"2024-09-15T22:44:20.955437+0000","last_fullsized":"2024-09-15T22:44:20.955437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966197+0000","last_change":"2024-09-15T22:44:20.964770+0000","last_active":"2024-09-15T22:44:20.966197+0000","last_peered":"2024-09-15T22:44:20.966197+0000","last_clean":"2024-09-15T22:44:20.966197+0000","last_became_active":"2024-09-15T22:44:20.964468+0000","last_became_peered":"2024-09-15T22:44:20.964468+0000","last_unstale":"2024-09-15T22:44:20.966197+0000","last_undegraded":"2024-09-15T22:44:20.966197+0000","last_fullsized":"2024-09-15T22:44:20.966197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954757+0000","last_change":"2024-09-15T22:44:20.954757+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954757+0000","last_undegraded":"2024-09-15T22:44:20.954757+0000","last_fullsized":"2024-09-15T22:44:20.954757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971699+0000","last_change":"2024-09-15T22:44:20.964367+0000","last_active":"2024-09-15T22:44:22.971699+0000","last_peered":"2024-09-15T22:44:22.971699+0000","last_clean":"2024-09-15T22:44:22.971699+0000","last_became_active":"2024-09-15T22:44:20.964060+0000","last_became_peered":"2024-09-15T22:44:20.964060+0000","last_unstale":"2024-09-15T22:44:22.971699+0000","last_undegraded":"2024-09-15T22:44:22.971699+0000","last_fullsized":"2024-09-15T22:44:22.971699+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:15.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953263+0000","last_change":"2024-09-15T22:44:20.953263+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953263+0000","last_undegraded":"2024-09-15T22:44:20.953263+0000","last_fullsized":"2024-09-15T22:44:20.953263+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965323+0000","last_change":"2024-09-15T22:44:20.962967+0000","last_active":"2024-09-15T22:44:20.965323+0000","last_peered":"2024-09-15T22:44:20.965323+0000","last_clean":"2024-09-15T22:44:20.965323+0000","last_became_active":"2024-09-15T22:44:20.962621+0000","last_became_peered":"2024-09-15T22:44:20.962621+0000","last_unstale":"2024-09-15T22:44:20.965323+0000","last_undegraded":"2024-09-15T22:44:20.965323+0000","last_fullsized":"2024-09-15T22:44:20.965323+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953112+0000","last_change":"2024-09-15T22:44:20.953112+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953112+0000","last_undegraded":"2024-09-15T22:44:20.953112+0000","last_fullsized":"2024-09-15T22:44:20.953112+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967962+0000","last_change":"2024-09-15T22:44:20.966571+0000","last_active":"2024-09-15T22:44:20.967962+0000","last_peered":"2024-09-15T22:44:20.967962+0000","last_clean":"2024-09-15T22:44:20.967962+0000","last_became_active":"2024-09-15T22:44:20.966183+0000","last_became_peered":"2024-09-15T22:44:20.966183+0000","last_unstale":"2024-09-15T22:44:20.967962+0000","last_undegraded":"2024-09-15T22:44:20.967962+0000","last_fullsized":"2024-09-15T22:44:20.967962+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:42.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971326+0000","last_change":"2024-09-15T22:44:21.975311+0000","last_active":"2024-09-15T22:44:22.971326+0000","last_peered":"2024-09-15T22:44:22.971326+0000","last_clean":"2024-09-15T22:44:22.971326+0000","last_became_active":"2024-09-15T22:44:21.975052+0000","last_became_peered":"2024-09-15T22:44:21.975052+0000","last_unstale":"2024-09-15T22:44:22.971326+0000","last_undegraded":"2024-09-15T22:44:22.971326+0000","last_fullsized":"2024-09-15T22:44:22.971326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:03.634300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968671+0000","last_change":"2024-09-15T22:44:20.967962+0000","last_active":"2024-09-15T22:44:20.968671+0000","last_peered":"2024-09-15T22:44:20.968671+0000","last_clean":"2024-09-15T22:44:20.968671+0000","last_became_active":"2024-09-15T22:44:20.967669+0000","last_became_peered":"2024-09-15T22:44:20.967669+0000","last_unstale":"2024-09-15T22:44:20.968671+0000","last_undegraded":"2024-09-15T22:44:20.968671+0000","last_fullsized":"2024-09-15T22:44:20.968671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:44.093894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951537+0000","last_change":"2024-09-15T22:44:20.951537+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951537+0000","last_undegraded":"2024-09-15T22:44:20.951537+0000","last_fullsized":"2024-09-15T22:44:20.951537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964290+0000","last_change":"2024-09-15T22:44:20.962150+0000","last_active":"2024-09-15T22:44:20.964290+0000","last_peered":"2024-09-15T22:44:20.964290+0000","last_clean":"2024-09-15T22:44:20.964290+0000","last_became_active":"2024-09-15T22:44:20.961861+0000","last_became_peered":"2024-09-15T22:44:20.961861+0000","last_unstale":"2024-09-15T22:44:20.964290+0000","last_undegraded":"2024-09-15T22:44:20.964290+0000","last_fullsized":"2024-09-15T22:44:20.964290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:07.460468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953886+0000","last_change":"2024-09-15T22:44:20.953886+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953886+0000","last_undegraded":"2024-09-15T22:44:20.953886+0000","last_fullsized":"2024-09-15T22:44:20.953886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971148+0000","last_change":"2024-09-15T22:44:20.962947+0000","last_active":"2024-09-15T22:44:22.971148+0000","last_peered":"2024-09-15T22:44:22.971148+0000","last_clean":"2024-09-15T22:44:22.971148+0000","last_became_active":"2024-09-15T22:44:20.962625+0000","last_became_peered":"2024-09-15T22:44:20.962625+0000","last_unstale":"2024-09-15T22:44:22.971148+0000","last_undegraded":"2024-09-15T22:44:22.971148+0000","last_fullsized":"2024-09-15T22:44:22.971148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:03.363102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952329+0000","last_change":"2024-09-15T22:44:20.952329+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952329+0000","last_undegraded":"2024-09-15T22:44:20.952329+0000","last_fullsized":"2024-09-15T22:44:20.952329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964098+0000","last_change":"2024-09-15T22:44:20.961177+0000","last_active":"2024-09-15T22:44:20.964098+0000","last_peered":"2024-09-15T22:44:20.964098+0000","last_clean":"2024-09-15T22:44:20.964098+0000","last_became_active":"2024-09-15T22:44:20.960859+0000","last_became_peered":"2024-09-15T22:44:20.960859+0000","last_unstale":"2024-09-15T22:44:20.964098+0000","last_undegraded":"2024-09-15T22:44:20.964098+0000","last_fullsized":"2024-09-15T22:44:20.964098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952588+0000","last_change":"2024-09-15T22:44:20.952588+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952588+0000","last_undegraded":"2024-09-15T22:44:20.952588+0000","last_fullsized":"2024-09-15T22:44:20.952588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.960629+0000","last_change":"2024-09-15T22:44:20.959715+0000","last_active":"2024-09-15T22:44:20.960629+0000","last_peered":"2024-09-15T22:44:20.960629+0000","last_clean":"2024-09-15T22:44:20.960629+0000","last_became_active":"2024-09-15T22:44:20.957914+0000","last_became_peered":"2024-09-15T22:44:20.957914+0000","last_unstale":"2024-09-15T22:44:20.960629+0000","last_undegraded":"2024-09-15T22:44:20.960629+0000","last_fullsized":"2024-09-15T22:44:20.960629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:30.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.953258+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:20.953258+0000","last_peered":"2024-09-15T22:44:20.953258+0000","last_clean":"2024-09-15T22:44:20.953258+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:20.953258+0000","last_undegraded":"2024-09-15T22:44:20.953258+0000","last_fullsized":"2024-09-15T22:44:20.953258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":299454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:26.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:44:26.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.374+0000 7f498bd2c640 1 Processor -- start 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.374+0000 7f498bd2c640 1 -- start start 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f498bd2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f498415ceb0 0x7f49841594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f498bd2c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498415d390 con 0x7f49840d02a0 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f498bd2c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498415d670 con 0x7f498415ca40 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f498bd2c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f498415d950 con 0x7f498415ceb0 2024-09-15T22:44:26.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f4989ac8640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f49840d02a0 0x7f49840d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52612/0 (socket says 172.21.15.134:52612) 2024-09-15T22:44:26.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f4989ac8640 1 -- 172.21.15.134:0/2616786308 learned_addr learned my addr 172.21.15.134:0/2616786308 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:26.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f498a2c9640 1 --2- 172.21.15.134:0/2616786308 >> v2:172.21.15.177:3300/0 conn(0x7f498415ceb0 0x7f49841594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251314614 0 0) 0x7f498415d390 con 0x7f49840d02a0 2024-09-15T22:44:26.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.375+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4970003520 con 0x7f49840d02a0 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 642555972 0 0) 0x7f4970003520 con 0x7f49840d02a0 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 >> v2:172.21.15.177:3300/0 conn(0x7f498415ceb0 msgr2=0x7f49841594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 --2- 172.21.15.134:0/2616786308 >> v2:172.21.15.177:3300/0 conn(0x7f498415ceb0 0x7f49841594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 >> v1:172.21.15.177:6789/0 conn(0x7f498415ca40 legacy=0x7f498415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498415dc30 con 0x7f49840d02a0 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f4980001670 con 0x7f49840d02a0 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 >> v1:172.21.15.134:6789/0 conn(0x7f49840d02a0 legacy=0x7f49840d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700039b0 0x7f4970003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4970004800 0x7f4970004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 0x7f497000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f498415d950 con 0x7f49700051c0 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f497000c160 con 0x7f4970004800 2024-09-15T22:44:26.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f497000c360 con 0x7f49700039b0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 0x7f497000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f4989ac8640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700039b0 0x7f4970003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f49892c7640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4970004800 0x7f4970004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 -- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700039b0 msgr2=0x7f4970003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700039b0 0x7f4970003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 -- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4970004800 msgr2=0x7f4970004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4970004800 0x7f4970004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.376+0000 7f498a2c9640 1 -- 172.21.15.134:0/2616786308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4970003520 con 0x7f49700051c0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.377+0000 7f498a2c9640 1 -- 172.21.15.134:0/2616786308 reap_dead start 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.377+0000 7f498a2c9640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 0x7f497000b9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f497c009f90 tx=0x7f4970005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428a8ac2210eacee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.377+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c035020 con 0x7f49700051c0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.377+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c003b90 con 0x7f49700051c0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.377+0000 7f4988ac6640 1 -- 172.21.15.134:0/2616786308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c009c10 con 0x7f49700051c0 2024-09-15T22:44:26.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 -- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 msgr2=0x7f497000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 0x7f497000b9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f497c009f90 tx=0x7f4970005830 comp rx=0 tx=0).stop 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 -- 172.21.15.134:0/2616786308 shutdown_connections 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 --2- 172.21.15.134:0/2616786308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49700051c0 0x7f497000b9c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 -- 172.21.15.134:0/2616786308 >> 172.21.15.134:0/2616786308 conn(0x7f4984062cc0 msgr2=0x7f498406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 -- 172.21.15.134:0/2616786308 shutdown_connections 2024-09-15T22:44:26.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.378+0000 7f498bd2c640 1 -- 172.21.15.134:0/2616786308 wait complete. 2024-09-15T22:44:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.379+0000 7f498bd2c640 1 Processor -- start 2024-09-15T22:44:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.379+0000 7f498bd2c640 1 -- start start 2024-09-15T22:44:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700051c0 0x7f4984073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4984158620 0x7f4984158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4984155d10 con 0x7f49840b0380 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4984155b90 con 0x7f4984158620 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f49840b4790 con 0x7f49700051c0 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52048/0 (socket says 172.21.15.134:52048) 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 -- 172.21.15.134:0/3995781619 learned_addr learned my addr 172.21.15.134:0/3995781619 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f4989ac8640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700051c0 0x7f4984073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498a2c9640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4984158620 0x7f4984158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 -- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700051c0 msgr2=0x7f4984073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700051c0 0x7f4984073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 -- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4984158620 msgr2=0x7f4984158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4984158620 0x7f4984158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 -- 172.21.15.134:0/3995781619 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49840735f0 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f49892c7640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f497400f620 tx=0x7f497400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740052e0 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974018070 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4984157b40 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974003810 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.380+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4984158100 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.381+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49840d0680 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.382+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f49740039b0 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.382+0000 7f497a7fc640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 0x7f496806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.383+0000 7f4989ac8640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 0x7f496806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.383+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f497408b4b0 con 0x7f49840b0380 2024-09-15T22:44:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.383+0000 7f4989ac8640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 0x7f496806e920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4980001eb0 tx=0x7f4980009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.387+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4974059a30 con 0x7f49840b0380 2024-09-15T22:44:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.550+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f498414bec0 con 0x7f496806c460 2024-09-15T22:44:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.556+0000 7f497a7fc640 1 -- 172.21.15.134:0/3995781619 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247544 (secure 0 0 0) 0x7f4980007720 con 0x7f496806c460 2024-09-15T22:44:26.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 msgr2=0x7f496806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 0x7f496806e920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4980001eb0 tx=0x7f4980009040 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 msgr2=0x7f498414b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f497400f620 tx=0x7f497400fae0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 shutdown_connections 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f496806c460 0x7f496806e920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4984158620 0x7f4984158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49840b0380 0x7f498414b980 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 --2- 172.21.15.134:0/3995781619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49700051c0 0x7f4984073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 >> 172.21.15.134:0/3995781619 conn(0x7f4984062cc0 msgr2=0x7f49840b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 shutdown_connections 2024-09-15T22:44:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.559+0000 7f498bd2c640 1 -- 172.21.15.134:0/3995781619 wait complete. 2024-09-15T22:44:26.571 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-15T22:44:24.987135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227020,"kb_used_data":6576,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747700,"statfs":{"total":773094113280,"available":772861644800,"internally_reserved":0,"allocated":6733824,"data_stored":3440764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044199"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971718+0000","last_change":"2024-09-15T22:44:21.964019+0000","last_active":"2024-09-15T22:44:22.971718+0000","last_peered":"2024-09-15T22:44:22.971718+0000","last_clean":"2024-09-15T22:44:22.971718+0000","last_became_active":"2024-09-15T22:44:21.963745+0000","last_became_peered":"2024-09-15T22:44:21.963745+0000","last_unstale":"2024-09-15T22:44:22.971718+0000","last_undegraded":"2024-09-15T22:44:22.971718+0000","last_fullsized":"2024-09-15T22:44:22.971718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:08.177048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955211+0000","last_change":"2024-09-15T22:44:20.955211+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955211+0000","last_undegraded":"2024-09-15T22:44:20.955211+0000","last_fullsized":"2024-09-15T22:44:20.955211+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955662+0000","last_change":"2024-09-15T22:44:20.955662+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955662+0000","last_undegraded":"2024-09-15T22:44:20.955662+0000","last_fullsized":"2024-09-15T22:44:20.955662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953143+0000","last_change":"2024-09-15T22:44:20.953143+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953143+0000","last_undegraded":"2024-09-15T22:44:20.953143+0000","last_fullsized":"2024-09-15T22:44:20.953143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971364+0000","last_change":"2024-09-15T22:44:21.969484+0000","last_active":"2024-09-15T22:44:22.971364+0000","last_peered":"2024-09-15T22:44:22.971364+0000","last_clean":"2024-09-15T22:44:22.971364+0000","last_became_active":"2024-09-15T22:44:21.969069+0000","last_became_peered":"2024-09-15T22:44:21.969069+0000","last_unstale":"2024-09-15T22:44:22.971364+0000","last_undegraded":"2024-09-15T22:44:22.971364+0000","last_fullsized":"2024-09-15T22:44:22.971364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:55.828144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971290+0000","last_change":"2024-09-15T22:44:21.976008+0000","last_active":"2024-09-15T22:44:22.971290+0000","last_peered":"2024-09-15T22:44:22.971290+0000","last_clean":"2024-09-15T22:44:22.971290+0000","last_became_active":"2024-09-15T22:44:21.975743+0000","last_became_peered":"2024-09-15T22:44:21.975743+0000","last_unstale":"2024-09-15T22:44:22.971290+0000","last_undegraded":"2024-09-15T22:44:22.971290+0000","last_fullsized":"2024-09-15T22:44:22.971290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:25.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953874+0000","last_change":"2024-09-15T22:44:20.953874+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953874+0000","last_undegraded":"2024-09-15T22:44:20.953874+0000","last_fullsized":"2024-09-15T22:44:20.953874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954377+0000","last_change":"2024-09-15T22:44:20.954377+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954377+0000","last_undegraded":"2024-09-15T22:44:20.954377+0000","last_fullsized":"2024-09-15T22:44:20.954377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952054+0000","last_change":"2024-09-15T22:44:20.952054+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952054+0000","last_undegraded":"2024-09-15T22:44:20.952054+0000","last_fullsized":"2024-09-15T22:44:20.952054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971583+0000","last_change":"2024-09-15T22:44:21.964323+0000","last_active":"2024-09-15T22:44:22.971583+0000","last_peered":"2024-09-15T22:44:22.971583+0000","last_clean":"2024-09-15T22:44:22.971583+0000","last_became_active":"2024-09-15T22:44:21.964031+0000","last_became_peered":"2024-09-15T22:44:21.964031+0000","last_unstale":"2024-09-15T22:44:22.971583+0000","last_undegraded":"2024-09-15T22:44:22.971583+0000","last_fullsized":"2024-09-15T22:44:22.971583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:46.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950446+0000","last_change":"2024-09-15T22:44:20.950446+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950446+0000","last_undegraded":"2024-09-15T22:44:20.950446+0000","last_fullsized":"2024-09-15T22:44:20.950446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951705+0000","last_change":"2024-09-15T22:44:20.951705+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951705+0000","last_undegraded":"2024-09-15T22:44:20.951705+0000","last_fullsized":"2024-09-15T22:44:20.951705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952497+0000","last_change":"2024-09-15T22:44:20.952497+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952497+0000","last_undegraded":"2024-09-15T22:44:20.952497+0000","last_fullsized":"2024-09-15T22:44:20.952497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954831+0000","last_change":"2024-09-15T22:44:20.954831+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954831+0000","last_undegraded":"2024-09-15T22:44:20.954831+0000","last_fullsized":"2024-09-15T22:44:20.954831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952498+0000","last_change":"2024-09-15T22:44:20.952498+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952498+0000","last_undegraded":"2024-09-15T22:44:20.952498+0000","last_fullsized":"2024-09-15T22:44:20.952498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970162+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.969875+0000","last_became_peered":"2024-09-15T22:44:21.969875+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.172394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971765+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:22.971765+0000","last_peered":"2024-09-15T22:44:22.971765+0000","last_clean":"2024-09-15T22:44:22.971765+0000","last_became_active":"2024-09-15T22:44:21.961717+0000","last_became_peered":"2024-09-15T22:44:21.961717+0000","last_unstale":"2024-09-15T22:44:22.971765+0000","last_undegraded":"2024-09-15T22:44:22.971765+0000","last_fullsized":"2024-09-15T22:44:22.971765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:35.936792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956339+0000","last_change":"2024-09-15T22:44:20.956339+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956339+0000","last_undegraded":"2024-09-15T22:44:20.956339+0000","last_fullsized":"2024-09-15T22:44:20.956339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954600+0000","last_change":"2024-09-15T22:44:20.954600+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954600+0000","last_undegraded":"2024-09-15T22:44:20.954600+0000","last_fullsized":"2024-09-15T22:44:20.954600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950521+0000","last_change":"2024-09-15T22:44:20.950521+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950521+0000","last_undegraded":"2024-09-15T22:44:20.950521+0000","last_fullsized":"2024-09-15T22:44:20.950521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952010+0000","last_change":"2024-09-15T22:44:20.952010+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952010+0000","last_undegraded":"2024-09-15T22:44:20.952010+0000","last_fullsized":"2024-09-15T22:44:20.952010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949379+0000","last_change":"2024-09-15T22:44:20.949379+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949379+0000","last_undegraded":"2024-09-15T22:44:20.949379+0000","last_fullsized":"2024-09-15T22:44:20.949379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953465+0000","last_change":"2024-09-15T22:44:20.953465+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953465+0000","last_undegraded":"2024-09-15T22:44:20.953465+0000","last_fullsized":"2024-09-15T22:44:20.953465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952976+0000","last_change":"2024-09-15T22:44:20.952976+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952976+0000","last_undegraded":"2024-09-15T22:44:20.952976+0000","last_fullsized":"2024-09-15T22:44:20.952976+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955140+0000","last_change":"2024-09-15T22:44:20.955140+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955140+0000","last_undegraded":"2024-09-15T22:44:20.955140+0000","last_fullsized":"2024-09-15T22:44:20.955140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951412+0000","last_change":"2024-09-15T22:44:20.951412+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951412+0000","last_undegraded":"2024-09-15T22:44:20.951412+0000","last_fullsized":"2024-09-15T22:44:20.951412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954184+0000","last_change":"2024-09-15T22:44:20.954184+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954184+0000","last_undegraded":"2024-09-15T22:44:20.954184+0000","last_fullsized":"2024-09-15T22:44:20.954184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953978+0000","last_change":"2024-09-15T22:44:20.953978+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953978+0000","last_undegraded":"2024-09-15T22:44:20.953978+0000","last_fullsized":"2024-09-15T22:44:20.953978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954614+0000","last_change":"2024-09-15T22:44:20.954614+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954614+0000","last_undegraded":"2024-09-15T22:44:20.954614+0000","last_fullsized":"2024-09-15T22:44:20.954614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954332+0000","last_change":"2024-09-15T22:44:20.954332+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954332+0000","last_undegraded":"2024-09-15T22:44:20.954332+0000","last_fullsized":"2024-09-15T22:44:20.954332+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952789+0000","last_change":"2024-09-15T22:44:20.952789+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952789+0000","last_undegraded":"2024-09-15T22:44:20.952789+0000","last_fullsized":"2024-09-15T22:44:20.952789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950008+0000","last_change":"2024-09-15T22:44:20.950008+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950008+0000","last_undegraded":"2024-09-15T22:44:20.950008+0000","last_fullsized":"2024-09-15T22:44:20.950008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971645+0000","last_change":"2024-09-15T22:44:21.966181+0000","last_active":"2024-09-15T22:44:22.971645+0000","last_peered":"2024-09-15T22:44:22.971645+0000","last_clean":"2024-09-15T22:44:22.971645+0000","last_became_active":"2024-09-15T22:44:21.965759+0000","last_became_peered":"2024-09-15T22:44:21.965759+0000","last_unstale":"2024-09-15T22:44:22.971645+0000","last_undegraded":"2024-09-15T22:44:22.971645+0000","last_fullsized":"2024-09-15T22:44:22.971645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:16.195412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961751+0000","last_change":"2024-09-15T22:44:20.959633+0000","last_active":"2024-09-15T22:44:20.961751+0000","last_peered":"2024-09-15T22:44:20.961751+0000","last_clean":"2024-09-15T22:44:20.961751+0000","last_became_active":"2024-09-15T22:44:20.959320+0000","last_became_peered":"2024-09-15T22:44:20.959320+0000","last_unstale":"2024-09-15T22:44:20.961751+0000","last_undegraded":"2024-09-15T22:44:20.961751+0000","last_fullsized":"2024-09-15T22:44:20.961751+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971803+0000","last_change":"2024-09-15T22:44:21.972701+0000","last_active":"2024-09-15T22:44:22.971803+0000","last_peered":"2024-09-15T22:44:22.971803+0000","last_clean":"2024-09-15T22:44:22.971803+0000","last_became_active":"2024-09-15T22:44:21.972403+0000","last_became_peered":"2024-09-15T22:44:21.972403+0000","last_unstale":"2024-09-15T22:44:22.971803+0000","last_undegraded":"2024-09-15T22:44:22.971803+0000","last_fullsized":"2024-09-15T22:44:22.971803+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:38.902404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966768+0000","last_change":"2024-09-15T22:44:20.965481+0000","last_active":"2024-09-15T22:44:20.966768+0000","last_peered":"2024-09-15T22:44:20.966768+0000","last_clean":"2024-09-15T22:44:20.966768+0000","last_became_active":"2024-09-15T22:44:20.965218+0000","last_became_peered":"2024-09-15T22:44:20.965218+0000","last_unstale":"2024-09-15T22:44:20.966768+0000","last_undegraded":"2024-09-15T22:44:20.966768+0000","last_fullsized":"2024-09-15T22:44:20.966768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953461+0000","last_change":"2024-09-15T22:44:20.953461+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953461+0000","last_undegraded":"2024-09-15T22:44:20.953461+0000","last_fullsized":"2024-09-15T22:44:20.953461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971591+0000","last_change":"2024-09-15T22:44:20.963289+0000","last_active":"2024-09-15T22:44:22.971591+0000","last_peered":"2024-09-15T22:44:22.971591+0000","last_clean":"2024-09-15T22:44:22.971591+0000","last_became_active":"2024-09-15T22:44:20.963013+0000","last_became_peered":"2024-09-15T22:44:20.963013+0000","last_unstale":"2024-09-15T22:44:22.971591+0000","last_undegraded":"2024-09-15T22:44:22.971591+0000","last_fullsized":"2024-09-15T22:44:22.971591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:26.208450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971501+0000","last_change":"2024-09-15T22:44:21.970159+0000","last_active":"2024-09-15T22:44:22.971501+0000","last_peered":"2024-09-15T22:44:22.971501+0000","last_clean":"2024-09-15T22:44:22.971501+0000","last_became_active":"2024-09-15T22:44:21.969890+0000","last_became_peered":"2024-09-15T22:44:21.969890+0000","last_unstale":"2024-09-15T22:44:22.971501+0000","last_undegraded":"2024-09-15T22:44:22.971501+0000","last_fullsized":"2024-09-15T22:44:22.971501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:11.500124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967704+0000","last_change":"2024-09-15T22:44:20.965106+0000","last_active":"2024-09-15T22:44:20.967704+0000","last_peered":"2024-09-15T22:44:20.967704+0000","last_clean":"2024-09-15T22:44:20.967704+0000","last_became_active":"2024-09-15T22:44:20.964830+0000","last_became_peered":"2024-09-15T22:44:20.964830+0000","last_unstale":"2024-09-15T22:44:20.967704+0000","last_undegraded":"2024-09-15T22:44:20.967704+0000","last_fullsized":"2024-09-15T22:44:20.967704+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:17.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953623+0000","last_change":"2024-09-15T22:44:20.953623+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953623+0000","last_undegraded":"2024-09-15T22:44:20.953623+0000","last_fullsized":"2024-09-15T22:44:20.953623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.969270+0000","last_change":"2024-09-15T22:44:20.967792+0000","last_active":"2024-09-15T22:44:20.969270+0000","last_peered":"2024-09-15T22:44:20.969270+0000","last_clean":"2024-09-15T22:44:20.969270+0000","last_became_active":"2024-09-15T22:44:20.967471+0000","last_became_peered":"2024-09-15T22:44:20.967471+0000","last_unstale":"2024-09-15T22:44:20.969270+0000","last_undegraded":"2024-09-15T22:44:20.969270+0000","last_fullsized":"2024-09-15T22:44:20.969270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.655871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.949945+0000","last_change":"2024-09-15T22:44:20.949945+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.949945+0000","last_undegraded":"2024-09-15T22:44:20.949945+0000","last_fullsized":"2024-09-15T22:44:20.949945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971435+0000","last_change":"2024-09-15T22:44:20.965421+0000","last_active":"2024-09-15T22:44:22.971435+0000","last_peered":"2024-09-15T22:44:22.971435+0000","last_clean":"2024-09-15T22:44:22.971435+0000","last_became_active":"2024-09-15T22:44:20.965146+0000","last_became_peered":"2024-09-15T22:44:20.965146+0000","last_unstale":"2024-09-15T22:44:22.971435+0000","last_undegraded":"2024-09-15T22:44:22.971435+0000","last_fullsized":"2024-09-15T22:44:22.971435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:46.174738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954042+0000","last_change":"2024-09-15T22:44:20.954042+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954042+0000","last_undegraded":"2024-09-15T22:44:20.954042+0000","last_fullsized":"2024-09-15T22:44:20.954042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961018+0000","last_change":"2024-09-15T22:44:20.958649+0000","last_active":"2024-09-15T22:44:20.961018+0000","last_peered":"2024-09-15T22:44:20.961018+0000","last_clean":"2024-09-15T22:44:20.961018+0000","last_became_active":"2024-09-15T22:44:20.958340+0000","last_became_peered":"2024-09-15T22:44:20.958340+0000","last_unstale":"2024-09-15T22:44:20.961018+0000","last_undegraded":"2024-09-15T22:44:20.961018+0000","last_fullsized":"2024-09-15T22:44:20.961018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:48.760192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970842+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.970583+0000","last_became_peered":"2024-09-15T22:44:21.970583+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:51.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.957529+0000","last_change":"2024-09-15T22:44:20.954064+0000","last_active":"2024-09-15T22:44:20.957529+0000","last_peered":"2024-09-15T22:44:20.957529+0000","last_clean":"2024-09-15T22:44:20.957529+0000","last_became_active":"2024-09-15T22:44:20.953807+0000","last_became_peered":"2024-09-15T22:44:20.953807+0000","last_unstale":"2024-09-15T22:44:20.957529+0000","last_undegraded":"2024-09-15T22:44:20.957529+0000","last_fullsized":"2024-09-15T22:44:20.957529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.287896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.950882+0000","last_change":"2024-09-15T22:44:20.950882+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.950882+0000","last_undegraded":"2024-09-15T22:44:20.950882+0000","last_fullsized":"2024-09-15T22:44:20.950882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.963178+0000","last_change":"2024-09-15T22:44:20.959186+0000","last_active":"2024-09-15T22:44:20.963178+0000","last_peered":"2024-09-15T22:44:20.963178+0000","last_clean":"2024-09-15T22:44:20.963178+0000","last_became_active":"2024-09-15T22:44:20.958905+0000","last_became_peered":"2024-09-15T22:44:20.958905+0000","last_unstale":"2024-09-15T22:44:20.963178+0000","last_undegraded":"2024-09-15T22:44:20.963178+0000","last_fullsized":"2024-09-15T22:44:20.963178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955958+0000","last_change":"2024-09-15T22:44:20.955958+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955958+0000","last_undegraded":"2024-09-15T22:44:20.955958+0000","last_fullsized":"2024-09-15T22:44:20.955958+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965079+0000","last_change":"2024-09-15T22:44:20.963252+0000","last_active":"2024-09-15T22:44:20.965079+0000","last_peered":"2024-09-15T22:44:20.965079+0000","last_clean":"2024-09-15T22:44:20.965079+0000","last_became_active":"2024-09-15T22:44:20.962903+0000","last_became_peered":"2024-09-15T22:44:20.962903+0000","last_unstale":"2024-09-15T22:44:20.965079+0000","last_undegraded":"2024-09-15T22:44:20.965079+0000","last_fullsized":"2024-09-15T22:44:20.965079+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:47.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952920+0000","last_change":"2024-09-15T22:44:20.952920+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952920+0000","last_undegraded":"2024-09-15T22:44:20.952920+0000","last_fullsized":"2024-09-15T22:44:20.952920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967745+0000","last_change":"2024-09-15T22:44:20.965734+0000","last_active":"2024-09-15T22:44:20.967745+0000","last_peered":"2024-09-15T22:44:20.967745+0000","last_clean":"2024-09-15T22:44:20.967745+0000","last_became_active":"2024-09-15T22:44:20.965475+0000","last_became_peered":"2024-09-15T22:44:20.965475+0000","last_unstale":"2024-09-15T22:44:20.967745+0000","last_undegraded":"2024-09-15T22:44:20.967745+0000","last_fullsized":"2024-09-15T22:44:20.967745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:32.592300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954960+0000","last_change":"2024-09-15T22:44:20.954960+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954960+0000","last_undegraded":"2024-09-15T22:44:20.954960+0000","last_fullsized":"2024-09-15T22:44:20.954960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965064+0000","last_change":"2024-09-15T22:44:20.963930+0000","last_active":"2024-09-15T22:44:20.965064+0000","last_peered":"2024-09-15T22:44:20.965064+0000","last_clean":"2024-09-15T22:44:20.965064+0000","last_became_active":"2024-09-15T22:44:20.963655+0000","last_became_peered":"2024-09-15T22:44:20.963655+0000","last_unstale":"2024-09-15T22:44:20.965064+0000","last_undegraded":"2024-09-15T22:44:20.965064+0000","last_fullsized":"2024-09-15T22:44:20.965064+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:44.797569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952619+0000","last_change":"2024-09-15T22:44:20.952619+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952619+0000","last_undegraded":"2024-09-15T22:44:20.952619+0000","last_fullsized":"2024-09-15T22:44:20.952619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965008+0000","last_change":"2024-09-15T22:44:20.963287+0000","last_active":"2024-09-15T22:44:20.965008+0000","last_peered":"2024-09-15T22:44:20.965008+0000","last_clean":"2024-09-15T22:44:20.965008+0000","last_became_active":"2024-09-15T22:44:20.962848+0000","last_became_peered":"2024-09-15T22:44:20.962848+0000","last_unstale":"2024-09-15T22:44:20.965008+0000","last_undegraded":"2024-09-15T22:44:20.965008+0000","last_fullsized":"2024-09-15T22:44:20.965008+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.449490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.956121+0000","last_change":"2024-09-15T22:44:20.956121+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.956121+0000","last_undegraded":"2024-09-15T22:44:20.956121+0000","last_fullsized":"2024-09-15T22:44:20.956121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966482+0000","last_change":"2024-09-15T22:44:20.963978+0000","last_active":"2024-09-15T22:44:20.966482+0000","last_peered":"2024-09-15T22:44:20.966482+0000","last_clean":"2024-09-15T22:44:20.966482+0000","last_became_active":"2024-09-15T22:44:20.963698+0000","last_became_peered":"2024-09-15T22:44:20.963698+0000","last_unstale":"2024-09-15T22:44:20.966482+0000","last_undegraded":"2024-09-15T22:44:20.966482+0000","last_fullsized":"2024-09-15T22:44:20.966482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:26.366026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952315+0000","last_change":"2024-09-15T22:44:20.952315+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952315+0000","last_undegraded":"2024-09-15T22:44:20.952315+0000","last_fullsized":"2024-09-15T22:44:20.952315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961610+0000","last_change":"2024-09-15T22:44:20.959952+0000","last_active":"2024-09-15T22:44:20.961610+0000","last_peered":"2024-09-15T22:44:20.961610+0000","last_clean":"2024-09-15T22:44:20.961610+0000","last_became_active":"2024-09-15T22:44:20.959667+0000","last_became_peered":"2024-09-15T22:44:20.959667+0000","last_unstale":"2024-09-15T22:44:20.961610+0000","last_undegraded":"2024-09-15T22:44:20.961610+0000","last_fullsized":"2024-09-15T22:44:20.961610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:29.532785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953076+0000","last_change":"2024-09-15T22:44:20.953076+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953076+0000","last_undegraded":"2024-09-15T22:44:20.953076+0000","last_fullsized":"2024-09-15T22:44:20.953076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.962787+0000","last_change":"2024-09-15T22:44:20.960790+0000","last_active":"2024-09-15T22:44:20.962787+0000","last_peered":"2024-09-15T22:44:20.962787+0000","last_clean":"2024-09-15T22:44:20.962787+0000","last_became_active":"2024-09-15T22:44:20.960509+0000","last_became_peered":"2024-09-15T22:44:20.960509+0000","last_unstale":"2024-09-15T22:44:20.962787+0000","last_undegraded":"2024-09-15T22:44:20.962787+0000","last_fullsized":"2024-09-15T22:44:20.962787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:52.822369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955910+0000","last_change":"2024-09-15T22:44:20.955910+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955910+0000","last_undegraded":"2024-09-15T22:44:20.955910+0000","last_fullsized":"2024-09-15T22:44:20.955910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968659+0000","last_change":"2024-09-15T22:44:20.967358+0000","last_active":"2024-09-15T22:44:20.968659+0000","last_peered":"2024-09-15T22:44:20.968659+0000","last_clean":"2024-09-15T22:44:20.968659+0000","last_became_active":"2024-09-15T22:44:20.966982+0000","last_became_peered":"2024-09-15T22:44:20.966982+0000","last_unstale":"2024-09-15T22:44:20.968659+0000","last_undegraded":"2024-09-15T22:44:20.968659+0000","last_fullsized":"2024-09-15T22:44:20.968659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955223+0000","last_change":"2024-09-15T22:44:20.955223+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955223+0000","last_undegraded":"2024-09-15T22:44:20.955223+0000","last_fullsized":"2024-09-15T22:44:20.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966258+0000","last_change":"2024-09-15T22:44:20.963170+0000","last_active":"2024-09-15T22:44:20.966258+0000","last_peered":"2024-09-15T22:44:20.966258+0000","last_clean":"2024-09-15T22:44:20.966258+0000","last_became_active":"2024-09-15T22:44:20.962837+0000","last_became_peered":"2024-09-15T22:44:20.962837+0000","last_unstale":"2024-09-15T22:44:20.966258+0000","last_undegraded":"2024-09-15T22:44:20.966258+0000","last_fullsized":"2024-09-15T22:44:20.966258+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:00.445490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953715+0000","last_change":"2024-09-15T22:44:20.953715+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953715+0000","last_undegraded":"2024-09-15T22:44:20.953715+0000","last_fullsized":"2024-09-15T22:44:20.953715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965391+0000","last_change":"2024-09-15T22:44:20.963980+0000","last_active":"2024-09-15T22:44:20.965391+0000","last_peered":"2024-09-15T22:44:20.965391+0000","last_clean":"2024-09-15T22:44:20.965391+0000","last_became_active":"2024-09-15T22:44:20.963718+0000","last_became_peered":"2024-09-15T22:44:20.963718+0000","last_unstale":"2024-09-15T22:44:20.965391+0000","last_undegraded":"2024-09-15T22:44:20.965391+0000","last_fullsized":"2024-09-15T22:44:20.965391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.705907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954597+0000","last_change":"2024-09-15T22:44:20.954597+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954597+0000","last_undegraded":"2024-09-15T22:44:20.954597+0000","last_fullsized":"2024-09-15T22:44:20.954597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967623+0000","last_change":"2024-09-15T22:44:20.964846+0000","last_active":"2024-09-15T22:44:20.967623+0000","last_peered":"2024-09-15T22:44:20.967623+0000","last_clean":"2024-09-15T22:44:20.967623+0000","last_became_active":"2024-09-15T22:44:20.964581+0000","last_became_peered":"2024-09-15T22:44:20.964581+0000","last_unstale":"2024-09-15T22:44:20.967623+0000","last_undegraded":"2024-09-15T22:44:20.967623+0000","last_fullsized":"2024-09-15T22:44:20.967623+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:11.524812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952202+0000","last_change":"2024-09-15T22:44:20.952202+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952202+0000","last_undegraded":"2024-09-15T22:44:20.952202+0000","last_fullsized":"2024-09-15T22:44:20.952202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.961268+0000","last_change":"2024-09-15T22:44:20.955951+0000","last_active":"2024-09-15T22:44:20.961268+0000","last_peered":"2024-09-15T22:44:20.961268+0000","last_clean":"2024-09-15T22:44:20.961268+0000","last_became_active":"2024-09-15T22:44:20.955657+0000","last_became_peered":"2024-09-15T22:44:20.955657+0000","last_unstale":"2024-09-15T22:44:20.961268+0000","last_undegraded":"2024-09-15T22:44:20.961268+0000","last_fullsized":"2024-09-15T22:44:20.961268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954193+0000","last_change":"2024-09-15T22:44:20.954193+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954193+0000","last_undegraded":"2024-09-15T22:44:20.954193+0000","last_fullsized":"2024-09-15T22:44:20.954193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965026+0000","last_change":"2024-09-15T22:44:20.963436+0000","last_active":"2024-09-15T22:44:20.965026+0000","last_peered":"2024-09-15T22:44:20.965026+0000","last_clean":"2024-09-15T22:44:20.965026+0000","last_became_active":"2024-09-15T22:44:20.962857+0000","last_became_peered":"2024-09-15T22:44:20.962857+0000","last_unstale":"2024-09-15T22:44:20.965026+0000","last_undegraded":"2024-09-15T22:44:20.965026+0000","last_fullsized":"2024-09-15T22:44:20.965026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:35.783303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952815+0000","last_change":"2024-09-15T22:44:20.952815+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952815+0000","last_undegraded":"2024-09-15T22:44:20.952815+0000","last_fullsized":"2024-09-15T22:44:20.952815+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966857+0000","last_change":"2024-09-15T22:44:20.965332+0000","last_active":"2024-09-15T22:44:20.966857+0000","last_peered":"2024-09-15T22:44:20.966857+0000","last_clean":"2024-09-15T22:44:20.966857+0000","last_became_active":"2024-09-15T22:44:20.965024+0000","last_became_peered":"2024-09-15T22:44:20.965024+0000","last_unstale":"2024-09-15T22:44:20.966857+0000","last_undegraded":"2024-09-15T22:44:20.966857+0000","last_fullsized":"2024-09-15T22:44:20.966857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:28.596714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.955437+0000","last_change":"2024-09-15T22:44:20.955437+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.955437+0000","last_undegraded":"2024-09-15T22:44:20.955437+0000","last_fullsized":"2024-09-15T22:44:20.955437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.966197+0000","last_change":"2024-09-15T22:44:20.964770+0000","last_active":"2024-09-15T22:44:20.966197+0000","last_peered":"2024-09-15T22:44:20.966197+0000","last_clean":"2024-09-15T22:44:20.966197+0000","last_became_active":"2024-09-15T22:44:20.964468+0000","last_became_peered":"2024-09-15T22:44:20.964468+0000","last_unstale":"2024-09-15T22:44:20.966197+0000","last_undegraded":"2024-09-15T22:44:20.966197+0000","last_fullsized":"2024-09-15T22:44:20.966197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:43.683784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.954757+0000","last_change":"2024-09-15T22:44:20.954757+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.954757+0000","last_undegraded":"2024-09-15T22:44:20.954757+0000","last_fullsized":"2024-09-15T22:44:20.954757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971699+0000","last_change":"2024-09-15T22:44:20.964367+0000","last_active":"2024-09-15T22:44:22.971699+0000","last_peered":"2024-09-15T22:44:22.971699+0000","last_clean":"2024-09-15T22:44:22.971699+0000","last_became_active":"2024-09-15T22:44:20.964060+0000","last_became_peered":"2024-09-15T22:44:20.964060+0000","last_unstale":"2024-09-15T22:44:22.971699+0000","last_undegraded":"2024-09-15T22:44:22.971699+0000","last_fullsized":"2024-09-15T22:44:22.971699+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:15.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953263+0000","last_change":"2024-09-15T22:44:20.953263+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953263+0000","last_undegraded":"2024-09-15T22:44:20.953263+0000","last_fullsized":"2024-09-15T22:44:20.953263+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.965323+0000","last_change":"2024-09-15T22:44:20.962967+0000","last_active":"2024-09-15T22:44:20.965323+0000","last_peered":"2024-09-15T22:44:20.965323+0000","last_clean":"2024-09-15T22:44:20.965323+0000","last_became_active":"2024-09-15T22:44:20.962621+0000","last_became_peered":"2024-09-15T22:44:20.962621+0000","last_unstale":"2024-09-15T22:44:20.965323+0000","last_undegraded":"2024-09-15T22:44:20.965323+0000","last_fullsized":"2024-09-15T22:44:20.965323+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:45.661145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953112+0000","last_change":"2024-09-15T22:44:20.953112+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953112+0000","last_undegraded":"2024-09-15T22:44:20.953112+0000","last_fullsized":"2024-09-15T22:44:20.953112+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.967962+0000","last_change":"2024-09-15T22:44:20.966571+0000","last_active":"2024-09-15T22:44:20.967962+0000","last_peered":"2024-09-15T22:44:20.967962+0000","last_clean":"2024-09-15T22:44:20.967962+0000","last_became_active":"2024-09-15T22:44:20.966183+0000","last_became_peered":"2024-09-15T22:44:20.966183+0000","last_unstale":"2024-09-15T22:44:20.967962+0000","last_undegraded":"2024-09-15T22:44:20.967962+0000","last_fullsized":"2024-09-15T22:44:20.967962+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:42.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971326+0000","last_change":"2024-09-15T22:44:21.975311+0000","last_active":"2024-09-15T22:44:22.971326+0000","last_peered":"2024-09-15T22:44:22.971326+0000","last_clean":"2024-09-15T22:44:22.971326+0000","last_became_active":"2024-09-15T22:44:21.975052+0000","last_became_peered":"2024-09-15T22:44:21.975052+0000","last_unstale":"2024-09-15T22:44:22.971326+0000","last_undegraded":"2024-09-15T22:44:22.971326+0000","last_fullsized":"2024-09-15T22:44:22.971326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:03.634300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.968671+0000","last_change":"2024-09-15T22:44:20.967962+0000","last_active":"2024-09-15T22:44:20.968671+0000","last_peered":"2024-09-15T22:44:20.968671+0000","last_clean":"2024-09-15T22:44:20.968671+0000","last_became_active":"2024-09-15T22:44:20.967669+0000","last_became_peered":"2024-09-15T22:44:20.967669+0000","last_unstale":"2024-09-15T22:44:20.968671+0000","last_undegraded":"2024-09-15T22:44:20.968671+0000","last_fullsized":"2024-09-15T22:44:20.968671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:44.093894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.951537+0000","last_change":"2024-09-15T22:44:20.951537+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.951537+0000","last_undegraded":"2024-09-15T22:44:20.951537+0000","last_fullsized":"2024-09-15T22:44:20.951537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964290+0000","last_change":"2024-09-15T22:44:20.962150+0000","last_active":"2024-09-15T22:44:20.964290+0000","last_peered":"2024-09-15T22:44:20.964290+0000","last_clean":"2024-09-15T22:44:20.964290+0000","last_became_active":"2024-09-15T22:44:20.961861+0000","last_became_peered":"2024-09-15T22:44:20.961861+0000","last_unstale":"2024-09-15T22:44:20.964290+0000","last_undegraded":"2024-09-15T22:44:20.964290+0000","last_fullsized":"2024-09-15T22:44:20.964290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:07.460468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.953886+0000","last_change":"2024-09-15T22:44:20.953886+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.953886+0000","last_undegraded":"2024-09-15T22:44:20.953886+0000","last_fullsized":"2024-09-15T22:44:20.953886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971148+0000","last_change":"2024-09-15T22:44:20.962947+0000","last_active":"2024-09-15T22:44:22.971148+0000","last_peered":"2024-09-15T22:44:22.971148+0000","last_clean":"2024-09-15T22:44:22.971148+0000","last_became_active":"2024-09-15T22:44:20.962625+0000","last_became_peered":"2024-09-15T22:44:20.962625+0000","last_unstale":"2024-09-15T22:44:22.971148+0000","last_undegraded":"2024-09-15T22:44:22.971148+0000","last_fullsized":"2024-09-15T22:44:22.971148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:03.363102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952329+0000","last_change":"2024-09-15T22:44:20.952329+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952329+0000","last_undegraded":"2024-09-15T22:44:20.952329+0000","last_fullsized":"2024-09-15T22:44:20.952329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.964098+0000","last_change":"2024-09-15T22:44:20.961177+0000","last_active":"2024-09-15T22:44:20.964098+0000","last_peered":"2024-09-15T22:44:20.964098+0000","last_clean":"2024-09-15T22:44:20.964098+0000","last_became_active":"2024-09-15T22:44:20.960859+0000","last_became_peered":"2024-09-15T22:44:20.960859+0000","last_unstale":"2024-09-15T22:44:20.964098+0000","last_undegraded":"2024-09-15T22:44:20.964098+0000","last_fullsized":"2024-09-15T22:44:20.964098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:48:51.753009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-15T22:44:20.952588+0000","last_change":"2024-09-15T22:44:20.952588+0000","last_active":"2024-09-15T22:44:20.941453+0000","last_peered":"2024-09-15T22:44:20.941453+0000","last_clean":"2024-09-15T22:44:20.941453+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:44:20.952588+0000","last_undegraded":"2024-09-15T22:44:20.952588+0000","last_fullsized":"2024-09-15T22:44:20.952588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.960629+0000","last_change":"2024-09-15T22:44:20.959715+0000","last_active":"2024-09-15T22:44:20.960629+0000","last_peered":"2024-09-15T22:44:20.960629+0000","last_clean":"2024-09-15T22:44:20.960629+0000","last_became_active":"2024-09-15T22:44:20.957914+0000","last_became_peered":"2024-09-15T22:44:20.957914+0000","last_unstale":"2024-09-15T22:44:20.960629+0000","last_undegraded":"2024-09-15T22:44:20.960629+0000","last_fullsized":"2024-09-15T22:44:20.960629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:30.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-15T22:44:20.953258+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:20.953258+0000","last_peered":"2024-09-15T22:44:20.953258+0000","last_clean":"2024-09-15T22:44:20.953258+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:20.953258+0000","last_undegraded":"2024-09-15T22:44:20.953258+0000","last_fullsized":"2024-09-15T22:44:20.953258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1282048,"data_stored":870450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":280082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":299454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955211+0000', 'last_change': '2024-09-15T22:44:20.955211+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955211+0000', 'last_undegraded': '2024-09-15T22:44:20.955211+0000', 'last_fullsized': '2024-09-15T22:44:20.955211+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955662+0000', 'last_change': '2024-09-15T22:44:20.955662+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955662+0000', 'last_undegraded': '2024-09-15T22:44:20.955662+0000', 'last_fullsized': '2024-09-15T22:44:20.955662+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-15T22:44:26.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953143+0000', 'last_change': '2024-09-15T22:44:20.953143+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953143+0000', 'last_undegraded': '2024-09-15T22:44:20.953143+0000', 'last_fullsized': '2024-09-15T22:44:20.953143+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953874+0000', 'last_change': '2024-09-15T22:44:20.953874+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953874+0000', 'last_undegraded': '2024-09-15T22:44:20.953874+0000', 'last_fullsized': '2024-09-15T22:44:20.953874+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954377+0000', 'last_change': '2024-09-15T22:44:20.954377+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954377+0000', 'last_undegraded': '2024-09-15T22:44:20.954377+0000', 'last_fullsized': '2024-09-15T22:44:20.954377+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952054+0000', 'last_change': '2024-09-15T22:44:20.952054+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952054+0000', 'last_undegraded': '2024-09-15T22:44:20.952054+0000', 'last_fullsized': '2024-09-15T22:44:20.952054+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.950446+0000', 'last_change': '2024-09-15T22:44:20.950446+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.950446+0000', 'last_undegraded': '2024-09-15T22:44:20.950446+0000', 'last_fullsized': '2024-09-15T22:44:20.950446+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.951705+0000', 'last_change': '2024-09-15T22:44:20.951705+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.951705+0000', 'last_undegraded': '2024-09-15T22:44:20.951705+0000', 'last_fullsized': '2024-09-15T22:44:20.951705+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.577 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952497+0000', 'last_change': '2024-09-15T22:44:20.952497+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952497+0000', 'last_undegraded': '2024-09-15T22:44:20.952497+0000', 'last_fullsized': '2024-09-15T22:44:20.952497+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954831+0000', 'last_change': '2024-09-15T22:44:20.954831+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954831+0000', 'last_undegraded': '2024-09-15T22:44:20.954831+0000', 'last_fullsized': '2024-09-15T22:44:20.954831+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952498+0000', 'last_change': '2024-09-15T22:44:20.952498+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952498+0000', 'last_undegraded': '2024-09-15T22:44:20.952498+0000', 'last_fullsized': '2024-09-15T22:44:20.952498+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.956339+0000', 'last_change': '2024-09-15T22:44:20.956339+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.956339+0000', 'last_undegraded': '2024-09-15T22:44:20.956339+0000', 'last_fullsized': '2024-09-15T22:44:20.956339+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954600+0000', 'last_change': '2024-09-15T22:44:20.954600+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954600+0000', 'last_undegraded': '2024-09-15T22:44:20.954600+0000', 'last_fullsized': '2024-09-15T22:44:20.954600+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-15T22:44:26.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.950521+0000', 'last_change': '2024-09-15T22:44:20.950521+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.950521+0000', 'last_undegraded': '2024-09-15T22:44:20.950521+0000', 'last_fullsized': '2024-09-15T22:44:20.950521+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952010+0000', 'last_change': '2024-09-15T22:44:20.952010+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952010+0000', 'last_undegraded': '2024-09-15T22:44:20.952010+0000', 'last_fullsized': '2024-09-15T22:44:20.952010+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.949379+0000', 'last_change': '2024-09-15T22:44:20.949379+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.949379+0000', 'last_undegraded': '2024-09-15T22:44:20.949379+0000', 'last_fullsized': '2024-09-15T22:44:20.949379+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953465+0000', 'last_change': '2024-09-15T22:44:20.953465+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953465+0000', 'last_undegraded': '2024-09-15T22:44:20.953465+0000', 'last_fullsized': '2024-09-15T22:44:20.953465+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-15T22:44:26.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952976+0000', 'last_change': '2024-09-15T22:44:20.952976+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952976+0000', 'last_undegraded': '2024-09-15T22:44:20.952976+0000', 'last_fullsized': '2024-09-15T22:44:20.952976+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955140+0000', 'last_change': '2024-09-15T22:44:20.955140+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955140+0000', 'last_undegraded': '2024-09-15T22:44:20.955140+0000', 'last_fullsized': '2024-09-15T22:44:20.955140+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.951412+0000', 'last_change': '2024-09-15T22:44:20.951412+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.951412+0000', 'last_undegraded': '2024-09-15T22:44:20.951412+0000', 'last_fullsized': '2024-09-15T22:44:20.951412+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954184+0000', 'last_change': '2024-09-15T22:44:20.954184+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954184+0000', 'last_undegraded': '2024-09-15T22:44:20.954184+0000', 'last_fullsized': '2024-09-15T22:44:20.954184+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953978+0000', 'last_change': '2024-09-15T22:44:20.953978+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953978+0000', 'last_undegraded': '2024-09-15T22:44:20.953978+0000', 'last_fullsized': '2024-09-15T22:44:20.953978+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-15T22:44:26.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954614+0000', 'last_change': '2024-09-15T22:44:20.954614+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954614+0000', 'last_undegraded': '2024-09-15T22:44:20.954614+0000', 'last_fullsized': '2024-09-15T22:44:20.954614+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954332+0000', 'last_change': '2024-09-15T22:44:20.954332+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954332+0000', 'last_undegraded': '2024-09-15T22:44:20.954332+0000', 'last_fullsized': '2024-09-15T22:44:20.954332+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952789+0000', 'last_change': '2024-09-15T22:44:20.952789+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952789+0000', 'last_undegraded': '2024-09-15T22:44:20.952789+0000', 'last_fullsized': '2024-09-15T22:44:20.952789+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.950008+0000', 'last_change': '2024-09-15T22:44:20.950008+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.950008+0000', 'last_undegraded': '2024-09-15T22:44:20.950008+0000', 'last_fullsized': '2024-09-15T22:44:20.950008+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953461+0000', 'last_change': '2024-09-15T22:44:20.953461+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953461+0000', 'last_undegraded': '2024-09-15T22:44:20.953461+0000', 'last_fullsized': '2024-09-15T22:44:20.953461+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953623+0000', 'last_change': '2024-09-15T22:44:20.953623+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953623+0000', 'last_undegraded': '2024-09-15T22:44:20.953623+0000', 'last_fullsized': '2024-09-15T22:44:20.953623+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-15T22:44:26.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.949945+0000', 'last_change': '2024-09-15T22:44:20.949945+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.949945+0000', 'last_undegraded': '2024-09-15T22:44:20.949945+0000', 'last_fullsized': '2024-09-15T22:44:20.949945+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954042+0000', 'last_change': '2024-09-15T22:44:20.954042+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954042+0000', 'last_undegraded': '2024-09-15T22:44:20.954042+0000', 'last_fullsized': '2024-09-15T22:44:20.954042+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.950882+0000', 'last_change': '2024-09-15T22:44:20.950882+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.950882+0000', 'last_undegraded': '2024-09-15T22:44:20.950882+0000', 'last_fullsized': '2024-09-15T22:44:20.950882+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955958+0000', 'last_change': '2024-09-15T22:44:20.955958+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955958+0000', 'last_undegraded': '2024-09-15T22:44:20.955958+0000', 'last_fullsized': '2024-09-15T22:44:20.955958+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952920+0000', 'last_change': '2024-09-15T22:44:20.952920+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952920+0000', 'last_undegraded': '2024-09-15T22:44:20.952920+0000', 'last_fullsized': '2024-09-15T22:44:20.952920+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954960+0000', 'last_change': '2024-09-15T22:44:20.954960+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954960+0000', 'last_undegraded': '2024-09-15T22:44:20.954960+0000', 'last_fullsized': '2024-09-15T22:44:20.954960+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-15T22:44:26.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952619+0000', 'last_change': '2024-09-15T22:44:20.952619+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952619+0000', 'last_undegraded': '2024-09-15T22:44:20.952619+0000', 'last_fullsized': '2024-09-15T22:44:20.952619+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.956121+0000', 'last_change': '2024-09-15T22:44:20.956121+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.956121+0000', 'last_undegraded': '2024-09-15T22:44:20.956121+0000', 'last_fullsized': '2024-09-15T22:44:20.956121+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952315+0000', 'last_change': '2024-09-15T22:44:20.952315+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952315+0000', 'last_undegraded': '2024-09-15T22:44:20.952315+0000', 'last_fullsized': '2024-09-15T22:44:20.952315+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953076+0000', 'last_change': '2024-09-15T22:44:20.953076+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953076+0000', 'last_undegraded': '2024-09-15T22:44:20.953076+0000', 'last_fullsized': '2024-09-15T22:44:20.953076+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955910+0000', 'last_change': '2024-09-15T22:44:20.955910+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955910+0000', 'last_undegraded': '2024-09-15T22:44:20.955910+0000', 'last_fullsized': '2024-09-15T22:44:20.955910+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955223+0000', 'last_change': '2024-09-15T22:44:20.955223+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955223+0000', 'last_undegraded': '2024-09-15T22:44:20.955223+0000', 'last_fullsized': '2024-09-15T22:44:20.955223+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.583 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953715+0000', 'last_change': '2024-09-15T22:44:20.953715+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953715+0000', 'last_undegraded': '2024-09-15T22:44:20.953715+0000', 'last_fullsized': '2024-09-15T22:44:20.953715+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954597+0000', 'last_change': '2024-09-15T22:44:20.954597+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954597+0000', 'last_undegraded': '2024-09-15T22:44:20.954597+0000', 'last_fullsized': '2024-09-15T22:44:20.954597+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952202+0000', 'last_change': '2024-09-15T22:44:20.952202+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952202+0000', 'last_undegraded': '2024-09-15T22:44:20.952202+0000', 'last_fullsized': '2024-09-15T22:44:20.952202+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954193+0000', 'last_change': '2024-09-15T22:44:20.954193+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954193+0000', 'last_undegraded': '2024-09-15T22:44:20.954193+0000', 'last_fullsized': '2024-09-15T22:44:20.954193+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952815+0000', 'last_change': '2024-09-15T22:44:20.952815+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952815+0000', 'last_undegraded': '2024-09-15T22:44:20.952815+0000', 'last_fullsized': '2024-09-15T22:44:20.952815+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-15T22:44:26.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.955437+0000', 'last_change': '2024-09-15T22:44:20.955437+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.955437+0000', 'last_undegraded': '2024-09-15T22:44:20.955437+0000', 'last_fullsized': '2024-09-15T22:44:20.955437+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.954757+0000', 'last_change': '2024-09-15T22:44:20.954757+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.954757+0000', 'last_undegraded': '2024-09-15T22:44:20.954757+0000', 'last_fullsized': '2024-09-15T22:44:20.954757+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953263+0000', 'last_change': '2024-09-15T22:44:20.953263+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953263+0000', 'last_undegraded': '2024-09-15T22:44:20.953263+0000', 'last_fullsized': '2024-09-15T22:44:20.953263+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953112+0000', 'last_change': '2024-09-15T22:44:20.953112+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953112+0000', 'last_undegraded': '2024-09-15T22:44:20.953112+0000', 'last_fullsized': '2024-09-15T22:44:20.953112+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.951537+0000', 'last_change': '2024-09-15T22:44:20.951537+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.951537+0000', 'last_undegraded': '2024-09-15T22:44:20.951537+0000', 'last_fullsized': '2024-09-15T22:44:20.951537+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.953886+0000', 'last_change': '2024-09-15T22:44:20.953886+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.953886+0000', 'last_undegraded': '2024-09-15T22:44:20.953886+0000', 'last_fullsized': '2024-09-15T22:44:20.953886+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.585 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-15T22:44:26.586 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952329+0000', 'last_change': '2024-09-15T22:44:20.952329+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952329+0000', 'last_undegraded': '2024-09-15T22:44:20.952329+0000', 'last_fullsized': '2024-09-15T22:44:20.952329+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:44:26.586 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-15T22:44:26.586 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:44:20.952588+0000', 'last_change': '2024-09-15T22:44:20.952588+0000', 'last_active': '2024-09-15T22:44:20.941453+0000', 'last_peered': '2024-09-15T22:44:20.941453+0000', 'last_clean': '2024-09-15T22:44:20.941453+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:44:20.952588+0000', 'last_undegraded': '2024-09-15T22:44:20.952588+0000', 'last_fullsized': '2024-09-15T22:44:20.952588+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'last_clean_scrub_stamp': '2024-09-15T22:44:20.941453+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:44:26.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:44:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.708+0000 7fccf75fd640 1 Processor -- start 2024-09-15T22:44:26.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.708+0000 7fccf75fd640 1 -- start start 2024-09-15T22:44:26.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fccf015c180 0x7fccf00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 0x7fccf00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 0x7fccf0073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fccf00ce740 con 0x7fccf015c180 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fccf0072640 con 0x7fccf00ce230 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf75fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fccf0072920 con 0x7fccf00cf5b0 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf5399640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fccf015c180 0x7fccf00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf5399640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fccf015c180 0x7fccf00cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52058/0 (socket says 172.21.15.134:52058) 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf5399640 1 -- 172.21.15.134:0/2764496415 learned_addr learned my addr 172.21.15.134:0/2764496415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf4b98640 1 --2- 172.21.15.134:0/2764496415 >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 0x7fccf00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf5b9a640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 0x7fccf0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.709+0000 7fccf5399640 1 -- 172.21.15.134:0/2764496415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 msgr2=0x7fccf0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5399640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 0x7fccf0073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5399640 1 -- 172.21.15.134:0/2764496415 >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 msgr2=0x7fccf00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5399640 1 --2- 172.21.15.134:0/2764496415 >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 0x7fccf00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5399640 1 -- 172.21.15.134:0/2764496415 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf0072c00 con 0x7fccf015c180 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf4b98640 1 --2- 172.21.15.134:0/2764496415 >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 0x7fccf00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5b9a640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 0x7fccf0073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fccf5399640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf015c180 0x7fccf00cdcf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fccf0071d60 tx=0x7fccec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2593d97b86d409 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fcce7fff640 1 -- 172.21.15.134:0/2764496415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec036070 con 0x7fccf015c180 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fcce7fff640 1 -- 172.21.15.134:0/2764496415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccec031600 con 0x7fccf015c180 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.710+0000 7fcce7fff640 1 -- 172.21.15.134:0/2764496415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0319d0 con 0x7fccf015c180 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 -- 172.21.15.134:0/2764496415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf015c180 msgr2=0x7fccf00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf015c180 0x7fccf00cdcf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fccf0071d60 tx=0x7fccec02a610 comp rx=0 tx=0).stop 2024-09-15T22:44:26.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 -- 172.21.15.134:0/2764496415 shutdown_connections 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf00cf5b0 0x7fccf0073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 --2- 172.21.15.134:0/2764496415 >> v2:172.21.15.177:3300/0 conn(0x7fccf00ce230 0x7fccf00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 --2- 172.21.15.134:0/2764496415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf015c180 0x7fccf00cdcf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 -- 172.21.15.134:0/2764496415 >> 172.21.15.134:0/2764496415 conn(0x7fccf0062cc0 msgr2=0x7fccf006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 -- 172.21.15.134:0/2764496415 shutdown_connections 2024-09-15T22:44:26.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.711+0000 7fccf75fd640 1 -- 172.21.15.134:0/2764496415 wait complete. 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.712+0000 7fccf75fd640 1 Processor -- start 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.712+0000 7fccf75fd640 1 -- start start 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccf00ce230 0x7fccf0156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf015c180 0x7fccf00ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fccf015c560 con 0x7fccf00cf5b0 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00722f0 con 0x7fccf00ce230 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf75fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fccf015c6e0 con 0x7fccf015c180 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52070/0 (socket says 172.21.15.134:52070) 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 -- 172.21.15.134:0/110446689 learned_addr learned my addr 172.21.15.134:0/110446689 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf5399640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccf00ce230 0x7fccf0156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf5b9a640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf015c180 0x7fccf00ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 -- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf015c180 msgr2=0x7fccf00ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf015c180 0x7fccf00ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 -- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccf00ce230 msgr2=0x7fccf0156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccf00ce230 0x7fccf0156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 -- 172.21.15.134:0/110446689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf0157240 con 0x7fccf00cf5b0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.713+0000 7fccf4b98640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c7f0 tx=0x7fcce000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.714+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0015070 con 0x7fccf00cf5b0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.714+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0007820 con 0x7fccf00cf5b0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.714+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf0157520 con 0x7fccf00cf5b0 2024-09-15T22:44:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.714+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0007bd0 con 0x7fccf00cf5b0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.714+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf0157dc0 con 0x7fccf00cf5b0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.715+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf00cf070 con 0x7fccf00cf5b0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.715+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fcce0018070 con 0x7fccf00cf5b0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.716+0000 7fcce5ffb640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 0x7fccd406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.716+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fcce008b920 con 0x7fccf00cf5b0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.716+0000 7fccf5399640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 0x7fccd406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.716+0000 7fccf5399640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 0x7fccd406e920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fccec033000 tx=0x7fccec009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.720+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcce00596b0 con 0x7fccf00cf5b0 2024-09-15T22:44:26.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.949+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fccf015b7c0 con 0x7fccf00cf5b0 2024-09-15T22:44:26.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.949+0000 7fcce5ffb640 1 -- 172.21.15.134:0/110446689 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1137 (secure 0 0 0) 0x7fcce005d9b0 con 0x7fccf00cf5b0 2024-09-15T22:44:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:26.951 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":204,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":53},{"state_name":"active+clean","count":44}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590368,"bytes_used":232468480,"bytes_avail":772861644800,"bytes_total":773094113280,"inactive_pgs_ratio":0.54639172554016113,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":29,"btime":"2024-09-15T22:44:24:969038+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5727}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-15T22:43:50.979324+0000","services":{}},"progress_events":{}} 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 msgr2=0x7fccd406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 0x7fccd406e920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fccec033000 tx=0x7fccec009000 comp rx=0 tx=0).stop 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 msgr2=0x7fccf01582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c7f0 tx=0x7fcce000ccb0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 shutdown_connections 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fccd406c460 0x7fccd406e920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccf015c180 0x7fccf00ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf00cf5b0 0x7fccf01582e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 --2- 172.21.15.134:0/110446689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccf00ce230 0x7fccf0156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 >> 172.21.15.134:0/110446689 conn(0x7fccf0062cc0 msgr2=0x7fccf006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 shutdown_connections 2024-09-15T22:44:26.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:26.951+0000 7fccf75fd640 1 -- 172.21.15.134:0/110446689 wait complete. 2024-09-15T22:44:26.963 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:44:26.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:44:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.061+0000 7fc95adfd640 1 Processor -- start 2024-09-15T22:44:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.061+0000 7fc95adfd640 1 -- start start 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95adfd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc95415c3d0 0x7fc9540b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95adfd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9540ce910 0x7fc9540b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95adfd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9540b5a60 con 0x7fc9540b3550 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95adfd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc9540b3ed0 con 0x7fc9540ce910 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95adfd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc9540b5d00 con 0x7fc95415c3d0 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9540ce910 0x7fc9540b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9540ce910 0x7fc9540b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52086/0 (socket says 172.21.15.134:52086) 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 -- 172.21.15.134:0/3786841630 learned_addr learned my addr 172.21.15.134:0/3786841630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc958b99640 1 --2- 172.21.15.134:0/3786841630 >> v2:172.21.15.177:3300/0 conn(0x7fc95415c3d0 0x7fc9540b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 -- 172.21.15.134:0/3786841630 >> v2:172.21.15.177:3300/0 conn(0x7fc95415c3d0 msgr2=0x7fc9540b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 --2- 172.21.15.134:0/3786841630 >> v2:172.21.15.177:3300/0 conn(0x7fc95415c3d0 0x7fc9540b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 -- 172.21.15.134:0/3786841630 >> v1:172.21.15.177:6789/0 conn(0x7fc9540b3550 legacy=0x7fc9540ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.062+0000 7fc95939a640 1 -- 172.21.15.134:0/3786841630 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9540b5fe0 con 0x7fc9540ce910 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.063+0000 7fc95939a640 1 --2- 172.21.15.134:0/3786841630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9540ce910 0x7fc9540b3990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9540b1170 tx=0x7fc94c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23efcce3192a0ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.063+0000 7fc9537fe640 1 -- 172.21.15.134:0/3786841630 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c036070 con 0x7fc9540ce910 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.063+0000 7fc9537fe640 1 -- 172.21.15.134:0/3786841630 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c031600 con 0x7fc9540ce910 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.063+0000 7fc9537fe640 1 -- 172.21.15.134:0/3786841630 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0319d0 con 0x7fc9540ce910 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 -- 172.21.15.134:0/3786841630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9540ce910 msgr2=0x7fc9540b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 --2- 172.21.15.134:0/3786841630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9540ce910 0x7fc9540b3990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9540b1170 tx=0x7fc94c02a6c0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 -- 172.21.15.134:0/3786841630 shutdown_connections 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 --2- 172.21.15.134:0/3786841630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9540ce910 0x7fc9540b3990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 --2- 172.21.15.134:0/3786841630 >> v2:172.21.15.177:3300/0 conn(0x7fc95415c3d0 0x7fc9540b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 -- 172.21.15.134:0/3786841630 >> 172.21.15.134:0/3786841630 conn(0x7fc95406ce90 msgr2=0x7fc95406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 -- 172.21.15.134:0/3786841630 shutdown_connections 2024-09-15T22:44:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.064+0000 7fc95adfd640 1 -- 172.21.15.134:0/3786841630 wait complete. 2024-09-15T22:44:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.065+0000 7fc95adfd640 1 Processor -- start 2024-09-15T22:44:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.065+0000 7fc95adfd640 1 -- start start 2024-09-15T22:44:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 0x7fc95415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540ce910 0x7fc95415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9540cef70 con 0x7fc95415c3d0 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9540b6d20 con 0x7fc9540ce910 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95adfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9540cf0f0 con 0x7fc9540b3550 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52102/0 (socket says 172.21.15.134:52102) 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 -- 172.21.15.134:0/4016762808 learned_addr learned my addr 172.21.15.134:0/4016762808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc958b99640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 0x7fc95415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc953fff640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540ce910 0x7fc95415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 -- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 msgr2=0x7fc95415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 0x7fc95415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 -- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540ce910 msgr2=0x7fc95415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540ce910 0x7fc95415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 -- 172.21.15.134:0/4016762808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95415d650 con 0x7fc95415c3d0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc958b99640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 0x7fc95415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.066+0000 7fc95939a640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009f10 tx=0x7fc94c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.067+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c036050 con 0x7fc95415c3d0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.067+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c042070 con 0x7fc95415c3d0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.067+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9540b1d50 con 0x7fc95415c3d0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.067+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c009510 con 0x7fc95415c3d0 2024-09-15T22:44:27.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.067+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9540b2310 con 0x7fc95415c3d0 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.068+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9540b3970 con 0x7fc95415c3d0 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.068+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fc94c007bd0 con 0x7fc95415c3d0 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.069+0000 7fc9517fa640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 0x7fc93806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.069+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fc94c0ac6d0 con 0x7fc95415c3d0 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.069+0000 7fc958b99640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 0x7fc93806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.069+0000 7fc958b99640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 0x7fc93806e920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc948006fd0 tx=0x7fc948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.073+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc94c07aab0 con 0x7fc95415c3d0 2024-09-15T22:44:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.234+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc95406d3a0 con 0x7fc93806c460 2024-09-15T22:44:27.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.240+0000 7fc9517fa640 1 -- 172.21.15.134:0/4016762808 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fc95406d3a0 con 0x7fc93806c460 2024-09-15T22:44:27.244 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 msgr2=0x7fc93806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 0x7fc93806e920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc948006fd0 tx=0x7fc948008040 comp rx=0 tx=0).stop 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 msgr2=0x7fc954157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009f10 tx=0x7fc94c004a40 comp rx=0 tx=0).stop 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 shutdown_connections 2024-09-15T22:44:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc93806c460 0x7fc93806e920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc95415c3d0 0x7fc954157310 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540ce910 0x7fc95415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 --2- 172.21.15.134:0/4016762808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9540b3550 0x7fc95415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 >> 172.21.15.134:0/4016762808 conn(0x7fc95406ce90 msgr2=0x7fc95415b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 shutdown_connections 2024-09-15T22:44:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:27.243+0000 7fc95adfd640 1 -- 172.21.15.134:0/4016762808 wait complete. 2024-09-15T22:44:27.256 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-15T22:44:26.987513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231460,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743260,"statfs":{"total":773094113280,"available":772857098240,"internally_reserved":0,"allocated":7053312,"data_stored":3581012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.040401"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971718+0000","last_change":"2024-09-15T22:44:21.964019+0000","last_active":"2024-09-15T22:44:22.971718+0000","last_peered":"2024-09-15T22:44:22.971718+0000","last_clean":"2024-09-15T22:44:22.971718+0000","last_became_active":"2024-09-15T22:44:21.963745+0000","last_became_peered":"2024-09-15T22:44:21.963745+0000","last_unstale":"2024-09-15T22:44:22.971718+0000","last_undegraded":"2024-09-15T22:44:22.971718+0000","last_fullsized":"2024-09-15T22:44:22.971718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:08.177048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662135+0000","last_change":"2024-09-15T22:44:21.971206+0000","last_active":"2024-09-15T22:44:23.662135+0000","last_peered":"2024-09-15T22:44:23.662135+0000","last_clean":"2024-09-15T22:44:23.662135+0000","last_became_active":"2024-09-15T22:44:21.970939+0000","last_became_peered":"2024-09-15T22:44:21.970939+0000","last_unstale":"2024-09-15T22:44:23.662135+0000","last_undegraded":"2024-09-15T22:44:23.662135+0000","last_fullsized":"2024-09-15T22:44:23.662135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:00.711404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968477+0000","last_change":"2024-09-15T22:44:21.965822+0000","last_active":"2024-09-15T22:44:22.968477+0000","last_peered":"2024-09-15T22:44:22.968477+0000","last_clean":"2024-09-15T22:44:22.968477+0000","last_became_active":"2024-09-15T22:44:21.965461+0000","last_became_peered":"2024-09-15T22:44:21.965461+0000","last_unstale":"2024-09-15T22:44:22.968477+0000","last_undegraded":"2024-09-15T22:44:22.968477+0000","last_fullsized":"2024-09-15T22:44:22.968477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:35.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662597+0000","last_change":"2024-09-15T22:44:21.962258+0000","last_active":"2024-09-15T22:44:23.662597+0000","last_peered":"2024-09-15T22:44:23.662597+0000","last_clean":"2024-09-15T22:44:23.662597+0000","last_became_active":"2024-09-15T22:44:21.962018+0000","last_became_peered":"2024-09-15T22:44:21.962018+0000","last_unstale":"2024-09-15T22:44:23.662597+0000","last_undegraded":"2024-09-15T22:44:23.662597+0000","last_fullsized":"2024-09-15T22:44:23.662597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:42.024963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971364+0000","last_change":"2024-09-15T22:44:21.969484+0000","last_active":"2024-09-15T22:44:22.971364+0000","last_peered":"2024-09-15T22:44:22.971364+0000","last_clean":"2024-09-15T22:44:22.971364+0000","last_became_active":"2024-09-15T22:44:21.969069+0000","last_became_peered":"2024-09-15T22:44:21.969069+0000","last_unstale":"2024-09-15T22:44:22.971364+0000","last_undegraded":"2024-09-15T22:44:22.971364+0000","last_fullsized":"2024-09-15T22:44:22.971364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:55.828144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971290+0000","last_change":"2024-09-15T22:44:21.976008+0000","last_active":"2024-09-15T22:44:22.971290+0000","last_peered":"2024-09-15T22:44:22.971290+0000","last_clean":"2024-09-15T22:44:22.971290+0000","last_became_active":"2024-09-15T22:44:21.975743+0000","last_became_peered":"2024-09-15T22:44:21.975743+0000","last_unstale":"2024-09-15T22:44:22.971290+0000","last_undegraded":"2024-09-15T22:44:22.971290+0000","last_fullsized":"2024-09-15T22:44:22.971290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:25.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662525+0000","last_change":"2024-09-15T22:44:21.965973+0000","last_active":"2024-09-15T22:44:23.662525+0000","last_peered":"2024-09-15T22:44:23.662525+0000","last_clean":"2024-09-15T22:44:23.662525+0000","last_became_active":"2024-09-15T22:44:21.965073+0000","last_became_peered":"2024-09-15T22:44:21.965073+0000","last_unstale":"2024-09-15T22:44:23.662525+0000","last_undegraded":"2024-09-15T22:44:23.662525+0000","last_fullsized":"2024-09-15T22:44:23.662525+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:21.796541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304158+0000","last_change":"2024-09-15T22:44:21.967600+0000","last_active":"2024-09-15T22:44:23.304158+0000","last_peered":"2024-09-15T22:44:23.304158+0000","last_clean":"2024-09-15T22:44:23.304158+0000","last_became_active":"2024-09-15T22:44:21.967133+0000","last_became_peered":"2024-09-15T22:44:21.967133+0000","last_unstale":"2024-09-15T22:44:23.304158+0000","last_undegraded":"2024-09-15T22:44:23.304158+0000","last_fullsized":"2024-09-15T22:44:23.304158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:33.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662554+0000","last_change":"2024-09-15T22:44:21.971592+0000","last_active":"2024-09-15T22:44:23.662554+0000","last_peered":"2024-09-15T22:44:23.662554+0000","last_clean":"2024-09-15T22:44:23.662554+0000","last_became_active":"2024-09-15T22:44:21.971355+0000","last_became_peered":"2024-09-15T22:44:21.971355+0000","last_unstale":"2024-09-15T22:44:23.662554+0000","last_undegraded":"2024-09-15T22:44:23.662554+0000","last_fullsized":"2024-09-15T22:44:23.662554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:51.888531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971583+0000","last_change":"2024-09-15T22:44:21.964323+0000","last_active":"2024-09-15T22:44:22.971583+0000","last_peered":"2024-09-15T22:44:22.971583+0000","last_clean":"2024-09-15T22:44:22.971583+0000","last_became_active":"2024-09-15T22:44:21.964031+0000","last_became_peered":"2024-09-15T22:44:21.964031+0000","last_unstale":"2024-09-15T22:44:22.971583+0000","last_undegraded":"2024-09-15T22:44:22.971583+0000","last_fullsized":"2024-09-15T22:44:22.971583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:46.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969027+0000","last_change":"2024-09-15T22:44:21.974043+0000","last_active":"2024-09-15T22:44:22.969027+0000","last_peered":"2024-09-15T22:44:22.969027+0000","last_clean":"2024-09-15T22:44:22.969027+0000","last_became_active":"2024-09-15T22:44:21.973791+0000","last_became_peered":"2024-09-15T22:44:21.973791+0000","last_unstale":"2024-09-15T22:44:22.969027+0000","last_undegraded":"2024-09-15T22:44:22.969027+0000","last_fullsized":"2024-09-15T22:44:22.969027+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:22.880809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662178+0000","last_change":"2024-09-15T22:44:21.961878+0000","last_active":"2024-09-15T22:44:23.662178+0000","last_peered":"2024-09-15T22:44:23.662178+0000","last_clean":"2024-09-15T22:44:23.662178+0000","last_became_active":"2024-09-15T22:44:21.961606+0000","last_became_peered":"2024-09-15T22:44:21.961606+0000","last_unstale":"2024-09-15T22:44:23.662178+0000","last_undegraded":"2024-09-15T22:44:23.662178+0000","last_fullsized":"2024-09-15T22:44:23.662178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:21.222188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662510+0000","last_change":"2024-09-15T22:44:21.971692+0000","last_active":"2024-09-15T22:44:23.662510+0000","last_peered":"2024-09-15T22:44:23.662510+0000","last_clean":"2024-09-15T22:44:23.662510+0000","last_became_active":"2024-09-15T22:44:21.971424+0000","last_became_peered":"2024-09-15T22:44:21.971424+0000","last_unstale":"2024-09-15T22:44:23.662510+0000","last_undegraded":"2024-09-15T22:44:23.662510+0000","last_fullsized":"2024-09-15T22:44:23.662510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.500166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968320+0000","last_change":"2024-09-15T22:44:21.969398+0000","last_active":"2024-09-15T22:44:22.968320+0000","last_peered":"2024-09-15T22:44:22.968320+0000","last_clean":"2024-09-15T22:44:22.968320+0000","last_became_active":"2024-09-15T22:44:21.969137+0000","last_became_peered":"2024-09-15T22:44:21.969137+0000","last_unstale":"2024-09-15T22:44:22.968320+0000","last_undegraded":"2024-09-15T22:44:22.968320+0000","last_fullsized":"2024-09-15T22:44:22.968320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:12.530310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662170+0000","last_change":"2024-09-15T22:44:21.971472+0000","last_active":"2024-09-15T22:44:23.662170+0000","last_peered":"2024-09-15T22:44:23.662170+0000","last_clean":"2024-09-15T22:44:23.662170+0000","last_became_active":"2024-09-15T22:44:21.971096+0000","last_became_peered":"2024-09-15T22:44:21.971096+0000","last_unstale":"2024-09-15T22:44:23.662170+0000","last_undegraded":"2024-09-15T22:44:23.662170+0000","last_fullsized":"2024-09-15T22:44:23.662170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:12.530310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970162+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.969875+0000","last_became_peered":"2024-09-15T22:44:21.969875+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.172394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971765+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:22.971765+0000","last_peered":"2024-09-15T22:44:22.971765+0000","last_clean":"2024-09-15T22:44:22.971765+0000","last_became_active":"2024-09-15T22:44:21.961717+0000","last_became_peered":"2024-09-15T22:44:21.961717+0000","last_unstale":"2024-09-15T22:44:22.971765+0000","last_undegraded":"2024-09-15T22:44:22.971765+0000","last_fullsized":"2024-09-15T22:44:22.971765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:35.936792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968547+0000","last_change":"2024-09-15T22:44:21.970255+0000","last_active":"2024-09-15T22:44:22.968547+0000","last_peered":"2024-09-15T22:44:22.968547+0000","last_clean":"2024-09-15T22:44:22.968547+0000","last_became_active":"2024-09-15T22:44:21.969655+0000","last_became_peered":"2024-09-15T22:44:21.969655+0000","last_unstale":"2024-09-15T22:44:22.968547+0000","last_undegraded":"2024-09-15T22:44:22.968547+0000","last_fullsized":"2024-09-15T22:44:22.968547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:22.600095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662114+0000","last_change":"2024-09-15T22:44:21.970509+0000","last_active":"2024-09-15T22:44:23.662114+0000","last_peered":"2024-09-15T22:44:23.662114+0000","last_clean":"2024-09-15T22:44:23.662114+0000","last_became_active":"2024-09-15T22:44:21.970247+0000","last_became_peered":"2024-09-15T22:44:21.970247+0000","last_unstale":"2024-09-15T22:44:23.662114+0000","last_undegraded":"2024-09-15T22:44:23.662114+0000","last_fullsized":"2024-09-15T22:44:23.662114+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:08.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968988+0000","last_change":"2024-09-15T22:44:21.970733+0000","last_active":"2024-09-15T22:44:22.968988+0000","last_peered":"2024-09-15T22:44:22.968988+0000","last_clean":"2024-09-15T22:44:22.968988+0000","last_became_active":"2024-09-15T22:44:21.970440+0000","last_became_peered":"2024-09-15T22:44:21.970440+0000","last_unstale":"2024-09-15T22:44:22.968988+0000","last_undegraded":"2024-09-15T22:44:22.968988+0000","last_fullsized":"2024-09-15T22:44:22.968988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662864+0000","last_change":"2024-09-15T22:44:21.973493+0000","last_active":"2024-09-15T22:44:23.662864+0000","last_peered":"2024-09-15T22:44:23.662864+0000","last_clean":"2024-09-15T22:44:23.662864+0000","last_became_active":"2024-09-15T22:44:21.973237+0000","last_became_peered":"2024-09-15T22:44:21.973237+0000","last_unstale":"2024-09-15T22:44:23.662864+0000","last_undegraded":"2024-09-15T22:44:23.662864+0000","last_fullsized":"2024-09-15T22:44:23.662864+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969356+0000","last_change":"2024-09-15T22:44:21.967673+0000","last_active":"2024-09-15T22:44:22.969356+0000","last_peered":"2024-09-15T22:44:22.969356+0000","last_clean":"2024-09-15T22:44:22.969356+0000","last_became_active":"2024-09-15T22:44:21.967380+0000","last_became_peered":"2024-09-15T22:44:21.967380+0000","last_unstale":"2024-09-15T22:44:22.969356+0000","last_undegraded":"2024-09-15T22:44:22.969356+0000","last_fullsized":"2024-09-15T22:44:22.969356+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:30.538282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662613+0000","last_change":"2024-09-15T22:44:21.970142+0000","last_active":"2024-09-15T22:44:23.662613+0000","last_peered":"2024-09-15T22:44:23.662613+0000","last_clean":"2024-09-15T22:44:23.662613+0000","last_became_active":"2024-09-15T22:44:21.965726+0000","last_became_peered":"2024-09-15T22:44:21.965726+0000","last_unstale":"2024-09-15T22:44:23.662613+0000","last_undegraded":"2024-09-15T22:44:23.662613+0000","last_fullsized":"2024-09-15T22:44:23.662613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:53.534579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661939+0000","last_change":"2024-09-15T22:44:21.971517+0000","last_active":"2024-09-15T22:44:23.661939+0000","last_peered":"2024-09-15T22:44:23.661939+0000","last_clean":"2024-09-15T22:44:23.661939+0000","last_became_active":"2024-09-15T22:44:21.971269+0000","last_became_peered":"2024-09-15T22:44:21.971269+0000","last_unstale":"2024-09-15T22:44:23.661939+0000","last_undegraded":"2024-09-15T22:44:23.661939+0000","last_fullsized":"2024-09-15T22:44:23.661939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:55.021082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662186+0000","last_change":"2024-09-15T22:44:21.972735+0000","last_active":"2024-09-15T22:44:23.662186+0000","last_peered":"2024-09-15T22:44:23.662186+0000","last_clean":"2024-09-15T22:44:23.662186+0000","last_became_active":"2024-09-15T22:44:21.972456+0000","last_became_peered":"2024-09-15T22:44:21.972456+0000","last_unstale":"2024-09-15T22:44:23.662186+0000","last_undegraded":"2024-09-15T22:44:23.662186+0000","last_fullsized":"2024-09-15T22:44:23.662186+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:43.476500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662515+0000","last_change":"2024-09-15T22:44:21.962292+0000","last_active":"2024-09-15T22:44:23.662515+0000","last_peered":"2024-09-15T22:44:23.662515+0000","last_clean":"2024-09-15T22:44:23.662515+0000","last_became_active":"2024-09-15T22:44:21.962028+0000","last_became_peered":"2024-09-15T22:44:21.962028+0000","last_unstale":"2024-09-15T22:44:23.662515+0000","last_undegraded":"2024-09-15T22:44:23.662515+0000","last_fullsized":"2024-09-15T22:44:23.662515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:35.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662244+0000","last_change":"2024-09-15T22:44:21.964754+0000","last_active":"2024-09-15T22:44:23.662244+0000","last_peered":"2024-09-15T22:44:23.662244+0000","last_clean":"2024-09-15T22:44:23.662244+0000","last_became_active":"2024-09-15T22:44:21.964494+0000","last_became_peered":"2024-09-15T22:44:21.964494+0000","last_unstale":"2024-09-15T22:44:23.662244+0000","last_undegraded":"2024-09-15T22:44:23.662244+0000","last_fullsized":"2024-09-15T22:44:23.662244+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:44.661369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304481+0000","last_change":"2024-09-15T22:44:21.960524+0000","last_active":"2024-09-15T22:44:23.304481+0000","last_peered":"2024-09-15T22:44:23.304481+0000","last_clean":"2024-09-15T22:44:23.304481+0000","last_became_active":"2024-09-15T22:44:21.960241+0000","last_became_peered":"2024-09-15T22:44:21.960241+0000","last_unstale":"2024-09-15T22:44:23.304481+0000","last_undegraded":"2024-09-15T22:44:23.304481+0000","last_fullsized":"2024-09-15T22:44:23.304481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:08.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304328+0000","last_change":"2024-09-15T22:44:21.967855+0000","last_active":"2024-09-15T22:44:23.304328+0000","last_peered":"2024-09-15T22:44:23.304328+0000","last_clean":"2024-09-15T22:44:23.304328+0000","last_became_active":"2024-09-15T22:44:21.965271+0000","last_became_peered":"2024-09-15T22:44:21.965271+0000","last_unstale":"2024-09-15T22:44:23.304328+0000","last_undegraded":"2024-09-15T22:44:23.304328+0000","last_fullsized":"2024-09-15T22:44:23.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:36.204012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662065+0000","last_change":"2024-09-15T22:44:21.962679+0000","last_active":"2024-09-15T22:44:23.662065+0000","last_peered":"2024-09-15T22:44:23.662065+0000","last_clean":"2024-09-15T22:44:23.662065+0000","last_became_active":"2024-09-15T22:44:21.962419+0000","last_became_peered":"2024-09-15T22:44:21.962419+0000","last_unstale":"2024-09-15T22:44:23.662065+0000","last_undegraded":"2024-09-15T22:44:23.662065+0000","last_fullsized":"2024-09-15T22:44:23.662065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:08.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661822+0000","last_change":"2024-09-15T22:44:21.972500+0000","last_active":"2024-09-15T22:44:23.661822+0000","last_peered":"2024-09-15T22:44:23.661822+0000","last_clean":"2024-09-15T22:44:23.661822+0000","last_became_active":"2024-09-15T22:44:21.972146+0000","last_became_peered":"2024-09-15T22:44:21.972146+0000","last_unstale":"2024-09-15T22:44:23.661822+0000","last_undegraded":"2024-09-15T22:44:23.661822+0000","last_fullsized":"2024-09-15T22:44:23.661822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:26.091548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968884+0000","last_change":"2024-09-15T22:44:21.968730+0000","last_active":"2024-09-15T22:44:22.968884+0000","last_peered":"2024-09-15T22:44:22.968884+0000","last_clean":"2024-09-15T22:44:22.968884+0000","last_became_active":"2024-09-15T22:44:21.968417+0000","last_became_peered":"2024-09-15T22:44:21.968417+0000","last_unstale":"2024-09-15T22:44:22.968884+0000","last_undegraded":"2024-09-15T22:44:22.968884+0000","last_fullsized":"2024-09-15T22:44:22.968884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971645+0000","last_change":"2024-09-15T22:44:21.966181+0000","last_active":"2024-09-15T22:44:22.971645+0000","last_peered":"2024-09-15T22:44:22.971645+0000","last_clean":"2024-09-15T22:44:22.971645+0000","last_became_active":"2024-09-15T22:44:21.965759+0000","last_became_peered":"2024-09-15T22:44:21.965759+0000","last_unstale":"2024-09-15T22:44:22.971645+0000","last_undegraded":"2024-09-15T22:44:22.971645+0000","last_fullsized":"2024-09-15T22:44:22.971645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:16.195412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969213+0000","last_change":"2024-09-15T22:44:20.959633+0000","last_active":"2024-09-15T22:44:22.969213+0000","last_peered":"2024-09-15T22:44:22.969213+0000","last_clean":"2024-09-15T22:44:22.969213+0000","last_became_active":"2024-09-15T22:44:20.959320+0000","last_became_peered":"2024-09-15T22:44:20.959320+0000","last_unstale":"2024-09-15T22:44:22.969213+0000","last_undegraded":"2024-09-15T22:44:22.969213+0000","last_fullsized":"2024-09-15T22:44:22.969213+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.449490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971803+0000","last_change":"2024-09-15T22:44:21.972701+0000","last_active":"2024-09-15T22:44:22.971803+0000","last_peered":"2024-09-15T22:44:22.971803+0000","last_clean":"2024-09-15T22:44:22.971803+0000","last_became_active":"2024-09-15T22:44:21.972403+0000","last_became_peered":"2024-09-15T22:44:21.972403+0000","last_unstale":"2024-09-15T22:44:22.971803+0000","last_undegraded":"2024-09-15T22:44:22.971803+0000","last_fullsized":"2024-09-15T22:44:22.971803+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:38.902404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662181+0000","last_change":"2024-09-15T22:44:20.965481+0000","last_active":"2024-09-15T22:44:23.662181+0000","last_peered":"2024-09-15T22:44:23.662181+0000","last_clean":"2024-09-15T22:44:23.662181+0000","last_became_active":"2024-09-15T22:44:20.965218+0000","last_became_peered":"2024-09-15T22:44:20.965218+0000","last_unstale":"2024-09-15T22:44:23.662181+0000","last_undegraded":"2024-09-15T22:44:23.662181+0000","last_fullsized":"2024-09-15T22:44:23.662181+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:01.187783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304531+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:23.304531+0000","last_peered":"2024-09-15T22:44:23.304531+0000","last_clean":"2024-09-15T22:44:23.304531+0000","last_became_active":"2024-09-15T22:44:21.961677+0000","last_became_peered":"2024-09-15T22:44:21.961677+0000","last_unstale":"2024-09-15T22:44:23.304531+0000","last_undegraded":"2024-09-15T22:44:23.304531+0000","last_fullsized":"2024-09-15T22:44:23.304531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:21.796541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971591+0000","last_change":"2024-09-15T22:44:20.963289+0000","last_active":"2024-09-15T22:44:22.971591+0000","last_peered":"2024-09-15T22:44:22.971591+0000","last_clean":"2024-09-15T22:44:22.971591+0000","last_became_active":"2024-09-15T22:44:20.963013+0000","last_became_peered":"2024-09-15T22:44:20.963013+0000","last_unstale":"2024-09-15T22:44:22.971591+0000","last_undegraded":"2024-09-15T22:44:22.971591+0000","last_fullsized":"2024-09-15T22:44:22.971591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:26.208450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971501+0000","last_change":"2024-09-15T22:44:21.970159+0000","last_active":"2024-09-15T22:44:22.971501+0000","last_peered":"2024-09-15T22:44:22.971501+0000","last_clean":"2024-09-15T22:44:22.971501+0000","last_became_active":"2024-09-15T22:44:21.969890+0000","last_became_peered":"2024-09-15T22:44:21.969890+0000","last_unstale":"2024-09-15T22:44:22.971501+0000","last_undegraded":"2024-09-15T22:44:22.971501+0000","last_fullsized":"2024-09-15T22:44:22.971501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:11.500124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662733+0000","last_change":"2024-09-15T22:44:20.965106+0000","last_active":"2024-09-15T22:44:23.662733+0000","last_peered":"2024-09-15T22:44:23.662733+0000","last_clean":"2024-09-15T22:44:23.662733+0000","last_became_active":"2024-09-15T22:44:20.964830+0000","last_became_peered":"2024-09-15T22:44:20.964830+0000","last_unstale":"2024-09-15T22:44:23.662733+0000","last_undegraded":"2024-09-15T22:44:23.662733+0000","last_fullsized":"2024-09-15T22:44:23.662733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:54.572155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304272+0000","last_change":"2024-09-15T22:44:21.970567+0000","last_active":"2024-09-15T22:44:23.304272+0000","last_peered":"2024-09-15T22:44:23.304272+0000","last_clean":"2024-09-15T22:44:23.304272+0000","last_became_active":"2024-09-15T22:44:21.970095+0000","last_became_peered":"2024-09-15T22:44:21.970095+0000","last_unstale":"2024-09-15T22:44:23.304272+0000","last_undegraded":"2024-09-15T22:44:23.304272+0000","last_fullsized":"2024-09-15T22:44:23.304272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:10.235338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968663+0000","last_change":"2024-09-15T22:44:20.967792+0000","last_active":"2024-09-15T22:44:22.968663+0000","last_peered":"2024-09-15T22:44:22.968663+0000","last_clean":"2024-09-15T22:44:22.968663+0000","last_became_active":"2024-09-15T22:44:20.967471+0000","last_became_peered":"2024-09-15T22:44:20.967471+0000","last_unstale":"2024-09-15T22:44:22.968663+0000","last_undegraded":"2024-09-15T22:44:22.968663+0000","last_fullsized":"2024-09-15T22:44:22.968663+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:52.499019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969183+0000","last_change":"2024-09-15T22:44:21.968012+0000","last_active":"2024-09-15T22:44:22.969183+0000","last_peered":"2024-09-15T22:44:22.969183+0000","last_clean":"2024-09-15T22:44:22.969183+0000","last_became_active":"2024-09-15T22:44:21.967689+0000","last_became_peered":"2024-09-15T22:44:21.967689+0000","last_unstale":"2024-09-15T22:44:22.969183+0000","last_undegraded":"2024-09-15T22:44:22.969183+0000","last_fullsized":"2024-09-15T22:44:22.969183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:14.441401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971435+0000","last_change":"2024-09-15T22:44:20.965421+0000","last_active":"2024-09-15T22:44:22.971435+0000","last_peered":"2024-09-15T22:44:22.971435+0000","last_clean":"2024-09-15T22:44:22.971435+0000","last_became_active":"2024-09-15T22:44:20.965146+0000","last_became_peered":"2024-09-15T22:44:20.965146+0000","last_unstale":"2024-09-15T22:44:22.971435+0000","last_undegraded":"2024-09-15T22:44:22.971435+0000","last_fullsized":"2024-09-15T22:44:22.971435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:46.174738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968278+0000","last_change":"2024-09-15T22:44:21.964712+0000","last_active":"2024-09-15T22:44:22.968278+0000","last_peered":"2024-09-15T22:44:22.968278+0000","last_clean":"2024-09-15T22:44:22.968278+0000","last_became_active":"2024-09-15T22:44:21.963739+0000","last_became_peered":"2024-09-15T22:44:21.963739+0000","last_unstale":"2024-09-15T22:44:22.968278+0000","last_undegraded":"2024-09-15T22:44:22.968278+0000","last_fullsized":"2024-09-15T22:44:22.968278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:36.788800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662266+0000","last_change":"2024-09-15T22:44:20.958649+0000","last_active":"2024-09-15T22:44:23.662266+0000","last_peered":"2024-09-15T22:44:23.662266+0000","last_clean":"2024-09-15T22:44:23.662266+0000","last_became_active":"2024-09-15T22:44:20.958340+0000","last_became_peered":"2024-09-15T22:44:20.958340+0000","last_unstale":"2024-09-15T22:44:23.662266+0000","last_undegraded":"2024-09-15T22:44:23.662266+0000","last_fullsized":"2024-09-15T22:44:23.662266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:47.710702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970842+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.970583+0000","last_became_peered":"2024-09-15T22:44:21.970583+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:51.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662608+0000","last_change":"2024-09-15T22:44:20.954064+0000","last_active":"2024-09-15T22:44:23.662608+0000","last_peered":"2024-09-15T22:44:23.662608+0000","last_clean":"2024-09-15T22:44:23.662608+0000","last_became_active":"2024-09-15T22:44:20.953807+0000","last_became_peered":"2024-09-15T22:44:20.953807+0000","last_unstale":"2024-09-15T22:44:23.662608+0000","last_undegraded":"2024-09-15T22:44:23.662608+0000","last_fullsized":"2024-09-15T22:44:23.662608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:56.681403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662726+0000","last_change":"2024-09-15T22:44:21.970320+0000","last_active":"2024-09-15T22:44:23.662726+0000","last_peered":"2024-09-15T22:44:23.662726+0000","last_clean":"2024-09-15T22:44:23.662726+0000","last_became_active":"2024-09-15T22:44:21.970058+0000","last_became_peered":"2024-09-15T22:44:21.970058+0000","last_unstale":"2024-09-15T22:44:23.662726+0000","last_undegraded":"2024-09-15T22:44:23.662726+0000","last_fullsized":"2024-09-15T22:44:23.662726+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:22.600095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662171+0000","last_change":"2024-09-15T22:44:20.959186+0000","last_active":"2024-09-15T22:44:23.662171+0000","last_peered":"2024-09-15T22:44:23.662171+0000","last_clean":"2024-09-15T22:44:23.662171+0000","last_became_active":"2024-09-15T22:44:20.958905+0000","last_became_peered":"2024-09-15T22:44:20.958905+0000","last_unstale":"2024-09-15T22:44:23.662171+0000","last_undegraded":"2024-09-15T22:44:23.662171+0000","last_fullsized":"2024-09-15T22:44:23.662171+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968483+0000","last_change":"2024-09-15T22:44:21.975115+0000","last_active":"2024-09-15T22:44:22.968483+0000","last_peered":"2024-09-15T22:44:22.968483+0000","last_clean":"2024-09-15T22:44:22.968483+0000","last_became_active":"2024-09-15T22:44:21.974860+0000","last_became_peered":"2024-09-15T22:44:21.974860+0000","last_unstale":"2024-09-15T22:44:22.968483+0000","last_undegraded":"2024-09-15T22:44:22.968483+0000","last_fullsized":"2024-09-15T22:44:22.968483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.500166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304594+0000","last_change":"2024-09-15T22:44:20.963252+0000","last_active":"2024-09-15T22:44:23.304594+0000","last_peered":"2024-09-15T22:44:23.304594+0000","last_clean":"2024-09-15T22:44:23.304594+0000","last_became_active":"2024-09-15T22:44:20.962903+0000","last_became_peered":"2024-09-15T22:44:20.962903+0000","last_unstale":"2024-09-15T22:44:23.304594+0000","last_undegraded":"2024-09-15T22:44:23.304594+0000","last_fullsized":"2024-09-15T22:44:23.304594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:08.285828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304683+0000","last_change":"2024-09-15T22:44:21.956575+0000","last_active":"2024-09-15T22:44:23.304683+0000","last_peered":"2024-09-15T22:44:23.304683+0000","last_clean":"2024-09-15T22:44:23.304683+0000","last_became_active":"2024-09-15T22:44:21.956315+0000","last_became_peered":"2024-09-15T22:44:21.956315+0000","last_unstale":"2024-09-15T22:44:23.304683+0000","last_undegraded":"2024-09-15T22:44:23.304683+0000","last_fullsized":"2024-09-15T22:44:23.304683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:42.024963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662859+0000","last_change":"2024-09-15T22:44:20.965734+0000","last_active":"2024-09-15T22:44:23.662859+0000","last_peered":"2024-09-15T22:44:23.662859+0000","last_clean":"2024-09-15T22:44:23.662859+0000","last_became_active":"2024-09-15T22:44:20.965475+0000","last_became_peered":"2024-09-15T22:44:20.965475+0000","last_unstale":"2024-09-15T22:44:23.662859+0000","last_undegraded":"2024-09-15T22:44:23.662859+0000","last_fullsized":"2024-09-15T22:44:23.662859+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:21.464136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662744+0000","last_change":"2024-09-15T22:44:21.956442+0000","last_active":"2024-09-15T22:44:23.662744+0000","last_peered":"2024-09-15T22:44:23.662744+0000","last_clean":"2024-09-15T22:44:23.662744+0000","last_became_active":"2024-09-15T22:44:21.956166+0000","last_became_peered":"2024-09-15T22:44:21.956166+0000","last_unstale":"2024-09-15T22:44:23.662744+0000","last_undegraded":"2024-09-15T22:44:23.662744+0000","last_fullsized":"2024-09-15T22:44:23.662744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:37.643908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.663052+0000","last_change":"2024-09-15T22:44:20.963930+0000","last_active":"2024-09-15T22:44:23.663052+0000","last_peered":"2024-09-15T22:44:23.663052+0000","last_clean":"2024-09-15T22:44:23.663052+0000","last_became_active":"2024-09-15T22:44:20.963655+0000","last_became_peered":"2024-09-15T22:44:20.963655+0000","last_unstale":"2024-09-15T22:44:23.663052+0000","last_undegraded":"2024-09-15T22:44:23.663052+0000","last_fullsized":"2024-09-15T22:44:23.663052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:55.035704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662238+0000","last_change":"2024-09-15T22:44:21.966977+0000","last_active":"2024-09-15T22:44:23.662238+0000","last_peered":"2024-09-15T22:44:23.662238+0000","last_clean":"2024-09-15T22:44:23.662238+0000","last_became_active":"2024-09-15T22:44:21.966669+0000","last_became_peered":"2024-09-15T22:44:21.966669+0000","last_unstale":"2024-09-15T22:44:23.662238+0000","last_undegraded":"2024-09-15T22:44:23.662238+0000","last_fullsized":"2024-09-15T22:44:23.662238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:26.091548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304453+0000","last_change":"2024-09-15T22:44:20.963287+0000","last_active":"2024-09-15T22:44:23.304453+0000","last_peered":"2024-09-15T22:44:23.304453+0000","last_clean":"2024-09-15T22:44:23.304453+0000","last_became_active":"2024-09-15T22:44:20.962848+0000","last_became_peered":"2024-09-15T22:44:20.962848+0000","last_unstale":"2024-09-15T22:44:23.304453+0000","last_undegraded":"2024-09-15T22:44:23.304453+0000","last_fullsized":"2024-09-15T22:44:23.304453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:21.594597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968558+0000","last_change":"2024-09-15T22:44:21.965328+0000","last_active":"2024-09-15T22:44:22.968558+0000","last_peered":"2024-09-15T22:44:22.968558+0000","last_clean":"2024-09-15T22:44:22.968558+0000","last_became_active":"2024-09-15T22:44:21.965053+0000","last_became_peered":"2024-09-15T22:44:21.965053+0000","last_unstale":"2024-09-15T22:44:22.968558+0000","last_undegraded":"2024-09-15T22:44:22.968558+0000","last_fullsized":"2024-09-15T22:44:22.968558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662089+0000","last_change":"2024-09-15T22:44:20.963978+0000","last_active":"2024-09-15T22:44:23.662089+0000","last_peered":"2024-09-15T22:44:23.662089+0000","last_clean":"2024-09-15T22:44:23.662089+0000","last_became_active":"2024-09-15T22:44:20.963698+0000","last_became_peered":"2024-09-15T22:44:20.963698+0000","last_unstale":"2024-09-15T22:44:23.662089+0000","last_undegraded":"2024-09-15T22:44:23.662089+0000","last_fullsized":"2024-09-15T22:44:23.662089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:40.777192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662028+0000","last_change":"2024-09-15T22:44:21.962678+0000","last_active":"2024-09-15T22:44:23.662028+0000","last_peered":"2024-09-15T22:44:23.662028+0000","last_clean":"2024-09-15T22:44:23.662028+0000","last_became_active":"2024-09-15T22:44:21.962413+0000","last_became_peered":"2024-09-15T22:44:21.962413+0000","last_unstale":"2024-09-15T22:44:23.662028+0000","last_undegraded":"2024-09-15T22:44:23.662028+0000","last_fullsized":"2024-09-15T22:44:23.662028+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.882415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662733+0000","last_change":"2024-09-15T22:44:20.959952+0000","last_active":"2024-09-15T22:44:23.662733+0000","last_peered":"2024-09-15T22:44:23.662733+0000","last_clean":"2024-09-15T22:44:23.662733+0000","last_became_active":"2024-09-15T22:44:20.959667+0000","last_became_peered":"2024-09-15T22:44:20.959667+0000","last_unstale":"2024-09-15T22:44:23.662733+0000","last_undegraded":"2024-09-15T22:44:23.662733+0000","last_fullsized":"2024-09-15T22:44:23.662733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:36.814570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662851+0000","last_change":"2024-09-15T22:44:21.966082+0000","last_active":"2024-09-15T22:44:23.662851+0000","last_peered":"2024-09-15T22:44:23.662851+0000","last_clean":"2024-09-15T22:44:23.662851+0000","last_became_active":"2024-09-15T22:44:21.965407+0000","last_became_peered":"2024-09-15T22:44:21.965407+0000","last_unstale":"2024-09-15T22:44:23.662851+0000","last_undegraded":"2024-09-15T22:44:23.662851+0000","last_fullsized":"2024-09-15T22:44:23.662851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.613820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662439+0000","last_change":"2024-09-15T22:44:20.960790+0000","last_active":"2024-09-15T22:44:23.662439+0000","last_peered":"2024-09-15T22:44:23.662439+0000","last_clean":"2024-09-15T22:44:23.662439+0000","last_became_active":"2024-09-15T22:44:20.960509+0000","last_became_peered":"2024-09-15T22:44:20.960509+0000","last_unstale":"2024-09-15T22:44:23.662439+0000","last_undegraded":"2024-09-15T22:44:23.662439+0000","last_fullsized":"2024-09-15T22:44:23.662439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:48.901073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968701+0000","last_change":"2024-09-15T22:44:21.970465+0000","last_active":"2024-09-15T22:44:22.968701+0000","last_peered":"2024-09-15T22:44:22.968701+0000","last_clean":"2024-09-15T22:44:22.968701+0000","last_became_active":"2024-09-15T22:44:21.969997+0000","last_became_peered":"2024-09-15T22:44:21.969997+0000","last_unstale":"2024-09-15T22:44:22.968701+0000","last_undegraded":"2024-09-15T22:44:22.968701+0000","last_fullsized":"2024-09-15T22:44:22.968701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:22.880809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662191+0000","last_change":"2024-09-15T22:44:20.967358+0000","last_active":"2024-09-15T22:44:23.662191+0000","last_peered":"2024-09-15T22:44:23.662191+0000","last_clean":"2024-09-15T22:44:23.662191+0000","last_became_active":"2024-09-15T22:44:20.966982+0000","last_became_peered":"2024-09-15T22:44:20.966982+0000","last_unstale":"2024-09-15T22:44:23.662191+0000","last_undegraded":"2024-09-15T22:44:23.662191+0000","last_fullsized":"2024-09-15T22:44:23.662191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:42.685193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968638+0000","last_change":"2024-09-15T22:44:21.968421+0000","last_active":"2024-09-15T22:44:22.968638+0000","last_peered":"2024-09-15T22:44:22.968638+0000","last_clean":"2024-09-15T22:44:22.968638+0000","last_became_active":"2024-09-15T22:44:21.968151+0000","last_became_peered":"2024-09-15T22:44:21.968151+0000","last_unstale":"2024-09-15T22:44:22.968638+0000","last_undegraded":"2024-09-15T22:44:22.968638+0000","last_fullsized":"2024-09-15T22:44:22.968638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304630+0000","last_change":"2024-09-15T22:44:20.963170+0000","last_active":"2024-09-15T22:44:23.304630+0000","last_peered":"2024-09-15T22:44:23.304630+0000","last_clean":"2024-09-15T22:44:23.304630+0000","last_became_active":"2024-09-15T22:44:20.962837+0000","last_became_peered":"2024-09-15T22:44:20.962837+0000","last_unstale":"2024-09-15T22:44:23.304630+0000","last_undegraded":"2024-09-15T22:44:23.304630+0000","last_fullsized":"2024-09-15T22:44:23.304630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:17.435610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661920+0000","last_change":"2024-09-15T22:44:21.966285+0000","last_active":"2024-09-15T22:44:23.661920+0000","last_peered":"2024-09-15T22:44:23.661920+0000","last_clean":"2024-09-15T22:44:23.661920+0000","last_became_active":"2024-09-15T22:44:21.965930+0000","last_became_peered":"2024-09-15T22:44:21.965930+0000","last_unstale":"2024-09-15T22:44:23.661920+0000","last_undegraded":"2024-09-15T22:44:23.661920+0000","last_fullsized":"2024-09-15T22:44:23.661920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:51.888531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968683+0000","last_change":"2024-09-15T22:44:20.963980+0000","last_active":"2024-09-15T22:44:22.968683+0000","last_peered":"2024-09-15T22:44:22.968683+0000","last_clean":"2024-09-15T22:44:22.968683+0000","last_became_active":"2024-09-15T22:44:20.963718+0000","last_became_peered":"2024-09-15T22:44:20.963718+0000","last_unstale":"2024-09-15T22:44:22.968683+0000","last_undegraded":"2024-09-15T22:44:22.968683+0000","last_fullsized":"2024-09-15T22:44:22.968683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.287896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662887+0000","last_change":"2024-09-15T22:44:21.962906+0000","last_active":"2024-09-15T22:44:23.662887+0000","last_peered":"2024-09-15T22:44:23.662887+0000","last_clean":"2024-09-15T22:44:23.662887+0000","last_became_active":"2024-09-15T22:44:21.962667+0000","last_became_peered":"2024-09-15T22:44:21.962667+0000","last_unstale":"2024-09-15T22:44:23.662887+0000","last_undegraded":"2024-09-15T22:44:23.662887+0000","last_fullsized":"2024-09-15T22:44:23.662887+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:07.804842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304643+0000","last_change":"2024-09-15T22:44:20.964846+0000","last_active":"2024-09-15T22:44:23.304643+0000","last_peered":"2024-09-15T22:44:23.304643+0000","last_clean":"2024-09-15T22:44:23.304643+0000","last_became_active":"2024-09-15T22:44:20.964581+0000","last_became_peered":"2024-09-15T22:44:20.964581+0000","last_unstale":"2024-09-15T22:44:23.304643+0000","last_undegraded":"2024-09-15T22:44:23.304643+0000","last_fullsized":"2024-09-15T22:44:23.304643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:04.494669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662390+0000","last_change":"2024-09-15T22:44:21.970881+0000","last_active":"2024-09-15T22:44:23.662390+0000","last_peered":"2024-09-15T22:44:23.662390+0000","last_clean":"2024-09-15T22:44:23.662390+0000","last_became_active":"2024-09-15T22:44:21.970607+0000","last_became_peered":"2024-09-15T22:44:21.970607+0000","last_unstale":"2024-09-15T22:44:23.662390+0000","last_undegraded":"2024-09-15T22:44:23.662390+0000","last_fullsized":"2024-09-15T22:44:23.662390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:33.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969146+0000","last_change":"2024-09-15T22:44:20.955951+0000","last_active":"2024-09-15T22:44:22.969146+0000","last_peered":"2024-09-15T22:44:22.969146+0000","last_clean":"2024-09-15T22:44:22.969146+0000","last_became_active":"2024-09-15T22:44:20.955657+0000","last_became_peered":"2024-09-15T22:44:20.955657+0000","last_unstale":"2024-09-15T22:44:22.969146+0000","last_undegraded":"2024-09-15T22:44:22.969146+0000","last_fullsized":"2024-09-15T22:44:22.969146+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:47.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304428+0000","last_change":"2024-09-15T22:44:21.963184+0000","last_active":"2024-09-15T22:44:23.304428+0000","last_peered":"2024-09-15T22:44:23.304428+0000","last_clean":"2024-09-15T22:44:23.304428+0000","last_became_active":"2024-09-15T22:44:21.962840+0000","last_became_peered":"2024-09-15T22:44:21.962840+0000","last_unstale":"2024-09-15T22:44:23.304428+0000","last_undegraded":"2024-09-15T22:44:23.304428+0000","last_fullsized":"2024-09-15T22:44:23.304428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:14.755532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304270+0000","last_change":"2024-09-15T22:44:20.963436+0000","last_active":"2024-09-15T22:44:23.304270+0000","last_peered":"2024-09-15T22:44:23.304270+0000","last_clean":"2024-09-15T22:44:23.304270+0000","last_became_active":"2024-09-15T22:44:20.962857+0000","last_became_peered":"2024-09-15T22:44:20.962857+0000","last_unstale":"2024-09-15T22:44:23.304270+0000","last_undegraded":"2024-09-15T22:44:23.304270+0000","last_fullsized":"2024-09-15T22:44:23.304270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:34.206219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304250+0000","last_change":"2024-09-15T22:44:21.967933+0000","last_active":"2024-09-15T22:44:23.304250+0000","last_peered":"2024-09-15T22:44:23.304250+0000","last_clean":"2024-09-15T22:44:23.304250+0000","last_became_active":"2024-09-15T22:44:21.967646+0000","last_became_peered":"2024-09-15T22:44:21.967646+0000","last_unstale":"2024-09-15T22:44:23.304250+0000","last_undegraded":"2024-09-15T22:44:23.304250+0000","last_fullsized":"2024-09-15T22:44:23.304250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:42.029341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662061+0000","last_change":"2024-09-15T22:44:20.965332+0000","last_active":"2024-09-15T22:44:23.662061+0000","last_peered":"2024-09-15T22:44:23.662061+0000","last_clean":"2024-09-15T22:44:23.662061+0000","last_became_active":"2024-09-15T22:44:20.965024+0000","last_became_peered":"2024-09-15T22:44:20.965024+0000","last_unstale":"2024-09-15T22:44:23.662061+0000","last_undegraded":"2024-09-15T22:44:23.662061+0000","last_fullsized":"2024-09-15T22:44:23.662061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:42.685193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968792+0000","last_change":"2024-09-15T22:44:21.970771+0000","last_active":"2024-09-15T22:44:22.968792+0000","last_peered":"2024-09-15T22:44:22.968792+0000","last_clean":"2024-09-15T22:44:22.968792+0000","last_became_active":"2024-09-15T22:44:21.969402+0000","last_became_peered":"2024-09-15T22:44:21.969402+0000","last_unstale":"2024-09-15T22:44:22.968792+0000","last_undegraded":"2024-09-15T22:44:22.968792+0000","last_fullsized":"2024-09-15T22:44:22.968792+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:30.538282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662264+0000","last_change":"2024-09-15T22:44:20.964770+0000","last_active":"2024-09-15T22:44:23.662264+0000","last_peered":"2024-09-15T22:44:23.662264+0000","last_clean":"2024-09-15T22:44:23.662264+0000","last_became_active":"2024-09-15T22:44:20.964468+0000","last_became_peered":"2024-09-15T22:44:20.964468+0000","last_unstale":"2024-09-15T22:44:23.662264+0000","last_undegraded":"2024-09-15T22:44:23.662264+0000","last_fullsized":"2024-09-15T22:44:23.662264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:33.632416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968739+0000","last_change":"2024-09-15T22:44:21.964702+0000","last_active":"2024-09-15T22:44:22.968739+0000","last_peered":"2024-09-15T22:44:22.968739+0000","last_clean":"2024-09-15T22:44:22.968739+0000","last_became_active":"2024-09-15T22:44:21.964398+0000","last_became_peered":"2024-09-15T22:44:21.964398+0000","last_unstale":"2024-09-15T22:44:22.968739+0000","last_undegraded":"2024-09-15T22:44:22.968739+0000","last_fullsized":"2024-09-15T22:44:22.968739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:14.441401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971699+0000","last_change":"2024-09-15T22:44:20.964367+0000","last_active":"2024-09-15T22:44:22.971699+0000","last_peered":"2024-09-15T22:44:22.971699+0000","last_clean":"2024-09-15T22:44:22.971699+0000","last_became_active":"2024-09-15T22:44:20.964060+0000","last_became_peered":"2024-09-15T22:44:20.964060+0000","last_unstale":"2024-09-15T22:44:22.971699+0000","last_undegraded":"2024-09-15T22:44:22.971699+0000","last_fullsized":"2024-09-15T22:44:22.971699+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:15.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661996+0000","last_change":"2024-09-15T22:44:21.969522+0000","last_active":"2024-09-15T22:44:23.661996+0000","last_peered":"2024-09-15T22:44:23.661996+0000","last_clean":"2024-09-15T22:44:23.661996+0000","last_became_active":"2024-09-15T22:44:21.968349+0000","last_became_peered":"2024-09-15T22:44:21.968349+0000","last_unstale":"2024-09-15T22:44:23.661996+0000","last_undegraded":"2024-09-15T22:44:23.661996+0000","last_fullsized":"2024-09-15T22:44:23.661996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:33.871575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.663086+0000","last_change":"2024-09-15T22:44:20.962967+0000","last_active":"2024-09-15T22:44:23.663086+0000","last_peered":"2024-09-15T22:44:23.663086+0000","last_clean":"2024-09-15T22:44:23.663086+0000","last_became_active":"2024-09-15T22:44:20.962621+0000","last_became_peered":"2024-09-15T22:44:20.962621+0000","last_unstale":"2024-09-15T22:44:23.663086+0000","last_undegraded":"2024-09-15T22:44:23.663086+0000","last_fullsized":"2024-09-15T22:44:23.663086+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:01.187783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304745+0000","last_change":"2024-09-15T22:44:21.961850+0000","last_active":"2024-09-15T22:44:23.304745+0000","last_peered":"2024-09-15T22:44:23.304745+0000","last_clean":"2024-09-15T22:44:23.304745+0000","last_became_active":"2024-09-15T22:44:21.961575+0000","last_became_peered":"2024-09-15T22:44:21.961575+0000","last_unstale":"2024-09-15T22:44:23.304745+0000","last_undegraded":"2024-09-15T22:44:23.304745+0000","last_fullsized":"2024-09-15T22:44:23.304745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:53.534579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968424+0000","last_change":"2024-09-15T22:44:20.966571+0000","last_active":"2024-09-15T22:44:22.968424+0000","last_peered":"2024-09-15T22:44:22.968424+0000","last_clean":"2024-09-15T22:44:22.968424+0000","last_became_active":"2024-09-15T22:44:20.966183+0000","last_became_peered":"2024-09-15T22:44:20.966183+0000","last_unstale":"2024-09-15T22:44:22.968424+0000","last_undegraded":"2024-09-15T22:44:22.968424+0000","last_fullsized":"2024-09-15T22:44:22.968424+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:30.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971326+0000","last_change":"2024-09-15T22:44:21.975311+0000","last_active":"2024-09-15T22:44:22.971326+0000","last_peered":"2024-09-15T22:44:22.971326+0000","last_clean":"2024-09-15T22:44:22.971326+0000","last_became_active":"2024-09-15T22:44:21.975052+0000","last_became_peered":"2024-09-15T22:44:21.975052+0000","last_unstale":"2024-09-15T22:44:22.971326+0000","last_undegraded":"2024-09-15T22:44:22.971326+0000","last_fullsized":"2024-09-15T22:44:22.971326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:03.634300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661826+0000","last_change":"2024-09-15T22:44:20.967962+0000","last_active":"2024-09-15T22:44:23.661826+0000","last_peered":"2024-09-15T22:44:23.661826+0000","last_clean":"2024-09-15T22:44:23.661826+0000","last_became_active":"2024-09-15T22:44:20.967669+0000","last_became_peered":"2024-09-15T22:44:20.967669+0000","last_unstale":"2024-09-15T22:44:23.661826+0000","last_undegraded":"2024-09-15T22:44:23.661826+0000","last_fullsized":"2024-09-15T22:44:23.661826+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662726+0000","last_change":"2024-09-15T22:44:21.974096+0000","last_active":"2024-09-15T22:44:23.662726+0000","last_peered":"2024-09-15T22:44:23.662726+0000","last_clean":"2024-09-15T22:44:23.662726+0000","last_became_active":"2024-09-15T22:44:21.973817+0000","last_became_peered":"2024-09-15T22:44:21.973817+0000","last_unstale":"2024-09-15T22:44:23.662726+0000","last_undegraded":"2024-09-15T22:44:23.662726+0000","last_fullsized":"2024-09-15T22:44:23.662726+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968582+0000","last_change":"2024-09-15T22:44:20.962150+0000","last_active":"2024-09-15T22:44:22.968582+0000","last_peered":"2024-09-15T22:44:22.968582+0000","last_clean":"2024-09-15T22:44:22.968582+0000","last_became_active":"2024-09-15T22:44:20.961861+0000","last_became_peered":"2024-09-15T22:44:20.961861+0000","last_unstale":"2024-09-15T22:44:22.968582+0000","last_undegraded":"2024-09-15T22:44:22.968582+0000","last_fullsized":"2024-09-15T22:44:22.968582+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:15.973313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304165+0000","last_change":"2024-09-15T22:44:21.962781+0000","last_active":"2024-09-15T22:44:23.304165+0000","last_peered":"2024-09-15T22:44:23.304165+0000","last_clean":"2024-09-15T22:44:23.304165+0000","last_became_active":"2024-09-15T22:44:21.962468+0000","last_became_peered":"2024-09-15T22:44:21.962468+0000","last_unstale":"2024-09-15T22:44:23.304165+0000","last_undegraded":"2024-09-15T22:44:23.304165+0000","last_fullsized":"2024-09-15T22:44:23.304165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:02.681660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971148+0000","last_change":"2024-09-15T22:44:20.962947+0000","last_active":"2024-09-15T22:44:22.971148+0000","last_peered":"2024-09-15T22:44:22.971148+0000","last_clean":"2024-09-15T22:44:22.971148+0000","last_became_active":"2024-09-15T22:44:20.962625+0000","last_became_peered":"2024-09-15T22:44:20.962625+0000","last_unstale":"2024-09-15T22:44:22.971148+0000","last_undegraded":"2024-09-15T22:44:22.971148+0000","last_fullsized":"2024-09-15T22:44:22.971148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:03.363102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661886+0000","last_change":"2024-09-15T22:44:21.973106+0000","last_active":"2024-09-15T22:44:23.661886+0000","last_peered":"2024-09-15T22:44:23.661886+0000","last_clean":"2024-09-15T22:44:23.661886+0000","last_became_active":"2024-09-15T22:44:21.972860+0000","last_became_peered":"2024-09-15T22:44:21.972860+0000","last_unstale":"2024-09-15T22:44:23.661886+0000","last_undegraded":"2024-09-15T22:44:23.661886+0000","last_fullsized":"2024-09-15T22:44:23.661886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:33.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304291+0000","last_change":"2024-09-15T22:44:20.961177+0000","last_active":"2024-09-15T22:44:23.304291+0000","last_peered":"2024-09-15T22:44:23.304291+0000","last_clean":"2024-09-15T22:44:23.304291+0000","last_became_active":"2024-09-15T22:44:20.960859+0000","last_became_peered":"2024-09-15T22:44:20.960859+0000","last_unstale":"2024-09-15T22:44:23.304291+0000","last_undegraded":"2024-09-15T22:44:23.304291+0000","last_fullsized":"2024-09-15T22:44:23.304291+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:21.875312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304401+0000","last_change":"2024-09-15T22:44:21.957672+0000","last_active":"2024-09-15T22:44:23.304401+0000","last_peered":"2024-09-15T22:44:23.304401+0000","last_clean":"2024-09-15T22:44:23.304401+0000","last_became_active":"2024-09-15T22:44:21.957407+0000","last_became_peered":"2024-09-15T22:44:21.957407+0000","last_unstale":"2024-09-15T22:44:23.304401+0000","last_undegraded":"2024-09-15T22:44:23.304401+0000","last_fullsized":"2024-09-15T22:44:23.304401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:41.287027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662254+0000","last_change":"2024-09-15T22:44:20.959715+0000","last_active":"2024-09-15T22:44:23.662254+0000","last_peered":"2024-09-15T22:44:23.662254+0000","last_clean":"2024-09-15T22:44:23.662254+0000","last_became_active":"2024-09-15T22:44:20.957914+0000","last_became_peered":"2024-09-15T22:44:20.957914+0000","last_unstale":"2024-09-15T22:44:23.662254+0000","last_undegraded":"2024-09-15T22:44:23.662254+0000","last_fullsized":"2024-09-15T22:44:23.662254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:53.458307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":239,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662124+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:23.662124+0000","last_peered":"2024-09-15T22:44:23.662124+0000","last_clean":"2024-09-15T22:44:23.662124+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:23.662124+0000","last_undegraded":"2024-09-15T22:44:23.662124+0000","last_fullsized":"2024-09-15T22:44:23.662124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":299524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":889834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":300048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":299522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":301204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1323008,"data_stored":890382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":737280,"data_stored":301044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":299454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:30.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:44:30.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.369+0000 7ffbfbad0640 1 Processor -- start 2024-09-15T22:44:30.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 -- start start 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffbf415e940 0x7ffbf40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffbf415ed20 0x7ffbf40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf40b7170 con 0x7ffbf40cef90 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf40d1ae0 con 0x7ffbf415e940 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.370+0000 7ffbfbad0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf40b7aa0 con 0x7ffbf415ed20 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffbf415e940 0x7ffbf40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffbf415e940 0x7ffbf40d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52106/0 (socket says 172.21.15.134:52106) 2024-09-15T22:44:30.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 -- 172.21.15.134:0/1733423115 learned_addr learned my addr 172.21.15.134:0/1733423115 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:30.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 -- 172.21.15.134:0/1733423115 >> v2:172.21.15.177:3300/0 conn(0x7ffbf415ed20 msgr2=0x7ffbf40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:30.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 --2- 172.21.15.134:0/1733423115 >> v2:172.21.15.177:3300/0 conn(0x7ffbf415ed20 0x7ffbf40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 -- 172.21.15.134:0/1733423115 >> v1:172.21.15.177:6789/0 conn(0x7ffbf40cef90 legacy=0x7ffbf40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:30.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.371+0000 7ffbf986c640 1 -- 172.21.15.134:0/1733423115 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf40d3660 con 0x7ffbf415e940 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbf986c640 1 --2- 172.21.15.134:0/1733423115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415e940 0x7ffbf40d1060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffbf406e900 tx=0x7ffbf002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfbccbeba925f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbf886a640 1 -- 172.21.15.134:0/1733423115 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbf0037070 con 0x7ffbf415e940 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbf886a640 1 -- 172.21.15.134:0/1733423115 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbf0032440 con 0x7ffbf415e940 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbf886a640 1 -- 172.21.15.134:0/1733423115 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbf0032810 con 0x7ffbf415e940 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1733423115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415e940 msgr2=0x7ffbf40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1733423115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415e940 0x7ffbf40d1060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffbf406e900 tx=0x7ffbf002a2c0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1733423115 shutdown_connections 2024-09-15T22:44:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1733423115 >> v2:172.21.15.177:3300/0 conn(0x7ffbf415ed20 0x7ffbf40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1733423115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415e940 0x7ffbf40d1060 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1733423115 >> 172.21.15.134:0/1733423115 conn(0x7ffbf40b6240 msgr2=0x7ffbf40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1733423115 shutdown_connections 2024-09-15T22:44:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.372+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1733423115 wait complete. 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 Processor -- start 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 -- start start 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbf40cef90 0x7ffbf40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbf415e940 0x7ffbf415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf40d3f00 con 0x7ffbf415ed20 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf40d3c20 con 0x7ffbf415e940 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfbad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf40d3310 con 0x7ffbf40cef90 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfa06d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfa06d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52120/0 (socket says 172.21.15.134:52120) 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.374+0000 7ffbfa06d640 1 -- 172.21.15.134:0/1570709543 learned_addr learned my addr 172.21.15.134:0/1570709543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbf906b640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbf415e940 0x7ffbf415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbf986c640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbf40cef90 0x7ffbf40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 -- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbf40cef90 msgr2=0x7ffbf40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbf40cef90 0x7ffbf40cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 -- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbf415e940 msgr2=0x7ffbf415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbf415e940 0x7ffbf415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 -- 172.21.15.134:0/1570709543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf415afb0 con 0x7ffbf415ed20 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfa06d640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00c7b0 tx=0x7ffbec00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec017070 con 0x7ffbf415ed20 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbec003da0 con 0x7ffbf415ed20 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec0052b0 con 0x7ffbf415ed20 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf415b290 con 0x7ffbf415ed20 2024-09-15T22:44:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.375+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf415b850 con 0x7ffbf415ed20 2024-09-15T22:44:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.376+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf40d1ef0 con 0x7ffbf415ed20 2024-09-15T22:44:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.377+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7ffbec01a070 con 0x7ffbf415ed20 2024-09-15T22:44:30.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.377+0000 7ffbea7fc640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 0x7ffbd806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.377+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ffbec08ac90 con 0x7ffbf415ed20 2024-09-15T22:44:30.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.377+0000 7ffbf986c640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 0x7ffbd806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.378+0000 7ffbf986c640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 0x7ffbd806e920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0034000 tx=0x7ffbf002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.382+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbec058be0 con 0x7ffbf415ed20 2024-09-15T22:44:30.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.544+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbf415ba50 con 0x7ffbd806c460 2024-09-15T22:44:30.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.550+0000 7ffbea7fc640 1 -- 172.21.15.134:0/1570709543 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7ffbf415ba50 con 0x7ffbd806c460 2024-09-15T22:44:30.554 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:30.555 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:44:30.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 msgr2=0x7ffbd806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 0x7ffbd806e920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0034000 tx=0x7ffbf002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 msgr2=0x7ffbf40b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00c7b0 tx=0x7ffbec00cc70 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 shutdown_connections 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ffbd806c460 0x7ffbd806e920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbf415ed20 0x7ffbf40b96a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbf415e940 0x7ffbf415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 --2- 172.21.15.134:0/1570709543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbf40cef90 0x7ffbf40cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 >> 172.21.15.134:0/1570709543 conn(0x7ffbf40b6240 msgr2=0x7ffbf40d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 shutdown_connections 2024-09-15T22:44:30.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.553+0000 7ffbfbad0640 1 -- 172.21.15.134:0/1570709543 wait complete. 2024-09-15T22:44:30.565 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-15T22:44:28.988089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231460,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743260,"statfs":{"total":773094113280,"available":772857098240,"internally_reserved":0,"allocated":7053312,"data_stored":3581012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001648"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971718+0000","last_change":"2024-09-15T22:44:21.964019+0000","last_active":"2024-09-15T22:44:22.971718+0000","last_peered":"2024-09-15T22:44:22.971718+0000","last_clean":"2024-09-15T22:44:22.971718+0000","last_became_active":"2024-09-15T22:44:21.963745+0000","last_became_peered":"2024-09-15T22:44:21.963745+0000","last_unstale":"2024-09-15T22:44:22.971718+0000","last_undegraded":"2024-09-15T22:44:22.971718+0000","last_fullsized":"2024-09-15T22:44:22.971718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:08.177048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662135+0000","last_change":"2024-09-15T22:44:21.971206+0000","last_active":"2024-09-15T22:44:23.662135+0000","last_peered":"2024-09-15T22:44:23.662135+0000","last_clean":"2024-09-15T22:44:23.662135+0000","last_became_active":"2024-09-15T22:44:21.970939+0000","last_became_peered":"2024-09-15T22:44:21.970939+0000","last_unstale":"2024-09-15T22:44:23.662135+0000","last_undegraded":"2024-09-15T22:44:23.662135+0000","last_fullsized":"2024-09-15T22:44:23.662135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:00.711404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968477+0000","last_change":"2024-09-15T22:44:21.965822+0000","last_active":"2024-09-15T22:44:22.968477+0000","last_peered":"2024-09-15T22:44:22.968477+0000","last_clean":"2024-09-15T22:44:22.968477+0000","last_became_active":"2024-09-15T22:44:21.965461+0000","last_became_peered":"2024-09-15T22:44:21.965461+0000","last_unstale":"2024-09-15T22:44:22.968477+0000","last_undegraded":"2024-09-15T22:44:22.968477+0000","last_fullsized":"2024-09-15T22:44:22.968477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:35.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662597+0000","last_change":"2024-09-15T22:44:21.962258+0000","last_active":"2024-09-15T22:44:23.662597+0000","last_peered":"2024-09-15T22:44:23.662597+0000","last_clean":"2024-09-15T22:44:23.662597+0000","last_became_active":"2024-09-15T22:44:21.962018+0000","last_became_peered":"2024-09-15T22:44:21.962018+0000","last_unstale":"2024-09-15T22:44:23.662597+0000","last_undegraded":"2024-09-15T22:44:23.662597+0000","last_fullsized":"2024-09-15T22:44:23.662597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:42.024963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971364+0000","last_change":"2024-09-15T22:44:21.969484+0000","last_active":"2024-09-15T22:44:22.971364+0000","last_peered":"2024-09-15T22:44:22.971364+0000","last_clean":"2024-09-15T22:44:22.971364+0000","last_became_active":"2024-09-15T22:44:21.969069+0000","last_became_peered":"2024-09-15T22:44:21.969069+0000","last_unstale":"2024-09-15T22:44:22.971364+0000","last_undegraded":"2024-09-15T22:44:22.971364+0000","last_fullsized":"2024-09-15T22:44:22.971364+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:55.828144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971290+0000","last_change":"2024-09-15T22:44:21.976008+0000","last_active":"2024-09-15T22:44:22.971290+0000","last_peered":"2024-09-15T22:44:22.971290+0000","last_clean":"2024-09-15T22:44:22.971290+0000","last_became_active":"2024-09-15T22:44:21.975743+0000","last_became_peered":"2024-09-15T22:44:21.975743+0000","last_unstale":"2024-09-15T22:44:22.971290+0000","last_undegraded":"2024-09-15T22:44:22.971290+0000","last_fullsized":"2024-09-15T22:44:22.971290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:25.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662525+0000","last_change":"2024-09-15T22:44:21.965973+0000","last_active":"2024-09-15T22:44:23.662525+0000","last_peered":"2024-09-15T22:44:23.662525+0000","last_clean":"2024-09-15T22:44:23.662525+0000","last_became_active":"2024-09-15T22:44:21.965073+0000","last_became_peered":"2024-09-15T22:44:21.965073+0000","last_unstale":"2024-09-15T22:44:23.662525+0000","last_undegraded":"2024-09-15T22:44:23.662525+0000","last_fullsized":"2024-09-15T22:44:23.662525+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:21.796541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304158+0000","last_change":"2024-09-15T22:44:21.967600+0000","last_active":"2024-09-15T22:44:23.304158+0000","last_peered":"2024-09-15T22:44:23.304158+0000","last_clean":"2024-09-15T22:44:23.304158+0000","last_became_active":"2024-09-15T22:44:21.967133+0000","last_became_peered":"2024-09-15T22:44:21.967133+0000","last_unstale":"2024-09-15T22:44:23.304158+0000","last_undegraded":"2024-09-15T22:44:23.304158+0000","last_fullsized":"2024-09-15T22:44:23.304158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:33.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662554+0000","last_change":"2024-09-15T22:44:21.971592+0000","last_active":"2024-09-15T22:44:23.662554+0000","last_peered":"2024-09-15T22:44:23.662554+0000","last_clean":"2024-09-15T22:44:23.662554+0000","last_became_active":"2024-09-15T22:44:21.971355+0000","last_became_peered":"2024-09-15T22:44:21.971355+0000","last_unstale":"2024-09-15T22:44:23.662554+0000","last_undegraded":"2024-09-15T22:44:23.662554+0000","last_fullsized":"2024-09-15T22:44:23.662554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:51.888531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971583+0000","last_change":"2024-09-15T22:44:21.964323+0000","last_active":"2024-09-15T22:44:22.971583+0000","last_peered":"2024-09-15T22:44:22.971583+0000","last_clean":"2024-09-15T22:44:22.971583+0000","last_became_active":"2024-09-15T22:44:21.964031+0000","last_became_peered":"2024-09-15T22:44:21.964031+0000","last_unstale":"2024-09-15T22:44:22.971583+0000","last_undegraded":"2024-09-15T22:44:22.971583+0000","last_fullsized":"2024-09-15T22:44:22.971583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:46.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969027+0000","last_change":"2024-09-15T22:44:21.974043+0000","last_active":"2024-09-15T22:44:22.969027+0000","last_peered":"2024-09-15T22:44:22.969027+0000","last_clean":"2024-09-15T22:44:22.969027+0000","last_became_active":"2024-09-15T22:44:21.973791+0000","last_became_peered":"2024-09-15T22:44:21.973791+0000","last_unstale":"2024-09-15T22:44:22.969027+0000","last_undegraded":"2024-09-15T22:44:22.969027+0000","last_fullsized":"2024-09-15T22:44:22.969027+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:22.880809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662178+0000","last_change":"2024-09-15T22:44:21.961878+0000","last_active":"2024-09-15T22:44:23.662178+0000","last_peered":"2024-09-15T22:44:23.662178+0000","last_clean":"2024-09-15T22:44:23.662178+0000","last_became_active":"2024-09-15T22:44:21.961606+0000","last_became_peered":"2024-09-15T22:44:21.961606+0000","last_unstale":"2024-09-15T22:44:23.662178+0000","last_undegraded":"2024-09-15T22:44:23.662178+0000","last_fullsized":"2024-09-15T22:44:23.662178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:21.222188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662510+0000","last_change":"2024-09-15T22:44:21.971692+0000","last_active":"2024-09-15T22:44:23.662510+0000","last_peered":"2024-09-15T22:44:23.662510+0000","last_clean":"2024-09-15T22:44:23.662510+0000","last_became_active":"2024-09-15T22:44:21.971424+0000","last_became_peered":"2024-09-15T22:44:21.971424+0000","last_unstale":"2024-09-15T22:44:23.662510+0000","last_undegraded":"2024-09-15T22:44:23.662510+0000","last_fullsized":"2024-09-15T22:44:23.662510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.500166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968320+0000","last_change":"2024-09-15T22:44:21.969398+0000","last_active":"2024-09-15T22:44:22.968320+0000","last_peered":"2024-09-15T22:44:22.968320+0000","last_clean":"2024-09-15T22:44:22.968320+0000","last_became_active":"2024-09-15T22:44:21.969137+0000","last_became_peered":"2024-09-15T22:44:21.969137+0000","last_unstale":"2024-09-15T22:44:22.968320+0000","last_undegraded":"2024-09-15T22:44:22.968320+0000","last_fullsized":"2024-09-15T22:44:22.968320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:12.530310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662170+0000","last_change":"2024-09-15T22:44:21.971472+0000","last_active":"2024-09-15T22:44:23.662170+0000","last_peered":"2024-09-15T22:44:23.662170+0000","last_clean":"2024-09-15T22:44:23.662170+0000","last_became_active":"2024-09-15T22:44:21.971096+0000","last_became_peered":"2024-09-15T22:44:21.971096+0000","last_unstale":"2024-09-15T22:44:23.662170+0000","last_undegraded":"2024-09-15T22:44:23.662170+0000","last_fullsized":"2024-09-15T22:44:23.662170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:12.530310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970162+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.969875+0000","last_became_peered":"2024-09-15T22:44:21.969875+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.172394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971765+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:22.971765+0000","last_peered":"2024-09-15T22:44:22.971765+0000","last_clean":"2024-09-15T22:44:22.971765+0000","last_became_active":"2024-09-15T22:44:21.961717+0000","last_became_peered":"2024-09-15T22:44:21.961717+0000","last_unstale":"2024-09-15T22:44:22.971765+0000","last_undegraded":"2024-09-15T22:44:22.971765+0000","last_fullsized":"2024-09-15T22:44:22.971765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:35.936792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968547+0000","last_change":"2024-09-15T22:44:21.970255+0000","last_active":"2024-09-15T22:44:22.968547+0000","last_peered":"2024-09-15T22:44:22.968547+0000","last_clean":"2024-09-15T22:44:22.968547+0000","last_became_active":"2024-09-15T22:44:21.969655+0000","last_became_peered":"2024-09-15T22:44:21.969655+0000","last_unstale":"2024-09-15T22:44:22.968547+0000","last_undegraded":"2024-09-15T22:44:22.968547+0000","last_fullsized":"2024-09-15T22:44:22.968547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:22.600095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662114+0000","last_change":"2024-09-15T22:44:21.970509+0000","last_active":"2024-09-15T22:44:23.662114+0000","last_peered":"2024-09-15T22:44:23.662114+0000","last_clean":"2024-09-15T22:44:23.662114+0000","last_became_active":"2024-09-15T22:44:21.970247+0000","last_became_peered":"2024-09-15T22:44:21.970247+0000","last_unstale":"2024-09-15T22:44:23.662114+0000","last_undegraded":"2024-09-15T22:44:23.662114+0000","last_fullsized":"2024-09-15T22:44:23.662114+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:08.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968988+0000","last_change":"2024-09-15T22:44:21.970733+0000","last_active":"2024-09-15T22:44:22.968988+0000","last_peered":"2024-09-15T22:44:22.968988+0000","last_clean":"2024-09-15T22:44:22.968988+0000","last_became_active":"2024-09-15T22:44:21.970440+0000","last_became_peered":"2024-09-15T22:44:21.970440+0000","last_unstale":"2024-09-15T22:44:22.968988+0000","last_undegraded":"2024-09-15T22:44:22.968988+0000","last_fullsized":"2024-09-15T22:44:22.968988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662864+0000","last_change":"2024-09-15T22:44:21.973493+0000","last_active":"2024-09-15T22:44:23.662864+0000","last_peered":"2024-09-15T22:44:23.662864+0000","last_clean":"2024-09-15T22:44:23.662864+0000","last_became_active":"2024-09-15T22:44:21.973237+0000","last_became_peered":"2024-09-15T22:44:21.973237+0000","last_unstale":"2024-09-15T22:44:23.662864+0000","last_undegraded":"2024-09-15T22:44:23.662864+0000","last_fullsized":"2024-09-15T22:44:23.662864+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969356+0000","last_change":"2024-09-15T22:44:21.967673+0000","last_active":"2024-09-15T22:44:22.969356+0000","last_peered":"2024-09-15T22:44:22.969356+0000","last_clean":"2024-09-15T22:44:22.969356+0000","last_became_active":"2024-09-15T22:44:21.967380+0000","last_became_peered":"2024-09-15T22:44:21.967380+0000","last_unstale":"2024-09-15T22:44:22.969356+0000","last_undegraded":"2024-09-15T22:44:22.969356+0000","last_fullsized":"2024-09-15T22:44:22.969356+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:30.538282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662613+0000","last_change":"2024-09-15T22:44:21.970142+0000","last_active":"2024-09-15T22:44:23.662613+0000","last_peered":"2024-09-15T22:44:23.662613+0000","last_clean":"2024-09-15T22:44:23.662613+0000","last_became_active":"2024-09-15T22:44:21.965726+0000","last_became_peered":"2024-09-15T22:44:21.965726+0000","last_unstale":"2024-09-15T22:44:23.662613+0000","last_undegraded":"2024-09-15T22:44:23.662613+0000","last_fullsized":"2024-09-15T22:44:23.662613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:53.534579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661939+0000","last_change":"2024-09-15T22:44:21.971517+0000","last_active":"2024-09-15T22:44:23.661939+0000","last_peered":"2024-09-15T22:44:23.661939+0000","last_clean":"2024-09-15T22:44:23.661939+0000","last_became_active":"2024-09-15T22:44:21.971269+0000","last_became_peered":"2024-09-15T22:44:21.971269+0000","last_unstale":"2024-09-15T22:44:23.661939+0000","last_undegraded":"2024-09-15T22:44:23.661939+0000","last_fullsized":"2024-09-15T22:44:23.661939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:55.021082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662186+0000","last_change":"2024-09-15T22:44:21.972735+0000","last_active":"2024-09-15T22:44:23.662186+0000","last_peered":"2024-09-15T22:44:23.662186+0000","last_clean":"2024-09-15T22:44:23.662186+0000","last_became_active":"2024-09-15T22:44:21.972456+0000","last_became_peered":"2024-09-15T22:44:21.972456+0000","last_unstale":"2024-09-15T22:44:23.662186+0000","last_undegraded":"2024-09-15T22:44:23.662186+0000","last_fullsized":"2024-09-15T22:44:23.662186+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:43.476500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662515+0000","last_change":"2024-09-15T22:44:21.962292+0000","last_active":"2024-09-15T22:44:23.662515+0000","last_peered":"2024-09-15T22:44:23.662515+0000","last_clean":"2024-09-15T22:44:23.662515+0000","last_became_active":"2024-09-15T22:44:21.962028+0000","last_became_peered":"2024-09-15T22:44:21.962028+0000","last_unstale":"2024-09-15T22:44:23.662515+0000","last_undegraded":"2024-09-15T22:44:23.662515+0000","last_fullsized":"2024-09-15T22:44:23.662515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:35.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662244+0000","last_change":"2024-09-15T22:44:21.964754+0000","last_active":"2024-09-15T22:44:23.662244+0000","last_peered":"2024-09-15T22:44:23.662244+0000","last_clean":"2024-09-15T22:44:23.662244+0000","last_became_active":"2024-09-15T22:44:21.964494+0000","last_became_peered":"2024-09-15T22:44:21.964494+0000","last_unstale":"2024-09-15T22:44:23.662244+0000","last_undegraded":"2024-09-15T22:44:23.662244+0000","last_fullsized":"2024-09-15T22:44:23.662244+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:44.661369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304481+0000","last_change":"2024-09-15T22:44:21.960524+0000","last_active":"2024-09-15T22:44:23.304481+0000","last_peered":"2024-09-15T22:44:23.304481+0000","last_clean":"2024-09-15T22:44:23.304481+0000","last_became_active":"2024-09-15T22:44:21.960241+0000","last_became_peered":"2024-09-15T22:44:21.960241+0000","last_unstale":"2024-09-15T22:44:23.304481+0000","last_undegraded":"2024-09-15T22:44:23.304481+0000","last_fullsized":"2024-09-15T22:44:23.304481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:08.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304328+0000","last_change":"2024-09-15T22:44:21.967855+0000","last_active":"2024-09-15T22:44:23.304328+0000","last_peered":"2024-09-15T22:44:23.304328+0000","last_clean":"2024-09-15T22:44:23.304328+0000","last_became_active":"2024-09-15T22:44:21.965271+0000","last_became_peered":"2024-09-15T22:44:21.965271+0000","last_unstale":"2024-09-15T22:44:23.304328+0000","last_undegraded":"2024-09-15T22:44:23.304328+0000","last_fullsized":"2024-09-15T22:44:23.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:36.204012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662065+0000","last_change":"2024-09-15T22:44:21.962679+0000","last_active":"2024-09-15T22:44:23.662065+0000","last_peered":"2024-09-15T22:44:23.662065+0000","last_clean":"2024-09-15T22:44:23.662065+0000","last_became_active":"2024-09-15T22:44:21.962419+0000","last_became_peered":"2024-09-15T22:44:21.962419+0000","last_unstale":"2024-09-15T22:44:23.662065+0000","last_undegraded":"2024-09-15T22:44:23.662065+0000","last_fullsized":"2024-09-15T22:44:23.662065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:08.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661822+0000","last_change":"2024-09-15T22:44:21.972500+0000","last_active":"2024-09-15T22:44:23.661822+0000","last_peered":"2024-09-15T22:44:23.661822+0000","last_clean":"2024-09-15T22:44:23.661822+0000","last_became_active":"2024-09-15T22:44:21.972146+0000","last_became_peered":"2024-09-15T22:44:21.972146+0000","last_unstale":"2024-09-15T22:44:23.661822+0000","last_undegraded":"2024-09-15T22:44:23.661822+0000","last_fullsized":"2024-09-15T22:44:23.661822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:26.091548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968884+0000","last_change":"2024-09-15T22:44:21.968730+0000","last_active":"2024-09-15T22:44:22.968884+0000","last_peered":"2024-09-15T22:44:22.968884+0000","last_clean":"2024-09-15T22:44:22.968884+0000","last_became_active":"2024-09-15T22:44:21.968417+0000","last_became_peered":"2024-09-15T22:44:21.968417+0000","last_unstale":"2024-09-15T22:44:22.968884+0000","last_undegraded":"2024-09-15T22:44:22.968884+0000","last_fullsized":"2024-09-15T22:44:22.968884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971645+0000","last_change":"2024-09-15T22:44:21.966181+0000","last_active":"2024-09-15T22:44:22.971645+0000","last_peered":"2024-09-15T22:44:22.971645+0000","last_clean":"2024-09-15T22:44:22.971645+0000","last_became_active":"2024-09-15T22:44:21.965759+0000","last_became_peered":"2024-09-15T22:44:21.965759+0000","last_unstale":"2024-09-15T22:44:22.971645+0000","last_undegraded":"2024-09-15T22:44:22.971645+0000","last_fullsized":"2024-09-15T22:44:22.971645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:16.195412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969213+0000","last_change":"2024-09-15T22:44:20.959633+0000","last_active":"2024-09-15T22:44:22.969213+0000","last_peered":"2024-09-15T22:44:22.969213+0000","last_clean":"2024-09-15T22:44:22.969213+0000","last_became_active":"2024-09-15T22:44:20.959320+0000","last_became_peered":"2024-09-15T22:44:20.959320+0000","last_unstale":"2024-09-15T22:44:22.969213+0000","last_undegraded":"2024-09-15T22:44:22.969213+0000","last_fullsized":"2024-09-15T22:44:22.969213+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.449490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971803+0000","last_change":"2024-09-15T22:44:21.972701+0000","last_active":"2024-09-15T22:44:22.971803+0000","last_peered":"2024-09-15T22:44:22.971803+0000","last_clean":"2024-09-15T22:44:22.971803+0000","last_became_active":"2024-09-15T22:44:21.972403+0000","last_became_peered":"2024-09-15T22:44:21.972403+0000","last_unstale":"2024-09-15T22:44:22.971803+0000","last_undegraded":"2024-09-15T22:44:22.971803+0000","last_fullsized":"2024-09-15T22:44:22.971803+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:38.902404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662181+0000","last_change":"2024-09-15T22:44:20.965481+0000","last_active":"2024-09-15T22:44:23.662181+0000","last_peered":"2024-09-15T22:44:23.662181+0000","last_clean":"2024-09-15T22:44:23.662181+0000","last_became_active":"2024-09-15T22:44:20.965218+0000","last_became_peered":"2024-09-15T22:44:20.965218+0000","last_unstale":"2024-09-15T22:44:23.662181+0000","last_undegraded":"2024-09-15T22:44:23.662181+0000","last_fullsized":"2024-09-15T22:44:23.662181+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:01.187783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304531+0000","last_change":"2024-09-15T22:44:21.961979+0000","last_active":"2024-09-15T22:44:23.304531+0000","last_peered":"2024-09-15T22:44:23.304531+0000","last_clean":"2024-09-15T22:44:23.304531+0000","last_became_active":"2024-09-15T22:44:21.961677+0000","last_became_peered":"2024-09-15T22:44:21.961677+0000","last_unstale":"2024-09-15T22:44:23.304531+0000","last_undegraded":"2024-09-15T22:44:23.304531+0000","last_fullsized":"2024-09-15T22:44:23.304531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:21.796541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971591+0000","last_change":"2024-09-15T22:44:20.963289+0000","last_active":"2024-09-15T22:44:22.971591+0000","last_peered":"2024-09-15T22:44:22.971591+0000","last_clean":"2024-09-15T22:44:22.971591+0000","last_became_active":"2024-09-15T22:44:20.963013+0000","last_became_peered":"2024-09-15T22:44:20.963013+0000","last_unstale":"2024-09-15T22:44:22.971591+0000","last_undegraded":"2024-09-15T22:44:22.971591+0000","last_fullsized":"2024-09-15T22:44:22.971591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:26.208450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971501+0000","last_change":"2024-09-15T22:44:21.970159+0000","last_active":"2024-09-15T22:44:22.971501+0000","last_peered":"2024-09-15T22:44:22.971501+0000","last_clean":"2024-09-15T22:44:22.971501+0000","last_became_active":"2024-09-15T22:44:21.969890+0000","last_became_peered":"2024-09-15T22:44:21.969890+0000","last_unstale":"2024-09-15T22:44:22.971501+0000","last_undegraded":"2024-09-15T22:44:22.971501+0000","last_fullsized":"2024-09-15T22:44:22.971501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:11.500124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662733+0000","last_change":"2024-09-15T22:44:20.965106+0000","last_active":"2024-09-15T22:44:23.662733+0000","last_peered":"2024-09-15T22:44:23.662733+0000","last_clean":"2024-09-15T22:44:23.662733+0000","last_became_active":"2024-09-15T22:44:20.964830+0000","last_became_peered":"2024-09-15T22:44:20.964830+0000","last_unstale":"2024-09-15T22:44:23.662733+0000","last_undegraded":"2024-09-15T22:44:23.662733+0000","last_fullsized":"2024-09-15T22:44:23.662733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:54.572155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304272+0000","last_change":"2024-09-15T22:44:21.970567+0000","last_active":"2024-09-15T22:44:23.304272+0000","last_peered":"2024-09-15T22:44:23.304272+0000","last_clean":"2024-09-15T22:44:23.304272+0000","last_became_active":"2024-09-15T22:44:21.970095+0000","last_became_peered":"2024-09-15T22:44:21.970095+0000","last_unstale":"2024-09-15T22:44:23.304272+0000","last_undegraded":"2024-09-15T22:44:23.304272+0000","last_fullsized":"2024-09-15T22:44:23.304272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:10.235338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968663+0000","last_change":"2024-09-15T22:44:20.967792+0000","last_active":"2024-09-15T22:44:22.968663+0000","last_peered":"2024-09-15T22:44:22.968663+0000","last_clean":"2024-09-15T22:44:22.968663+0000","last_became_active":"2024-09-15T22:44:20.967471+0000","last_became_peered":"2024-09-15T22:44:20.967471+0000","last_unstale":"2024-09-15T22:44:22.968663+0000","last_undegraded":"2024-09-15T22:44:22.968663+0000","last_fullsized":"2024-09-15T22:44:22.968663+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:52.499019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969183+0000","last_change":"2024-09-15T22:44:21.968012+0000","last_active":"2024-09-15T22:44:22.969183+0000","last_peered":"2024-09-15T22:44:22.969183+0000","last_clean":"2024-09-15T22:44:22.969183+0000","last_became_active":"2024-09-15T22:44:21.967689+0000","last_became_peered":"2024-09-15T22:44:21.967689+0000","last_unstale":"2024-09-15T22:44:22.969183+0000","last_undegraded":"2024-09-15T22:44:22.969183+0000","last_fullsized":"2024-09-15T22:44:22.969183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:14.441401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971435+0000","last_change":"2024-09-15T22:44:20.965421+0000","last_active":"2024-09-15T22:44:22.971435+0000","last_peered":"2024-09-15T22:44:22.971435+0000","last_clean":"2024-09-15T22:44:22.971435+0000","last_became_active":"2024-09-15T22:44:20.965146+0000","last_became_peered":"2024-09-15T22:44:20.965146+0000","last_unstale":"2024-09-15T22:44:22.971435+0000","last_undegraded":"2024-09-15T22:44:22.971435+0000","last_fullsized":"2024-09-15T22:44:22.971435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:46.174738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968278+0000","last_change":"2024-09-15T22:44:21.964712+0000","last_active":"2024-09-15T22:44:22.968278+0000","last_peered":"2024-09-15T22:44:22.968278+0000","last_clean":"2024-09-15T22:44:22.968278+0000","last_became_active":"2024-09-15T22:44:21.963739+0000","last_became_peered":"2024-09-15T22:44:21.963739+0000","last_unstale":"2024-09-15T22:44:22.968278+0000","last_undegraded":"2024-09-15T22:44:22.968278+0000","last_fullsized":"2024-09-15T22:44:22.968278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:36.788800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662266+0000","last_change":"2024-09-15T22:44:20.958649+0000","last_active":"2024-09-15T22:44:23.662266+0000","last_peered":"2024-09-15T22:44:23.662266+0000","last_clean":"2024-09-15T22:44:23.662266+0000","last_became_active":"2024-09-15T22:44:20.958340+0000","last_became_peered":"2024-09-15T22:44:20.958340+0000","last_unstale":"2024-09-15T22:44:23.662266+0000","last_undegraded":"2024-09-15T22:44:23.662266+0000","last_fullsized":"2024-09-15T22:44:23.662266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:47.710702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971191+0000","last_change":"2024-09-15T22:44:21.970842+0000","last_active":"2024-09-15T22:44:22.971191+0000","last_peered":"2024-09-15T22:44:22.971191+0000","last_clean":"2024-09-15T22:44:22.971191+0000","last_became_active":"2024-09-15T22:44:21.970583+0000","last_became_peered":"2024-09-15T22:44:21.970583+0000","last_unstale":"2024-09-15T22:44:22.971191+0000","last_undegraded":"2024-09-15T22:44:22.971191+0000","last_fullsized":"2024-09-15T22:44:22.971191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:51.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662608+0000","last_change":"2024-09-15T22:44:20.954064+0000","last_active":"2024-09-15T22:44:23.662608+0000","last_peered":"2024-09-15T22:44:23.662608+0000","last_clean":"2024-09-15T22:44:23.662608+0000","last_became_active":"2024-09-15T22:44:20.953807+0000","last_became_peered":"2024-09-15T22:44:20.953807+0000","last_unstale":"2024-09-15T22:44:23.662608+0000","last_undegraded":"2024-09-15T22:44:23.662608+0000","last_fullsized":"2024-09-15T22:44:23.662608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:56.681403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662726+0000","last_change":"2024-09-15T22:44:21.970320+0000","last_active":"2024-09-15T22:44:23.662726+0000","last_peered":"2024-09-15T22:44:23.662726+0000","last_clean":"2024-09-15T22:44:23.662726+0000","last_became_active":"2024-09-15T22:44:21.970058+0000","last_became_peered":"2024-09-15T22:44:21.970058+0000","last_unstale":"2024-09-15T22:44:23.662726+0000","last_undegraded":"2024-09-15T22:44:23.662726+0000","last_fullsized":"2024-09-15T22:44:23.662726+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:22.600095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662171+0000","last_change":"2024-09-15T22:44:20.959186+0000","last_active":"2024-09-15T22:44:23.662171+0000","last_peered":"2024-09-15T22:44:23.662171+0000","last_clean":"2024-09-15T22:44:23.662171+0000","last_became_active":"2024-09-15T22:44:20.958905+0000","last_became_peered":"2024-09-15T22:44:20.958905+0000","last_unstale":"2024-09-15T22:44:23.662171+0000","last_undegraded":"2024-09-15T22:44:23.662171+0000","last_fullsized":"2024-09-15T22:44:23.662171+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968483+0000","last_change":"2024-09-15T22:44:21.975115+0000","last_active":"2024-09-15T22:44:22.968483+0000","last_peered":"2024-09-15T22:44:22.968483+0000","last_clean":"2024-09-15T22:44:22.968483+0000","last_became_active":"2024-09-15T22:44:21.974860+0000","last_became_peered":"2024-09-15T22:44:21.974860+0000","last_unstale":"2024-09-15T22:44:22.968483+0000","last_undegraded":"2024-09-15T22:44:22.968483+0000","last_fullsized":"2024-09-15T22:44:22.968483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.500166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304594+0000","last_change":"2024-09-15T22:44:20.963252+0000","last_active":"2024-09-15T22:44:23.304594+0000","last_peered":"2024-09-15T22:44:23.304594+0000","last_clean":"2024-09-15T22:44:23.304594+0000","last_became_active":"2024-09-15T22:44:20.962903+0000","last_became_peered":"2024-09-15T22:44:20.962903+0000","last_unstale":"2024-09-15T22:44:23.304594+0000","last_undegraded":"2024-09-15T22:44:23.304594+0000","last_fullsized":"2024-09-15T22:44:23.304594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:08.285828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304683+0000","last_change":"2024-09-15T22:44:21.956575+0000","last_active":"2024-09-15T22:44:23.304683+0000","last_peered":"2024-09-15T22:44:23.304683+0000","last_clean":"2024-09-15T22:44:23.304683+0000","last_became_active":"2024-09-15T22:44:21.956315+0000","last_became_peered":"2024-09-15T22:44:21.956315+0000","last_unstale":"2024-09-15T22:44:23.304683+0000","last_undegraded":"2024-09-15T22:44:23.304683+0000","last_fullsized":"2024-09-15T22:44:23.304683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:42.024963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662859+0000","last_change":"2024-09-15T22:44:20.965734+0000","last_active":"2024-09-15T22:44:23.662859+0000","last_peered":"2024-09-15T22:44:23.662859+0000","last_clean":"2024-09-15T22:44:23.662859+0000","last_became_active":"2024-09-15T22:44:20.965475+0000","last_became_peered":"2024-09-15T22:44:20.965475+0000","last_unstale":"2024-09-15T22:44:23.662859+0000","last_undegraded":"2024-09-15T22:44:23.662859+0000","last_fullsized":"2024-09-15T22:44:23.662859+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:21.464136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662744+0000","last_change":"2024-09-15T22:44:21.956442+0000","last_active":"2024-09-15T22:44:23.662744+0000","last_peered":"2024-09-15T22:44:23.662744+0000","last_clean":"2024-09-15T22:44:23.662744+0000","last_became_active":"2024-09-15T22:44:21.956166+0000","last_became_peered":"2024-09-15T22:44:21.956166+0000","last_unstale":"2024-09-15T22:44:23.662744+0000","last_undegraded":"2024-09-15T22:44:23.662744+0000","last_fullsized":"2024-09-15T22:44:23.662744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:37.643908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.663052+0000","last_change":"2024-09-15T22:44:20.963930+0000","last_active":"2024-09-15T22:44:23.663052+0000","last_peered":"2024-09-15T22:44:23.663052+0000","last_clean":"2024-09-15T22:44:23.663052+0000","last_became_active":"2024-09-15T22:44:20.963655+0000","last_became_peered":"2024-09-15T22:44:20.963655+0000","last_unstale":"2024-09-15T22:44:23.663052+0000","last_undegraded":"2024-09-15T22:44:23.663052+0000","last_fullsized":"2024-09-15T22:44:23.663052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:55.035704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662238+0000","last_change":"2024-09-15T22:44:21.966977+0000","last_active":"2024-09-15T22:44:23.662238+0000","last_peered":"2024-09-15T22:44:23.662238+0000","last_clean":"2024-09-15T22:44:23.662238+0000","last_became_active":"2024-09-15T22:44:21.966669+0000","last_became_peered":"2024-09-15T22:44:21.966669+0000","last_unstale":"2024-09-15T22:44:23.662238+0000","last_undegraded":"2024-09-15T22:44:23.662238+0000","last_fullsized":"2024-09-15T22:44:23.662238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:26.091548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304453+0000","last_change":"2024-09-15T22:44:20.963287+0000","last_active":"2024-09-15T22:44:23.304453+0000","last_peered":"2024-09-15T22:44:23.304453+0000","last_clean":"2024-09-15T22:44:23.304453+0000","last_became_active":"2024-09-15T22:44:20.962848+0000","last_became_peered":"2024-09-15T22:44:20.962848+0000","last_unstale":"2024-09-15T22:44:23.304453+0000","last_undegraded":"2024-09-15T22:44:23.304453+0000","last_fullsized":"2024-09-15T22:44:23.304453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:21.594597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968558+0000","last_change":"2024-09-15T22:44:21.965328+0000","last_active":"2024-09-15T22:44:22.968558+0000","last_peered":"2024-09-15T22:44:22.968558+0000","last_clean":"2024-09-15T22:44:22.968558+0000","last_became_active":"2024-09-15T22:44:21.965053+0000","last_became_peered":"2024-09-15T22:44:21.965053+0000","last_unstale":"2024-09-15T22:44:22.968558+0000","last_undegraded":"2024-09-15T22:44:22.968558+0000","last_fullsized":"2024-09-15T22:44:22.968558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662089+0000","last_change":"2024-09-15T22:44:20.963978+0000","last_active":"2024-09-15T22:44:23.662089+0000","last_peered":"2024-09-15T22:44:23.662089+0000","last_clean":"2024-09-15T22:44:23.662089+0000","last_became_active":"2024-09-15T22:44:20.963698+0000","last_became_peered":"2024-09-15T22:44:20.963698+0000","last_unstale":"2024-09-15T22:44:23.662089+0000","last_undegraded":"2024-09-15T22:44:23.662089+0000","last_fullsized":"2024-09-15T22:44:23.662089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:40.777192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662028+0000","last_change":"2024-09-15T22:44:21.962678+0000","last_active":"2024-09-15T22:44:23.662028+0000","last_peered":"2024-09-15T22:44:23.662028+0000","last_clean":"2024-09-15T22:44:23.662028+0000","last_became_active":"2024-09-15T22:44:21.962413+0000","last_became_peered":"2024-09-15T22:44:21.962413+0000","last_unstale":"2024-09-15T22:44:23.662028+0000","last_undegraded":"2024-09-15T22:44:23.662028+0000","last_fullsized":"2024-09-15T22:44:23.662028+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.882415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662733+0000","last_change":"2024-09-15T22:44:20.959952+0000","last_active":"2024-09-15T22:44:23.662733+0000","last_peered":"2024-09-15T22:44:23.662733+0000","last_clean":"2024-09-15T22:44:23.662733+0000","last_became_active":"2024-09-15T22:44:20.959667+0000","last_became_peered":"2024-09-15T22:44:20.959667+0000","last_unstale":"2024-09-15T22:44:23.662733+0000","last_undegraded":"2024-09-15T22:44:23.662733+0000","last_fullsized":"2024-09-15T22:44:23.662733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:36.814570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662851+0000","last_change":"2024-09-15T22:44:21.966082+0000","last_active":"2024-09-15T22:44:23.662851+0000","last_peered":"2024-09-15T22:44:23.662851+0000","last_clean":"2024-09-15T22:44:23.662851+0000","last_became_active":"2024-09-15T22:44:21.965407+0000","last_became_peered":"2024-09-15T22:44:21.965407+0000","last_unstale":"2024-09-15T22:44:23.662851+0000","last_undegraded":"2024-09-15T22:44:23.662851+0000","last_fullsized":"2024-09-15T22:44:23.662851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.613820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662439+0000","last_change":"2024-09-15T22:44:20.960790+0000","last_active":"2024-09-15T22:44:23.662439+0000","last_peered":"2024-09-15T22:44:23.662439+0000","last_clean":"2024-09-15T22:44:23.662439+0000","last_became_active":"2024-09-15T22:44:20.960509+0000","last_became_peered":"2024-09-15T22:44:20.960509+0000","last_unstale":"2024-09-15T22:44:23.662439+0000","last_undegraded":"2024-09-15T22:44:23.662439+0000","last_fullsized":"2024-09-15T22:44:23.662439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:48.901073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968701+0000","last_change":"2024-09-15T22:44:21.970465+0000","last_active":"2024-09-15T22:44:22.968701+0000","last_peered":"2024-09-15T22:44:22.968701+0000","last_clean":"2024-09-15T22:44:22.968701+0000","last_became_active":"2024-09-15T22:44:21.969997+0000","last_became_peered":"2024-09-15T22:44:21.969997+0000","last_unstale":"2024-09-15T22:44:22.968701+0000","last_undegraded":"2024-09-15T22:44:22.968701+0000","last_fullsized":"2024-09-15T22:44:22.968701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:22.880809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662191+0000","last_change":"2024-09-15T22:44:20.967358+0000","last_active":"2024-09-15T22:44:23.662191+0000","last_peered":"2024-09-15T22:44:23.662191+0000","last_clean":"2024-09-15T22:44:23.662191+0000","last_became_active":"2024-09-15T22:44:20.966982+0000","last_became_peered":"2024-09-15T22:44:20.966982+0000","last_unstale":"2024-09-15T22:44:23.662191+0000","last_undegraded":"2024-09-15T22:44:23.662191+0000","last_fullsized":"2024-09-15T22:44:23.662191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:42.685193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968638+0000","last_change":"2024-09-15T22:44:21.968421+0000","last_active":"2024-09-15T22:44:22.968638+0000","last_peered":"2024-09-15T22:44:22.968638+0000","last_clean":"2024-09-15T22:44:22.968638+0000","last_became_active":"2024-09-15T22:44:21.968151+0000","last_became_peered":"2024-09-15T22:44:21.968151+0000","last_unstale":"2024-09-15T22:44:22.968638+0000","last_undegraded":"2024-09-15T22:44:22.968638+0000","last_fullsized":"2024-09-15T22:44:22.968638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:18.441108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304630+0000","last_change":"2024-09-15T22:44:20.963170+0000","last_active":"2024-09-15T22:44:23.304630+0000","last_peered":"2024-09-15T22:44:23.304630+0000","last_clean":"2024-09-15T22:44:23.304630+0000","last_became_active":"2024-09-15T22:44:20.962837+0000","last_became_peered":"2024-09-15T22:44:20.962837+0000","last_unstale":"2024-09-15T22:44:23.304630+0000","last_undegraded":"2024-09-15T22:44:23.304630+0000","last_fullsized":"2024-09-15T22:44:23.304630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:17.435610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661920+0000","last_change":"2024-09-15T22:44:21.966285+0000","last_active":"2024-09-15T22:44:23.661920+0000","last_peered":"2024-09-15T22:44:23.661920+0000","last_clean":"2024-09-15T22:44:23.661920+0000","last_became_active":"2024-09-15T22:44:21.965930+0000","last_became_peered":"2024-09-15T22:44:21.965930+0000","last_unstale":"2024-09-15T22:44:23.661920+0000","last_undegraded":"2024-09-15T22:44:23.661920+0000","last_fullsized":"2024-09-15T22:44:23.661920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:51.888531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968683+0000","last_change":"2024-09-15T22:44:20.963980+0000","last_active":"2024-09-15T22:44:22.968683+0000","last_peered":"2024-09-15T22:44:22.968683+0000","last_clean":"2024-09-15T22:44:22.968683+0000","last_became_active":"2024-09-15T22:44:20.963718+0000","last_became_peered":"2024-09-15T22:44:20.963718+0000","last_unstale":"2024-09-15T22:44:22.968683+0000","last_undegraded":"2024-09-15T22:44:22.968683+0000","last_fullsized":"2024-09-15T22:44:22.968683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.287896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662887+0000","last_change":"2024-09-15T22:44:21.962906+0000","last_active":"2024-09-15T22:44:23.662887+0000","last_peered":"2024-09-15T22:44:23.662887+0000","last_clean":"2024-09-15T22:44:23.662887+0000","last_became_active":"2024-09-15T22:44:21.962667+0000","last_became_peered":"2024-09-15T22:44:21.962667+0000","last_unstale":"2024-09-15T22:44:23.662887+0000","last_undegraded":"2024-09-15T22:44:23.662887+0000","last_fullsized":"2024-09-15T22:44:23.662887+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:07.804842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304643+0000","last_change":"2024-09-15T22:44:20.964846+0000","last_active":"2024-09-15T22:44:23.304643+0000","last_peered":"2024-09-15T22:44:23.304643+0000","last_clean":"2024-09-15T22:44:23.304643+0000","last_became_active":"2024-09-15T22:44:20.964581+0000","last_became_peered":"2024-09-15T22:44:20.964581+0000","last_unstale":"2024-09-15T22:44:23.304643+0000","last_undegraded":"2024-09-15T22:44:23.304643+0000","last_fullsized":"2024-09-15T22:44:23.304643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:04.494669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662390+0000","last_change":"2024-09-15T22:44:21.970881+0000","last_active":"2024-09-15T22:44:23.662390+0000","last_peered":"2024-09-15T22:44:23.662390+0000","last_clean":"2024-09-15T22:44:23.662390+0000","last_became_active":"2024-09-15T22:44:21.970607+0000","last_became_peered":"2024-09-15T22:44:21.970607+0000","last_unstale":"2024-09-15T22:44:23.662390+0000","last_undegraded":"2024-09-15T22:44:23.662390+0000","last_fullsized":"2024-09-15T22:44:23.662390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:33.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.969146+0000","last_change":"2024-09-15T22:44:20.955951+0000","last_active":"2024-09-15T22:44:22.969146+0000","last_peered":"2024-09-15T22:44:22.969146+0000","last_clean":"2024-09-15T22:44:22.969146+0000","last_became_active":"2024-09-15T22:44:20.955657+0000","last_became_peered":"2024-09-15T22:44:20.955657+0000","last_unstale":"2024-09-15T22:44:22.969146+0000","last_undegraded":"2024-09-15T22:44:22.969146+0000","last_fullsized":"2024-09-15T22:44:22.969146+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:47.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304428+0000","last_change":"2024-09-15T22:44:21.963184+0000","last_active":"2024-09-15T22:44:23.304428+0000","last_peered":"2024-09-15T22:44:23.304428+0000","last_clean":"2024-09-15T22:44:23.304428+0000","last_became_active":"2024-09-15T22:44:21.962840+0000","last_became_peered":"2024-09-15T22:44:21.962840+0000","last_unstale":"2024-09-15T22:44:23.304428+0000","last_undegraded":"2024-09-15T22:44:23.304428+0000","last_fullsized":"2024-09-15T22:44:23.304428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:14.755532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304270+0000","last_change":"2024-09-15T22:44:20.963436+0000","last_active":"2024-09-15T22:44:23.304270+0000","last_peered":"2024-09-15T22:44:23.304270+0000","last_clean":"2024-09-15T22:44:23.304270+0000","last_became_active":"2024-09-15T22:44:20.962857+0000","last_became_peered":"2024-09-15T22:44:20.962857+0000","last_unstale":"2024-09-15T22:44:23.304270+0000","last_undegraded":"2024-09-15T22:44:23.304270+0000","last_fullsized":"2024-09-15T22:44:23.304270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:34.206219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304250+0000","last_change":"2024-09-15T22:44:21.967933+0000","last_active":"2024-09-15T22:44:23.304250+0000","last_peered":"2024-09-15T22:44:23.304250+0000","last_clean":"2024-09-15T22:44:23.304250+0000","last_became_active":"2024-09-15T22:44:21.967646+0000","last_became_peered":"2024-09-15T22:44:21.967646+0000","last_unstale":"2024-09-15T22:44:23.304250+0000","last_undegraded":"2024-09-15T22:44:23.304250+0000","last_fullsized":"2024-09-15T22:44:23.304250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:42.029341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662061+0000","last_change":"2024-09-15T22:44:20.965332+0000","last_active":"2024-09-15T22:44:23.662061+0000","last_peered":"2024-09-15T22:44:23.662061+0000","last_clean":"2024-09-15T22:44:23.662061+0000","last_became_active":"2024-09-15T22:44:20.965024+0000","last_became_peered":"2024-09-15T22:44:20.965024+0000","last_unstale":"2024-09-15T22:44:23.662061+0000","last_undegraded":"2024-09-15T22:44:23.662061+0000","last_fullsized":"2024-09-15T22:44:23.662061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:42.685193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968792+0000","last_change":"2024-09-15T22:44:21.970771+0000","last_active":"2024-09-15T22:44:22.968792+0000","last_peered":"2024-09-15T22:44:22.968792+0000","last_clean":"2024-09-15T22:44:22.968792+0000","last_became_active":"2024-09-15T22:44:21.969402+0000","last_became_peered":"2024-09-15T22:44:21.969402+0000","last_unstale":"2024-09-15T22:44:22.968792+0000","last_undegraded":"2024-09-15T22:44:22.968792+0000","last_fullsized":"2024-09-15T22:44:22.968792+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:30.538282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662264+0000","last_change":"2024-09-15T22:44:20.964770+0000","last_active":"2024-09-15T22:44:23.662264+0000","last_peered":"2024-09-15T22:44:23.662264+0000","last_clean":"2024-09-15T22:44:23.662264+0000","last_became_active":"2024-09-15T22:44:20.964468+0000","last_became_peered":"2024-09-15T22:44:20.964468+0000","last_unstale":"2024-09-15T22:44:23.662264+0000","last_undegraded":"2024-09-15T22:44:23.662264+0000","last_fullsized":"2024-09-15T22:44:23.662264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:33.632416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968739+0000","last_change":"2024-09-15T22:44:21.964702+0000","last_active":"2024-09-15T22:44:22.968739+0000","last_peered":"2024-09-15T22:44:22.968739+0000","last_clean":"2024-09-15T22:44:22.968739+0000","last_became_active":"2024-09-15T22:44:21.964398+0000","last_became_peered":"2024-09-15T22:44:21.964398+0000","last_unstale":"2024-09-15T22:44:22.968739+0000","last_undegraded":"2024-09-15T22:44:22.968739+0000","last_fullsized":"2024-09-15T22:44:22.968739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:14.441401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971699+0000","last_change":"2024-09-15T22:44:20.964367+0000","last_active":"2024-09-15T22:44:22.971699+0000","last_peered":"2024-09-15T22:44:22.971699+0000","last_clean":"2024-09-15T22:44:22.971699+0000","last_became_active":"2024-09-15T22:44:20.964060+0000","last_became_peered":"2024-09-15T22:44:20.964060+0000","last_unstale":"2024-09-15T22:44:22.971699+0000","last_undegraded":"2024-09-15T22:44:22.971699+0000","last_fullsized":"2024-09-15T22:44:22.971699+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:15.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661996+0000","last_change":"2024-09-15T22:44:21.969522+0000","last_active":"2024-09-15T22:44:23.661996+0000","last_peered":"2024-09-15T22:44:23.661996+0000","last_clean":"2024-09-15T22:44:23.661996+0000","last_became_active":"2024-09-15T22:44:21.968349+0000","last_became_peered":"2024-09-15T22:44:21.968349+0000","last_unstale":"2024-09-15T22:44:23.661996+0000","last_undegraded":"2024-09-15T22:44:23.661996+0000","last_fullsized":"2024-09-15T22:44:23.661996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:33.871575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.663086+0000","last_change":"2024-09-15T22:44:20.962967+0000","last_active":"2024-09-15T22:44:23.663086+0000","last_peered":"2024-09-15T22:44:23.663086+0000","last_clean":"2024-09-15T22:44:23.663086+0000","last_became_active":"2024-09-15T22:44:20.962621+0000","last_became_peered":"2024-09-15T22:44:20.962621+0000","last_unstale":"2024-09-15T22:44:23.663086+0000","last_undegraded":"2024-09-15T22:44:23.663086+0000","last_fullsized":"2024-09-15T22:44:23.663086+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:01.187783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304745+0000","last_change":"2024-09-15T22:44:21.961850+0000","last_active":"2024-09-15T22:44:23.304745+0000","last_peered":"2024-09-15T22:44:23.304745+0000","last_clean":"2024-09-15T22:44:23.304745+0000","last_became_active":"2024-09-15T22:44:21.961575+0000","last_became_peered":"2024-09-15T22:44:21.961575+0000","last_unstale":"2024-09-15T22:44:23.304745+0000","last_undegraded":"2024-09-15T22:44:23.304745+0000","last_fullsized":"2024-09-15T22:44:23.304745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:53.534579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968424+0000","last_change":"2024-09-15T22:44:20.966571+0000","last_active":"2024-09-15T22:44:22.968424+0000","last_peered":"2024-09-15T22:44:22.968424+0000","last_clean":"2024-09-15T22:44:22.968424+0000","last_became_active":"2024-09-15T22:44:20.966183+0000","last_became_peered":"2024-09-15T22:44:20.966183+0000","last_unstale":"2024-09-15T22:44:22.968424+0000","last_undegraded":"2024-09-15T22:44:22.968424+0000","last_fullsized":"2024-09-15T22:44:22.968424+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:30.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971326+0000","last_change":"2024-09-15T22:44:21.975311+0000","last_active":"2024-09-15T22:44:22.971326+0000","last_peered":"2024-09-15T22:44:22.971326+0000","last_clean":"2024-09-15T22:44:22.971326+0000","last_became_active":"2024-09-15T22:44:21.975052+0000","last_became_peered":"2024-09-15T22:44:21.975052+0000","last_unstale":"2024-09-15T22:44:22.971326+0000","last_undegraded":"2024-09-15T22:44:22.971326+0000","last_fullsized":"2024-09-15T22:44:22.971326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:03.634300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661826+0000","last_change":"2024-09-15T22:44:20.967962+0000","last_active":"2024-09-15T22:44:23.661826+0000","last_peered":"2024-09-15T22:44:23.661826+0000","last_clean":"2024-09-15T22:44:23.661826+0000","last_became_active":"2024-09-15T22:44:20.967669+0000","last_became_peered":"2024-09-15T22:44:20.967669+0000","last_unstale":"2024-09-15T22:44:23.661826+0000","last_undegraded":"2024-09-15T22:44:23.661826+0000","last_fullsized":"2024-09-15T22:44:23.661826+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662726+0000","last_change":"2024-09-15T22:44:21.974096+0000","last_active":"2024-09-15T22:44:23.662726+0000","last_peered":"2024-09-15T22:44:23.662726+0000","last_clean":"2024-09-15T22:44:23.662726+0000","last_became_active":"2024-09-15T22:44:21.973817+0000","last_became_peered":"2024-09-15T22:44:21.973817+0000","last_unstale":"2024-09-15T22:44:23.662726+0000","last_undegraded":"2024-09-15T22:44:23.662726+0000","last_fullsized":"2024-09-15T22:44:23.662726+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:09.291326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.968582+0000","last_change":"2024-09-15T22:44:20.962150+0000","last_active":"2024-09-15T22:44:22.968582+0000","last_peered":"2024-09-15T22:44:22.968582+0000","last_clean":"2024-09-15T22:44:22.968582+0000","last_became_active":"2024-09-15T22:44:20.961861+0000","last_became_peered":"2024-09-15T22:44:20.961861+0000","last_unstale":"2024-09-15T22:44:22.968582+0000","last_undegraded":"2024-09-15T22:44:22.968582+0000","last_fullsized":"2024-09-15T22:44:22.968582+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:15.973313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304165+0000","last_change":"2024-09-15T22:44:21.962781+0000","last_active":"2024-09-15T22:44:23.304165+0000","last_peered":"2024-09-15T22:44:23.304165+0000","last_clean":"2024-09-15T22:44:23.304165+0000","last_became_active":"2024-09-15T22:44:21.962468+0000","last_became_peered":"2024-09-15T22:44:21.962468+0000","last_unstale":"2024-09-15T22:44:23.304165+0000","last_undegraded":"2024-09-15T22:44:23.304165+0000","last_fullsized":"2024-09-15T22:44:23.304165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:02.681660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:22.971148+0000","last_change":"2024-09-15T22:44:20.962947+0000","last_active":"2024-09-15T22:44:22.971148+0000","last_peered":"2024-09-15T22:44:22.971148+0000","last_clean":"2024-09-15T22:44:22.971148+0000","last_became_active":"2024-09-15T22:44:20.962625+0000","last_became_peered":"2024-09-15T22:44:20.962625+0000","last_unstale":"2024-09-15T22:44:22.971148+0000","last_undegraded":"2024-09-15T22:44:22.971148+0000","last_fullsized":"2024-09-15T22:44:22.971148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:03.363102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.661886+0000","last_change":"2024-09-15T22:44:21.973106+0000","last_active":"2024-09-15T22:44:23.661886+0000","last_peered":"2024-09-15T22:44:23.661886+0000","last_clean":"2024-09-15T22:44:23.661886+0000","last_became_active":"2024-09-15T22:44:21.972860+0000","last_became_peered":"2024-09-15T22:44:21.972860+0000","last_unstale":"2024-09-15T22:44:23.661886+0000","last_undegraded":"2024-09-15T22:44:23.661886+0000","last_fullsized":"2024-09-15T22:44:23.661886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:33.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304291+0000","last_change":"2024-09-15T22:44:20.961177+0000","last_active":"2024-09-15T22:44:23.304291+0000","last_peered":"2024-09-15T22:44:23.304291+0000","last_clean":"2024-09-15T22:44:23.304291+0000","last_became_active":"2024-09-15T22:44:20.960859+0000","last_became_peered":"2024-09-15T22:44:20.960859+0000","last_unstale":"2024-09-15T22:44:23.304291+0000","last_undegraded":"2024-09-15T22:44:23.304291+0000","last_fullsized":"2024-09-15T22:44:23.304291+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:21.875312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.304401+0000","last_change":"2024-09-15T22:44:21.957672+0000","last_active":"2024-09-15T22:44:23.304401+0000","last_peered":"2024-09-15T22:44:23.304401+0000","last_clean":"2024-09-15T22:44:23.304401+0000","last_became_active":"2024-09-15T22:44:21.957407+0000","last_became_peered":"2024-09-15T22:44:21.957407+0000","last_unstale":"2024-09-15T22:44:23.304401+0000","last_undegraded":"2024-09-15T22:44:23.304401+0000","last_fullsized":"2024-09-15T22:44:23.304401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:20.941453+0000","last_clean_scrub_stamp":"2024-09-15T22:44:20.941453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:41.287027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662254+0000","last_change":"2024-09-15T22:44:20.959715+0000","last_active":"2024-09-15T22:44:23.662254+0000","last_peered":"2024-09-15T22:44:23.662254+0000","last_clean":"2024-09-15T22:44:23.662254+0000","last_became_active":"2024-09-15T22:44:20.957914+0000","last_became_peered":"2024-09-15T22:44:20.957914+0000","last_unstale":"2024-09-15T22:44:23.662254+0000","last_undegraded":"2024-09-15T22:44:23.662254+0000","last_fullsized":"2024-09-15T22:44:23.662254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:19.935956+0000","last_clean_scrub_stamp":"2024-09-15T22:44:19.935956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:53.458307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":239,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T22:44:23.662124+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:23.662124+0000","last_peered":"2024-09-15T22:44:23.662124+0000","last_clean":"2024-09-15T22:44:23.662124+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:23.662124+0000","last_undegraded":"2024-09-15T22:44:23.662124+0000","last_fullsized":"2024-09-15T22:44:23.662124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":299524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":889834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":300048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":299522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":301204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1323008,"data_stored":890382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":737280,"data_stored":301044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":299454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:30.569 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:44:30.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:44:30.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.710+0000 7fc505c17640 1 Processor -- start 2024-09-15T22:44:30.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.710+0000 7fc505c17640 1 -- start start 2024-09-15T22:44:30.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc505c17640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc50015f9f0 0x7fc500072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc505c17640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50015c970 con 0x7fc50015b370 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc505c17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50015bbb0 con 0x7fc50006f130 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc505c17640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc50015fef0 con 0x7fc50015f9f0 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc4ff7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc50015b370 0x7fc50006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52626/0 (socket says 172.21.15.134:52626) 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.711+0000 7fc4ff7fe640 1 -- 172.21.15.134:0/1563799505 learned_addr learned my addr 172.21.15.134:0/1563799505 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fffff640 1 --2- 172.21.15.134:0/1563799505 >> v2:172.21.15.177:3300/0 conn(0x7fc50015f9f0 0x7fc500072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164784515 0 0) 0x7fc50015c970 con 0x7fc50015b370 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4e8003520 con 0x7fc50015b370 2024-09-15T22:44:30.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180126709 0 0) 0x7fc50015bbb0 con 0x7fc50006f130 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50015c970 con 0x7fc50006f130 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fffff640 1 -- 172.21.15.134:0/1563799505 >> v1:172.21.15.177:6789/0 conn(0x7fc50006f130 legacy=0x7fc50006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fffff640 1 -- 172.21.15.134:0/1563799505 >> v1:172.21.15.134:6789/0 conn(0x7fc50015b370 legacy=0x7fc50006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.712+0000 7fc4fffff640 1 -- 172.21.15.134:0/1563799505 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50015be90 con 0x7fc50015f9f0 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc4fffff640 1 --2- 172.21.15.134:0/1563799505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015f9f0 0x7fc500072560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009d90 tx=0x7fc4f802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13654b30f0c224b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8007740 con 0x7fc50015f9f0 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f80078e0 con 0x7fc50015f9f0 2024-09-15T22:44:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc4fe7fc640 1 -- 172.21.15.134:0/1563799505 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8007cb0 con 0x7fc50015f9f0 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc505c17640 1 -- 172.21.15.134:0/1563799505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015f9f0 msgr2=0x7fc500072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc505c17640 1 --2- 172.21.15.134:0/1563799505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015f9f0 0x7fc500072560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009d90 tx=0x7fc4f802a660 comp rx=0 tx=0).stop 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc505c17640 1 -- 172.21.15.134:0/1563799505 shutdown_connections 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc505c17640 1 --2- 172.21.15.134:0/1563799505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015f9f0 0x7fc500072560 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.713+0000 7fc505c17640 1 -- 172.21.15.134:0/1563799505 >> 172.21.15.134:0/1563799505 conn(0x7fc50006bba0 msgr2=0x7fc50006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.714+0000 7fc505c17640 1 -- 172.21.15.134:0/1563799505 shutdown_connections 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.714+0000 7fc505c17640 1 -- 172.21.15.134:0/1563799505 wait complete. 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.715+0000 7fc505c17640 1 Processor -- start 2024-09-15T22:44:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.715+0000 7fc505c17640 1 -- start start 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015b370 0x7fc50015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 0x7fc5000b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc5000731b0 con 0x7fc50006f130 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc50015c450 con 0x7fc50015b370 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc5000cf4a0 con 0x7fc50015f9f0 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52128/0 (socket says 172.21.15.134:52128) 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 -- 172.21.15.134:0/3295788727 learned_addr learned my addr 172.21.15.134:0/3295788727 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4feffd640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015b370 0x7fc50015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4fffff640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 0x7fc5000b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 -- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 msgr2=0x7fc5000b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 0x7fc5000b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 -- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015b370 msgr2=0x7fc50015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015b370 0x7fc50015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 -- 172.21.15.134:0/3295788727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc500154d00 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4fffff640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 0x7fc5000b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4ff7fe640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c530 tx=0x7fc4f000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0017070 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005ce0 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50015dfb0 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0007270 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.716+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5001f39c0 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.717+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5000b5a50 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.718+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fc4f001a070 con 0x7fc50006f130 2024-09-15T22:44:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.718+0000 7fc4e7fff640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 0x7fc4ec06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.718+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fc4f008a910 con 0x7fc50006f130 2024-09-15T22:44:30.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.718+0000 7fc4feffd640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 0x7fc4ec06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.719+0000 7fc4feffd640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 0x7fc4ec06e920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007fd0 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.722+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5000b5a50 con 0x7fc50006f130 2024-09-15T22:44:30.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.948+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc5001580d0 con 0x7fc50006f130 2024-09-15T22:44:30.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.950+0000 7fc4e7fff640 1 -- 172.21.15.134:0/3295788727 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fc4f0058870 con 0x7fc50006f130 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:44:30.952 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.952+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 msgr2=0x7fc4ec06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.952+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 0x7fc4ec06e920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007fd0 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.952+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 msgr2=0x7fc500150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.952+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c530 tx=0x7fc4f000c9f0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 shutdown_connections 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc4ec06c460 0x7fc4ec06e920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50015f9f0 0x7fc5000b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc50015b370 0x7fc50015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 --2- 172.21.15.134:0/3295788727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc50006f130 0x7fc500150a40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 >> 172.21.15.134:0/3295788727 conn(0x7fc50006bba0 msgr2=0x7fc5000b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 shutdown_connections 2024-09-15T22:44:30.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:30.953+0000 7fc505c17640 1 -- 172.21.15.134:0/3295788727 wait complete. 2024-09-15T22:44:30.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:31.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.064+0000 7f24443b9640 1 Processor -- start 2024-09-15T22:44:31.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.064+0000 7f24443b9640 1 -- start start 2024-09-15T22:44:31.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f24443b9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f24443b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 0x7f243c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f24443b9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c0ce740 con 0x7f243c0cf5b0 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f24443b9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f243c072640 con 0x7f243c15c180 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f24443b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f243c072920 con 0x7f243c0ce230 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f2442155640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f2441954640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 0x7f243c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f2442155640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:47192/0 (socket says 172.21.15.134:47192) 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f2442155640 1 -- 172.21.15.134:0/911055000 learned_addr learned my addr 172.21.15.134:0/911055000 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.065+0000 7f2442956640 1 --1- 172.21.15.134:0/911055000 >> v1:172.21.15.177:6789/0 conn(0x7f243c0cf5b0 0x7f243c073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:39278/0 (socket says 172.21.15.134:39278) 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441954640 1 -- 172.21.15.134:0/911055000 >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 msgr2=0x7f243c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441954640 1 --2- 172.21.15.134:0/911055000 >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441954640 1 -- 172.21.15.134:0/911055000 >> v1:172.21.15.177:6789/0 conn(0x7f243c0cf5b0 legacy=0x7f243c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441153640 1 -- 172.21.15.134:0/911055000 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684977898 0 0) 0x7f243c0ce740 con 0x7f243c0cf5b0 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441954640 1 -- 172.21.15.134:0/911055000 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c072c00 con 0x7f243c0ce230 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2442155640 1 --2- 172.21.15.134:0/911055000 >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.066+0000 7f2441954640 1 --2- 172.21.15.134:0/911055000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 0x7f243c0cf070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f242c0097a0 tx=0x7f242c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f9123938562e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f2441153640 1 -- 172.21.15.134:0/911055000 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037070 con 0x7f243c0ce230 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f2441153640 1 -- 172.21.15.134:0/911055000 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c02ae50 con 0x7f243c0ce230 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f2441153640 1 -- 172.21.15.134:0/911055000 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c032660 con 0x7f243c0ce230 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 -- 172.21.15.134:0/911055000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 msgr2=0x7f243c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 --2- 172.21.15.134:0/911055000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 0x7f243c0cf070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f242c0097a0 tx=0x7f242c02a100 comp rx=0 tx=0).stop 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 -- 172.21.15.134:0/911055000 shutdown_connections 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 --2- 172.21.15.134:0/911055000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c0ce230 0x7f243c0cf070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 --2- 172.21.15.134:0/911055000 >> v2:172.21.15.177:3300/0 conn(0x7f243c15c180 0x7f243c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 -- 172.21.15.134:0/911055000 >> 172.21.15.134:0/911055000 conn(0x7f243c062cc0 msgr2=0x7f243c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 -- 172.21.15.134:0/911055000 shutdown_connections 2024-09-15T22:44:31.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.067+0000 7f24443b9640 1 -- 172.21.15.134:0/911055000 wait complete. 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.068+0000 7f24443b9640 1 Processor -- start 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.068+0000 7f24443b9640 1 -- start start 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f243c0cf5b0 0x7f243c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c15c180 0x7f243c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f243c15c560 con 0x7f243c0ce230 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f243c0722f0 con 0x7f243c0cf5b0 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f24443b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f243c15c6e0 con 0x7f243c15c180 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f2442155640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f2442155640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52130/0 (socket says 172.21.15.134:52130) 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f2442155640 1 -- 172.21.15.134:0/550491926 learned_addr learned my addr 172.21.15.134:0/550491926 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f2442956640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c15c180 0x7f243c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.069+0000 7f2441954640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f243c0cf5b0 0x7f243c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 -- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c15c180 msgr2=0x7f243c151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c15c180 0x7f243c151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 -- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f243c0cf5b0 msgr2=0x7f243c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f243c0cf5b0 0x7f243c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 -- 172.21.15.134:0/550491926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c1504d0 con 0x7f243c0ce230 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2442155640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f243800efc0 tx=0x7f243800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438014480 con 0x7f243c0ce230 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2438019070 con 0x7f243c0ce230 2024-09-15T22:44:31.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c1507b0 con 0x7f243c0ce230 2024-09-15T22:44:31.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438014820 con 0x7f243c0ce230 2024-09-15T22:44:31.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.070+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c1500c0 con 0x7f243c0ce230 2024-09-15T22:44:31.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.071+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c071910 con 0x7f243c0ce230 2024-09-15T22:44:31.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.071+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f2438005d10 con 0x7f243c0ce230 2024-09-15T22:44:31.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.072+0000 7f2432ffd640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 0x7f242006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.072+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f243808bd50 con 0x7f243c0ce230 2024-09-15T22:44:31.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.072+0000 7f2441954640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 0x7f242006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.072+0000 7f2441954640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 0x7f242006e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f242c034000 tx=0x7f242c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.076+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f243c071910 con 0x7f243c0ce230 2024-09-15T22:44:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.274+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f243c0cf070 con 0x7f243c0ce230 2024-09-15T22:44:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.275+0000 7f2432ffd640 1 -- 172.21.15.134:0/550491926 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5235 (secure 0 0 0) 0x7f243808f030 con 0x7f243c0ce230 2024-09-15T22:44:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:31.276 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":29,"btime":"2024-09-15T22:44:24:969038+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 29 2024-09-15T22:44:31.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 msgr2=0x7f242006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 0x7f242006e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f242c034000 tx=0x7f242c02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:31.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 msgr2=0x7f243c14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f243800efc0 tx=0x7f243800c490 comp rx=0 tx=0).stop 2024-09-15T22:44:31.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 shutdown_connections 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f242006c460 0x7f242006e920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f243c15c180 0x7f243c151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f243c0cf5b0 0x7f243c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 --2- 172.21.15.134:0/550491926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f243c0ce230 0x7f243c14fb80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 >> 172.21.15.134:0/550491926 conn(0x7f243c062cc0 msgr2=0x7f243c15a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 shutdown_connections 2024-09-15T22:44:31.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.277+0000 7f24443b9640 1 -- 172.21.15.134:0/550491926 wait complete. 2024-09-15T22:44:31.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:44:21.291495+0000', 'modified': '2024-09-15T22:44:24.068627+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5727}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5727': {'gid': 5727, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6837/3316659079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3316659079}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 3316659079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5727, 'qdb_cluster': [5727]} 2024-09-15T22:44:31.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:44:31.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:44:31.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.792+0000 7f188365e640 1 Processor -- start 2024-09-15T22:44:31.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.792+0000 7f188365e640 1 -- start start 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f188365e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f187c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f188365e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f187c06c1f0 0x7f187c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f188365e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c0cd5f0 con 0x7f187c06be10 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f188365e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f187c0cd8d0 con 0x7f187c06c1f0 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f188365e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f187c0cdbb0 con 0x7f187c151c50 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f18813fa640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f187c06be10 0x7f187c151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52638/0 (socket says 172.21.15.134:52638) 2024-09-15T22:44:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f18813fa640 1 -- 172.21.15.134:0/3065544583 learned_addr learned my addr 172.21.15.134:0/3065544583 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530052467 0 0) 0x7f187c0cd5f0 con 0x7f187c06be10 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f187c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1868004630 con 0x7f187c06be10 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1881bfb640 1 --2- 172.21.15.134:0/3065544583 >> v2:172.21.15.177:3300/0 conn(0x7f187c06c1f0 0x7f187c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3752720694 0 0) 0x7f1868004630 con 0x7f187c06be10 2024-09-15T22:44:31.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 msgr2=0x7f187c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f187c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 >> v2:172.21.15.177:3300/0 conn(0x7f187c06c1f0 msgr2=0x7f187c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 --2- 172.21.15.134:0/3065544583 >> v2:172.21.15.177:3300/0 conn(0x7f187c06c1f0 0x7f187c15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c0cde90 con 0x7f187c06be10 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f186c001670 con 0x7f187c06be10 2024-09-15T22:44:31.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1881bfb640 1 --2- 172.21.15.134:0/3065544583 >> v2:172.21.15.177:3300/0 conn(0x7f187c06c1f0 0x7f187c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:31.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 >> v1:172.21.15.134:6789/0 conn(0x7f187c06be10 legacy=0x7f187c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1868004ac0 0x7f1868004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f1868005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868005e50 0x7f18680062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f187c0cd8d0 con 0x7f1868004ac0 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187c0cdbb0 con 0x7f1868005e50 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f186800cb00 con 0x7f187c151c50 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.793+0000 7f18813fa640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1868004ac0 0x7f1868004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f1868005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f1881bfb640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868005e50 0x7f18680062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 -- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 msgr2=0x7f1868005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f1868005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 -- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868005e50 msgr2=0x7f18680062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868005e50 0x7f18680062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 -- 172.21.15.134:0/3065544583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1868004630 con 0x7f1868004ac0 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c151c50 0x7f1868005910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:31.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.794+0000 7f18813fa640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1868004ac0 0x7f1868004ee0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c240 tx=0x7f1868006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e04dce24aaf890 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c02e070 con 0x7f1868004ac0 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c005af0 con 0x7f1868004ac0 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f1873fff640 1 -- 172.21.15.134:0/3065544583 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c007d30 con 0x7f1868004ac0 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 -- 172.21.15.134:0/3065544583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1868004ac0 msgr2=0x7f1868004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 --2- 172.21.15.134:0/3065544583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1868004ac0 0x7f1868004ee0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c240 tx=0x7f1868006940 comp rx=0 tx=0).stop 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f1881bfb640 1 -- 172.21.15.134:0/3065544583 reap_dead start 2024-09-15T22:44:31.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 -- 172.21.15.134:0/3065544583 shutdown_connections 2024-09-15T22:44:31.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 -- 172.21.15.134:0/3065544583 >> 172.21.15.134:0/3065544583 conn(0x7f187c062cc0 msgr2=0x7f187c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 -- 172.21.15.134:0/3065544583 shutdown_connections 2024-09-15T22:44:31.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.795+0000 7f188365e640 1 -- 172.21.15.134:0/3065544583 wait complete. 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.796+0000 7f188365e640 1 Processor -- start 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.796+0000 7f188365e640 1 -- start start 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868004ac0 0x7f187c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 0x7f187c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f187c0cd010 con 0x7f187c0ac5c0 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187c0ce690 con 0x7f1868004ac0 2024-09-15T22:44:31.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f188365e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f187c0cd190 con 0x7f187c0adbe0 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f1881bfb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f1881bfb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52140/0 (socket says 172.21.15.134:52140) 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f1881bfb640 1 -- 172.21.15.134:0/1685561124 learned_addr learned my addr 172.21.15.134:0/1685561124 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 0x7f187c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.797+0000 7f18813fa640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868004ac0 0x7f187c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 -- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 msgr2=0x7f187c0ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 0x7f187c0ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 -- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868004ac0 msgr2=0x7f187c140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868004ac0 0x7f187c140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 -- 172.21.15.134:0/1685561124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c0acb40 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 0x7f187c0ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1881bfb640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f187c0b59b0 tx=0x7f1874007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1871ffb640 1 -- 172.21.15.134:0/1685561124 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874014410 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1871ffb640 1 -- 172.21.15.134:0/1685561124 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874019070 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f1871ffb640 1 -- 172.21.15.134:0/1685561124 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740147d0 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c0ace20 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.798+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c0ad3e0 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.800+0000 7f1871ffb640 1 -- 172.21.15.134:0/1685561124 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f1874014970 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.800+0000 7f1871ffb640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 0x7f186006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.800+0000 7f1871ffb640 1 -- 172.21.15.134:0/1685561124 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f187408bda0 con 0x7f187c0ac5c0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.800+0000 7f18813fa640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 0x7f186006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.801+0000 7f18813fa640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 0x7f186006e950 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c240 tx=0x7f186c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.801+0000 7f18863fa740 1 Processor -- start 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.801+0000 7f18863fa740 1 -- start start 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845bc1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7da50 0x555845b768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555845ade520 con 0x555845b79a80 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555845a863e0 con 0x555845b7c2c0 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x555845ada4e0 con 0x555845b7da50 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52142/0 (socket says 172.21.15.134:52142) 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 -- 172.21.15.134:0/3137768946 learned_addr learned my addr 172.21.15.134:0/3137768946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1881bfb640 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7da50 0x555845b768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f18813fa640 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845bc1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 -- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7da50 msgr2=0x555845b768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7da50 0x555845b768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 -- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 msgr2=0x555845bc1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845bc1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.802+0000 7f1880bf9640 1 -- 172.21.15.134:0/3137768946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555845aa12f0 con 0x555845b79a80 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f1880bf9640 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1878009c60 tx=0x7f1878009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce75ddaafe83f8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f185effd640 1 -- 172.21.15.134:0/3137768946 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187801a030 con 0x555845b79a80 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f185effd640 1 -- 172.21.15.134:0/3137768946 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878013d50 con 0x555845b79a80 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f185effd640 1 -- 172.21.15.134:0/3137768946 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780166a0 con 0x555845b79a80 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 -- 172.21.15.134:0/3137768946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 msgr2=0x555845b7c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1878009c60 tx=0x7f1878009190 comp rx=0 tx=0).stop 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 -- 172.21.15.134:0/3137768946 shutdown_connections 2024-09-15T22:44:31.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7da50 0x555845b768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b79a80 0x555845b7c6a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 --2- 172.21.15.134:0/3137768946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845bc1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 -- 172.21.15.134:0/3137768946 >> 172.21.15.134:0/3137768946 conn(0x555845b78a80 msgr2=0x555845bc0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 -- 172.21.15.134:0/3137768946 shutdown_connections 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.803+0000 7f18863fa740 1 -- 172.21.15.134:0/3137768946 wait complete. 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.804+0000 7f18863fa740 1 -- start start 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.804+0000 7f18863fa740 1 Processor -- start 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845b9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845b770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555845b77f20 con 0x555845b7da50 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555845a67450 con 0x555845b7c2c0 2024-09-15T22:44:31.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x555845bc2290 con 0x555845b7b9c0 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18863fa740 10 client.0 _ll_register_callbacks cb 0x5558457f0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52146/0 (socket says 172.21.15.134:52146) 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 -- 172.21.15.134:0/1589596202 learned_addr learned my addr 172.21.15.134:0/1589596202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1881bfb640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845b770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f18813fa640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845b9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 -- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 msgr2=0x555845b770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845b770d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 -- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 msgr2=0x555845b9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845b9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 -- 172.21.15.134:0/1589596202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558457f12d0 con 0x555845b7da50 2024-09-15T22:44:31.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1857fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:44:31.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.805+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1878005bc0 tx=0x7f18780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7855c48c2c6079cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878006240 con 0x555845b7da50 2024-09-15T22:44:31.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f187802aaf0 con 0x555845b7da50 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1878013d50 con 0x555845b7da50 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1878031050 con 0x555845b7da50 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 10 client.5871 fetch_fsmap learned FSMap version 29 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5558458bb6b0 con 0x555845b7da50 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878013d50 con 0x555845b7da50 2024-09-15T22:44:31.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1878034020 con 0x555845b7da50 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 10 client.5871 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 10 client.5871 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 20 client.5871 populate_metadata read hostname 'smithi134' 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845b9fbc0 0x555845b9ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 4 client.5871 mds_command: new command op to 5727 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 --> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555845aebc50 con 0x555845b9fbc0 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.806+0000 7f18813fa640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845b9fbc0 0x555845b9ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f1857fff640 10 client.5871 ms_handle_connect on v2:172.21.15.134:6834/3316659079 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18813fa640 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845b9fbc0 0x555845b9ffa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da899f1b1836811b server_cookie=4aa306f27faf6cc1 in_seq=0 out_seq=0 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f1857fff640 1 -- 172.21.15.134:0/1589596202 <== mds.0 v2:172.21.15.134:6834/3316659079 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555845aebc50 con 0x555845b9fbc0 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f1857fff640 10 client.5871 handle_command_reply: tid=0 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 client.5871 shutdown 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 msgr2=0x555845b7b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1878005bc0 tx=0x7f18780046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 shutdown_connections 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845b770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845b7b480 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845b9fbc0 0x555845b9ffa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 --2- 172.21.15.134:0/1589596202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845b9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f1857fff640 0 client.5871 ms_handle_reset on v2:172.21.15.134:6834/3316659079 2024-09-15T22:44:31.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 >> 172.21.15.134:0/1589596202 conn(0x555845b79a80 msgr2=0x555845b7a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.807+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 shutdown_connections 2024-09-15T22:44:31.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.808+0000 7f18863fa740 1 -- 172.21.15.134:0/1589596202 wait complete. 2024-09-15T22:44:31.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.808+0000 7f18863fa740 20 client.5871 trim_cache size 0 max 16384 2024-09-15T22:44:31.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.825+0000 7f18863fa740 1 Processor -- start 2024-09-15T22:44:31.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.825+0000 7f18863fa740 1 -- start start 2024-09-15T22:44:31.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845be50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845ba1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1fe150 con 0x555845b7da50 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1424b0 con 0x555845b7c2c0 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f187c1fdb00 con 0x555845b7b9c0 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52154/0 (socket says 172.21.15.134:52154) 2024-09-15T22:44:31.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 -- 172.21.15.134:0/130035679 learned_addr learned my addr 172.21.15.134:0/130035679 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1880bf9640 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845ba1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f18813fa640 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845be50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 -- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 msgr2=0x555845be50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845be50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 -- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 msgr2=0x555845ba1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845ba1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.826+0000 7f1881bfb640 1 -- 172.21.15.134:0/130035679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555845ba6c30 con 0x555845b7da50 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f1881bfb640 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1874002230 tx=0x7f1874004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b111f3cb61830f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f185e7fc640 1 -- 172.21.15.134:0/130035679 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740599f0 con 0x555845b7da50 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f185e7fc640 1 -- 172.21.15.134:0/130035679 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187405dda0 con 0x555845b7da50 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f185e7fc640 1 -- 172.21.15.134:0/130035679 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874062660 con 0x555845b7da50 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 -- 172.21.15.134:0/130035679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 msgr2=0x555845ba1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1874002230 tx=0x7f1874004a40 comp rx=0 tx=0).stop 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 -- 172.21.15.134:0/130035679 shutdown_connections 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7da50 0x555845ba1860 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7c2c0 0x555845ba1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 --2- 172.21.15.134:0/130035679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845be50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 -- 172.21.15.134:0/130035679 >> 172.21.15.134:0/130035679 conn(0x555845b79a80 msgr2=0x555845ba3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 -- 172.21.15.134:0/130035679 shutdown_connections 2024-09-15T22:44:31.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.827+0000 7f18863fa740 1 -- 172.21.15.134:0/130035679 wait complete. 2024-09-15T22:44:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.828+0000 7f18863fa740 1 -- start start 2024-09-15T22:44:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.828+0000 7f18863fa740 1 Processor -- start 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845bbf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7da50 0x555845c40360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555845b76bf0 con 0x555845b7c2c0 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555845b77f20 con 0x555845b7da50 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x555845b75bc0 con 0x555845b7b9c0 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18863fa740 10 client.0 _ll_register_callbacks cb 0x7f1878009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52156/0 (socket says 172.21.15.134:52156) 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 -- 172.21.15.134:0/1227483823 learned_addr learned my addr 172.21.15.134:0/1227483823 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f18813fa640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845bbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1881bfb640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7da50 0x555845c40360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 -- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 msgr2=0x555845bbf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845bbf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 -- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7da50 msgr2=0x555845c40360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7da50 0x555845c40360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 -- 172.21.15.134:0/1227483823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555845bc0fa0 con 0x555845b7c2c0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1880bf9640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1878009680 tx=0x7f1878008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26168a698b58a95d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.829+0000 7f1857fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187803a060 con 0x555845b7c2c0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f1878006200 con 0x555845b7c2c0 2024-09-15T22:44:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f187405dda0 con 0x555845b7c2c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1878040050 con 0x555845b7c2c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 10 client.5877 fetch_fsmap learned FSMap version 29 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x555845b7b520 con 0x555845b7c2c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187405dda0 con 0x555845b7c2c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1878043020 con 0x555845b7c2c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 10 client.5877 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 10 client.5877 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 20 client.5877 populate_metadata read hostname 'smithi134' 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845bbd9c0 0x555845ba3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 4 client.5877 mds_command: new command op to 5727 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 --> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] -- command(tid 0: {"prefix": "status"}) -- 0x555845ae5fa0 con 0x555845bbd9c0 2024-09-15T22:44:31.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18813fa640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845bbd9c0 0x555845ba3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f1857fff640 10 client.5877 ms_handle_connect on v2:172.21.15.134:6834/3316659079 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.830+0000 7f18813fa640 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845bbd9c0 0x555845ba3370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5a2cd29b00e4196 server_cookie=6e0a0a527230ec77 in_seq=0 out_seq=0 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f1857fff640 1 -- 172.21.15.134:0/1227483823 <== mds.0 v2:172.21.15.134:6834/3316659079 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555845ae5fa0 con 0x555845bbd9c0 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f1857fff640 10 client.5877 handle_command_reply: tid=0 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 client.5877 shutdown 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 msgr2=0x555845c3f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1878009680 tx=0x7f1878008040 comp rx=0 tx=0).stop 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 shutdown_connections 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:6834/3316659079,v1:172.21.15.134:6837/3316659079] conn(0x555845bbd9c0 0x555845ba3370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555845b7da50 0x555845c40360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555845b7c2c0 0x555845c3f2b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f1857fff640 0 client.5877 ms_handle_reset on v2:172.21.15.134:6834/3316659079 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 --2- 172.21.15.134:0/1227483823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555845b7b9c0 0x555845bbf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 >> 172.21.15.134:0/1227483823 conn(0x555845b79a80 msgr2=0x555845ba1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 shutdown_connections 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 1 -- 172.21.15.134:0/1227483823 wait complete. 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f18863fa740 20 client.5877 trim_cache size 0 max 16384 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 5727, 2024-09-15T22:44:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 9.8833671970000001, 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 29, 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 61, 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 61, 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 13.949872219 2024-09-15T22:44:31.842 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:44:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 msgr2=0x7f186006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 0x7f186006e950 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c240 tx=0x7f186c009030 comp rx=0 tx=0).stop 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 msgr2=0x7f187c073910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.831+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f187c0b59b0 tx=0x7f1874007700 comp rx=0 tx=0).stop 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 shutdown_connections 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f186006c490 0x7f186006e950 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c0ac5c0 0x7f187c073910 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187c0adbe0 0x7f187c0ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 --2- 172.21.15.134:0/1685561124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1868004ac0 0x7f187c140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 >> 172.21.15.134:0/1685561124 conn(0x7f187c062cc0 msgr2=0x7f187c159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 shutdown_connections 2024-09-15T22:44:31.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.832+0000 7f188365e640 1 -- 172.21.15.134:0/1685561124 wait complete. 2024-09-15T22:44:31.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:44:31.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.943+0000 7fd73f8ba640 1 Processor -- start 2024-09-15T22:44:31.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.943+0000 7fd73f8ba640 1 -- start start 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73f8ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7380cf070 0x7fd7380cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73f8ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd738073120 0x7fd738073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73f8ba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7380ce740 con 0x7fd73815c180 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73f8ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd738072640 con 0x7fd7380cf070 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73f8ba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd738072920 con 0x7fd738073120 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7380cf070 0x7fd7380cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7380cf070 0x7fd7380cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52164/0 (socket says 172.21.15.134:52164) 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 -- 172.21.15.134:0/2880316786 learned_addr learned my addr 172.21.15.134:0/2880316786 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73de57640 1 --2- 172.21.15.134:0/2880316786 >> v2:172.21.15.177:3300/0 conn(0x7fd738073120 0x7fd738073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 -- 172.21.15.134:0/2880316786 >> v2:172.21.15.177:3300/0 conn(0x7fd738073120 msgr2=0x7fd738073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 --2- 172.21.15.134:0/2880316786 >> v2:172.21.15.177:3300/0 conn(0x7fd738073120 0x7fd738073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 -- 172.21.15.134:0/2880316786 >> v1:172.21.15.177:6789/0 conn(0x7fd73815c180 legacy=0x7fd7380cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:31.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.944+0000 7fd73ce55640 1 -- 172.21.15.134:0/2880316786 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd738072c00 con 0x7fd7380cf070 2024-09-15T22:44:31.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.945+0000 7fd73ce55640 1 --2- 172.21.15.134:0/2880316786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7380cf070 0x7fd7380cf4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cd070 tx=0x7fd72802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a74d3380e00d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.945+0000 7fd72ffff640 1 -- 172.21.15.134:0/2880316786 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728037070 con 0x7fd7380cf070 2024-09-15T22:44:31.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.945+0000 7fd72ffff640 1 -- 172.21.15.134:0/2880316786 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728032440 con 0x7fd7380cf070 2024-09-15T22:44:31.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.945+0000 7fd72ffff640 1 -- 172.21.15.134:0/2880316786 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728032810 con 0x7fd7380cf070 2024-09-15T22:44:31.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 -- 172.21.15.134:0/2880316786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7380cf070 msgr2=0x7fd7380cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/2880316786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7380cf070 0x7fd7380cf4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cd070 tx=0x7fd72802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 -- 172.21.15.134:0/2880316786 shutdown_connections 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/2880316786 >> v2:172.21.15.177:3300/0 conn(0x7fd738073120 0x7fd738073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/2880316786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7380cf070 0x7fd7380cf4e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 -- 172.21.15.134:0/2880316786 >> 172.21.15.134:0/2880316786 conn(0x7fd738062cc0 msgr2=0x7fd73806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 -- 172.21.15.134:0/2880316786 shutdown_connections 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.946+0000 7fd73f8ba640 1 -- 172.21.15.134:0/2880316786 wait complete. 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.947+0000 7fd73f8ba640 1 Processor -- start 2024-09-15T22:44:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.947+0000 7fd73f8ba640 1 -- start start 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd738073120 0x7fd7380af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7380cf070 0x7fd73815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380722f0 con 0x7fd73815c180 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380ced00 con 0x7fd738073120 2024-09-15T22:44:31.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd73815c560 con 0x7fd7380cf070 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52166/0 (socket says 172.21.15.134:52166) 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 -- 172.21.15.134:0/145691567 learned_addr learned my addr 172.21.15.134:0/145691567 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73d656640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd738073120 0x7fd7380af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73ce55640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7380cf070 0x7fd73815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 -- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7380cf070 msgr2=0x7fd73815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7380cf070 0x7fd73815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 -- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd738073120 msgr2=0x7fd7380af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd738073120 0x7fd7380af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 -- 172.21.15.134:0/145691567 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73815e8a0 con 0x7fd73815c180 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73de57640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd730007e70 tx=0x7fd73000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730014620 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730019070 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7380af6a0 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.948+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730014a20 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.949+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73815e5c0 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.950+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7380d0660 con 0x7fd73815c180 2024-09-15T22:44:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.950+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fd730014bc0 con 0x7fd73815c180 2024-09-15T22:44:31.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.950+0000 7fd72dffb640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 0x7fd71c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:31.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.951+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fd73008bf00 con 0x7fd73815c180 2024-09-15T22:44:31.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.951+0000 7fd73d656640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 0x7fd71c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:31.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.951+0000 7fd73d656640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 0x7fd71c06e950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd734006fd0 tx=0x7fd734009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:31.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:31.955+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd730059da0 con 0x7fd73815c180 2024-09-15T22:44:32.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.155+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd738157930 con 0x7fd73815c180 2024-09-15T22:44:32.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.156+0000 7fd72dffb640 1 -- 172.21.15.134:0/145691567 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7fd73005e0a0 con 0x7fd73815c180 2024-09-15T22:44:32.158 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:44:32.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 msgr2=0x7fd71c06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 0x7fd71c06e950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd734006fd0 tx=0x7fd734009060 comp rx=0 tx=0).stop 2024-09-15T22:44:32.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 msgr2=0x7fd7381f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd730007e70 tx=0x7fd73000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 shutdown_connections 2024-09-15T22:44:32.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd71c06c490 0x7fd71c06e950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd73815c180 0x7fd7381f5c40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7380cf070 0x7fd73815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 --2- 172.21.15.134:0/145691567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd738073120 0x7fd7380af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 >> 172.21.15.134:0/145691567 conn(0x7fd738062cc0 msgr2=0x7fd7381597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 shutdown_connections 2024-09-15T22:44:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32.158+0000 7fd73f8ba640 1 -- 172.21.15.134:0/145691567 wait complete. 2024-09-15T22:44:32.170 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:44:32.170 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:44:32.171 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:44:32.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.172 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:44:32.187 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:44:32.187 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:32.188 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42621sec preferred_lft 42621sec 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.189 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:32.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.190 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:44:32.252 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:44:32.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.254 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:44:32.310 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:44:32.311 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:44:32.311 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:44:32.312 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:44:32.312 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:44:32.312 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:44:32.312 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:44:32.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:44:32.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:44:32.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:44:32.313 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:44:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:44:32.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:44:32.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.438 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:44:32.453 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:44:32.453 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:44:32.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:44:32.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:44:32.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:44:32.519 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:32.574 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:44:32.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:44:32.575 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:32.630 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:44:32.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:44:32.713 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:44:32.713 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:44:32.713 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:44:32.722 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:44:32.722 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:44:32.722 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:44:32.722 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:44:32.722 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:44:32.726 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:44:32.726 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:44:32.726 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:44:32.727 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:44:32.728 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:44:32.729 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:44:32.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:32.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:32.801 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:44:32.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:44:32.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:44:32.899 INFO:teuthology.orchestra.run.smithi134.stdout:client5886 2024-09-15T22:44:32.899 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:32.899 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:32.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:44:33.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.055+0000 7fad3b1e8640 1 Processor -- start 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.055+0000 7fad3b1e8640 1 -- start start 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad3b1e8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad3415e940 0x7fad340d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad3b1e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fad3415ed20 0x7fad340d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad3b1e8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad340b7170 con 0x7fad340cef90 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad3b1e8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fad340d1ae0 con 0x7fad3415ed20 2024-09-15T22:44:33.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad3b1e8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fad340b7aa0 con 0x7fad3415e940 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fad3415ed20 0x7fad340d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fad3415ed20 0x7fad340d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52178/0 (socket says 172.21.15.134:52178) 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad39785640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fad340cef90 0x7fad340b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52654/0 (socket says 172.21.15.134:52654) 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 -- 172.21.15.134:0/3330556923 learned_addr learned my addr 172.21.15.134:0/3330556923 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad38f84640 1 --2- 172.21.15.134:0/3330556923 >> v2:172.21.15.177:3300/0 conn(0x7fad3415e940 0x7fad340d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 -- 172.21.15.134:0/3330556923 >> v2:172.21.15.177:3300/0 conn(0x7fad3415e940 msgr2=0x7fad340d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:33.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 --2- 172.21.15.134:0/3330556923 >> v2:172.21.15.177:3300/0 conn(0x7fad3415e940 0x7fad340d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 -- 172.21.15.134:0/3330556923 >> v1:172.21.15.134:6789/0 conn(0x7fad340cef90 legacy=0x7fad340b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad33fff640 1 -- 172.21.15.134:0/3330556923 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad340d3660 con 0x7fad3415ed20 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.056+0000 7fad337fe640 1 -- 172.21.15.134:0/3330556923 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473055426 0 0) 0x7fad2c001490 con 0x7fad340cef90 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.057+0000 7fad33fff640 1 --2- 172.21.15.134:0/3330556923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415ed20 0x7fad340d15a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fad340509d0 tx=0x7fad2002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a30ca7d89f104b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.057+0000 7fad337fe640 1 -- 172.21.15.134:0/3330556923 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20037070 con 0x7fad3415ed20 2024-09-15T22:44:33.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.057+0000 7fad337fe640 1 -- 172.21.15.134:0/3330556923 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2002ae50 con 0x7fad3415ed20 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.057+0000 7fad337fe640 1 -- 172.21.15.134:0/3330556923 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20032860 con 0x7fad3415ed20 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3330556923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415ed20 msgr2=0x7fad340d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3330556923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415ed20 0x7fad340d15a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fad340509d0 tx=0x7fad2002a300 comp rx=0 tx=0).stop 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3330556923 shutdown_connections 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3330556923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415ed20 0x7fad340d15a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3330556923 >> v2:172.21.15.177:3300/0 conn(0x7fad3415e940 0x7fad340d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3330556923 >> 172.21.15.134:0/3330556923 conn(0x7fad340b6240 msgr2=0x7fad340b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:33.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3330556923 shutdown_connections 2024-09-15T22:44:33.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.058+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3330556923 wait complete. 2024-09-15T22:44:33.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.059+0000 7fad3b1e8640 1 Processor -- start 2024-09-15T22:44:33.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.059+0000 7fad3b1e8640 1 -- start start 2024-09-15T22:44:33.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad340cef90 0x7fad340ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 0x7fad3415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad340d3f00 con 0x7fad3415e940 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad340d3c20 con 0x7fad340cef90 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad3b1e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fad340d3310 con 0x7fad3415ed20 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52184/0 (socket says 172.21.15.134:52184) 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 -- 172.21.15.134:0/3394430623 learned_addr learned my addr 172.21.15.134:0/3394430623 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad38f84640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad340cef90 0x7fad340ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad39785640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 0x7fad3415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 -- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 msgr2=0x7fad3415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 0x7fad3415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 -- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad340cef90 msgr2=0x7fad340ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad340cef90 0x7fad340ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 -- 172.21.15.134:0/3394430623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad341e8310 con 0x7fad3415e940 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad39785640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 0x7fad3415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.060+0000 7fad33fff640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad2002a340 tx=0x7fad200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.061+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20041070 con 0x7fad3415e940 2024-09-15T22:44:33.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.061+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2003c670 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.061+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3414afa0 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.061+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20037040 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.061+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3414b560 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.062+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad340d1ef0 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.062+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fad20044070 con 0x7fad3415e940 2024-09-15T22:44:33.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.062+0000 7fad317fa640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 0x7fad1806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:33.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.063+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fad200ac190 con 0x7fad3415e940 2024-09-15T22:44:33.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.063+0000 7fad38f84640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 0x7fad1806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:33.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.063+0000 7fad38f84640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 0x7fad1806e920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad28006fd0 tx=0x7fad28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:33.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.067+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad2007a7a0 con 0x7fad3415e940 2024-09-15T22:44:33.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.265+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fad340ba6b0 con 0x7fad3415e940 2024-09-15T22:44:33.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.265+0000 7fad317fa640 1 -- 172.21.15.134:0/3394430623 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7fad2007a0a0 con 0x7fad3415e940 2024-09-15T22:44:33.267 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:44:33.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.267+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 msgr2=0x7fad1806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.267+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 0x7fad1806e920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad28006fd0 tx=0x7fad28008040 comp rx=0 tx=0).stop 2024-09-15T22:44:33.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.267+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 msgr2=0x7fad3415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.267+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad2002a340 tx=0x7fad200046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 shutdown_connections 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fad1806c460 0x7fad1806e920 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3415ed20 0x7fad3415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3415e940 0x7fad3415c580 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 --2- 172.21.15.134:0/3394430623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad340cef90 0x7fad340ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 >> 172.21.15.134:0/3394430623 conn(0x7fad340b6240 msgr2=0x7fad340b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 shutdown_connections 2024-09-15T22:44:33.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:33.268+0000 7fad3b1e8640 1 -- 172.21.15.134:0/3394430623 wait complete. 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:44:33.280 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:44:33.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.280 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:33.300 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42610sec preferred_lft 42610sec 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:44:33.301 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:44:33.302 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:44:33.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.303 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:44:33.368 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:44:33.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.370 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:44:33.429 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:44:33.430 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:44:33.430 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:44:33.430 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:44:33.430 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:44:33.430 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:44:33.430 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:44:33.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:44:33.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:44:33.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:44:33.431 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:44:33.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:44:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:44:33.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:44:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:44:33.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.565 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:44:33.581 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:44:33.581 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:44:33.582 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:44:33.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:44:33.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:44:33.648 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:44:33.703 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:44:33.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:44:33.704 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:44:33.759 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:44:33.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:44:33.843 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:44:33.843 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:44:33.843 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:44:33.851 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:44:33.851 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:44:33.851 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:44:33.852 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:44:33.852 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:44:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:44:33.857 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:44:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:44:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:44:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:44:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:44:33.858 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:44:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:33.859 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:44:33.924 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:44:34.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:44:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:44:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:44:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:44:34.020 INFO:teuthology.orchestra.run.smithi177.stdout:client5114 2024-09-15T22:44:34.020 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:34.020 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:34.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:44:34.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.143+0000 7f2407477640 1 Processor -- start 2024-09-15T22:44:34.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 -- start start 2024-09-15T22:44:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f2400072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f240015f9f0 0x7f240006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240015c970 con 0x7f240006ef60 2024-09-15T22:44:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f240015fef0 con 0x7f240015f9f0 2024-09-15T22:44:34.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.144+0000 7f2407477640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f240015bbb0 con 0x7f240015b370 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f240015f9f0 0x7f240006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2405a14640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f240006ef60 0x7f2400071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52666/0 (socket says 172.21.15.134:52666) 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f240015f9f0 0x7f240006ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52186/0 (socket says 172.21.15.134:52186) 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2405a14640 1 -- 172.21.15.134:0/664862213 learned_addr learned my addr 172.21.15.134:0/664862213 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2405213640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f2400072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 -- 172.21.15.134:0/664862213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 msgr2=0x7f2400072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f2400072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 -- 172.21.15.134:0/664862213 >> v1:172.21.15.134:6789/0 conn(0x7f240006ef60 legacy=0x7f2400071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f23f3fff640 1 -- 172.21.15.134:0/664862213 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441439753 0 0) 0x7f240015c970 con 0x7f240006ef60 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2404a12640 1 -- 172.21.15.134:0/664862213 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240015be90 con 0x7f240015f9f0 2024-09-15T22:44:34.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.145+0000 7f2405213640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f2400072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2404a12640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240015f9f0 0x7f240006ea20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1236d8235514fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:34.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f23f3fff640 1 -- 172.21.15.134:0/664862213 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4037070 con 0x7f240015f9f0 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f23f3fff640 1 -- 172.21.15.134:0/664862213 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f402ae50 con 0x7f240015f9f0 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f23f3fff640 1 -- 172.21.15.134:0/664862213 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4032660 con 0x7f240015f9f0 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 -- 172.21.15.134:0/664862213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240015f9f0 msgr2=0x7f240006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240015f9f0 0x7f240006ea20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402a100 comp rx=0 tx=0).stop 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 -- 172.21.15.134:0/664862213 shutdown_connections 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240015f9f0 0x7f240006ea20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 --2- 172.21.15.134:0/664862213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f2400072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.146+0000 7f2407477640 1 -- 172.21.15.134:0/664862213 >> 172.21.15.134:0/664862213 conn(0x7f240006bba0 msgr2=0x7f240006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.147+0000 7f2407477640 1 -- 172.21.15.134:0/664862213 shutdown_connections 2024-09-15T22:44:34.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.147+0000 7f2407477640 1 -- 172.21.15.134:0/664862213 wait complete. 2024-09-15T22:44:34.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 Processor -- start 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 -- start start 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f24000ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f240015f9f0 0x7f24000aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24000731b0 con 0x7f240006ef60 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f240015c450 con 0x7f240015f9f0 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.148+0000 7f2407477640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f24000cf4a0 con 0x7f240015b370 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52196/0 (socket says 172.21.15.134:52196) 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 -- 172.21.15.134:0/1961860512 learned_addr learned my addr 172.21.15.134:0/1961860512 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2404a12640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f24000ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405a14640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f240015f9f0 0x7f24000aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 -- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 msgr2=0x7f24000ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f24000ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 -- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f240015f9f0 msgr2=0x7f24000aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f240015f9f0 0x7f24000aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 -- 172.21.15.134:0/1961860512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400152ca0 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2404a12640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f24000ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2405213640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e7e0 tx=0x7f23fc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00f040 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc004030 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240015a190 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc004400 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.149+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240015a750 con 0x7f240006ef60 2024-09-15T22:44:34.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.150+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240015b750 con 0x7f240006ef60 2024-09-15T22:44:34.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.151+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f23fc00c6d0 con 0x7f240006ef60 2024-09-15T22:44:34.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.151+0000 7f23f1ffb640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 0x7f23e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.151+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f23fc08b640 con 0x7f240006ef60 2024-09-15T22:44:34.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.151+0000 7f2404a12640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 0x7f23e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.152+0000 7f2404a12640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 0x7f23e406e920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f23f4034000 tx=0x7f23f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:34.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.155+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23fc017020 con 0x7f240006ef60 2024-09-15T22:44:34.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:34.356+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f2400155c10 con 0x7f240006ef60 2024-09-15T22:44:35.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.058+0000 7f23f1ffb640 1 -- 172.21.15.134:0/1961860512 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v30) ==== 136+0+0 (secure 0 0 0) 0x7f23fc059a20 con 0x7f240006ef60 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 msgr2=0x7f23e406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 0x7f23e406e920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f23f4034000 tx=0x7f23f402e000 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 msgr2=0x7f240014ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e7e0 tx=0x7f23fc00eca0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 shutdown_connections 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f23e406c460 0x7f23e406e920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f240015f9f0 0x7f24000aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f240015b370 0x7f24000ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 --2- 172.21.15.134:0/1961860512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240006ef60 0x7f240014ae50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 >> 172.21.15.134:0/1961860512 conn(0x7f240006bba0 msgr2=0x7f240006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 shutdown_connections 2024-09-15T22:44:35.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.060+0000 7f2407477640 1 -- 172.21.15.134:0/1961860512 wait complete. 2024-09-15T22:44:35.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:44:35.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.172+0000 7f0526bfd640 1 Processor -- start 2024-09-15T22:44:35.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 -- start start 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05200d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f052015ed20 0x7f05200d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05200cef90 0x7f05200b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f05200d1ae0 con 0x7f052015ed20 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f05200b7170 con 0x7f05200cef90 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.173+0000 7f0526bfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f05200b7aa0 con 0x7f052015e940 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f052015ed20 0x7f05200d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f052015ed20 0x7f05200d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52202/0 (socket says 172.21.15.134:52202) 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 -- 172.21.15.134:0/1535513790 learned_addr learned my addr 172.21.15.134:0/1535513790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f052519a640 1 --2- 172.21.15.134:0/1535513790 >> v2:172.21.15.177:3300/0 conn(0x7f05200cef90 0x7f05200b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f0524999640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05200d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 -- 172.21.15.134:0/1535513790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 msgr2=0x7f05200d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05200d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 -- 172.21.15.134:0/1535513790 >> v2:172.21.15.177:3300/0 conn(0x7f05200cef90 msgr2=0x7f05200b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 --2- 172.21.15.134:0/1535513790 >> v2:172.21.15.177:3300/0 conn(0x7f05200cef90 0x7f05200b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f051ffff640 1 -- 172.21.15.134:0/1535513790 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05200d3660 con 0x7f052015ed20 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.174+0000 7f0524999640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05200d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f051ffff640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05200d15a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0520073e20 tx=0x7f050c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76514ad9cccef2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f051f7fe640 1 -- 172.21.15.134:0/1535513790 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c037070 con 0x7f052015ed20 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f051f7fe640 1 -- 172.21.15.134:0/1535513790 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c032440 con 0x7f052015ed20 2024-09-15T22:44:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f051f7fe640 1 -- 172.21.15.134:0/1535513790 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c032810 con 0x7f052015ed20 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 -- 172.21.15.134:0/1535513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 msgr2=0x7f05200d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05200d15a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0520073e20 tx=0x7f050c02a270 comp rx=0 tx=0).stop 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 -- 172.21.15.134:0/1535513790 shutdown_connections 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1535513790 >> v2:172.21.15.177:3300/0 conn(0x7f05200cef90 0x7f05200b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05200d15a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1535513790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05200d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 -- 172.21.15.134:0/1535513790 >> 172.21.15.134:0/1535513790 conn(0x7f05200b6240 msgr2=0x7f05200b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 -- 172.21.15.134:0/1535513790 shutdown_connections 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.175+0000 7f0526bfd640 1 -- 172.21.15.134:0/1535513790 wait complete. 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.176+0000 7f0526bfd640 1 Processor -- start 2024-09-15T22:44:35.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 -- start start 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05200cef90 0x7f05201e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05201e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05200d3f00 con 0x7f052015ed20 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05200d3c20 con 0x7f05200cef90 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.177+0000 7f0526bfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f05200d1ef0 con 0x7f052015e940 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52210/0 (socket says 172.21.15.134:52210) 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 -- 172.21.15.134:0/1586194430 learned_addr learned my addr 172.21.15.134:0/1586194430 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f051ffff640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05201e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f0524999640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05200cef90 0x7f05201e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 -- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 msgr2=0x7f05201e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05201e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 -- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05200cef90 msgr2=0x7f05201e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05200cef90 0x7f05201e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 -- 172.21.15.134:0/1586194430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05201458e0 con 0x7f052015ed20 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f052519a640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0518007e90 tx=0x7f051800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518014420 con 0x7f052015ed20 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0518019070 con 0x7f052015ed20 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0520145bc0 con 0x7f052015ed20 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518014820 con 0x7f052015ed20 2024-09-15T22:44:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.178+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0520158fa0 con 0x7f052015ed20 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.179+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05200d1060 con 0x7f052015ed20 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.180+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7f05180149c0 con 0x7f052015ed20 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.180+0000 7f051d7fa640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 0x7f050406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.180+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f051808bd70 con 0x7f052015ed20 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.180+0000 7f0524999640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 0x7f050406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.180+0000 7f0524999640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 0x7f050406e950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05200d0050 tx=0x7f0514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.184+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0518059ca0 con 0x7f052015ed20 2024-09-15T22:44:35.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.372+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f0520159260 con 0x7f050406c490 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.374+0000 7f051d7fa640 1 -- 172.21.15.134:0/1586194430 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f0520159260 con 0x7f050406c490 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:35.375 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.375+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 msgr2=0x7f050406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.375+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 0x7f050406e950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05200d0050 tx=0x7f0514008040 comp rx=0 tx=0).stop 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.375+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 msgr2=0x7f05201466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.375+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0518007e90 tx=0x7f051800e4b0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 shutdown_connections 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f050406c490 0x7f050406e950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f052015ed20 0x7f05201466a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052015e940 0x7f05201e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 --2- 172.21.15.134:0/1586194430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05200cef90 0x7f05201e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 >> 172.21.15.134:0/1586194430 conn(0x7f05200b6240 msgr2=0x7f0520160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 shutdown_connections 2024-09-15T22:44:35.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.376+0000 7f0526bfd640 1 -- 172.21.15.134:0/1586194430 wait complete. 2024-09-15T22:44:35.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:44:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.488+0000 7fa5da28c640 1 Processor -- start 2024-09-15T22:44:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.488+0000 7fa5da28c640 1 -- start start 2024-09-15T22:44:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5da28c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40d1360 0x7fa5d40714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5da28c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5d415ef30 0x7fa5d406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5da28c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5d415f480 con 0x7fa5d40b6e60 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5da28c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa5d40731e0 con 0x7fa5d415ef30 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5da28c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d415f760 con 0x7fa5d40d1360 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5d415ef30 0x7fa5d406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5d415ef30 0x7fa5d406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52216/0 (socket says 172.21.15.134:52216) 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 -- 172.21.15.134:0/3926260734 learned_addr learned my addr 172.21.15.134:0/3926260734 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d3fff640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40d1360 0x7fa5d40714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 -- 172.21.15.134:0/3926260734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40d1360 msgr2=0x7fa5d40714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40d1360 0x7fa5d40714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 -- 172.21.15.134:0/3926260734 >> v1:172.21.15.177:6789/0 conn(0x7fa5d40b6e60 legacy=0x7fa5d40b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.489+0000 7fa5d37fe640 1 -- 172.21.15.134:0/3926260734 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d415fa40 con 0x7fa5d415ef30 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.490+0000 7fa5d37fe640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d406ccb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b597daf932f7086 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.490+0000 7fa5d2ffd640 1 -- 172.21.15.134:0/3926260734 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8037070 con 0x7fa5d415ef30 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.490+0000 7fa5d2ffd640 1 -- 172.21.15.134:0/3926260734 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c8032440 con 0x7fa5d415ef30 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.490+0000 7fa5d2ffd640 1 -- 172.21.15.134:0/3926260734 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8032810 con 0x7fa5d415ef30 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 -- 172.21.15.134:0/3926260734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 msgr2=0x7fa5d406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d406ccb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c802a270 comp rx=0 tx=0).stop 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 -- 172.21.15.134:0/3926260734 shutdown_connections 2024-09-15T22:44:35.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d406ccb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 --2- 172.21.15.134:0/3926260734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40d1360 0x7fa5d40714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 -- 172.21.15.134:0/3926260734 >> 172.21.15.134:0/3926260734 conn(0x7fa5d406f370 msgr2=0x7fa5d406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 -- 172.21.15.134:0/3926260734 shutdown_connections 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.491+0000 7fa5da28c640 1 -- 172.21.15.134:0/3926260734 wait complete. 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.492+0000 7fa5da28c640 1 Processor -- start 2024-09-15T22:44:35.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.492+0000 7fa5da28c640 1 -- start start 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40b6e60 0x7fa5d4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d40d1360 0x7fa5d40d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d4071a30 con 0x7fa5d415ef30 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d40d1740 con 0x7fa5d40d1360 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d406d1f0 con 0x7fa5d40b6e60 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52218/0 (socket says 172.21.15.134:52218) 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 -- 172.21.15.134:0/246695001 learned_addr learned my addr 172.21.15.134:0/246695001 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:35.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d3fff640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40b6e60 0x7fa5d4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d37fe640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d40d1360 0x7fa5d40d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 -- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40b6e60 msgr2=0x7fa5d4157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40b6e60 0x7fa5d4157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 -- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d40d1360 msgr2=0x7fa5d40d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d40d1360 0x7fa5d40d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 -- 172.21.15.134:0/246695001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d4159030 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d8829640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c7d0 tx=0x7fa5cc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc003b70 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5cc003d30 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d4159310 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00aa90 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.493+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d4158ab0 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.494+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d4069160 con 0x7fa5d415ef30 2024-09-15T22:44:35.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.495+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fa5cc00ac30 con 0x7fa5d415ef30 2024-09-15T22:44:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.495+0000 7fa5d0ff9640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 0x7fa5c006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.495+0000 7fa5d3fff640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 0x7fa5c006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.495+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fa5cc08b480 con 0x7fa5d415ef30 2024-09-15T22:44:35.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.496+0000 7fa5d3fff640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 0x7fa5c006e920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4006fd0 tx=0x7fa5c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.500+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5cc0593b0 con 0x7fa5d415ef30 2024-09-15T22:44:35.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.665+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa5d40d31e0 con 0x7fa5d415ef30 2024-09-15T22:44:35.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.666+0000 7fa5d0ff9640 1 -- 172.21.15.134:0/246695001 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fa5cc05d6b0 con 0x7fa5d415ef30 2024-09-15T22:44:35.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 msgr2=0x7fa5c006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 0x7fa5c006e920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4006fd0 tx=0x7fa5c4008040 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 msgr2=0x7fa5d40d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c7d0 tx=0x7fa5cc00cc90 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 shutdown_connections 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa5c006c460 0x7fa5c006e920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5d415ef30 0x7fa5d40d0730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d40d1360 0x7fa5d40d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 --2- 172.21.15.134:0/246695001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d40b6e60 0x7fa5d4157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 >> 172.21.15.134:0/246695001 conn(0x7fa5d406f370 msgr2=0x7fa5d406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 shutdown_connections 2024-09-15T22:44:35.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.668+0000 7fa5da28c640 1 -- 172.21.15.134:0/246695001 wait complete. 2024-09-15T22:44:35.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:35.682 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol89960) 2024-09-15T22:44:35.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:35.712 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:44:35.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:35.769 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol89960) 2024-09-15T22:44:35.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol59191 2024-09-15T22:44:35.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.985+0000 7fe9067d8640 1 Processor -- start 2024-09-15T22:44:35.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.985+0000 7fe9067d8640 1 -- start start 2024-09-15T22:44:35.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe9067d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 0x7fe9000aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe9067d8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe9000b57d0 0x7fe9000b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe9067d8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90006dc40 con 0x7fe900072290 2024-09-15T22:44:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe9067d8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe90006e570 con 0x7fe9000b57d0 2024-09-15T22:44:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe9067d8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe90006df20 con 0x7fe900161cc0 2024-09-15T22:44:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe904d75640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe900072290 0x7fe90006ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52678/0 (socket says 172.21.15.134:52678) 2024-09-15T22:44:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe904d75640 1 -- 172.21.15.134:0/2044716620 learned_addr learned my addr 172.21.15.134:0/2044716620 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe8fffff640 1 --2- 172.21.15.134:0/2044716620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 0x7fe9000aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe8ff7fe640 1 --2- 172.21.15.134:0/2044716620 >> v2:172.21.15.177:3300/0 conn(0x7fe9000b57d0 0x7fe9000b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21544991 0 0) 0x7fe90006dc40 con 0x7fe900072290 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.986+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e8003520 con 0x7fe900072290 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.987+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3597674675 0 0) 0x7fe8e8003520 con 0x7fe900072290 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.987+0000 7fe8fffff640 1 -- 172.21.15.134:0/2044716620 >> v2:172.21.15.177:3300/0 conn(0x7fe9000b57d0 msgr2=0x7fe9000b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.987+0000 7fe8fffff640 1 --2- 172.21.15.134:0/2044716620 >> v2:172.21.15.177:3300/0 conn(0x7fe9000b57d0 0x7fe9000b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.987+0000 7fe8fffff640 1 -- 172.21.15.134:0/2044716620 >> v1:172.21.15.134:6789/0 conn(0x7fe900072290 legacy=0x7fe90006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.987+0000 7fe8fffff640 1 -- 172.21.15.134:0/2044716620 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90006e200 con 0x7fe900161cc0 2024-09-15T22:44:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe8fffff640 1 --2- 172.21.15.134:0/2044716620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 0x7fe9000aebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2e22a0970fda14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0037070 con 0x7fe900161cc0 2024-09-15T22:44:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f002aba0 con 0x7fe900161cc0 2024-09-15T22:44:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe8feffd640 1 -- 172.21.15.134:0/2044716620 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80019f0 con 0x7fe900161cc0 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 -- 172.21.15.134:0/2044716620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 msgr2=0x7fe9000aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 --2- 172.21.15.134:0/2044716620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 0x7fe9000aebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002a110 comp rx=0 tx=0).stop 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 -- 172.21.15.134:0/2044716620 shutdown_connections 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 --2- 172.21.15.134:0/2044716620 >> v2:172.21.15.177:3300/0 conn(0x7fe9000b57d0 0x7fe9000b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 --2- 172.21.15.134:0/2044716620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900161cc0 0x7fe9000aebf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 -- 172.21.15.134:0/2044716620 >> 172.21.15.134:0/2044716620 conn(0x7fe90006bba0 msgr2=0x7fe90006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 -- 172.21.15.134:0/2044716620 shutdown_connections 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.988+0000 7fe9067d8640 1 -- 172.21.15.134:0/2044716620 wait complete. 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.990+0000 7fe9067d8640 1 Processor -- start 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.990+0000 7fe9067d8640 1 -- start start 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900072290 0x7fe900156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9000b57d0 0x7fe9000b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000b4be0 con 0x7fe900161cc0 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000b4a60 con 0x7fe9000b57d0 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe90006f110 con 0x7fe900072290 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52230/0 (socket says 172.21.15.134:52230) 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 -- 172.21.15.134:0/399052621 learned_addr learned my addr 172.21.15.134:0/399052621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe8fffff640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900072290 0x7fe900156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe8ff7fe640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9000b57d0 0x7fe9000b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 -- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900072290 msgr2=0x7fe900156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900072290 0x7fe900156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 -- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9000b57d0 msgr2=0x7fe9000b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9000b57d0 0x7fe9000b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 -- 172.21.15.134:0/399052621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9000b0f60 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe904d75640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001b60 tx=0x7fe8f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8017070 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f8012400 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9000b1240 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80127b0 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.991+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9000b1800 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.993+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9000b5c10 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.993+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) ==== 90999+0+0 (secure 0 0 0) 0x7fe8f801a070 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.993+0000 7fe8fcff9640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 0x7fe8ec06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.993+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f808b480 con 0x7fe900161cc0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.993+0000 7fe8fffff640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 0x7fe8ec06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:36.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.994+0000 7fe8fffff640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 0x7fe8ec06e920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0034000 tx=0x7fe8f002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:36.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:35.998+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8f8059460 con 0x7fe900161cc0 2024-09-15T22:44:36.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.189+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol59191", "target": ["mon-mgr", ""]}) -- 0x7fe900154390 con 0x7fe8ec06c460 2024-09-15T22:44:36.195 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:36.193+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:36.195 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:36.193+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:36.195 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:36.193+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:36.196 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:36.193+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:36.196 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:36.193+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:36.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.219+0000 7fe8fcff9640 1 -- 172.21.15.134:0/399052621 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8f0038040 con 0x7fe8ec06c460 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 msgr2=0x7fe8ec06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 0x7fe8ec06e920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0034000 tx=0x7fe8f002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 msgr2=0x7fe900153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001b60 tx=0x7fe8f800a430 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 shutdown_connections 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fe8ec06c460 0x7fe8ec06e920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe900161cc0 0x7fe900153b00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9000b57d0 0x7fe9000b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 --2- 172.21.15.134:0/399052621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe900072290 0x7fe900156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 >> 172.21.15.134:0/399052621 conn(0x7fe90006bba0 msgr2=0x7fe9000b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:36.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 shutdown_connections 2024-09-15T22:44:36.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:36.221+0000 7fe9067d8640 1 -- 172.21.15.134:0/399052621 wait complete. 2024-09-15T22:44:36.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:36.235 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol59191/.meta ./volumes/_nogroup/subvol89960) 2024-09-15T22:44:37.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol89960 2024-09-15T22:44:38.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.009+0000 7f0cd2f96640 1 Processor -- start 2024-09-15T22:44:38.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.009+0000 7f0cd2f96640 1 -- start start 2024-09-15T22:44:38.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd2f96640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0ccc0ae8e0 0x7f0ccc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd2f96640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ccc148400 con 0x7f0ccc148020 2024-09-15T22:44:38.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd2f96640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ccc0b53e0 con 0x7f0ccc0b0b30 2024-09-15T22:44:38.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd2f96640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0ccc0b5ff0 con 0x7f0ccc0ae8e0 2024-09-15T22:44:38.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd0d32640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0ccc148020 0x7f0ccc0b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37296/0 (socket says 172.21.15.134:37296) 2024-09-15T22:44:38.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd0d32640 1 -- 172.21.15.134:0/2157844240 learned_addr learned my addr 172.21.15.134:0/2157844240 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:38.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616716312 0 0) 0x7f0ccc148400 con 0x7f0ccc148020 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cb8003520 con 0x7f0ccc148020 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.010+0000 7f0cd1533640 1 --2- 172.21.15.134:0/2157844240 >> v2:172.21.15.177:3300/0 conn(0x7f0ccc0ae8e0 0x7f0ccc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3033193294 0 0) 0x7f0cb8003520 con 0x7f0ccc148020 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 >> v2:172.21.15.177:3300/0 conn(0x7f0ccc0ae8e0 msgr2=0x7f0ccc0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 --2- 172.21.15.134:0/2157844240 >> v2:172.21.15.177:3300/0 conn(0x7f0ccc0ae8e0 0x7f0ccc0aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 >> v1:172.21.15.177:6789/0 conn(0x7f0ccc0b0b30 legacy=0x7f0ccc0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc0b56c0 con 0x7f0ccc148020 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0cc40019f0 con 0x7f0ccc148020 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 >> v1:172.21.15.134:6789/0 conn(0x7f0ccc148020 legacy=0x7f0ccc0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb80039b0 0x7f0cb8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 0x7f0cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cb80051c0 0x7f0cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0b5ff0 con 0x7f0cb8004800 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb800c090 con 0x7f0cb80039b0 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb800c290 con 0x7f0cb80051c0 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 0x7f0cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0cd0d32640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb80039b0 0x7f0cb8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0cd1533640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cb80051c0 0x7f0cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 -- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cb80051c0 msgr2=0x7f0cb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cb80051c0 0x7f0cb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 -- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb80039b0 msgr2=0x7f0cb8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb80039b0 0x7f0cb8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0ccbfff640 1 -- 172.21.15.134:0/2157844240 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb8003520 con 0x7f0cb8004800 2024-09-15T22:44:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.011+0000 7f0cd1533640 1 -- 172.21.15.134:0/2157844240 reap_dead start 2024-09-15T22:44:38.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.012+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 0x7f0cb8004c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001750 tx=0x7f0cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f49d6e4545073e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.012+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc001370 con 0x7f0cb8004800 2024-09-15T22:44:38.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.012+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0052d0 con 0x7f0cb8004800 2024-09-15T22:44:38.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.012+0000 7f0ccb7fe640 1 -- 172.21.15.134:0/2157844240 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc02abc0 con 0x7f0cb8004800 2024-09-15T22:44:38.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 -- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 msgr2=0x7f0cb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 0x7f0cb8004c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001750 tx=0x7f0cb8005830 comp rx=0 tx=0).stop 2024-09-15T22:44:38.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 -- 172.21.15.134:0/2157844240 shutdown_connections 2024-09-15T22:44:38.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/2157844240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8004800 0x7f0cb8004c80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 -- 172.21.15.134:0/2157844240 >> 172.21.15.134:0/2157844240 conn(0x7f0ccc06d0d0 msgr2=0x7f0ccc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 -- 172.21.15.134:0/2157844240 shutdown_connections 2024-09-15T22:44:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.013+0000 7f0cd2f96640 1 -- 172.21.15.134:0/2157844240 wait complete. 2024-09-15T22:44:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.014+0000 7f0cd2f96640 1 Processor -- start 2024-09-15T22:44:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.014+0000 7f0cd2f96640 1 -- start start 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb8004800 0x7f0ccc160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ccc1442d0 0x7f0ccc15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0aed10 con 0x7f0ccc15ef40 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0b5c80 con 0x7f0cb8004800 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd2f96640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc0aee90 con 0x7f0ccc1442d0 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33978/0 (socket says 172.21.15.134:33978) 2024-09-15T22:44:38.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 -- 172.21.15.134:0/1408412949 learned_addr learned my addr 172.21.15.134:0/1408412949 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd0d32640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb8004800 0x7f0ccc160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0cd1533640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ccc1442d0 0x7f0ccc15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 -- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ccc1442d0 msgr2=0x7f0ccc15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ccc1442d0 0x7f0ccc15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 -- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb8004800 msgr2=0x7f0ccc160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb8004800 0x7f0ccc160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 -- 172.21.15.134:0/1408412949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc1609b0 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.015+0000 7f0ccbfff640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001870 tx=0x7f0cbc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.016+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc03f030 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.016+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc005480 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.016+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc037040 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.016+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ccc15f3d0 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.016+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ccc15fc70 con 0x7f0ccc15ef40 2024-09-15T22:44:38.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.017+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ccc0b3f50 con 0x7f0ccc15ef40 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.017+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7f0cbc042070 con 0x7f0ccc15ef40 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.018+0000 7f0cc97fa640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 0x7f0cac06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.018+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f0cbc0ab110 con 0x7f0ccc15ef40 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.018+0000 7f0cd0d32640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 0x7f0cac06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.018+0000 7f0cd0d32640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 0x7f0cac06e9b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40013d0 tx=0x7f0cc4006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.022+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cbc079520 con 0x7f0ccc15ef40 2024-09-15T22:44:38.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.213+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol89960", "target": ["mon-mgr", ""]}) -- 0x7f0ccc15f7d0 con 0x7f0cac06c4f0 2024-09-15T22:44:38.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.238+0000 7f0cc97fa640 1 -- 172.21.15.134:0/1408412949 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f0cc40018f0 con 0x7f0cac06c4f0 2024-09-15T22:44:38.239 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol89960 2024-09-15T22:44:38.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 msgr2=0x7f0cac06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 0x7f0cac06e9b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40013d0 tx=0x7f0cc4006040 comp rx=0 tx=0).stop 2024-09-15T22:44:38.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 msgr2=0x7f0ccc1439a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001870 tx=0x7f0cbc001120 comp rx=0 tx=0).stop 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 shutdown_connections 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cac06c4f0 0x7f0cac06e9b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ccc1442d0 0x7f0ccc15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ccc15ef40 0x7f0ccc1439a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 --2- 172.21.15.134:0/1408412949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cb8004800 0x7f0ccc160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 >> 172.21.15.134:0/1408412949 conn(0x7f0ccc06d0d0 msgr2=0x7f0ccc06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:38.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 shutdown_connections 2024-09-15T22:44:38.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.240+0000 7f0cd2f96640 1 -- 172.21.15.134:0/1408412949 wait complete. 2024-09-15T22:44:38.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol89960 2024-09-15T22:44:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.353+0000 7fab7f5b7640 1 Processor -- start 2024-09-15T22:44:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.353+0000 7fab7f5b7640 1 -- start start 2024-09-15T22:44:38.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7f5b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab7806f130 0x7fab780b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7f5b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab780ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7f5b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7815c820 con 0x7fab78158e50 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7f5b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fab780b43f0 con 0x7fab7806f130 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7f5b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab780b3630 con 0x7fab7815c370 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7d353640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fab78158e50 0x7fab7806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37312/0 (socket says 172.21.15.134:37312) 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7d353640 1 -- 172.21.15.134:0/3750276653 learned_addr learned my addr 172.21.15.134:0/3750276653 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7db54640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab780ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3750276653 >> v2:172.21.15.177:3300/0 conn(0x7fab7806f130 0x7fab780b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858422522 0 0) 0x7fab74001110 con 0x7fab78158e50 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab64003520 con 0x7fab78158e50 2024-09-15T22:44:38.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710250900 0 0) 0x7fab64003520 con 0x7fab78158e50 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 msgr2=0x7fab780ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab780ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 >> v2:172.21.15.177:3300/0 conn(0x7fab7806f130 msgr2=0x7fab780b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 --2- 172.21.15.134:0/3750276653 >> v2:172.21.15.177:3300/0 conn(0x7fab7806f130 0x7fab780b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab780b3910 con 0x7fab78158e50 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fab74001840 con 0x7fab78158e50 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3750276653 >> v2:172.21.15.177:3300/0 conn(0x7fab7806f130 0x7fab780b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 >> v1:172.21.15.134:6789/0 conn(0x7fab78158e50 legacy=0x7fab7806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab640039b0 0x7fab64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.354+0000 7fab6ffff640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab6ffff640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab64004d40 0x7fab640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab780b43f0 con 0x7fab64004d40 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab780b3630 con 0x7fab640039b0 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab6400b9c0 con 0x7fab7815c370 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab64004d40 0x7fab640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7d353640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab640039b0 0x7fab64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 -- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 msgr2=0x7fab64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 -- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab640039b0 msgr2=0x7fab64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab640039b0 0x7fab64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7db54640 1 -- 172.21.15.134:0/3750276653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab64003520 con 0x7fab64004d40 2024-09-15T22:44:38.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.355+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab7815c370 0x7fab64004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7db54640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab64004d40 0x7fab640051c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fab70009fc0 tx=0x7fab64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e0cd69b21c19e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70009c10 con 0x7fab64004d40 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70036070 con 0x7fab64004d40 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab6ffff640 1 -- 172.21.15.134:0/3750276653 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70031880 con 0x7fab64004d40 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3750276653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab64004d40 msgr2=0x7fab640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3750276653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab64004d40 0x7fab640051c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fab70009fc0 tx=0x7fab64005830 comp rx=0 tx=0).stop 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7db54640 1 -- 172.21.15.134:0/3750276653 reap_dead start 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3750276653 shutdown_connections 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3750276653 >> 172.21.15.134:0/3750276653 conn(0x7fab7806bba0 msgr2=0x7fab7806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3750276653 shutdown_connections 2024-09-15T22:44:38.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.356+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3750276653 wait complete. 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 Processor -- start 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 -- start start 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 0x7fab78151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 0x7fab7815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab78159230 con 0x7fab780acc00 2024-09-15T22:44:38.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab780b3ed0 con 0x7fab7815e120 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7f5b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab780ce200 con 0x7fab64004d40 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7cb52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7cb52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33984/0 (socket says 172.21.15.134:33984) 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.358+0000 7fab7cb52640 1 -- 172.21.15.134:0/3480836213 learned_addr learned my addr 172.21.15.134:0/3480836213 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7db54640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 0x7fab7815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7d353640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 0x7fab78151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 -- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 msgr2=0x7fab78151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 0x7fab78151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 -- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 msgr2=0x7fab7815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 0x7fab7815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 -- 172.21.15.134:0/3480836213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab780ab110 con 0x7fab780acc00 2024-09-15T22:44:38.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7d353640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 0x7fab78151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7db54640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 0x7fab7815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7cb52640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fab680118d0 tx=0x7fab68011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6800fb70 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6800fd10 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab780ab3f0 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68015660 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.359+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab78154b20 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.360+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab780b0640 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.361+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7fab68015800 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.361+0000 7fab6dffb640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 0x7fab5c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.361+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fab6808c300 con 0x7fab780acc00 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.361+0000 7fab7d353640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 0x7fab5c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:38.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.362+0000 7fab7d353640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 0x7fab5c06e9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab740016c0 tx=0x7fab74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:38.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.365+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab68019030 con 0x7fab780acc00 2024-09-15T22:44:38.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.555+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol89960", "target": ["mon-mgr", ""]}) -- 0x7fab780b0360 con 0x7fab5c06c520 2024-09-15T22:44:38.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.559+0000 7fab6dffb640 1 -- 172.21.15.134:0/3480836213 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7fab780b0360 con 0x7fab5c06c520 2024-09-15T22:44:38.560 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol89960 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 msgr2=0x7fab5c06e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 0x7fab5c06e9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab740016c0 tx=0x7fab74009040 comp rx=0 tx=0).stop 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 msgr2=0x7fab780af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fab680118d0 tx=0x7fab68011d90 comp rx=0 tx=0).stop 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 shutdown_connections 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fab5c06c520 0x7fab5c06e9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7815e120 0x7fab7815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab780acc00 0x7fab780af710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 --2- 172.21.15.134:0/3480836213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab64004d40 0x7fab78151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:38.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 >> 172.21.15.134:0/3480836213 conn(0x7fab7806bba0 msgr2=0x7fab780ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:38.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 shutdown_connections 2024-09-15T22:44:38.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:38.561+0000 7fab7f5b7640 1 -- 172.21.15.134:0/3480836213 wait complete. 2024-09-15T22:44:38.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:38.573 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/3ef2ad27df3ec0c180865a58df60de51.meta) 2024-09-15T22:44:42.890 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:44:42.890 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:44:42.890 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:44:42.890 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol89960 2024-09-15T22:44:42.890 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:44:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:42.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol89960 alice 2024-09-15T22:44:43.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.006+0000 7ff4bf6dd640 1 Processor -- start 2024-09-15T22:44:43.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.006+0000 7ff4bf6dd640 1 -- start start 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bf6dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b806bba0 0x7ff4b806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bf6dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4b815ed20 0x7ff4b815f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bf6dd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b806c500 con 0x7ff4b8148100 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bf6dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b80b58a0 con 0x7ff4b815ed20 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bf6dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b806f270 con 0x7ff4b806bba0 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bdc7a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4b815ed20 0x7ff4b815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bdc7a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4b815ed20 0x7ff4b815f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34000/0 (socket says 172.21.15.134:34000) 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bdc7a640 1 -- 172.21.15.134:0/1486437203 learned_addr learned my addr 172.21.15.134:0/1486437203 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.007+0000 7ff4bcc78640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b806bba0 0x7ff4b806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4bdc7a640 1 -- 172.21.15.134:0/1486437203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b806bba0 msgr2=0x7ff4b806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4bdc7a640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b806bba0 0x7ff4b806bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4bdc7a640 1 -- 172.21.15.134:0/1486437203 >> v1:172.21.15.177:6789/0 conn(0x7ff4b8148100 legacy=0x7ff4b806eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4bdc7a640 1 -- 172.21.15.134:0/1486437203 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b80b4800 con 0x7ff4b815ed20 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4bdc7a640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b815ed20 0x7ff4b815f170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009e50 tx=0x7ff4b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3b181c706c4fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.008+0000 7ff4affff640 1 -- 172.21.15.134:0/1486437203 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0036070 con 0x7ff4b815ed20 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4affff640 1 -- 172.21.15.134:0/1486437203 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b0031600 con 0x7ff4b815ed20 2024-09-15T22:44:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4affff640 1 -- 172.21.15.134:0/1486437203 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00319d0 con 0x7ff4b815ed20 2024-09-15T22:44:43.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/1486437203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b815ed20 msgr2=0x7ff4b815f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b815ed20 0x7ff4b815f170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009e50 tx=0x7ff4b002a710 comp rx=0 tx=0).stop 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/1486437203 shutdown_connections 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b815ed20 0x7ff4b815f170 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/1486437203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b806bba0 0x7ff4b806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/1486437203 >> 172.21.15.134:0/1486437203 conn(0x7ff4b8062810 msgr2=0x7ff4b806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/1486437203 shutdown_connections 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.009+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/1486437203 wait complete. 2024-09-15T22:44:43.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.010+0000 7ff4bf6dd640 1 Processor -- start 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.010+0000 7ff4bf6dd640 1 -- start start 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4b806bba0 0x7ff4b8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b815ed20 0x7ff4b813bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b80b4dc0 con 0x7ff4b8148100 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b81484e0 con 0x7ff4b806bba0 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bf6dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b80b50a0 con 0x7ff4b815ed20 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bcc78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bcc78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34010/0 (socket says 172.21.15.134:34010) 2024-09-15T22:44:43.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.011+0000 7ff4bcc78640 1 -- 172.21.15.134:0/920589837 learned_addr learned my addr 172.21.15.134:0/920589837 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 -- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b815ed20 msgr2=0x7ff4b813bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b815ed20 0x7ff4b813bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 -- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4b806bba0 msgr2=0x7ff4b8157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4b806bba0 0x7ff4b8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 -- 172.21.15.134:0/920589837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b813ad80 con 0x7ff4b8148100 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bcc78640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d800 tx=0x7ff4a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800b6c0 con 0x7ff4b8148100 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a8019070 con 0x7ff4b8148100 2024-09-15T22:44:43.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b813b060 con 0x7ff4b8148100 2024-09-15T22:44:43.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800ba80 con 0x7ff4b8148100 2024-09-15T22:44:43.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.012+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b813c350 con 0x7ff4b8148100 2024-09-15T22:44:43.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.013+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b80b5380 con 0x7ff4b8148100 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.014+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7ff4a800bc20 con 0x7ff4b8148100 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.014+0000 7ff4adffb640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 0x7ff49c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.014+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff4a808bcf0 con 0x7ff4b8148100 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.014+0000 7ff4bd479640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 0x7ff49c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.015+0000 7ff4bd479640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 0x7ff49c06e9b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f60 tx=0x7ff4b40079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.019+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4a8090070 con 0x7ff4b8148100 2024-09-15T22:44:43.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.210+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol89960", "auth_id": "alice", "target": ["mon-mgr", ""]}) -- 0x7ff4b80b41b0 con 0x7ff49c06c4f0 2024-09-15T22:44:43.218 INFO:tasks.ceph.mgr.y.smithi134.stderr:Creating meta for ID alice with tenant None 2024-09-15T22:44:43.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.243+0000 7ff4adffb640 1 -- 172.21.15.134:0/920589837 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4b80b41b0 con 0x7ff49c06c4f0 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 msgr2=0x7ff49c06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 0x7ff49c06e9b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f60 tx=0x7ff4b40079d0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 msgr2=0x7ff4b813b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d800 tx=0x7ff4a800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 shutdown_connections 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff49c06c4f0 0x7ff49c06e9b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4b815ed20 0x7ff4b813bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4b8148100 0x7ff4b813b6d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 --2- 172.21.15.134:0/920589837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4b806bba0 0x7ff4b8157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 >> 172.21.15.134:0/920589837 conn(0x7ff4b8062810 msgr2=0x7ff4b80cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 shutdown_connections 2024-09-15T22:44:43.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.245+0000 7ff4bf6dd640 1 -- 172.21.15.134:0/920589837 wait complete. 2024-09-15T22:44:43.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-15T22:44:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.356+0000 7f091830a640 1 Processor -- start 2024-09-15T22:44:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.356+0000 7f091830a640 1 -- start start 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f091830a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09100d02a0 0x7f09100d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f091830a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f091015ca40 0x7f091015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f091830a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09100d0bc0 con 0x7f091015ce80 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f091830a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f091015d390 con 0x7f091015ca40 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f091830a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f091015d670 con 0x7f09100d02a0 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f091015ca40 0x7f091015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f091015ca40 0x7f091015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34024/0 (socket says 172.21.15.134:34024) 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 -- 172.21.15.134:0/1651552805 learned_addr learned my addr 172.21.15.134:0/1651552805 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09160a6640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09100d02a0 0x7f09100d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 -- 172.21.15.134:0/1651552805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09100d02a0 msgr2=0x7f09100d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:43.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09100d02a0 0x7f09100d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.357+0000 7f09158a5640 1 -- 172.21.15.134:0/1651552805 >> v1:172.21.15.177:6789/0 conn(0x7f091015ce80 legacy=0x7f09101594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:43.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.358+0000 7f09158a5640 1 -- 172.21.15.134:0/1651552805 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091015d950 con 0x7f091015ca40 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.358+0000 7f09158a5640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ca40 0x7f091015e430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0904009870 tx=0x7f090402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196f2cfe3e2998cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.358+0000 7f09150a4640 1 -- 172.21.15.134:0/1651552805 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904037070 con 0x7f091015ca40 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.358+0000 7f09150a4640 1 -- 172.21.15.134:0/1651552805 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904032440 con 0x7f091015ca40 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.358+0000 7f09150a4640 1 -- 172.21.15.134:0/1651552805 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904032810 con 0x7f091015ca40 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 -- 172.21.15.134:0/1651552805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ca40 msgr2=0x7f091015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ca40 0x7f091015e430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0904009870 tx=0x7f090402a180 comp rx=0 tx=0).stop 2024-09-15T22:44:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 -- 172.21.15.134:0/1651552805 shutdown_connections 2024-09-15T22:44:43.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ca40 0x7f091015e430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 --2- 172.21.15.134:0/1651552805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09100d02a0 0x7f09100d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 -- 172.21.15.134:0/1651552805 >> 172.21.15.134:0/1651552805 conn(0x7f0910062cc0 msgr2=0x7f091006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 -- 172.21.15.134:0/1651552805 shutdown_connections 2024-09-15T22:44:43.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.359+0000 7f091830a640 1 -- 172.21.15.134:0/1651552805 wait complete. 2024-09-15T22:44:43.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.360+0000 7f091830a640 1 Processor -- start 2024-09-15T22:44:43.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.360+0000 7f091830a640 1 -- start start 2024-09-15T22:44:43.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09100d02a0 0x7f09101f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f091015ca40 0x7f09101594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0910155b90 con 0x7f091015ce80 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f091015df10 con 0x7f09100d02a0 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f091830a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0910155d10 con 0x7f091015ca40 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34028/0 (socket says 172.21.15.134:34028) 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 -- 172.21.15.134:0/3839878289 learned_addr learned my addr 172.21.15.134:0/3839878289 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09160a6640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09100d02a0 0x7f09101f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09158a5640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f091015ca40 0x7f09101594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 -- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f091015ca40 msgr2=0x7f09101594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f091015ca40 0x7f09101594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 -- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09100d02a0 msgr2=0x7f09101f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09100d02a0 0x7f09101f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 -- 172.21.15.134:0/3839878289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09101f1fc0 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.361+0000 7f09168a7640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f090000c780 tx=0x7f090000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.362+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900004b60 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.362+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900004d00 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.362+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0910159e60 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.362+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000aa90 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.362+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091015a420 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.363+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09100b4790 con 0x7f091015ce80 2024-09-15T22:44:43.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.363+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7f090000ac30 con 0x7f091015ce80 2024-09-15T22:44:43.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.364+0000 7f090effd640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 0x7f08fc06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.364+0000 7f09160a6640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 0x7f08fc06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.364+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f090008bcb0 con 0x7f091015ce80 2024-09-15T22:44:43.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.364+0000 7f09160a6640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 0x7f08fc06e9b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f09080079a0 tx=0x7f0908008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.368+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0900059a70 con 0x7f091015ce80 2024-09-15T22:44:43.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.596+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) -- 0x7f09100cc530 con 0x7f091015ce80 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.596+0000 7f090effd640 1 -- 172.21.15.134:0/3839878289 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v14) ==== 107+0+280 (secure 0 0 0) 0x7f090005dd70 con 0x7f091015ce80 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.alice", 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBbY+dmLqGXDRAAWJsQ8nyZJINeoIwNxDxX2A==", 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol89960", 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:44:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-15T22:44:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:43.599 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 msgr2=0x7f08fc06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 0x7f08fc06e9b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f09080079a0 tx=0x7f0908008040 comp rx=0 tx=0).stop 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 msgr2=0x7f09101f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f090000c780 tx=0x7f090000cc40 comp rx=0 tx=0).stop 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 shutdown_connections 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f08fc06c4f0 0x7f08fc06e9b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f091015ce80 0x7f09101f5de0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f091015ca40 0x7f09101594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 --2- 172.21.15.134:0/3839878289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09100d02a0 0x7f09101f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.598+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 >> 172.21.15.134:0/3839878289 conn(0x7f0910062cc0 msgr2=0x7f0910154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.599+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 shutdown_connections 2024-09-15T22:44:43.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.599+0000 7f091830a640 1 -- 172.21.15.134:0/3839878289 wait complete. 2024-09-15T22:44:43.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol89960 2024-09-15T22:44:43.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.712+0000 7ff944edd640 1 Processor -- start 2024-09-15T22:44:43.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.712+0000 7ff944edd640 1 -- start start 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff944edd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff94006f130 0x7ff9400b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff944edd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff94015c370 0x7ff9400ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff944edd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94015c820 con 0x7ff940158e50 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff944edd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff9400b43f0 con 0x7ff94006f130 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff944edd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9400b3630 con 0x7ff94015c370 2024-09-15T22:44:43.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93e59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff940158e50 0x7ff94006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37320/0 (socket says 172.21.15.134:37320) 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93e59c640 1 -- 172.21.15.134:0/2088774521 learned_addr learned my addr 172.21.15.134:0/2088774521 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff935d9b640 1 --2- 172.21.15.134:0/2088774521 >> v2:172.21.15.177:3300/0 conn(0x7ff94006f130 0x7ff9400b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93ed9d640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff94015c370 0x7ff9400ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412391290 0 0) 0x7ff930001110 con 0x7ff940158e50 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff92c003520 con 0x7ff940158e50 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff935d9b640 1 -- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff94015c370 msgr2=0x7ff9400ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff935d9b640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff94015c370 0x7ff9400ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff935d9b640 1 -- 172.21.15.134:0/2088774521 >> v1:172.21.15.134:6789/0 conn(0x7ff940158e50 legacy=0x7ff94006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 29917898 0 0) 0x7ff92c003520 con 0x7ff940158e50 2024-09-15T22:44:43.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.713+0000 7ff935d9b640 1 -- 172.21.15.134:0/2088774521 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9400b3910 con 0x7ff94006f130 2024-09-15T22:44:43.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.714+0000 7ff935d9b640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff9400b5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff928009790 tx=0x7ff92802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf383d6b0de9341 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.714+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928037070 con 0x7ff94006f130 2024-09-15T22:44:43.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.714+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92802ab90 con 0x7ff94006f130 2024-09-15T22:44:43.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.714+0000 7ff93dd9b640 1 -- 172.21.15.134:0/2088774521 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930001840 con 0x7ff94006f130 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 -- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 msgr2=0x7ff9400b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff9400b5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff928009790 tx=0x7ff92802a100 comp rx=0 tx=0).stop 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 -- 172.21.15.134:0/2088774521 shutdown_connections 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff94015c370 0x7ff9400ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 --2- 172.21.15.134:0/2088774521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff9400b5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 -- 172.21.15.134:0/2088774521 >> 172.21.15.134:0/2088774521 conn(0x7ff94006bba0 msgr2=0x7ff94006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 -- 172.21.15.134:0/2088774521 shutdown_connections 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.715+0000 7ff944edd640 1 -- 172.21.15.134:0/2088774521 wait complete. 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.716+0000 7ff944edd640 1 Processor -- start 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.716+0000 7ff944edd640 1 -- start start 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff940147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff940158e50 0x7ff9400cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff940159230 con 0x7ff94015c370 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9400b3ed0 con 0x7ff94006f130 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff944edd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9400ce740 con 0x7ff940158e50 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34032/0 (socket says 172.21.15.134:34032) 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 -- 172.21.15.134:0/2956930326 learned_addr learned my addr 172.21.15.134:0/2956930326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff935d9b640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff940158e50 0x7ff9400cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93e59c640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff940147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 -- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff940158e50 msgr2=0x7ff9400cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff940158e50 0x7ff9400cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 -- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 msgr2=0x7ff940147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff940147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.717+0000 7ff93ed9d640 1 -- 172.21.15.134:0/2956930326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94014a650 con 0x7ff94015c370 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff93ed9d640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff93800efc0 tx=0x7ff93800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938018020 con 0x7ff94015c370 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff938014480 con 0x7ff94015c370 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94014a930 con 0x7ff94015c370 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938014870 con 0x7ff94015c370 2024-09-15T22:44:43.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.718+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94014aef0 con 0x7ff94015c370 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.719+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9400ce200 con 0x7ff94015c370 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.719+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7ff938005d10 con 0x7ff94015c370 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.720+0000 7ff9377fe640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 0x7ff92006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.720+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff93808c430 con 0x7ff94015c370 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.720+0000 7ff93e59c640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 0x7ff92006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:43.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.720+0000 7ff93e59c640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 0x7ff92006e9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff930005880 tx=0x7ff930009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:43.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.724+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff938022070 con 0x7ff94015c370 2024-09-15T22:44:43.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.912+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol89960", "target": ["mon-mgr", ""]}) -- 0x7ff9400cfb10 con 0x7ff92006c4f0 2024-09-15T22:44:43.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.923+0000 7ff9377fe640 1 -- 172.21.15.134:0/2956930326 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff9400cfb10 con 0x7ff92006c4f0 2024-09-15T22:44:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 msgr2=0x7ff92006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 0x7ff92006e9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff930005880 tx=0x7ff930009040 comp rx=0 tx=0).stop 2024-09-15T22:44:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 msgr2=0x7ff9400cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff93800efc0 tx=0x7ff93800c490 comp rx=0 tx=0).stop 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 shutdown_connections 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff92006c4f0 0x7ff92006e9b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff94015c370 0x7ff9400cefd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff940158e50 0x7ff9400cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 --2- 172.21.15.134:0/2956930326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff94006f130 0x7ff940147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 >> 172.21.15.134:0/2956930326 conn(0x7ff94006bba0 msgr2=0x7ff9400711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 shutdown_connections 2024-09-15T22:44:43.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:43.926+0000 7ff944edd640 1 -- 172.21.15.134:0/2956930326 wait complete. 2024-09-15T22:44:43.928 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.926+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.929 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.926+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.929 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.926+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.929 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.926+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.929 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.926+0000 7fac2baaf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol59191 2024-09-15T22:44:43.943 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.941+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.943 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.941+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.943 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.941+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.943 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.941+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:43.943 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:44:43.941+0000 7fac2cab1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:44:44.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.043+0000 7fa9523e4640 1 Processor -- start 2024-09-15T22:44:44.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.043+0000 7fa9523e4640 1 -- start start 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa9523e4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa94c158e50 0x7fa94c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa9523e4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa94c15c800 con 0x7fa94c06f130 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa9523e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa94c0b43f0 con 0x7fa94c15c370 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa9523e4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa94c0b3630 con 0x7fa94c158e50 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa950981640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa94c06f130 0x7fa94c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37332/0 (socket says 172.21.15.134:37332) 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa950981640 1 -- 172.21.15.134:0/1004559546 learned_addr learned my addr 172.21.15.134:0/1004559546 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94bfff640 1 --2- 172.21.15.134:0/1004559546 >> v2:172.21.15.177:3300/0 conn(0x7fa94c158e50 0x7fa94c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475486752 0 0) 0x7fa94c15c800 con 0x7fa94c06f130 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa934003520 con 0x7fa94c06f130 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2087423061 0 0) 0x7fa934003520 con 0x7fa94c06f130 2024-09-15T22:44:44.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 >> v2:172.21.15.177:3300/0 conn(0x7fa94c158e50 msgr2=0x7fa94c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 --2- 172.21.15.134:0/1004559546 >> v2:172.21.15.177:3300/0 conn(0x7fa94c158e50 0x7fa94c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 >> v1:172.21.15.177:6789/0 conn(0x7fa94c15c370 legacy=0x7fa94c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c0b3910 con 0x7fa94c06f130 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa944001a10 con 0x7fa94c06f130 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 >> v1:172.21.15.134:6789/0 conn(0x7fa94c06f130 legacy=0x7fa94c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.044+0000 7fa94affd640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9340039b0 0x7fa934003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94affd640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 0x7fa934004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94affd640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa934005120 0x7fa93400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c0b3630 con 0x7fa9340043b0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa93400e270 con 0x7fa9340039b0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa93400e470 con 0x7fa934005120 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 0x7fa934004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94bfff640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9340039b0 0x7fa934003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa950981640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa934005120 0x7fa93400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 -- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa934005120 msgr2=0x7fa93400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa934005120 0x7fa93400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 -- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9340039b0 msgr2=0x7fa934003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9340039b0 0x7fa934003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa94b7fe640 1 -- 172.21.15.134:0/1004559546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa934003520 con 0x7fa9340043b0 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.045+0000 7fa950981640 1 -- 172.21.15.134:0/1004559546 reap_dead start 2024-09-15T22:44:44.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa94b7fe640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 0x7fa934004880 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa9400018b0 tx=0x7fa934005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6260994fde8bbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940037070 con 0x7fa9340043b0 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94002abf0 con 0x7fa9340043b0 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa94affd640 1 -- 172.21.15.134:0/1004559546 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940001480 con 0x7fa9340043b0 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 -- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 msgr2=0x7fa934004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 0x7fa934004880 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa9400018b0 tx=0x7fa934005830 comp rx=0 tx=0).stop 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 -- 172.21.15.134:0/1004559546 shutdown_connections 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 --2- 172.21.15.134:0/1004559546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9340043b0 0x7fa934004880 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 -- 172.21.15.134:0/1004559546 >> 172.21.15.134:0/1004559546 conn(0x7fa94c06bba0 msgr2=0x7fa94c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 -- 172.21.15.134:0/1004559546 shutdown_connections 2024-09-15T22:44:44.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.046+0000 7fa9523e4640 1 -- 172.21.15.134:0/1004559546 wait complete. 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.047+0000 7fa9523e4640 1 Processor -- start 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 -- start start 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 0x7fa94c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa94c15a5f0 0x7fa94c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c159230 con 0x7fa94c15dc40 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c0b3ed0 con 0x7fa94c15a5f0 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa9523e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa94c0b5050 con 0x7fa9340043b0 2024-09-15T22:44:44.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.048+0000 7fa950981640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34074/0 (socket says 172.21.15.134:34074) 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 -- 172.21.15.134:0/4049712577 learned_addr learned my addr 172.21.15.134:0/4049712577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa94b7fe640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa94c15a5f0 0x7fa94c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa94bfff640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 0x7fa94c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 -- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 msgr2=0x7fa94c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 0x7fa94c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 -- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa94c15a5f0 msgr2=0x7fa94c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa94c15a5f0 0x7fa94c15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 -- 172.21.15.134:0/4049712577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c159550 con 0x7fa94c15dc40 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa94bfff640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 0x7fa94c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa950981640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa944000f80 tx=0x7fa944007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400ab30 con 0x7fa94c15dc40 2024-09-15T22:44:44.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa944019070 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c159830 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440133f0 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.049+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c159df0 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.050+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c0b5380 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.051+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7fa944013590 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.051+0000 7fa948ff9640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 0x7fa93806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.051+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fa94408bc70 con 0x7fa94c15dc40 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.051+0000 7fa94bfff640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 0x7fa93806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.052+0000 7fa94bfff640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 0x7fa93806e9e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bc0 tx=0x7fa93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.055+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa94405a080 con 0x7fa94c15dc40 2024-09-15T22:44:44.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.249+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol59191", "target": ["mon-mgr", ""]}) -- 0x7fa94c15fd40 con 0x7fa93806c520 2024-09-15T22:44:44.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.261+0000 7fa948ff9640 1 -- 172.21.15.134:0/4049712577 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa94c15fd40 con 0x7fa93806c520 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 msgr2=0x7fa93806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 0x7fa93806e9e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bc0 tx=0x7fa93c008040 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 msgr2=0x7fa94c14f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa944000f80 tx=0x7fa944007b00 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 shutdown_connections 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa93806c520 0x7fa93806e9e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c15dc40 0x7fa94c14f000 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa94c15a5f0 0x7fa94c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 --2- 172.21.15.134:0/4049712577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9340043b0 0x7fa94c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 >> 172.21.15.134:0/4049712577 conn(0x7fa94c06bba0 msgr2=0x7fa94c155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 shutdown_connections 2024-09-15T22:44:44.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.263+0000 7fa9523e4640 1 -- 172.21.15.134:0/4049712577 wait complete. 2024-09-15T22:44:44.279 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:44:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:44:44.331 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:44:44.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:44:44.337 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:44:44.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:44.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:44.437 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:44:44.437 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:44.437 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:44.437 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:44.453 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:44.453 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:44.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:44:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 Processor -- start 2024-09-15T22:44:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 -- start start 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 0x7ff29c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff29c0b6d50 0x7ff29c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c1600e0 0x7ff29c160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff29c074100 con 0x7ff29c0b6d50 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff29c0b76d0 con 0x7ff29c15c5e0 2024-09-15T22:44:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.649+0000 7ff2a28f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff29c15c9c0 con 0x7ff29c1600e0 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff29c0b6d50 0x7ff29c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff29c0b6d50 0x7ff29c0b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34088/0 (socket says 172.21.15.134:34088) 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 -- 172.21.15.134:0/3633689891 learned_addr learned my addr 172.21.15.134:0/3633689891 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff29bfff640 1 --2- 172.21.15.134:0/3633689891 >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 0x7ff29c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff2a0e8e640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c1600e0 0x7ff29c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 -- 172.21.15.134:0/3633689891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c1600e0 msgr2=0x7ff29c160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c1600e0 0x7ff29c160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 -- 172.21.15.134:0/3633689891 >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 msgr2=0x7ff29c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 --2- 172.21.15.134:0/3633689891 >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 0x7ff29c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff293fff640 1 -- 172.21.15.134:0/3633689891 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c0b1dd0 con 0x7ff29c0b6d50 2024-09-15T22:44:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.650+0000 7ff29bfff640 1 --2- 172.21.15.134:0/3633689891 >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 0x7ff29c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff293fff640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c0b7190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0638c0 tx=0x7ff28402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6761e98c7cd21a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff29b7fe640 1 -- 172.21.15.134:0/3633689891 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284037070 con 0x7ff29c0b6d50 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff29b7fe640 1 -- 172.21.15.134:0/3633689891 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff284032440 con 0x7ff29c0b6d50 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff29b7fe640 1 -- 172.21.15.134:0/3633689891 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284032810 con 0x7ff29c0b6d50 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 -- 172.21.15.134:0/3633689891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 msgr2=0x7ff29c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c0b7190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0638c0 tx=0x7ff28402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 -- 172.21.15.134:0/3633689891 shutdown_connections 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c1600e0 0x7ff29c160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/3633689891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c0b7190 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/3633689891 >> v2:172.21.15.177:3300/0 conn(0x7ff29c15c5e0 0x7ff29c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.651+0000 7ff2a28f1640 1 -- 172.21.15.134:0/3633689891 >> 172.21.15.134:0/3633689891 conn(0x7ff29c0b4220 msgr2=0x7ff29c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.652+0000 7ff2a28f1640 1 -- 172.21.15.134:0/3633689891 shutdown_connections 2024-09-15T22:44:44.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.652+0000 7ff2a28f1640 1 -- 172.21.15.134:0/3633689891 wait complete. 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 Processor -- start 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 -- start start 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c15c5e0 0x7ff29c1ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff29c1600e0 0x7ff29c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c073ab0 con 0x7ff29c0b6d50 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c0737d0 con 0x7ff29c1600e0 2024-09-15T22:44:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff2a28f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff29c073d90 con 0x7ff29c15c5e0 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.653+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34094/0 (socket says 172.21.15.134:34094) 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 -- 172.21.15.134:0/679293100 learned_addr learned my addr 172.21.15.134:0/679293100 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 -- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c15c5e0 msgr2=0x7ff29c1ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c15c5e0 0x7ff29c1ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2a0e8e640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff29c1600e0 0x7ff29c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 -- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff29c1600e0 msgr2=0x7ff29c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff29c1600e0 0x7ff29c14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 -- 172.21.15.134:0/679293100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c150350 con 0x7ff29c0b6d50 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff29bfff640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e810 tx=0x7ff28c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00f040 con 0x7ff29c0b6d50 2024-09-15T22:44:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c004030 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c150630 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004400 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.654+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c150ed0 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.655+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c150800 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.656+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 10) ==== 91050+0+0 (secure 0 0 0) 0x7ff28c00c6d0 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.656+0000 7ff2997fa640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 0x7ff27c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.656+0000 7ff293fff640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 0x7ff27c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.656+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff28c08b690 con 0x7ff29c0b6d50 2024-09-15T22:44:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.657+0000 7ff293fff640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 0x7ff27c06e9e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff284034000 tx=0x7ff28402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.661+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff28c017020 con 0x7ff29c0b6d50 2024-09-15T22:44:44.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.838+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff29c073130 con 0x7ff29c0b6d50 2024-09-15T22:44:44.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.839+0000 7ff2997fa640 1 -- 172.21.15.134:0/679293100 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) ==== 80+0+0 (secure 0 0 0) 0x7ff28c059a60 con 0x7ff29c0b6d50 2024-09-15T22:44:44.840 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:44:44.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 msgr2=0x7ff27c06e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 0x7ff27c06e9e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff284034000 tx=0x7ff28402c000 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 msgr2=0x7ff29c15f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e810 tx=0x7ff28c00ecd0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 shutdown_connections 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff27c06c520 0x7ff27c06e9e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff29c1600e0 0x7ff29c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff29c15c5e0 0x7ff29c1ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 --2- 172.21.15.134:0/679293100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff29c0b6d50 0x7ff29c15f110 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 >> 172.21.15.134:0/679293100 conn(0x7ff29c0b4220 msgr2=0x7ff29c0d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 shutdown_connections 2024-09-15T22:44:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:44.841+0000 7ff2a28f1640 1 -- 172.21.15.134:0/679293100 wait complete. 2024-09-15T22:44:44.853 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:44:44.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:44.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:44.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:44:44.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:44.900 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:44:44.922 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:44.922 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:44.922 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:44.940 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:44.940 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:44.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:44:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.096+0000 7ff50af11640 1 Processor -- start 2024-09-15T22:44:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.096+0000 7ff50af11640 1 -- start start 2024-09-15T22:44:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.097+0000 7ff50af11640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff504073060 0x7ff5040b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.097+0000 7ff50af11640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 0x7ff5040ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.097+0000 7ff50af11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff504162650 con 0x7ff5040b4eb0 2024-09-15T22:44:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.097+0000 7ff50af11640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff504162930 con 0x7ff504073060 2024-09-15T22:44:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.097+0000 7ff50af11640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff504162c10 con 0x7ff504162150 2024-09-15T22:44:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.098+0000 7ff503fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 0x7ff5040ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.098+0000 7ff503fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 0x7ff5040ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:49374/0 (socket says 172.21.15.134:49374) 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.098+0000 7ff503fff640 1 -- 172.21.15.134:0/353767002 learned_addr learned my addr 172.21.15.134:0/353767002 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.098+0000 7ff508cad640 1 --2- 172.21.15.134:0/353767002 >> v2:172.21.15.134:3300/0 conn(0x7ff504073060 0x7ff5040b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.099+0000 7ff508cad640 1 -- 172.21.15.134:0/353767002 >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 msgr2=0x7ff5040ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.099+0000 7ff508cad640 1 --2- 172.21.15.134:0/353767002 >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 0x7ff5040ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.099+0000 7ff508cad640 1 -- 172.21.15.134:0/353767002 >> v1:172.21.15.134:6789/0 conn(0x7ff5040b4eb0 legacy=0x7ff50415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.099+0000 7ff508cad640 1 -- 172.21.15.134:0/353767002 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff504162ef0 con 0x7ff504073060 2024-09-15T22:44:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.100+0000 7ff508cad640 1 --2- 172.21.15.134:0/353767002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff504073060 0x7ff5040b5c90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff504062d50 tx=0x7ff4f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36686c6729ace05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff5037fe640 1 -- 172.21.15.134:0/353767002 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8037070 con 0x7ff504073060 2024-09-15T22:44:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff5037fe640 1 -- 172.21.15.134:0/353767002 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f8032440 con 0x7ff504073060 2024-09-15T22:44:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff5037fe640 1 -- 172.21.15.134:0/353767002 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8032810 con 0x7ff504073060 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 -- 172.21.15.134:0/353767002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff504073060 msgr2=0x7ff5040b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 --2- 172.21.15.134:0/353767002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff504073060 0x7ff5040b5c90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff504062d50 tx=0x7ff4f802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 -- 172.21.15.134:0/353767002 shutdown_connections 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 --2- 172.21.15.134:0/353767002 >> v2:172.21.15.177:3300/0 conn(0x7ff504162150 0x7ff5040ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 --2- 172.21.15.134:0/353767002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff504073060 0x7ff5040b5c90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.101+0000 7ff50af11640 1 -- 172.21.15.134:0/353767002 >> 172.21.15.134:0/353767002 conn(0x7ff50406cae0 msgr2=0x7ff50406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.102+0000 7ff50af11640 1 -- 172.21.15.134:0/353767002 shutdown_connections 2024-09-15T22:44:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.102+0000 7ff50af11640 1 -- 172.21.15.134:0/353767002 wait complete. 2024-09-15T22:44:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.103+0000 7ff50af11640 1 Processor -- start 2024-09-15T22:44:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.103+0000 7ff50af11640 1 -- start start 2024-09-15T22:44:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 0x7ff504147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff504162150 0x7ff504160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040aee20 con 0x7ff5040b4eb0 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040b61d0 con 0x7ff504162150 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff50af11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff504073440 con 0x7ff504073060 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34098/0 (socket says 172.21.15.134:34098) 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 -- 172.21.15.134:0/2462137075 learned_addr learned my addr 172.21.15.134:0/2462137075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff5094ae640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff504162150 0x7ff504160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff508cad640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 0x7ff504147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 -- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 msgr2=0x7ff504147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 0x7ff504147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 -- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff504162150 msgr2=0x7ff504160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff504162150 0x7ff504160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 -- 172.21.15.134:0/2462137075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff504147b60 con 0x7ff5040b4eb0 2024-09-15T22:44:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff508cad640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 0x7ff504147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff503fff640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e900 tx=0x7ff4f000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.104+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0017070 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.105+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f000ca00 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.105+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000cdd0 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.105+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5040cd160 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.105+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5040cda00 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.106+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5040b5c90 con 0x7ff5040b4eb0 2024-09-15T22:44:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.106+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7ff4f001a070 con 0x7ff5040b4eb0 2024-09-15T22:44:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.106+0000 7ff5017fa640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 0x7ff4e806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.106+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff4f008b8f0 con 0x7ff5040b4eb0 2024-09-15T22:44:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.106+0000 7ff508cad640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 0x7ff4e806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.107+0000 7ff508cad640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 0x7ff4e806ead0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8034000 tx=0x7ff4f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.111+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4f0059600 con 0x7ff5040b4eb0 2024-09-15T22:44:45.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.290+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5040b1aa0 con 0x7ff5040b4eb0 2024-09-15T22:44:45.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.291+0000 7ff5017fa640 1 -- 172.21.15.134:0/2462137075 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) ==== 80+0+0 (secure 0 0 0) 0x7ff4f005d900 con 0x7ff5040b4eb0 2024-09-15T22:44:45.292 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:44:45.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 msgr2=0x7ff4e806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 0x7ff4e806ead0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8034000 tx=0x7ff4f802e000 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 msgr2=0x7ff5040ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e900 tx=0x7ff4f000edc0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 shutdown_connections 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff4e806c610 0x7ff4e806ead0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff504162150 0x7ff504160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5040b4eb0 0x7ff5040ce200 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 --2- 172.21.15.134:0/2462137075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff504073060 0x7ff504147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 >> 172.21.15.134:0/2462137075 conn(0x7ff50406cae0 msgr2=0x7ff5040b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 shutdown_connections 2024-09-15T22:44:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.293+0000 7ff50af11640 1 -- 172.21.15.134:0/2462137075 wait complete. 2024-09-15T22:44:45.305 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:44:45.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:45.305 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:44:45.335 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:44:45.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:45.336 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:44:45.393 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:45.393 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:45.393 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:45.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:45.409 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:44:45.409 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:45.409 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:45.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:45.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:45.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.547+0000 7f151e265640 1 Processor -- start 2024-09-15T22:44:45.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.547+0000 7f151e265640 1 -- start start 2024-09-15T22:44:45.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151e265640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f15180cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151e265640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 0x7f15180b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151e265640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15180ce150 con 0x7f15180b65c0 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151e265640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f15180b08a0 con 0x7f15180aff30 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151e265640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15180ce430 con 0x7f1518156880 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f151c802640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 0x7f15180b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f1517fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f15180cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f15177fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f15180b65c0 0x7f1518160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:38218/0 (socket says 172.21.15.134:38218) 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.548+0000 7f15177fe640 1 -- 172.21.15.134:0/2145658450 learned_addr learned my addr 172.21.15.134:0/2145658450 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1516ffd640 1 -- 172.21.15.134:0/2145658450 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189981472 0 0) 0x7f15180ce150 con 0x7f15180b65c0 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1516ffd640 1 -- 172.21.15.134:0/2145658450 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1500003520 con 0x7f15180b65c0 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1517fff640 1 -- 172.21.15.134:0/2145658450 >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 msgr2=0x7f15180b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1517fff640 1 --2- 172.21.15.134:0/2145658450 >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 0x7f15180b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1517fff640 1 -- 172.21.15.134:0/2145658450 >> v1:172.21.15.177:6789/0 conn(0x7f15180b65c0 legacy=0x7f1518160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1517fff640 1 -- 172.21.15.134:0/2145658450 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151815ff30 con 0x7f1518156880 2024-09-15T22:44:45.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f151c802640 1 --2- 172.21.15.134:0/2145658450 >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 0x7f15180b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:45.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.549+0000 7f1517fff640 1 --2- 172.21.15.134:0/2145658450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f15180cdae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f15080097a0 tx=0x7f150802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b258f28d11d707e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f1516ffd640 1 -- 172.21.15.134:0/2145658450 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508037070 con 0x7f1518156880 2024-09-15T22:44:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f1516ffd640 1 -- 172.21.15.134:0/2145658450 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150802ae50 con 0x7f1518156880 2024-09-15T22:44:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f1516ffd640 1 -- 172.21.15.134:0/2145658450 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508032640 con 0x7f1518156880 2024-09-15T22:44:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 -- 172.21.15.134:0/2145658450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 msgr2=0x7f15180cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 --2- 172.21.15.134:0/2145658450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f15180cdae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f15080097a0 tx=0x7f150802a100 comp rx=0 tx=0).stop 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 -- 172.21.15.134:0/2145658450 shutdown_connections 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 --2- 172.21.15.134:0/2145658450 >> v2:172.21.15.177:3300/0 conn(0x7f15180aff30 0x7f15180b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 --2- 172.21.15.134:0/2145658450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f15180cdae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 -- 172.21.15.134:0/2145658450 >> 172.21.15.134:0/2145658450 conn(0x7f151806cae0 msgr2=0x7f151806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 -- 172.21.15.134:0/2145658450 shutdown_connections 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.550+0000 7f151e265640 1 -- 172.21.15.134:0/2145658450 wait complete. 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.551+0000 7f151e265640 1 Processor -- start 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 -- start start 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15180aff30 0x7f1518154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f151815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15180b6a00 con 0x7f15180b65c0 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1518156c60 con 0x7f15180aff30 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f151e265640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f15180ce710 con 0x7f1518156880 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f15177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.552+0000 7f15177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34114/0 (socket says 172.21.15.134:34114) 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 -- 172.21.15.134:0/3982016828 learned_addr learned my addr 172.21.15.134:0/3982016828 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f151c802640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f151815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f1517fff640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15180aff30 0x7f1518154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 -- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 msgr2=0x7f151815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f151815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 -- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15180aff30 msgr2=0x7f1518154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15180aff30 0x7f1518154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 -- 172.21.15.134:0/3982016828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180abee0 con 0x7f15180b65c0 2024-09-15T22:44:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f15177fe640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c430 tx=0x7f150c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c017070 con 0x7f15180b65c0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c005ce0 con 0x7f15180b65c0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15180b48e0 con 0x7f15180b65c0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0072f0 con 0x7f15180b65c0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.553+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15180b4ea0 con 0x7f15180b65c0 2024-09-15T22:44:45.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.554+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15180b0360 con 0x7f15180b65c0 2024-09-15T22:44:45.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.555+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f150c01a070 con 0x7f15180b65c0 2024-09-15T22:44:45.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.555+0000 7f1514ff9640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 0x7f150406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.555+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f150c08acc0 con 0x7f15180b65c0 2024-09-15T22:44:45.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.555+0000 7f1517fff640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 0x7f150406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.555+0000 7f1517fff640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 0x7f150406ead0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f150802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.559+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f150c0589d0 con 0x7f15180b65c0 2024-09-15T22:44:45.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.758+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15180b1250 con 0x7f15180b65c0 2024-09-15T22:44:45.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.759+0000 7f1514ff9640 1 -- 172.21.15.134:0/3982016828 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5235 (secure 0 0 0) 0x7f150c05ccd0 con 0x7f15180b65c0 2024-09-15T22:44:45.760 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:45.760 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"btime":"2024-09-15T22:44:35:052132+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:45.761 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-09-15T22:44:45.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 msgr2=0x7f150406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 0x7f150406ead0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f150802e000 comp rx=0 tx=0).stop 2024-09-15T22:44:45.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 msgr2=0x7f15180b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c430 tx=0x7f150c00c830 comp rx=0 tx=0).stop 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 shutdown_connections 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f150406c610 0x7f150406ead0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1518156880 0x7f151815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15180b65c0 0x7f15180b5980 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 --2- 172.21.15.134:0/3982016828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15180aff30 0x7f1518154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 >> 172.21.15.134:0/3982016828 conn(0x7f151806cae0 msgr2=0x7f151815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 shutdown_connections 2024-09-15T22:44:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.761+0000 7f151e265640 1 -- 172.21.15.134:0/3982016828 wait complete. 2024-09-15T22:44:45.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:45.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.869+0000 7fd47171f640 1 Processor -- start 2024-09-15T22:44:45.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 -- start start 2024-09-15T22:44:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd46c15e940 0x7fd46c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd46c15ed20 0x7fd46c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 0x7fd46c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd46c0d1ae0 con 0x7fd46c15e940 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd46c0b7170 con 0x7fd46c15ed20 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd47171f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c0b7aa0 con 0x7fd46c0cef90 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.870+0000 7fd46affd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd46c15e940 0x7fd46c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd46c15e940 0x7fd46c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34122/0 (socket says 172.21.15.134:34122) 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 -- 172.21.15.134:0/3051432198 learned_addr learned my addr 172.21.15.134:0/3051432198 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46a7fc640 1 --2- 172.21.15.134:0/3051432198 >> v2:172.21.15.177:3300/0 conn(0x7fd46c15ed20 0x7fd46c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46b7fe640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 0x7fd46c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 -- 172.21.15.134:0/3051432198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 msgr2=0x7fd46c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 0x7fd46c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 -- 172.21.15.134:0/3051432198 >> v2:172.21.15.177:3300/0 conn(0x7fd46c15ed20 msgr2=0x7fd46c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 --2- 172.21.15.134:0/3051432198 >> v2:172.21.15.177:3300/0 conn(0x7fd46c15ed20 0x7fd46c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 -- 172.21.15.134:0/3051432198 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0d3660 con 0x7fd46c15e940 2024-09-15T22:44:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46b7fe640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 0x7fd46c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.871+0000 7fd46affd640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15e940 0x7fd46c0d1060 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06e900 tx=0x7fd45c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b75f3944bf62ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd469ffb640 1 -- 172.21.15.134:0/3051432198 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c036070 con 0x7fd46c15e940 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd469ffb640 1 -- 172.21.15.134:0/3051432198 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c031600 con 0x7fd46c15e940 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd469ffb640 1 -- 172.21.15.134:0/3051432198 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0319d0 con 0x7fd46c15e940 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 -- 172.21.15.134:0/3051432198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15e940 msgr2=0x7fd46c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15e940 0x7fd46c0d1060 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06e900 tx=0x7fd45c02a730 comp rx=0 tx=0).stop 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 -- 172.21.15.134:0/3051432198 shutdown_connections 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c0cef90 0x7fd46c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 --2- 172.21.15.134:0/3051432198 >> v2:172.21.15.177:3300/0 conn(0x7fd46c15ed20 0x7fd46c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 --2- 172.21.15.134:0/3051432198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15e940 0x7fd46c0d1060 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 -- 172.21.15.134:0/3051432198 >> 172.21.15.134:0/3051432198 conn(0x7fd46c0b6240 msgr2=0x7fd46c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 -- 172.21.15.134:0/3051432198 shutdown_connections 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.872+0000 7fd47171f640 1 -- 172.21.15.134:0/3051432198 wait complete. 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 Processor -- start 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 -- start start 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46c0cef90 0x7fd46c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c15e940 0x7fd46c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c0d3f00 con 0x7fd46c15ed20 2024-09-15T22:44:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c0d3c20 con 0x7fd46c0cef90 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd47171f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c0d1ef0 con 0x7fd46c15e940 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd46b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd46b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34132/0 (socket says 172.21.15.134:34132) 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.874+0000 7fd46b7fe640 1 -- 172.21.15.134:0/3323475588 learned_addr learned my addr 172.21.15.134:0/3323475588 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46affd640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46c0cef90 0x7fd46c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46a7fc640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c15e940 0x7fd46c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 -- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c15e940 msgr2=0x7fd46c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c15e940 0x7fd46c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 -- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46c0cef90 msgr2=0x7fd46c15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46c0cef90 0x7fd46c15ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 -- 172.21.15.134:0/3323475588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0cd1a0 con 0x7fd46c15ed20 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd46b7fe640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c7f0 tx=0x7fd46400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464015070 con 0x7fd46c15ed20 2024-09-15T22:44:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd464007820 con 0x7fd46c15ed20 2024-09-15T22:44:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c0cd480 con 0x7fd46c15ed20 2024-09-15T22:44:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464007c10 con 0x7fd46c15ed20 2024-09-15T22:44:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.875+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c145290 con 0x7fd46c15ed20 2024-09-15T22:44:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.876+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46c145490 con 0x7fd46c15ed20 2024-09-15T22:44:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.877+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd464018070 con 0x7fd46c15ed20 2024-09-15T22:44:45.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.877+0000 7fd4537fe640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 0x7fd45806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.877+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fd46408bbc0 con 0x7fd46c15ed20 2024-09-15T22:44:45.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.877+0000 7fd46affd640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 0x7fd45806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.878+0000 7fd46affd640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 0x7fd45806ead0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd45c033000 tx=0x7fd45c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:45.882+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd46c145490 con 0x7fd46c15ed20 2024-09-15T22:44:46.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.087+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd46c0d1060 con 0x7fd46c15ed20 2024-09-15T22:44:46.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.087+0000 7fd4537fe640 1 -- 172.21.15.134:0/3323475588 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5235 (secure 0 0 0) 0x7fd4640595e0 con 0x7fd46c15ed20 2024-09-15T22:44:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:46.089 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"btime":"2024-09-15T22:44:35:052132+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:46.090 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 msgr2=0x7fd45806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 0x7fd45806ead0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd45c033000 tx=0x7fd45c009000 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 msgr2=0x7fd46c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c7f0 tx=0x7fd46400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 shutdown_connections 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd45806c610 0x7fd45806ead0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd46c15ed20 0x7fd46c144720 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46c15e940 0x7fd46c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 --2- 172.21.15.134:0/3323475588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46c0cef90 0x7fd46c15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 >> 172.21.15.134:0/3323475588 conn(0x7fd46c0b6240 msgr2=0x7fd46c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 shutdown_connections 2024-09-15T22:44:46.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.089+0000 7fd47171f640 1 -- 172.21.15.134:0/3323475588 wait complete. 2024-09-15T22:44:46.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:46.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.199+0000 7fb68c6d9640 1 Processor -- start 2024-09-15T22:44:46.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.199+0000 7fb68c6d9640 1 -- start start 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb6840d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb68415ed20 0x7fb6840d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb6840cef90 0x7fb6840b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840d1ae0 con 0x7fb68415ed20 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840b7170 con 0x7fb6840cef90 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68c6d9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840b7aa0 con 0x7fb68415e940 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb68415ed20 0x7fb6840d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb68415ed20 0x7fb6840d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49558/0 (socket says 172.21.15.134:49558) 2024-09-15T22:44:46.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 -- 172.21.15.134:0/3465121042 learned_addr learned my addr 172.21.15.134:0/3465121042 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68a475640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb6840d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb68ac76640 1 --2- 172.21.15.134:0/3465121042 >> v2:172.21.15.177:3300/0 conn(0x7fb6840cef90 0x7fb6840b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 -- 172.21.15.134:0/3465121042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 msgr2=0x7fb6840d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb6840d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 -- 172.21.15.134:0/3465121042 >> v2:172.21.15.177:3300/0 conn(0x7fb6840cef90 msgr2=0x7fb6840b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 --2- 172.21.15.134:0/3465121042 >> v2:172.21.15.177:3300/0 conn(0x7fb6840cef90 0x7fb6840b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.200+0000 7fb689c74640 1 -- 172.21.15.134:0/3465121042 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840d3660 con 0x7fb68415ed20 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb689c74640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb68415ed20 0x7fb6840d15a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb684073e20 tx=0x7fb67402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1305efd0096f174a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb689473640 1 -- 172.21.15.134:0/3465121042 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674037070 con 0x7fb68415ed20 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb689473640 1 -- 172.21.15.134:0/3465121042 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674032440 con 0x7fb68415ed20 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb689473640 1 -- 172.21.15.134:0/3465121042 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674032810 con 0x7fb68415ed20 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb68c6d9640 1 -- 172.21.15.134:0/3465121042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb68415ed20 msgr2=0x7fb6840d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.201+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb68415ed20 0x7fb6840d15a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb684073e20 tx=0x7fb67402a270 comp rx=0 tx=0).stop 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 -- 172.21.15.134:0/3465121042 shutdown_connections 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/3465121042 >> v2:172.21.15.177:3300/0 conn(0x7fb6840cef90 0x7fb6840b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb68415ed20 0x7fb6840d15a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/3465121042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb6840d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 -- 172.21.15.134:0/3465121042 >> 172.21.15.134:0/3465121042 conn(0x7fb6840b6240 msgr2=0x7fb6840b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 -- 172.21.15.134:0/3465121042 shutdown_connections 2024-09-15T22:44:46.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.202+0000 7fb68c6d9640 1 -- 172.21.15.134:0/3465121042 wait complete. 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 Processor -- start 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 -- start start 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb68415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 0x7fb6841577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840d3f00 con 0x7fb6840cef90 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840d3c20 con 0x7fb68415ed20 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.203+0000 7fb68c6d9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840d1ef0 con 0x7fb68415e940 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49566/0 (socket says 172.21.15.134:49566) 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 -- 172.21.15.134:0/109778147 learned_addr learned my addr 172.21.15.134:0/109778147 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68ac76640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 0x7fb6841577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb689c74640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb68415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 -- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 msgr2=0x7fb68415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb68415ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 -- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 msgr2=0x7fb6841577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 0x7fb6841577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 -- 172.21.15.134:0/109778147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6841f8990 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68ac76640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 0x7fb6841577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68a475640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c820 tx=0x7fb68000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680015070 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680004240 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb684159e50 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68000ce10 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.204+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb684159390 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.205+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6840d1060 con 0x7fb6840cef90 2024-09-15T22:44:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.206+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fb6800077d0 con 0x7fb6840cef90 2024-09-15T22:44:46.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.206+0000 7fb67affd640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 0x7fb66806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.206+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fb68008b8b0 con 0x7fb6840cef90 2024-09-15T22:44:46.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.206+0000 7fb689c74640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 0x7fb66806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.206+0000 7fb689c74640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 0x7fb66806ead0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb67402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.210+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb680059b00 con 0x7fb6840cef90 2024-09-15T22:44:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.375+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6840ba6b0 con 0x7fb6840cef90 2024-09-15T22:44:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.376+0000 7fb67affd640 1 -- 172.21.15.134:0/109778147 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7fb680059400 con 0x7fb6840cef90 2024-09-15T22:44:46.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:46.378 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":61,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:22.956255+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:19.893552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:20.258562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 msgr2=0x7fb66806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 0x7fb66806ead0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb67402e000 comp rx=0 tx=0).stop 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 msgr2=0x7fb6841f8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c820 tx=0x7fb68000cce0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 shutdown_connections 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb66806c610 0x7fb66806ead0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb68415ed20 0x7fb6841577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415e940 0x7fb68415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 --2- 172.21.15.134:0/109778147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6840cef90 0x7fb6841f8450 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.378+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 >> 172.21.15.134:0/109778147 conn(0x7fb6840b6240 msgr2=0x7fb68415ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.379+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 shutdown_connections 2024-09-15T22:44:46.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.379+0000 7fb68c6d9640 1 -- 172.21.15.134:0/109778147 wait complete. 2024-09-15T22:44:46.391 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:44:46.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.487+0000 7fb9dc69b640 1 Processor -- start 2024-09-15T22:44:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.488+0000 7fb9dc69b640 1 -- start start 2024-09-15T22:44:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.488+0000 7fb9dc69b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9d40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.488+0000 7fb9dc69b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9d415f5f0 0x7fb9d40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.488+0000 7fb9dc69b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d40af960 con 0x7fb9d415fa30 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.488+0000 7fb9dc69b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d40aee20 con 0x7fb9d415f5f0 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9dc69b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d40af0c0 con 0x7fb9d415f210 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9dac38640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb9d415fa30 0x7fb9d4162390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:44972/0 (socket says 172.21.15.134:44972) 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9dac38640 1 -- 172.21.15.134:0/43622176 learned_addr learned my addr 172.21.15.134:0/43622176 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348825734 0 0) 0x7fb9d40af960 con 0x7fb9d415fa30 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9bc003520 con 0x7fb9d415fa30 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9da437640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9d40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9c36640 1 --2- 172.21.15.134:0/43622176 >> v2:172.21.15.177:3300/0 conn(0x7fb9d415f5f0 0x7fb9d40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1508120448 0 0) 0x7fb9bc003520 con 0x7fb9d415fa30 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 msgr2=0x7fb9d40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9d40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 >> v2:172.21.15.177:3300/0 conn(0x7fb9d415f5f0 msgr2=0x7fb9d40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 --2- 172.21.15.134:0/43622176 >> v2:172.21.15.177:3300/0 conn(0x7fb9d415f5f0 0x7fb9d40713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d40af3a0 con 0x7fb9d415fa30 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb9c40019f0 con 0x7fb9d415fa30 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 >> v1:172.21.15.134:6789/0 conn(0x7fb9d415fa30 legacy=0x7fb9d4162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9bc0039b0 0x7fb9bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9bc004d40 0x7fb9bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d40aee20 con 0x7fb9bc0039b0 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d40af0c0 con 0x7fb9bc004d40 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc00b9c0 con 0x7fb9d415f210 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9da437640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9bc0039b0 0x7fb9bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9d9c36640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.489+0000 7fb9dac38640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9bc004d40 0x7fb9bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 -- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 msgr2=0x7fb9bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9d415f210 0x7fb9bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 -- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9bc004d40 msgr2=0x7fb9bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9bc004d40 0x7fb9bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 -- 172.21.15.134:0/43622176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc003520 con 0x7fb9bc0039b0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9dac38640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9bc004d40 0x7fb9bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9da437640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9bc0039b0 0x7fb9bc003dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009ac0 tx=0x7fb9bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726e0d6264ab0398 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc036070 con 0x7fb9bc0039b0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc031400 con 0x7fb9bc0039b0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.490+0000 7fb9d9435640 1 -- 172.21.15.134:0/43622176 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc009690 con 0x7fb9bc0039b0 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 -- 172.21.15.134:0/43622176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9bc0039b0 msgr2=0x7fb9bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/43622176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9bc0039b0 0x7fb9bc003dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009ac0 tx=0x7fb9bc005830 comp rx=0 tx=0).stop 2024-09-15T22:44:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dac38640 1 -- 172.21.15.134:0/43622176 reap_dead start 2024-09-15T22:44:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 -- 172.21.15.134:0/43622176 shutdown_connections 2024-09-15T22:44:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 -- 172.21.15.134:0/43622176 >> 172.21.15.134:0/43622176 conn(0x7fb9d40b2480 msgr2=0x7fb9d40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 -- 172.21.15.134:0/43622176 shutdown_connections 2024-09-15T22:44:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.491+0000 7fb9dc69b640 1 -- 172.21.15.134:0/43622176 wait complete. 2024-09-15T22:44:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.492+0000 7fb9dc69b640 1 Processor -- start 2024-09-15T22:44:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.492+0000 7fb9dc69b640 1 -- start start 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9bc0039b0 0x7fb9d4158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d4145af0 0x7fb9d415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d406ea20 con 0x7fb9d415d770 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d406d4f0 con 0x7fb9d4145af0 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dc69b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d406eba0 con 0x7fb9bc0039b0 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49594/0 (socket says 172.21.15.134:49594) 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 -- 172.21.15.134:0/1183006969 learned_addr learned my addr 172.21.15.134:0/1183006969 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9da437640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9bc0039b0 0x7fb9d4158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9d9c36640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d4145af0 0x7fb9d415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 -- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9bc0039b0 msgr2=0x7fb9d4158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9bc0039b0 0x7fb9d4158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 -- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d4145af0 msgr2=0x7fb9d415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d4145af0 0x7fb9d415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.493+0000 7fb9dac38640 1 -- 172.21.15.134:0/1183006969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d4149080 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9dac38640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb9d415fe10 tx=0x7fb9c400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4007a80 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c4018070 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d4149360 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4013420 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.494+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d4157b10 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.495+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d40d0bd0 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.495+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fb9c40135c0 con 0x7fb9d415d770 2024-09-15T22:44:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.496+0000 7fb9d2ffd640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 0x7fb9c006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.496+0000 7fb9da437640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 0x7fb9c006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.496+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fb9c408bb20 con 0x7fb9d415d770 2024-09-15T22:44:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.497+0000 7fb9da437640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 0x7fb9c006ead0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc033000 tx=0x7fb9cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.500+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9c4059f10 con 0x7fb9d415d770 2024-09-15T22:44:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.698+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9d40ae8e0 con 0x7fb9d415d770 2024-09-15T22:44:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.699+0000 7fb9d2ffd640 1 -- 172.21.15.134:0/1183006969 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5235 (secure 0 0 0) 0x7fb9c4059810 con 0x7fb9d415d770 2024-09-15T22:44:46.701 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:46.701 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"btime":"2024-09-15T22:44:35:052132+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:46.701 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 msgr2=0x7fb9c006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 0x7fb9c006ead0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc033000 tx=0x7fb9cc008030 comp rx=0 tx=0).stop 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 msgr2=0x7fb9d41484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb9d415fe10 tx=0x7fb9c400e530 comp rx=0 tx=0).stop 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 shutdown_connections 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb9c006c610 0x7fb9c006ead0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d415d770 0x7fb9d41484a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9d4145af0 0x7fb9d415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 --2- 172.21.15.134:0/1183006969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9bc0039b0 0x7fb9d4158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 >> 172.21.15.134:0/1183006969 conn(0x7fb9d40b2480 msgr2=0x7fb9d40ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 shutdown_connections 2024-09-15T22:44:46.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.701+0000 7fb9dc69b640 1 -- 172.21.15.134:0/1183006969 wait complete. 2024-09-15T22:44:46.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 Processor -- start 2024-09-15T22:44:46.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 -- start start 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 0x7f11140d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11140b7170 con 0x7f111415ed20 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f11140d1ae0 con 0x7f11140cef90 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.810+0000 7f111a942640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11140b7aa0 con 0x7f111415e940 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f11137fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f111415ed20 0x7f11140b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:44974/0 (socket says 172.21.15.134:44974) 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f11137fe640 1 -- 172.21.15.134:0/4202434456 learned_addr learned my addr 172.21.15.134:0/4202434456 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1113fff640 1 --2- 172.21.15.134:0/4202434456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1118edf640 1 --2- 172.21.15.134:0/4202434456 >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 0x7f11140d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1112ffd640 1 -- 172.21.15.134:0/4202434456 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052286145 0 0) 0x7f1108001110 con 0x7f111415ed20 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1112ffd640 1 -- 172.21.15.134:0/4202434456 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10fc003520 con 0x7f111415ed20 2024-09-15T22:44:46.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1113fff640 1 -- 172.21.15.134:0/4202434456 >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 msgr2=0x7f11140d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1113fff640 1 --2- 172.21.15.134:0/4202434456 >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 0x7f11140d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1113fff640 1 -- 172.21.15.134:0/4202434456 >> v1:172.21.15.134:6789/0 conn(0x7f111415ed20 legacy=0x7f11140b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1113fff640 1 -- 172.21.15.134:0/4202434456 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11140d3660 con 0x7f111415e940 2024-09-15T22:44:46.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.811+0000 7f1118edf640 1 --2- 172.21.15.134:0/4202434456 >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 0x7f11140d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.812+0000 7f1113fff640 1 --2- 172.21.15.134:0/4202434456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140d1060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11040097a0 tx=0x7f110402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d2d8989bc8dcca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.812+0000 7f1112ffd640 1 -- 172.21.15.134:0/4202434456 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104037070 con 0x7f111415e940 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.812+0000 7f1112ffd640 1 -- 172.21.15.134:0/4202434456 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104032440 con 0x7f111415e940 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.812+0000 7f1112ffd640 1 -- 172.21.15.134:0/4202434456 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11040327f0 con 0x7f111415e940 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 -- 172.21.15.134:0/4202434456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 msgr2=0x7f11140d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 --2- 172.21.15.134:0/4202434456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140d1060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11040097a0 tx=0x7f110402a210 comp rx=0 tx=0).stop 2024-09-15T22:44:46.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 -- 172.21.15.134:0/4202434456 shutdown_connections 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 --2- 172.21.15.134:0/4202434456 >> v2:172.21.15.177:3300/0 conn(0x7f11140cef90 0x7f11140d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 --2- 172.21.15.134:0/4202434456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140d1060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 -- 172.21.15.134:0/4202434456 >> 172.21.15.134:0/4202434456 conn(0x7f11140b6240 msgr2=0x7f11140b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 -- 172.21.15.134:0/4202434456 shutdown_connections 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.813+0000 7f111a942640 1 -- 172.21.15.134:0/4202434456 wait complete. 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.814+0000 7f111a942640 1 Processor -- start 2024-09-15T22:44:46.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.814+0000 7f111a942640 1 -- start start 2024-09-15T22:44:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 0x7f11140ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11140d3f00 con 0x7f11140cef90 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11140d3c20 con 0x7f111415ed20 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11140d3310 con 0x7f111415e940 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49600/0 (socket says 172.21.15.134:49600) 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 -- 172.21.15.134:0/2377195468 learned_addr learned my addr 172.21.15.134:0/2377195468 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1118edf640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 0x7f11140ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f11137fe640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 -- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 msgr2=0x7f11140cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 -- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 msgr2=0x7f11140ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 0x7f11140ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 -- 172.21.15.134:0/2377195468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111415bb70 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1118edf640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 0x7f11140ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1113fff640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f110402a250 tx=0x7f11040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104037040 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104042070 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11140cdc20 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110403b930 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.815+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141594c0 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.816+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11140d1ef0 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.817+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f110403bad0 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.817+0000 7f1110ff9640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 0x7f110006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.817+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f11040ac160 con 0x7f11140cef90 2024-09-15T22:44:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.817+0000 7f11137fe640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 0x7f110006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.818+0000 7f11137fe640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 0x7f110006ead0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11140ce590 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:46.822+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f110407a670 con 0x7f11140cef90 2024-09-15T22:44:47.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.023+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11140ba6b0 con 0x7f11140cef90 2024-09-15T22:44:47.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.024+0000 7f1110ff9640 1 -- 172.21.15.134:0/2377195468 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5235 (secure 0 0 0) 0x7f1104079f70 con 0x7f11140cef90 2024-09-15T22:44:47.025 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:47.026 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"btime":"2024-09-15T22:44:35:052132+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:21.291495+0000","modified":"2024-09-15T22:44:24.068627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/3316659079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3316659079},{"type":"v1","addr":"172.21.15.134:6837","nonce":3316659079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5727,"qdb_cluster":[5727]},"id":4}]} 2024-09-15T22:44:47.026 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 msgr2=0x7f110006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 0x7f110006ead0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11140ce590 tx=0x7f1108009040 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 msgr2=0x7f111415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f110402a250 tx=0x7f11040046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 shutdown_connections 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f110006c610 0x7f110006ead0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f111415ed20 0x7f11140ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f111415e940 0x7f11140cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 --2- 172.21.15.134:0/2377195468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140cef90 0x7f111415b630 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 >> 172.21.15.134:0/2377195468 conn(0x7f11140b6240 msgr2=0x7f11140b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 shutdown_connections 2024-09-15T22:44:47.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.026+0000 7f111a942640 1 -- 172.21.15.134:0/2377195468 wait complete. 2024-09-15T22:44:47.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:47.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.136+0000 7feac9b66640 1 Processor -- start 2024-09-15T22:44:47.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.136+0000 7feac9b66640 1 -- start start 2024-09-15T22:44:47.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac9b66640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feac415c300 0x7feac40affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac9b66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feac406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac9b66640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac415ecf0 con 0x7feac406f010 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac9b66640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7feac415c6e0 con 0x7feac415c300 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac9b66640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feac415efb0 con 0x7feac40cd300 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7feac406f010 0x7feac41622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:44988/0 (socket says 172.21.15.134:44988) 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac3fff640 1 -- 172.21.15.134:0/952257481 learned_addr learned my addr 172.21.15.134:0/952257481 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac2ffd640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feac406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac37fe640 1 --2- 172.21.15.134:0/952257481 >> v2:172.21.15.177:3300/0 conn(0x7feac415c300 0x7feac40affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.137+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254975755 0 0) 0x7feac415ecf0 con 0x7feac406f010 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaac003520 con 0x7feac406f010 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2688616840 0 0) 0x7feaac003520 con 0x7feac406f010 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 msgr2=0x7feac406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feac406ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 >> v2:172.21.15.177:3300/0 conn(0x7feac415c300 msgr2=0x7feac40affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 --2- 172.21.15.134:0/952257481 >> v2:172.21.15.177:3300/0 conn(0x7feac415c300 0x7feac40affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac415f290 con 0x7feac406f010 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7feabc001670 con 0x7feac406f010 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 >> v1:172.21.15.134:6789/0 conn(0x7feac406f010 legacy=0x7feac41622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feaac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feaac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feaac004d40 0x7feaac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feac415c6e0 con 0x7feaac003f30 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feac415efb0 con 0x7feaac004d40 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feaac00ba10 con 0x7feac40cd300 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feaac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac37fe640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feaac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac3fff640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feaac004d40 0x7feaac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 -- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 msgr2=0x7feaac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac40cd300 0x7feaac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 -- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feaac004d40 msgr2=0x7feaac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feaac004d40 0x7feaac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac2ffd640 1 -- 172.21.15.134:0/952257481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac003520 con 0x7feaac003f30 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.138+0000 7feac3fff640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feaac004d40 0x7feaac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.139+0000 7feac2ffd640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feaac004800 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feab8009a90 tx=0x7feaac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fb1f40db95a3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.139+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8036070 con 0x7feaac003f30 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.139+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8031400 con 0x7feaac003f30 2024-09-15T22:44:47.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.139+0000 7feac27fc640 1 -- 172.21.15.134:0/952257481 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8009690 con 0x7feaac003f30 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 -- 172.21.15.134:0/952257481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 msgr2=0x7feaac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 --2- 172.21.15.134:0/952257481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feaac004800 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feab8009a90 tx=0x7feaac005830 comp rx=0 tx=0).stop 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac3fff640 1 -- 172.21.15.134:0/952257481 reap_dead start 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 -- 172.21.15.134:0/952257481 shutdown_connections 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 -- 172.21.15.134:0/952257481 >> 172.21.15.134:0/952257481 conn(0x7feac406cae0 msgr2=0x7feac406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 -- 172.21.15.134:0/952257481 shutdown_connections 2024-09-15T22:44:47.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.140+0000 7feac9b66640 1 -- 172.21.15.134:0/952257481 wait complete. 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.141+0000 7feac9b66640 1 Processor -- start 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.141+0000 7feac9b66640 1 -- start start 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 0x7feac41f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 0x7feac40ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feac4071880 con 0x7feaac003f30 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feac415f850 con 0x7feac40ce510 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7feac40b0500 con 0x7feac414d7f0 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49624/0 (socket says 172.21.15.134:49624) 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 -- 172.21.15.134:0/4124814744 learned_addr learned my addr 172.21.15.134:0/4124814744 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac2ffd640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 0x7feac41f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac3fff640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 0x7feac40ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 -- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 msgr2=0x7feac41f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 0x7feac41f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 -- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 msgr2=0x7feac40ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 0x7feac40ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 -- 172.21.15.134:0/4124814744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac41f52a0 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac3fff640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 0x7feac40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac2ffd640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 0x7feac41f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac37fe640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feab4011e90 tx=0x7feab400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4015630 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab40157d0 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac414dc70 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.142+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4015ba0 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.143+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac40b2430 con 0x7feaac003f30 2024-09-15T22:44:47.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.143+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac40b2670 con 0x7feaac003f30 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.144+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7feab401d400 con 0x7feaac003f30 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.144+0000 7feaabfff640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 0x7feab006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.144+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7feab408cd70 con 0x7feaac003f30 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.144+0000 7feac2ffd640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 0x7feab006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.145+0000 7feac2ffd640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 0x7feab006eb00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feab8033000 tx=0x7feab8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.149+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feab4091070 con 0x7feaac003f30 2024-09-15T22:44:47.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.314+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feac40affc0 con 0x7feaac003f30 2024-09-15T22:44:47.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.315+0000 7feaabfff640 1 -- 172.21.15.134:0/4124814744 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7feac41f52a0 con 0x7feaac003f30 2024-09-15T22:44:47.317 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:47.317 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":61,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:22.956255+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:19.893552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:20.258562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 msgr2=0x7feab006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 0x7feab006eb00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feab8033000 tx=0x7feab8008030 comp rx=0 tx=0).stop 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 msgr2=0x7feac40b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feab4011e90 tx=0x7feab400f580 comp rx=0 tx=0).stop 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 shutdown_connections 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7feab006c640 0x7feab006eb00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feac40ce510 0x7feac40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feac414d7f0 0x7feac41f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 --2- 172.21.15.134:0/4124814744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaac003f30 0x7feac40b1b70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.317+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 >> 172.21.15.134:0/4124814744 conn(0x7feac406cae0 msgr2=0x7feac406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.318+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 shutdown_connections 2024-09-15T22:44:47.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.318+0000 7feac9b66640 1 -- 172.21.15.134:0/4124814744 wait complete. 2024-09-15T22:44:47.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:44:47.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.428+0000 7f26bbb78640 1 Processor -- start 2024-09-15T22:44:47.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.428+0000 7f26bbb78640 1 -- start start 2024-09-15T22:44:47.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26bbb78640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26b415ca40 0x7f26b415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26bbb78640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ceb0 0x7f26b41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26bbb78640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b415d390 con 0x7f26b40d02a0 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26bbb78640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f26b415d670 con 0x7f26b415ca40 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26bbb78640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f26b415d950 con 0x7f26b415ceb0 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26b415ca40 0x7f26b415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9914640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f26b40d02a0 0x7f26b40d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45000/0 (socket says 172.21.15.134:45000) 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26b415ca40 0x7f26b415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49640/0 (socket says 172.21.15.134:49640) 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9914640 1 -- 172.21.15.134:0/2449806495 learned_addr learned my addr 172.21.15.134:0/2449806495 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 -- 172.21.15.134:0/2449806495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ceb0 msgr2=0x7f26b41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 --2- 172.21.15.134:0/2449806495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ceb0 0x7f26b41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 -- 172.21.15.134:0/2449806495 >> v1:172.21.15.134:6789/0 conn(0x7f26b40d02a0 legacy=0x7f26b40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b9113640 1 -- 172.21.15.134:0/2449806495 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b415dc30 con 0x7f26b415ca40 2024-09-15T22:44:47.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.429+0000 7f26b8912640 1 -- 172.21.15.134:0/2449806495 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812737564 0 0) 0x7f26b415d390 con 0x7f26b40d02a0 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26b9113640 1 --2- 172.21.15.134:0/2449806495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ca40 0x7f26b415e430 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ba40 tx=0x7f26a402c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7516d080054b8559 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26b8912640 1 -- 172.21.15.134:0/2449806495 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a403a070 con 0x7f26b415ca40 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26b8912640 1 -- 172.21.15.134:0/2449806495 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a4031070 con 0x7f26b415ca40 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26b8912640 1 -- 172.21.15.134:0/2449806495 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a40328f0 con 0x7f26b415ca40 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26bbb78640 1 -- 172.21.15.134:0/2449806495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ca40 msgr2=0x7f26b415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.430+0000 7f26bbb78640 1 --2- 172.21.15.134:0/2449806495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ca40 0x7f26b415e430 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ba40 tx=0x7f26a402c7d0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 -- 172.21.15.134:0/2449806495 shutdown_connections 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 --2- 172.21.15.134:0/2449806495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ceb0 0x7f26b41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 --2- 172.21.15.134:0/2449806495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ca40 0x7f26b415e430 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 -- 172.21.15.134:0/2449806495 >> 172.21.15.134:0/2449806495 conn(0x7f26b4062cc0 msgr2=0x7f26b406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 -- 172.21.15.134:0/2449806495 shutdown_connections 2024-09-15T22:44:47.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.431+0000 7f26bbb78640 1 -- 172.21.15.134:0/2449806495 wait complete. 2024-09-15T22:44:47.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.432+0000 7f26bbb78640 1 Processor -- start 2024-09-15T22:44:47.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.432+0000 7f26bbb78640 1 -- start start 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.432+0000 7f26bbb78640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b40d02a0 0x7f26b41ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ca40 0x7f26b4073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4155d10 con 0x7f26b415ceb0 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4155b90 con 0x7f26b40d02a0 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40b4790 con 0x7f26b415ca40 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26b9914640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b40d02a0 0x7f26b41ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49652/0 (socket says 172.21.15.134:49652) 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 -- 172.21.15.134:0/160551748 learned_addr learned my addr 172.21.15.134:0/160551748 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26b9113640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ca40 0x7f26b4073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 -- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ca40 msgr2=0x7f26b4073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ca40 0x7f26b4073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 -- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b40d02a0 msgr2=0x7f26b41ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b40d02a0 0x7f26b41ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 -- 172.21.15.134:0/160551748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b41f35c0 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26ba115640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b9e0 tx=0x7f26ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac019070 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac00cb40 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b41f38a0 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac014440 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.433+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41f3e60 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.434+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b40d0680 con 0x7f26b415ceb0 2024-09-15T22:44:47.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.435+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f26ac01c070 con 0x7f26b415ceb0 2024-09-15T22:44:47.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.435+0000 7f26aa7fc640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 0x7f269806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.435+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f26ac08b570 con 0x7f26b415ceb0 2024-09-15T22:44:47.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.435+0000 7f26b9914640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 0x7f269806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.436+0000 7f26b9914640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 0x7f269806ead0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b0000f60 tx=0x7f26b0007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.439+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26ac059280 con 0x7f26b415ceb0 2024-09-15T22:44:47.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.639+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f26b40b5430 con 0x7f26b415ceb0 2024-09-15T22:44:47.641 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:44:47.639+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.641+0000 7f26aa7fc640 1 -- 172.21.15.134:0/160551748 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f26ac05d580 con 0x7f26b415ceb0 2024-09-15T22:44:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 msgr2=0x7f269806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 0x7f269806ead0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b0000f60 tx=0x7f26b0007d50 comp rx=0 tx=0).stop 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 msgr2=0x7f26b414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b9e0 tx=0x7f26ac00bea0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 shutdown_connections 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f269806c610 0x7f269806ead0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26b415ceb0 0x7f26b414bf50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26b415ca40 0x7f26b4073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 --2- 172.21.15.134:0/160551748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b40d02a0 0x7f26b41ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.643+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 >> 172.21.15.134:0/160551748 conn(0x7f26b4062cc0 msgr2=0x7f26b4152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.644+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 shutdown_connections 2024-09-15T22:44:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.644+0000 7f26bbb78640 1 -- 172.21.15.134:0/160551748 wait complete. 2024-09-15T22:44:47.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:44:47.683 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:44:47.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.758+0000 7f0d00dbd640 1 Processor -- start 2024-09-15T22:44:47.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.758+0000 7f0d00dbd640 1 -- start start 2024-09-15T22:44:47.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0d00dbd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0d1560 0x7f0cfc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0d00dbd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0cfc0731e0 0x7f0cfc0b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0d00dbd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc0b59c0 con 0x7f0cfc0b1e40 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0d00dbd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0cfc071780 con 0x7f0cfc0731e0 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0d00dbd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0cfc071a60 con 0x7f0cfc0d1560 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf9d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0cfc0731e0 0x7f0cfc0b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cfad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0cfc0b1e40 0x7f0cfc1624e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45002/0 (socket says 172.21.15.134:45002) 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cfad9d640 1 -- 172.21.15.134:0/4101133463 learned_addr learned my addr 172.21.15.134:0/4101133463 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf9d9b640 1 -- 172.21.15.134:0/4101133463 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0d1560 msgr2=0x7f0cfc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf9d9b640 1 --2- 172.21.15.134:0/4101133463 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0d1560 0x7f0cfc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf9d9b640 1 -- 172.21.15.134:0/4101133463 >> v1:172.21.15.134:6789/0 conn(0x7f0cfc0b1e40 legacy=0x7f0cfc1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf9d9b640 1 -- 172.21.15.134:0/4101133463 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc06e460 con 0x7f0cfc0731e0 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.759+0000 7f0cf959a640 1 -- 172.21.15.134:0/4101133463 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143619388 0 0) 0x7f0cfc0b59c0 con 0x7f0cfc0b1e40 2024-09-15T22:44:47.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.760+0000 7f0cf9d9b640 1 --2- 172.21.15.134:0/4101133463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc0b6e40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0b18a0 tx=0x7f0cf002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcae3c0fb334f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.760+0000 7f0cf959a640 1 -- 172.21.15.134:0/4101133463 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0037070 con 0x7f0cfc0731e0 2024-09-15T22:44:47.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.760+0000 7f0cf959a640 1 -- 172.21.15.134:0/4101133463 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0032440 con 0x7f0cfc0731e0 2024-09-15T22:44:47.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.760+0000 7f0cf959a640 1 -- 172.21.15.134:0/4101133463 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0032810 con 0x7f0cfc0731e0 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 -- 172.21.15.134:0/4101133463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 msgr2=0x7f0cfc0b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/4101133463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc0b6e40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0b18a0 tx=0x7f0cf002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 -- 172.21.15.134:0/4101133463 shutdown_connections 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/4101133463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc0b6e40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/4101133463 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0d1560 0x7f0cfc0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 -- 172.21.15.134:0/4101133463 >> 172.21.15.134:0/4101133463 conn(0x7f0cfc06f370 msgr2=0x7f0cfc06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 -- 172.21.15.134:0/4101133463 shutdown_connections 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.761+0000 7f0d00dbd640 1 -- 172.21.15.134:0/4101133463 wait complete. 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.762+0000 7f0d00dbd640 1 Processor -- start 2024-09-15T22:44:47.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.762+0000 7f0d00dbd640 1 -- start start 2024-09-15T22:44:47.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0b1e40 0x7f0cfc14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cfc0d1560 0x7f0cfc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc071410 con 0x7f0cfc0731e0 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc06ea20 con 0x7f0cfc0b1e40 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0d00dbd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc0b7380 con 0x7f0cfc0d1560 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49684/0 (socket says 172.21.15.134:49684) 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 -- 172.21.15.134:0/3023939192 learned_addr learned my addr 172.21.15.134:0/3023939192 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 -- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cfc0d1560 msgr2=0x7f0cfc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cfc0d1560 0x7f0cfc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 -- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0b1e40 msgr2=0x7f0cfc14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0b1e40 0x7f0cfc14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.763+0000 7f0cfa59c640 1 -- 172.21.15.134:0/3023939192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc14a9f0 con 0x7f0cfc0731e0 2024-09-15T22:44:47.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0cfa59c640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00ba50 tx=0x7f0cec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec019070 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cec00cc00 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec014440 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc14d980 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.764+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc14af70 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.765+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cfc0b7710 con 0x7f0cfc0731e0 2024-09-15T22:44:47.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.765+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f0cec01c070 con 0x7f0cfc0731e0 2024-09-15T22:44:47.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.766+0000 7f0ceaffd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 0x7f0cdc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.766+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5795+0+0 (secure 0 0 0) 0x7f0cec08b670 con 0x7f0cfc0731e0 2024-09-15T22:44:47.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.766+0000 7f0cf9d9b640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 0x7f0cdc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.766+0000 7f0cf9d9b640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 0x7f0cdc06ea40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034000 tx=0x7f0cf002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.770+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cec059a50 con 0x7f0cfc0731e0 2024-09-15T22:44:47.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:47.969+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0cfc069160 con 0x7f0cfc0731e0 2024-09-15T22:44:48.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.642+0000 7f0ceaffd640 1 -- 172.21.15.134:0/3023939192 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f0cec059350 con 0x7f0cfc0731e0 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 msgr2=0x7f0cdc06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 0x7f0cdc06ea40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034000 tx=0x7f0cf002c000 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 msgr2=0x7f0cfc14a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00ba50 tx=0x7f0cec00bf10 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 shutdown_connections 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cdc06c580 0x7f0cdc06ea40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cfc0d1560 0x7f0cfc0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0b1e40 0x7f0cfc14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 --2- 172.21.15.134:0/3023939192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cfc0731e0 0x7f0cfc14a2d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 >> 172.21.15.134:0/3023939192 conn(0x7f0cfc06f370 msgr2=0x7f0cfc15d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 shutdown_connections 2024-09-15T22:44:48.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.645+0000 7f0d00dbd640 1 -- 172.21.15.134:0/3023939192 wait complete. 2024-09-15T22:44:48.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:44:48.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.807+0000 7fd0e68ba640 1 Processor -- start 2024-09-15T22:44:48.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.807+0000 7fd0e68ba640 1 -- start start 2024-09-15T22:44:48.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0e68ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0e00ccb80 0x7fd0e015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0e68ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0e68ba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e00b3570 con 0x7fd0e00b4c50 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0e68ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e00b50a0 con 0x7fd0e00ccb80 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0e68ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e00b3850 con 0x7fd0e0072d10 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0e00ccb80 0x7fd0e015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0e00ccb80 0x7fd0e015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49686/0 (socket says 172.21.15.134:49686) 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0dffff640 1 -- 172.21.15.134:0/1606287074 learned_addr learned my addr 172.21.15.134:0/1606287074 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0df7fe640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.808+0000 7fd0dffff640 1 -- 172.21.15.134:0/1606287074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 msgr2=0x7fd0e00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0dffff640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0dffff640 1 -- 172.21.15.134:0/1606287074 >> v1:172.21.15.177:6789/0 conn(0x7fd0e00b4c50 legacy=0x7fd0e015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0dffff640 1 -- 172.21.15.134:0/1606287074 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e00b3b30 con 0x7fd0e00ccb80 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0df7fe640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:48.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0dffff640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00ccb80 0x7fd0e015bbd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009870 tx=0x7fd0d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f8872aa9053aad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0deffd640 1 -- 172.21.15.134:0/1606287074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0037070 con 0x7fd0e00ccb80 2024-09-15T22:44:48.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0deffd640 1 -- 172.21.15.134:0/1606287074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d0032440 con 0x7fd0e00ccb80 2024-09-15T22:44:48.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.809+0000 7fd0deffd640 1 -- 172.21.15.134:0/1606287074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0032810 con 0x7fd0e00ccb80 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1606287074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00ccb80 msgr2=0x7fd0e015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00ccb80 0x7fd0e015bbd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009870 tx=0x7fd0d002a270 comp rx=0 tx=0).stop 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1606287074 shutdown_connections 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1606287074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00ccb80 0x7fd0e015bbd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1606287074 >> 172.21.15.134:0/1606287074 conn(0x7fd0e006bba0 msgr2=0x7fd0e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1606287074 shutdown_connections 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.810+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1606287074 wait complete. 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.811+0000 7fd0e68ba640 1 Processor -- start 2024-09-15T22:44:48.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.811+0000 7fd0e68ba640 1 -- start start 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e0141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 0x7fd0e00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00b43d0 con 0x7fd0e00b4c50 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00b40f0 con 0x7fd0e00ccb80 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e68ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e00ccf60 con 0x7fd0e0072d10 2024-09-15T22:44:48.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49696/0 (socket says 172.21.15.134:49696) 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0df7fe640 1 -- 172.21.15.134:0/1617929963 learned_addr learned my addr 172.21.15.134:0/1617929963 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0dffff640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e0141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.812+0000 7fd0e4e57640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 0x7fd0e00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 -- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 msgr2=0x7fd0e0141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e0141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 -- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 msgr2=0x7fd0e00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 0x7fd0e00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 -- 172.21.15.134:0/1617929963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e0144fc0 con 0x7fd0e00b4c50 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0e4e57640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 0x7fd0e00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0df7fe640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c7f0 tx=0x7fd0d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4015070 con 0x7fd0e00b4c50 2024-09-15T22:44:48.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d4007820 con 0x7fd0e00b4c50 2024-09-15T22:44:48.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4007bf0 con 0x7fd0e00b4c50 2024-09-15T22:44:48.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e01420c0 con 0x7fd0e00b4c50 2024-09-15T22:44:48.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.813+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e0142680 con 0x7fd0e00b4c50 2024-09-15T22:44:48.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.814+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e00b4710 con 0x7fd0e00b4c50 2024-09-15T22:44:48.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.814+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd0d4018070 con 0x7fd0e00b4c50 2024-09-15T22:44:48.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.815+0000 7fd0dcff9640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 0x7fd0cc06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.815+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5795+0+0 (secure 0 0 0) 0x7fd0d408bab0 con 0x7fd0e00b4c50 2024-09-15T22:44:48.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.815+0000 7fd0dffff640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 0x7fd0cc06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.815+0000 7fd0dffff640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 0x7fd0cc06ead0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0034000 tx=0x7fd0d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.819+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0d4059650 con 0x7fd0e00b4c50 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:48.985+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0e0072a30 con 0x7fd0e00b4c50 2024-09-15T22:44:49.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.646+0000 7fd0dcff9640 1 -- 172.21.15.134:0/1617929963 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7fd0d405d950 con 0x7fd0e00b4c50 2024-09-15T22:44:49.648 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 msgr2=0x7fd0cc06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 0x7fd0cc06ead0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0034000 tx=0x7fd0d002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 msgr2=0x7fd0e00b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c7f0 tx=0x7fd0d400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 shutdown_connections 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd0cc06c610 0x7fd0cc06ead0 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0034000 tx=0x7fd0d002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00ccb80 0x7fd0e00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0e00b4c50 0x7fd0e00b01c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 --2- 172.21.15.134:0/1617929963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e0072d10 0x7fd0e0141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 >> 172.21.15.134:0/1617929963 conn(0x7fd0e006bba0 msgr2=0x7fd0e015d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 shutdown_connections 2024-09-15T22:44:49.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.650+0000 7fd0e68ba640 1 -- 172.21.15.134:0/1617929963 wait complete. 2024-09-15T22:44:49.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:44:49.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.766+0000 7f9b83749640 1 Processor -- start 2024-09-15T22:44:49.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.766+0000 7f9b83749640 1 -- start start 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b83749640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c15b370 0x7f9b7c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b83749640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b83749640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7c15c970 con 0x7f9b7c06ef60 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b83749640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7c15fef0 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b83749640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c15bbb0 con 0x7f9b7c15b370 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49712/0 (socket says 172.21.15.134:49712) 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 -- 172.21.15.134:0/4230401842 learned_addr learned my addr 172.21.15.134:0/4230401842 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:49.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 -- 172.21.15.134:0/4230401842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c15b370 msgr2=0x7f9b7c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b814e5640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c15b370 0x7f9b7c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c15b370 0x7f9b7c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 -- 172.21.15.134:0/4230401842 >> v1:172.21.15.177:6789/0 conn(0x7f9b7c06ef60 legacy=0x7f9b7c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.767+0000 7f9b80ce4640 1 -- 172.21.15.134:0/4230401842 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c15be90 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.768+0000 7f9b80ce4640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009870 tx=0x7f9b6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04fcc66ecacdee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:49.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.768+0000 7f9b73fff640 1 -- 172.21.15.134:0/4230401842 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c037070 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.768+0000 7f9b73fff640 1 -- 172.21.15.134:0/4230401842 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c032440 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.768+0000 7f9b73fff640 1 -- 172.21.15.134:0/4230401842 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c032810 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 -- 172.21.15.134:0/4230401842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15f9f0 msgr2=0x7f9b7c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009870 tx=0x7f9b6c02a180 comp rx=0 tx=0).stop 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 -- 172.21.15.134:0/4230401842 shutdown_connections 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c06ea20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 --2- 172.21.15.134:0/4230401842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c15b370 0x7f9b7c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 -- 172.21.15.134:0/4230401842 >> 172.21.15.134:0/4230401842 conn(0x7f9b7c06bba0 msgr2=0x7f9b7c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 -- 172.21.15.134:0/4230401842 shutdown_connections 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.769+0000 7f9b83749640 1 -- 172.21.15.134:0/4230401842 wait complete. 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.770+0000 7f9b83749640 1 Processor -- start 2024-09-15T22:44:49.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.770+0000 7f9b83749640 1 -- start start 2024-09-15T22:44:49.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c06ef60 0x7f9b7c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0731b0 con 0x7f9b7c15b370 2024-09-15T22:44:49.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c15c450 con 0x7f9b7c15f9f0 2024-09-15T22:44:49.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b83749640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cf4a0 con 0x7f9b7c06ef60 2024-09-15T22:44:49.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49724/0 (socket says 172.21.15.134:49724) 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 -- 172.21.15.134:0/3756350250 learned_addr learned my addr 172.21.15.134:0/3756350250 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b81ce6640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b814e5640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c06ef60 0x7f9b7c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 -- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c06ef60 msgr2=0x7f9b7c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c06ef60 0x7f9b7c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 -- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 msgr2=0x7f9b7c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 -- 172.21.15.134:0/3756350250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c158960 con 0x7f9b7c15b370 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b81ce6640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.771+0000 7f9b80ce4640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0090b0 tx=0x7f9b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.772+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c041020 con 0x7f9b7c15b370 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.772+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c030990 con 0x7f9b7c15b370 2024-09-15T22:44:49.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.772+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c159c20 con 0x7f9b7c15b370 2024-09-15T22:44:49.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.772+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c037040 con 0x7f9b7c15b370 2024-09-15T22:44:49.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.772+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c158c00 con 0x7f9b7c15b370 2024-09-15T22:44:49.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.773+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7c15b750 con 0x7f9b7c15b370 2024-09-15T22:44:49.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.773+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f9b6c044020 con 0x7f9b7c15b370 2024-09-15T22:44:49.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.774+0000 7f9b71ffb640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 0x7f9b6006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.774+0000 7f9b814e5640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 0x7f9b6006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.774+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5357+0+0 (secure 0 0 0) 0x7f9b6c0ac220 con 0x7f9b7c15b370 2024-09-15T22:44:49.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.774+0000 7f9b814e5640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 0x7f9b6006ead0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006fd0 tx=0x7f9b78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:49.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.778+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b6c04b030 con 0x7f9b7c15b370 2024-09-15T22:44:49.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:49.945+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9b7c15ab70 con 0x7f9b7c15b370 2024-09-15T22:44:50.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.648+0000 7f9b71ffb640 1 -- 172.21.15.134:0/3756350250 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7f9b6c07a770 con 0x7f9b7c15b370 2024-09-15T22:44:50.649 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:44:50.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 msgr2=0x7f9b6006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 0x7f9b6006ead0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006fd0 tx=0x7f9b78008040 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 msgr2=0x7f9b7c14af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0090b0 tx=0x7f9b6c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 shutdown_connections 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9b6006c610 0x7f9b6006ead0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b7c15f9f0 0x7f9b7c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b7c15b370 0x7f9b7c14af50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 --2- 172.21.15.134:0/3756350250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b7c06ef60 0x7f9b7c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 >> 172.21.15.134:0/3756350250 conn(0x7f9b7c06bba0 msgr2=0x7f9b7c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 shutdown_connections 2024-09-15T22:44:50.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.652+0000 7f9b83749640 1 -- 172.21.15.134:0/3756350250 wait complete. 2024-09-15T22:44:50.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:44:50.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.776+0000 7fa085fd8640 1 Processor -- start 2024-09-15T22:44:50.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.776+0000 7fa085fd8640 1 -- start start 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa08015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa08015c400 0x7fa080162c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa08006e170 0x7fa08006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa0800b4830 con 0x7fa08006e170 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa08015f230 con 0x7fa08015c400 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa085fd8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa08015f510 con 0x7fa08015c020 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa08006e170 0x7fa08006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa08006e170 0x7fa08006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49732/0 (socket says 172.21.15.134:49732) 2024-09-15T22:44:50.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 -- 172.21.15.134:0/1208354360 learned_addr learned my addr 172.21.15.134:0/1208354360 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07effd640 1 --2- 172.21.15.134:0/1208354360 >> v2:172.21.15.177:3300/0 conn(0x7fa08015c400 0x7fa080162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07f7fe640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa08015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 -- 172.21.15.134:0/1208354360 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 msgr2=0x7fa08015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa08015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 -- 172.21.15.134:0/1208354360 >> v2:172.21.15.177:3300/0 conn(0x7fa08015c400 msgr2=0x7fa080162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 --2- 172.21.15.134:0/1208354360 >> v2:172.21.15.177:3300/0 conn(0x7fa08015c400 0x7fa080162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.777+0000 7fa07ffff640 1 -- 172.21.15.134:0/1208354360 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08015f7f0 con 0x7fa08006e170 2024-09-15T22:44:50.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.778+0000 7fa07ffff640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa08006bba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa080073100 tx=0x7fa07802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac77a05311a18f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.778+0000 7fa07e7fc640 1 -- 172.21.15.134:0/1208354360 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078036070 con 0x7fa08006e170 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.778+0000 7fa07e7fc640 1 -- 172.21.15.134:0/1208354360 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa078031600 con 0x7fa08006e170 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.778+0000 7fa07e7fc640 1 -- 172.21.15.134:0/1208354360 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780319d0 con 0x7fa08006e170 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 -- 172.21.15.134:0/1208354360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 msgr2=0x7fa08006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa08006bba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa080073100 tx=0x7fa07802a6a0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 -- 172.21.15.134:0/1208354360 shutdown_connections 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa08006bba0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 --2- 172.21.15.134:0/1208354360 >> v2:172.21.15.177:3300/0 conn(0x7fa08015c400 0x7fa080162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 --2- 172.21.15.134:0/1208354360 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa08015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 -- 172.21.15.134:0/1208354360 >> 172.21.15.134:0/1208354360 conn(0x7fa08006ccb0 msgr2=0x7fa08006d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:50.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 -- 172.21.15.134:0/1208354360 shutdown_connections 2024-09-15T22:44:50.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.779+0000 7fa085fd8640 1 -- 172.21.15.134:0/1208354360 wait complete. 2024-09-15T22:44:50.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.780+0000 7fa085fd8640 1 Processor -- start 2024-09-15T22:44:50.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.780+0000 7fa085fd8640 1 -- start start 2024-09-15T22:44:50.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa0801e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa08015c400 0x7fa0800720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa08006e740 con 0x7fa08006e170 2024-09-15T22:44:50.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa08006e5c0 con 0x7fa08015c400 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa085fd8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa08006c0e0 con 0x7fa08015c020 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49748/0 (socket says 172.21.15.134:49748) 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 -- 172.21.15.134:0/2629241368 learned_addr learned my addr 172.21.15.134:0/2629241368 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07effd640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa0801e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07ffff640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa08015c400 0x7fa0800720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 -- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 msgr2=0x7fa0801e8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa0801e8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.781+0000 7fa07f7fe640 1 -- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa08015c400 msgr2=0x7fa0800720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa07f7fe640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa08015c400 0x7fa0800720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa07f7fe640 1 -- 172.21.15.134:0/2629241368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0801e94e0 con 0x7fa08006e170 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa07f7fe640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa07000d800 tx=0x7fa07000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07000b6c0 con 0x7fa08006e170 2024-09-15T22:44:50.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070019070 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0801e97c0 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07000ba80 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.782+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0800cc1d0 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.783+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08006bba0 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.783+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fa07000bc20 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.784+0000 7fa067fff640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 0x7fa06c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.784+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7fa07008b9c0 con 0x7fa08006e170 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.784+0000 7fa07effd640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 0x7fa06c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.784+0000 7fa07effd640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 0x7fa06c06ead0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa0801f7910 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:50.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.788+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0700599d0 con 0x7fa08006e170 2024-09-15T22:44:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.951+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa08015ec30 con 0x7fa08006e170 2024-09-15T22:44:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.954+0000 7fa067fff640 1 -- 172.21.15.134:0/2629241368 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fa07005dcd0 con 0x7fa08006e170 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 msgr2=0x7fa06c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 0x7fa06c06ead0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa0801f7910 tx=0x7fa074008040 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 msgr2=0x7fa080156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa07000d800 tx=0x7fa07000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 shutdown_connections 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa06c06c610 0x7fa06c06ead0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa08015c400 0x7fa0800720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa08015c020 0x7fa0801e8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 --2- 172.21.15.134:0/2629241368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08006e170 0x7fa080156960 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 >> 172.21.15.134:0/2629241368 conn(0x7fa08006ccb0 msgr2=0x7fa08015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 shutdown_connections 2024-09-15T22:44:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:50.956+0000 7fa085fd8640 1 -- 172.21.15.134:0/2629241368 wait complete. 2024-09-15T22:44:50.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:44:51.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.065+0000 7f30d05d6640 1 Processor -- start 2024-09-15T22:44:51.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.065+0000 7f30d05d6640 1 -- start start 2024-09-15T22:44:51.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.066+0000 7f30d05d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30c80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.066+0000 7f30d05d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c80b7170 con 0x7f30c80cef90 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.066+0000 7f30d05d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c80b7aa0 con 0x7f30c815ed20 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.066+0000 7f30d05d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f30c80d3660 con 0x7f30c815e940 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ceb73640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f30c80cef90 0x7f30c80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45014/0 (socket says 172.21.15.134:45014) 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ceb73640 1 -- 172.21.15.134:0/1573326558 learned_addr learned my addr 172.21.15.134:0/1573326558 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30c80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140781300 0 0) 0x7f30c0001490 con 0x7f30c80cef90 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30b4003520 con 0x7f30c80cef90 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377217953 0 0) 0x7f30b4003520 con 0x7f30c80cef90 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 msgr2=0x7f30c80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30c80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 >> v1:172.21.15.177:6789/0 conn(0x7f30c815ed20 legacy=0x7f30c80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c80d3940 con 0x7f30c80cef90 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f30c0001bc0 con 0x7f30c80cef90 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 >> v1:172.21.15.134:6789/0 conn(0x7f30c80cef90 legacy=0x7f30c80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30b4004d40 0x7f30b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30c80d3660 con 0x7f30b40039e0 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30b400bb00 con 0x7f30b4004d40 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f30b400bd00 con 0x7f30c815e940 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ceb73640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30b4004d40 0x7f30b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30cdb71640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 -- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 msgr2=0x7f30b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c815e940 0x7f30b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 -- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30b4004d40 msgr2=0x7f30b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30b4004d40 0x7f30b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.067+0000 7f30ce372640 1 -- 172.21.15.134:0/1573326558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b4003520 con 0x7f30b40039e0 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.068+0000 7f30ceb73640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30b4004d40 0x7f30b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.068+0000 7f30ce372640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30b4003e00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009a90 tx=0x7f30b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7010f69d13b995 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.068+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4036070 con 0x7f30b40039e0 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.068+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4031400 con 0x7f30b40039e0 2024-09-15T22:44:51.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.068+0000 7f30cd370640 1 -- 172.21.15.134:0/1573326558 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4009690 con 0x7f30b40039e0 2024-09-15T22:44:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 -- 172.21.15.134:0/1573326558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 msgr2=0x7f30b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 --2- 172.21.15.134:0/1573326558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30b4003e00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009a90 tx=0x7f30b4005830 comp rx=0 tx=0).stop 2024-09-15T22:44:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30ceb73640 1 -- 172.21.15.134:0/1573326558 reap_dead start 2024-09-15T22:44:51.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 -- 172.21.15.134:0/1573326558 shutdown_connections 2024-09-15T22:44:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 -- 172.21.15.134:0/1573326558 >> 172.21.15.134:0/1573326558 conn(0x7f30c80b6240 msgr2=0x7f30c80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 -- 172.21.15.134:0/1573326558 shutdown_connections 2024-09-15T22:44:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.069+0000 7f30d05d6640 1 -- 172.21.15.134:0/1573326558 wait complete. 2024-09-15T22:44:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.070+0000 7f30d05d6640 1 Processor -- start 2024-09-15T22:44:51.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.070+0000 7f30d05d6640 1 -- start start 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c81549c0 0x7f30c8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c8155380 0x7f30c8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30c80d3310 con 0x7f30b40039e0 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30c80d3f00 con 0x7f30c81549c0 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30d05d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f30c80d1ef0 con 0x7f30c8155380 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49770/0 (socket says 172.21.15.134:49770) 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 -- 172.21.15.134:0/2061658614 learned_addr learned my addr 172.21.15.134:0/2061658614 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ceb73640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c8155380 0x7f30c8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30cdb71640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c81549c0 0x7f30c8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 -- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c8155380 msgr2=0x7f30c8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c8155380 0x7f30c8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 -- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c81549c0 msgr2=0x7f30c8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c81549c0 0x7f30c8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 -- 172.21.15.134:0/2061658614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c8157ae0 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.071+0000 7f30ce372640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009a90 tx=0x7f30c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.072+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4040020 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.072+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4003bc0 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.072+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c8157da0 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.072+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4036040 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.072+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c8158360 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.073+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c80d1060 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.073+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f30c4043020 con 0x7f30b40039e0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.074+0000 7f30beffd640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 0x7f30ac06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.074+0000 7f30cdb71640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 0x7f30ac06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.074+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f30c40ab6c0 con 0x7f30b40039e0 2024-09-15T22:44:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.074+0000 7f30cdb71640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 0x7f30ac06eb00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f30c80b6210 tx=0x7f30b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.078+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30c404a070 con 0x7f30b40039e0 2024-09-15T22:44:51.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.304+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f30c80ba6b0 con 0x7f30b40039e0 2024-09-15T22:44:51.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:44:51.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:44:51.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.657+0000 7f30beffd640 1 -- 172.21.15.134:0/2061658614 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v192) ==== 161+0+0 (secure 0 0 0) 0x7f30c40044e0 con 0x7f30b40039e0 2024-09-15T22:44:51.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.659+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 msgr2=0x7f30ac06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.659+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 0x7f30ac06eb00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f30c80b6210 tx=0x7f30b8009040 comp rx=0 tx=0).stop 2024-09-15T22:44:51.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.659+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 msgr2=0x7f30c81575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.659+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009a90 tx=0x7f30c4004730 comp rx=0 tx=0).stop 2024-09-15T22:44:51.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 shutdown_connections 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f30ac06c640 0x7f30ac06eb00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30c8155380 0x7f30c8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c81549c0 0x7f30c8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 --2- 172.21.15.134:0/2061658614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40039e0 0x7f30c81575a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 >> 172.21.15.134:0/2061658614 conn(0x7f30c80b6240 msgr2=0x7f30c80cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 shutdown_connections 2024-09-15T22:44:51.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.660+0000 7f30d05d6640 1 -- 172.21.15.134:0/2061658614 wait complete. 2024-09-15T22:44:51.672 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-15T22:44:51.672 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:44:51.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:51.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.811+0000 7f0cdac8d640 1 Processor -- start 2024-09-15T22:44:51.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.811+0000 7f0cdac8d640 1 -- start start 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cdac8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cd40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cdac8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0cd406c1f0 0x7f0cd415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cdac8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd40cd5f0 con 0x7f0cd4151540 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cdac8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd40cd8d0 con 0x7f0cd406c1f0 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cdac8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd40cdbb0 con 0x7f0cd406be10 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd922a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0cd4151540 0x7f0cd415e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45020/0 (socket says 172.21.15.134:45020) 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd922a640 1 -- 172.21.15.134:0/795052183 learned_addr learned my addr 172.21.15.134:0/795052183 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cd40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> v2:172.21.15.177:3300/0 conn(0x7f0cd406c1f0 0x7f0cd415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499740109 0 0) 0x7f0cd40cd5f0 con 0x7f0cd4151540 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.812+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cc4004630 con 0x7f0cd4151540 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300867153 0 0) 0x7f0cc4004630 con 0x7f0cd4151540 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 msgr2=0x7f0cd40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cd40cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 >> v2:172.21.15.177:3300/0 conn(0x7f0cd406c1f0 msgr2=0x7f0cd415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 --2- 172.21.15.134:0/795052183 >> v2:172.21.15.177:3300/0 conn(0x7f0cd406c1f0 0x7f0cd415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd40cde90 con 0x7f0cd4151540 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0ccc0019f0 con 0x7f0cd4151540 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> v2:172.21.15.177:3300/0 conn(0x7f0cd406c1f0 0x7f0cd415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 >> v1:172.21.15.134:6789/0 conn(0x7f0cd4151540 legacy=0x7f0cd415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cc4004ac0 0x7f0cc4004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cc4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cc40062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd40cd8d0 con 0x7f0cc4005910 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd40cdbb0 con 0x7f0cc4004ac0 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc400cad0 con 0x7f0cd406be10 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cc4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cc4004ac0 0x7f0cc4004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd922a640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cc40062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 -- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 msgr2=0x7f0cc40062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd406be10 0x7f0cc40062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 -- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cc4004ac0 msgr2=0x7f0cc4004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cc4004ac0 0x7f0cc4004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd3fff640 1 -- 172.21.15.134:0/795052183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4004630 con 0x7f0cc4005910 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.813+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cc4004ac0 0x7f0cc4004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cc4005d90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009c60 tx=0x7f0cc4006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801338c6dba15fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0009860 con 0x7f0cc4005910 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0004020 con 0x7f0cc4005910 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cd37fe640 1 -- 172.21.15.134:0/795052183 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00043f0 con 0x7f0cc4005910 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cdac8d640 1 -- 172.21.15.134:0/795052183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 msgr2=0x7f0cc4005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/795052183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cc4005d90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009c60 tx=0x7f0cc4006940 comp rx=0 tx=0).stop 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.814+0000 7f0cd922a640 1 -- 172.21.15.134:0/795052183 reap_dead start 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.815+0000 7f0cdac8d640 1 -- 172.21.15.134:0/795052183 shutdown_connections 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.815+0000 7f0cdac8d640 1 -- 172.21.15.134:0/795052183 >> 172.21.15.134:0/795052183 conn(0x7f0cd4062cc0 msgr2=0x7f0cd406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.815+0000 7f0cdac8d640 1 -- 172.21.15.134:0/795052183 shutdown_connections 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.815+0000 7f0cdac8d640 1 -- 172.21.15.134:0/795052183 wait complete. 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.816+0000 7f0cdac8d640 1 Processor -- start 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.816+0000 7f0cdac8d640 1 -- start start 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd40ae8e0 0x7f0cd40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 0x7f0cd40725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd40cd010 con 0x7f0cc4005910 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd40ce690 con 0x7f0cd4072140 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd40cd190 con 0x7f0cd40ae8e0 2024-09-15T22:44:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49780/0 (socket says 172.21.15.134:49780) 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 -- 172.21.15.134:0/781571492 learned_addr learned my addr 172.21.15.134:0/781571492 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd922a640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 0x7f0cd40725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 -- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd40ae8e0 msgr2=0x7f0cd40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd40ae8e0 0x7f0cd40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 -- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 msgr2=0x7f0cd40725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 0x7f0cd40725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 -- 172.21.15.134:0/781571492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd415bdc0 con 0x7f0cc4005910 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd922a640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 0x7f0cd40725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd8a29640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80116d0 tx=0x7f0cc8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800f9c0 con 0x7f0cc4005910 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc800fb60 con 0x7f0cc4005910 2024-09-15T22:44:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8015460 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd415c0a0 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.817+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd415c660 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.818+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd40afd90 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.819+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f0cc8015600 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.819+0000 7f0cd17fa640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 0x7f0cb806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.819+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 0x7f0cb806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.819+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f0cc808be80 con 0x7f0cc4005910 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.820+0000 7f0cd3fff640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 0x7f0cb806ead0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0032000 tx=0x7f0cc002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.824+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cc8019030 con 0x7f0cc4005910 2024-09-15T22:44:51.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.992+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cd40b4520 con 0x7f0cc4005910 2024-09-15T22:44:51.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.993+0000 7f0cd17fa640 1 -- 172.21.15.134:0/781571492 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13070 (secure 0 0 0) 0x7f0cc805a570 con 0x7f0cc4005910 2024-09-15T22:44:51.994 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:51.994 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":64,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:50.647798+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6837/3316659079":"2024-09-16T22:44:47.640468+0000","172.21.15.134:6834/3316659079":"2024-09-16T22:44:47.640468+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:51.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 msgr2=0x7f0cb806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 0x7f0cb806ead0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0032000 tx=0x7f0cc002e000 comp rx=0 tx=0).stop 2024-09-15T22:44:51.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 msgr2=0x7f0cd4145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80116d0 tx=0x7f0cc8011b90 comp rx=0 tx=0).stop 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 shutdown_connections 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0cb806c610 0x7f0cb806ead0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd4072140 0x7f0cd40725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0cd40ae8e0 0x7f0cd40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 --2- 172.21.15.134:0/781571492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc4005910 0x7f0cd4145e50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 >> 172.21.15.134:0/781571492 conn(0x7f0cd4062cc0 msgr2=0x7f0cd40b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 shutdown_connections 2024-09-15T22:44:51.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:51.995+0000 7f0cdac8d640 1 -- 172.21.15.134:0/781571492 wait complete. 2024-09-15T22:44:52.007 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:44:52.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:44:52.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.109+0000 7f60a099f640 1 Processor -- start 2024-09-15T22:44:52.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.109+0000 7f60a099f640 1 -- start start 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f60a099f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f609c06bf60 0x7f609c06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f60a099f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c0b8180 0x7f609c0b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f60a099f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c0cfc80 con 0x7f609c161ca0 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f60a099f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f609c06c8a0 con 0x7f609c0b8180 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f60a099f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f609c0d3cb0 con 0x7f609c06bf60 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c0b8180 0x7f609c0b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c0b8180 0x7f609c0b85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49788/0 (socket says 172.21.15.134:49788) 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 -- 172.21.15.134:0/4252043469 learned_addr learned my addr 172.21.15.134:0/4252043469 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609affd640 1 --2- 172.21.15.134:0/4252043469 >> v2:172.21.15.177:3300/0 conn(0x7f609c06bf60 0x7f609c06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 -- 172.21.15.134:0/4252043469 >> v2:172.21.15.177:3300/0 conn(0x7f609c06bf60 msgr2=0x7f609c06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 --2- 172.21.15.134:0/4252043469 >> v2:172.21.15.177:3300/0 conn(0x7f609c06bf60 0x7f609c06c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 -- 172.21.15.134:0/4252043469 >> v1:172.21.15.177:6789/0 conn(0x7f609c161ca0 legacy=0x7f609c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.110+0000 7f609bfff640 1 -- 172.21.15.134:0/4252043469 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0d3f70 con 0x7f609c0b8180 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.111+0000 7f609bfff640 1 --2- 172.21.15.134:0/4252043469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0b8180 0x7f609c0b85b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f609c0d0000 tx=0x7f609402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d382534ad834ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.111+0000 7f609a7fc640 1 -- 172.21.15.134:0/4252043469 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094036070 con 0x7f609c0b8180 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.111+0000 7f609a7fc640 1 -- 172.21.15.134:0/4252043469 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094031600 con 0x7f609c0b8180 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.111+0000 7f609a7fc640 1 -- 172.21.15.134:0/4252043469 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60940319d0 con 0x7f609c0b8180 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 -- 172.21.15.134:0/4252043469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0b8180 msgr2=0x7f609c0b85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 --2- 172.21.15.134:0/4252043469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0b8180 0x7f609c0b85b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f609c0d0000 tx=0x7f609402a730 comp rx=0 tx=0).stop 2024-09-15T22:44:52.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 -- 172.21.15.134:0/4252043469 shutdown_connections 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 --2- 172.21.15.134:0/4252043469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0b8180 0x7f609c0b85b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 --2- 172.21.15.134:0/4252043469 >> v2:172.21.15.177:3300/0 conn(0x7f609c06bf60 0x7f609c06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 -- 172.21.15.134:0/4252043469 >> 172.21.15.134:0/4252043469 conn(0x7f609c0d45a0 msgr2=0x7f609c0d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 -- 172.21.15.134:0/4252043469 shutdown_connections 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.112+0000 7f60a099f640 1 -- 172.21.15.134:0/4252043469 wait complete. 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.113+0000 7f60a099f640 1 Processor -- start 2024-09-15T22:44:52.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.113+0000 7f60a099f640 1 -- start start 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f609c06bf60 0x7f609c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 0x7f609c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0b7c60 con 0x7f609c161ca0 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0b7980 con 0x7f609c0b8180 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f60a099f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f609c162080 con 0x7f609c06bf60 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49796/0 (socket says 172.21.15.134:49796) 2024-09-15T22:44:52.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 -- 172.21.15.134:0/2296461538 learned_addr learned my addr 172.21.15.134:0/2296461538 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609affd640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 0x7f609c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609b7fe640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f609c06bf60 0x7f609c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 -- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f609c06bf60 msgr2=0x7f609c0b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f609c06bf60 0x7f609c0b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 -- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 msgr2=0x7f609c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 0x7f609c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 -- 172.21.15.134:0/2296461538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0b5f00 con 0x7f609c161ca0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609affd640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 0x7f609c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.114+0000 7f609bfff640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6094034040 tx=0x7f6094004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.115+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094036050 con 0x7f609c161ca0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.115+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094042070 con 0x7f609c161ca0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.115+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c0b61e0 con 0x7f609c161ca0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.115+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094009510 con 0x7f609c161ca0 2024-09-15T22:44:52.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.115+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c0b67a0 con 0x7f609c161ca0 2024-09-15T22:44:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.116+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609c0b7630 con 0x7f609c161ca0 2024-09-15T22:44:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.116+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f6094007bf0 con 0x7f609c161ca0 2024-09-15T22:44:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.117+0000 7f6083fff640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 0x7f608806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.117+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f60940ac4b0 con 0x7f609c161ca0 2024-09-15T22:44:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.117+0000 7f609b7fe640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 0x7f608806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.117+0000 7f609b7fe640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 0x7f608806ead0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f608c001780 tx=0x7f608c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.121+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f609407aa00 con 0x7f609c161ca0 2024-09-15T22:44:52.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.285+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f609c0cf880 con 0x7f609c161ca0 2024-09-15T22:44:52.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.285+0000 7f6083fff640 1 -- 172.21.15.134:0/2296461538 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f609407a300 con 0x7f609c161ca0 2024-09-15T22:44:52.287 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 msgr2=0x7f608806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 0x7f608806ead0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f608c001780 tx=0x7f608c009040 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 msgr2=0x7f609c1f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6094034040 tx=0x7f6094004a40 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 shutdown_connections 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f608806c610 0x7f608806ead0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c161ca0 0x7f609c1f30c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f609c0b8180 0x7f609c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 --2- 172.21.15.134:0/2296461538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f609c06bf60 0x7f609c0b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 >> 172.21.15.134:0/2296461538 conn(0x7f609c0d45a0 msgr2=0x7f609c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 shutdown_connections 2024-09-15T22:44:52.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.287+0000 7f60a099f640 1 -- 172.21.15.134:0/2296461538 wait complete. 2024-09-15T22:44:52.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-15T22:44:52.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.397+0000 7f63a0274640 1 Processor -- start 2024-09-15T22:44:52.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.397+0000 7f63a0274640 1 -- start start 2024-09-15T22:44:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f63a0274640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f639815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f63a0274640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639815d390 con 0x7f639815ce80 2024-09-15T22:44:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f63a0274640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639815d670 con 0x7f63980d02a0 2024-09-15T22:44:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f63a0274640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f639815d950 con 0x7f639815ca40 2024-09-15T22:44:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f639e811640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f639815ce80 0x7f63981594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45022/0 (socket says 172.21.15.134:45022) 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f639e811640 1 -- 172.21.15.134:0/3210041378 learned_addr learned my addr 172.21.15.134:0/3210041378 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f639d80f640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f639815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711992703 0 0) 0x7f639815d390 con 0x7f639815ce80 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.398+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6384003520 con 0x7f639815ce80 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885628402 0 0) 0x7f639815d670 con 0x7f63980d02a0 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639815d390 con 0x7f63980d02a0 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2286640137 0 0) 0x7f6384003520 con 0x7f639815ce80 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 msgr2=0x7f639815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f639815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 >> v1:172.21.15.177:6789/0 conn(0x7f63980d02a0 legacy=0x7f63980d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639815dc30 con 0x7f639815ce80 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f63900019f0 con 0x7f639815ce80 2024-09-15T22:44:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 >> v1:172.21.15.134:6789/0 conn(0x7f639815ce80 legacy=0x7f63981594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6384003b70 0x7f6384003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6384004800 0x7f6384004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f63840051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f639815d950 con 0x7f6384003b70 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f638400dce0 con 0x7f6384004800 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f638400dee0 con 0x7f639815ca40 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6384003b70 0x7f6384003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d80f640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6384004800 0x7f6384004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e811640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f63840051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 -- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 msgr2=0x7f63840051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f63840051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 -- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6384004800 msgr2=0x7f6384004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6384004800 0x7f6384004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e010640 1 -- 172.21.15.134:0/3210041378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6384003520 con 0x7f6384003b70 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639d80f640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6384004800 0x7f6384004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.399+0000 7f639e811640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f639815ca40 0x7f63840051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f639e010640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6384003b70 0x7f6384003f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f63940018d0 tx=0x7f6384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bd19e282eb298e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63940014f0 con 0x7f6384003b70 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63940052d0 con 0x7f6384003b70 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f639d00e640 1 -- 172.21.15.134:0/3210041378 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639402aca0 con 0x7f6384003b70 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f63a0274640 1 -- 172.21.15.134:0/3210041378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6384003b70 msgr2=0x7f6384003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f63a0274640 1 --2- 172.21.15.134:0/3210041378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6384003b70 0x7f6384003f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f63940018d0 tx=0x7f6384005830 comp rx=0 tx=0).stop 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.400+0000 7f639e811640 1 -- 172.21.15.134:0/3210041378 reap_dead start 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.401+0000 7f63a0274640 1 -- 172.21.15.134:0/3210041378 shutdown_connections 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.401+0000 7f63a0274640 1 -- 172.21.15.134:0/3210041378 >> 172.21.15.134:0/3210041378 conn(0x7f6398062cc0 msgr2=0x7f639806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.401+0000 7f63a0274640 1 -- 172.21.15.134:0/3210041378 shutdown_connections 2024-09-15T22:44:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.401+0000 7f63a0274640 1 -- 172.21.15.134:0/3210041378 wait complete. 2024-09-15T22:44:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.402+0000 7f63a0274640 1 Processor -- start 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.402+0000 7f63a0274640 1 -- start start 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.402+0000 7f63a0274640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 0x7f63981f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.402+0000 7f63a0274640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6398151da0 0x7f63980cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6398155d10 con 0x7f6398158170 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6398155b90 con 0x7f6398151da0 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63980b4790 con 0x7f6384003b70 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49816/0 (socket says 172.21.15.134:49816) 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 -- 172.21.15.134:0/797618170 learned_addr learned my addr 172.21.15.134:0/797618170 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639e811640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6398151da0 0x7f63980cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639e010640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 0x7f63981f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 -- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 msgr2=0x7f63981f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 0x7f63981f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 -- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6398151da0 msgr2=0x7f63980cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6398151da0 0x7f63980cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 -- 172.21.15.134:0/797618170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6398158850 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639e010640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 0x7f63981f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f639d80f640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6388011730 tx=0x7f6388011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638800f8e0 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638800fa80 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63981f36c0 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638800fe70 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.403+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6398158b30 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.404+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63980d0680 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.405+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f6388015460 con 0x7f6398158170 2024-09-15T22:44:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.405+0000 7f638effd640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 0x7f637c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.405+0000 7f639e010640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 0x7f637c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.405+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f638808beb0 con 0x7f6398158170 2024-09-15T22:44:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.406+0000 7f639e010640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 0x7f637c06eb00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6394032000 tx=0x7f6394009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.410+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6388019030 con 0x7f6398158170 2024-09-15T22:44:52.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.636+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7f63980cd9c0 con 0x7f6398158170 2024-09-15T22:44:52.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.659+0000 7f638effd640 1 -- 172.21.15.134:0/797618170 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v193) ==== 134+0+0 (secure 0 0 0) 0x7f638805a510 con 0x7f6398158170 2024-09-15T22:44:52.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 msgr2=0x7f637c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 0x7f637c06eb00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6394032000 tx=0x7f6394009030 comp rx=0 tx=0).stop 2024-09-15T22:44:52.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 msgr2=0x7f63981f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6388011730 tx=0x7f6388011bf0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 shutdown_connections 2024-09-15T22:44:52.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f637c06c640 0x7f637c06eb00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6398151da0 0x7f63980cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398158170 0x7f63981f0b40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 --2- 172.21.15.134:0/797618170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6384003b70 0x7f63981f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 >> 172.21.15.134:0/797618170 conn(0x7f6398062cc0 msgr2=0x7f63980b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 shutdown_connections 2024-09-15T22:44:52.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.661+0000 7f63a0274640 1 -- 172.21.15.134:0/797618170 wait complete. 2024-09-15T22:44:52.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:44:52.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.775+0000 7fa03bda6640 1 Processor -- start 2024-09-15T22:44:52.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.775+0000 7fa03bda6640 1 -- start start 2024-09-15T22:44:52.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa03bda6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa03415c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa03bda6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0340b5500 con 0x7fa034158e50 2024-09-15T22:44:52.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa03bda6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0340b43f0 con 0x7fa03406f130 2024-09-15T22:44:52.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa03bda6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa0340b3630 con 0x7fa0340b5050 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa039b42640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa034158e50 0x7fa03406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45024/0 (socket says 172.21.15.134:45024) 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa039b42640 1 -- 172.21.15.134:0/108755450 learned_addr learned my addr 172.21.15.134:0/108755450 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392072095 0 0) 0x7fa030001110 con 0x7fa034158e50 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa03a343640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa03415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.776+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa020003520 con 0x7fa034158e50 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3309523130 0 0) 0x7fa020003520 con 0x7fa034158e50 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 msgr2=0x7fa03415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa03415c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 >> v1:172.21.15.177:6789/0 conn(0x7fa03406f130 legacy=0x7fa0340ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0340b3910 con 0x7fa034158e50 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa030001840 con 0x7fa034158e50 2024-09-15T22:44:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 >> v1:172.21.15.134:6789/0 conn(0x7fa034158e50 legacy=0x7fa03406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa0200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa020003f60 0x7fa020004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020004d40 0x7fa0200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0340b3630 con 0x7fa020003f60 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa02000baa0 con 0x7fa020004d40 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa02000deb0 con 0x7fa0340b5050 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa020003f60 0x7fa020004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039b42640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa0200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa03a343640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020004d40 0x7fa0200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 -- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 msgr2=0x7fa0200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0340b5050 0x7fa0200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 -- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020004d40 msgr2=0x7fa0200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020004d40 0x7fa0200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.777+0000 7fa039341640 1 -- 172.21.15.134:0/108755450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa020003520 con 0x7fa020003f60 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.778+0000 7fa039341640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa020003f60 0x7fa020004800 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0340cc940 tx=0x7fa020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9e1802d5fed6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.778+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240013c0 con 0x7fa020003f60 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.778+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0240052d0 con 0x7fa020003f60 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.778+0000 7fa038b40640 1 -- 172.21.15.134:0/108755450 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02402a890 con 0x7fa020003f60 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 -- 172.21.15.134:0/108755450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa020003f60 msgr2=0x7fa020004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 --2- 172.21.15.134:0/108755450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa020003f60 0x7fa020004800 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0340cc940 tx=0x7fa020005830 comp rx=0 tx=0).stop 2024-09-15T22:44:52.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03a343640 1 -- 172.21.15.134:0/108755450 reap_dead start 2024-09-15T22:44:52.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 -- 172.21.15.134:0/108755450 shutdown_connections 2024-09-15T22:44:52.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 -- 172.21.15.134:0/108755450 >> 172.21.15.134:0/108755450 conn(0x7fa03406bba0 msgr2=0x7fa03406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 -- 172.21.15.134:0/108755450 shutdown_connections 2024-09-15T22:44:52.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.779+0000 7fa03bda6640 1 -- 172.21.15.134:0/108755450 wait complete. 2024-09-15T22:44:52.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.780+0000 7fa03bda6640 1 Processor -- start 2024-09-15T22:44:52.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.780+0000 7fa03bda6640 1 -- start start 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 0x7fa0341448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 0x7fa0341f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa034159230 con 0x7fa0341f1180 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa0340b3ed0 con 0x7fa020003f60 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa03415c370 con 0x7fa0341f0430 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49850/0 (socket says 172.21.15.134:49850) 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 -- 172.21.15.134:0/128181624 learned_addr learned my addr 172.21.15.134:0/128181624 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03a343640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 0x7fa0341f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039b42640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 0x7fa0341448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 -- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 msgr2=0x7fa0341f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 0x7fa0341f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 -- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 msgr2=0x7fa0341448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 0x7fa0341448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 -- 172.21.15.134:0/128181624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa034147fe0 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039b42640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 0x7fa0341448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03a343640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 0x7fa0341f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa039341640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa02402a540 tx=0x7fa024001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02403f020 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0240050d0 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0341f0e20 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024006a40 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.781+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0340af000 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.782+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03415c750 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.783+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fa024042020 con 0x7fa0341f1180 2024-09-15T22:44:52.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.783+0000 7fa02a7fc640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 0x7fa01806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.783+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7fa0240ab270 con 0x7fa0341f1180 2024-09-15T22:44:52.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.783+0000 7fa039b42640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 0x7fa01806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.784+0000 7fa039b42640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 0x7fa01806eb00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa030001050 tx=0x7fa030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.788+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa024049030 con 0x7fa0341f1180 2024-09-15T22:44:52.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.953+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa0340cf0f0 con 0x7fa0341f1180 2024-09-15T22:44:52.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.958+0000 7fa02a7fc640 1 -- 172.21.15.134:0/128181624 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fa034147fe0 con 0x7fa0341f1180 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 msgr2=0x7fa01806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 0x7fa01806eb00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa030001050 tx=0x7fa030009040 comp rx=0 tx=0).stop 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 msgr2=0x7fa034147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa02402a540 tx=0x7fa024001170 comp rx=0 tx=0).stop 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 shutdown_connections 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa01806c640 0x7fa01806eb00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0341f0430 0x7fa0341f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0341f1180 0x7fa034147aa0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 --2- 172.21.15.134:0/128181624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa020003f60 0x7fa0341448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 >> 172.21.15.134:0/128181624 conn(0x7fa03406bba0 msgr2=0x7fa034071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.960+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 shutdown_connections 2024-09-15T22:44:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:52.961+0000 7fa03bda6640 1 -- 172.21.15.134:0/128181624 wait complete. 2024-09-15T22:44:52.973 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:44:52.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:53.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:44:53.067 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:44:53.067 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:53.067 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:53.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:53.083 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:53.083 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:53.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:53.102 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:44:53.102 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:53.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:44:53.139 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:44:53.139 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:53.160 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:44:53.160 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:44:53.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:44:53.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.275+0000 7f897f4ba640 1 Processor -- start 2024-09-15T22:44:53.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 -- start start 2024-09-15T22:44:53.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f897815e940 0x7f89780d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f89780cef90 0x7f89780d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89780b7170 con 0x7f897815ed20 2024-09-15T22:44:53.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f89780d1ae0 con 0x7f897815e940 2024-09-15T22:44:53.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.276+0000 7f897f4ba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f89780b7aa0 con 0x7f89780cef90 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f897815e940 0x7f89780d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f897815e940 0x7f89780d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49856/0 (socket says 172.21.15.134:49856) 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 -- 172.21.15.134:0/3972312551 learned_addr learned my addr 172.21.15.134:0/3972312551 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897da57640 1 --2- 172.21.15.134:0/3972312551 >> v2:172.21.15.177:3300/0 conn(0x7f89780cef90 0x7f89780d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 -- 172.21.15.134:0/3972312551 >> v2:172.21.15.177:3300/0 conn(0x7f89780cef90 msgr2=0x7f89780d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 --2- 172.21.15.134:0/3972312551 >> v2:172.21.15.177:3300/0 conn(0x7f89780cef90 0x7f89780d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 -- 172.21.15.134:0/3972312551 >> v1:172.21.15.177:6789/0 conn(0x7f897815ed20 legacy=0x7f89780b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:53.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 -- 172.21.15.134:0/3972312551 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89780d3660 con 0x7f897815e940 2024-09-15T22:44:53.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.277+0000 7f897d256640 1 --2- 172.21.15.134:0/3972312551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815e940 0x7f89780d1060 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f897806d070 tx=0x7f897002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1134520bbf1c2ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f896ffff640 1 -- 172.21.15.134:0/3972312551 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970036070 con 0x7f897815e940 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f896ffff640 1 -- 172.21.15.134:0/3972312551 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8970031600 con 0x7f897815e940 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f896ffff640 1 -- 172.21.15.134:0/3972312551 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700319d0 con 0x7f897815e940 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 -- 172.21.15.134:0/3972312551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815e940 msgr2=0x7f89780d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 --2- 172.21.15.134:0/3972312551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815e940 0x7f89780d1060 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f897806d070 tx=0x7f897002a780 comp rx=0 tx=0).stop 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 -- 172.21.15.134:0/3972312551 shutdown_connections 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 --2- 172.21.15.134:0/3972312551 >> v2:172.21.15.177:3300/0 conn(0x7f89780cef90 0x7f89780d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 --2- 172.21.15.134:0/3972312551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815e940 0x7f89780d1060 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 -- 172.21.15.134:0/3972312551 >> 172.21.15.134:0/3972312551 conn(0x7f89780b6240 msgr2=0x7f89780b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 -- 172.21.15.134:0/3972312551 shutdown_connections 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.278+0000 7f897f4ba640 1 -- 172.21.15.134:0/3972312551 wait complete. 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.279+0000 7f897f4ba640 1 Processor -- start 2024-09-15T22:44:53.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.279+0000 7f897f4ba640 1 -- start start 2024-09-15T22:44:53.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89780cef90 0x7f89781591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 0x7f89780ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89780d3f00 con 0x7f897815ed20 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f89780d3c20 con 0x7f89780cef90 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897f4ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f89780d3310 con 0x7f897815e940 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897da57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897da57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49858/0 (socket says 172.21.15.134:49858) 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897da57640 1 -- 172.21.15.134:0/1435575865 learned_addr learned my addr 172.21.15.134:0/1435575865 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897d256640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89780cef90 0x7f89781591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.280+0000 7f897ca55640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 0x7f89780ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 -- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 msgr2=0x7f89780ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 0x7f89780ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 -- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89780cef90 msgr2=0x7f89781591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89780cef90 0x7f89781591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 -- 172.21.15.134:0/1435575865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897815ad60 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897ca55640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 0x7f89780ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897da57640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f897400d5d0 tx=0x7f897400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740125f0 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974019070 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740129f0 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8978159780 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.281+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8978159d40 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.282+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89780d1ef0 con 0x7f897815ed20 2024-09-15T22:44:53.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.282+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f8974012b90 con 0x7f897815ed20 2024-09-15T22:44:53.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.283+0000 7f896dffb640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.283+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f897408b970 con 0x7f897815ed20 2024-09-15T22:44:53.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.283+0000 7f897d256640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.283+0000 7f897d256640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8970033000 tx=0x7f8970009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.287+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8974059fe0 con 0x7f897815ed20 2024-09-15T22:44:53.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.484+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89780ba6b0 con 0x7f897815ed20 2024-09-15T22:44:53.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.484+0000 7f896dffb640 1 -- 172.21.15.134:0/1435575865 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3923 (secure 0 0 0) 0x7f897405ee20 con 0x7f897815ed20 2024-09-15T22:44:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:53.486 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":32,"btime":"2024-09-15T22:44:48:642194+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1953048186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1953048186},{"type":"v1","addr":"172.21.15.177:6834","nonce":1953048186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3996638451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3996638451},{"type":"v1","addr":"172.21.15.177:6835","nonce":3996638451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3979474619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":3979474619},{"type":"v1","addr":"172.21.15.134:6836","nonce":3979474619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":6036,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2032422748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2032422748},{"type":"v1","addr":"172.21.15.134:6837","nonce":2032422748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-09-15T22:44:53.486 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 32 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.486+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 msgr2=0x7f895c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.486+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8970033000 tx=0x7f8970009000 comp rx=0 tx=0).stop 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.486+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 msgr2=0x7f897815a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.486+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f897400d5d0 tx=0x7f897400da90 comp rx=0 tx=0).stop 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 shutdown_connections 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897815ed20 0x7f897815a820 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897815e940 0x7f89780ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 --2- 172.21.15.134:0/1435575865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89780cef90 0x7f89781591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 >> 172.21.15.134:0/1435575865 conn(0x7f89780b6240 msgr2=0x7f89780b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 shutdown_connections 2024-09-15T22:44:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.487+0000 7f897f4ba640 1 -- 172.21.15.134:0/1435575865 wait complete. 2024-09-15T22:44:53.499 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:44:53.499 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:44:53.500 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:44:53.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:53.500 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:44:53.500 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:44:53.501 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:44:53.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:53.501 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:44:53.501 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:44:53.501 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:44:53.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:53.501 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:44:53.501 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:44:53.502 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:44:53.502 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:44:53.509 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:44:53.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:44:53.510 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:44:53.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:44:53.513 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:44:53.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:44:53.515 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:44:53.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:44:53.553 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:44:53.553 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:53.554 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:44:53.554 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:53.556 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:44:53.557 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:53.557 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:44:53.557 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:53.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:44:53.627 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:44:53.628 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:44:53.642 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:44:53.642 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:44:53.643 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-09-15T22:44:53.641+0000 7fce8c761640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.660+0000 7f897625e640 1 Processor -- start 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.660+0000 7f897625e640 1 -- start start 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f897625e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015e940 0x7f89700d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f897625e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f897015ed20 0x7f89700d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f897625e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89700b7170 con 0x7f89700cef90 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f897625e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f89700d1ae0 con 0x7f897015ed20 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f897625e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f89700b7aa0 con 0x7f897015e940 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f897015ed20 0x7f89700d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f89700cef90 0x7f89700b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45048/0 (socket says 172.21.15.134:45048) 2024-09-15T22:44:53.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896ffff640 1 -- 172.21.15.134:0/1103724944 learned_addr learned my addr 172.21.15.134:0/1103724944 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896f7fe640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015e940 0x7f89700d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896effd640 1 -- 172.21.15.134:0/1103724944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015e940 msgr2=0x7f89700d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896effd640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015e940 0x7f89700d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896effd640 1 -- 172.21.15.134:0/1103724944 >> v1:172.21.15.134:6789/0 conn(0x7f89700cef90 legacy=0x7f89700b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.661+0000 7f896effd640 1 -- 172.21.15.134:0/1103724944 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700d3660 con 0x7f897015ed20 2024-09-15T22:44:53.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.662+0000 7f896effd640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897015ed20 0x7f89700d15a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f89640097a0 tx=0x7f896402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf226722fabc1e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.667+0000 7f896e7fc640 1 -- 172.21.15.134:0/1103724944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964037070 con 0x7f897015ed20 2024-09-15T22:44:53.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f896e7fc640 1 -- 172.21.15.134:0/1103724944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8964032440 con 0x7f897015ed20 2024-09-15T22:44:53.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f896e7fc640 1 -- 172.21.15.134:0/1103724944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964032810 con 0x7f897015ed20 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 -- 172.21.15.134:0/1103724944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897015ed20 msgr2=0x7f89700d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897015ed20 0x7f89700d15a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f89640097a0 tx=0x7f896402a210 comp rx=0 tx=0).stop 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 -- 172.21.15.134:0/1103724944 shutdown_connections 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f897015ed20 0x7f89700d15a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 --2- 172.21.15.134:0/1103724944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015e940 0x7f89700d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 -- 172.21.15.134:0/1103724944 >> 172.21.15.134:0/1103724944 conn(0x7f89700b6240 msgr2=0x7f89700b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 -- 172.21.15.134:0/1103724944 shutdown_connections 2024-09-15T22:44:53.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.668+0000 7f897625e640 1 -- 172.21.15.134:0/1103724944 wait complete. 2024-09-15T22:44:53.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.669+0000 7f897625e640 1 Processor -- start 2024-09-15T22:44:53.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 -- start start 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f897015e940 0x7f89701e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015ed20 0x7f8970159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89700d3f00 con 0x7f89700cef90 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f89700d3c20 con 0x7f897015e940 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.670+0000 7f897625e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f89700d3310 con 0x7f897015ed20 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49894/0 (socket says 172.21.15.134:49894) 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 -- 172.21.15.134:0/3418225261 learned_addr learned my addr 172.21.15.134:0/3418225261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896effd640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f897015e940 0x7f89701e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896ffff640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015ed20 0x7f8970159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 -- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015ed20 msgr2=0x7f8970159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015ed20 0x7f8970159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 -- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f897015e940 msgr2=0x7f89701e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:53.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f897015e940 0x7f89701e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:53.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 -- 172.21.15.134:0/3418225261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89701f4690 con 0x7f89700cef90 2024-09-15T22:44:53.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.671+0000 7f896f7fe640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f896000e9b0 tx=0x7f896000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.676+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960017070 con 0x7f89700cef90 2024-09-15T22:44:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.676+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89701e7c20 con 0x7f89700cef90 2024-09-15T22:44:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.676+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896000c9a0 con 0x7f89700cef90 2024-09-15T22:44:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.676+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960021060 con 0x7f89700cef90 2024-09-15T22:44:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.676+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89701e81e0 con 0x7f89700cef90 2024-09-15T22:44:53.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.677+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89700d1f80 con 0x7f89700cef90 2024-09-15T22:44:53.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.677+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f896001a070 con 0x7f89700cef90 2024-09-15T22:44:53.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.678+0000 7f8957fff640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:53.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.678+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 4943+0+0 (secure 0 0 0) 0x7f896008b8c0 con 0x7f89700cef90 2024-09-15T22:44:53.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.678+0000 7f896effd640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:53.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.678+0000 7f896effd640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8964034000 tx=0x7f896402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:53.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.682+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89701f4690 con 0x7f89700cef90 2024-09-15T22:44:53.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:53.860+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f89700ba6b0 con 0x7f89700cef90 2024-09-15T22:44:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.691+0000 7f8957fff640 1 -- 172.21.15.134:0/3418225261 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7f89600598d0 con 0x7f89700cef90 2024-09-15T22:44:54.693 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.693+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 msgr2=0x7f895c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.693+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8964034000 tx=0x7f896402e000 comp rx=0 tx=0).stop 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.693+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 msgr2=0x7f89701f4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.693+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f896000e9b0 tx=0x7f896000ee70 comp rx=0 tx=0).stop 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 shutdown_connections 2024-09-15T22:44:54.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f895c06c610 0x7f895c06ead0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f897015ed20 0x7f8970159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f897015e940 0x7f89701e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 --2- 172.21.15.134:0/3418225261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89700cef90 0x7f89701f4150 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 >> 172.21.15.134:0/3418225261 conn(0x7f89700b6240 msgr2=0x7f89700b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 shutdown_connections 2024-09-15T22:44:54.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.694+0000 7f897625e640 1 -- 172.21.15.134:0/3418225261 wait complete. 2024-09-15T22:44:54.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:44:54.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.809+0000 7f652f453640 1 Processor -- start 2024-09-15T22:44:54.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.809+0000 7f652f453640 1 -- start start 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f652815e7b0 0x7f6528071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f6528073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6528073ff0 0x7f652806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f652806e680 con 0x7f6528073ff0 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6528071880 con 0x7f652815e7b0 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652f453640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f652806e8d0 con 0x7f65280b5600 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652d9f0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6528073ff0 0x7f652806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652d9f0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6528073ff0 0x7f652806ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49912/0 (socket says 172.21.15.134:49912) 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.810+0000 7f652d9f0640 1 -- 172.21.15.134:0/3987071945 learned_addr learned my addr 172.21.15.134:0/3987071945 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 -- 172.21.15.134:0/3987071945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 msgr2=0x7f6528073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 --2- 172.21.15.134:0/3987071945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f6528073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 -- 172.21.15.134:0/3987071945 >> v2:172.21.15.177:3300/0 conn(0x7f652815e7b0 msgr2=0x7f6528071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 --2- 172.21.15.134:0/3987071945 >> v2:172.21.15.177:3300/0 conn(0x7f652815e7b0 0x7f6528071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 -- 172.21.15.134:0/3987071945 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652806ebb0 con 0x7f6528073ff0 2024-09-15T22:44:54.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.811+0000 7f652d9f0640 1 --2- 172.21.15.134:0/3987071945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6528073ff0 0x7f652806ccb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6528050260 tx=0x7f652002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b189089e9d27c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:54.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f6527fff640 1 -- 172.21.15.134:0/3987071945 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520037070 con 0x7f6528073ff0 2024-09-15T22:44:54.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f6527fff640 1 -- 172.21.15.134:0/3987071945 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6520032440 con 0x7f6528073ff0 2024-09-15T22:44:54.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f6527fff640 1 -- 172.21.15.134:0/3987071945 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520032810 con 0x7f6528073ff0 2024-09-15T22:44:54.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 -- 172.21.15.134:0/3987071945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6528073ff0 msgr2=0x7f652806ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 --2- 172.21.15.134:0/3987071945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6528073ff0 0x7f652806ccb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6528050260 tx=0x7f652002a140 comp rx=0 tx=0).stop 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 -- 172.21.15.134:0/3987071945 shutdown_connections 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 --2- 172.21.15.134:0/3987071945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6528073ff0 0x7f652806ccb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 --2- 172.21.15.134:0/3987071945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f6528073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 --2- 172.21.15.134:0/3987071945 >> v2:172.21.15.177:3300/0 conn(0x7f652815e7b0 0x7f6528071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 -- 172.21.15.134:0/3987071945 >> 172.21.15.134:0/3987071945 conn(0x7f65280b4300 msgr2=0x7f65280b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 -- 172.21.15.134:0/3987071945 shutdown_connections 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.812+0000 7f652f453640 1 -- 172.21.15.134:0/3987071945 wait complete. 2024-09-15T22:44:54.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.814+0000 7f652f453640 1 Processor -- start 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.814+0000 7f652f453640 1 -- start start 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.814+0000 7f652f453640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f652814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 0x7f652815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f652806d1f0 con 0x7f65281e7b30 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6528073590 con 0x7f652815e7b0 2024-09-15T22:44:54.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f652806d370 con 0x7f65280b5600 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49914/0 (socket says 172.21.15.134:49914) 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 -- 172.21.15.134:0/1131332280 learned_addr learned my addr 172.21.15.134:0/1131332280 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d1ef640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f652814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652c9ee640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 0x7f652815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 -- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 msgr2=0x7f652814f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f652814f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 -- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 msgr2=0x7f652815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 0x7f652815fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 -- 172.21.15.134:0/1131332280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65281606e0 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652c9ee640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 0x7f652815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652d9f0640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f65200090b0 tx=0x7f65200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520041070 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652003c950 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65281609c0 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.815+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520037040 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.816+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6528153820 con 0x7f65281e7b30 2024-09-15T22:44:54.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.817+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6528160ee0 con 0x7f65281e7b30 2024-09-15T22:44:54.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.817+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f6520044070 con 0x7f65281e7b30 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.817+0000 7f6525ffb640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 0x7f651406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.817+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f65200ac190 con 0x7f65281e7b30 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.817+0000 7f652d1ef640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 0x7f651406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.818+0000 7f652d1ef640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 0x7f651406ead0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f651800a400 tx=0x7f651800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:54.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:54.822+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f652007a060 con 0x7f65281e7b30 2024-09-15T22:44:55.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.049+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6528073ab0 con 0x7f65281e7b30 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.050+0000 7f6525ffb640 1 -- 172.21.15.134:0/1131332280 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5617 (secure 0 0 0) 0x7f652007e360 con 0x7f65281e7b30 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.051 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:55.052 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.054 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:44:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.058 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.059 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.061 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.062 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:55.063 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:44:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.065 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.alice", 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBbY+dmLqGXDRAAWJsQ8nyZJINeoIwNxDxX2A==", 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.066 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol89960", 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:44:55.067 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:44:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:44:55.069 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:44:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 msgr2=0x7f651406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 0x7f651406ead0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f651800a400 tx=0x7f651800d040 comp rx=0 tx=0).stop 2024-09-15T22:44:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 msgr2=0x7f6528158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f65200090b0 tx=0x7f65200046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 shutdown_connections 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f651406c610 0x7f651406ead0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65281e7b30 0x7f6528158ca0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f652815e7b0 0x7f652815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 --2- 172.21.15.134:0/1131332280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65280b5600 0x7f652814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 >> 172.21.15.134:0/1131332280 conn(0x7f65280b4300 msgr2=0x7f65280b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 shutdown_connections 2024-09-15T22:44:55.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.052+0000 7f652f453640 1 -- 172.21.15.134:0/1131332280 wait complete. 2024-09-15T22:44:55.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-15T22:44:55.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 Processor -- start 2024-09-15T22:44:55.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 -- start start 2024-09-15T22:44:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f531c15e940 0x7f531c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f531c15ed20 0x7f531c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0b7170 con 0x7f531c0cef90 2024-09-15T22:44:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0d1ae0 con 0x7f531c15e940 2024-09-15T22:44:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.171+0000 7f5322318640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0b7aa0 con 0x7f531c15ed20 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f531c15e940 0x7f531c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f531c15e940 0x7f531c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49926/0 (socket says 172.21.15.134:49926) 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 -- 172.21.15.134:0/1194001372 learned_addr learned my addr 172.21.15.134:0/1194001372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531b7fe640 1 --2- 172.21.15.134:0/1194001372 >> v2:172.21.15.177:3300/0 conn(0x7f531c15ed20 0x7f531c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 -- 172.21.15.134:0/1194001372 >> v2:172.21.15.177:3300/0 conn(0x7f531c15ed20 msgr2=0x7f531c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 --2- 172.21.15.134:0/1194001372 >> v2:172.21.15.177:3300/0 conn(0x7f531c15ed20 0x7f531c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 -- 172.21.15.134:0/1194001372 >> v1:172.21.15.134:6789/0 conn(0x7f531c0cef90 legacy=0x7f531c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531bfff640 1 -- 172.21.15.134:0/1194001372 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0d3660 con 0x7f531c15e940 2024-09-15T22:44:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.172+0000 7f531affd640 1 -- 172.21.15.134:0/1194001372 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505835574 0 0) 0x7f5314001490 con 0x7f531c0cef90 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f531bfff640 1 --2- 172.21.15.134:0/1194001372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15e940 0x7f531c0d1060 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f531c06e900 tx=0x7f530c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3540ab177c744a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f531affd640 1 -- 172.21.15.134:0/1194001372 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c037070 con 0x7f531c15e940 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f531affd640 1 -- 172.21.15.134:0/1194001372 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c02ae50 con 0x7f531c15e940 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f531affd640 1 -- 172.21.15.134:0/1194001372 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c032860 con 0x7f531c15e940 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 -- 172.21.15.134:0/1194001372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15e940 msgr2=0x7f531c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 --2- 172.21.15.134:0/1194001372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15e940 0x7f531c0d1060 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f531c06e900 tx=0x7f530c02a300 comp rx=0 tx=0).stop 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 -- 172.21.15.134:0/1194001372 shutdown_connections 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 --2- 172.21.15.134:0/1194001372 >> v2:172.21.15.177:3300/0 conn(0x7f531c15ed20 0x7f531c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 --2- 172.21.15.134:0/1194001372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15e940 0x7f531c0d1060 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 -- 172.21.15.134:0/1194001372 >> 172.21.15.134:0/1194001372 conn(0x7f531c0b6240 msgr2=0x7f531c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 -- 172.21.15.134:0/1194001372 shutdown_connections 2024-09-15T22:44:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.173+0000 7f5322318640 1 -- 172.21.15.134:0/1194001372 wait complete. 2024-09-15T22:44:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 Processor -- start 2024-09-15T22:44:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 -- start start 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f531c0cef90 0x7f531c1e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f531c15e940 0x7f531c0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0d3f00 con 0x7f531c15ed20 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0d3c20 con 0x7f531c0cef90 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.175+0000 7f5322318640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f531c0d3310 con 0x7f531c15e940 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49934/0 (socket says 172.21.15.134:49934) 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 -- 172.21.15.134:0/123033403 learned_addr learned my addr 172.21.15.134:0/123033403 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f531bfff640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f531c0cef90 0x7f531c1e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f531b7fe640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f531c15e940 0x7f531c0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 -- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f531c15e940 msgr2=0x7f531c0b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f531c15e940 0x7f531c0b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 -- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f531c0cef90 msgr2=0x7f531c1e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f531c0cef90 0x7f531c1e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 -- 172.21.15.134:0/123033403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c157e80 con 0x7f531c15ed20 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f53208b5640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f531400c780 tx=0x7f531400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314003b70 con 0x7f531c15ed20 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5314003d10 con 0x7f531c15ed20 2024-09-15T22:44:55.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c1f7c10 con 0x7f531c15ed20 2024-09-15T22:44:55.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314005270 con 0x7f531c15ed20 2024-09-15T22:44:55.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.176+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c1f81d0 con 0x7f531c15ed20 2024-09-15T22:44:55.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.177+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c0d1ef0 con 0x7f531c15ed20 2024-09-15T22:44:55.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.178+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f5314005410 con 0x7f531c15ed20 2024-09-15T22:44:55.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.178+0000 7f5318ff9640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 0x7f530806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.178+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f531408b4f0 con 0x7f531c15ed20 2024-09-15T22:44:55.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.178+0000 7f531bfff640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 0x7f530806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.178+0000 7f531bfff640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 0x7f530806ead0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.182+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f531c0b7170 con 0x7f531c15ed20 2024-09-15T22:44:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.409+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) -- 0x7f531c0b5f10 con 0x7f531c15ed20 2024-09-15T22:44:55.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.411+0000 7f5318ff9640 1 -- 172.21.15.134:0/123033403 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v15) ==== 82+0+0 (secure 0 0 0) 0x7f5314059b30 con 0x7f531c15ed20 2024-09-15T22:44:55.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 msgr2=0x7f530806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 0x7f530806ead0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:55.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 msgr2=0x7f531c157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f531400c780 tx=0x7f531400cb80 comp rx=0 tx=0).stop 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 shutdown_connections 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f530806c610 0x7f530806ead0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f531c15ed20 0x7f531c157940 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f531c15e940 0x7f531c0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 --2- 172.21.15.134:0/123033403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f531c0cef90 0x7f531c1e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 >> 172.21.15.134:0/123033403 conn(0x7f531c0b6240 msgr2=0x7f531c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 shutdown_connections 2024-09-15T22:44:55.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.414+0000 7f5322318640 1 -- 172.21.15.134:0/123033403 wait complete. 2024-09-15T22:44:55.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:44:55.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.523+0000 7f2107865640 1 Processor -- start 2024-09-15T22:44:55.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.523+0000 7f2107865640 1 -- start start 2024-09-15T22:44:55.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2107865640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2100073830 0x7f21000cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2107865640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21000ce740 con 0x7f21000cf070 2024-09-15T22:44:55.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2107865640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2100072640 con 0x7f210015c180 2024-09-15T22:44:55.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2107865640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2100072920 con 0x7f2100073830 2024-09-15T22:44:55.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2104e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f21000cf070 0x7f2100073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45066/0 (socket says 172.21.15.134:45066) 2024-09-15T22:44:55.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2104e00640 1 -- 172.21.15.134:0/103764332 learned_addr learned my addr 172.21.15.134:0/103764332 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:55.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.524+0000 7f2105e02640 1 --2- 172.21.15.134:0/103764332 >> v2:172.21.15.134:3300/0 conn(0x7f2100073830 0x7f21000cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718136023 0 0) 0x7f21000ce740 con 0x7f21000cf070 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ec003520 con 0x7f21000cf070 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f2105e02640 1 -- 172.21.15.134:0/103764332 >> v1:172.21.15.177:6789/0 conn(0x7f210015c180 legacy=0x7f21000cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643213973 0 0) 0x7f2100072640 con 0x7f210015c180 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f2105e02640 1 -- 172.21.15.134:0/103764332 >> v1:172.21.15.134:6789/0 conn(0x7f21000cf070 legacy=0x7f2100073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f2105e02640 1 -- 172.21.15.134:0/103764332 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2100072c00 con 0x7f2100073830 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.525+0000 7f2105e02640 1 --2- 172.21.15.134:0/103764332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2100073830 0x7f21000cf4e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4827abf328ae454 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8037070 con 0x7f2100073830 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8032440 con 0x7f2100073830 2024-09-15T22:44:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f20f7fff640 1 -- 172.21.15.134:0/103764332 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8032810 con 0x7f2100073830 2024-09-15T22:44:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 -- 172.21.15.134:0/103764332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2100073830 msgr2=0x7f21000cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 --2- 172.21.15.134:0/103764332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2100073830 0x7f21000cf4e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 -- 172.21.15.134:0/103764332 shutdown_connections 2024-09-15T22:44:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 --2- 172.21.15.134:0/103764332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2100073830 0x7f21000cf4e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 -- 172.21.15.134:0/103764332 >> 172.21.15.134:0/103764332 conn(0x7f2100062cc0 msgr2=0x7f210006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 -- 172.21.15.134:0/103764332 shutdown_connections 2024-09-15T22:44:55.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.526+0000 7f2107865640 1 -- 172.21.15.134:0/103764332 wait complete. 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.527+0000 7f2107865640 1 Processor -- start 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 -- start start 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2100073830 0x7f210014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 0x7f21000ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21000722f0 con 0x7f210015c180 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21000ced00 con 0x7f2100073830 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2107865640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f210015c560 con 0x7f21000cf070 2024-09-15T22:44:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2105e02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2105e02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49946/0 (socket says 172.21.15.134:49946) 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2105e02640 1 -- 172.21.15.134:0/4154817978 learned_addr learned my addr 172.21.15.134:0/4154817978 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2105601640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2100073830 0x7f210014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.528+0000 7f2104e00640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 0x7f21000ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 -- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 msgr2=0x7f21000ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 0x7f21000ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 -- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2100073830 msgr2=0x7f210014fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2100073830 0x7f210014fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 -- 172.21.15.134:0/4154817978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21001f8530 con 0x7f210015c180 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2104e00640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 0x7f21000ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2105e02640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8037040 con 0x7f210015c180 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8004230 con 0x7f210015c180 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8003610 con 0x7f210015c180 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21001f7770 con 0x7f210015c180 2024-09-15T22:44:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.529+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21001f7d30 con 0x7f210015c180 2024-09-15T22:44:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.530+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21000cf4e0 con 0x7f210015c180 2024-09-15T22:44:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.531+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f20f80037b0 con 0x7f210015c180 2024-09-15T22:44:55.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.531+0000 7f20f5ffb640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 0x7f20e406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.531+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f20f80ac350 con 0x7f210015c180 2024-09-15T22:44:55.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.531+0000 7f2105601640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 0x7f20e406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.532+0000 7f2105601640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 0x7f20e406ead0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0012e0 tx=0x7f20fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.535+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20f807a990 con 0x7f210015c180 2024-09-15T22:44:55.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.702+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f210015aa50 con 0x7f210015c180 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.702+0000 7f20f5ffb640 1 -- 172.21.15.134:0/4154817978 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f20f807a290 con 0x7f210015c180 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:44:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:44:55.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 msgr2=0x7f20e406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 0x7f20e406ead0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0012e0 tx=0x7f20fc009040 comp rx=0 tx=0).stop 2024-09-15T22:44:55.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 msgr2=0x7f21000aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f80046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 shutdown_connections 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f20e406c610 0x7f20e406ead0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f210015c180 0x7f21000aee20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21000cf070 0x7f21000ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 --2- 172.21.15.134:0/4154817978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2100073830 0x7f210014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 >> 172.21.15.134:0/4154817978 conn(0x7f2100062cc0 msgr2=0x7f2100156970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 shutdown_connections 2024-09-15T22:44:55.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.705+0000 7f2107865640 1 -- 172.21.15.134:0/4154817978 wait complete. 2024-09-15T22:44:55.717 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:44:55.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:44:55.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.818+0000 7f474cbb0640 1 Processor -- start 2024-09-15T22:44:55.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.819+0000 7f474cbb0640 1 -- start start 2024-09-15T22:44:55.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.819+0000 7f474cbb0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f47480cf5d0 0x7f47480cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.819+0000 7f474cbb0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f474806d4f0 0x7f474806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.819+0000 7f474cbb0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47480b4240 con 0x7f4748145d90 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.819+0000 7f474cbb0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f474806d080 con 0x7f474806d4f0 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f474cbb0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f47480b4520 con 0x7f47480cf5d0 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f474806d4f0 0x7f474806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f474806d4f0 0x7f474806d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49958/0 (socket says 172.21.15.134:49958) 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 -- 172.21.15.134:0/1819140256 learned_addr learned my addr 172.21.15.134:0/1819140256 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4745d9b640 1 --2- 172.21.15.134:0/1819140256 >> v2:172.21.15.177:3300/0 conn(0x7f47480cf5d0 0x7f47480cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 -- 172.21.15.134:0/1819140256 >> v2:172.21.15.177:3300/0 conn(0x7f47480cf5d0 msgr2=0x7f47480cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 --2- 172.21.15.134:0/1819140256 >> v2:172.21.15.177:3300/0 conn(0x7f47480cf5d0 0x7f47480cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 -- 172.21.15.134:0/1819140256 >> v1:172.21.15.177:6789/0 conn(0x7f4748145d90 legacy=0x7f47480ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.820+0000 7f4746d9d640 1 -- 172.21.15.134:0/1819140256 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47480b4800 con 0x7f474806d4f0 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f4746d9d640 1 --2- 172.21.15.134:0/1819140256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474806d4f0 0x7f474806d960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f474806ef20 tx=0x7f474002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4fd40b9c97dd67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474559a640 1 -- 172.21.15.134:0/1819140256 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740036070 con 0x7f474806d4f0 2024-09-15T22:44:55.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474559a640 1 -- 172.21.15.134:0/1819140256 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4740031600 con 0x7f474806d4f0 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474559a640 1 -- 172.21.15.134:0/1819140256 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47400319d0 con 0x7f474806d4f0 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 -- 172.21.15.134:0/1819140256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474806d4f0 msgr2=0x7f474806d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1819140256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474806d4f0 0x7f474806d960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f474806ef20 tx=0x7f474002a6f0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 -- 172.21.15.134:0/1819140256 shutdown_connections 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1819140256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474806d4f0 0x7f474806d960 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1819140256 >> v2:172.21.15.177:3300/0 conn(0x7f47480cf5d0 0x7f47480cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 -- 172.21.15.134:0/1819140256 >> 172.21.15.134:0/1819140256 conn(0x7f474806bba0 msgr2=0x7f474806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:55.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 -- 172.21.15.134:0/1819140256 shutdown_connections 2024-09-15T22:44:55.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.821+0000 7f474cbb0640 1 -- 172.21.15.134:0/1819140256 wait complete. 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 Processor -- start 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 -- start start 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 0x7f47481f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4748145d90 0x7f47480b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47480cd660 con 0x7f47480cf5d0 2024-09-15T22:44:55.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47480cff80 con 0x7f4748145d90 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.823+0000 7f474cbb0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f47480b5610 con 0x7f474806d4f0 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49970/0 (socket says 172.21.15.134:49970) 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 -- 172.21.15.134:0/1423519103 learned_addr learned my addr 172.21.15.134:0/1423519103 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4746d9d640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4748145d90 0x7f47480b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f474659c640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 0x7f47481f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 -- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 msgr2=0x7f47481f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 0x7f47481f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 -- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4748145d90 msgr2=0x7f47480b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4748145d90 0x7f47480b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 -- 172.21.15.134:0/1423519103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47481f2d90 con 0x7f47480cf5d0 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f474659c640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 0x7f47481f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f4745d9b640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f473000d5f0 tx=0x7f473000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47300125f0 con 0x7f47480cf5d0 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4730019070 con 0x7f47480cf5d0 2024-09-15T22:44:55.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47300129d0 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474813c420 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.824+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474813c9e0 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.825+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47480ce910 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.826+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f4730012b70 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.826+0000 7f473effd640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 0x7f472806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.826+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f473008b920 con 0x7f47480cf5d0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.826+0000 7f474659c640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 0x7f472806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:55.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.827+0000 7f474659c640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 0x7f472806ead0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f47480cd630 tx=0x7f4738009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:55.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.831+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47480ce910 con 0x7f47480cf5d0 2024-09-15T22:44:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:55.997+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4748146170 con 0x7f47480cf5d0 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.700+0000 7f473effd640 1 -- 172.21.15.134:0/1423519103 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f47481f2d90 con 0x7f47480cf5d0 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 msgr2=0x7f472806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 0x7f472806ead0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f47480cd630 tx=0x7f4738009040 comp rx=0 tx=0).stop 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 msgr2=0x7f474815bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f473000d5f0 tx=0x7f473000dab0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 shutdown_connections 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f472806c610 0x7f472806ead0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4748145d90 0x7f47480b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47480cf5d0 0x7f474815bdc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.703+0000 7f474cbb0640 1 --2- 172.21.15.134:0/1423519103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f474806d4f0 0x7f47481f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.704+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 >> 172.21.15.134:0/1423519103 conn(0x7f474806bba0 msgr2=0x7f47480b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:56.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.704+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 shutdown_connections 2024-09-15T22:44:56.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.704+0000 7f474cbb0640 1 -- 172.21.15.134:0/1423519103 wait complete. 2024-09-15T22:44:56.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:44:56.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.830+0000 7fb573aaf640 1 Processor -- start 2024-09-15T22:44:56.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.830+0000 7fb573aaf640 1 -- start start 2024-09-15T22:44:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb573aaf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb56c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb573aaf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c0b3570 con 0x7fb56c072d10 2024-09-15T22:44:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb573aaf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c0b3850 con 0x7fb56c0ccb80 2024-09-15T22:44:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb573aaf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb56c0b3b30 con 0x7fb56c0b4e20 2024-09-15T22:44:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb57204c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb56c072d10 0x7fb56c06db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47930/0 (socket says 172.21.15.134:47930) 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb57204c640 1 -- 172.21.15.134:0/3117905992 learned_addr learned my addr 172.21.15.134:0/3117905992 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440035362 0 0) 0x7fb56c0b3570 con 0x7fb56c072d10 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb558003520 con 0x7fb56c072d10 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb57104a640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb56c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1075092114 0 0) 0x7fb558003520 con 0x7fb56c072d10 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 msgr2=0x7fb56c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb56c15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 >> v1:172.21.15.177:6789/0 conn(0x7fb56c0ccb80 legacy=0x7fb56c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c0b3e10 con 0x7fb56c072d10 2024-09-15T22:44:56.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb5640019f0 con 0x7fb56c072d10 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 >> v1:172.21.15.134:6789/0 conn(0x7fb56c072d10 legacy=0x7fb56c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb5580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb558003f60 0x7fb558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb558004d40 0x7fb5580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0b3b30 con 0x7fb558004d40 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb55800baa0 con 0x7fb558003f60 2024-09-15T22:44:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.831+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb55800bca0 con 0x7fb56c0b4e20 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb558004d40 0x7fb5580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57184b640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb5580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57104a640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb558003f60 0x7fb558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 -- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 msgr2=0x7fb5580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0b4e20 0x7fb5580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 -- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb558003f60 msgr2=0x7fb558004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:56.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb558003f60 0x7fb558004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.832+0000 7fb57204c640 1 -- 172.21.15.134:0/3117905992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb558003520 con 0x7fb558004d40 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb57204c640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb558004d40 0x7fb5580051c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb56400a860 tx=0x7fb558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ec8af097799222 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400a480 con 0x7fb558004d40 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56402f070 con 0x7fb558004d40 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb570849640 1 -- 172.21.15.134:0/3117905992 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56402bd40 con 0x7fb558004d40 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 -- 172.21.15.134:0/3117905992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb558004d40 msgr2=0x7fb5580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 --2- 172.21.15.134:0/3117905992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb558004d40 0x7fb5580051c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb56400a860 tx=0x7fb558005830 comp rx=0 tx=0).stop 2024-09-15T22:44:56.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb57204c640 1 -- 172.21.15.134:0/3117905992 reap_dead start 2024-09-15T22:44:56.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 -- 172.21.15.134:0/3117905992 shutdown_connections 2024-09-15T22:44:56.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 -- 172.21.15.134:0/3117905992 >> 172.21.15.134:0/3117905992 conn(0x7fb56c06bba0 msgr2=0x7fb56c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:56.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 -- 172.21.15.134:0/3117905992 shutdown_connections 2024-09-15T22:44:56.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.833+0000 7fb573aaf640 1 -- 172.21.15.134:0/3117905992 wait complete. 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.834+0000 7fb573aaf640 1 Processor -- start 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.834+0000 7fb573aaf640 1 -- start start 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 0x7fb56c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 0x7fb56c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0ccf60 con 0x7fb56c145f00 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0b43d0 con 0x7fb56c15d460 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb573aaf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb56c15bbd0 con 0x7fb56c0ace50 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb57184b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb57184b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37840/0 (socket says 172.21.15.134:37840) 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb57184b640 1 -- 172.21.15.134:0/2989659585 learned_addr learned my addr 172.21.15.134:0/2989659585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb57104a640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 0x7fb56c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.835+0000 7fb57204c640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 0x7fb56c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 -- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 msgr2=0x7fb56c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 0x7fb56c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 -- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 msgr2=0x7fb56c15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 0x7fb56c15d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 -- 172.21.15.134:0/2989659585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c146aa0 con 0x7fb56c145f00 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57104a640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 0x7fb56c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:56.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57204c640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 0x7fb56c15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb57184b640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb568011a60 tx=0x7fb568011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56800f940 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568016030 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c146d80 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56800fd20 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.836+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c147340 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.837+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c15bfa0 con 0x7fb56c145f00 2024-09-15T22:44:56.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.837+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fb5680035f0 con 0x7fb56c145f00 2024-09-15T22:44:56.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.838+0000 7fb5627fc640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 0x7fb55006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.838+0000 7fb57104a640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 0x7fb55006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.838+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5227+0+0 (secure 0 0 0) 0x7fb56808d680 con 0x7fb56c145f00 2024-09-15T22:44:56.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.839+0000 7fb57104a640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 0x7fb55006eb00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb56c06f3c0 tx=0x7fb55c00a290 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:56.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:56.843+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb56805bc50 con 0x7fb56c145f00 2024-09-15T22:44:57.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.011+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb56c0ad230 con 0x7fb56c145f00 2024-09-15T22:44:57.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.706+0000 7fb5627fc640 1 -- 172.21.15.134:0/2989659585 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7fb56808d030 con 0x7fb56c145f00 2024-09-15T22:44:57.707 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 msgr2=0x7fb55006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 0x7fb55006eb00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb56c06f3c0 tx=0x7fb55c00a290 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 msgr2=0x7fb56c0ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb568011a60 tx=0x7fb568011f20 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 shutdown_connections 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb55006c640 0x7fb55006eb00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb56c15d460 0x7fb56c15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb56c0ace50 0x7fb56c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 --2- 172.21.15.134:0/2989659585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c145f00 0x7fb56c0ac1e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 >> 172.21.15.134:0/2989659585 conn(0x7fb56c06bba0 msgr2=0x7fb56c0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.709+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 shutdown_connections 2024-09-15T22:44:57.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.710+0000 7fb573aaf640 1 -- 172.21.15.134:0/2989659585 wait complete. 2024-09-15T22:44:57.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:44:57.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 Processor -- start 2024-09-15T22:44:57.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 -- start start 2024-09-15T22:44:57.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6a4161e30 0x7fd6a40d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a40cf9a0 con 0x7fd6a40b3d50 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a4162210 con 0x7fd6a406dfd0 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.842+0000 7fd6ab05c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a40cfcf0 con 0x7fd6a4161e30 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd6a40b3d50 0x7fd6a406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47940/0 (socket says 172.21.15.134:47940) 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a3fff640 1 -- 172.21.15.134:0/2088616194 learned_addr learned my addr 172.21.15.134:0/2088616194 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256017609 0 0) 0x7fd6a40cf9a0 con 0x7fd6a40b3d50 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68c003520 con 0x7fd6a40b3d50 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a8df8640 1 --2- 172.21.15.134:0/2088616194 >> v2:172.21.15.177:3300/0 conn(0x7fd6a4161e30 0x7fd6a40d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 880078861 0 0) 0x7fd68c003520 con 0x7fd6a40b3d50 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 >> v2:172.21.15.177:3300/0 conn(0x7fd6a4161e30 msgr2=0x7fd6a40d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 --2- 172.21.15.134:0/2088616194 >> v2:172.21.15.177:3300/0 conn(0x7fd6a4161e30 0x7fd6a40d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 >> v1:172.21.15.177:6789/0 conn(0x7fd6a406dfd0 legacy=0x7fd6a40b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a40d5210 con 0x7fd6a40b3d50 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd698001670 con 0x7fd6a40b3d50 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 >> v1:172.21.15.134:6789/0 conn(0x7fd6a40b3d50 legacy=0x7fd6a406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c0039b0 0x7fd68c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 0x7fd68c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd68c0051c0 0x7fd68c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40cfcf0 con 0x7fd68c004800 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c00c060 con 0x7fd68c0051c0 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c00c260 con 0x7fd68c0039b0 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 0x7fd68c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a8df8640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c0039b0 0x7fd68c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.843+0000 7fd6a95f9640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd68c0051c0 0x7fd68c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 -- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c0039b0 msgr2=0x7fd68c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c0039b0 0x7fd68c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 -- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd68c0051c0 msgr2=0x7fd68c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd68c0051c0 0x7fd68c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 -- 172.21.15.134:0/2088616194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c003520 con 0x7fd68c004800 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a95f9640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd68c0051c0 0x7fd68c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a95f9640 1 -- 172.21.15.134:0/2088616194 reap_dead start 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 0x7fd68c004c80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40b41c0 tx=0x7fd68c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a6634d3aed2d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698007d30 con 0x7fd68c004800 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6980058d0 con 0x7fd68c004800 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.844+0000 7fd6a37fe640 1 -- 172.21.15.134:0/2088616194 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698005d20 con 0x7fd68c004800 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 -- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 msgr2=0x7fd68c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 0x7fd68c004c80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40b41c0 tx=0x7fd68c005830 comp rx=0 tx=0).stop 2024-09-15T22:44:57.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 -- 172.21.15.134:0/2088616194 shutdown_connections 2024-09-15T22:44:57.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/2088616194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c004800 0x7fd68c004c80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 -- 172.21.15.134:0/2088616194 >> 172.21.15.134:0/2088616194 conn(0x7fd6a40d1870 msgr2=0x7fd6a40d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:57.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 -- 172.21.15.134:0/2088616194 shutdown_connections 2024-09-15T22:44:57.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.845+0000 7fd6ab05c640 1 -- 172.21.15.134:0/2088616194 wait complete. 2024-09-15T22:44:57.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.846+0000 7fd6ab05c640 1 Processor -- start 2024-09-15T22:44:57.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.846+0000 7fd6ab05c640 1 -- start start 2024-09-15T22:44:57.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c004800 0x7fd6a4157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a4160ca0 0x7fd6a40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40b3290 con 0x7fd6a414baa0 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40b3950 con 0x7fd6a4160ca0 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6ab05c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a40b3410 con 0x7fd68c004800 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37850/0 (socket says 172.21.15.134:37850) 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6a3fff640 1 -- 172.21.15.134:0/3501814651 learned_addr learned my addr 172.21.15.134:0/3501814651 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6a8df8640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c004800 0x7fd6a4157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.847+0000 7fd6a95f9640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a4160ca0 0x7fd6a40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 -- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c004800 msgr2=0x7fd6a4157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c004800 0x7fd6a4157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 -- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a4160ca0 msgr2=0x7fd6a40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a4160ca0 0x7fd6a40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 -- 172.21.15.134:0/3501814651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a4156750 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a3fff640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd6980058a0 tx=0x7fd698001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698042020 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd698039040 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698007680 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a4156a30 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.848+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a4156ff0 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.849+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a41610b0 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.850+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd698045020 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.850+0000 7fd6a17fa640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 0x7fd69006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.850+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5609+0+0 (secure 0 0 0) 0x7fd6980abec0 con 0x7fd6a414baa0 2024-09-15T22:44:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.850+0000 7fd6a8df8640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 0x7fd69006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:57.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.851+0000 7fd6a8df8640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 0x7fd69006ead0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd694009b80 tx=0x7fd694008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:57.855+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6a41610b0 con 0x7fd6a414baa0 2024-09-15T22:44:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.055+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd6a4069190 con 0x7fd6a414baa0 2024-09-15T22:44:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.707+0000 7fd6a17fa640 1 -- 172.21.15.134:0/3501814651 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v34) ==== 174+0+0 (secure 0 0 0) 0x7fd69804c030 con 0x7fd6a414baa0 2024-09-15T22:44:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 10 and data pool 11 2024-09-15T22:44:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 msgr2=0x7fd69006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 0x7fd69006ead0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd694009b80 tx=0x7fd694008040 comp rx=0 tx=0).stop 2024-09-15T22:44:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 msgr2=0x7fd6a4160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd6980058a0 tx=0x7fd698001a40 comp rx=0 tx=0).stop 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 shutdown_connections 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd69006c610 0x7fd69006ead0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a4160ca0 0x7fd6a40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a414baa0 0x7fd6a4160760 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 --2- 172.21.15.134:0/3501814651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd68c004800 0x7fd6a4157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.714+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 >> 172.21.15.134:0/3501814651 conn(0x7fd6a40d1870 msgr2=0x7fd6a40ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.715+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 shutdown_connections 2024-09-15T22:44:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.716+0000 7fd6ab05c640 1 -- 172.21.15.134:0/3501814651 wait complete. 2024-09-15T22:44:58.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:58.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.849+0000 7f0b0510a640 1 Processor -- start 2024-09-15T22:44:58.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.849+0000 7f0b0510a640 1 -- start start 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0b0510a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b0015e940 0x7f0b000d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0b0510a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b0015ed20 0x7f0b000d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0b0510a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000b7170 con 0x7f0b000cef90 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0b0510a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000d1ae0 con 0x7f0b0015e940 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0b0510a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000b7aa0 con 0x7f0b0015ed20 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0afed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b0015e940 0x7f0b000d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0afed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b0015e940 0x7f0b000d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37858/0 (socket says 172.21.15.134:37858) 2024-09-15T22:44:58.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.850+0000 7f0afed9d640 1 -- 172.21.15.134:0/478043416 learned_addr learned my addr 172.21.15.134:0/478043416 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:58.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.851+0000 7f0afed9d640 1 -- 172.21.15.134:0/478043416 >> v2:172.21.15.177:3300/0 conn(0x7f0b0015ed20 msgr2=0x7f0b000d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:58.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.851+0000 7f0afed9d640 1 --2- 172.21.15.134:0/478043416 >> v2:172.21.15.177:3300/0 conn(0x7f0b0015ed20 0x7f0b000d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.851+0000 7f0afed9d640 1 -- 172.21.15.134:0/478043416 >> v1:172.21.15.177:6789/0 conn(0x7f0b000cef90 legacy=0x7f0b000b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:58.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.851+0000 7f0afed9d640 1 -- 172.21.15.134:0/478043416 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000d3660 con 0x7f0b0015e940 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.851+0000 7f0afed9d640 1 --2- 172.21.15.134:0/478043416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b0015e940 0x7f0b000d1060 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006e900 tx=0x7f0af002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93baf5d3dfd8ee5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0afdd9b640 1 -- 172.21.15.134:0/478043416 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0037070 con 0x7f0b0015e940 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0afdd9b640 1 -- 172.21.15.134:0/478043416 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af0032440 con 0x7f0b0015e940 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0afdd9b640 1 -- 172.21.15.134:0/478043416 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0032810 con 0x7f0b0015e940 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 -- 172.21.15.134:0/478043416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b0015e940 msgr2=0x7f0b000d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 --2- 172.21.15.134:0/478043416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b0015e940 0x7f0b000d1060 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006e900 tx=0x7f0af002a2c0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 -- 172.21.15.134:0/478043416 shutdown_connections 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 --2- 172.21.15.134:0/478043416 >> v2:172.21.15.177:3300/0 conn(0x7f0b0015ed20 0x7f0b000d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 --2- 172.21.15.134:0/478043416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b0015e940 0x7f0b000d1060 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 -- 172.21.15.134:0/478043416 >> 172.21.15.134:0/478043416 conn(0x7f0b000b6240 msgr2=0x7f0b000b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:58.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 -- 172.21.15.134:0/478043416 shutdown_connections 2024-09-15T22:44:58.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.852+0000 7f0b0510a640 1 -- 172.21.15.134:0/478043416 wait complete. 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 Processor -- start 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 -- start start 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 0x7f0b0015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 0x7f0b000b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d3f00 con 0x7f0b000cef90 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d3c20 con 0x7f0b0015e940 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0b0510a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d3310 con 0x7f0b0015ed20 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37866/0 (socket says 172.21.15.134:37866) 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.854+0000 7f0afed9d640 1 -- 172.21.15.134:0/1699561066 learned_addr learned my addr 172.21.15.134:0/1699561066 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afe59c640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 0x7f0b0015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0aff59e640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 0x7f0b000b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 -- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 msgr2=0x7f0b000b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 0x7f0b000b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 -- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 msgr2=0x7f0b0015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 0x7f0b0015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 -- 172.21.15.134:0/1699561066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0015afb0 con 0x7f0b000cef90 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0aff59e640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 0x7f0b000b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afe59c640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 0x7f0b0015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0afed9d640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0041070 con 0x7f0b000cef90 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af003c870 con 0x7f0b000cef90 2024-09-15T22:44:58.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0015b290 con 0x7f0b000cef90 2024-09-15T22:44:58.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0037040 con 0x7f0b000cef90 2024-09-15T22:44:58.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.855+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0015b850 con 0x7f0b000cef90 2024-09-15T22:44:58.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.856+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0015ba90 con 0x7f0b000cef90 2024-09-15T22:44:58.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.857+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f0af0044070 con 0x7f0b000cef90 2024-09-15T22:44:58.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.857+0000 7f0ae77fe640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 0x7f0aec06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.857+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f0af00ac630 con 0x7f0b000cef90 2024-09-15T22:44:58.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.857+0000 7f0afe59c640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 0x7f0aec06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.858+0000 7f0afe59c640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 0x7f0aec06ea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b0015bc90 tx=0x7f0af4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:58.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:58.862+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b0015ba90 con 0x7f0b000cef90 2024-09-15T22:44:59.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.032+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b000d1ef0 con 0x7f0b000cef90 2024-09-15T22:44:59.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.033+0000 7f0ae77fe640 1 -- 172.21.15.134:0/1699561066 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16717 (secure 0 0 0) 0x7f0b000b7170 con 0x7f0b000cef90 2024-09-15T22:44:59.035 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:59.035 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":72,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:58.056564+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:56.017103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:57.030116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 msgr2=0x7f0aec06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 0x7f0aec06ea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b0015bc90 tx=0x7f0af4008040 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 msgr2=0x7f0b000cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af00046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 shutdown_connections 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f0aec06c580 0x7f0aec06ea40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b0015ed20 0x7f0b000b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015e940 0x7f0b0015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 --2- 172.21.15.134:0/1699561066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b000cef90 0x7f0b000cac00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 >> 172.21.15.134:0/1699561066 conn(0x7f0b000b6240 msgr2=0x7f0b000d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 shutdown_connections 2024-09-15T22:44:59.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.035+0000 7f0b0510a640 1 -- 172.21.15.134:0/1699561066 wait complete. 2024-09-15T22:44:59.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:44:59.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 Processor -- start 2024-09-15T22:44:59.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 -- start start 2024-09-15T22:44:59.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015e940 0x7fd0a00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a015ed20 0x7fd0a00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00b7170 con 0x7fd0a00cef90 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a00d1ae0 con 0x7fd0a015ed20 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.145+0000 7fd0a7191640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00b7aa0 con 0x7fd0a015e940 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a015ed20 0x7fd0a00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a015ed20 0x7fd0a00d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37870/0 (socket says 172.21.15.134:37870) 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 -- 172.21.15.134:0/872105613 learned_addr learned my addr 172.21.15.134:0/872105613 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd0a4f2d640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015e940 0x7fd0a00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 -- 172.21.15.134:0/872105613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015e940 msgr2=0x7fd0a00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015e940 0x7fd0a00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 -- 172.21.15.134:0/872105613 >> v1:172.21.15.177:6789/0 conn(0x7fd0a00cef90 legacy=0x7fd0a00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.146+0000 7fd09ffff640 1 -- 172.21.15.134:0/872105613 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a00d3660 con 0x7fd0a015ed20 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd09ffff640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a015ed20 0x7fd0a00d15a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009870 tx=0x7fd08c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1cf443675de5f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd09f7fe640 1 -- 172.21.15.134:0/872105613 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c037070 con 0x7fd0a015ed20 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd09f7fe640 1 -- 172.21.15.134:0/872105613 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08c02ae50 con 0x7fd0a015ed20 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd09f7fe640 1 -- 172.21.15.134:0/872105613 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c032860 con 0x7fd0a015ed20 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 -- 172.21.15.134:0/872105613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a015ed20 msgr2=0x7fd0a00d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a015ed20 0x7fd0a00d15a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009870 tx=0x7fd08c02a300 comp rx=0 tx=0).stop 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 -- 172.21.15.134:0/872105613 shutdown_connections 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a015ed20 0x7fd0a00d15a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 --2- 172.21.15.134:0/872105613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015e940 0x7fd0a00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 -- 172.21.15.134:0/872105613 >> 172.21.15.134:0/872105613 conn(0x7fd0a00b6240 msgr2=0x7fd0a00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 -- 172.21.15.134:0/872105613 shutdown_connections 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.147+0000 7fd0a7191640 1 -- 172.21.15.134:0/872105613 wait complete. 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 Processor -- start 2024-09-15T22:44:59.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 -- start start 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 0x7fd0a00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015ed20 0x7fd0a00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d3f00 con 0x7fd0a00cef90 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d3c20 con 0x7fd0a015e940 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.149+0000 7fd0a7191640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00d3310 con 0x7fd0a015ed20 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37880/0 (socket says 172.21.15.134:37880) 2024-09-15T22:44:59.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 -- 172.21.15.134:0/4125177252 learned_addr learned my addr 172.21.15.134:0/4125177252 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd09ffff640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 0x7fd0a00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a572e640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015ed20 0x7fd0a00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 -- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015ed20 msgr2=0x7fd0a00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015ed20 0x7fd0a00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 -- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 msgr2=0x7fd0a00cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 0x7fd0a00cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 -- 172.21.15.134:0/4125177252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a00cac20 con 0x7fd0a00cef90 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd09ffff640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 0x7fd0a00cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a4f2d640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9e0 tx=0x7fd09400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094017070 con 0x7fd0a00cef90 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09400c970 con 0x7fd0a00cef90 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a0148ad0 con 0x7fd0a00cef90 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09400cd60 con 0x7fd0a00cef90 2024-09-15T22:44:59.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.150+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a0149050 con 0x7fd0a00cef90 2024-09-15T22:44:59.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.151+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a00ba010 con 0x7fd0a00cef90 2024-09-15T22:44:59.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.152+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd09401a070 con 0x7fd0a00cef90 2024-09-15T22:44:59.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.152+0000 7fd09d7fa640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 0x7fd08406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.152+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fd09408b970 con 0x7fd0a00cef90 2024-09-15T22:44:59.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.152+0000 7fd09ffff640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 0x7fd08406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.153+0000 7fd09ffff640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 0x7fd08406ead0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd08c034000 tx=0x7fd08c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.156+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0a00ba010 con 0x7fd0a00cef90 2024-09-15T22:44:59.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.322+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0a00b5360 con 0x7fd0a00cef90 2024-09-15T22:44:59.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.323+0000 7fd09d7fa640 1 -- 172.21.15.134:0/4125177252 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16717 (secure 0 0 0) 0x7fd0a00b5360 con 0x7fd0a00cef90 2024-09-15T22:44:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:44:59.325 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":72,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:58.056564+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:56.017103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:57.030116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:59.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 msgr2=0x7fd08406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 0x7fd08406ead0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd08c034000 tx=0x7fd08c02e000 comp rx=0 tx=0).stop 2024-09-15T22:44:59.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 msgr2=0x7fd0a00ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9e0 tx=0x7fd09400eea0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 shutdown_connections 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd08406c610 0x7fd08406ead0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0a015ed20 0x7fd0a00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a015e940 0x7fd0a00cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 --2- 172.21.15.134:0/4125177252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00cef90 0x7fd0a00ca6e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 >> 172.21.15.134:0/4125177252 conn(0x7fd0a00b6240 msgr2=0x7fd0a00b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 shutdown_connections 2024-09-15T22:44:59.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.325+0000 7fd0a7191640 1 -- 172.21.15.134:0/4125177252 wait complete. 2024-09-15T22:44:59.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:44:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.437+0000 7f9607ef8640 1 Processor -- start 2024-09-15T22:44:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.437+0000 7f9607ef8640 1 -- start start 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9607ef8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9600073150 0x7f96000b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9607ef8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f96000b7190 0x7f960006e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9607ef8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960006d130 con 0x7f960015e860 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9607ef8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f960006d410 con 0x7f9600073150 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9607ef8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f960006d6f0 con 0x7f96000b7190 2024-09-15T22:44:59.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9605493640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9600073150 0x7f96000b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9605493640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9600073150 0x7f96000b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37894/0 (socket says 172.21.15.134:37894) 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9605493640 1 -- 172.21.15.134:0/128524643 learned_addr learned my addr 172.21.15.134:0/128524643 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.438+0000 7f9606495640 1 --2- 172.21.15.134:0/128524643 >> v2:172.21.15.177:3300/0 conn(0x7f96000b7190 0x7f960006e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9605493640 1 -- 172.21.15.134:0/128524643 >> v2:172.21.15.177:3300/0 conn(0x7f96000b7190 msgr2=0x7f960006e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9605493640 1 --2- 172.21.15.134:0/128524643 >> v2:172.21.15.177:3300/0 conn(0x7f96000b7190 0x7f960006e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9605493640 1 -- 172.21.15.134:0/128524643 >> v1:172.21.15.177:6789/0 conn(0x7f960015e860 legacy=0x7f960015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9605493640 1 -- 172.21.15.134:0/128524643 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960006d9d0 con 0x7f9600073150 2024-09-15T22:44:59.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9605493640 1 --2- 172.21.15.134:0/128524643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600073150 0x7f96000b6c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f96000730e0 tx=0x7f95f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5939a8de4c3cc6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.439+0000 7f9604c92640 1 -- 172.21.15.134:0/128524643 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4037070 con 0x7f9600073150 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9604c92640 1 -- 172.21.15.134:0/128524643 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f4032440 con 0x7f9600073150 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9604c92640 1 -- 172.21.15.134:0/128524643 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4032810 con 0x7f9600073150 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 -- 172.21.15.134:0/128524643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600073150 msgr2=0x7f96000b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 --2- 172.21.15.134:0/128524643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600073150 0x7f96000b6c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f96000730e0 tx=0x7f95f402a270 comp rx=0 tx=0).stop 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 -- 172.21.15.134:0/128524643 shutdown_connections 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 --2- 172.21.15.134:0/128524643 >> v2:172.21.15.177:3300/0 conn(0x7f96000b7190 0x7f960006e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 --2- 172.21.15.134:0/128524643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600073150 0x7f96000b6c50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 -- 172.21.15.134:0/128524643 >> 172.21.15.134:0/128524643 conn(0x7f96000b4290 msgr2=0x7f96000b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 -- 172.21.15.134:0/128524643 shutdown_connections 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.440+0000 7f9607ef8640 1 -- 172.21.15.134:0/128524643 wait complete. 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.441+0000 7f9607ef8640 1 Processor -- start 2024-09-15T22:44:59.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.441+0000 7f9607ef8640 1 -- start start 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9600073150 0x7f9600143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 0x7f9600146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f960006cd50 con 0x7f960015e860 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96000b7600 con 0x7f9600073150 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9607ef8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f960006ced0 con 0x7f96000b7190 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9606495640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9606495640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37906/0 (socket says 172.21.15.134:37906) 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9606495640 1 -- 172.21.15.134:0/3282238282 learned_addr learned my addr 172.21.15.134:0/3282238282 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9605c94640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9600073150 0x7f9600143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.442+0000 7f9605493640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 0x7f9600146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 -- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 msgr2=0x7f9600146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 0x7f9600146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 -- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9600073150 msgr2=0x7f9600143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9600073150 0x7f9600143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 -- 172.21.15.134:0/3282238282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96001470b0 con 0x7f960015e860 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9605493640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 0x7f9600146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9606495640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e930 tx=0x7f95f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8017070 con 0x7f960015e860 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f800c980 con 0x7f960015e860 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800cd70 con 0x7f960015e860 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9600144490 con 0x7f960015e860 2024-09-15T22:44:59.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.443+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9600144a50 con 0x7f960015e860 2024-09-15T22:44:59.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.444+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96000b6c50 con 0x7f960015e860 2024-09-15T22:44:59.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.444+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f95f801a070 con 0x7f960015e860 2024-09-15T22:44:59.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.445+0000 7f95fe7fc640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 0x7f95ec06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.445+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f95f808bc30 con 0x7f960015e860 2024-09-15T22:44:59.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.445+0000 7f9605c94640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 0x7f95ec06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.445+0000 7f9605c94640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 0x7f95ec06ead0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f95f0001e70 tx=0x7f95f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.449+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95f8059a00 con 0x7f960015e860 2024-09-15T22:44:59.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.646+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f96000b1b00 con 0x7f960015e860 2024-09-15T22:44:59.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.726+0000 7f95fe7fc640 1 -- 172.21.15.134:0/3282238282 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f95f805dd00 con 0x7f960015e860 2024-09-15T22:44:59.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.728+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 msgr2=0x7f95ec06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.728+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 0x7f95ec06ead0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f95f0001e70 tx=0x7f95f0009040 comp rx=0 tx=0).stop 2024-09-15T22:44:59.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.728+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 msgr2=0x7f9600155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.728+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e930 tx=0x7f95f800edf0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 shutdown_connections 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f95ec06c610 0x7f95ec06ead0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960015e860 0x7f9600155210 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96000b7190 0x7f9600146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 --2- 172.21.15.134:0/3282238282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9600073150 0x7f9600143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 >> 172.21.15.134:0/3282238282 conn(0x7f96000b4290 msgr2=0x7f9600161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 shutdown_connections 2024-09-15T22:44:59.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.729+0000 7f9607ef8640 1 -- 172.21.15.134:0/3282238282 wait complete. 2024-09-15T22:44:59.741 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:44:59.742 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:44:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.843+0000 7fb75b923640 1 Processor -- start 2024-09-15T22:44:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.843+0000 7fb75b923640 1 -- start start 2024-09-15T22:44:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb75b923640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb754148020 0x7fb7540b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb75b923640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 0x7fb7540b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb75b923640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb754148400 con 0x7fb7540ae8e0 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb75b923640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb7540b5ff0 con 0x7fb754148020 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb75b923640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb7540b53e0 con 0x7fb7540b4b90 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb754148020 0x7fb7540b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb759ec0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb7540ae8e0 0x7fb75406e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47946/0 (socket says 172.21.15.134:47946) 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb754148020 0x7fb7540b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37922/0 (socket says 172.21.15.134:37922) 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb759ec0640 1 -- 172.21.15.134:0/3636373756 learned_addr learned my addr 172.21.15.134:0/3636373756 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb758ebe640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 0x7fb7540b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 -- 172.21.15.134:0/3636373756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 msgr2=0x7fb7540b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 0x7fb7540b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 -- 172.21.15.134:0/3636373756 >> v1:172.21.15.134:6789/0 conn(0x7fb7540ae8e0 legacy=0x7fb75406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb7596bf640 1 -- 172.21.15.134:0/3636373756 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7540b56c0 con 0x7fb754148020 2024-09-15T22:44:59.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb74bfff640 1 -- 172.21.15.134:0/3636373756 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252073109 0 0) 0x7fb754148400 con 0x7fb7540ae8e0 2024-09-15T22:44:59.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.844+0000 7fb758ebe640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 0x7fb7540b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:59.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb7596bf640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb754148020 0x7fb7540b0b30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb7500097a0 tx=0x7fb75002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55011a6522d4adfc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb74bfff640 1 -- 172.21.15.134:0/3636373756 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750037070 con 0x7fb754148020 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb74bfff640 1 -- 172.21.15.134:0/3636373756 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750032440 con 0x7fb754148020 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb74bfff640 1 -- 172.21.15.134:0/3636373756 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750032810 con 0x7fb754148020 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb75b923640 1 -- 172.21.15.134:0/3636373756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb754148020 msgr2=0x7fb7540b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.845+0000 7fb75b923640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb754148020 0x7fb7540b0b30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb7500097a0 tx=0x7fb75002a180 comp rx=0 tx=0).stop 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 -- 172.21.15.134:0/3636373756 shutdown_connections 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7540b4b90 0x7fb7540b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 --2- 172.21.15.134:0/3636373756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb754148020 0x7fb7540b0b30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 -- 172.21.15.134:0/3636373756 >> 172.21.15.134:0/3636373756 conn(0x7fb75406d0d0 msgr2=0x7fb75406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 -- 172.21.15.134:0/3636373756 shutdown_connections 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.846+0000 7fb75b923640 1 -- 172.21.15.134:0/3636373756 wait complete. 2024-09-15T22:44:59.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.847+0000 7fb75b923640 1 Processor -- start 2024-09-15T22:44:59.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.847+0000 7fb75b923640 1 -- start start 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 0x7fb754133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 0x7fb754160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540b69c0 con 0x7fb7540b4b90 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540b5c80 con 0x7fb7540ae8e0 2024-09-15T22:44:59.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb7540b4fd0 con 0x7fb754148020 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37932/0 (socket says 172.21.15.134:37932) 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 -- 172.21.15.134:0/2651510712 learned_addr learned my addr 172.21.15.134:0/2651510712 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb759ec0640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 0x7fb754160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb7596bf640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 0x7fb754133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 -- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 msgr2=0x7fb754160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 0x7fb754160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 -- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 msgr2=0x7fb754133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 0x7fb754133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 -- 172.21.15.134:0/2651510712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7541e7450 con 0x7fb7540b4b90 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb759ec0640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 0x7fb754160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb7596bf640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 0x7fb754133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb758ebe640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c7f0 tx=0x7fb74400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744015070 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744007820 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb754141ab0 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.848+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744007bd0 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.849+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb754142070 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.849+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7540b4580 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.850+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fb744018070 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.850+0000 7fb749ffb640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 0x7fb73806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.851+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fb74408bb80 con 0x7fb7540b4b90 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.851+0000 7fb7596bf640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 0x7fb73806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.851+0000 7fb7596bf640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 0x7fb73806ead0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb750034000 tx=0x7fb75002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:44:59.855+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7540b4580 con 0x7fb7540b4b90 2024-09-15T22:45:00.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.053+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb7540d1b00 con 0x7fb7540b4b90 2024-09-15T22:45:00.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.736+0000 7fb749ffb640 1 -- 172.21.15.134:0/2651510712 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fb744059dd0 con 0x7fb7540b4b90 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.738+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 msgr2=0x7fb73806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.738+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 0x7fb73806ead0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb750034000 tx=0x7fb75002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.738+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 msgr2=0x7fb7541e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.738+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c7f0 tx=0x7fb74400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.738+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 shutdown_connections 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb73806c610 0x7fb73806ead0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb754148020 0x7fb754160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7540b4b90 0x7fb7541e6f10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 --2- 172.21.15.134:0/2651510712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7540ae8e0 0x7fb754133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 >> 172.21.15.134:0/2651510712 conn(0x7fb75406d0d0 msgr2=0x7fb75406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:00.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 shutdown_connections 2024-09-15T22:45:00.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.739+0000 7fb75b923640 1 -- 172.21.15.134:0/2651510712 wait complete. 2024-09-15T22:45:00.752 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:45:00.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:00.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.850+0000 7f52cbc27640 1 Processor -- start 2024-09-15T22:45:00.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.851+0000 7f52cbc27640 1 -- start start 2024-09-15T22:45:00.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52cbc27640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f52c415ed20 0x7f52c40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52cbc27640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c40b7170 con 0x7f52c415e940 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52cbc27640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c40b7aa0 con 0x7f52c40cef90 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52cbc27640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f52c40d3660 con 0x7f52c415ed20 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c99c3640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f52c415e940 0x7f52c40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47958/0 (socket says 172.21.15.134:47958) 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c99c3640 1 -- 172.21.15.134:0/453318981 learned_addr learned my addr 172.21.15.134:0/453318981 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069108217 0 0) 0x7f52bc001110 con 0x7f52c415e940 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ac003520 con 0x7f52c415e940 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c91c2640 1 --2- 172.21.15.134:0/453318981 >> v2:172.21.15.177:3300/0 conn(0x7f52c415ed20 0x7f52c40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2935121765 0 0) 0x7f52ac003520 con 0x7f52c415e940 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 >> v2:172.21.15.177:3300/0 conn(0x7f52c415ed20 msgr2=0x7f52c40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 --2- 172.21.15.134:0/453318981 >> v2:172.21.15.177:3300/0 conn(0x7f52c415ed20 0x7f52c40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 >> v1:172.21.15.177:6789/0 conn(0x7f52c40cef90 legacy=0x7f52c40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c40d3940 con 0x7f52c415e940 2024-09-15T22:45:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f52bc001840 con 0x7f52c415e940 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 >> v1:172.21.15.134:6789/0 conn(0x7f52c415e940 legacy=0x7f52c40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 0x7f52ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac004800 0x7f52ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52ac0051c0 0x7f52ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40d3660 con 0x7f52ac0039b0 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac00c070 con 0x7f52ac0051c0 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52ac00c270 con 0x7f52ac004800 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.852+0000 7f52c99c3640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 0x7f52ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c91c2640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac004800 0x7f52ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52ca1c4640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52ac0051c0 0x7f52ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 -- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac004800 msgr2=0x7f52ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:00.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac004800 0x7f52ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 -- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52ac0051c0 msgr2=0x7f52ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52ac0051c0 0x7f52ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 -- 172.21.15.134:0/453318981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac003520 con 0x7f52ac0039b0 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c91c2640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac004800 0x7f52ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52ca1c4640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52ac0051c0 0x7f52ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52ca1c4640 1 -- 172.21.15.134:0/453318981 reap_dead start 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c99c3640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 0x7f52ac003dd0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c4c0 tx=0x7f52ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53db8c8f96656c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.853+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00c0e0 con 0x7f52ac0039b0 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc034070 con 0x7f52ac0039b0 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52c89c1640 1 -- 172.21.15.134:0/453318981 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc005d70 con 0x7f52ac0039b0 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 -- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 msgr2=0x7f52ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 0x7f52ac003dd0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c4c0 tx=0x7f52ac005830 comp rx=0 tx=0).stop 2024-09-15T22:45:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 -- 172.21.15.134:0/453318981 shutdown_connections 2024-09-15T22:45:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 --2- 172.21.15.134:0/453318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac0039b0 0x7f52ac003dd0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 -- 172.21.15.134:0/453318981 >> 172.21.15.134:0/453318981 conn(0x7f52c40b6240 msgr2=0x7f52c40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 -- 172.21.15.134:0/453318981 shutdown_connections 2024-09-15T22:45:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.854+0000 7f52cbc27640 1 -- 172.21.15.134:0/453318981 wait complete. 2024-09-15T22:45:00.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.855+0000 7f52cbc27640 1 Processor -- start 2024-09-15T22:45:00.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.855+0000 7f52cbc27640 1 -- start start 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 0x7f52c41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 0x7f52c40b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40d1ef0 con 0x7f52c41f4620 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40d3f00 con 0x7f52c41f41a0 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52cbc27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52c40d2070 con 0x7f52ac0039b0 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37956/0 (socket says 172.21.15.134:37956) 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 -- 172.21.15.134:0/1922387094 learned_addr learned my addr 172.21.15.134:0/1922387094 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52c99c3640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 0x7f52c41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52c91c2640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 0x7f52c40b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 -- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 msgr2=0x7f52c41583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 0x7f52c41583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 -- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 msgr2=0x7f52c40b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 0x7f52c40b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52ca1c4640 1 -- 172.21.15.134:0/1922387094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4148d10 con 0x7f52c41f4620 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52c99c3640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 0x7f52c41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.856+0000 7f52c91c2640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 0x7f52c40b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52ca1c4640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f52c406ed30 tx=0x7f52b400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:00.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4003970 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4018070 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4003d50 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c4157630 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.857+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c4157bb0 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.858+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c40d10f0 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.858+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f52b40050d0 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.859+0000 7f52c27fc640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 0x7f52b006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.859+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f52b408b580 con 0x7f52c41f4620 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.859+0000 7f52c99c3640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 0x7f52b006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:00.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.859+0000 7f52c99c3640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 0x7f52b006ead0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52bc033000 tx=0x7f52bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:00.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:00.863+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52b4059a30 con 0x7f52c41f4620 2024-09-15T22:45:01.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.064+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52c40ba6b0 con 0x7f52c41f4620 2024-09-15T22:45:01.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.065+0000 7f52c27fc640 1 -- 172.21.15.134:0/1922387094 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5234 (secure 0 0 0) 0x7f52b4059330 con 0x7f52c41f4620 2024-09-15T22:45:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:01.067 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":36,"btime":"2024-09-15T22:45:00:727361+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 36 2024-09-15T22:45:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 msgr2=0x7f52b006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 0x7f52b006ead0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52bc033000 tx=0x7f52bc02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 msgr2=0x7f52c40b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f52c406ed30 tx=0x7f52b400eb90 comp rx=0 tx=0).stop 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 shutdown_connections 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f52b006c610 0x7f52b006ead0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41f4620 0x7f52c40b5930 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52c41f41a0 0x7f52c40b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 --2- 172.21.15.134:0/1922387094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52ac0039b0 0x7f52c41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 >> 172.21.15.134:0/1922387094 conn(0x7f52c40b6240 msgr2=0x7f52c40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 shutdown_connections 2024-09-15T22:45:01.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.067+0000 7f52cbc27640 1 -- 172.21.15.134:0/1922387094 wait complete. 2024-09-15T22:45:01.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.177+0000 7f988a323640 1 Processor -- start 2024-09-15T22:45:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.177+0000 7f988a323640 1 -- start start 2024-09-15T22:45:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f988a323640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f98840cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f988a323640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98840cd5f0 con 0x7f9884151c50 2024-09-15T22:45:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f988a323640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98840cd8d0 con 0x7f988406c1f0 2024-09-15T22:45:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f988a323640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98840cdbb0 con 0x7f988406be10 2024-09-15T22:45:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f98888c0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9884151c50 0x7f9884164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47972/0 (socket says 172.21.15.134:47972) 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f98888c0640 1 -- 172.21.15.134:0/2833719214 learned_addr learned my addr 172.21.15.134:0/2833719214 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9883fff640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f98840cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926957341 0 0) 0x7f98840cd5f0 con 0x7f9884151c50 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f986c003520 con 0x7f9884151c50 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2877022772 0 0) 0x7f986c003520 con 0x7f9884151c50 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 msgr2=0x7f98840cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f98840cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 >> v1:172.21.15.177:6789/0 conn(0x7f988406c1f0 legacy=0x7f9884151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840cde90 con 0x7f9884151c50 2024-09-15T22:45:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f987c0019f0 con 0x7f9884151c50 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 >> v1:172.21.15.134:6789/0 conn(0x7f9884151c50 legacy=0x7f9884164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c0039e0 0x7f986c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c004390 0x7f986c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f986c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98840cdbb0 con 0x7f986c004390 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f986c00b9c0 con 0x7f986c0039e0 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f986c00ddd0 con 0x7f988406be10 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.178+0000 7f98837fe640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c004390 0x7f986c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f9883fff640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c0039e0 0x7f986c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98888c0640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f986c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 -- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 msgr2=0x7f986c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f988406be10 0x7f986c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 -- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c0039e0 msgr2=0x7f986c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c0039e0 0x7f986c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 -- 172.21.15.134:0/2833719214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c003520 con 0x7f986c004390 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.179+0000 7f98837fe640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c004390 0x7f986c004860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f98780018e0 tx=0x7f986c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772045c1f3083284 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878037070 con 0x7f986c004390 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987802ac10 con 0x7f986c004390 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f9882ffd640 1 -- 172.21.15.134:0/2833719214 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98780014e0 con 0x7f986c004390 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 -- 172.21.15.134:0/2833719214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c004390 msgr2=0x7f986c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 --2- 172.21.15.134:0/2833719214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c004390 0x7f986c004860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f98780018e0 tx=0x7f986c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f98888c0640 1 -- 172.21.15.134:0/2833719214 reap_dead start 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 -- 172.21.15.134:0/2833719214 shutdown_connections 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 -- 172.21.15.134:0/2833719214 >> 172.21.15.134:0/2833719214 conn(0x7f9884062cc0 msgr2=0x7f988406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 -- 172.21.15.134:0/2833719214 shutdown_connections 2024-09-15T22:45:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.180+0000 7f988a323640 1 -- 172.21.15.134:0/2833719214 wait complete. 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.181+0000 7f988a323640 1 Processor -- start 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 -- start start 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c004390 0x7f9884150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9884151190 0x7f98840aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98840cd010 con 0x7f9884150d10 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98840ce690 con 0x7f9884151190 2024-09-15T22:45:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f988a323640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98840cd190 con 0x7f986c004390 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f98837fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f98837fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37968/0 (socket says 172.21.15.134:37968) 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.182+0000 7f98837fe640 1 -- 172.21.15.134:0/319273030 learned_addr learned my addr 172.21.15.134:0/319273030 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f9883fff640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c004390 0x7f9884150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98888c0640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9884151190 0x7f98840aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 -- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c004390 msgr2=0x7f9884150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c004390 0x7f9884150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 -- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9884151190 msgr2=0x7f98840aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9884151190 0x7f98840aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 -- 172.21.15.134:0/319273030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9884157740 con 0x7f9884150d10 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f98837fe640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9878001a00 tx=0x7f98780012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878037040 con 0x7f9884150d10 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98780052e0 con 0x7f9884150d10 2024-09-15T22:45:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9884157a20 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878007240 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.183+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9884150a70 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.184+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884157bf0 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.185+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f987803a070 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.185+0000 7f9880ff9640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 0x7f987006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.185+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f98780ab9e0 con 0x7f9884150d10 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.185+0000 7f9883fff640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 0x7f987006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.186+0000 7f9883fff640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 0x7f987006eb00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9874009b00 tx=0x7f9874008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.189+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9884157bf0 con 0x7f9884150d10 2024-09-15T22:45:01.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.355+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9884154060 con 0x7f9884150d10 2024-09-15T22:45:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.357+0000 7f9880ff9640 1 -- 172.21.15.134:0/319273030 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16704 (secure 0 0 0) 0x7f9878079c40 con 0x7f9884150d10 2024-09-15T22:45:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:01.358 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":73,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:44:59.720706+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:56.017103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:57.030116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 msgr2=0x7f987006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 0x7f987006eb00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9874009b00 tx=0x7f9874008040 comp rx=0 tx=0).stop 2024-09-15T22:45:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 msgr2=0x7f98840ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9878001a00 tx=0x7f98780012b0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 shutdown_connections 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f987006c640 0x7f987006eb00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9884151190 0x7f98840aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9884150d10 0x7f98840ae8e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 --2- 172.21.15.134:0/319273030 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c004390 0x7f9884150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 >> 172.21.15.134:0/319273030 conn(0x7f9884062cc0 msgr2=0x7f9884159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 shutdown_connections 2024-09-15T22:45:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.359+0000 7f988a323640 1 -- 172.21.15.134:0/319273030 wait complete. 2024-09-15T22:45:01.371 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:45:01.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.468+0000 7f5c86f0c640 1 Processor -- start 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.468+0000 7f5c86f0c640 1 -- start start 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c86f0c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5c800b5600 0x7f5c80073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c86f0c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8006e8d0 con 0x7f5c80073ff0 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c86f0c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8006ebb0 con 0x7f5c8015e7b0 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c86f0c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8006e680 con 0x7f5c800b5600 2024-09-15T22:45:01.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c854a9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5c80073ff0 0x7f5c8006ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47986/0 (socket says 172.21.15.134:47986) 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c854a9640 1 -- 172.21.15.134:0/434780886 learned_addr learned my addr 172.21.15.134:0/434780886 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c7ffff640 1 --2- 172.21.15.134:0/434780886 >> v2:172.21.15.177:3300/0 conn(0x7f5c800b5600 0x7f5c80073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410858416 0 0) 0x7f5c8006e8d0 con 0x7f5c80073ff0 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.469+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c70003520 con 0x7f5c80073ff0 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.470+0000 7f5c7ffff640 1 -- 172.21.15.134:0/434780886 >> v1:172.21.15.177:6789/0 conn(0x7f5c8015e7b0 legacy=0x7f5c80071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.470+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2422210408 0 0) 0x7f5c70003520 con 0x7f5c80073ff0 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.470+0000 7f5c7ffff640 1 -- 172.21.15.134:0/434780886 >> v1:172.21.15.134:6789/0 conn(0x7f5c80073ff0 legacy=0x7f5c8006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.470+0000 7f5c7ffff640 1 -- 172.21.15.134:0/434780886 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c800732b0 con 0x7f5c800b5600 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.470+0000 7f5c7ffff640 1 --2- 172.21.15.134:0/434780886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c800b5600 0x7f5c80073ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c8006e800 tx=0x7f5c6c02a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a34823471d68eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c037070 con 0x7f5c800b5600 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6c02aac0 con 0x7f5c800b5600 2024-09-15T22:45:01.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c7f7fe640 1 -- 172.21.15.134:0/434780886 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780019f0 con 0x7f5c800b5600 2024-09-15T22:45:01.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 -- 172.21.15.134:0/434780886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c800b5600 msgr2=0x7f5c80073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/434780886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c800b5600 0x7f5c80073ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c8006e800 tx=0x7f5c6c02a030 comp rx=0 tx=0).stop 2024-09-15T22:45:01.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 -- 172.21.15.134:0/434780886 shutdown_connections 2024-09-15T22:45:01.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/434780886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c800b5600 0x7f5c80073ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 -- 172.21.15.134:0/434780886 >> 172.21.15.134:0/434780886 conn(0x7f5c800b4300 msgr2=0x7f5c800b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 -- 172.21.15.134:0/434780886 shutdown_connections 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.471+0000 7f5c86f0c640 1 -- 172.21.15.134:0/434780886 wait complete. 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.472+0000 7f5c86f0c640 1 Processor -- start 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.472+0000 7f5c86f0c640 1 -- start start 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c8015e7b0 0x7f5c80152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 0x7f5c80154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8006d540 con 0x7f5c800b5600 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8006d3c0 con 0x7f5c801547c0 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c86f0c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c801551b0 con 0x7f5c8015e7b0 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c84ca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c84ca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37978/0 (socket says 172.21.15.134:37978) 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.473+0000 7f5c84ca8640 1 -- 172.21.15.134:0/1872170885 learned_addr learned my addr 172.21.15.134:0/1872170885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c7ffff640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c8015e7b0 0x7f5c80152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c854a9640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 0x7f5c80154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 -- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c8015e7b0 msgr2=0x7f5c80152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c8015e7b0 0x7f5c80152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 -- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 msgr2=0x7f5c80154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 0x7f5c80154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 -- 172.21.15.134:0/1872170885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c80152e10 con 0x7f5c800b5600 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c854a9640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 0x7f5c80154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c84ca8640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c520 tx=0x7f5c7400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74017070 con 0x7f5c800b5600 2024-09-15T22:45:01.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c74005480 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c801530d0 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74003830 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.474+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c80153690 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.475+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c80073ab0 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.475+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f5c7401a070 con 0x7f5c800b5600 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.476+0000 7f5c7d7fa640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 0x7f5c6406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.476+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7408ade0 con 0x7f5c800b5600 2024-09-15T22:45:01.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.476+0000 7f5c7ffff640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 0x7f5c6406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.476+0000 7f5c7ffff640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 0x7f5c6406ead0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c034000 tx=0x7f5c6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.480+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c74059150 con 0x7f5c800b5600 2024-09-15T22:45:01.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.640+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c800b1a90 con 0x7f5c6406c610 2024-09-15T22:45:01.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.647+0000 7f5c7d7fa640 1 -- 172.21.15.134:0/1872170885 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252066 (secure 0 0 0) 0x7f5c800b1a90 con 0x7f5c6406c610 2024-09-15T22:45:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:01.652 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:01.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 msgr2=0x7f5c6406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 0x7f5c6406ead0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c034000 tx=0x7f5c6c02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 msgr2=0x7f5c8014edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c520 tx=0x7f5c7400c9e0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 shutdown_connections 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f5c6406c610 0x7f5c6406ead0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c801547c0 0x7f5c80154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c8015e7b0 0x7f5c80152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 --2- 172.21.15.134:0/1872170885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800b5600 0x7f5c8014edb0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 >> 172.21.15.134:0/1872170885 conn(0x7f5c800b4300 msgr2=0x7f5c800b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 shutdown_connections 2024-09-15T22:45:01.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.650+0000 7f5c86f0c640 1 -- 172.21.15.134:0/1872170885 wait complete. 2024-09-15T22:45:01.663 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-15T22:45:00.994857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236796,"kb_used_data":8064,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737924,"statfs":{"total":773094113280,"available":772851634176,"internally_reserved":0,"allocated":8257536,"data_stored":4114347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.292730"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769676+0000","last_change":"2024-09-15T22:44:58.739420+0000","last_active":"2024-09-15T22:44:59.769676+0000","last_peered":"2024-09-15T22:44:59.769676+0000","last_clean":"2024-09-15T22:44:59.769676+0000","last_became_active":"2024-09-15T22:44:58.738545+0000","last_became_peered":"2024-09-15T22:44:58.738545+0000","last_unstale":"2024-09-15T22:44:59.769676+0000","last_undegraded":"2024-09-15T22:44:59.769676+0000","last_fullsized":"2024-09-15T22:44:59.769676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:59.309169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770226+0000","last_change":"2024-09-15T22:44:58.733306+0000","last_active":"2024-09-15T22:44:59.770226+0000","last_peered":"2024-09-15T22:44:59.770226+0000","last_clean":"2024-09-15T22:44:59.770226+0000","last_became_active":"2024-09-15T22:44:58.729647+0000","last_became_peered":"2024-09-15T22:44:58.729647+0000","last_unstale":"2024-09-15T22:44:59.770226+0000","last_undegraded":"2024-09-15T22:44:59.770226+0000","last_fullsized":"2024-09-15T22:44:59.770226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:01.810455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769922+0000","last_change":"2024-09-15T22:44:58.722251+0000","last_active":"2024-09-15T22:44:59.769922+0000","last_peered":"2024-09-15T22:44:59.769922+0000","last_clean":"2024-09-15T22:44:59.769922+0000","last_became_active":"2024-09-15T22:44:58.721904+0000","last_became_peered":"2024-09-15T22:44:58.721904+0000","last_unstale":"2024-09-15T22:44:59.769922+0000","last_undegraded":"2024-09-15T22:44:59.769922+0000","last_fullsized":"2024-09-15T22:44:59.769922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:51.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769768+0000","last_change":"2024-09-15T22:44:58.721569+0000","last_active":"2024-09-15T22:44:59.769768+0000","last_peered":"2024-09-15T22:44:59.769768+0000","last_clean":"2024-09-15T22:44:59.769768+0000","last_became_active":"2024-09-15T22:44:58.721272+0000","last_became_peered":"2024-09-15T22:44:58.721272+0000","last_unstale":"2024-09-15T22:44:59.769768+0000","last_undegraded":"2024-09-15T22:44:59.769768+0000","last_fullsized":"2024-09-15T22:44:59.769768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:55.201733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770154+0000","last_change":"2024-09-15T22:44:58.730819+0000","last_active":"2024-09-15T22:44:59.770154+0000","last_peered":"2024-09-15T22:44:59.770154+0000","last_clean":"2024-09-15T22:44:59.770154+0000","last_became_active":"2024-09-15T22:44:58.730546+0000","last_became_peered":"2024-09-15T22:44:58.730546+0000","last_unstale":"2024-09-15T22:44:59.770154+0000","last_undegraded":"2024-09-15T22:44:59.770154+0000","last_fullsized":"2024-09-15T22:44:59.770154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:44.439755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771420+0000","last_change":"2024-09-15T22:44:58.739267+0000","last_active":"2024-09-15T22:44:59.771420+0000","last_peered":"2024-09-15T22:44:59.771420+0000","last_clean":"2024-09-15T22:44:59.771420+0000","last_became_active":"2024-09-15T22:44:58.738508+0000","last_became_peered":"2024-09-15T22:44:58.738508+0000","last_unstale":"2024-09-15T22:44:59.771420+0000","last_undegraded":"2024-09-15T22:44:59.771420+0000","last_fullsized":"2024-09-15T22:44:59.771420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:44.565468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729869+0000","last_change":"2024-09-15T22:44:58.722638+0000","last_active":"2024-09-15T22:44:59.729869+0000","last_peered":"2024-09-15T22:44:59.729869+0000","last_clean":"2024-09-15T22:44:59.729869+0000","last_became_active":"2024-09-15T22:44:58.722375+0000","last_became_peered":"2024-09-15T22:44:58.722375+0000","last_unstale":"2024-09-15T22:44:59.729869+0000","last_undegraded":"2024-09-15T22:44:59.729869+0000","last_fullsized":"2024-09-15T22:44:59.729869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:04.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769069+0000","last_change":"2024-09-15T22:44:58.740562+0000","last_active":"2024-09-15T22:44:59.769069+0000","last_peered":"2024-09-15T22:44:59.769069+0000","last_clean":"2024-09-15T22:44:59.769069+0000","last_became_active":"2024-09-15T22:44:58.739659+0000","last_became_peered":"2024-09-15T22:44:58.739659+0000","last_unstale":"2024-09-15T22:44:59.769069+0000","last_undegraded":"2024-09-15T22:44:59.769069+0000","last_fullsized":"2024-09-15T22:44:59.769069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:19.152415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770253+0000","last_change":"2024-09-15T22:44:58.724815+0000","last_active":"2024-09-15T22:44:59.770253+0000","last_peered":"2024-09-15T22:44:59.770253+0000","last_clean":"2024-09-15T22:44:59.770253+0000","last_became_active":"2024-09-15T22:44:58.724541+0000","last_became_peered":"2024-09-15T22:44:58.724541+0000","last_unstale":"2024-09-15T22:44:59.770253+0000","last_undegraded":"2024-09-15T22:44:59.770253+0000","last_fullsized":"2024-09-15T22:44:59.770253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:04.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730416+0000","last_change":"2024-09-15T22:44:58.730560+0000","last_active":"2024-09-15T22:44:59.730416+0000","last_peered":"2024-09-15T22:44:59.730416+0000","last_clean":"2024-09-15T22:44:59.730416+0000","last_became_active":"2024-09-15T22:44:58.730278+0000","last_became_peered":"2024-09-15T22:44:58.730278+0000","last_unstale":"2024-09-15T22:44:59.730416+0000","last_undegraded":"2024-09-15T22:44:59.730416+0000","last_fullsized":"2024-09-15T22:44:59.730416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:43.690218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769710+0000","last_change":"2024-09-15T22:44:58.740606+0000","last_active":"2024-09-15T22:44:59.769710+0000","last_peered":"2024-09-15T22:44:59.769710+0000","last_clean":"2024-09-15T22:44:59.769710+0000","last_became_active":"2024-09-15T22:44:58.740227+0000","last_became_peered":"2024-09-15T22:44:58.740227+0000","last_unstale":"2024-09-15T22:44:59.769710+0000","last_undegraded":"2024-09-15T22:44:59.769710+0000","last_fullsized":"2024-09-15T22:44:59.769710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:30.771229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732995+0000","last_change":"2024-09-15T22:44:58.716386+0000","last_active":"2024-09-15T22:44:59.732995+0000","last_peered":"2024-09-15T22:44:59.732995+0000","last_clean":"2024-09-15T22:44:59.732995+0000","last_became_active":"2024-09-15T22:44:58.716083+0000","last_became_peered":"2024-09-15T22:44:58.716083+0000","last_unstale":"2024-09-15T22:44:59.732995+0000","last_undegraded":"2024-09-15T22:44:59.732995+0000","last_fullsized":"2024-09-15T22:44:59.732995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:13.972403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769717+0000","last_change":"2024-09-15T22:44:58.729985+0000","last_active":"2024-09-15T22:44:59.769717+0000","last_peered":"2024-09-15T22:44:59.769717+0000","last_clean":"2024-09-15T22:44:59.769717+0000","last_became_active":"2024-09-15T22:44:58.729679+0000","last_became_peered":"2024-09-15T22:44:58.729679+0000","last_unstale":"2024-09-15T22:44:59.769717+0000","last_undegraded":"2024-09-15T22:44:59.769717+0000","last_fullsized":"2024-09-15T22:44:59.769717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:46.051951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733040+0000","last_change":"2024-09-15T22:44:58.726724+0000","last_active":"2024-09-15T22:44:59.733040+0000","last_peered":"2024-09-15T22:44:59.733040+0000","last_clean":"2024-09-15T22:44:59.733040+0000","last_became_active":"2024-09-15T22:44:58.726460+0000","last_became_peered":"2024-09-15T22:44:58.726460+0000","last_unstale":"2024-09-15T22:44:59.733040+0000","last_undegraded":"2024-09-15T22:44:59.733040+0000","last_fullsized":"2024-09-15T22:44:59.733040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:26.415268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732294+0000","last_change":"2024-09-15T22:44:58.720816+0000","last_active":"2024-09-15T22:44:59.732294+0000","last_peered":"2024-09-15T22:44:59.732294+0000","last_clean":"2024-09-15T22:44:59.732294+0000","last_became_active":"2024-09-15T22:44:58.720402+0000","last_became_peered":"2024-09-15T22:44:58.720402+0000","last_unstale":"2024-09-15T22:44:59.732294+0000","last_undegraded":"2024-09-15T22:44:59.732294+0000","last_fullsized":"2024-09-15T22:44:59.732294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:12.033067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769198+0000","last_change":"2024-09-15T22:44:58.741154+0000","last_active":"2024-09-15T22:44:59.769198+0000","last_peered":"2024-09-15T22:44:59.769198+0000","last_clean":"2024-09-15T22:44:59.769198+0000","last_became_active":"2024-09-15T22:44:58.740866+0000","last_became_peered":"2024-09-15T22:44:58.740866+0000","last_unstale":"2024-09-15T22:44:59.769198+0000","last_undegraded":"2024-09-15T22:44:59.769198+0000","last_fullsized":"2024-09-15T22:44:59.769198+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.352166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769948+0000","last_change":"2024-09-15T22:44:58.726742+0000","last_active":"2024-09-15T22:44:59.769948+0000","last_peered":"2024-09-15T22:44:59.769948+0000","last_clean":"2024-09-15T22:44:59.769948+0000","last_became_active":"2024-09-15T22:44:58.726443+0000","last_became_peered":"2024-09-15T22:44:58.726443+0000","last_unstale":"2024-09-15T22:44:59.769948+0000","last_undegraded":"2024-09-15T22:44:59.769948+0000","last_fullsized":"2024-09-15T22:44:59.769948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:20.078527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770475+0000","last_change":"2024-09-15T22:44:58.736315+0000","last_active":"2024-09-15T22:44:59.770475+0000","last_peered":"2024-09-15T22:44:59.770475+0000","last_clean":"2024-09-15T22:44:59.770475+0000","last_became_active":"2024-09-15T22:44:58.735889+0000","last_became_peered":"2024-09-15T22:44:58.735889+0000","last_unstale":"2024-09-15T22:44:59.770475+0000","last_undegraded":"2024-09-15T22:44:59.770475+0000","last_fullsized":"2024-09-15T22:44:59.770475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:19.152415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769564+0000","last_change":"2024-09-15T22:44:58.740671+0000","last_active":"2024-09-15T22:44:59.769564+0000","last_peered":"2024-09-15T22:44:59.769564+0000","last_clean":"2024-09-15T22:44:59.769564+0000","last_became_active":"2024-09-15T22:44:58.740214+0000","last_became_peered":"2024-09-15T22:44:58.740214+0000","last_unstale":"2024-09-15T22:44:59.769564+0000","last_undegraded":"2024-09-15T22:44:59.769564+0000","last_fullsized":"2024-09-15T22:44:59.769564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:27.617801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770388+0000","last_change":"2024-09-15T22:44:58.732773+0000","last_active":"2024-09-15T22:44:59.770388+0000","last_peered":"2024-09-15T22:44:59.770388+0000","last_clean":"2024-09-15T22:44:59.770388+0000","last_became_active":"2024-09-15T22:44:58.732472+0000","last_became_peered":"2024-09-15T22:44:58.732472+0000","last_unstale":"2024-09-15T22:44:59.770388+0000","last_undegraded":"2024-09-15T22:44:59.770388+0000","last_fullsized":"2024-09-15T22:44:59.770388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:19.652996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769900+0000","last_change":"2024-09-15T22:44:58.729587+0000","last_active":"2024-09-15T22:44:59.769900+0000","last_peered":"2024-09-15T22:44:59.769900+0000","last_clean":"2024-09-15T22:44:59.769900+0000","last_became_active":"2024-09-15T22:44:58.728769+0000","last_became_peered":"2024-09-15T22:44:58.728769+0000","last_unstale":"2024-09-15T22:44:59.769900+0000","last_undegraded":"2024-09-15T22:44:59.769900+0000","last_fullsized":"2024-09-15T22:44:59.769900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:32.845338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771470+0000","last_change":"2024-09-15T22:44:58.732559+0000","last_active":"2024-09-15T22:44:59.771470+0000","last_peered":"2024-09-15T22:44:59.771470+0000","last_clean":"2024-09-15T22:44:59.771470+0000","last_became_active":"2024-09-15T22:44:58.732277+0000","last_became_peered":"2024-09-15T22:44:58.732277+0000","last_unstale":"2024-09-15T22:44:59.771470+0000","last_undegraded":"2024-09-15T22:44:59.771470+0000","last_fullsized":"2024-09-15T22:44:59.771470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:12.033067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730102+0000","last_change":"2024-09-15T22:44:58.734037+0000","last_active":"2024-09-15T22:44:59.730102+0000","last_peered":"2024-09-15T22:44:59.730102+0000","last_clean":"2024-09-15T22:44:59.730102+0000","last_became_active":"2024-09-15T22:44:58.732887+0000","last_became_peered":"2024-09-15T22:44:58.732887+0000","last_unstale":"2024-09-15T22:44:59.730102+0000","last_undegraded":"2024-09-15T22:44:59.730102+0000","last_fullsized":"2024-09-15T22:44:59.730102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:26.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769343+0000","last_change":"2024-09-15T22:44:58.740113+0000","last_active":"2024-09-15T22:44:59.769343+0000","last_peered":"2024-09-15T22:44:59.769343+0000","last_clean":"2024-09-15T22:44:59.769343+0000","last_became_active":"2024-09-15T22:44:58.739309+0000","last_became_peered":"2024-09-15T22:44:58.739309+0000","last_unstale":"2024-09-15T22:44:59.769343+0000","last_undegraded":"2024-09-15T22:44:59.769343+0000","last_fullsized":"2024-09-15T22:44:59.769343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:27.510026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730166+0000","last_change":"2024-09-15T22:44:58.733381+0000","last_active":"2024-09-15T22:44:59.730166+0000","last_peered":"2024-09-15T22:44:59.730166+0000","last_clean":"2024-09-15T22:44:59.730166+0000","last_became_active":"2024-09-15T22:44:58.733083+0000","last_became_peered":"2024-09-15T22:44:58.733083+0000","last_unstale":"2024-09-15T22:44:59.730166+0000","last_undegraded":"2024-09-15T22:44:59.730166+0000","last_fullsized":"2024-09-15T22:44:59.730166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:32.338278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769541+0000","last_change":"2024-09-15T22:44:58.736161+0000","last_active":"2024-09-15T22:44:59.769541+0000","last_peered":"2024-09-15T22:44:59.769541+0000","last_clean":"2024-09-15T22:44:59.769541+0000","last_became_active":"2024-09-15T22:44:58.735863+0000","last_became_peered":"2024-09-15T22:44:58.735863+0000","last_unstale":"2024-09-15T22:44:59.769541+0000","last_undegraded":"2024-09-15T22:44:59.769541+0000","last_fullsized":"2024-09-15T22:44:59.769541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:54.321947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770122+0000","last_change":"2024-09-15T22:44:58.729883+0000","last_active":"2024-09-15T22:44:59.770122+0000","last_peered":"2024-09-15T22:44:59.770122+0000","last_clean":"2024-09-15T22:44:59.770122+0000","last_became_active":"2024-09-15T22:44:58.729445+0000","last_became_peered":"2024-09-15T22:44:58.729445+0000","last_unstale":"2024-09-15T22:44:59.770122+0000","last_undegraded":"2024-09-15T22:44:59.770122+0000","last_fullsized":"2024-09-15T22:44:59.770122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:32.750874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769802+0000","last_change":"2024-09-15T22:44:58.737594+0000","last_active":"2024-09-15T22:44:59.769802+0000","last_peered":"2024-09-15T22:44:59.769802+0000","last_clean":"2024-09-15T22:44:59.769802+0000","last_became_active":"2024-09-15T22:44:58.737342+0000","last_became_peered":"2024-09-15T22:44:58.737342+0000","last_unstale":"2024-09-15T22:44:59.769802+0000","last_undegraded":"2024-09-15T22:44:59.769802+0000","last_fullsized":"2024-09-15T22:44:59.769802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:46.858817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769699+0000","last_change":"2024-09-15T22:44:58.735177+0000","last_active":"2024-09-15T22:44:59.769699+0000","last_peered":"2024-09-15T22:44:59.769699+0000","last_clean":"2024-09-15T22:44:59.769699+0000","last_became_active":"2024-09-15T22:44:58.734962+0000","last_became_peered":"2024-09-15T22:44:58.734962+0000","last_unstale":"2024-09-15T22:44:59.769699+0000","last_undegraded":"2024-09-15T22:44:59.769699+0000","last_fullsized":"2024-09-15T22:44:59.769699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.360720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769290+0000","last_change":"2024-09-15T22:44:58.738195+0000","last_active":"2024-09-15T22:44:59.769290+0000","last_peered":"2024-09-15T22:44:59.769290+0000","last_clean":"2024-09-15T22:44:59.769290+0000","last_became_active":"2024-09-15T22:44:58.737815+0000","last_became_peered":"2024-09-15T22:44:58.737815+0000","last_unstale":"2024-09-15T22:44:59.769290+0000","last_undegraded":"2024-09-15T22:44:59.769290+0000","last_fullsized":"2024-09-15T22:44:59.769290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:48.366185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769532+0000","last_change":"2024-09-15T22:44:58.731268+0000","last_active":"2024-09-15T22:44:59.769532+0000","last_peered":"2024-09-15T22:44:59.769532+0000","last_clean":"2024-09-15T22:44:59.769532+0000","last_became_active":"2024-09-15T22:44:58.730999+0000","last_became_peered":"2024-09-15T22:44:58.730999+0000","last_unstale":"2024-09-15T22:44:59.769532+0000","last_undegraded":"2024-09-15T22:44:59.769532+0000","last_fullsized":"2024-09-15T22:44:59.769532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:13.972403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769079+0000","last_change":"2024-09-15T22:44:58.734469+0000","last_active":"2024-09-15T22:44:59.769079+0000","last_peered":"2024-09-15T22:44:59.769079+0000","last_clean":"2024-09-15T22:44:59.769079+0000","last_became_active":"2024-09-15T22:44:58.734218+0000","last_became_peered":"2024-09-15T22:44:58.734218+0000","last_unstale":"2024-09-15T22:44:59.769079+0000","last_undegraded":"2024-09-15T22:44:59.769079+0000","last_fullsized":"2024-09-15T22:44:59.769079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769524+0000","last_change":"2024-09-15T22:44:58.734867+0000","last_active":"2024-09-15T22:44:59.769524+0000","last_peered":"2024-09-15T22:44:59.769524+0000","last_clean":"2024-09-15T22:44:59.769524+0000","last_became_active":"2024-09-15T22:44:58.734547+0000","last_became_peered":"2024-09-15T22:44:58.734547+0000","last_unstale":"2024-09-15T22:44:59.769524+0000","last_undegraded":"2024-09-15T22:44:59.769524+0000","last_fullsized":"2024-09-15T22:44:59.769524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:32.988979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771666+0000","last_change":"2024-09-15T22:44:57.724554+0000","last_active":"2024-09-15T22:44:59.771666+0000","last_peered":"2024-09-15T22:44:59.771666+0000","last_clean":"2024-09-15T22:44:59.771666+0000","last_became_active":"2024-09-15T22:44:57.724272+0000","last_became_peered":"2024-09-15T22:44:57.724272+0000","last_unstale":"2024-09-15T22:44:59.771666+0000","last_undegraded":"2024-09-15T22:44:59.771666+0000","last_fullsized":"2024-09-15T22:44:59.771666+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770254+0000","last_change":"2024-09-15T22:44:58.722762+0000","last_active":"2024-09-15T22:44:59.770254+0000","last_peered":"2024-09-15T22:44:59.770254+0000","last_clean":"2024-09-15T22:44:59.770254+0000","last_became_active":"2024-09-15T22:44:58.722510+0000","last_became_peered":"2024-09-15T22:44:58.722510+0000","last_unstale":"2024-09-15T22:44:59.770254+0000","last_undegraded":"2024-09-15T22:44:59.770254+0000","last_fullsized":"2024-09-15T22:44:59.770254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:54.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770541+0000","last_change":"2024-09-15T22:44:57.721186+0000","last_active":"2024-09-15T22:44:59.770541+0000","last_peered":"2024-09-15T22:44:59.770541+0000","last_clean":"2024-09-15T22:44:59.770541+0000","last_became_active":"2024-09-15T22:44:57.720777+0000","last_became_peered":"2024-09-15T22:44:57.720777+0000","last_unstale":"2024-09-15T22:44:59.770541+0000","last_undegraded":"2024-09-15T22:44:59.770541+0000","last_fullsized":"2024-09-15T22:44:59.770541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:02.333280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771629+0000","last_change":"2024-09-15T22:44:58.741275+0000","last_active":"2024-09-15T22:44:59.771629+0000","last_peered":"2024-09-15T22:44:59.771629+0000","last_clean":"2024-09-15T22:44:59.771629+0000","last_became_active":"2024-09-15T22:44:58.740990+0000","last_became_peered":"2024-09-15T22:44:58.740990+0000","last_unstale":"2024-09-15T22:44:59.771629+0000","last_undegraded":"2024-09-15T22:44:59.771629+0000","last_fullsized":"2024-09-15T22:44:59.771629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769759+0000","last_change":"2024-09-15T22:44:57.723997+0000","last_active":"2024-09-15T22:44:59.769759+0000","last_peered":"2024-09-15T22:44:59.769759+0000","last_clean":"2024-09-15T22:44:59.769759+0000","last_became_active":"2024-09-15T22:44:57.723720+0000","last_became_peered":"2024-09-15T22:44:57.723720+0000","last_unstale":"2024-09-15T22:44:59.769759+0000","last_undegraded":"2024-09-15T22:44:59.769759+0000","last_fullsized":"2024-09-15T22:44:59.769759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:04.175583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730065+0000","last_change":"2024-09-15T22:44:58.716161+0000","last_active":"2024-09-15T22:44:59.730065+0000","last_peered":"2024-09-15T22:44:59.730065+0000","last_clean":"2024-09-15T22:44:59.730065+0000","last_became_active":"2024-09-15T22:44:58.715887+0000","last_became_peered":"2024-09-15T22:44:58.715887+0000","last_unstale":"2024-09-15T22:44:59.730065+0000","last_undegraded":"2024-09-15T22:44:59.730065+0000","last_fullsized":"2024-09-15T22:44:59.730065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:10.358424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771623+0000","last_change":"2024-09-15T22:44:57.722175+0000","last_active":"2024-09-15T22:44:59.771623+0000","last_peered":"2024-09-15T22:44:59.771623+0000","last_clean":"2024-09-15T22:44:59.771623+0000","last_became_active":"2024-09-15T22:44:57.721868+0000","last_became_peered":"2024-09-15T22:44:57.721868+0000","last_unstale":"2024-09-15T22:44:59.771623+0000","last_undegraded":"2024-09-15T22:44:59.771623+0000","last_fullsized":"2024-09-15T22:44:59.771623+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:50.510802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769963+0000","last_change":"2024-09-15T22:44:58.734933+0000","last_active":"2024-09-15T22:44:59.769963+0000","last_peered":"2024-09-15T22:44:59.769963+0000","last_clean":"2024-09-15T22:44:59.769963+0000","last_became_active":"2024-09-15T22:44:58.734580+0000","last_became_peered":"2024-09-15T22:44:58.734580+0000","last_unstale":"2024-09-15T22:44:59.769963+0000","last_undegraded":"2024-09-15T22:44:59.769963+0000","last_fullsized":"2024-09-15T22:44:59.769963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:33.254357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732881+0000","last_change":"2024-09-15T22:44:57.723505+0000","last_active":"2024-09-15T22:44:59.732881+0000","last_peered":"2024-09-15T22:44:59.732881+0000","last_clean":"2024-09-15T22:44:59.732881+0000","last_became_active":"2024-09-15T22:44:57.723228+0000","last_became_peered":"2024-09-15T22:44:57.723228+0000","last_unstale":"2024-09-15T22:44:59.732881+0000","last_undegraded":"2024-09-15T22:44:59.732881+0000","last_fullsized":"2024-09-15T22:44:59.732881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:43.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771458+0000","last_change":"2024-09-15T22:44:58.739311+0000","last_active":"2024-09-15T22:44:59.771458+0000","last_peered":"2024-09-15T22:44:59.771458+0000","last_clean":"2024-09-15T22:44:59.771458+0000","last_became_active":"2024-09-15T22:44:58.739043+0000","last_became_peered":"2024-09-15T22:44:58.739043+0000","last_unstale":"2024-09-15T22:44:59.771458+0000","last_undegraded":"2024-09-15T22:44:59.771458+0000","last_fullsized":"2024-09-15T22:44:59.771458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:58.963227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729730+0000","last_change":"2024-09-15T22:44:57.723384+0000","last_active":"2024-09-15T22:44:59.729730+0000","last_peered":"2024-09-15T22:44:59.729730+0000","last_clean":"2024-09-15T22:44:59.729730+0000","last_became_active":"2024-09-15T22:44:57.723114+0000","last_became_peered":"2024-09-15T22:44:57.723114+0000","last_unstale":"2024-09-15T22:44:59.729730+0000","last_undegraded":"2024-09-15T22:44:59.729730+0000","last_fullsized":"2024-09-15T22:44:59.729730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:48.285580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.728231+0000","last_change":"2024-09-15T22:44:58.721327+0000","last_active":"2024-09-15T22:44:58.728231+0000","last_peered":"2024-09-15T22:44:58.728231+0000","last_clean":"2024-09-15T22:44:58.728231+0000","last_became_active":"2024-09-15T22:44:58.721062+0000","last_became_peered":"2024-09-15T22:44:58.721062+0000","last_unstale":"2024-09-15T22:44:58.728231+0000","last_undegraded":"2024-09-15T22:44:58.728231+0000","last_fullsized":"2024-09-15T22:44:58.728231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:00.411067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.711784+0000","last_change":"2024-09-15T22:44:57.723548+0000","last_active":"2024-09-15T22:44:58.711784+0000","last_peered":"2024-09-15T22:44:58.711784+0000","last_clean":"2024-09-15T22:44:58.711784+0000","last_became_active":"2024-09-15T22:44:57.723285+0000","last_became_peered":"2024-09-15T22:44:57.723285+0000","last_unstale":"2024-09-15T22:44:58.711784+0000","last_undegraded":"2024-09-15T22:44:58.711784+0000","last_fullsized":"2024-09-15T22:44:58.711784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:16.619173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732495+0000","last_change":"2024-09-15T22:44:58.726064+0000","last_active":"2024-09-15T22:44:59.732495+0000","last_peered":"2024-09-15T22:44:59.732495+0000","last_clean":"2024-09-15T22:44:59.732495+0000","last_became_active":"2024-09-15T22:44:58.725779+0000","last_became_peered":"2024-09-15T22:44:58.725779+0000","last_unstale":"2024-09-15T22:44:59.732495+0000","last_undegraded":"2024-09-15T22:44:59.732495+0000","last_fullsized":"2024-09-15T22:44:59.732495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732257+0000","last_change":"2024-09-15T22:44:57.716302+0000","last_active":"2024-09-15T22:44:59.732257+0000","last_peered":"2024-09-15T22:44:59.732257+0000","last_clean":"2024-09-15T22:44:59.732257+0000","last_became_active":"2024-09-15T22:44:57.715969+0000","last_became_peered":"2024-09-15T22:44:57.715969+0000","last_unstale":"2024-09-15T22:44:59.732257+0000","last_undegraded":"2024-09-15T22:44:59.732257+0000","last_fullsized":"2024-09-15T22:44:59.732257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730411+0000","last_change":"2024-09-15T22:44:58.734521+0000","last_active":"2024-09-15T22:44:59.730411+0000","last_peered":"2024-09-15T22:44:59.730411+0000","last_clean":"2024-09-15T22:44:59.730411+0000","last_became_active":"2024-09-15T22:44:58.734273+0000","last_became_peered":"2024-09-15T22:44:58.734273+0000","last_unstale":"2024-09-15T22:44:59.730411+0000","last_undegraded":"2024-09-15T22:44:59.730411+0000","last_fullsized":"2024-09-15T22:44:59.730411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:14.580693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769542+0000","last_change":"2024-09-15T22:44:57.726916+0000","last_active":"2024-09-15T22:44:59.769542+0000","last_peered":"2024-09-15T22:44:59.769542+0000","last_clean":"2024-09-15T22:44:59.769542+0000","last_became_active":"2024-09-15T22:44:57.726664+0000","last_became_peered":"2024-09-15T22:44:57.726664+0000","last_unstale":"2024-09-15T22:44:59.769542+0000","last_undegraded":"2024-09-15T22:44:59.769542+0000","last_fullsized":"2024-09-15T22:44:59.769542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:21.635734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769685+0000","last_change":"2024-09-15T22:44:58.736955+0000","last_active":"2024-09-15T22:44:59.769685+0000","last_peered":"2024-09-15T22:44:59.769685+0000","last_clean":"2024-09-15T22:44:59.769685+0000","last_became_active":"2024-09-15T22:44:58.736680+0000","last_became_peered":"2024-09-15T22:44:58.736680+0000","last_unstale":"2024-09-15T22:44:59.769685+0000","last_undegraded":"2024-09-15T22:44:59.769685+0000","last_fullsized":"2024-09-15T22:44:59.769685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:26.415268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770303+0000","last_change":"2024-09-15T22:44:57.730260+0000","last_active":"2024-09-15T22:44:59.770303+0000","last_peered":"2024-09-15T22:44:59.770303+0000","last_clean":"2024-09-15T22:44:59.770303+0000","last_became_active":"2024-09-15T22:44:57.729978+0000","last_became_peered":"2024-09-15T22:44:57.729978+0000","last_unstale":"2024-09-15T22:44:59.770303+0000","last_undegraded":"2024-09-15T22:44:59.770303+0000","last_fullsized":"2024-09-15T22:44:59.770303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769447+0000","last_change":"2024-09-15T22:44:58.739015+0000","last_active":"2024-09-15T22:44:59.769447+0000","last_peered":"2024-09-15T22:44:59.769447+0000","last_clean":"2024-09-15T22:44:59.769447+0000","last_became_active":"2024-09-15T22:44:58.738704+0000","last_became_peered":"2024-09-15T22:44:58.738704+0000","last_unstale":"2024-09-15T22:44:59.769447+0000","last_undegraded":"2024-09-15T22:44:59.769447+0000","last_fullsized":"2024-09-15T22:44:59.769447+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:23.509445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733198+0000","last_change":"2024-09-15T22:44:57.719464+0000","last_active":"2024-09-15T22:44:59.733198+0000","last_peered":"2024-09-15T22:44:59.733198+0000","last_clean":"2024-09-15T22:44:59.733198+0000","last_became_active":"2024-09-15T22:44:57.719115+0000","last_became_peered":"2024-09-15T22:44:57.719115+0000","last_unstale":"2024-09-15T22:44:59.733198+0000","last_undegraded":"2024-09-15T22:44:59.733198+0000","last_fullsized":"2024-09-15T22:44:59.733198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769961+0000","last_change":"2024-09-15T22:44:58.724037+0000","last_active":"2024-09-15T22:44:59.769961+0000","last_peered":"2024-09-15T22:44:59.769961+0000","last_clean":"2024-09-15T22:44:59.769961+0000","last_became_active":"2024-09-15T22:44:58.723750+0000","last_became_peered":"2024-09-15T22:44:58.723750+0000","last_unstale":"2024-09-15T22:44:59.769961+0000","last_undegraded":"2024-09-15T22:44:59.769961+0000","last_fullsized":"2024-09-15T22:44:59.769961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:57.576386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.744113+0000","last_change":"2024-09-15T22:44:57.719852+0000","last_active":"2024-09-15T22:44:58.744113+0000","last_peered":"2024-09-15T22:44:58.744113+0000","last_clean":"2024-09-15T22:44:58.744113+0000","last_became_active":"2024-09-15T22:44:57.719555+0000","last_became_peered":"2024-09-15T22:44:57.719555+0000","last_unstale":"2024-09-15T22:44:58.744113+0000","last_undegraded":"2024-09-15T22:44:58.744113+0000","last_fullsized":"2024-09-15T22:44:58.744113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:52.596547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771569+0000","last_change":"2024-09-15T22:44:58.728185+0000","last_active":"2024-09-15T22:44:59.771569+0000","last_peered":"2024-09-15T22:44:59.771569+0000","last_clean":"2024-09-15T22:44:59.771569+0000","last_became_active":"2024-09-15T22:44:58.727883+0000","last_became_peered":"2024-09-15T22:44:58.727883+0000","last_unstale":"2024-09-15T22:44:59.771569+0000","last_undegraded":"2024-09-15T22:44:59.771569+0000","last_fullsized":"2024-09-15T22:44:59.771569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.740535+0000","last_change":"2024-09-15T22:44:57.721945+0000","last_active":"2024-09-15T22:44:58.740535+0000","last_peered":"2024-09-15T22:44:58.740535+0000","last_clean":"2024-09-15T22:44:58.740535+0000","last_became_active":"2024-09-15T22:44:57.721663+0000","last_became_peered":"2024-09-15T22:44:57.721663+0000","last_unstale":"2024-09-15T22:44:58.740535+0000","last_undegraded":"2024-09-15T22:44:58.740535+0000","last_fullsized":"2024-09-15T22:44:58.740535+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:16.712865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729985+0000","last_change":"2024-09-15T22:44:58.736701+0000","last_active":"2024-09-15T22:44:59.729985+0000","last_peered":"2024-09-15T22:44:59.729985+0000","last_clean":"2024-09-15T22:44:59.729985+0000","last_became_active":"2024-09-15T22:44:58.736133+0000","last_became_peered":"2024-09-15T22:44:58.736133+0000","last_unstale":"2024-09-15T22:44:59.729985+0000","last_undegraded":"2024-09-15T22:44:59.729985+0000","last_fullsized":"2024-09-15T22:44:59.729985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:54.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729824+0000","last_change":"2024-09-15T22:44:57.720928+0000","last_active":"2024-09-15T22:44:59.729824+0000","last_peered":"2024-09-15T22:44:59.729824+0000","last_clean":"2024-09-15T22:44:59.729824+0000","last_became_active":"2024-09-15T22:44:57.720664+0000","last_became_peered":"2024-09-15T22:44:57.720664+0000","last_unstale":"2024-09-15T22:44:59.729824+0000","last_undegraded":"2024-09-15T22:44:59.729824+0000","last_fullsized":"2024-09-15T22:44:59.729824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.544071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770030+0000","last_change":"2024-09-15T22:44:58.732808+0000","last_active":"2024-09-15T22:44:59.770030+0000","last_peered":"2024-09-15T22:44:59.770030+0000","last_clean":"2024-09-15T22:44:59.770030+0000","last_became_active":"2024-09-15T22:44:58.732434+0000","last_became_peered":"2024-09-15T22:44:58.732434+0000","last_unstale":"2024-09-15T22:44:59.770030+0000","last_undegraded":"2024-09-15T22:44:59.770030+0000","last_fullsized":"2024-09-15T22:44:59.770030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:19.130465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730016+0000","last_change":"2024-09-15T22:44:57.717966+0000","last_active":"2024-09-15T22:44:59.730016+0000","last_peered":"2024-09-15T22:44:59.730016+0000","last_clean":"2024-09-15T22:44:59.730016+0000","last_became_active":"2024-09-15T22:44:57.717688+0000","last_became_peered":"2024-09-15T22:44:57.717688+0000","last_unstale":"2024-09-15T22:44:59.730016+0000","last_undegraded":"2024-09-15T22:44:59.730016+0000","last_fullsized":"2024-09-15T22:44:59.730016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:23.966155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769783+0000","last_change":"2024-09-15T22:44:58.723799+0000","last_active":"2024-09-15T22:44:59.769783+0000","last_peered":"2024-09-15T22:44:59.769783+0000","last_clean":"2024-09-15T22:44:59.769783+0000","last_became_active":"2024-09-15T22:44:58.723514+0000","last_became_peered":"2024-09-15T22:44:58.723514+0000","last_unstale":"2024-09-15T22:44:59.769783+0000","last_undegraded":"2024-09-15T22:44:59.769783+0000","last_fullsized":"2024-09-15T22:44:59.769783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:59.641435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729661+0000","last_change":"2024-09-15T22:44:57.719876+0000","last_active":"2024-09-15T22:44:59.729661+0000","last_peered":"2024-09-15T22:44:59.729661+0000","last_clean":"2024-09-15T22:44:59.729661+0000","last_became_active":"2024-09-15T22:44:57.719622+0000","last_became_peered":"2024-09-15T22:44:57.719622+0000","last_unstale":"2024-09-15T22:44:59.729661+0000","last_undegraded":"2024-09-15T22:44:59.729661+0000","last_fullsized":"2024-09-15T22:44:59.729661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:37.206258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770216+0000","last_change":"2024-09-15T22:44:58.730544+0000","last_active":"2024-09-15T22:44:59.770216+0000","last_peered":"2024-09-15T22:44:59.770216+0000","last_clean":"2024-09-15T22:44:59.770216+0000","last_became_active":"2024-09-15T22:44:58.730305+0000","last_became_peered":"2024-09-15T22:44:58.730305+0000","last_unstale":"2024-09-15T22:44:59.770216+0000","last_undegraded":"2024-09-15T22:44:59.770216+0000","last_fullsized":"2024-09-15T22:44:59.770216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:59.515142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769858+0000","last_change":"2024-09-15T22:44:57.723846+0000","last_active":"2024-09-15T22:44:59.769858+0000","last_peered":"2024-09-15T22:44:59.769858+0000","last_clean":"2024-09-15T22:44:59.769858+0000","last_became_active":"2024-09-15T22:44:57.723582+0000","last_became_peered":"2024-09-15T22:44:57.723582+0000","last_unstale":"2024-09-15T22:44:59.769858+0000","last_undegraded":"2024-09-15T22:44:59.769858+0000","last_fullsized":"2024-09-15T22:44:59.769858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:14.881718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769799+0000","last_change":"2024-09-15T22:44:58.724711+0000","last_active":"2024-09-15T22:44:59.769799+0000","last_peered":"2024-09-15T22:44:59.769799+0000","last_clean":"2024-09-15T22:44:59.769799+0000","last_became_active":"2024-09-15T22:44:58.724449+0000","last_became_peered":"2024-09-15T22:44:58.724449+0000","last_unstale":"2024-09-15T22:44:59.769799+0000","last_undegraded":"2024-09-15T22:44:59.769799+0000","last_fullsized":"2024-09-15T22:44:59.769799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:06.059690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770326+0000","last_change":"2024-09-15T22:44:57.728063+0000","last_active":"2024-09-15T22:44:59.770326+0000","last_peered":"2024-09-15T22:44:59.770326+0000","last_clean":"2024-09-15T22:44:59.770326+0000","last_became_active":"2024-09-15T22:44:57.727789+0000","last_became_peered":"2024-09-15T22:44:57.727789+0000","last_unstale":"2024-09-15T22:44:59.770326+0000","last_undegraded":"2024-09-15T22:44:59.770326+0000","last_fullsized":"2024-09-15T22:44:59.770326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769947+0000","last_change":"2024-09-15T22:44:58.723773+0000","last_active":"2024-09-15T22:44:59.769947+0000","last_peered":"2024-09-15T22:44:59.769947+0000","last_clean":"2024-09-15T22:44:59.769947+0000","last_became_active":"2024-09-15T22:44:58.723495+0000","last_became_peered":"2024-09-15T22:44:58.723495+0000","last_unstale":"2024-09-15T22:44:59.769947+0000","last_undegraded":"2024-09-15T22:44:59.769947+0000","last_fullsized":"2024-09-15T22:44:59.769947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:07.298908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769955+0000","last_change":"2024-09-15T22:44:57.730331+0000","last_active":"2024-09-15T22:44:59.769955+0000","last_peered":"2024-09-15T22:44:59.769955+0000","last_clean":"2024-09-15T22:44:59.769955+0000","last_became_active":"2024-09-15T22:44:57.729981+0000","last_became_peered":"2024-09-15T22:44:57.729981+0000","last_unstale":"2024-09-15T22:44:59.769955+0000","last_undegraded":"2024-09-15T22:44:59.769955+0000","last_fullsized":"2024-09-15T22:44:59.769955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:38.436931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770038+0000","last_change":"2024-09-15T22:44:58.743039+0000","last_active":"2024-09-15T22:44:59.770038+0000","last_peered":"2024-09-15T22:44:59.770038+0000","last_clean":"2024-09-15T22:44:59.770038+0000","last_became_active":"2024-09-15T22:44:58.742796+0000","last_became_peered":"2024-09-15T22:44:58.742796+0000","last_unstale":"2024-09-15T22:44:59.770038+0000","last_undegraded":"2024-09-15T22:44:59.770038+0000","last_fullsized":"2024-09-15T22:44:59.770038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:30.588493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771702+0000","last_change":"2024-09-15T22:44:57.723600+0000","last_active":"2024-09-15T22:44:59.771702+0000","last_peered":"2024-09-15T22:44:59.771702+0000","last_clean":"2024-09-15T22:44:59.771702+0000","last_became_active":"2024-09-15T22:44:57.723325+0000","last_became_peered":"2024-09-15T22:44:57.723325+0000","last_unstale":"2024-09-15T22:44:59.771702+0000","last_undegraded":"2024-09-15T22:44:59.771702+0000","last_fullsized":"2024-09-15T22:44:59.771702+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:43.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.729146+0000","last_change":"2024-09-15T22:44:58.720684+0000","last_active":"2024-09-15T22:44:58.729146+0000","last_peered":"2024-09-15T22:44:58.729146+0000","last_clean":"2024-09-15T22:44:58.729146+0000","last_became_active":"2024-09-15T22:44:58.720425+0000","last_became_peered":"2024-09-15T22:44:58.720425+0000","last_unstale":"2024-09-15T22:44:58.729146+0000","last_undegraded":"2024-09-15T22:44:58.729146+0000","last_fullsized":"2024-09-15T22:44:58.729146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:58.485921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771634+0000","last_change":"2024-09-15T22:44:57.723789+0000","last_active":"2024-09-15T22:44:59.771634+0000","last_peered":"2024-09-15T22:44:59.771634+0000","last_clean":"2024-09-15T22:44:59.771634+0000","last_became_active":"2024-09-15T22:44:57.723517+0000","last_became_peered":"2024-09-15T22:44:57.723517+0000","last_unstale":"2024-09-15T22:44:59.771634+0000","last_undegraded":"2024-09-15T22:44:59.771634+0000","last_fullsized":"2024-09-15T22:44:59.771634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.717764+0000","last_change":"2024-09-15T22:44:58.715964+0000","last_active":"2024-09-15T22:44:58.717764+0000","last_peered":"2024-09-15T22:44:58.717764+0000","last_clean":"2024-09-15T22:44:58.717764+0000","last_became_active":"2024-09-15T22:44:58.715633+0000","last_became_peered":"2024-09-15T22:44:58.715633+0000","last_unstale":"2024-09-15T22:44:58.717764+0000","last_undegraded":"2024-09-15T22:44:58.717764+0000","last_fullsized":"2024-09-15T22:44:58.717764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:19.855489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769618+0000","last_change":"2024-09-15T22:44:57.725682+0000","last_active":"2024-09-15T22:44:59.769618+0000","last_peered":"2024-09-15T22:44:59.769618+0000","last_clean":"2024-09-15T22:44:59.769618+0000","last_became_active":"2024-09-15T22:44:57.725399+0000","last_became_peered":"2024-09-15T22:44:57.725399+0000","last_unstale":"2024-09-15T22:44:59.769618+0000","last_undegraded":"2024-09-15T22:44:59.769618+0000","last_fullsized":"2024-09-15T22:44:59.769618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:17.784611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732943+0000","last_change":"2024-09-15T22:44:58.720587+0000","last_active":"2024-09-15T22:44:59.732943+0000","last_peered":"2024-09-15T22:44:59.732943+0000","last_clean":"2024-09-15T22:44:59.732943+0000","last_became_active":"2024-09-15T22:44:58.720068+0000","last_became_peered":"2024-09-15T22:44:58.720068+0000","last_unstale":"2024-09-15T22:44:59.732943+0000","last_undegraded":"2024-09-15T22:44:59.732943+0000","last_fullsized":"2024-09-15T22:44:59.732943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769625+0000","last_change":"2024-09-15T22:44:57.730552+0000","last_active":"2024-09-15T22:44:59.769625+0000","last_peered":"2024-09-15T22:44:59.769625+0000","last_clean":"2024-09-15T22:44:59.769625+0000","last_became_active":"2024-09-15T22:44:57.730272+0000","last_became_peered":"2024-09-15T22:44:57.730272+0000","last_unstale":"2024-09-15T22:44:59.769625+0000","last_undegraded":"2024-09-15T22:44:59.769625+0000","last_fullsized":"2024-09-15T22:44:59.769625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.146006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770586+0000","last_change":"2024-09-15T22:44:58.724847+0000","last_active":"2024-09-15T22:44:59.770586+0000","last_peered":"2024-09-15T22:44:59.770586+0000","last_clean":"2024-09-15T22:44:59.770586+0000","last_became_active":"2024-09-15T22:44:58.724519+0000","last_became_peered":"2024-09-15T22:44:58.724519+0000","last_unstale":"2024-09-15T22:44:59.770586+0000","last_undegraded":"2024-09-15T22:44:59.770586+0000","last_fullsized":"2024-09-15T22:44:59.770586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.352166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769758+0000","last_change":"2024-09-15T22:44:57.723208+0000","last_active":"2024-09-15T22:44:59.769758+0000","last_peered":"2024-09-15T22:44:59.769758+0000","last_clean":"2024-09-15T22:44:59.769758+0000","last_became_active":"2024-09-15T22:44:57.722938+0000","last_became_peered":"2024-09-15T22:44:57.722938+0000","last_unstale":"2024-09-15T22:44:59.769758+0000","last_undegraded":"2024-09-15T22:44:59.769758+0000","last_fullsized":"2024-09-15T22:44:59.769758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:40.221992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730345+0000","last_change":"2024-09-15T22:44:58.721712+0000","last_active":"2024-09-15T22:44:59.730345+0000","last_peered":"2024-09-15T22:44:59.730345+0000","last_clean":"2024-09-15T22:44:59.730345+0000","last_became_active":"2024-09-15T22:44:58.720800+0000","last_became_peered":"2024-09-15T22:44:58.720800+0000","last_unstale":"2024-09-15T22:44:59.730345+0000","last_undegraded":"2024-09-15T22:44:59.730345+0000","last_fullsized":"2024-09-15T22:44:59.730345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:59.230259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:45:00.715939+0000","last_change":"2024-09-15T22:44:57.728062+0000","last_active":"2024-09-15T22:45:00.715939+0000","last_peered":"2024-09-15T22:45:00.715939+0000","last_clean":"2024-09-15T22:45:00.715939+0000","last_became_active":"2024-09-15T22:44:57.727790+0000","last_became_peered":"2024-09-15T22:44:57.727790+0000","last_unstale":"2024-09-15T22:45:00.715939+0000","last_undegraded":"2024-09-15T22:45:00.715939+0000","last_fullsized":"2024-09-15T22:45:00.715939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:19.134125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769968+0000","last_change":"2024-09-15T22:44:58.733604+0000","last_active":"2024-09-15T22:44:59.769968+0000","last_peered":"2024-09-15T22:44:59.769968+0000","last_clean":"2024-09-15T22:44:59.769968+0000","last_became_active":"2024-09-15T22:44:58.733326+0000","last_became_peered":"2024-09-15T22:44:58.733326+0000","last_unstale":"2024-09-15T22:44:59.769968+0000","last_undegraded":"2024-09-15T22:44:59.769968+0000","last_fullsized":"2024-09-15T22:44:59.769968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.181032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733137+0000","last_change":"2024-09-15T22:44:57.720365+0000","last_active":"2024-09-15T22:44:59.733137+0000","last_peered":"2024-09-15T22:44:59.733137+0000","last_clean":"2024-09-15T22:44:59.733137+0000","last_became_active":"2024-09-15T22:44:57.720093+0000","last_became_peered":"2024-09-15T22:44:57.720093+0000","last_unstale":"2024-09-15T22:44:59.733137+0000","last_undegraded":"2024-09-15T22:44:59.733137+0000","last_fullsized":"2024-09-15T22:44:59.733137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:57.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730117+0000","last_change":"2024-09-15T22:44:58.721676+0000","last_active":"2024-09-15T22:44:59.730117+0000","last_peered":"2024-09-15T22:44:59.730117+0000","last_clean":"2024-09-15T22:44:59.730117+0000","last_became_active":"2024-09-15T22:44:58.721358+0000","last_became_peered":"2024-09-15T22:44:58.721358+0000","last_unstale":"2024-09-15T22:44:59.730117+0000","last_undegraded":"2024-09-15T22:44:59.730117+0000","last_fullsized":"2024-09-15T22:44:59.730117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732859+0000","last_change":"2024-09-15T22:44:57.720955+0000","last_active":"2024-09-15T22:44:59.732859+0000","last_peered":"2024-09-15T22:44:59.732859+0000","last_clean":"2024-09-15T22:44:59.732859+0000","last_became_active":"2024-09-15T22:44:57.720675+0000","last_became_peered":"2024-09-15T22:44:57.720675+0000","last_unstale":"2024-09-15T22:44:59.732859+0000","last_undegraded":"2024-09-15T22:44:59.732859+0000","last_fullsized":"2024-09-15T22:44:59.732859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:50.510802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770221+0000","last_change":"2024-09-15T22:44:58.726079+0000","last_active":"2024-09-15T22:44:59.770221+0000","last_peered":"2024-09-15T22:44:59.770221+0000","last_clean":"2024-09-15T22:44:59.770221+0000","last_became_active":"2024-09-15T22:44:58.725760+0000","last_became_peered":"2024-09-15T22:44:58.725760+0000","last_unstale":"2024-09-15T22:44:59.770221+0000","last_undegraded":"2024-09-15T22:44:59.770221+0000","last_fullsized":"2024-09-15T22:44:59.770221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:47.081842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733008+0000","last_change":"2024-09-15T22:44:57.723760+0000","last_active":"2024-09-15T22:44:59.733008+0000","last_peered":"2024-09-15T22:44:59.733008+0000","last_clean":"2024-09-15T22:44:59.733008+0000","last_became_active":"2024-09-15T22:44:57.723482+0000","last_became_peered":"2024-09-15T22:44:57.723482+0000","last_unstale":"2024-09-15T22:44:59.733008+0000","last_undegraded":"2024-09-15T22:44:59.733008+0000","last_fullsized":"2024-09-15T22:44:59.733008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:17.780234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769444+0000","last_change":"2024-09-15T22:44:58.742866+0000","last_active":"2024-09-15T22:44:59.769444+0000","last_peered":"2024-09-15T22:44:59.769444+0000","last_clean":"2024-09-15T22:44:59.769444+0000","last_became_active":"2024-09-15T22:44:58.742606+0000","last_became_peered":"2024-09-15T22:44:58.742606+0000","last_unstale":"2024-09-15T22:44:59.769444+0000","last_undegraded":"2024-09-15T22:44:59.769444+0000","last_fullsized":"2024-09-15T22:44:59.769444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:52.508884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770316+0000","last_change":"2024-09-15T22:44:57.727532+0000","last_active":"2024-09-15T22:44:59.770316+0000","last_peered":"2024-09-15T22:44:59.770316+0000","last_clean":"2024-09-15T22:44:59.770316+0000","last_became_active":"2024-09-15T22:44:57.727315+0000","last_became_peered":"2024-09-15T22:44:57.727315+0000","last_unstale":"2024-09-15T22:44:59.770316+0000","last_undegraded":"2024-09-15T22:44:59.770316+0000","last_fullsized":"2024-09-15T22:44:59.770316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.895527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.736325+0000","last_change":"2024-09-15T22:44:58.731105+0000","last_active":"2024-09-15T22:44:58.736325+0000","last_peered":"2024-09-15T22:44:58.736325+0000","last_clean":"2024-09-15T22:44:58.736325+0000","last_became_active":"2024-09-15T22:44:58.730812+0000","last_became_peered":"2024-09-15T22:44:58.730812+0000","last_unstale":"2024-09-15T22:44:58.736325+0000","last_undegraded":"2024-09-15T22:44:58.736325+0000","last_fullsized":"2024-09-15T22:44:58.736325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:54.742160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769701+0000","last_change":"2024-09-15T22:44:57.729504+0000","last_active":"2024-09-15T22:44:59.769701+0000","last_peered":"2024-09-15T22:44:59.769701+0000","last_clean":"2024-09-15T22:44:59.769701+0000","last_became_active":"2024-09-15T22:44:57.729061+0000","last_became_peered":"2024-09-15T22:44:57.729061+0000","last_unstale":"2024-09-15T22:44:59.769701+0000","last_undegraded":"2024-09-15T22:44:59.769701+0000","last_fullsized":"2024-09-15T22:44:59.769701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:45.990609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769090+0000","last_change":"2024-09-15T22:44:58.728888+0000","last_active":"2024-09-15T22:44:59.769090+0000","last_peered":"2024-09-15T22:44:59.769090+0000","last_clean":"2024-09-15T22:44:59.769090+0000","last_became_active":"2024-09-15T22:44:58.728622+0000","last_became_peered":"2024-09-15T22:44:58.728622+0000","last_unstale":"2024-09-15T22:44:59.769090+0000","last_undegraded":"2024-09-15T22:44:59.769090+0000","last_fullsized":"2024-09-15T22:44:59.769090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771354+0000","last_change":"2024-09-15T22:44:57.724755+0000","last_active":"2024-09-15T22:44:59.771354+0000","last_peered":"2024-09-15T22:44:59.771354+0000","last_clean":"2024-09-15T22:44:59.771354+0000","last_became_active":"2024-09-15T22:44:57.724467+0000","last_became_peered":"2024-09-15T22:44:57.724467+0000","last_unstale":"2024-09-15T22:44:59.771354+0000","last_undegraded":"2024-09-15T22:44:59.771354+0000","last_fullsized":"2024-09-15T22:44:59.771354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:45.990609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770178+0000","last_change":"2024-09-15T22:44:58.739649+0000","last_active":"2024-09-15T22:44:59.770178+0000","last_peered":"2024-09-15T22:44:59.770178+0000","last_clean":"2024-09-15T22:44:59.770178+0000","last_became_active":"2024-09-15T22:44:58.739383+0000","last_became_peered":"2024-09-15T22:44:58.739383+0000","last_unstale":"2024-09-15T22:44:59.770178+0000","last_undegraded":"2024-09-15T22:44:59.770178+0000","last_fullsized":"2024-09-15T22:44:59.770178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:20.391612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730025+0000","last_change":"2024-09-15T22:44:57.718453+0000","last_active":"2024-09-15T22:44:59.730025+0000","last_peered":"2024-09-15T22:44:59.730025+0000","last_clean":"2024-09-15T22:44:59.730025+0000","last_became_active":"2024-09-15T22:44:57.718156+0000","last_became_peered":"2024-09-15T22:44:57.718156+0000","last_unstale":"2024-09-15T22:44:59.730025+0000","last_undegraded":"2024-09-15T22:44:59.730025+0000","last_fullsized":"2024-09-15T22:44:59.730025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.210258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":261,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729679+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:59.729679+0000","last_peered":"2024-09-15T22:44:59.729679+0000","last_clean":"2024-09-15T22:44:59.729679+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:59.729679+0000","last_undegraded":"2024-09-15T22:44:59.729679+0000","last_fullsized":"2024-09-15T22:44:59.729679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":369551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1478656,"data_stored":958397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":368633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":892928,"data_stored":368065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":368521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":958307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":884736,"data_stored":368009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":856064,"data_stored":354864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:01.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.802+0000 7fbc9b186640 1 Processor -- start 2024-09-15T22:45:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.802+0000 7fbc9b186640 1 -- start start 2024-09-15T22:45:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc9b186640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc940cf070 0x7fbc940cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc9b186640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc940ce740 con 0x7fbc9415c180 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc9b186640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc94072640 con 0x7fbc94073120 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc9b186640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbc94072920 con 0x7fbc940cf070 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc940cf070 0x7fbc940cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc940cf070 0x7fbc940cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37990/0 (socket says 172.21.15.134:37990) 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc98f22640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbc9415c180 0x7fbc940cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48000/0 (socket says 172.21.15.134:48000) 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 -- 172.21.15.134:0/2288198164 learned_addr learned my addr 172.21.15.134:0/2288198164 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 -- 172.21.15.134:0/2288198164 >> v1:172.21.15.177:6789/0 conn(0x7fbc94073120 legacy=0x7fbc9406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 -- 172.21.15.134:0/2288198164 >> v1:172.21.15.134:6789/0 conn(0x7fbc9415c180 legacy=0x7fbc940cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc93fff640 1 -- 172.21.15.134:0/2288198164 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc94072c00 con 0x7fbc940cf070 2024-09-15T22:45:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.803+0000 7fbc937fe640 1 -- 172.21.15.134:0/2288198164 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076195026 0 0) 0x7fbc940ce740 con 0x7fbc9415c180 2024-09-15T22:45:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc93fff640 1 --2- 172.21.15.134:0/2288198164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc940cf070 0x7fbc940cf4e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009870 tx=0x7fbc8002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2b92357c6d664d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc937fe640 1 -- 172.21.15.134:0/2288198164 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80037070 con 0x7fbc940cf070 2024-09-15T22:45:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc937fe640 1 -- 172.21.15.134:0/2288198164 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80032440 con 0x7fbc940cf070 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc937fe640 1 -- 172.21.15.134:0/2288198164 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80032810 con 0x7fbc940cf070 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc9b186640 1 -- 172.21.15.134:0/2288198164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc940cf070 msgr2=0x7fbc940cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.804+0000 7fbc9b186640 1 --2- 172.21.15.134:0/2288198164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc940cf070 0x7fbc940cf4e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009870 tx=0x7fbc8002a210 comp rx=0 tx=0).stop 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.805+0000 7fbc9b186640 1 -- 172.21.15.134:0/2288198164 shutdown_connections 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.805+0000 7fbc9b186640 1 --2- 172.21.15.134:0/2288198164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc940cf070 0x7fbc940cf4e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.805+0000 7fbc9b186640 1 -- 172.21.15.134:0/2288198164 >> 172.21.15.134:0/2288198164 conn(0x7fbc94062cc0 msgr2=0x7fbc9406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.805+0000 7fbc9b186640 1 -- 172.21.15.134:0/2288198164 shutdown_connections 2024-09-15T22:45:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.805+0000 7fbc9b186640 1 -- 172.21.15.134:0/2288198164 wait complete. 2024-09-15T22:45:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.806+0000 7fbc9b186640 1 Processor -- start 2024-09-15T22:45:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.806+0000 7fbc9b186640 1 -- start start 2024-09-15T22:45:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 0x7fbc9415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc940cf070 0x7fbc940b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940722f0 con 0x7fbc9415c180 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940ced00 con 0x7fbc940cf070 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9415c560 con 0x7fbc94073120 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38004/0 (socket says 172.21.15.134:38004) 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 -- 172.21.15.134:0/1334067629 learned_addr learned my addr 172.21.15.134:0/1334067629 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc98f22640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 0x7fbc9415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc93fff640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc940cf070 0x7fbc940b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 -- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 msgr2=0x7fbc9415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 0x7fbc9415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 -- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc940cf070 msgr2=0x7fbc940b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc940cf070 0x7fbc940b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 -- 172.21.15.134:0/1334067629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9415f520 con 0x7fbc9415c180 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc98f22640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 0x7fbc9415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc99723640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c7b0 tx=0x7fbc8c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c017070 con 0x7fbc9415c180 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8c003da0 con 0x7fbc9415c180 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9415f800 con 0x7fbc9415c180 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0052b0 con 0x7fbc9415c180 2024-09-15T22:45:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.807+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9415fae0 con 0x7fbc9415c180 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.808+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc940d0660 con 0x7fbc9415c180 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.809+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fbc8c01a070 con 0x7fbc9415c180 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.810+0000 7fbc917fa640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 0x7fbc7806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.810+0000 7fbc98f22640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 0x7fbc7806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.810+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fbc8c08aee0 con 0x7fbc9415c180 2024-09-15T22:45:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.810+0000 7fbc98f22640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 0x7fbc7806eb00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.814+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc8c0592d0 con 0x7fbc9415c180 2024-09-15T22:45:01.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.976+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc941586c0 con 0x7fbc7806c640 2024-09-15T22:45:01.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.982+0000 7fbc917fa640 1 -- 172.21.15.134:0/1334067629 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252066 (secure 0 0 0) 0x7fbc941586c0 con 0x7fbc7806c640 2024-09-15T22:45:01.986 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:01.988 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 msgr2=0x7fbc7806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 0x7fbc7806eb00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88009040 comp rx=0 tx=0).stop 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 msgr2=0x7fbc941f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c7b0 tx=0x7fbc8c00cc70 comp rx=0 tx=0).stop 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 shutdown_connections 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fbc7806c640 0x7fbc7806eb00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9415c180 0x7fbc941f5270 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc940cf070 0x7fbc940b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 --2- 172.21.15.134:0/1334067629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc94073120 0x7fbc9415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.985+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 >> 172.21.15.134:0/1334067629 conn(0x7fbc94062cc0 msgr2=0x7fbc94158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.986+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 shutdown_connections 2024-09-15T22:45:01.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:01.986+0000 7fbc9b186640 1 -- 172.21.15.134:0/1334067629 wait complete. 2024-09-15T22:45:01.998 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-15T22:45:00.994857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236796,"kb_used_data":8064,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737924,"statfs":{"total":773094113280,"available":772851634176,"internally_reserved":0,"allocated":8257536,"data_stored":4114347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.292730"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769676+0000","last_change":"2024-09-15T22:44:58.739420+0000","last_active":"2024-09-15T22:44:59.769676+0000","last_peered":"2024-09-15T22:44:59.769676+0000","last_clean":"2024-09-15T22:44:59.769676+0000","last_became_active":"2024-09-15T22:44:58.738545+0000","last_became_peered":"2024-09-15T22:44:58.738545+0000","last_unstale":"2024-09-15T22:44:59.769676+0000","last_undegraded":"2024-09-15T22:44:59.769676+0000","last_fullsized":"2024-09-15T22:44:59.769676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:59.309169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770226+0000","last_change":"2024-09-15T22:44:58.733306+0000","last_active":"2024-09-15T22:44:59.770226+0000","last_peered":"2024-09-15T22:44:59.770226+0000","last_clean":"2024-09-15T22:44:59.770226+0000","last_became_active":"2024-09-15T22:44:58.729647+0000","last_became_peered":"2024-09-15T22:44:58.729647+0000","last_unstale":"2024-09-15T22:44:59.770226+0000","last_undegraded":"2024-09-15T22:44:59.770226+0000","last_fullsized":"2024-09-15T22:44:59.770226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:01.810455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769922+0000","last_change":"2024-09-15T22:44:58.722251+0000","last_active":"2024-09-15T22:44:59.769922+0000","last_peered":"2024-09-15T22:44:59.769922+0000","last_clean":"2024-09-15T22:44:59.769922+0000","last_became_active":"2024-09-15T22:44:58.721904+0000","last_became_peered":"2024-09-15T22:44:58.721904+0000","last_unstale":"2024-09-15T22:44:59.769922+0000","last_undegraded":"2024-09-15T22:44:59.769922+0000","last_fullsized":"2024-09-15T22:44:59.769922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:51.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769768+0000","last_change":"2024-09-15T22:44:58.721569+0000","last_active":"2024-09-15T22:44:59.769768+0000","last_peered":"2024-09-15T22:44:59.769768+0000","last_clean":"2024-09-15T22:44:59.769768+0000","last_became_active":"2024-09-15T22:44:58.721272+0000","last_became_peered":"2024-09-15T22:44:58.721272+0000","last_unstale":"2024-09-15T22:44:59.769768+0000","last_undegraded":"2024-09-15T22:44:59.769768+0000","last_fullsized":"2024-09-15T22:44:59.769768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:55.201733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770154+0000","last_change":"2024-09-15T22:44:58.730819+0000","last_active":"2024-09-15T22:44:59.770154+0000","last_peered":"2024-09-15T22:44:59.770154+0000","last_clean":"2024-09-15T22:44:59.770154+0000","last_became_active":"2024-09-15T22:44:58.730546+0000","last_became_peered":"2024-09-15T22:44:58.730546+0000","last_unstale":"2024-09-15T22:44:59.770154+0000","last_undegraded":"2024-09-15T22:44:59.770154+0000","last_fullsized":"2024-09-15T22:44:59.770154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:44.439755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771420+0000","last_change":"2024-09-15T22:44:58.739267+0000","last_active":"2024-09-15T22:44:59.771420+0000","last_peered":"2024-09-15T22:44:59.771420+0000","last_clean":"2024-09-15T22:44:59.771420+0000","last_became_active":"2024-09-15T22:44:58.738508+0000","last_became_peered":"2024-09-15T22:44:58.738508+0000","last_unstale":"2024-09-15T22:44:59.771420+0000","last_undegraded":"2024-09-15T22:44:59.771420+0000","last_fullsized":"2024-09-15T22:44:59.771420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:44.565468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729869+0000","last_change":"2024-09-15T22:44:58.722638+0000","last_active":"2024-09-15T22:44:59.729869+0000","last_peered":"2024-09-15T22:44:59.729869+0000","last_clean":"2024-09-15T22:44:59.729869+0000","last_became_active":"2024-09-15T22:44:58.722375+0000","last_became_peered":"2024-09-15T22:44:58.722375+0000","last_unstale":"2024-09-15T22:44:59.729869+0000","last_undegraded":"2024-09-15T22:44:59.729869+0000","last_fullsized":"2024-09-15T22:44:59.729869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:04.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769069+0000","last_change":"2024-09-15T22:44:58.740562+0000","last_active":"2024-09-15T22:44:59.769069+0000","last_peered":"2024-09-15T22:44:59.769069+0000","last_clean":"2024-09-15T22:44:59.769069+0000","last_became_active":"2024-09-15T22:44:58.739659+0000","last_became_peered":"2024-09-15T22:44:58.739659+0000","last_unstale":"2024-09-15T22:44:59.769069+0000","last_undegraded":"2024-09-15T22:44:59.769069+0000","last_fullsized":"2024-09-15T22:44:59.769069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:19.152415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770253+0000","last_change":"2024-09-15T22:44:58.724815+0000","last_active":"2024-09-15T22:44:59.770253+0000","last_peered":"2024-09-15T22:44:59.770253+0000","last_clean":"2024-09-15T22:44:59.770253+0000","last_became_active":"2024-09-15T22:44:58.724541+0000","last_became_peered":"2024-09-15T22:44:58.724541+0000","last_unstale":"2024-09-15T22:44:59.770253+0000","last_undegraded":"2024-09-15T22:44:59.770253+0000","last_fullsized":"2024-09-15T22:44:59.770253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:04.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730416+0000","last_change":"2024-09-15T22:44:58.730560+0000","last_active":"2024-09-15T22:44:59.730416+0000","last_peered":"2024-09-15T22:44:59.730416+0000","last_clean":"2024-09-15T22:44:59.730416+0000","last_became_active":"2024-09-15T22:44:58.730278+0000","last_became_peered":"2024-09-15T22:44:58.730278+0000","last_unstale":"2024-09-15T22:44:59.730416+0000","last_undegraded":"2024-09-15T22:44:59.730416+0000","last_fullsized":"2024-09-15T22:44:59.730416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:43.690218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769710+0000","last_change":"2024-09-15T22:44:58.740606+0000","last_active":"2024-09-15T22:44:59.769710+0000","last_peered":"2024-09-15T22:44:59.769710+0000","last_clean":"2024-09-15T22:44:59.769710+0000","last_became_active":"2024-09-15T22:44:58.740227+0000","last_became_peered":"2024-09-15T22:44:58.740227+0000","last_unstale":"2024-09-15T22:44:59.769710+0000","last_undegraded":"2024-09-15T22:44:59.769710+0000","last_fullsized":"2024-09-15T22:44:59.769710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:30.771229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732995+0000","last_change":"2024-09-15T22:44:58.716386+0000","last_active":"2024-09-15T22:44:59.732995+0000","last_peered":"2024-09-15T22:44:59.732995+0000","last_clean":"2024-09-15T22:44:59.732995+0000","last_became_active":"2024-09-15T22:44:58.716083+0000","last_became_peered":"2024-09-15T22:44:58.716083+0000","last_unstale":"2024-09-15T22:44:59.732995+0000","last_undegraded":"2024-09-15T22:44:59.732995+0000","last_fullsized":"2024-09-15T22:44:59.732995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:13.972403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769717+0000","last_change":"2024-09-15T22:44:58.729985+0000","last_active":"2024-09-15T22:44:59.769717+0000","last_peered":"2024-09-15T22:44:59.769717+0000","last_clean":"2024-09-15T22:44:59.769717+0000","last_became_active":"2024-09-15T22:44:58.729679+0000","last_became_peered":"2024-09-15T22:44:58.729679+0000","last_unstale":"2024-09-15T22:44:59.769717+0000","last_undegraded":"2024-09-15T22:44:59.769717+0000","last_fullsized":"2024-09-15T22:44:59.769717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:46.051951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733040+0000","last_change":"2024-09-15T22:44:58.726724+0000","last_active":"2024-09-15T22:44:59.733040+0000","last_peered":"2024-09-15T22:44:59.733040+0000","last_clean":"2024-09-15T22:44:59.733040+0000","last_became_active":"2024-09-15T22:44:58.726460+0000","last_became_peered":"2024-09-15T22:44:58.726460+0000","last_unstale":"2024-09-15T22:44:59.733040+0000","last_undegraded":"2024-09-15T22:44:59.733040+0000","last_fullsized":"2024-09-15T22:44:59.733040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:26.415268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732294+0000","last_change":"2024-09-15T22:44:58.720816+0000","last_active":"2024-09-15T22:44:59.732294+0000","last_peered":"2024-09-15T22:44:59.732294+0000","last_clean":"2024-09-15T22:44:59.732294+0000","last_became_active":"2024-09-15T22:44:58.720402+0000","last_became_peered":"2024-09-15T22:44:58.720402+0000","last_unstale":"2024-09-15T22:44:59.732294+0000","last_undegraded":"2024-09-15T22:44:59.732294+0000","last_fullsized":"2024-09-15T22:44:59.732294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:12.033067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769198+0000","last_change":"2024-09-15T22:44:58.741154+0000","last_active":"2024-09-15T22:44:59.769198+0000","last_peered":"2024-09-15T22:44:59.769198+0000","last_clean":"2024-09-15T22:44:59.769198+0000","last_became_active":"2024-09-15T22:44:58.740866+0000","last_became_peered":"2024-09-15T22:44:58.740866+0000","last_unstale":"2024-09-15T22:44:59.769198+0000","last_undegraded":"2024-09-15T22:44:59.769198+0000","last_fullsized":"2024-09-15T22:44:59.769198+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.352166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769948+0000","last_change":"2024-09-15T22:44:58.726742+0000","last_active":"2024-09-15T22:44:59.769948+0000","last_peered":"2024-09-15T22:44:59.769948+0000","last_clean":"2024-09-15T22:44:59.769948+0000","last_became_active":"2024-09-15T22:44:58.726443+0000","last_became_peered":"2024-09-15T22:44:58.726443+0000","last_unstale":"2024-09-15T22:44:59.769948+0000","last_undegraded":"2024-09-15T22:44:59.769948+0000","last_fullsized":"2024-09-15T22:44:59.769948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:20.078527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770475+0000","last_change":"2024-09-15T22:44:58.736315+0000","last_active":"2024-09-15T22:44:59.770475+0000","last_peered":"2024-09-15T22:44:59.770475+0000","last_clean":"2024-09-15T22:44:59.770475+0000","last_became_active":"2024-09-15T22:44:58.735889+0000","last_became_peered":"2024-09-15T22:44:58.735889+0000","last_unstale":"2024-09-15T22:44:59.770475+0000","last_undegraded":"2024-09-15T22:44:59.770475+0000","last_fullsized":"2024-09-15T22:44:59.770475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:19.152415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769564+0000","last_change":"2024-09-15T22:44:58.740671+0000","last_active":"2024-09-15T22:44:59.769564+0000","last_peered":"2024-09-15T22:44:59.769564+0000","last_clean":"2024-09-15T22:44:59.769564+0000","last_became_active":"2024-09-15T22:44:58.740214+0000","last_became_peered":"2024-09-15T22:44:58.740214+0000","last_unstale":"2024-09-15T22:44:59.769564+0000","last_undegraded":"2024-09-15T22:44:59.769564+0000","last_fullsized":"2024-09-15T22:44:59.769564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:27.617801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770388+0000","last_change":"2024-09-15T22:44:58.732773+0000","last_active":"2024-09-15T22:44:59.770388+0000","last_peered":"2024-09-15T22:44:59.770388+0000","last_clean":"2024-09-15T22:44:59.770388+0000","last_became_active":"2024-09-15T22:44:58.732472+0000","last_became_peered":"2024-09-15T22:44:58.732472+0000","last_unstale":"2024-09-15T22:44:59.770388+0000","last_undegraded":"2024-09-15T22:44:59.770388+0000","last_fullsized":"2024-09-15T22:44:59.770388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:19.652996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769900+0000","last_change":"2024-09-15T22:44:58.729587+0000","last_active":"2024-09-15T22:44:59.769900+0000","last_peered":"2024-09-15T22:44:59.769900+0000","last_clean":"2024-09-15T22:44:59.769900+0000","last_became_active":"2024-09-15T22:44:58.728769+0000","last_became_peered":"2024-09-15T22:44:58.728769+0000","last_unstale":"2024-09-15T22:44:59.769900+0000","last_undegraded":"2024-09-15T22:44:59.769900+0000","last_fullsized":"2024-09-15T22:44:59.769900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:32.845338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771470+0000","last_change":"2024-09-15T22:44:58.732559+0000","last_active":"2024-09-15T22:44:59.771470+0000","last_peered":"2024-09-15T22:44:59.771470+0000","last_clean":"2024-09-15T22:44:59.771470+0000","last_became_active":"2024-09-15T22:44:58.732277+0000","last_became_peered":"2024-09-15T22:44:58.732277+0000","last_unstale":"2024-09-15T22:44:59.771470+0000","last_undegraded":"2024-09-15T22:44:59.771470+0000","last_fullsized":"2024-09-15T22:44:59.771470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:12.033067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730102+0000","last_change":"2024-09-15T22:44:58.734037+0000","last_active":"2024-09-15T22:44:59.730102+0000","last_peered":"2024-09-15T22:44:59.730102+0000","last_clean":"2024-09-15T22:44:59.730102+0000","last_became_active":"2024-09-15T22:44:58.732887+0000","last_became_peered":"2024-09-15T22:44:58.732887+0000","last_unstale":"2024-09-15T22:44:59.730102+0000","last_undegraded":"2024-09-15T22:44:59.730102+0000","last_fullsized":"2024-09-15T22:44:59.730102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:26.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769343+0000","last_change":"2024-09-15T22:44:58.740113+0000","last_active":"2024-09-15T22:44:59.769343+0000","last_peered":"2024-09-15T22:44:59.769343+0000","last_clean":"2024-09-15T22:44:59.769343+0000","last_became_active":"2024-09-15T22:44:58.739309+0000","last_became_peered":"2024-09-15T22:44:58.739309+0000","last_unstale":"2024-09-15T22:44:59.769343+0000","last_undegraded":"2024-09-15T22:44:59.769343+0000","last_fullsized":"2024-09-15T22:44:59.769343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:27.510026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730166+0000","last_change":"2024-09-15T22:44:58.733381+0000","last_active":"2024-09-15T22:44:59.730166+0000","last_peered":"2024-09-15T22:44:59.730166+0000","last_clean":"2024-09-15T22:44:59.730166+0000","last_became_active":"2024-09-15T22:44:58.733083+0000","last_became_peered":"2024-09-15T22:44:58.733083+0000","last_unstale":"2024-09-15T22:44:59.730166+0000","last_undegraded":"2024-09-15T22:44:59.730166+0000","last_fullsized":"2024-09-15T22:44:59.730166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:32.338278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769541+0000","last_change":"2024-09-15T22:44:58.736161+0000","last_active":"2024-09-15T22:44:59.769541+0000","last_peered":"2024-09-15T22:44:59.769541+0000","last_clean":"2024-09-15T22:44:59.769541+0000","last_became_active":"2024-09-15T22:44:58.735863+0000","last_became_peered":"2024-09-15T22:44:58.735863+0000","last_unstale":"2024-09-15T22:44:59.769541+0000","last_undegraded":"2024-09-15T22:44:59.769541+0000","last_fullsized":"2024-09-15T22:44:59.769541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:54.321947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770122+0000","last_change":"2024-09-15T22:44:58.729883+0000","last_active":"2024-09-15T22:44:59.770122+0000","last_peered":"2024-09-15T22:44:59.770122+0000","last_clean":"2024-09-15T22:44:59.770122+0000","last_became_active":"2024-09-15T22:44:58.729445+0000","last_became_peered":"2024-09-15T22:44:58.729445+0000","last_unstale":"2024-09-15T22:44:59.770122+0000","last_undegraded":"2024-09-15T22:44:59.770122+0000","last_fullsized":"2024-09-15T22:44:59.770122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:32.750874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769802+0000","last_change":"2024-09-15T22:44:58.737594+0000","last_active":"2024-09-15T22:44:59.769802+0000","last_peered":"2024-09-15T22:44:59.769802+0000","last_clean":"2024-09-15T22:44:59.769802+0000","last_became_active":"2024-09-15T22:44:58.737342+0000","last_became_peered":"2024-09-15T22:44:58.737342+0000","last_unstale":"2024-09-15T22:44:59.769802+0000","last_undegraded":"2024-09-15T22:44:59.769802+0000","last_fullsized":"2024-09-15T22:44:59.769802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:46.858817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769699+0000","last_change":"2024-09-15T22:44:58.735177+0000","last_active":"2024-09-15T22:44:59.769699+0000","last_peered":"2024-09-15T22:44:59.769699+0000","last_clean":"2024-09-15T22:44:59.769699+0000","last_became_active":"2024-09-15T22:44:58.734962+0000","last_became_peered":"2024-09-15T22:44:58.734962+0000","last_unstale":"2024-09-15T22:44:59.769699+0000","last_undegraded":"2024-09-15T22:44:59.769699+0000","last_fullsized":"2024-09-15T22:44:59.769699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.360720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769290+0000","last_change":"2024-09-15T22:44:58.738195+0000","last_active":"2024-09-15T22:44:59.769290+0000","last_peered":"2024-09-15T22:44:59.769290+0000","last_clean":"2024-09-15T22:44:59.769290+0000","last_became_active":"2024-09-15T22:44:58.737815+0000","last_became_peered":"2024-09-15T22:44:58.737815+0000","last_unstale":"2024-09-15T22:44:59.769290+0000","last_undegraded":"2024-09-15T22:44:59.769290+0000","last_fullsized":"2024-09-15T22:44:59.769290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:48.366185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769532+0000","last_change":"2024-09-15T22:44:58.731268+0000","last_active":"2024-09-15T22:44:59.769532+0000","last_peered":"2024-09-15T22:44:59.769532+0000","last_clean":"2024-09-15T22:44:59.769532+0000","last_became_active":"2024-09-15T22:44:58.730999+0000","last_became_peered":"2024-09-15T22:44:58.730999+0000","last_unstale":"2024-09-15T22:44:59.769532+0000","last_undegraded":"2024-09-15T22:44:59.769532+0000","last_fullsized":"2024-09-15T22:44:59.769532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:13.972403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769079+0000","last_change":"2024-09-15T22:44:58.734469+0000","last_active":"2024-09-15T22:44:59.769079+0000","last_peered":"2024-09-15T22:44:59.769079+0000","last_clean":"2024-09-15T22:44:59.769079+0000","last_became_active":"2024-09-15T22:44:58.734218+0000","last_became_peered":"2024-09-15T22:44:58.734218+0000","last_unstale":"2024-09-15T22:44:59.769079+0000","last_undegraded":"2024-09-15T22:44:59.769079+0000","last_fullsized":"2024-09-15T22:44:59.769079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769524+0000","last_change":"2024-09-15T22:44:58.734867+0000","last_active":"2024-09-15T22:44:59.769524+0000","last_peered":"2024-09-15T22:44:59.769524+0000","last_clean":"2024-09-15T22:44:59.769524+0000","last_became_active":"2024-09-15T22:44:58.734547+0000","last_became_peered":"2024-09-15T22:44:58.734547+0000","last_unstale":"2024-09-15T22:44:59.769524+0000","last_undegraded":"2024-09-15T22:44:59.769524+0000","last_fullsized":"2024-09-15T22:44:59.769524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:32.988979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771666+0000","last_change":"2024-09-15T22:44:57.724554+0000","last_active":"2024-09-15T22:44:59.771666+0000","last_peered":"2024-09-15T22:44:59.771666+0000","last_clean":"2024-09-15T22:44:59.771666+0000","last_became_active":"2024-09-15T22:44:57.724272+0000","last_became_peered":"2024-09-15T22:44:57.724272+0000","last_unstale":"2024-09-15T22:44:59.771666+0000","last_undegraded":"2024-09-15T22:44:59.771666+0000","last_fullsized":"2024-09-15T22:44:59.771666+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770254+0000","last_change":"2024-09-15T22:44:58.722762+0000","last_active":"2024-09-15T22:44:59.770254+0000","last_peered":"2024-09-15T22:44:59.770254+0000","last_clean":"2024-09-15T22:44:59.770254+0000","last_became_active":"2024-09-15T22:44:58.722510+0000","last_became_peered":"2024-09-15T22:44:58.722510+0000","last_unstale":"2024-09-15T22:44:59.770254+0000","last_undegraded":"2024-09-15T22:44:59.770254+0000","last_fullsized":"2024-09-15T22:44:59.770254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:54.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770541+0000","last_change":"2024-09-15T22:44:57.721186+0000","last_active":"2024-09-15T22:44:59.770541+0000","last_peered":"2024-09-15T22:44:59.770541+0000","last_clean":"2024-09-15T22:44:59.770541+0000","last_became_active":"2024-09-15T22:44:57.720777+0000","last_became_peered":"2024-09-15T22:44:57.720777+0000","last_unstale":"2024-09-15T22:44:59.770541+0000","last_undegraded":"2024-09-15T22:44:59.770541+0000","last_fullsized":"2024-09-15T22:44:59.770541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:02.333280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771629+0000","last_change":"2024-09-15T22:44:58.741275+0000","last_active":"2024-09-15T22:44:59.771629+0000","last_peered":"2024-09-15T22:44:59.771629+0000","last_clean":"2024-09-15T22:44:59.771629+0000","last_became_active":"2024-09-15T22:44:58.740990+0000","last_became_peered":"2024-09-15T22:44:58.740990+0000","last_unstale":"2024-09-15T22:44:59.771629+0000","last_undegraded":"2024-09-15T22:44:59.771629+0000","last_fullsized":"2024-09-15T22:44:59.771629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769759+0000","last_change":"2024-09-15T22:44:57.723997+0000","last_active":"2024-09-15T22:44:59.769759+0000","last_peered":"2024-09-15T22:44:59.769759+0000","last_clean":"2024-09-15T22:44:59.769759+0000","last_became_active":"2024-09-15T22:44:57.723720+0000","last_became_peered":"2024-09-15T22:44:57.723720+0000","last_unstale":"2024-09-15T22:44:59.769759+0000","last_undegraded":"2024-09-15T22:44:59.769759+0000","last_fullsized":"2024-09-15T22:44:59.769759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:04.175583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730065+0000","last_change":"2024-09-15T22:44:58.716161+0000","last_active":"2024-09-15T22:44:59.730065+0000","last_peered":"2024-09-15T22:44:59.730065+0000","last_clean":"2024-09-15T22:44:59.730065+0000","last_became_active":"2024-09-15T22:44:58.715887+0000","last_became_peered":"2024-09-15T22:44:58.715887+0000","last_unstale":"2024-09-15T22:44:59.730065+0000","last_undegraded":"2024-09-15T22:44:59.730065+0000","last_fullsized":"2024-09-15T22:44:59.730065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:10.358424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771623+0000","last_change":"2024-09-15T22:44:57.722175+0000","last_active":"2024-09-15T22:44:59.771623+0000","last_peered":"2024-09-15T22:44:59.771623+0000","last_clean":"2024-09-15T22:44:59.771623+0000","last_became_active":"2024-09-15T22:44:57.721868+0000","last_became_peered":"2024-09-15T22:44:57.721868+0000","last_unstale":"2024-09-15T22:44:59.771623+0000","last_undegraded":"2024-09-15T22:44:59.771623+0000","last_fullsized":"2024-09-15T22:44:59.771623+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:50.510802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769963+0000","last_change":"2024-09-15T22:44:58.734933+0000","last_active":"2024-09-15T22:44:59.769963+0000","last_peered":"2024-09-15T22:44:59.769963+0000","last_clean":"2024-09-15T22:44:59.769963+0000","last_became_active":"2024-09-15T22:44:58.734580+0000","last_became_peered":"2024-09-15T22:44:58.734580+0000","last_unstale":"2024-09-15T22:44:59.769963+0000","last_undegraded":"2024-09-15T22:44:59.769963+0000","last_fullsized":"2024-09-15T22:44:59.769963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:33.254357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732881+0000","last_change":"2024-09-15T22:44:57.723505+0000","last_active":"2024-09-15T22:44:59.732881+0000","last_peered":"2024-09-15T22:44:59.732881+0000","last_clean":"2024-09-15T22:44:59.732881+0000","last_became_active":"2024-09-15T22:44:57.723228+0000","last_became_peered":"2024-09-15T22:44:57.723228+0000","last_unstale":"2024-09-15T22:44:59.732881+0000","last_undegraded":"2024-09-15T22:44:59.732881+0000","last_fullsized":"2024-09-15T22:44:59.732881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:43.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771458+0000","last_change":"2024-09-15T22:44:58.739311+0000","last_active":"2024-09-15T22:44:59.771458+0000","last_peered":"2024-09-15T22:44:59.771458+0000","last_clean":"2024-09-15T22:44:59.771458+0000","last_became_active":"2024-09-15T22:44:58.739043+0000","last_became_peered":"2024-09-15T22:44:58.739043+0000","last_unstale":"2024-09-15T22:44:59.771458+0000","last_undegraded":"2024-09-15T22:44:59.771458+0000","last_fullsized":"2024-09-15T22:44:59.771458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:58.963227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729730+0000","last_change":"2024-09-15T22:44:57.723384+0000","last_active":"2024-09-15T22:44:59.729730+0000","last_peered":"2024-09-15T22:44:59.729730+0000","last_clean":"2024-09-15T22:44:59.729730+0000","last_became_active":"2024-09-15T22:44:57.723114+0000","last_became_peered":"2024-09-15T22:44:57.723114+0000","last_unstale":"2024-09-15T22:44:59.729730+0000","last_undegraded":"2024-09-15T22:44:59.729730+0000","last_fullsized":"2024-09-15T22:44:59.729730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:48.285580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.728231+0000","last_change":"2024-09-15T22:44:58.721327+0000","last_active":"2024-09-15T22:44:58.728231+0000","last_peered":"2024-09-15T22:44:58.728231+0000","last_clean":"2024-09-15T22:44:58.728231+0000","last_became_active":"2024-09-15T22:44:58.721062+0000","last_became_peered":"2024-09-15T22:44:58.721062+0000","last_unstale":"2024-09-15T22:44:58.728231+0000","last_undegraded":"2024-09-15T22:44:58.728231+0000","last_fullsized":"2024-09-15T22:44:58.728231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:00.411067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.711784+0000","last_change":"2024-09-15T22:44:57.723548+0000","last_active":"2024-09-15T22:44:58.711784+0000","last_peered":"2024-09-15T22:44:58.711784+0000","last_clean":"2024-09-15T22:44:58.711784+0000","last_became_active":"2024-09-15T22:44:57.723285+0000","last_became_peered":"2024-09-15T22:44:57.723285+0000","last_unstale":"2024-09-15T22:44:58.711784+0000","last_undegraded":"2024-09-15T22:44:58.711784+0000","last_fullsized":"2024-09-15T22:44:58.711784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:16.619173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732495+0000","last_change":"2024-09-15T22:44:58.726064+0000","last_active":"2024-09-15T22:44:59.732495+0000","last_peered":"2024-09-15T22:44:59.732495+0000","last_clean":"2024-09-15T22:44:59.732495+0000","last_became_active":"2024-09-15T22:44:58.725779+0000","last_became_peered":"2024-09-15T22:44:58.725779+0000","last_unstale":"2024-09-15T22:44:59.732495+0000","last_undegraded":"2024-09-15T22:44:59.732495+0000","last_fullsized":"2024-09-15T22:44:59.732495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732257+0000","last_change":"2024-09-15T22:44:57.716302+0000","last_active":"2024-09-15T22:44:59.732257+0000","last_peered":"2024-09-15T22:44:59.732257+0000","last_clean":"2024-09-15T22:44:59.732257+0000","last_became_active":"2024-09-15T22:44:57.715969+0000","last_became_peered":"2024-09-15T22:44:57.715969+0000","last_unstale":"2024-09-15T22:44:59.732257+0000","last_undegraded":"2024-09-15T22:44:59.732257+0000","last_fullsized":"2024-09-15T22:44:59.732257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730411+0000","last_change":"2024-09-15T22:44:58.734521+0000","last_active":"2024-09-15T22:44:59.730411+0000","last_peered":"2024-09-15T22:44:59.730411+0000","last_clean":"2024-09-15T22:44:59.730411+0000","last_became_active":"2024-09-15T22:44:58.734273+0000","last_became_peered":"2024-09-15T22:44:58.734273+0000","last_unstale":"2024-09-15T22:44:59.730411+0000","last_undegraded":"2024-09-15T22:44:59.730411+0000","last_fullsized":"2024-09-15T22:44:59.730411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:14.580693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769542+0000","last_change":"2024-09-15T22:44:57.726916+0000","last_active":"2024-09-15T22:44:59.769542+0000","last_peered":"2024-09-15T22:44:59.769542+0000","last_clean":"2024-09-15T22:44:59.769542+0000","last_became_active":"2024-09-15T22:44:57.726664+0000","last_became_peered":"2024-09-15T22:44:57.726664+0000","last_unstale":"2024-09-15T22:44:59.769542+0000","last_undegraded":"2024-09-15T22:44:59.769542+0000","last_fullsized":"2024-09-15T22:44:59.769542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:21.635734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769685+0000","last_change":"2024-09-15T22:44:58.736955+0000","last_active":"2024-09-15T22:44:59.769685+0000","last_peered":"2024-09-15T22:44:59.769685+0000","last_clean":"2024-09-15T22:44:59.769685+0000","last_became_active":"2024-09-15T22:44:58.736680+0000","last_became_peered":"2024-09-15T22:44:58.736680+0000","last_unstale":"2024-09-15T22:44:59.769685+0000","last_undegraded":"2024-09-15T22:44:59.769685+0000","last_fullsized":"2024-09-15T22:44:59.769685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:26.415268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770303+0000","last_change":"2024-09-15T22:44:57.730260+0000","last_active":"2024-09-15T22:44:59.770303+0000","last_peered":"2024-09-15T22:44:59.770303+0000","last_clean":"2024-09-15T22:44:59.770303+0000","last_became_active":"2024-09-15T22:44:57.729978+0000","last_became_peered":"2024-09-15T22:44:57.729978+0000","last_unstale":"2024-09-15T22:44:59.770303+0000","last_undegraded":"2024-09-15T22:44:59.770303+0000","last_fullsized":"2024-09-15T22:44:59.770303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769447+0000","last_change":"2024-09-15T22:44:58.739015+0000","last_active":"2024-09-15T22:44:59.769447+0000","last_peered":"2024-09-15T22:44:59.769447+0000","last_clean":"2024-09-15T22:44:59.769447+0000","last_became_active":"2024-09-15T22:44:58.738704+0000","last_became_peered":"2024-09-15T22:44:58.738704+0000","last_unstale":"2024-09-15T22:44:59.769447+0000","last_undegraded":"2024-09-15T22:44:59.769447+0000","last_fullsized":"2024-09-15T22:44:59.769447+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:23.509445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733198+0000","last_change":"2024-09-15T22:44:57.719464+0000","last_active":"2024-09-15T22:44:59.733198+0000","last_peered":"2024-09-15T22:44:59.733198+0000","last_clean":"2024-09-15T22:44:59.733198+0000","last_became_active":"2024-09-15T22:44:57.719115+0000","last_became_peered":"2024-09-15T22:44:57.719115+0000","last_unstale":"2024-09-15T22:44:59.733198+0000","last_undegraded":"2024-09-15T22:44:59.733198+0000","last_fullsized":"2024-09-15T22:44:59.733198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769961+0000","last_change":"2024-09-15T22:44:58.724037+0000","last_active":"2024-09-15T22:44:59.769961+0000","last_peered":"2024-09-15T22:44:59.769961+0000","last_clean":"2024-09-15T22:44:59.769961+0000","last_became_active":"2024-09-15T22:44:58.723750+0000","last_became_peered":"2024-09-15T22:44:58.723750+0000","last_unstale":"2024-09-15T22:44:59.769961+0000","last_undegraded":"2024-09-15T22:44:59.769961+0000","last_fullsized":"2024-09-15T22:44:59.769961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:57.576386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.744113+0000","last_change":"2024-09-15T22:44:57.719852+0000","last_active":"2024-09-15T22:44:58.744113+0000","last_peered":"2024-09-15T22:44:58.744113+0000","last_clean":"2024-09-15T22:44:58.744113+0000","last_became_active":"2024-09-15T22:44:57.719555+0000","last_became_peered":"2024-09-15T22:44:57.719555+0000","last_unstale":"2024-09-15T22:44:58.744113+0000","last_undegraded":"2024-09-15T22:44:58.744113+0000","last_fullsized":"2024-09-15T22:44:58.744113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:52.596547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771569+0000","last_change":"2024-09-15T22:44:58.728185+0000","last_active":"2024-09-15T22:44:59.771569+0000","last_peered":"2024-09-15T22:44:59.771569+0000","last_clean":"2024-09-15T22:44:59.771569+0000","last_became_active":"2024-09-15T22:44:58.727883+0000","last_became_peered":"2024-09-15T22:44:58.727883+0000","last_unstale":"2024-09-15T22:44:59.771569+0000","last_undegraded":"2024-09-15T22:44:59.771569+0000","last_fullsized":"2024-09-15T22:44:59.771569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:32.915320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.740535+0000","last_change":"2024-09-15T22:44:57.721945+0000","last_active":"2024-09-15T22:44:58.740535+0000","last_peered":"2024-09-15T22:44:58.740535+0000","last_clean":"2024-09-15T22:44:58.740535+0000","last_became_active":"2024-09-15T22:44:57.721663+0000","last_became_peered":"2024-09-15T22:44:57.721663+0000","last_unstale":"2024-09-15T22:44:58.740535+0000","last_undegraded":"2024-09-15T22:44:58.740535+0000","last_fullsized":"2024-09-15T22:44:58.740535+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:16.712865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729985+0000","last_change":"2024-09-15T22:44:58.736701+0000","last_active":"2024-09-15T22:44:59.729985+0000","last_peered":"2024-09-15T22:44:59.729985+0000","last_clean":"2024-09-15T22:44:59.729985+0000","last_became_active":"2024-09-15T22:44:58.736133+0000","last_became_peered":"2024-09-15T22:44:58.736133+0000","last_unstale":"2024-09-15T22:44:59.729985+0000","last_undegraded":"2024-09-15T22:44:59.729985+0000","last_fullsized":"2024-09-15T22:44:59.729985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:54.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729824+0000","last_change":"2024-09-15T22:44:57.720928+0000","last_active":"2024-09-15T22:44:59.729824+0000","last_peered":"2024-09-15T22:44:59.729824+0000","last_clean":"2024-09-15T22:44:59.729824+0000","last_became_active":"2024-09-15T22:44:57.720664+0000","last_became_peered":"2024-09-15T22:44:57.720664+0000","last_unstale":"2024-09-15T22:44:59.729824+0000","last_undegraded":"2024-09-15T22:44:59.729824+0000","last_fullsized":"2024-09-15T22:44:59.729824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:12.544071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770030+0000","last_change":"2024-09-15T22:44:58.732808+0000","last_active":"2024-09-15T22:44:59.770030+0000","last_peered":"2024-09-15T22:44:59.770030+0000","last_clean":"2024-09-15T22:44:59.770030+0000","last_became_active":"2024-09-15T22:44:58.732434+0000","last_became_peered":"2024-09-15T22:44:58.732434+0000","last_unstale":"2024-09-15T22:44:59.770030+0000","last_undegraded":"2024-09-15T22:44:59.770030+0000","last_fullsized":"2024-09-15T22:44:59.770030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:19.130465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730016+0000","last_change":"2024-09-15T22:44:57.717966+0000","last_active":"2024-09-15T22:44:59.730016+0000","last_peered":"2024-09-15T22:44:59.730016+0000","last_clean":"2024-09-15T22:44:59.730016+0000","last_became_active":"2024-09-15T22:44:57.717688+0000","last_became_peered":"2024-09-15T22:44:57.717688+0000","last_unstale":"2024-09-15T22:44:59.730016+0000","last_undegraded":"2024-09-15T22:44:59.730016+0000","last_fullsized":"2024-09-15T22:44:59.730016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:23.966155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769783+0000","last_change":"2024-09-15T22:44:58.723799+0000","last_active":"2024-09-15T22:44:59.769783+0000","last_peered":"2024-09-15T22:44:59.769783+0000","last_clean":"2024-09-15T22:44:59.769783+0000","last_became_active":"2024-09-15T22:44:58.723514+0000","last_became_peered":"2024-09-15T22:44:58.723514+0000","last_unstale":"2024-09-15T22:44:59.769783+0000","last_undegraded":"2024-09-15T22:44:59.769783+0000","last_fullsized":"2024-09-15T22:44:59.769783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:59.641435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729661+0000","last_change":"2024-09-15T22:44:57.719876+0000","last_active":"2024-09-15T22:44:59.729661+0000","last_peered":"2024-09-15T22:44:59.729661+0000","last_clean":"2024-09-15T22:44:59.729661+0000","last_became_active":"2024-09-15T22:44:57.719622+0000","last_became_peered":"2024-09-15T22:44:57.719622+0000","last_unstale":"2024-09-15T22:44:59.729661+0000","last_undegraded":"2024-09-15T22:44:59.729661+0000","last_fullsized":"2024-09-15T22:44:59.729661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:37.206258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770216+0000","last_change":"2024-09-15T22:44:58.730544+0000","last_active":"2024-09-15T22:44:59.770216+0000","last_peered":"2024-09-15T22:44:59.770216+0000","last_clean":"2024-09-15T22:44:59.770216+0000","last_became_active":"2024-09-15T22:44:58.730305+0000","last_became_peered":"2024-09-15T22:44:58.730305+0000","last_unstale":"2024-09-15T22:44:59.770216+0000","last_undegraded":"2024-09-15T22:44:59.770216+0000","last_fullsized":"2024-09-15T22:44:59.770216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:59.515142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769858+0000","last_change":"2024-09-15T22:44:57.723846+0000","last_active":"2024-09-15T22:44:59.769858+0000","last_peered":"2024-09-15T22:44:59.769858+0000","last_clean":"2024-09-15T22:44:59.769858+0000","last_became_active":"2024-09-15T22:44:57.723582+0000","last_became_peered":"2024-09-15T22:44:57.723582+0000","last_unstale":"2024-09-15T22:44:59.769858+0000","last_undegraded":"2024-09-15T22:44:59.769858+0000","last_fullsized":"2024-09-15T22:44:59.769858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:14.881718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769799+0000","last_change":"2024-09-15T22:44:58.724711+0000","last_active":"2024-09-15T22:44:59.769799+0000","last_peered":"2024-09-15T22:44:59.769799+0000","last_clean":"2024-09-15T22:44:59.769799+0000","last_became_active":"2024-09-15T22:44:58.724449+0000","last_became_peered":"2024-09-15T22:44:58.724449+0000","last_unstale":"2024-09-15T22:44:59.769799+0000","last_undegraded":"2024-09-15T22:44:59.769799+0000","last_fullsized":"2024-09-15T22:44:59.769799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:06.059690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770326+0000","last_change":"2024-09-15T22:44:57.728063+0000","last_active":"2024-09-15T22:44:59.770326+0000","last_peered":"2024-09-15T22:44:59.770326+0000","last_clean":"2024-09-15T22:44:59.770326+0000","last_became_active":"2024-09-15T22:44:57.727789+0000","last_became_peered":"2024-09-15T22:44:57.727789+0000","last_unstale":"2024-09-15T22:44:59.770326+0000","last_undegraded":"2024-09-15T22:44:59.770326+0000","last_fullsized":"2024-09-15T22:44:59.770326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:17.042298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769947+0000","last_change":"2024-09-15T22:44:58.723773+0000","last_active":"2024-09-15T22:44:59.769947+0000","last_peered":"2024-09-15T22:44:59.769947+0000","last_clean":"2024-09-15T22:44:59.769947+0000","last_became_active":"2024-09-15T22:44:58.723495+0000","last_became_peered":"2024-09-15T22:44:58.723495+0000","last_unstale":"2024-09-15T22:44:59.769947+0000","last_undegraded":"2024-09-15T22:44:59.769947+0000","last_fullsized":"2024-09-15T22:44:59.769947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:07.298908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769955+0000","last_change":"2024-09-15T22:44:57.730331+0000","last_active":"2024-09-15T22:44:59.769955+0000","last_peered":"2024-09-15T22:44:59.769955+0000","last_clean":"2024-09-15T22:44:59.769955+0000","last_became_active":"2024-09-15T22:44:57.729981+0000","last_became_peered":"2024-09-15T22:44:57.729981+0000","last_unstale":"2024-09-15T22:44:59.769955+0000","last_undegraded":"2024-09-15T22:44:59.769955+0000","last_fullsized":"2024-09-15T22:44:59.769955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:38.436931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770038+0000","last_change":"2024-09-15T22:44:58.743039+0000","last_active":"2024-09-15T22:44:59.770038+0000","last_peered":"2024-09-15T22:44:59.770038+0000","last_clean":"2024-09-15T22:44:59.770038+0000","last_became_active":"2024-09-15T22:44:58.742796+0000","last_became_peered":"2024-09-15T22:44:58.742796+0000","last_unstale":"2024-09-15T22:44:59.770038+0000","last_undegraded":"2024-09-15T22:44:59.770038+0000","last_fullsized":"2024-09-15T22:44:59.770038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:30.588493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771702+0000","last_change":"2024-09-15T22:44:57.723600+0000","last_active":"2024-09-15T22:44:59.771702+0000","last_peered":"2024-09-15T22:44:59.771702+0000","last_clean":"2024-09-15T22:44:59.771702+0000","last_became_active":"2024-09-15T22:44:57.723325+0000","last_became_peered":"2024-09-15T22:44:57.723325+0000","last_unstale":"2024-09-15T22:44:59.771702+0000","last_undegraded":"2024-09-15T22:44:59.771702+0000","last_fullsized":"2024-09-15T22:44:59.771702+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:43.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.729146+0000","last_change":"2024-09-15T22:44:58.720684+0000","last_active":"2024-09-15T22:44:58.729146+0000","last_peered":"2024-09-15T22:44:58.729146+0000","last_clean":"2024-09-15T22:44:58.729146+0000","last_became_active":"2024-09-15T22:44:58.720425+0000","last_became_peered":"2024-09-15T22:44:58.720425+0000","last_unstale":"2024-09-15T22:44:58.729146+0000","last_undegraded":"2024-09-15T22:44:58.729146+0000","last_fullsized":"2024-09-15T22:44:58.729146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:58.485921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771634+0000","last_change":"2024-09-15T22:44:57.723789+0000","last_active":"2024-09-15T22:44:59.771634+0000","last_peered":"2024-09-15T22:44:59.771634+0000","last_clean":"2024-09-15T22:44:59.771634+0000","last_became_active":"2024-09-15T22:44:57.723517+0000","last_became_peered":"2024-09-15T22:44:57.723517+0000","last_unstale":"2024-09-15T22:44:59.771634+0000","last_undegraded":"2024-09-15T22:44:59.771634+0000","last_fullsized":"2024-09-15T22:44:59.771634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:11.959282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.717764+0000","last_change":"2024-09-15T22:44:58.715964+0000","last_active":"2024-09-15T22:44:58.717764+0000","last_peered":"2024-09-15T22:44:58.717764+0000","last_clean":"2024-09-15T22:44:58.717764+0000","last_became_active":"2024-09-15T22:44:58.715633+0000","last_became_peered":"2024-09-15T22:44:58.715633+0000","last_unstale":"2024-09-15T22:44:58.717764+0000","last_undegraded":"2024-09-15T22:44:58.717764+0000","last_fullsized":"2024-09-15T22:44:58.717764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:19.855489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769618+0000","last_change":"2024-09-15T22:44:57.725682+0000","last_active":"2024-09-15T22:44:59.769618+0000","last_peered":"2024-09-15T22:44:59.769618+0000","last_clean":"2024-09-15T22:44:59.769618+0000","last_became_active":"2024-09-15T22:44:57.725399+0000","last_became_peered":"2024-09-15T22:44:57.725399+0000","last_unstale":"2024-09-15T22:44:59.769618+0000","last_undegraded":"2024-09-15T22:44:59.769618+0000","last_fullsized":"2024-09-15T22:44:59.769618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:17.784611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732943+0000","last_change":"2024-09-15T22:44:58.720587+0000","last_active":"2024-09-15T22:44:59.732943+0000","last_peered":"2024-09-15T22:44:59.732943+0000","last_clean":"2024-09-15T22:44:59.732943+0000","last_became_active":"2024-09-15T22:44:58.720068+0000","last_became_peered":"2024-09-15T22:44:58.720068+0000","last_unstale":"2024-09-15T22:44:59.732943+0000","last_undegraded":"2024-09-15T22:44:59.732943+0000","last_fullsized":"2024-09-15T22:44:59.732943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769625+0000","last_change":"2024-09-15T22:44:57.730552+0000","last_active":"2024-09-15T22:44:59.769625+0000","last_peered":"2024-09-15T22:44:59.769625+0000","last_clean":"2024-09-15T22:44:59.769625+0000","last_became_active":"2024-09-15T22:44:57.730272+0000","last_became_peered":"2024-09-15T22:44:57.730272+0000","last_unstale":"2024-09-15T22:44:59.769625+0000","last_undegraded":"2024-09-15T22:44:59.769625+0000","last_fullsized":"2024-09-15T22:44:59.769625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.146006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770586+0000","last_change":"2024-09-15T22:44:58.724847+0000","last_active":"2024-09-15T22:44:59.770586+0000","last_peered":"2024-09-15T22:44:59.770586+0000","last_clean":"2024-09-15T22:44:59.770586+0000","last_became_active":"2024-09-15T22:44:58.724519+0000","last_became_peered":"2024-09-15T22:44:58.724519+0000","last_unstale":"2024-09-15T22:44:59.770586+0000","last_undegraded":"2024-09-15T22:44:59.770586+0000","last_fullsized":"2024-09-15T22:44:59.770586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.352166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769758+0000","last_change":"2024-09-15T22:44:57.723208+0000","last_active":"2024-09-15T22:44:59.769758+0000","last_peered":"2024-09-15T22:44:59.769758+0000","last_clean":"2024-09-15T22:44:59.769758+0000","last_became_active":"2024-09-15T22:44:57.722938+0000","last_became_peered":"2024-09-15T22:44:57.722938+0000","last_unstale":"2024-09-15T22:44:59.769758+0000","last_undegraded":"2024-09-15T22:44:59.769758+0000","last_fullsized":"2024-09-15T22:44:59.769758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:40.221992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730345+0000","last_change":"2024-09-15T22:44:58.721712+0000","last_active":"2024-09-15T22:44:59.730345+0000","last_peered":"2024-09-15T22:44:59.730345+0000","last_clean":"2024-09-15T22:44:59.730345+0000","last_became_active":"2024-09-15T22:44:58.720800+0000","last_became_peered":"2024-09-15T22:44:58.720800+0000","last_unstale":"2024-09-15T22:44:59.730345+0000","last_undegraded":"2024-09-15T22:44:59.730345+0000","last_fullsized":"2024-09-15T22:44:59.730345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:59.230259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:45:00.715939+0000","last_change":"2024-09-15T22:44:57.728062+0000","last_active":"2024-09-15T22:45:00.715939+0000","last_peered":"2024-09-15T22:45:00.715939+0000","last_clean":"2024-09-15T22:45:00.715939+0000","last_became_active":"2024-09-15T22:44:57.727790+0000","last_became_peered":"2024-09-15T22:44:57.727790+0000","last_unstale":"2024-09-15T22:45:00.715939+0000","last_undegraded":"2024-09-15T22:45:00.715939+0000","last_fullsized":"2024-09-15T22:45:00.715939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:19.134125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769968+0000","last_change":"2024-09-15T22:44:58.733604+0000","last_active":"2024-09-15T22:44:59.769968+0000","last_peered":"2024-09-15T22:44:59.769968+0000","last_clean":"2024-09-15T22:44:59.769968+0000","last_became_active":"2024-09-15T22:44:58.733326+0000","last_became_peered":"2024-09-15T22:44:58.733326+0000","last_unstale":"2024-09-15T22:44:59.769968+0000","last_undegraded":"2024-09-15T22:44:59.769968+0000","last_fullsized":"2024-09-15T22:44:59.769968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.181032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733137+0000","last_change":"2024-09-15T22:44:57.720365+0000","last_active":"2024-09-15T22:44:59.733137+0000","last_peered":"2024-09-15T22:44:59.733137+0000","last_clean":"2024-09-15T22:44:59.733137+0000","last_became_active":"2024-09-15T22:44:57.720093+0000","last_became_peered":"2024-09-15T22:44:57.720093+0000","last_unstale":"2024-09-15T22:44:59.733137+0000","last_undegraded":"2024-09-15T22:44:59.733137+0000","last_fullsized":"2024-09-15T22:44:59.733137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:57.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730117+0000","last_change":"2024-09-15T22:44:58.721676+0000","last_active":"2024-09-15T22:44:59.730117+0000","last_peered":"2024-09-15T22:44:59.730117+0000","last_clean":"2024-09-15T22:44:59.730117+0000","last_became_active":"2024-09-15T22:44:58.721358+0000","last_became_peered":"2024-09-15T22:44:58.721358+0000","last_unstale":"2024-09-15T22:44:59.730117+0000","last_undegraded":"2024-09-15T22:44:59.730117+0000","last_fullsized":"2024-09-15T22:44:59.730117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.732859+0000","last_change":"2024-09-15T22:44:57.720955+0000","last_active":"2024-09-15T22:44:59.732859+0000","last_peered":"2024-09-15T22:44:59.732859+0000","last_clean":"2024-09-15T22:44:59.732859+0000","last_became_active":"2024-09-15T22:44:57.720675+0000","last_became_peered":"2024-09-15T22:44:57.720675+0000","last_unstale":"2024-09-15T22:44:59.732859+0000","last_undegraded":"2024-09-15T22:44:59.732859+0000","last_fullsized":"2024-09-15T22:44:59.732859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:50.510802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770221+0000","last_change":"2024-09-15T22:44:58.726079+0000","last_active":"2024-09-15T22:44:59.770221+0000","last_peered":"2024-09-15T22:44:59.770221+0000","last_clean":"2024-09-15T22:44:59.770221+0000","last_became_active":"2024-09-15T22:44:58.725760+0000","last_became_peered":"2024-09-15T22:44:58.725760+0000","last_unstale":"2024-09-15T22:44:59.770221+0000","last_undegraded":"2024-09-15T22:44:59.770221+0000","last_fullsized":"2024-09-15T22:44:59.770221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:47.081842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.733008+0000","last_change":"2024-09-15T22:44:57.723760+0000","last_active":"2024-09-15T22:44:59.733008+0000","last_peered":"2024-09-15T22:44:59.733008+0000","last_clean":"2024-09-15T22:44:59.733008+0000","last_became_active":"2024-09-15T22:44:57.723482+0000","last_became_peered":"2024-09-15T22:44:57.723482+0000","last_unstale":"2024-09-15T22:44:59.733008+0000","last_undegraded":"2024-09-15T22:44:59.733008+0000","last_fullsized":"2024-09-15T22:44:59.733008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:17.780234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769444+0000","last_change":"2024-09-15T22:44:58.742866+0000","last_active":"2024-09-15T22:44:59.769444+0000","last_peered":"2024-09-15T22:44:59.769444+0000","last_clean":"2024-09-15T22:44:59.769444+0000","last_became_active":"2024-09-15T22:44:58.742606+0000","last_became_peered":"2024-09-15T22:44:58.742606+0000","last_unstale":"2024-09-15T22:44:59.769444+0000","last_undegraded":"2024-09-15T22:44:59.769444+0000","last_fullsized":"2024-09-15T22:44:59.769444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:52.508884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770316+0000","last_change":"2024-09-15T22:44:57.727532+0000","last_active":"2024-09-15T22:44:59.770316+0000","last_peered":"2024-09-15T22:44:59.770316+0000","last_clean":"2024-09-15T22:44:59.770316+0000","last_became_active":"2024-09-15T22:44:57.727315+0000","last_became_peered":"2024-09-15T22:44:57.727315+0000","last_unstale":"2024-09-15T22:44:59.770316+0000","last_undegraded":"2024-09-15T22:44:59.770316+0000","last_fullsized":"2024-09-15T22:44:59.770316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.895527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-15T22:44:58.736325+0000","last_change":"2024-09-15T22:44:58.731105+0000","last_active":"2024-09-15T22:44:58.736325+0000","last_peered":"2024-09-15T22:44:58.736325+0000","last_clean":"2024-09-15T22:44:58.736325+0000","last_became_active":"2024-09-15T22:44:58.730812+0000","last_became_peered":"2024-09-15T22:44:58.730812+0000","last_unstale":"2024-09-15T22:44:58.736325+0000","last_undegraded":"2024-09-15T22:44:58.736325+0000","last_fullsized":"2024-09-15T22:44:58.736325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:54.742160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769701+0000","last_change":"2024-09-15T22:44:57.729504+0000","last_active":"2024-09-15T22:44:59.769701+0000","last_peered":"2024-09-15T22:44:59.769701+0000","last_clean":"2024-09-15T22:44:59.769701+0000","last_became_active":"2024-09-15T22:44:57.729061+0000","last_became_peered":"2024-09-15T22:44:57.729061+0000","last_unstale":"2024-09-15T22:44:59.769701+0000","last_undegraded":"2024-09-15T22:44:59.769701+0000","last_fullsized":"2024-09-15T22:44:59.769701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:45.990609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.769090+0000","last_change":"2024-09-15T22:44:58.728888+0000","last_active":"2024-09-15T22:44:59.769090+0000","last_peered":"2024-09-15T22:44:59.769090+0000","last_clean":"2024-09-15T22:44:59.769090+0000","last_became_active":"2024-09-15T22:44:58.728622+0000","last_became_peered":"2024-09-15T22:44:58.728622+0000","last_unstale":"2024-09-15T22:44:59.769090+0000","last_undegraded":"2024-09-15T22:44:59.769090+0000","last_fullsized":"2024-09-15T22:44:59.769090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:56.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.771354+0000","last_change":"2024-09-15T22:44:57.724755+0000","last_active":"2024-09-15T22:44:59.771354+0000","last_peered":"2024-09-15T22:44:59.771354+0000","last_clean":"2024-09-15T22:44:59.771354+0000","last_became_active":"2024-09-15T22:44:57.724467+0000","last_became_peered":"2024-09-15T22:44:57.724467+0000","last_unstale":"2024-09-15T22:44:59.771354+0000","last_undegraded":"2024-09-15T22:44:59.771354+0000","last_fullsized":"2024-09-15T22:44:59.771354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:45.990609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.770178+0000","last_change":"2024-09-15T22:44:58.739649+0000","last_active":"2024-09-15T22:44:59.770178+0000","last_peered":"2024-09-15T22:44:59.770178+0000","last_clean":"2024-09-15T22:44:59.770178+0000","last_became_active":"2024-09-15T22:44:58.739383+0000","last_became_peered":"2024-09-15T22:44:58.739383+0000","last_unstale":"2024-09-15T22:44:59.770178+0000","last_undegraded":"2024-09-15T22:44:59.770178+0000","last_fullsized":"2024-09-15T22:44:59.770178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:57.702079+0000","last_clean_scrub_stamp":"2024-09-15T22:44:57.702079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:20.391612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.730025+0000","last_change":"2024-09-15T22:44:57.718453+0000","last_active":"2024-09-15T22:44:59.730025+0000","last_peered":"2024-09-15T22:44:59.730025+0000","last_clean":"2024-09-15T22:44:59.730025+0000","last_became_active":"2024-09-15T22:44:57.718156+0000","last_became_peered":"2024-09-15T22:44:57.718156+0000","last_unstale":"2024-09-15T22:44:59.730025+0000","last_undegraded":"2024-09-15T22:44:59.730025+0000","last_fullsized":"2024-09-15T22:44:59.730025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:44:56.696724+0000","last_clean_scrub_stamp":"2024-09-15T22:44:56.696724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.210258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":261,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T22:44:59.729679+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:44:59.729679+0000","last_peered":"2024-09-15T22:44:59.729679+0000","last_clean":"2024-09-15T22:44:59.729679+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:44:59.729679+0000","last_undegraded":"2024-09-15T22:44:59.729679+0000","last_fullsized":"2024-09-15T22:44:59.729679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":369551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1478656,"data_stored":958397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":368633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":892928,"data_stored":368065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":368521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":958307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":884736,"data_stored":368009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":856064,"data_stored":354864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:02.002 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:45:02.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:45:02.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.142+0000 7f1dbfd9f640 1 Processor -- start 2024-09-15T22:45:02.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.142+0000 7f1dbfd9f640 1 -- start start 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbfd9f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 0x7f1db806e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbfd9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1db806feb0 0x7f1db8072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbfd9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1db806ee10 con 0x7f1db80d06e0 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbfd9f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1db815d8a0 con 0x7f1db806feb0 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbfd9f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1db806f0f0 con 0x7f1db815c4b0 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbd33a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1db806feb0 0x7f1db8072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbd33a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1db806feb0 0x7f1db8072da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38014/0 (socket says 172.21.15.134:38014) 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.143+0000 7f1dbd33a640 1 -- 172.21.15.134:0/1119566984 learned_addr learned my addr 172.21.15.134:0/1119566984 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbdb3b640 1 --2- 172.21.15.134:0/1119566984 >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 0x7f1db806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbd33a640 1 -- 172.21.15.134:0/1119566984 >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 msgr2=0x7f1db806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbd33a640 1 --2- 172.21.15.134:0/1119566984 >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 0x7f1db806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbd33a640 1 -- 172.21.15.134:0/1119566984 >> v1:172.21.15.177:6789/0 conn(0x7f1db80d06e0 legacy=0x7f1db80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbd33a640 1 -- 172.21.15.134:0/1119566984 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db806f3d0 con 0x7f1db806feb0 2024-09-15T22:45:02.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbdb3b640 1 --2- 172.21.15.134:0/1119566984 >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 0x7f1db806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:02.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbd33a640 1 --2- 172.21.15.134:0/1119566984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db806feb0 0x7f1db8072da0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1db80b7720 tx=0x7f1dac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2747a8d90658fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.144+0000 7f1dbcb39640 1 -- 172.21.15.134:0/1119566984 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac037070 con 0x7f1db806feb0 2024-09-15T22:45:02.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbcb39640 1 -- 172.21.15.134:0/1119566984 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac032440 con 0x7f1db806feb0 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbcb39640 1 -- 172.21.15.134:0/1119566984 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac032810 con 0x7f1db806feb0 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/1119566984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db806feb0 msgr2=0x7f1db8072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/1119566984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db806feb0 0x7f1db8072da0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1db80b7720 tx=0x7f1dac02a230 comp rx=0 tx=0).stop 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/1119566984 shutdown_connections 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/1119566984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db806feb0 0x7f1db8072da0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/1119566984 >> v2:172.21.15.177:3300/0 conn(0x7f1db815c4b0 0x7f1db806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/1119566984 >> 172.21.15.134:0/1119566984 conn(0x7f1db806ccb0 msgr2=0x7f1db806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/1119566984 shutdown_connections 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.145+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/1119566984 wait complete. 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.146+0000 7f1dbfd9f640 1 Processor -- start 2024-09-15T22:45:02.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.146+0000 7f1dbfd9f640 1 -- start start 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1db806feb0 0x7f1db815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1db815c4b0 0x7f1db81f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1db80732e0 con 0x7f1db80d06e0 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1db806f990 con 0x7f1db806feb0 2024-09-15T22:45:02.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbfd9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1db815c890 con 0x7f1db815c4b0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38030/0 (socket says 172.21.15.134:38030) 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 -- 172.21.15.134:0/3942526337 learned_addr learned my addr 172.21.15.134:0/3942526337 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbdb3b640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1db806feb0 0x7f1db815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbe33c640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1db815c4b0 0x7f1db81f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 -- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1db815c4b0 msgr2=0x7f1db81f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1db815c4b0 0x7f1db81f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 -- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1db806feb0 msgr2=0x7f1db815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1db806feb0 0x7f1db815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.147+0000 7f1dbd33a640 1 -- 172.21.15.134:0/3942526337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db81f50a0 con 0x7f1db80d06e0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1dbd33a640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1dac02a270 tx=0x7f1dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac037040 con 0x7f1db80d06e0 2024-09-15T22:45:02.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac042070 con 0x7f1db80d06e0 2024-09-15T22:45:02.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db80b4be0 con 0x7f1db80d06e0 2024-09-15T22:45:02.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac030bb0 con 0x7f1db80d06e0 2024-09-15T22:45:02.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.148+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db81ee790 con 0x7f1db80d06e0 2024-09-15T22:45:02.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.149+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db8072da0 con 0x7f1db80d06e0 2024-09-15T22:45:02.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.149+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f1dac047460 con 0x7f1db80d06e0 2024-09-15T22:45:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.150+0000 7f1db67fc640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 0x7f1da406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.150+0000 7f1dbdb3b640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 0x7f1da406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.150+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f1dac0ac5e0 con 0x7f1db80d06e0 2024-09-15T22:45:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.150+0000 7f1dbdb3b640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 0x7f1da406ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1db80affd0 tx=0x7f1da8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.154+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1dac045360 con 0x7f1db80d06e0 2024-09-15T22:45:02.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.383+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1db80b18e0 con 0x7f1db80d06e0 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.386+0000 7f1db67fc640 1 -- 172.21.15.134:0/3942526337 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f1dac07a940 con 0x7f1db80d06e0 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:45:02.387 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:45:02.388 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:45:02.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 msgr2=0x7f1da406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 0x7f1da406ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1db80affd0 tx=0x7f1da8008040 comp rx=0 tx=0).stop 2024-09-15T22:45:02.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 msgr2=0x7f1db815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1dac02a270 tx=0x7f1dac0046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 shutdown_connections 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f1da406c610 0x7f1da406ead0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1db815c4b0 0x7f1db81f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1db80d06e0 0x7f1db815efb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 --2- 172.21.15.134:0/3942526337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1db806feb0 0x7f1db815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 >> 172.21.15.134:0/3942526337 conn(0x7f1db806ccb0 msgr2=0x7f1db815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 shutdown_connections 2024-09-15T22:45:02.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.388+0000 7f1dbfd9f640 1 -- 172.21.15.134:0/3942526337 wait complete. 2024-09-15T22:45:02.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:02.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.497+0000 7ff21a331640 1 Processor -- start 2024-09-15T22:45:02.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.497+0000 7ff21a331640 1 -- start start 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff21a331640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff21415c180 0x7ff2140cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff21a331640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140ce230 0x7ff2140cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff21a331640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2140ce740 con 0x7ff2140cf5b0 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff21a331640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff214072640 con 0x7ff21415c180 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff21a331640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff214072920 con 0x7ff2140ce230 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff213fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff21415c180 0x7ff2140cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff2188ce640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff2140cf5b0 0x7ff214073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48014/0 (socket says 172.21.15.134:48014) 2024-09-15T22:45:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff213fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff21415c180 0x7ff2140cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38044/0 (socket says 172.21.15.134:38044) 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff2188ce640 1 -- 172.21.15.134:0/2228607330 learned_addr learned my addr 172.21.15.134:0/2228607330 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.498+0000 7ff2137fe640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140ce230 0x7ff2140cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff213fff640 1 -- 172.21.15.134:0/2228607330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140ce230 msgr2=0x7ff2140cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff213fff640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140ce230 0x7ff2140cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff213fff640 1 -- 172.21.15.134:0/2228607330 >> v1:172.21.15.134:6789/0 conn(0x7ff2140cf5b0 legacy=0x7ff214073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff213fff640 1 -- 172.21.15.134:0/2228607330 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff214072c00 con 0x7ff21415c180 2024-09-15T22:45:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff213fff640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140cdcf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ef800067bc4b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff212ffd640 1 -- 172.21.15.134:0/2228607330 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204037070 con 0x7ff21415c180 2024-09-15T22:45:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff212ffd640 1 -- 172.21.15.134:0/2228607330 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20402ae50 con 0x7ff21415c180 2024-09-15T22:45:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.499+0000 7ff212ffd640 1 -- 172.21.15.134:0/2228607330 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204032660 con 0x7ff21415c180 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 -- 172.21.15.134:0/2228607330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 msgr2=0x7ff2140cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140cdcf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402a100 comp rx=0 tx=0).stop 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 -- 172.21.15.134:0/2228607330 shutdown_connections 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140ce230 0x7ff2140cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 --2- 172.21.15.134:0/2228607330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140cdcf0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 -- 172.21.15.134:0/2228607330 >> 172.21.15.134:0/2228607330 conn(0x7ff214062cc0 msgr2=0x7ff21406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 -- 172.21.15.134:0/2228607330 shutdown_connections 2024-09-15T22:45:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.500+0000 7ff21a331640 1 -- 172.21.15.134:0/2228607330 wait complete. 2024-09-15T22:45:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.501+0000 7ff21a331640 1 Processor -- start 2024-09-15T22:45:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.501+0000 7ff21a331640 1 -- start start 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 0x7ff2141f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 0x7ff214150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff21415c560 con 0x7ff21415c180 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140722f0 con 0x7ff2140ce230 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff21a331640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff21415c6e0 con 0x7ff2140cf5b0 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38052/0 (socket says 172.21.15.134:38052) 2024-09-15T22:45:02.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 -- 172.21.15.134:0/2929268155 learned_addr learned my addr 172.21.15.134:0/2929268155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2137fe640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 0x7ff214150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff213fff640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 0x7ff2141f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 -- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 msgr2=0x7ff214150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 0x7ff214150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 -- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 msgr2=0x7ff2141f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 0x7ff2141f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 -- 172.21.15.134:0/2929268155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff214153270 con 0x7ff21415c180 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2137fe640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 0x7ff214150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff213fff640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 0x7ff2141f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.502+0000 7ff2188ce640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ca20 tx=0x7ff20c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.503+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c017070 con 0x7ff21415c180 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.503+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c00abd0 con 0x7ff21415c180 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.503+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff214153550 con 0x7ff21415c180 2024-09-15T22:45:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.503+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c012400 con 0x7ff21415c180 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.503+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21415e030 con 0x7ff21415c180 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.504+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21415db40 con 0x7ff21415c180 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.504+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7ff20c01a070 con 0x7ff21415c180 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.505+0000 7ff210ff9640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 0x7ff20006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.505+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7ff20c08b610 con 0x7ff21415c180 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.505+0000 7ff213fff640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 0x7ff20006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:02.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.505+0000 7ff213fff640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 0x7ff20006ead0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff204034000 tx=0x7ff20402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:02.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.509+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff20c059220 con 0x7ff21415c180 2024-09-15T22:45:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.707+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2140cf070 con 0x7ff21415c180 2024-09-15T22:45:02.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.708+0000 7ff210ff9640 1 -- 172.21.15.134:0/2929268155 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5234 (secure 0 0 0) 0x7ff20c05d520 con 0x7ff21415c180 2024-09-15T22:45:02.709 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:02.709 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":36,"btime":"2024-09-15T22:45:00:727361+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:02.710 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 36 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 msgr2=0x7ff20006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 0x7ff20006ead0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff204034000 tx=0x7ff20402e000 comp rx=0 tx=0).stop 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 msgr2=0x7ff2140b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ca20 tx=0x7ff20c00cee0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 shutdown_connections 2024-09-15T22:45:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7ff20006c610 0x7ff20006ead0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21415c180 0x7ff2140b0380 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2140cf5b0 0x7ff214150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 --2- 172.21.15.134:0/2929268155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140ce230 0x7ff2141f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 >> 172.21.15.134:0/2929268155 conn(0x7ff214062cc0 msgr2=0x7ff2140b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 shutdown_connections 2024-09-15T22:45:02.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:02.710+0000 7ff21a331640 1 -- 172.21.15.134:0/2929268155 wait complete. 2024-09-15T22:45:03.125 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:44:58.056856+0000', 'modified': '2024-09-15T22:45:00.054597+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6117': {'gid': 6117, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6836/1551084696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1551084696}, {'type': 'v1', 'addr': '172.21.15.134:6836', 'nonce': 1551084696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6117, 'qdb_cluster': [6117]} 2024-09-15T22:45:03.125 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:45:03.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:45:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.224+0000 7f8fd4674640 1 Processor -- start 2024-09-15T22:45:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.224+0000 7f8fd4674640 1 -- start start 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd4674640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd4674640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd4674640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc0d0bc0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd4674640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8fcc15d390 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd4674640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc15d670 con 0x7f8fcc15ca40 2024-09-15T22:45:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd2410640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd2410640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38068/0 (socket says 172.21.15.134:38068) 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd2c11640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8fcc15ce80 0x7f8fcc1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48030/0 (socket says 172.21.15.134:48030) 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.225+0000 7f8fd2410640 1 -- 172.21.15.134:0/748754874 learned_addr learned my addr 172.21.15.134:0/748754874 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd2410640 1 -- 172.21.15.134:0/748754874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 msgr2=0x7f8fcc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd2410640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd2410640 1 -- 172.21.15.134:0/748754874 >> v1:172.21.15.134:6789/0 conn(0x7f8fcc15ce80 legacy=0x7f8fcc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd140e640 1 -- 172.21.15.134:0/748754874 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467772807 0 0) 0x7f8fcc0d0bc0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd2410640 1 -- 172.21.15.134:0/748754874 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc15d950 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.226+0000 7f8fd2410640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009e50 tx=0x7f8fbc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e00e3d680d9f61d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd140e640 1 -- 172.21.15.134:0/748754874 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc036070 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd140e640 1 -- 172.21.15.134:0/748754874 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fbc031600 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd140e640 1 -- 172.21.15.134:0/748754874 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0319d0 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 -- 172.21.15.134:0/748754874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc0d02a0 msgr2=0x7f8fcc0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009e50 tx=0x7f8fbc02a680 comp rx=0 tx=0).stop 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 -- 172.21.15.134:0/748754874 shutdown_connections 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 --2- 172.21.15.134:0/748754874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc0d0680 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 -- 172.21.15.134:0/748754874 >> 172.21.15.134:0/748754874 conn(0x7f8fcc062cc0 msgr2=0x7f8fcc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 -- 172.21.15.134:0/748754874 shutdown_connections 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.227+0000 7f8fd4674640 1 -- 172.21.15.134:0/748754874 wait complete. 2024-09-15T22:45:03.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.228+0000 7f8fd4674640 1 Processor -- start 2024-09-15T22:45:03.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.228+0000 7f8fd4674640 1 -- start start 2024-09-15T22:45:03.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc073760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc155b90 con 0x7f8fcc15ce80 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc15df10 con 0x7f8fcc0d02a0 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd4674640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc155d10 con 0x7f8fcc15ca40 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd2c11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd2c11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38078/0 (socket says 172.21.15.134:38078) 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd2c11640 1 -- 172.21.15.134:0/28826988 learned_addr learned my addr 172.21.15.134:0/28826988 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd2410640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.229+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 -- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 msgr2=0x7f8fcc073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc073760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 -- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 msgr2=0x7f8fcc14c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc14c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 -- 172.21.15.134:0/28826988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc14ce40 con 0x7f8fcc15ce80 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2410640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4001eb0 tx=0x7f8fc400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fcaffd640 1 -- 172.21.15.134:0/28826988 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40074e0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fcaffd640 1 -- 172.21.15.134:0/28826988 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc40047e0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fcaffd640 1 -- 172.21.15.134:0/28826988 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4004bb0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc0711c0 con 0x7f8fcc15ce80 2024-09-15T22:45:03.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.230+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc071a60 con 0x7f8fcc15ce80 2024-09-15T22:45:03.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.231+0000 7f8fcaffd640 1 -- 172.21.15.134:0/28826988 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f8fc4011070 con 0x7f8fcc15ce80 2024-09-15T22:45:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.232+0000 7f8fcaffd640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 0x7f8fb806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.232+0000 7f8fcaffd640 1 -- 172.21.15.134:0/28826988 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f8fc408b620 con 0x7f8fcc15ce80 2024-09-15T22:45:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.232+0000 7f8fd2410640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 0x7f8fb806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.232+0000 7f8fd2410640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 0x7f8fb806ead0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc033000 tx=0x7f8fbc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.233+0000 7f8fd7415740 1 Processor -- start 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.233+0000 7f8fd7415740 1 -- start start 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514684d0 0x55eb514adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51462ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eb513c8520 con 0x55eb51465c90 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eb513703e0 con 0x55eb514684d0 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55eb513c44e0 con 0x55eb51469c60 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38084/0 (socket says 172.21.15.134:38084) 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/2753204820 learned_addr learned my addr 172.21.15.134:0/2753204820 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd2410640 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514684d0 0x55eb514adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51462ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 msgr2=0x55eb51462ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51462ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514684d0 msgr2=0x55eb514adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514684d0 0x55eb514adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/2753204820 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5138b2f0 con 0x55eb51465c90 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000b920 tx=0x7f8fc000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c72f7fd6e2f88a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fb3fff640 1 -- 172.21.15.134:0/2753204820 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0018020 con 0x55eb51465c90 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.234+0000 7f8fb3fff640 1 -- 172.21.15.134:0/2753204820 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc000fa80 con 0x55eb51465c90 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fb3fff640 1 -- 172.21.15.134:0/2753204820 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000fe30 con 0x55eb51465c90 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 -- 172.21.15.134:0/2753204820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 msgr2=0x55eb514688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000b920 tx=0x7f8fc000bde0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 -- 172.21.15.134:0/2753204820 shutdown_connections 2024-09-15T22:45:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51462ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51465c90 0x55eb514688b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2753204820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514684d0 0x55eb514adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 -- 172.21.15.134:0/2753204820 >> 172.21.15.134:0/2753204820 conn(0x55eb51464c90 msgr2=0x55eb514ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 -- 172.21.15.134:0/2753204820 shutdown_connections 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.235+0000 7f8fd7415740 1 -- 172.21.15.134:0/2753204820 wait complete. 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.236+0000 7f8fd7415740 1 -- start start 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.236+0000 7f8fd7415740 1 Processor -- start 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51486ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb514bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eb51464130 con 0x55eb514684d0 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eb51351450 con 0x55eb514bd960 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55eb514ae4a0 con 0x55eb51469c60 2024-09-15T22:45:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 10 client.0 _ll_register_callbacks cb 0x55eb510daac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38090/0 (socket says 172.21.15.134:38090) 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 -- 172.21.15.134:0/2688430410 learned_addr learned my addr 172.21.15.134:0/2688430410 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51486ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb514bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 -- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 msgr2=0x55eb51486ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51486ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 -- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 msgr2=0x55eb514bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb514bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 -- 172.21.15.134:0/2688430410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb510db2d0 con 0x55eb514684d0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51486ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd2410640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc02ac70 tx=0x7f8fbc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8eacb68fa2b084 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:03.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc036050 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f8fbc03e7c0 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.237+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fc000fa80 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8fbc057050 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 10 client.6264 fetch_fsmap learned FSMap version 36 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55eb511a56b0 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc000fa80 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f8fbc05a020 con 0x55eb514684d0 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 10 client.6264 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 10 client.6264 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 20 client.6264 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb514c94b0 0x55eb514cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 4 client.6264 mds_command: new command op to 6117 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:03.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 --> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb513d5c50 con 0x55eb514c94b0 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb514c94b0 0x55eb514cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fb17fa640 10 client.6264 ms_handle_connect on v2:172.21.15.134:6834/1551084696 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.238+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb514c94b0 0x55eb514cb8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4dfcd664ecf99da server_cookie=221b54445805cdf0 in_seq=0 out_seq=0 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fb17fa640 1 -- 172.21.15.134:0/2688430410 <== mds.0 v2:172.21.15.134:6834/1551084696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb513d5c50 con 0x55eb514c94b0 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fb17fa640 10 client.6264 handle_command_reply: tid=0 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 client.6264 shutdown 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 msgr2=0x55eb51490200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc02ac70 tx=0x7f8fbc004ab0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 shutdown_connections 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb514c94b0 0x55eb514cb8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb514bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fb17fa640 0 client.6264 ms_handle_reset on v2:172.21.15.134:6834/1551084696 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb51486ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 --2- 172.21.15.134:0/2688430410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb51490200 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 >> 172.21.15.134:0/2688430410 conn(0x55eb51465c90 msgr2=0x55eb514b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 shutdown_connections 2024-09-15T22:45:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 1 -- 172.21.15.134:0/2688430410 wait complete. 2024-09-15T22:45:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.239+0000 7f8fd7415740 20 client.6264 trim_cache size 0 max 16384 2024-09-15T22:45:03.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.257+0000 7f8fd7415740 1 Processor -- start 2024-09-15T22:45:03.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.257+0000 7f8fd7415740 1 -- start start 2024-09-15T22:45:03.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb514684d0 0x55eb514901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51488690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc06bba0 con 0x55eb51469c60 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc1f47e0 con 0x55eb514bd960 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc1f4e30 con 0x55eb514684d0 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38102/0 (socket says 172.21.15.134:38102) 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/3989462041 learned_addr learned my addr 172.21.15.134:0/3989462041 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb514684d0 msgr2=0x55eb514901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb514684d0 0x55eb514901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 msgr2=0x55eb51488690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51488690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 -- 172.21.15.134:0/3989462041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb514be110 con 0x55eb51469c60 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.258+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000b8f0 tx=0x7f8fc0009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ded0c68f3f370b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fb37fe640 1 -- 172.21.15.134:0/3989462041 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc002d070 con 0x55eb51469c60 2024-09-15T22:45:03.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fb37fe640 1 -- 172.21.15.134:0/3989462041 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc000fcb0 con 0x55eb51469c60 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fb37fe640 1 -- 172.21.15.134:0/3989462041 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0018040 con 0x55eb51469c60 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 -- 172.21.15.134:0/3989462041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 msgr2=0x55eb51490b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000b8f0 tx=0x7f8fc0009000 comp rx=0 tx=0).stop 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 -- 172.21.15.134:0/3989462041 shutdown_connections 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51488690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb51469c60 0x55eb51490b90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 --2- 172.21.15.134:0/3989462041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb514684d0 0x55eb514901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 -- 172.21.15.134:0/3989462041 >> 172.21.15.134:0/3989462041 conn(0x55eb51465c90 msgr2=0x55eb514bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 -- 172.21.15.134:0/3989462041 shutdown_connections 2024-09-15T22:45:03.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.259+0000 7f8fd7415740 1 -- 172.21.15.134:0/3989462041 wait complete. 2024-09-15T22:45:03.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.260+0000 7f8fd7415740 1 -- start start 2024-09-15T22:45:03.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.260+0000 7f8fd7415740 1 Processor -- start 2024-09-15T22:45:03.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb514ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51486120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eb51490740 con 0x55eb514684d0 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eb514be2e0 con 0x55eb514bd960 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55eb514c14d0 con 0x55eb51469c60 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 10 client.0 _ll_register_callbacks cb 0x7f8fbc009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38110/0 (socket says 172.21.15.134:38110) 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 -- 172.21.15.134:0/1160886776 learned_addr learned my addr 172.21.15.134:0/1160886776 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb514ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2c11640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51486120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 -- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 msgr2=0x55eb514ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb514ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 -- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 msgr2=0x55eb51486120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51486120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 -- 172.21.15.134:0/1160886776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb514acf30 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd2410640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc03ec20 tx=0x7f8fbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ddc8a4c3ca83f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc036040 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f8fbc03d910 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fc000fcb0 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8fbc065050 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 10 client.6270 fetch_fsmap learned FSMap version 36 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.261+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55eb514ad830 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc000fcb0 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f8fbc068020 con 0x55eb514684d0 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 10 client.6270 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 10 client.6270 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:03.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 20 client.6270 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb5152b760 0x55eb5145f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 4 client.6270 mds_command: new command op to 6117 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 --> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] -- command(tid 0: {"prefix": "status"}) -- 0x55eb513cffa0 con 0x55eb5152b760 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb5152b760 0x55eb5145f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 10 client.6270 ms_handle_connect on v2:172.21.15.134:6834/1551084696 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd1c0f640 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb5152b760 0x55eb5145f7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3ed209a5a5497f server_cookie=7ce13ace5a347388 in_seq=0 out_seq=0 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 1 -- 172.21.15.134:0/1160886776 <== mds.0 v2:172.21.15.134:6834/1551084696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55eb513cffa0 con 0x55eb5152b760 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 10 client.6270 handle_command_reply: tid=0 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 client.6270 shutdown 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 msgr2=0x55eb5150d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc03ec20 tx=0x7f8fbc004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 shutdown_connections 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:6834/1551084696,v1:172.21.15.134:6836/1551084696] conn(0x55eb5152b760 0x55eb5145f7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb514bd960 0x55eb51486120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55eb51469c60 0x55eb514ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 --2- 172.21.15.134:0/1160886776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb514684d0 0x55eb5150d700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fb17fa640 0 client.6270 ms_handle_reset on v2:172.21.15.134:6834/1551084696 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.262+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 >> 172.21.15.134:0/1160886776 conn(0x55eb51465c90 msgr2=0x55eb51488720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 shutdown_connections 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd7415740 1 -- 172.21.15.134:0/1160886776 wait complete. 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd7415740 20 client.6270 trim_cache size 0 max 16384 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:45:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 6117, 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 4.5540729689999999, 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 36, 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 73, 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 73, 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 9.6349973989999995 2024-09-15T22:45:03.271 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 msgr2=0x7f8fb806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 0x7f8fb806ead0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc033000 tx=0x7f8fbc009000 comp rx=0 tx=0).stop 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 msgr2=0x7f8fcc157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4001eb0 tx=0x7f8fc400c870 comp rx=0 tx=0).stop 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 shutdown_connections 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f8fb806c610 0x7f8fb806ead0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fcc15ce80 0x7f8fcc157530 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fcc15ca40 0x7f8fcc073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 --2- 172.21.15.134:0/28826988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fcc0d02a0 0x7f8fcc14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 >> 172.21.15.134:0/28826988 conn(0x7f8fcc062cc0 msgr2=0x7f8fcc0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 shutdown_connections 2024-09-15T22:45:03.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.263+0000 7f8fd4674640 1 -- 172.21.15.134:0/28826988 wait complete. 2024-09-15T22:45:03.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:45:03.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.372+0000 7f76db01e640 1 Processor -- start 2024-09-15T22:45:03.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.372+0000 7f76db01e640 1 -- start start 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76db01e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76d415c180 0x7f76d40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76db01e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d40ce740 con 0x7f76d4073120 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76db01e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d4072640 con 0x7f76d40ce230 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76db01e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f76d4072920 con 0x7f76d415c180 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76d8dba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76d415c180 0x7f76d40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76d8dba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76d415c180 0x7f76d40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38116/0 (socket says 172.21.15.134:38116) 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76d8dba640 1 -- 172.21.15.134:0/1884991133 learned_addr learned my addr 172.21.15.134:0/1884991133 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.373+0000 7f76d95bb640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f76d4073120 0x7f76d406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48044/0 (socket says 172.21.15.134:48044) 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d8dba640 1 -- 172.21.15.134:0/1884991133 >> v1:172.21.15.177:6789/0 conn(0x7f76d40ce230 legacy=0x7f76d40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d8dba640 1 -- 172.21.15.134:0/1884991133 >> v1:172.21.15.134:6789/0 conn(0x7f76d4073120 legacy=0x7f76d406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d8dba640 1 -- 172.21.15.134:0/1884991133 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4072c00 con 0x7f76d415c180 2024-09-15T22:45:03.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d8dba640 1 --2- 172.21.15.134:0/1884991133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d415c180 0x7f76d40cdcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009870 tx=0x7f76c402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924cffcf312b4072 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d37fe640 1 -- 172.21.15.134:0/1884991133 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4037070 con 0x7f76d415c180 2024-09-15T22:45:03.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d37fe640 1 -- 172.21.15.134:0/1884991133 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4032440 con 0x7f76d415c180 2024-09-15T22:45:03.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.374+0000 7f76d37fe640 1 -- 172.21.15.134:0/1884991133 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4032810 con 0x7f76d415c180 2024-09-15T22:45:03.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 -- 172.21.15.134:0/1884991133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d415c180 msgr2=0x7f76d40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 --2- 172.21.15.134:0/1884991133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d415c180 0x7f76d40cdcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009870 tx=0x7f76c402a210 comp rx=0 tx=0).stop 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 -- 172.21.15.134:0/1884991133 shutdown_connections 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 --2- 172.21.15.134:0/1884991133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d415c180 0x7f76d40cdcf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 -- 172.21.15.134:0/1884991133 >> 172.21.15.134:0/1884991133 conn(0x7f76d4062cc0 msgr2=0x7f76d406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 -- 172.21.15.134:0/1884991133 shutdown_connections 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.375+0000 7f76db01e640 1 -- 172.21.15.134:0/1884991133 wait complete. 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.376+0000 7f76db01e640 1 Processor -- start 2024-09-15T22:45:03.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.376+0000 7f76db01e640 1 -- start start 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76d4073120 0x7f76d414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76d415c180 0x7f76d406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40cf780 con 0x7f76d40ce230 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40722f0 con 0x7f76d415c180 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76db01e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f76d415c560 con 0x7f76d4073120 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38130/0 (socket says 172.21.15.134:38130) 2024-09-15T22:45:03.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 -- 172.21.15.134:0/3928161013 learned_addr learned my addr 172.21.15.134:0/3928161013 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 -- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76d4073120 msgr2=0x7f76d414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76d4073120 0x7f76d414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 -- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76d415c180 msgr2=0x7f76d406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76d415c180 0x7f76d406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.377+0000 7f76d3fff640 1 -- 172.21.15.134:0/3928161013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d40c6410 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76d3fff640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c430 tx=0x7f76c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011790 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c8017070 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d40c66f0 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011bb0 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.378+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41f21d0 con 0x7f76d40ce230 2024-09-15T22:45:03.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.379+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d40cdcf0 con 0x7f76d40ce230 2024-09-15T22:45:03.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.379+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f76c801c460 con 0x7f76d40ce230 2024-09-15T22:45:03.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.380+0000 7f76d17fa640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 0x7f76c006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.380+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f76c808b700 con 0x7f76d40ce230 2024-09-15T22:45:03.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.380+0000 7f76d8dba640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 0x7f76c006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.380+0000 7f76d8dba640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 0x7f76c006ead0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f76c4034000 tx=0x7f76c402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.384+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76c8059b30 con 0x7f76d40ce230 2024-09-15T22:45:03.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.583+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76d415f670 con 0x7f76d40ce230 2024-09-15T22:45:03.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.583+0000 7f76d17fa640 1 -- 172.21.15.134:0/3928161013 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f76c8059430 con 0x7f76d40ce230 2024-09-15T22:45:03.585 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 msgr2=0x7f76c006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 0x7f76c006ead0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f76c4034000 tx=0x7f76c402c000 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 msgr2=0x7f76d406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c430 tx=0x7f76c800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 shutdown_connections 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f76c006c610 0x7f76c006ead0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76d415c180 0x7f76d406c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d40ce230 0x7f76d406bba0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 --2- 172.21.15.134:0/3928161013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76d4073120 0x7f76d414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 >> 172.21.15.134:0/3928161013 conn(0x7f76d4062cc0 msgr2=0x7f76d40cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 shutdown_connections 2024-09-15T22:45:03.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03.585+0000 7f76db01e640 1 -- 172.21.15.134:0/3928161013 wait complete. 2024-09-15T22:45:03.597 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:45:03.597 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:03.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:03.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:03.598 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:45:03.614 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:45:03.615 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42589sec preferred_lft 42589sec 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:45:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:03.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:03.617 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:03.679 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:45:03.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:03.681 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:45:03.736 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:45:03.737 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:03.737 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:03.737 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:03.737 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:03.737 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:03.737 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:45:03.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:03.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:03.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:03.738 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:45:03.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:03.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:03.862 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:45:03.878 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:45:03.878 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:45:03.878 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:03.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:03.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:45:03.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:03.943 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:03.970 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:45:03.968+0000 7f935ca7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:45:03.985 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:03.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:03.985 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:04.040 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:45:04.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:04.123 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:04.123 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:04.124 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:04.132 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:04.132 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:04.132 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:04.132 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:04.132 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:04.139 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:45:04.140 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:45:04.141 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:45:04.141 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:45:04.141 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:45:04.141 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:45:04.142 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:45:04.142 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:45:04.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:04.209 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:04.308 INFO:teuthology.orchestra.run.smithi134.stdout:client5794 2024-09-15T22:45:04.309 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:04.309 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:04.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:45:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.463+0000 7fa00db4b640 1 Processor -- start 2024-09-15T22:45:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.463+0000 7fa00db4b640 1 -- start start 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa00db4b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa00815c180 0x7fa0080cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa00db4b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa008073120 0x7fa008073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa00db4b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0080ce740 con 0x7fa0080ce230 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa00db4b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa008072640 con 0x7fa00815c180 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa00db4b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa008072920 con 0x7fa008073120 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa0077fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa00815c180 0x7fa0080cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa0077fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa00815c180 0x7fa0080cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38146/0 (socket says 172.21.15.134:38146) 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.464+0000 7fa0077fe640 1 -- 172.21.15.134:0/1406719510 learned_addr learned my addr 172.21.15.134:0/1406719510 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0077fe640 1 -- 172.21.15.134:0/1406719510 >> v2:172.21.15.177:3300/0 conn(0x7fa008073120 msgr2=0x7fa008073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa007fff640 1 --2- 172.21.15.134:0/1406719510 >> v2:172.21.15.177:3300/0 conn(0x7fa008073120 0x7fa008073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0077fe640 1 --2- 172.21.15.134:0/1406719510 >> v2:172.21.15.177:3300/0 conn(0x7fa008073120 0x7fa008073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0077fe640 1 -- 172.21.15.134:0/1406719510 >> v1:172.21.15.177:6789/0 conn(0x7fa0080ce230 legacy=0x7fa0080cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0077fe640 1 -- 172.21.15.134:0/1406719510 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa008072c00 con 0x7fa00815c180 2024-09-15T22:45:04.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0077fe640 1 --2- 172.21.15.134:0/1406719510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080cdcf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cd0a0 tx=0x7f9ff802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3fd47d6a3305c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:04.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.465+0000 7fa0067fc640 1 -- 172.21.15.134:0/1406719510 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037070 con 0x7fa00815c180 2024-09-15T22:45:04.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa0067fc640 1 -- 172.21.15.134:0/1406719510 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8032440 con 0x7fa00815c180 2024-09-15T22:45:04.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa0067fc640 1 -- 172.21.15.134:0/1406719510 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032810 con 0x7fa00815c180 2024-09-15T22:45:04.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 -- 172.21.15.134:0/1406719510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 msgr2=0x7fa0080cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 --2- 172.21.15.134:0/1406719510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080cdcf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cd0a0 tx=0x7f9ff802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 -- 172.21.15.134:0/1406719510 shutdown_connections 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 --2- 172.21.15.134:0/1406719510 >> v2:172.21.15.177:3300/0 conn(0x7fa008073120 0x7fa008073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 --2- 172.21.15.134:0/1406719510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080cdcf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 -- 172.21.15.134:0/1406719510 >> 172.21.15.134:0/1406719510 conn(0x7fa008062cc0 msgr2=0x7fa00806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 -- 172.21.15.134:0/1406719510 shutdown_connections 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.466+0000 7fa00db4b640 1 -- 172.21.15.134:0/1406719510 wait complete. 2024-09-15T22:45:04.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.467+0000 7fa00db4b640 1 Processor -- start 2024-09-15T22:45:04.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.467+0000 7fa00db4b640 1 -- start start 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa008073120 0x7fa00815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0080ce230 0x7fa00815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0080cf780 con 0x7fa00815c180 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa0080722f0 con 0x7fa008073120 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa00db4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa00815c560 con 0x7fa0080ce230 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38154/0 (socket says 172.21.15.134:38154) 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 -- 172.21.15.134:0/2320095433 learned_addr learned my addr 172.21.15.134:0/2320095433 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 -- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0080ce230 msgr2=0x7fa00815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0080ce230 0x7fa00815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa007fff640 1 -- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa008073120 msgr2=0x7fa00815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.468+0000 7fa0077fe640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa008073120 0x7fa00815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7fa007fff640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa008073120 0x7fa00815acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7fa007fff640 1 -- 172.21.15.134:0/2320095433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00815ec50 con 0x7fa00815c180 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7fa007fff640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa00000cc60 tx=0x7fa00000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000003990 con 0x7fa00815c180 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa000003b30 con 0x7fa00815c180 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000004020 con 0x7fa00815c180 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00815eef0 con 0x7fa00815c180 2024-09-15T22:45:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.469+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00815f4b0 con 0x7fa00815c180 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.470+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0081e6f10 con 0x7fa00815c180 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.470+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fa0000041c0 con 0x7fa00815c180 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.471+0000 7f9feffff640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 0x7f9ff406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.471+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fa00008c040 con 0x7fa00815c180 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.471+0000 7fa0077fe640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 0x7f9ff406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.471+0000 7fa0077fe640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 0x7f9ff406ead0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.475+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa000014030 con 0x7fa00815c180 2024-09-15T22:45:04.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.678+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0081571d0 con 0x7fa00815c180 2024-09-15T22:45:04.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.679+0000 7f9feffff640 1 -- 172.21.15.134:0/2320095433 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7fa00005a190 con 0x7fa00815c180 2024-09-15T22:45:04.680 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 msgr2=0x7f9ff406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 0x7f9ff406ead0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 msgr2=0x7fa0080b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa00000cc60 tx=0x7fa00000a5c0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 shutdown_connections 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f9ff406c610 0x7f9ff406ead0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa00815c180 0x7fa0080b3440 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0080ce230 0x7fa00815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 --2- 172.21.15.134:0/2320095433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa008073120 0x7fa00815acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 >> 172.21.15.134:0/2320095433 conn(0x7fa008062cc0 msgr2=0x7fa0080b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:04.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 shutdown_connections 2024-09-15T22:45:04.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:04.681+0000 7fa00db4b640 1 -- 172.21.15.134:0/2320095433 wait complete. 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:04.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:04.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.695 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:04.715 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42578sec preferred_lft 42578sec 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:45:04.716 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:45:04.717 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:04.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.718 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:04.783 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:45:04.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.785 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:45:04.843 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:45:04.844 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:04.844 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:04.844 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:04.844 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:04.844 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:04.844 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:45:04.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:04.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:04.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:04.845 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:45:04.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:04.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:04.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.977 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:45:04.993 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:45:04.993 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:45:04.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:04.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:04.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:45:05.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:05.059 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:05.114 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:05.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:05.115 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:05.170 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:45:05.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:05.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:05.254 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:05.254 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:05.255 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:05.263 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:05.263 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:05.263 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:05.263 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:05.264 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:45:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:45:05.269 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:45:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:45:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:45:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:45:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:45:05.270 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:45:05.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:05.270 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:05.336 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:05.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:05.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:05.432 INFO:teuthology.orchestra.run.smithi177.stdout:client5797 2024-09-15T22:45:05.432 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:05.432 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:05.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:45:05.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.560+0000 7fa6bdb6d640 1 Processor -- start 2024-09-15T22:45:05.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.560+0000 7fa6bdb6d640 1 -- start start 2024-09-15T22:45:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b8072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 0x7fa6b806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6b806ef60 0x7fa6b8071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b815fef0 con 0x7fa6b806ef60 2024-09-15T22:45:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b815c970 con 0x7fa6b815f9f0 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6bdb6d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b815bbb0 con 0x7fa6b815b370 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6b806ef60 0x7fa6b8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6b806ef60 0x7fa6b8071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38164/0 (socket says 172.21.15.134:38164) 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 -- 172.21.15.134:0/832526270 learned_addr learned my addr 172.21.15.134:0/832526270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b77fe640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6aeffd640 1 --2- 172.21.15.134:0/832526270 >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 0x7fa6b806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 -- 172.21.15.134:0/832526270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 msgr2=0x7fa6b8072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b8072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 -- 172.21.15.134:0/832526270 >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 msgr2=0x7fa6b806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/832526270 >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 0x7fa6b806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b7fff640 1 -- 172.21.15.134:0/832526270 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b815be90 con 0x7fa6b806ef60 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6b77fe640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b8072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.561+0000 7fa6aeffd640 1 --2- 172.21.15.134:0/832526270 >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 0x7fa6b806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:05.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b806ef60 0x7fa6b8071040 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa6b806cb80 tx=0x7fa6b002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4921dd27783235a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:05.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6b6ffd640 1 -- 172.21.15.134:0/832526270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0036070 con 0x7fa6b806ef60 2024-09-15T22:45:05.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6b6ffd640 1 -- 172.21.15.134:0/832526270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b0031600 con 0x7fa6b806ef60 2024-09-15T22:45:05.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6b6ffd640 1 -- 172.21.15.134:0/832526270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00319d0 con 0x7fa6b806ef60 2024-09-15T22:45:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/832526270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b806ef60 msgr2=0x7fa6b8071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.562+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b806ef60 0x7fa6b8071040 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa6b806cb80 tx=0x7fa6b002a610 comp rx=0 tx=0).stop 2024-09-15T22:45:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/832526270 shutdown_connections 2024-09-15T22:45:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b806ef60 0x7fa6b8071040 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/832526270 >> v2:172.21.15.177:3300/0 conn(0x7fa6b815f9f0 0x7fa6b806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/832526270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b8072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/832526270 >> 172.21.15.134:0/832526270 conn(0x7fa6b806bba0 msgr2=0x7fa6b806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/832526270 shutdown_connections 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.563+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/832526270 wait complete. 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.564+0000 7fa6bdb6d640 1 Processor -- start 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.564+0000 7fa6bdb6d640 1 -- start start 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6b806ef60 0x7fa6b8155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b80af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b80731b0 con 0x7fa6b815f9f0 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b815c450 con 0x7fa6b806ef60 2024-09-15T22:45:05.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b815b750 con 0x7fa6b815b370 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38176/0 (socket says 172.21.15.134:38176) 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 -- 172.21.15.134:0/2883331766 learned_addr learned my addr 172.21.15.134:0/2883331766 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b77fe640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6b806ef60 0x7fa6b8155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6aeffd640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b80af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 -- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 msgr2=0x7fa6b80af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b80af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 -- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6b806ef60 msgr2=0x7fa6b8155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6b806ef60 0x7fa6b8155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 -- 172.21.15.134:0/2883331766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b81f4510 con 0x7fa6b815f9f0 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b7fff640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009f40 tx=0x7fa6b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:05.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0036050 con 0x7fa6b815f9f0 2024-09-15T22:45:05.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b0042070 con 0x7fa6b815f9f0 2024-09-15T22:45:05.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b81f47f0 con 0x7fa6b815f9f0 2024-09-15T22:45:05.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.565+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0009510 con 0x7fa6b815f9f0 2024-09-15T22:45:05.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.566+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b81f4db0 con 0x7fa6b815f9f0 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.567+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b806ea20 con 0x7fa6b815f9f0 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.567+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fa6b0007bf0 con 0x7fa6b815f9f0 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.567+0000 7fa6b4ff9640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 0x7fa69806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.568+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fa6b00ac830 con 0x7fa6b815f9f0 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.568+0000 7fa6b77fe640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 0x7fa69806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:05.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.568+0000 7fa6b77fe640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 0x7fa69806ead0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8006fd0 tx=0x7fa6a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:05.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.572+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6b0045360 con 0x7fa6b815f9f0 2024-09-15T22:45:05.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:05.777+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa6b81f7760 con 0x7fa6b815f9f0 2024-09-15T22:45:06.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.763+0000 7fa6b4ff9640 1 -- 172.21.15.134:0/2883331766 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v37) ==== 136+0+0 (secure 0 0 0) 0x7fa6b007ab10 con 0x7fa6b815f9f0 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 msgr2=0x7fa69806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 0x7fa69806ead0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8006fd0 tx=0x7fa6a8008040 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 msgr2=0x7fa6b81575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009f40 tx=0x7fa6b0004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 shutdown_connections 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fa69806c610 0x7fa69806ead0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6b815f9f0 0x7fa6b81575c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6b815b370 0x7fa6b80af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 --2- 172.21.15.134:0/2883331766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6b806ef60 0x7fa6b8155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 >> 172.21.15.134:0/2883331766 conn(0x7fa6b806bba0 msgr2=0x7fa6b80b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:06.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.766+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 shutdown_connections 2024-09-15T22:45:06.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.767+0000 7fa6bdb6d640 1 -- 172.21.15.134:0/2883331766 wait complete. 2024-09-15T22:45:06.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:45:06.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.889+0000 7fb15dc23640 1 Processor -- start 2024-09-15T22:45:06.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.889+0000 7fb15dc23640 1 -- start start 2024-09-15T22:45:06.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb15dc23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb1581594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb15dc23640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15815d390 con 0x7fb1580d02a0 2024-09-15T22:45:06.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb15dc23640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15815d670 con 0x7fb15815ca40 2024-09-15T22:45:06.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb15dc23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb15815d950 con 0x7fb15815ceb0 2024-09-15T22:45:06.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb1577fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb1580d02a0 0x7fb1580d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43024/0 (socket says 172.21.15.134:43024) 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb1577fe640 1 -- 172.21.15.134:0/467074170 learned_addr learned my addr 172.21.15.134:0/467074170 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998488092 0 0) 0x7fb15815d390 con 0x7fb1580d02a0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb157fff640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb1581594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.890+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb140003520 con 0x7fb1580d02a0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3833472748 0 0) 0x7fb140003520 con 0x7fb1580d02a0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 msgr2=0x7fb1581594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb1581594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 >> v1:172.21.15.177:6789/0 conn(0x7fb15815ca40 legacy=0x7fb15815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15815dc30 con 0x7fb1580d02a0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb1480019f0 con 0x7fb1580d02a0 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 >> v1:172.21.15.134:6789/0 conn(0x7fb1580d02a0 legacy=0x7fb1580d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1400039e0 0x7fb140003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb140004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb140004d40 0x7fb1400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb15815d950 con 0x7fb1400039e0 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb14000ba70 con 0x7fb140004d40 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb14000bc70 con 0x7fb15815ceb0 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1400039e0 0x7fb140003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb156ffd640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb140004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb157fff640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb140004d40 0x7fb1400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 -- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 msgr2=0x7fb140004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb15815ceb0 0x7fb140004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 -- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb140004d40 msgr2=0x7fb1400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb140004d40 0x7fb1400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb1577fe640 1 -- 172.21.15.134:0/467074170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb140003520 con 0x7fb1400039e0 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.891+0000 7fb157fff640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb140004d40 0x7fb1400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb1577fe640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1400039e0 0x7fb140003dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb14800a920 tx=0x7fb140005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126c6471cabbb381 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14800a4c0 con 0x7fb1400039e0 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14802f070 con 0x7fb1400039e0 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb1567fc640 1 -- 172.21.15.134:0/467074170 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14802bd00 con 0x7fb1400039e0 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb15dc23640 1 -- 172.21.15.134:0/467074170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1400039e0 msgr2=0x7fb140003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb15dc23640 1 --2- 172.21.15.134:0/467074170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1400039e0 0x7fb140003dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb14800a920 tx=0x7fb140005830 comp rx=0 tx=0).stop 2024-09-15T22:45:06.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb157fff640 1 -- 172.21.15.134:0/467074170 reap_dead start 2024-09-15T22:45:06.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb15dc23640 1 -- 172.21.15.134:0/467074170 shutdown_connections 2024-09-15T22:45:06.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.892+0000 7fb15dc23640 1 -- 172.21.15.134:0/467074170 >> 172.21.15.134:0/467074170 conn(0x7fb158062cc0 msgr2=0x7fb15806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:06.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.893+0000 7fb15dc23640 1 -- 172.21.15.134:0/467074170 shutdown_connections 2024-09-15T22:45:06.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.893+0000 7fb15dc23640 1 -- 172.21.15.134:0/467074170 wait complete. 2024-09-15T22:45:06.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.894+0000 7fb15dc23640 1 Processor -- start 2024-09-15T22:45:06.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.894+0000 7fb15dc23640 1 -- start start 2024-09-15T22:45:06.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1400039e0 0x7fb158146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb158158b30 0x7fb158073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb158155b90 con 0x7fb158073670 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb15815eb40 con 0x7fb1400039e0 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb158155d10 con 0x7fb158158b30 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58926/0 (socket says 172.21.15.134:58926) 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 -- 172.21.15.134:0/382672546 learned_addr learned my addr 172.21.15.134:0/382672546 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:06.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb156ffd640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb158158b30 0x7fb158073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb1577fe640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1400039e0 0x7fb158146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 -- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb158158b30 msgr2=0x7fb158073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb158158b30 0x7fb158073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 -- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1400039e0 msgr2=0x7fb158146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1400039e0 0x7fb158146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 -- 172.21.15.134:0/382672546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb158071df0 con 0x7fb158073670 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb157fff640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb15806cd40 tx=0x7fb150011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150019020 con 0x7fb158073670 2024-09-15T22:45:06.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb150004460 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150003850 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1580720d0 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.895+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb158072690 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.896+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb158073af0 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.897+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fb15001c020 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.897+0000 7fb13ffff640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 0x7fb14406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.898+0000 7fb1577fe640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 0x7fb14406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.898+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fb15008bbd0 con 0x7fb158073670 2024-09-15T22:45:06.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.898+0000 7fb1577fe640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 0x7fb14406eb00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb148033000 tx=0x7fb148009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:06.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:06.902+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb158073af0 con 0x7fb158073670 2024-09-15T22:45:07.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.092+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fb1580b4790 con 0x7fb14406c640 2024-09-15T22:45:07.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.093+0000 7fb13ffff640 1 -- 172.21.15.134:0/382672546 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fb1580b4790 con 0x7fb14406c640 2024-09-15T22:45:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:45:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:45:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:45:07.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 msgr2=0x7fb14406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 0x7fb14406eb00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb148033000 tx=0x7fb148009030 comp rx=0 tx=0).stop 2024-09-15T22:45:07.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 msgr2=0x7fb1581f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb15806cd40 tx=0x7fb150011920 comp rx=0 tx=0).stop 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 shutdown_connections 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fb14406c640 0x7fb14406eb00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb158073670 0x7fb1581f5a40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb158158b30 0x7fb158073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 --2- 172.21.15.134:0/382672546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1400039e0 0x7fb158146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 >> 172.21.15.134:0/382672546 conn(0x7fb158062cc0 msgr2=0x7fb1581516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 shutdown_connections 2024-09-15T22:45:07.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.096+0000 7fb15dc23640 1 -- 172.21.15.134:0/382672546 wait complete. 2024-09-15T22:45:07.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:45:07.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.209+0000 7f32beac9640 1 Processor -- start 2024-09-15T22:45:07.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.209+0000 7f32beac9640 1 -- start start 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32beac9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32b8148020 0x7f32b80b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32beac9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b8148400 con 0x7f32b80b4b90 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32beac9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b80b53e0 con 0x7f32b80ae8e0 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32beac9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f32b80b5ff0 con 0x7f32b8148020 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32bc865640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32b8148020 0x7f32b80b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32b7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f32b80b4b90 0x7f32b80b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43032/0 (socket says 172.21.15.134:43032) 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32bc865640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32b8148020 0x7f32b80b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58940/0 (socket says 172.21.15.134:58940) 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32b7fff640 1 -- 172.21.15.134:0/2194483241 learned_addr learned my addr 172.21.15.134:0/2194483241 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32bc865640 1 -- 172.21.15.134:0/2194483241 >> v1:172.21.15.177:6789/0 conn(0x7f32b80ae8e0 legacy=0x7f32b80aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32bc865640 1 -- 172.21.15.134:0/2194483241 >> v1:172.21.15.134:6789/0 conn(0x7f32b80b4b90 legacy=0x7f32b80b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32bc865640 1 -- 172.21.15.134:0/2194483241 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b80b56c0 con 0x7f32b8148020 2024-09-15T22:45:07.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.210+0000 7f32b77fe640 1 -- 172.21.15.134:0/2194483241 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269179237 0 0) 0x7f32b8148400 con 0x7f32b80b4b90 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.211+0000 7f32bc865640 1 --2- 172.21.15.134:0/2194483241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b8148020 0x7f32b80b0b30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097a0 tx=0x7f32ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d875c5ded6b652 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.211+0000 7f32b77fe640 1 -- 172.21.15.134:0/2194483241 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac037070 con 0x7f32b8148020 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.211+0000 7f32b77fe640 1 -- 172.21.15.134:0/2194483241 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac032440 con 0x7f32b8148020 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.211+0000 7f32b77fe640 1 -- 172.21.15.134:0/2194483241 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac032810 con 0x7f32b8148020 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 -- 172.21.15.134:0/2194483241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b8148020 msgr2=0x7f32b80b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 --2- 172.21.15.134:0/2194483241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b8148020 0x7f32b80b0b30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097a0 tx=0x7f32ac02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 -- 172.21.15.134:0/2194483241 shutdown_connections 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 --2- 172.21.15.134:0/2194483241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b8148020 0x7f32b80b0b30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 -- 172.21.15.134:0/2194483241 >> 172.21.15.134:0/2194483241 conn(0x7f32b806d0d0 msgr2=0x7f32b806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 -- 172.21.15.134:0/2194483241 shutdown_connections 2024-09-15T22:45:07.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.212+0000 7f32beac9640 1 -- 172.21.15.134:0/2194483241 wait complete. 2024-09-15T22:45:07.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.213+0000 7f32beac9640 1 Processor -- start 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.213+0000 7f32beac9640 1 -- start start 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 0x7f32b80d0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b8148020 0x7f32b80b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32b80b5000 con 0x7f32b80b4b90 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32b80b5c80 con 0x7f32b8148020 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32beac9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f32b80b5180 con 0x7f32b80ae8e0 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58956/0 (socket says 172.21.15.134:58956) 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 -- 172.21.15.134:0/3841700590 learned_addr learned my addr 172.21.15.134:0/3841700590 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32bc865640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 0x7f32b80d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32bd066640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b8148020 0x7f32b80b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 -- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 msgr2=0x7f32b80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 0x7f32b80d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 -- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b8148020 msgr2=0x7f32b80b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b8148020 0x7f32b80b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32b7fff640 1 -- 172.21.15.134:0/3841700590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b8141420 con 0x7f32b80b4b90 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.214+0000 7f32bc865640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 0x7f32b80d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:07.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32b7fff640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c4a0 tx=0x7f32a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4018070 con 0x7f32b80b4b90 2024-09-15T22:45:07.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40074e0 con 0x7f32b80b4b90 2024-09-15T22:45:07.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b8144ac0 con 0x7f32b80b4b90 2024-09-15T22:45:07.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4004a20 con 0x7f32b80b4b90 2024-09-15T22:45:07.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.215+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b8143d00 con 0x7f32b80b4b90 2024-09-15T22:45:07.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.216+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b8072440 con 0x7f32b80b4b90 2024-09-15T22:45:07.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.216+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f32a401b070 con 0x7f32b80b4b90 2024-09-15T22:45:07.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.217+0000 7f32b57fa640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 0x7f329c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.217+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f32a408adb0 con 0x7f32b80b4b90 2024-09-15T22:45:07.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.217+0000 7f32bc865640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 0x7f329c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.217+0000 7f32bc865640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 0x7f329c06ead0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f32ac034000 tx=0x7f32ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.221+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32b8072440 con 0x7f32b80b4b90 2024-09-15T22:45:07.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.386+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f32b80b0b30 con 0x7f32b80b4b90 2024-09-15T22:45:07.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.387+0000 7f32b57fa640 1 -- 172.21.15.134:0/3841700590 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f32a4058f80 con 0x7f32b80b4b90 2024-09-15T22:45:07.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.388+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 msgr2=0x7f329c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.388+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 0x7f329c06ead0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f32ac034000 tx=0x7f32ac02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.388+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 msgr2=0x7f32b80b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.388+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c4a0 tx=0x7f32a400c960 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 shutdown_connections 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f329c06c610 0x7f329c06ead0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b8148020 0x7f32b80b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32b80b4b90 0x7f32b80b1740 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 --2- 172.21.15.134:0/3841700590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b80ae8e0 0x7f32b80d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 >> 172.21.15.134:0/3841700590 conn(0x7f32b806d0d0 msgr2=0x7f32b806f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 shutdown_connections 2024-09-15T22:45:07.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.389+0000 7f32beac9640 1 -- 172.21.15.134:0/3841700590 wait complete. 2024-09-15T22:45:07.401 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:07.401 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:07.417 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:07.417 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:07.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:45:07.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.613+0000 7fd51aec9640 1 Processor -- start 2024-09-15T22:45:07.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.613+0000 7fd51aec9640 1 -- start start 2024-09-15T22:45:07.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd51aec9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd51415c620 0x7fd5140d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd51aec9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140b77f0 con 0x7fd514073ff0 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd51aec9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140d2cf0 con 0x7fd5140b4530 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd51aec9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd51415ca00 con 0x7fd51415c620 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd50bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd514073ff0 0x7fd5140b70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43038/0 (socket says 172.21.15.134:43038) 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd50bfff640 1 -- 172.21.15.134:0/318744915 learned_addr learned my addr 172.21.15.134:0/318744915 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd518c65640 1 --2- 172.21.15.134:0/318744915 >> v2:172.21.15.177:3300/0 conn(0x7fd51415c620 0x7fd5140d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718458303 0 0) 0x7fd5140b77f0 con 0x7fd514073ff0 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.614+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc003520 con 0x7fd514073ff0 2024-09-15T22:45:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3959365504 0 0) 0x7fd4fc003520 con 0x7fd514073ff0 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd518c65640 1 -- 172.21.15.134:0/318744915 >> v1:172.21.15.177:6789/0 conn(0x7fd5140b4530 legacy=0x7fd5140d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd518c65640 1 -- 172.21.15.134:0/318744915 >> v1:172.21.15.134:6789/0 conn(0x7fd514073ff0 legacy=0x7fd5140b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd518c65640 1 -- 172.21.15.134:0/318744915 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140d2fd0 con 0x7fd51415c620 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd518c65640 1 --2- 172.21.15.134:0/318744915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd5140d2380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd5100097a0 tx=0x7fd51002a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17079d370da6f02c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.615+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510037070 con 0x7fd51415c620 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51002aad0 con 0x7fd51415c620 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd50b7fe640 1 -- 172.21.15.134:0/318744915 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504001670 con 0x7fd51415c620 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 -- 172.21.15.134:0/318744915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 msgr2=0x7fd5140d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 --2- 172.21.15.134:0/318744915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd5140d2380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd5100097a0 tx=0x7fd51002a040 comp rx=0 tx=0).stop 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 -- 172.21.15.134:0/318744915 shutdown_connections 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 --2- 172.21.15.134:0/318744915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd5140d2380 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 -- 172.21.15.134:0/318744915 >> 172.21.15.134:0/318744915 conn(0x7fd514062810 msgr2=0x7fd514062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:07.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 -- 172.21.15.134:0/318744915 shutdown_connections 2024-09-15T22:45:07.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.616+0000 7fd51aec9640 1 -- 172.21.15.134:0/318744915 wait complete. 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.617+0000 7fd51aec9640 1 Processor -- start 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.617+0000 7fd51aec9640 1 -- start start 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 0x7fd51415f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd51415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140b68e0 con 0x7fd514073ff0 2024-09-15T22:45:07.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140b6c50 con 0x7fd51415c620 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd51aec9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5140d28c0 con 0x7fd5140b4530 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd518c65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd518c65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58962/0 (socket says 172.21.15.134:58962) 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd518c65640 1 -- 172.21.15.134:0/898886982 learned_addr learned my addr 172.21.15.134:0/898886982 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd519466640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd51415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd518c65640 1 -- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 msgr2=0x7fd51415f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd50bfff640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 0x7fd51415f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.618+0000 7fd518c65640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 0x7fd51415f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd518c65640 1 -- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 msgr2=0x7fd51415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd518c65640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd51415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd518c65640 1 -- 172.21.15.134:0/898886982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51415e910 con 0x7fd514073ff0 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd519466640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd51415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd50bfff640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 0x7fd51415f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd518c65640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098c0 tx=0x7fd5100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510037040 con 0x7fd514073ff0 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510004030 con 0x7fd514073ff0 2024-09-15T22:45:07.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510004420 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51415ebf0 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.619+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51415f490 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.620+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51415efe0 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.620+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd51003a040 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.621+0000 7fd5097fa640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 0x7fd50006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.621+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fd5100abde0 con 0x7fd514073ff0 2024-09-15T22:45:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.621+0000 7fd50bfff640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 0x7fd50006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:07.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.621+0000 7fd50bfff640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 0x7fd50006ead0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:07.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.625+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd510042020 con 0x7fd514073ff0 2024-09-15T22:45:07.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.805+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5140d2380 con 0x7fd514073ff0 2024-09-15T22:45:07.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.806+0000 7fd5097fa640 1 -- 172.21.15.134:0/898886982 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7fd51007a040 con 0x7fd514073ff0 2024-09-15T22:45:07.807 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:45:07.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 msgr2=0x7fd50006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 0x7fd50006ead0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).stop 2024-09-15T22:45:07.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 msgr2=0x7fd51415e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098c0 tx=0x7fd5100046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 shutdown_connections 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd50006c610 0x7fd50006ead0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51415c620 0x7fd51415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5140b4530 0x7fd51415f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 --2- 172.21.15.134:0/898886982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514073ff0 0x7fd51415e330 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 >> 172.21.15.134:0/898886982 conn(0x7fd514062810 msgr2=0x7fd5140b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 shutdown_connections 2024-09-15T22:45:07.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:07.808+0000 7fd51aec9640 1 -- 172.21.15.134:0/898886982 wait complete. 2024-09-15T22:45:07.821 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:45:07.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:07.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:07.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:45:07.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:07.850 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:45:07.906 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:07.906 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:07.926 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:07.926 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:07.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:45:08.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.085+0000 7f2a99650640 1 Processor -- start 2024-09-15T22:45:08.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.085+0000 7f2a99650640 1 -- start start 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a99650640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a940cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a99650640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2a940b7aa0 0x7f2a940b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a99650640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a940d34d0 con 0x7f2a940b61f0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a99650640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2a940d3790 con 0x7f2a940b7aa0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a99650640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2a940d3a70 con 0x7f2a9415e860 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a927fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2a940b61f0 0x7f2a940b6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43050/0 (socket says 172.21.15.134:43050) 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a927fc640 1 -- 172.21.15.134:0/3210678509 learned_addr learned my addr 172.21.15.134:0/3210678509 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947711729 0 0) 0x7f2a940d34d0 con 0x7f2a940b61f0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a7c003520 con 0x7f2a940b61f0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a92ffd640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a940cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.086+0000 7f2a937fe640 1 --2- 172.21.15.134:0/3210678509 >> v2:172.21.15.177:3300/0 conn(0x7f2a940b7aa0 0x7f2a940b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 821238741 0 0) 0x7f2a7c003520 con 0x7f2a940b61f0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 msgr2=0x7f2a940cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a940cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 >> v2:172.21.15.177:3300/0 conn(0x7f2a940b7aa0 msgr2=0x7f2a940b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 --2- 172.21.15.134:0/3210678509 >> v2:172.21.15.177:3300/0 conn(0x7f2a940b7aa0 0x7f2a940b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a940d3d50 con 0x7f2a940b61f0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f2a88001670 con 0x7f2a940b61f0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 >> v1:172.21.15.134:6789/0 conn(0x7f2a940b61f0 legacy=0x7f2a940b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a7c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a7c004d40 0x7f2a7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940d3790 con 0x7f2a7c003f30 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940d3a70 con 0x7f2a7c004d40 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c00b9f0 con 0x7f2a9415e860 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a92ffd640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a7c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a937fe640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a7c004d40 0x7f2a7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 -- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 msgr2=0x7f2a7c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a9415e860 0x7f2a7c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 -- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a7c004d40 msgr2=0x7f2a7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a7c004d40 0x7f2a7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.087+0000 7f2a927fc640 1 -- 172.21.15.134:0/3210678509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c003520 con 0x7f2a7c003f30 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.088+0000 7f2a927fc640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a7c004800 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2a940d52f0 tx=0x7f2a7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f899c9e88ed04f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.088+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88007d50 con 0x7f2a7c003f30 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.088+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a880058d0 con 0x7f2a7c003f30 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.088+0000 7f2a91ffb640 1 -- 172.21.15.134:0/3210678509 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88005cc0 con 0x7f2a7c003f30 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 -- 172.21.15.134:0/3210678509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 msgr2=0x7f2a7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 --2- 172.21.15.134:0/3210678509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a7c004800 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2a940d52f0 tx=0x7f2a7c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a937fe640 1 -- 172.21.15.134:0/3210678509 reap_dead start 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 -- 172.21.15.134:0/3210678509 shutdown_connections 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 -- 172.21.15.134:0/3210678509 >> 172.21.15.134:0/3210678509 conn(0x7f2a94062c60 msgr2=0x7f2a940d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 -- 172.21.15.134:0/3210678509 shutdown_connections 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.089+0000 7f2a99650640 1 -- 172.21.15.134:0/3210678509 wait complete. 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.090+0000 7f2a99650640 1 Processor -- start 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.090+0000 7f2a99650640 1 -- start start 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a940cb7b0 0x7f2a940cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a940b8530 0x7f2a940b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9415ec40 con 0x7f2a7c003f30 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940d4310 con 0x7f2a940cb7b0 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9415edc0 con 0x7f2a940b8530 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58976/0 (socket says 172.21.15.134:58976) 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 -- 172.21.15.134:0/4227056643 learned_addr learned my addr 172.21.15.134:0/4227056643 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a927fc640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a940cb7b0 0x7f2a940cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a937fe640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a940b8530 0x7f2a940b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 -- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a940b8530 msgr2=0x7f2a940b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a940b8530 0x7f2a940b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 -- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a940cb7b0 msgr2=0x7f2a940cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a940cb7b0 0x7f2a940cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 -- 172.21.15.134:0/4227056643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9414efc0 con 0x7f2a7c003f30 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a92ffd640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2a84011600 tx=0x7f2a84011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400f920 con 0x7f2a7c003f30 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8400fac0 con 0x7f2a7c003f30 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a940cbc40 con 0x7f2a7c003f30 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.091+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400fe70 con 0x7f2a7c003f30 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.092+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a940cc200 con 0x7f2a7c003f30 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.093+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a940b3ad0 con 0x7f2a7c003f30 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.093+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f2a84015460 con 0x7f2a7c003f30 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.093+0000 7f2a7b7fe640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 0x7f2a8006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.094+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5796+0+0 (secure 0 0 0) 0x7f2a8408c2c0 con 0x7f2a7c003f30 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.094+0000 7f2a927fc640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 0x7f2a8006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.094+0000 7f2a927fc640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 0x7f2a8006ead0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a88033000 tx=0x7f2a88009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.098+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a84019030 con 0x7f2a7c003f30 2024-09-15T22:45:08.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.273+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2a940d2700 con 0x7f2a7c003f30 2024-09-15T22:45:08.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.273+0000 7f2a7b7fe640 1 -- 172.21.15.134:0/4227056643 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7f2a8405a5c0 con 0x7f2a7c003f30 2024-09-15T22:45:08.275 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.275+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 msgr2=0x7f2a8006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.275+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 0x7f2a8006ead0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a88033000 tx=0x7f2a88009030 comp rx=0 tx=0).stop 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 msgr2=0x7f2a9414ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2a84011600 tx=0x7f2a84011ac0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 shutdown_connections 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f2a8006c610 0x7f2a8006ead0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a940b8530 0x7f2a940b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a940cb7b0 0x7f2a940cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 --2- 172.21.15.134:0/4227056643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a7c003f30 0x7f2a9414ea80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 >> 172.21.15.134:0/4227056643 conn(0x7f2a94062c60 msgr2=0x7f2a940b9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 shutdown_connections 2024-09-15T22:45:08.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.276+0000 7f2a99650640 1 -- 172.21.15.134:0/4227056643 wait complete. 2024-09-15T22:45:08.288 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:45:08.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:08.288 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:08.322 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:45:08.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:08.323 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:45:08.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.477+0000 7fabfa22e640 1 Processor -- start 2024-09-15T22:45:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.477+0000 7fabfa22e640 1 -- start start 2024-09-15T22:45:08.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabfa22e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fabf40cd300 0x7fabf406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabfa22e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fabf406f010 0x7fabf40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabfa22e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf415ecf0 con 0x7fabf415c300 2024-09-15T22:45:08.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabfa22e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fabf406f480 con 0x7fabf40cd300 2024-09-15T22:45:08.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabfa22e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fabf415c6e0 con 0x7fabf406f010 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fabf40cd300 0x7fabf406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fabf40cd300 0x7fabf406ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58980/0 (socket says 172.21.15.134:58980) 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 -- 172.21.15.134:0/2045004172 learned_addr learned my addr 172.21.15.134:0/2045004172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf3fff640 1 --2- 172.21.15.134:0/2045004172 >> v2:172.21.15.177:3300/0 conn(0x7fabf406f010 0x7fabf40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 -- 172.21.15.134:0/2045004172 >> v2:172.21.15.177:3300/0 conn(0x7fabf406f010 msgr2=0x7fabf40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 --2- 172.21.15.134:0/2045004172 >> v2:172.21.15.177:3300/0 conn(0x7fabf406f010 0x7fabf40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 -- 172.21.15.134:0/2045004172 >> v1:172.21.15.134:6789/0 conn(0x7fabf415c300 legacy=0x7fabf40affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf27fc640 1 -- 172.21.15.134:0/2045004172 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3210331849 0 0) 0x7fabf415ecf0 con 0x7fabf415c300 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.478+0000 7fabf2ffd640 1 -- 172.21.15.134:0/2045004172 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf415efb0 con 0x7fabf40cd300 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabf2ffd640 1 --2- 172.21.15.134:0/2045004172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf40cd300 0x7fabf406ead0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabf40cd030 tx=0x7fabe802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0bce7b50164504 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabf27fc640 1 -- 172.21.15.134:0/2045004172 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8037070 con 0x7fabf40cd300 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabf27fc640 1 -- 172.21.15.134:0/2045004172 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe8032440 con 0x7fabf40cd300 2024-09-15T22:45:08.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabf27fc640 1 -- 172.21.15.134:0/2045004172 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8032810 con 0x7fabf40cd300 2024-09-15T22:45:08.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 -- 172.21.15.134:0/2045004172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf40cd300 msgr2=0x7fabf406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 --2- 172.21.15.134:0/2045004172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf40cd300 0x7fabf406ead0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabf40cd030 tx=0x7fabe802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 -- 172.21.15.134:0/2045004172 shutdown_connections 2024-09-15T22:45:08.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 --2- 172.21.15.134:0/2045004172 >> v2:172.21.15.177:3300/0 conn(0x7fabf406f010 0x7fabf40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 --2- 172.21.15.134:0/2045004172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf40cd300 0x7fabf406ead0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.479+0000 7fabfa22e640 1 -- 172.21.15.134:0/2045004172 >> 172.21.15.134:0/2045004172 conn(0x7fabf406cae0 msgr2=0x7fabf406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.480+0000 7fabfa22e640 1 -- 172.21.15.134:0/2045004172 shutdown_connections 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.480+0000 7fabfa22e640 1 -- 172.21.15.134:0/2045004172 wait complete. 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.481+0000 7fabfa22e640 1 Processor -- start 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.481+0000 7fabfa22e640 1 -- start start 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.481+0000 7fabfa22e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabf406f010 0x7fabf414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 0x7fabf415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fabf415f850 con 0x7fabf415c300 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fabf415f570 con 0x7fabf40cd300 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fabf4071880 con 0x7fabf406f010 2024-09-15T22:45:08.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58992/0 (socket says 172.21.15.134:58992) 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 -- 172.21.15.134:0/4262776297 learned_addr learned my addr 172.21.15.134:0/4262776297 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf2ffd640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 0x7fabf415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 -- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabf406f010 msgr2=0x7fabf414ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf37fe640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabf406f010 0x7fabf414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabf406f010 0x7fabf414ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 -- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 msgr2=0x7fabf415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 0x7fabf415b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 -- 172.21.15.134:0/4262776297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf41f5390 con 0x7fabf415c300 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf2ffd640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 0x7fabf415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabf3fff640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fabec007e60 tx=0x7fabec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec014420 con 0x7fabf415c300 2024-09-15T22:45:08.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec019070 con 0x7fabf415c300 2024-09-15T22:45:08.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec014820 con 0x7fabf415c300 2024-09-15T22:45:08.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf41f4780 con 0x7fabf415c300 2024-09-15T22:45:08.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.482+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41f4d40 con 0x7fabf415c300 2024-09-15T22:45:08.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.483+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf406ead0 con 0x7fabf415c300 2024-09-15T22:45:08.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.484+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fabec0149c0 con 0x7fabf415c300 2024-09-15T22:45:08.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.484+0000 7fabdbfff640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 0x7fabe006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.484+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5796+0+0 (secure 0 0 0) 0x7fabec08c1c0 con 0x7fabf415c300 2024-09-15T22:45:08.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.484+0000 7fabf37fe640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 0x7fabe006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.485+0000 7fabf37fe640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 0x7fabe006ead0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000f60 tx=0x7fabe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.489+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabec05a4c0 con 0x7fabf415c300 2024-09-15T22:45:08.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.688+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabf415e730 con 0x7fabf415c300 2024-09-15T22:45:08.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.689+0000 7fabdbfff640 1 -- 172.21.15.134:0/4262776297 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7fabec059dc0 con 0x7fabf415c300 2024-09-15T22:45:08.691 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:08.691 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:08.691 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:08.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 msgr2=0x7fabe006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 0x7fabe006ead0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000f60 tx=0x7fabe4009040 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 msgr2=0x7fabf415d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fabec007e60 tx=0x7fabec00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 shutdown_connections 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fabe006c610 0x7fabe006ead0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabf415c300 0x7fabf415d0c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabf40cd300 0x7fabf415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 --2- 172.21.15.134:0/4262776297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabf406f010 0x7fabf414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 >> 172.21.15.134:0/4262776297 conn(0x7fabf406cae0 msgr2=0x7fabf40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 shutdown_connections 2024-09-15T22:45:08.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.691+0000 7fabfa22e640 1 -- 172.21.15.134:0/4262776297 wait complete. 2024-09-15T22:45:08.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-15T22:45:08.823 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-09-15T22:45:08.824 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-15T22:45:08.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol50030 2024-09-15T22:45:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.924+0000 7f6c484b7640 1 Processor -- start 2024-09-15T22:45:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.924+0000 7f6c484b7640 1 -- start start 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c484b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c4015d790 0x7f6c400cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c484b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4006d700 con 0x7f6c4015d3b0 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c484b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400cde80 con 0x7f6c400cd3b0 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c484b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4006da30 con 0x7f6c4015d790 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c4015d790 0x7f6c400cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c4015d790 0x7f6c400cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59002/0 (socket says 172.21.15.134:59002) 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c46253640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6c4015d3b0 0x7f6c40071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43060/0 (socket says 172.21.15.134:43060) 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 -- 172.21.15.134:0/558025108 learned_addr learned my addr 172.21.15.134:0/558025108 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 -- 172.21.15.134:0/558025108 >> v1:172.21.15.177:6789/0 conn(0x7f6c400cd3b0 legacy=0x7f6c400cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 -- 172.21.15.134:0/558025108 >> v1:172.21.15.134:6789/0 conn(0x7f6c4015d3b0 legacy=0x7f6c40071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.925+0000 7f6c45a52640 1 -- 172.21.15.134:0/558025108 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c400cd8c0 con 0x7f6c4015d790 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.926+0000 7f6c45a52640 1 --2- 172.21.15.134:0/558025108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4015d790 0x7f6c400cce70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009850 tx=0x7f6c3002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd74a1659250fb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.926+0000 7f6c45251640 1 -- 172.21.15.134:0/558025108 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30004030 con 0x7f6c4015d790 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.926+0000 7f6c45251640 1 -- 172.21.15.134:0/558025108 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c300041d0 con 0x7f6c4015d790 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.926+0000 7f6c45251640 1 -- 172.21.15.134:0/558025108 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30003610 con 0x7f6c4015d790 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 -- 172.21.15.134:0/558025108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4015d790 msgr2=0x7f6c400cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 --2- 172.21.15.134:0/558025108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4015d790 0x7f6c400cce70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009850 tx=0x7f6c3002a290 comp rx=0 tx=0).stop 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 -- 172.21.15.134:0/558025108 shutdown_connections 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 --2- 172.21.15.134:0/558025108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4015d790 0x7f6c400cce70 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 -- 172.21.15.134:0/558025108 >> 172.21.15.134:0/558025108 conn(0x7f6c4006bba0 msgr2=0x7f6c4006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 -- 172.21.15.134:0/558025108 shutdown_connections 2024-09-15T22:45:08.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.927+0000 7f6c484b7640 1 -- 172.21.15.134:0/558025108 wait complete. 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.928+0000 7f6c484b7640 1 Processor -- start 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.928+0000 7f6c484b7640 1 -- start start 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 0x7f6c40152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 0x7f6c4015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4015cd70 con 0x7f6c400cd3b0 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4015cbf0 con 0x7f6c400b5210 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400cfa30 con 0x7f6c4015d3b0 2024-09-15T22:45:08.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59016/0 (socket says 172.21.15.134:59016) 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 -- 172.21.15.134:0/2077056913 learned_addr learned my addr 172.21.15.134:0/2077056913 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c45a52640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 0x7f6c40152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46a54640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 0x7f6c4015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 -- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 msgr2=0x7f6c40152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 0x7f6c40152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 -- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 msgr2=0x7f6c4015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 0x7f6c4015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 -- 172.21.15.134:0/2077056913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c401f8410 con 0x7f6c400cd3b0 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c45a52640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 0x7f6c40152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46a54640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 0x7f6c4015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c46253640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c430 tx=0x7f6c3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0074e0 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c007680 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c004a00 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.929+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c401f86f0 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.930+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401f8cb0 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.930+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c400cec20 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.931+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f6c3c01a020 con 0x7f6c400cd3b0 2024-09-15T22:45:08.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.931+0000 7f6c36ffd640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 0x7f6c2406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.931+0000 7f6c45a52640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 0x7f6c2406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.931+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5796+0+0 (secure 0 0 0) 0x7f6c3c08b1a0 con 0x7f6c400cd3b0 2024-09-15T22:45:08.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.932+0000 7f6c45a52640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 0x7f6c2406eb00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6c30033000 tx=0x7f6c3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:08.936+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c400cec20 con 0x7f6c400cd3b0 2024-09-15T22:45:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.124+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 --> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol50030", "target": ["mon-mgr", ""]}) -- 0x7f6c4006c390 con 0x7f6c2406c640 2024-09-15T22:45:09.130 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:09.129+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:09.131 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:09.129+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:09.131 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:09.129+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:09.131 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:09.129+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:09.131 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:09.129+0000 7fac29aab640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.159+0000 7f6c36ffd640 1 -- 172.21.15.134:0/2077056913 <== mgr.4104 v2:172.21.15.134:6824/210106985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6c4006c390 con 0x7f6c2406c640 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 msgr2=0x7f6c2406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 0x7f6c2406eb00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6c30033000 tx=0x7f6c3002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 msgr2=0x7f6c400adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c430 tx=0x7f6c3c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 shutdown_connections 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f6c2406c640 0x7f6c2406eb00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c400b5210 0x7f6c4015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c4015d3b0 0x7f6c40152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 --2- 172.21.15.134:0/2077056913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c400cd3b0 0x7f6c400adf10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 >> 172.21.15.134:0/2077056913 conn(0x7f6c4006bba0 msgr2=0x7f6c4015efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 shutdown_connections 2024-09-15T22:45:09.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.161+0000 7f6c484b7640 1 -- 172.21.15.134:0/2077056913 wait complete. 2024-09-15T22:45:09.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 Processor -- start 2024-09-15T22:45:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 -- start start 2024-09-15T22:45:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83c415c5e0 0x7f83c40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 0x7f83c40b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c415c9c0 con 0x7f83c40b6d50 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f83c4074100 con 0x7f83c415c5e0 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.272+0000 7f83c9566640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83c40b76d0 con 0x7f83c40b66e0 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83c415c5e0 0x7f83c40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c37fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 0x7f83c40b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c37fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 0x7f83c40b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:48444/0 (socket says 172.21.15.134:48444) 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83bbfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f83c40b6d50 0x7f83c41600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:49864/0 (socket says 172.21.15.134:49864) 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83c415c5e0 0x7f83c40712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:52754/0 (socket says 172.21.15.134:52754) 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c37fe640 1 -- 172.21.15.134:0/366839577 learned_addr learned my addr 172.21.15.134:0/366839577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 -- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 msgr2=0x7f83c40b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 --2- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 0x7f83c40b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 -- 172.21.15.134:0/366839577 >> v1:172.21.15.177:6789/0 conn(0x7f83c40b6d50 legacy=0x7f83c41600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.273+0000 7f83c2ffd640 1 -- 172.21.15.134:0/366839577 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c40b1dd0 con 0x7f83c415c5e0 2024-09-15T22:45:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.274+0000 7f83c2ffd640 1 --2- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c415c5e0 0x7f83c40712b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097a0 tx=0x7f83b402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ac1fb0ebf91619 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.274+0000 7f83c27fc640 1 -- 172.21.15.134:0/366839577 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4037070 con 0x7f83c415c5e0 2024-09-15T22:45:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.274+0000 7f83c27fc640 1 -- 172.21.15.134:0/366839577 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4032440 con 0x7f83c415c5e0 2024-09-15T22:45:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.274+0000 7f83c27fc640 1 -- 172.21.15.134:0/366839577 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4032810 con 0x7f83c415c5e0 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 -- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c415c5e0 msgr2=0x7f83c40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 --2- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c415c5e0 0x7f83c40712b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097a0 tx=0x7f83b402a180 comp rx=0 tx=0).stop 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 -- 172.21.15.134:0/366839577 shutdown_connections 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 --2- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c40b66e0 0x7f83c40b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 --2- 172.21.15.134:0/366839577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c415c5e0 0x7f83c40712b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 -- 172.21.15.134:0/366839577 >> 172.21.15.134:0/366839577 conn(0x7f83c40b4220 msgr2=0x7f83c40b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 -- 172.21.15.134:0/366839577 shutdown_connections 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.275+0000 7f83c9566640 1 -- 172.21.15.134:0/366839577 wait complete. 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.276+0000 7f83c9566640 1 Processor -- start 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.276+0000 7f83c9566640 1 -- start start 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c40b6d50 0x7f83c4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c415c5e0 0x7f83c415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4073ab0 con 0x7f83c40b66e0 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83c40737d0 con 0x7f83c40b6d50 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c9566640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83c4073d90 con 0x7f83c415c5e0 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59024/0 (socket says 172.21.15.134:59024) 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 -- 172.21.15.134:0/2136634758 learned_addr learned my addr 172.21.15.134:0/2136634758 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c37fe640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c415c5e0 0x7f83c415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83bbfff640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c40b6d50 0x7f83c4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 -- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c415c5e0 msgr2=0x7f83c415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c415c5e0 0x7f83c415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 -- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c40b6d50 msgr2=0x7f83c4153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c40b6d50 0x7f83c4153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 -- 172.21.15.134:0/2136634758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4152330 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83c2ffd640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f83b40096f0 tx=0x7f83b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.277+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4037040 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.278+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4030500 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.278+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b40308d0 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.278+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c415bca0 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.278+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c4158e60 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.279+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c4069190 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.279+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7f83b4044020 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.279+0000 7f83bb7fe640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 0x7f83a406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.280+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5796+0+0 (secure 0 0 0) 0x7f83b40ab8b0 con 0x7f83c40b66e0 2024-09-15T22:45:09.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.280+0000 7f83bbfff640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 0x7f83a406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.280+0000 7f83bbfff640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 0x7f83a406ead0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f83c40b61f0 tx=0x7f83ac007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.284+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83b404b020 con 0x7f83c40b66e0 2024-09-15T22:45:09.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.485+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83c4071a60 con 0x7f83c40b66e0 2024-09-15T22:45:09.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.485+0000 7f83bb7fe640 1 -- 172.21.15.134:0/2136634758 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7f83b4079560 con 0x7f83c40b66e0 2024-09-15T22:45:09.487 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:09.487 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:09.487 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 msgr2=0x7f83a406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 0x7f83a406ead0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f83c40b61f0 tx=0x7f83ac007e80 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 msgr2=0x7f83c4151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f83b40096f0 tx=0x7f83b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 shutdown_connections 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7f83a406c610 0x7f83a406ead0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83c415c5e0 0x7f83c415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c40b6d50 0x7f83c4153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 --2- 172.21.15.134:0/2136634758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c40b66e0 0x7f83c4151df0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 >> 172.21.15.134:0/2136634758 conn(0x7f83c40b4220 msgr2=0x7f83c40b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 shutdown_connections 2024-09-15T22:45:09.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.487+0000 7f83c9566640 1 -- 172.21.15.134:0/2136634758 wait complete. 2024-09-15T22:45:09.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-15T22:45:09.616 INFO:teuthology.orchestra.run.smithi134.stdout:[{"id":6342,"entity":{"name":{"type":"client","num":6342},"addr":{"type":"any","addr":"172.21.15.134:0","nonce":1536265329}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.474989033,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.976406925411027,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6342 172.21.15.134:0/1536265329","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"y","hostname":"smithi134","pid":"36524","root":"/"}}] 2024-09-15T22:45:09.617 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi134", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36524", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.134:0", "nonce": 1536265329, "type": "any" }, "name": { "num": 6342, "type": "client" } }, "id": 6342, "inst": "client.6342 172.21.15.134:0/1536265329", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.976406925411027 }, "state": "open", "uptime": 0.474989033 } ] 2024-09-15T22:45:09.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T22:45:09.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.714+0000 7fc859318640 1 Processor -- start 2024-09-15T22:45:09.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.714+0000 7fc859318640 1 -- start start 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc859318640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 0x7fc8540d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc859318640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85415ed20 0x7fc8540d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc859318640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8540b7170 con 0x7fc8540cef90 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc859318640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540d1ae0 con 0x7fc85415ed20 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc859318640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540b7aa0 con 0x7fc85415e940 2024-09-15T22:45:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc84a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85415ed20 0x7fc8540d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc84a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85415ed20 0x7fc8540d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59034/0 (socket says 172.21.15.134:59034) 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc8537fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc8540cef90 0x7fc8540b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43062/0 (socket says 172.21.15.134:43062) 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.715+0000 7fc84a7fc640 1 -- 172.21.15.134:0/3312395697 learned_addr learned my addr 172.21.15.134:0/3312395697 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc852ffd640 1 --2- 172.21.15.134:0/3312395697 >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 0x7fc8540d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc84a7fc640 1 -- 172.21.15.134:0/3312395697 >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 msgr2=0x7fc8540d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc84a7fc640 1 --2- 172.21.15.134:0/3312395697 >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 0x7fc8540d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc8527fc640 1 -- 172.21.15.134:0/3312395697 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314079445 0 0) 0x7fc84c001490 con 0x7fc8540cef90 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc84a7fc640 1 -- 172.21.15.134:0/3312395697 >> v1:172.21.15.134:6789/0 conn(0x7fc8540cef90 legacy=0x7fc8540b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc84a7fc640 1 -- 172.21.15.134:0/3312395697 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8540d3660 con 0x7fc85415ed20 2024-09-15T22:45:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.716+0000 7fc852ffd640 1 --2- 172.21.15.134:0/3312395697 >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 0x7fc8540d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc84a7fc640 1 --2- 172.21.15.134:0/3312395697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415ed20 0x7fc8540d15a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc8540509d0 tx=0x7fc83c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c60889b99d1bd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc8527fc640 1 -- 172.21.15.134:0/3312395697 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c037070 con 0x7fc85415ed20 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc8527fc640 1 -- 172.21.15.134:0/3312395697 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c02ae50 con 0x7fc85415ed20 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc8527fc640 1 -- 172.21.15.134:0/3312395697 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c032860 con 0x7fc85415ed20 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 -- 172.21.15.134:0/3312395697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415ed20 msgr2=0x7fc8540d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 --2- 172.21.15.134:0/3312395697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415ed20 0x7fc8540d15a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc8540509d0 tx=0x7fc83c02a300 comp rx=0 tx=0).stop 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 -- 172.21.15.134:0/3312395697 shutdown_connections 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 --2- 172.21.15.134:0/3312395697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415ed20 0x7fc8540d15a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 --2- 172.21.15.134:0/3312395697 >> v2:172.21.15.177:3300/0 conn(0x7fc85415e940 0x7fc8540d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 -- 172.21.15.134:0/3312395697 >> 172.21.15.134:0/3312395697 conn(0x7fc8540b6240 msgr2=0x7fc8540b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 -- 172.21.15.134:0/3312395697 shutdown_connections 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.717+0000 7fc859318640 1 -- 172.21.15.134:0/3312395697 wait complete. 2024-09-15T22:45:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.719+0000 7fc859318640 1 Processor -- start 2024-09-15T22:45:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.719+0000 7fc859318640 1 -- start start 2024-09-15T22:45:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.719+0000 7fc859318640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540cef90 0x7fc8541e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc85415ed20 0x7fc8541476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d3f00 con 0x7fc85415e940 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d3c20 con 0x7fc8540cef90 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540d3310 con 0x7fc85415ed20 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59044/0 (socket says 172.21.15.134:59044) 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 -- 172.21.15.134:0/1149004317 learned_addr learned my addr 172.21.15.134:0/1149004317 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc852ffd640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540cef90 0x7fc8541e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc8537fe640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc85415ed20 0x7fc8541476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 -- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc85415ed20 msgr2=0x7fc8541476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc85415ed20 0x7fc8541476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 -- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540cef90 msgr2=0x7fc8541e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540cef90 0x7fc8541e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 -- 172.21.15.134:0/1149004317 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8541456e0 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84a7fc640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c037040 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c004230 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c03c670 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8541459c0 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.720+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8540ce500 con 0x7fc85415e940 2024-09-15T22:45:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.721+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8540d1ef0 con 0x7fc85415e940 2024-09-15T22:45:09.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.722+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fc83c03a070 con 0x7fc85415e940 2024-09-15T22:45:09.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.722+0000 7fc84bfff640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 0x7fc83406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.722+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5796+0+0 (secure 0 0 0) 0x7fc83c0ac240 con 0x7fc85415e940 2024-09-15T22:45:09.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.722+0000 7fc852ffd640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 0x7fc83406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.723+0000 7fc852ffd640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 0x7fc83406ead0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc844008850 tx=0x7fc844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.727+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc83c041020 con 0x7fc85415e940 2024-09-15T22:45:09.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.939+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc8540ba6b0 con 0x7fc85415e940 2024-09-15T22:45:09.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.944+0000 7fc84bfff640 1 -- 172.21.15.134:0/1149004317 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v11) ==== 81+0+473221 (secure 0 0 0) 0x7fc83c07a4d0 con 0x7fc85415e940 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 11, 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "active_gid": 4104, 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "active_name": "y", 2024-09-15T22:45:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "active_addrs": { 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 210106985 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 210106985 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "active_addr": "172.21.15.134:6825/210106985", 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "active_change": "2024-09-15T22:41:06.939854+0000", 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "available": true, 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "standbys": [ 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "gid": 4111, 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "x", 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "available_modules": [ 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "alerts", 2024-09-15T22:45:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:45:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_destination": { 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_destination", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_from_name": { 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_from_name", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "Ceph", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Email From: name", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_host": { 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_host", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP server", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_password": { 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_password", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Password to authenticate with", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_port": { 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_port", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "465", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP port", 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_sender": { 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_sender", 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_ssl": { 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_ssl", 2024-09-15T22:45:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_user": { 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_user", 2024-09-15T22:45:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "User to authenticate as", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "balancer", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "active": { 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "active", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "begin_time": { 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "begin_time", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0000", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "begin_weekday": { 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "begin_weekday", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "6", 2024-09-15T22:45:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_max_iterations": { 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "25", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "250", 2024-09-15T22:45:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_metrics": { 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_metrics", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_step": { 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_step", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0.5", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0.001", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "0.999", 2024-09-15T22:45:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "end_time": { 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "end_time", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "2359", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "end_weekday": { 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "end_weekday", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "6", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "min_score": { 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "min_score", 2024-09-15T22:45:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": { 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mode", 2024-09-15T22:45:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "upmap", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-compat", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "none", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "read", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap-read" 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Balancer mode", 2024-09-15T22:45:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_ids": { 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pool_ids", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:45:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:45:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap_max_deviation": { 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "upmap_max_deviation", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap_max_optimizations": { 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephadm", 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_down_multiplier": { 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_down_multiplier", 2024-09-15T22:45:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3.0", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_refresh_rate": { 2024-09-15T22:45:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_refresh_rate", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "20", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_starting_port": { 2024-09-15T22:45:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_starting_port", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "4721", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_ptrace": { 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_ptrace", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "autotune_interval": { 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "autotune_interval", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0.7", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm_log_destination": { 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephadm_log_destination", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "file", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "file,syslog", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "syslog" 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:45:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "cgroups_split": { 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cgroups_split", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:45:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "config_checks_enabled": { 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "config_checks_enabled", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "config_dashboard": { 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "config_dashboard", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_alertmanager": { 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_alertmanager", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:45:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_base": { 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_base", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:45:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_elasticsearch": { 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:45:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "elasticsearch container image", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_grafana": { 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_grafana", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:45:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_haproxy": { 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_haproxy", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "HAproxy container image", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_agent": { 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_collector": { 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_query": { 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger query container image", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_keepalived": { 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_keepalived", 2024-09-15T22:45:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Keepalived container image", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_loki": { 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_loki", 2024-09-15T22:45:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Loki container image", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_node_exporter": { 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_node_exporter", 2024-09-15T22:45:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_nvmeof": { 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_nvmeof", 2024-09-15T22:45:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Nvme-of container image", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_prometheus": { 2024-09-15T22:45:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_prometheus", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_promtail": { 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_promtail", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Promtail container image", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_samba": { 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_samba", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_snmp_gateway": { 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "container_init": { 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_init", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "daemon_cache_timeout": { 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "900", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "default_registry": { 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "default_registry", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "device_cache_timeout": { 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_cache_timeout", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1800", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "device_enhanced_scan": { 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_enhanced_scan", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "facts_cache_timeout": { 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "facts_cache_timeout", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "grafana_dashboards_path": { 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "host_check_interval": { 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "host_check_interval", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "hw_monitoring": { 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "hw_monitoring", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "inventory_list_all": { 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "inventory_list_all", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "log_refresh_metadata": { 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_refresh_metadata", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "*", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "max_count_per_host": { 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_count_per_host", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd_draining_count": { 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_osd_draining_count", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "migration_current": { 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "migration_current", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "internal - do not modify", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": { 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mode", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "root", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm-package", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "root" 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "oob_default_addr": { 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "oob_default_addr", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "169.254.1.1", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "prometheus_alerts_path": { 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_insecure": { 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_insecure", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_password": { 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_password", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_url": { 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_url", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_username": { 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_username", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "secure_monitoring_stack": { 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "service_discovery_port": { 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "service_discovery_port", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8765", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "ssh_config_file": { 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssh_config_file", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.048 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "use_agent": { 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "use_agent", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "use_repo_digest": { 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "use_repo_digest", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_failed_host_check": { 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_stray_daemons": { 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_stray_hosts": { 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crash", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "retain_interval": { 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "retain_interval", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "31536000", 2024-09-15T22:45:10.060 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_recent_interval": { 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_recent_interval", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1209600", 2024-09-15T22:45:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "dashboard", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:45:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:45:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:45:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_URL": { 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:45:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:45:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:45:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:45:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:45:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "45", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:45:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:45:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:45:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:45:10.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:45:10.107 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:45:10.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.109 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "cross_origin_url": { 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cross_origin_url", 2024-09-15T22:45:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "crt_file": { 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crt_file", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.111 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "debug": { 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "debug", 2024-09-15T22:45:10.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "jwt_token_ttl": { 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "jwt_token_ttl", 2024-09-15T22:45:10.113 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "28800", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "key_file": { 2024-09-15T22:45:10.114 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "key_file", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.115 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.116 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.117 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.118 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.119 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "motd": { 2024-09-15T22:45:10.120 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "motd", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "The message of the day", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:45:10.121 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "::", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8080", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl": { 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl", 2024-09-15T22:45:10.124 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl_server_port": { 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl_server_port", 2024-09-15T22:45:10.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8443", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_behaviour": { 2024-09-15T22:45:10.126 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_behaviour", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "redirect", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "redirect" 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.127 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_error_status_code": { 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_error_status_code", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "500", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "400", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "599", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.128 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "url_prefix": { 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "url_prefix", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "devicehealth", 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_monitoring": { 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enable_monitoring", 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "monitor device health metrics", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.131 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "mark_out_threshold": { 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mark_out_threshold", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.136 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "2419200", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": { 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pool_name", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "device_health_metrics", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "retention_period": { 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "retention_period", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15552000", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "scrape_frequency": { 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "scrape_frequency", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "86400", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "self_heal": { 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "self_heal", 2024-09-15T22:45:10.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.141 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_threshold": { 2024-09-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_threshold", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "7257600", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "diskprediction_local", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.144 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.145 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.146 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "predict_interval": { 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "predict_interval", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "86400", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.149 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "predictor_model": { 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "predictor_model", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "prophetstor", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.151 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "influx", 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": false, 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.152 INFO:teuthology.orchestra.run.smithi134.stdout: "batch_size": { 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "batch_size", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5000", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "database": { 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "database", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "ceph", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:45:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": { 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "hostname", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "30", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "5", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.157 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.160 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "password": { 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "password", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.162 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "port": { 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "port", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8086", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.163 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB server port", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl": { 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "false", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:45:10.164 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "threads": { 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "threads", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "32", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:45:10.165 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "username": { 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "username", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:45:10.166 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "verify_ssl": { 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "verify_ssl", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "true", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:45:10.167 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "insights", 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.169 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.170 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.172 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "iostat", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.174 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.175 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.176 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.178 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "localpool", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "failure_domain": { 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "failure_domain", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "host", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.180 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.184 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": { 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "min_size", 2024-09-15T22:45:10.185 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "num_rep": { 2024-09-15T22:45:10.186 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "num_rep", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": { 2024-09-15T22:45:10.187 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pg_num", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "128", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "prefix": { 2024-09-15T22:45:10.188 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prefix", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.189 INFO:teuthology.orchestra.run.smithi134.stdout: "subtree": { 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "subtree", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "rack", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mds_autoscaler", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.191 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.192 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.193 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.194 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mirroring", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.196 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.197 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.198 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "nfs", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.205 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.206 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "orchestrator", 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.207 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "fail_fs": { 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "fail_fs", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.208 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.209 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.210 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.211 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.212 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator": { 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "orchestrator", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "rook", 2024-09-15T22:45:10.214 INFO:teuthology.orchestra.run.smithi134.stdout: "test_orchestrator" 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Orchestrator backend", 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "osd_perf_query", 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.215 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.216 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.217 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.218 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.220 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "osd_support", 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.222 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.223 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.224 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pg_autoscaler", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.227 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.228 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.229 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.230 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.231 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.232 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "threshold": { 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "threshold", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3.0", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1.0", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "scaling threshold", 2024-09-15T22:45:10.233 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "progress", 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_pg_recovery_event": { 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.234 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "enabled": { 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enabled", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.235 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.236 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.239 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "max_completed_events": { 2024-09-15T22:45:10.241 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_completed_events", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "50", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prometheus", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "cache": { 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cache", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.244 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "exclude_perf_counters": { 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "exclude_perf_counters", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:45:10.245 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.246 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.247 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.248 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.249 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_stats_pools": { 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_stats_pools", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "300", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "scrape_interval": { 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "scrape_interval", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15.0", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "::", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.254 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "9283", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "stale_cache_strategy": { 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "stale_cache_strategy", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "log", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_behaviour": { 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_behaviour", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "default", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "default", 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: "error" 2024-09-15T22:45:10.257 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_error_status_code": { 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_error_status_code", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "500", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "400", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "599", 2024-09-15T22:45:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_support", 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.259 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.260 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.261 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.262 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.263 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.264 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "max_concurrent_snap_create": { 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "trash_purge_schedule": { 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "trash_purge_schedule", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "restful", 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_auth": { 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enable_auth", 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.268 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "key_file": { 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "key_file", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.269 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.270 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.273 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.275 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.276 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rgw", 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.277 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.278 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.279 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.280 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.283 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rook", 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.286 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.287 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "storage_class": { 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "storage_class", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "local", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "selftest", 2024-09-15T22:45:10.290 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.291 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.294 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "roption1": { 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "roption1", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "roption2": { 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "roption2", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "xyz", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.297 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption1": { 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption1", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.298 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption2": { 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption2", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.299 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption3": { 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption3", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.300 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption4": { 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption4", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.301 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption5": { 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption5", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.302 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption6": { 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption6", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.303 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption7": { 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption7", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "42", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.304 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "testkey": { 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testkey", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.305 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "testlkey": { 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testlkey", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.306 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "testnewline": { 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testnewline", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.307 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snap_schedule", 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_m_granularity": { 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_m_granularity", 2024-09-15T22:45:10.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "dump_on_update": { 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "dump_on_update", 2024-09-15T22:45:10.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.311 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.312 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.313 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "stats", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.316 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.320 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "status", 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.321 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.322 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.323 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.324 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.325 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.326 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "telegraf", 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "address": { 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "address", 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.327 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.329 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.330 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.331 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.332 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "telemetry", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_basic": { 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_basic", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.335 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_crash": { 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_crash", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.336 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_device": { 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_device", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.337 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_ident": { 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_ident", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.338 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_perf": { 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_perf", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.339 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "contact": { 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "contact", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.340 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": { 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "description", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.341 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "device_url": { 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_url", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:45:10.342 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "enabled": { 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enabled", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.343 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "24", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "8", 2024-09-15T22:45:10.344 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "last_opt_revision": { 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "last_opt_revision", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.345 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "leaderboard": { 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "leaderboard", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.346 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "leaderboard_description": { 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "leaderboard_description", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.347 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.348 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.350 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.351 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.352 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "organization": { 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "organization", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.353 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "proxy": { 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "proxy", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.354 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "url": { 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "url", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.355 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "test_orchestrator", 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.356 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.357 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.358 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.359 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.360 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.362 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.364 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.365 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.366 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "max_concurrent_clones": { 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_concurrent_clones", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "4", 2024-09-15T22:45:10.367 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "periodic_async_work": { 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "periodic_async_work", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.368 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Periodically check for async work", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot_clone_delay": { 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix", 2024-09-15T22:45:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "discovery_interval": { 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "discovery_interval", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "100", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "identifier": { 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "identifier", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_host": { 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_host", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_port": { 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_port", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10051", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_sender": { 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_sender", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "modules": [ 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "iostat", 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "nfs", 2024-09-15T22:45:10.383 INFO:teuthology.orchestra.run.smithi134.stdout: "restful" 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "available_modules": [ 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "alerts", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.384 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.385 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.386 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.388 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.389 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_destination": { 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_destination", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.390 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_from_name": { 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_from_name", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.391 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "Ceph", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Email From: name", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_host": { 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_host", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.392 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP server", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_password": { 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_password", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Password to authenticate with", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_port": { 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_port", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "465", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP port", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_sender": { 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_sender", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_ssl": { 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_ssl", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "smtp_user": { 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "smtp_user", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "User to authenticate as", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "balancer", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "active": { 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "active", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "begin_time": { 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "begin_time", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0000", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "begin_weekday": { 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "begin_weekday", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "6", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_max_iterations": { 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "25", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "250", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_metrics": { 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_metrics", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_compat_step": { 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crush_compat_step", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0.5", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0.001", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "0.999", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "end_time": { 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "end_time", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "2359", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "end_weekday": { 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "end_weekday", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "0", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "6", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "min_score": { 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "min_score", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": { 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mode", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "upmap", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-compat", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "none", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "read", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap", 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap-read" 2024-09-15T22:45:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Balancer mode", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_ids": { 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pool_ids", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap_max_deviation": { 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "upmap_max_deviation", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "upmap_max_optimizations": { 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephadm", 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_down_multiplier": { 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_down_multiplier", 2024-09-15T22:45:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3.0", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_refresh_rate": { 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_refresh_rate", 2024-09-15T22:45:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "20", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "agent_starting_port": { 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "agent_starting_port", 2024-09-15T22:45:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "4721", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_ptrace": { 2024-09-15T22:45:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_ptrace", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "autotune_interval": { 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "autotune_interval", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0.7", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm_log_destination": { 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephadm_log_destination", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "file", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "file,syslog", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "syslog" 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:45:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "cgroups_split": { 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cgroups_split", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "config_checks_enabled": { 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "config_checks_enabled", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "config_dashboard": { 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "config_dashboard", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_alertmanager": { 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_alertmanager", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_base": { 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_base", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_elasticsearch": { 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "elasticsearch container image", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_grafana": { 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_grafana", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_haproxy": { 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_haproxy", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "HAproxy container image", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_agent": { 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_collector": { 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_jaeger_query": { 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Jaeger query container image", 2024-09-15T22:45:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_keepalived": { 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_keepalived", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Keepalived container image", 2024-09-15T22:45:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_loki": { 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_loki", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Loki container image", 2024-09-15T22:45:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_node_exporter": { 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_node_exporter", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_nvmeof": { 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_nvmeof", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Nvme-of container image", 2024-09-15T22:45:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_prometheus": { 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_prometheus", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Prometheus container image", 2024-09-15T22:45:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_promtail": { 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_promtail", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Promtail container image", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_samba": { 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_samba", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:45:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image_snmp_gateway": { 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:45:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "container_init": { 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "container_init", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:45:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "daemon_cache_timeout": { 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:45:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "900", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:45:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "default_registry": { 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "default_registry", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "docker.io", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:45:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "device_cache_timeout": { 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_cache_timeout", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1800", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:45:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "device_enhanced_scan": { 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_enhanced_scan", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:45:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "facts_cache_timeout": { 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "facts_cache_timeout", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "grafana_dashboards_path": { 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "host_check_interval": { 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "host_check_interval", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "hw_monitoring": { 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "hw_monitoring", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "inventory_list_all": { 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "inventory_list_all", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:45:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "log_refresh_metadata": { 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_refresh_metadata", 2024-09-15T22:45:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:45:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "*", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "max_count_per_host": { 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_count_per_host", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd_draining_count": { 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_osd_draining_count", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "migration_current": { 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "migration_current", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "internal - do not modify", 2024-09-15T22:45:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": { 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mode", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "root", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm-package", 2024-09-15T22:45:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "root" 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "oob_default_addr": { 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "oob_default_addr", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "169.254.1.1", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "prometheus_alerts_path": { 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_insecure": { 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_insecure", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_password": { 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_password", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_url": { 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_url", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "registry_username": { 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "registry_username", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "secure_monitoring_stack": { 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "service_discovery_port": { 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "service_discovery_port", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8765", 2024-09-15T22:45:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "ssh_config_file": { 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssh_config_file", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "use_agent": { 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "use_agent", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "use_repo_digest": { 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "use_repo_digest", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.481 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_failed_host_check": { 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.482 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_stray_daemons": { 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.483 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_on_stray_hosts": { 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.484 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crash", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.485 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.486 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.488 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.489 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.490 INFO:teuthology.orchestra.run.smithi134.stdout: "retain_interval": { 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "retain_interval", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "31536000", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.491 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_recent_interval": { 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_recent_interval", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1209600", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "dashboard", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.493 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.494 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.495 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.497 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.498 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.499 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.500 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.501 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.502 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.503 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.504 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.505 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.506 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.507 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.508 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_URL": { 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.509 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.510 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.511 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.513 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.515 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.517 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.518 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.519 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.520 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.521 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.525 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.526 INFO:teuthology.orchestra.run.smithi134.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:45:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "45", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:45:10.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:45:10.529 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "admin", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:45:10.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.531 INFO:teuthology.orchestra.run.smithi134.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.532 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.533 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "cross_origin_url": { 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cross_origin_url", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "crt_file": { 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crt_file", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.537 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "debug": { 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "debug", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.538 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "jwt_token_ttl": { 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "jwt_token_ttl", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "28800", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "key_file": { 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "key_file", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.540 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.541 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.542 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.543 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.544 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "motd": { 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "motd", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "The message of the day", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.546 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "::", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.548 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8080", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.549 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl": { 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.550 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl_server_port": { 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl_server_port", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8443", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.551 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_behaviour": { 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_behaviour", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "redirect", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: "redirect" 2024-09-15T22:45:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_error_status_code": { 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_error_status_code", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "500", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "400", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "599", 2024-09-15T22:45:10.553 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "url_prefix": { 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "url_prefix", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.554 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "devicehealth", 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.555 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_monitoring": { 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enable_monitoring", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "monitor device health metrics", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.556 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.557 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.558 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.559 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.560 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "mark_out_threshold": { 2024-09-15T22:45:10.561 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mark_out_threshold", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "2419200", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": { 2024-09-15T22:45:10.562 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pool_name", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "device_health_metrics", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "retention_period": { 2024-09-15T22:45:10.563 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "retention_period", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15552000", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.564 INFO:teuthology.orchestra.run.smithi134.stdout: "scrape_frequency": { 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "scrape_frequency", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "86400", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.565 INFO:teuthology.orchestra.run.smithi134.stdout: "self_heal": { 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "self_heal", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.566 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "warn_threshold": { 2024-09-15T22:45:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "warn_threshold", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "7257600", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "diskprediction_local", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.572 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.573 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "predict_interval": { 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "predict_interval", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "86400", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.574 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "predictor_model": { 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "predictor_model", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "prophetstor", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.575 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "600", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.576 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "influx", 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": false, 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "batch_size": { 2024-09-15T22:45:10.577 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "batch_size", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5000", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.578 INFO:teuthology.orchestra.run.smithi134.stdout: "database": { 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "database", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "ceph", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": { 2024-09-15T22:45:10.579 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "hostname", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.580 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "30", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "5", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.581 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.584 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.585 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "password": { 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "password", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "port": { 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "port", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "8086", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "InfluxDB server port", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: "ssl": { 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "ssl", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "false", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.589 INFO:teuthology.orchestra.run.smithi134.stdout: "threads": { 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "threads", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "32", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "username": { 2024-09-15T22:45:10.590 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "username", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "verify_ssl": { 2024-09-15T22:45:10.591 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "verify_ssl", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "true", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "insights", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.593 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.594 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.595 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.596 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.597 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "iostat", 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.598 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.599 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.600 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.601 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.602 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "localpool", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "failure_domain": { 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "failure_domain", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "host", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.604 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.605 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.606 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.607 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.608 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.609 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": { 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "min_size", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.610 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "num_rep": { 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "num_rep", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.611 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": { 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pg_num", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "128", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.612 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "prefix": { 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prefix", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.613 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "subtree": { 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "subtree", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "rack", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.614 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mds_autoscaler", 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.618 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.619 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mirroring", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.621 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.622 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.623 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.625 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "nfs", 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.626 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.627 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.630 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "orchestrator", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "fail_fs": { 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "fail_fs", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.632 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.633 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.634 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.635 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.636 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.637 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator": { 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "orchestrator", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.638 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm", 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "rook", 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "test_orchestrator" 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Orchestrator backend", 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "osd_perf_query", 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.639 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.640 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "osd_support", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "pg_autoscaler", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "threshold": { 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "threshold", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "3.0", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1.0", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "scaling threshold", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "progress", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_pg_recovery_event": { 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "enabled": { 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enabled", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "max_completed_events": { 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_completed_events", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "50", 2024-09-15T22:45:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "sleep_interval": { 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "sleep_interval", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "prometheus", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "cache": { 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cache", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "exclude_perf_counters": { 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "exclude_perf_counters", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_stats_pools": { 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_stats_pools", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "300", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "scrape_interval": { 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "scrape_interval", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15.0", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "::", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "9283", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "stale_cache_strategy": { 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "stale_cache_strategy", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "log", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_behaviour": { 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_behaviour", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "default", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "default", 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "error" 2024-09-15T22:45:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "standby_error_status_code": { 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "standby_error_status_code", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "500", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "400", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "599", 2024-09-15T22:45:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_support", 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "max_concurrent_snap_create": { 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:45:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "trash_purge_schedule": { 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "trash_purge_schedule", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "restful", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_auth": { 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enable_auth", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "key_file": { 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "key_file", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "server_addr": { 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_addr", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "server_port": { 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "server_port", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rgw", 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "5", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rook", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "storage_class": { 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "storage_class", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "local", 2024-09-15T22:45:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "selftest", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "roption1": { 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "roption1", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "roption2": { 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "roption2", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "xyz", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption1": { 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption1", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption2": { 2024-09-15T22:45:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption2", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption3": { 2024-09-15T22:45:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption3", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "float", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption4": { 2024-09-15T22:45:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption4", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption5": { 2024-09-15T22:45:10.728 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption5", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption6": { 2024-09-15T22:45:10.729 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption6", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "rwoption7": { 2024-09-15T22:45:10.730 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rwoption7", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "1", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "42", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "testkey": { 2024-09-15T22:45:10.731 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testkey", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "testlkey": { 2024-09-15T22:45:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testlkey", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "testnewline": { 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "testnewline", 2024-09-15T22:45:10.733 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snap_schedule", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_m_granularity": { 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "allow_m_granularity", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:45:10.735 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "dump_on_update": { 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "dump_on_update", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.736 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.737 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.738 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.739 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.740 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.741 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "stats", 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.742 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.744 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.745 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.746 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "status", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.748 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.749 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.750 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.751 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.752 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "telegraf", 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.753 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "address": { 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "address", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "15", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.756 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.758 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "telemetry", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_basic": { 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_basic", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.761 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_crash": { 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_crash", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.762 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_device": { 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_device", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.763 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_ident": { 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_ident", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.764 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "channel_perf": { 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "channel_perf", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.765 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "contact": { 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "contact", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.766 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": { 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "description", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.767 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "device_url": { 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "device_url", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.768 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "enabled": { 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "enabled", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.769 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "24", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "8", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.770 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "last_opt_revision": { 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "last_opt_revision", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "1", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.771 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "leaderboard": { 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "leaderboard", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.772 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "leaderboard_description": { 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "leaderboard_description", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.776 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.777 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.778 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "organization": { 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "organization", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.779 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "proxy": { 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "proxy", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "url": { 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "url", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "test_orchestrator", 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.782 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.783 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.784 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.786 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.787 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.788 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.790 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.792 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "max_concurrent_clones": { 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "max_concurrent_clones", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "4", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:45:10.793 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "periodic_async_work": { 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "periodic_async_work", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Periodically check for async work", 2024-09-15T22:45:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot_clone_delay": { 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "0", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:45:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "True", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:45:10.796 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "can_run": true, 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "error_string": "", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "module_options": { 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "discovery_interval": { 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "discovery_interval", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "uint", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "100", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "identifier": { 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "identifier", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "interval": { 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "interval", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "secs", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "60", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "log_level": { 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_level", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster": { 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.802 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_cluster_level": { 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_cluster_level", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "info", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [ 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "critical", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "debug", 2024-09-15T22:45:10.803 INFO:teuthology.orchestra.run.smithi134.stdout: "error", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "info", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "warning" 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": { 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "log_to_file", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "bool", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "False", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_host": { 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_host", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.805 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_port": { 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_port", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "int", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.806 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "10051", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "zabbix_sender": { 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zabbix_sender", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "str", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "level": "advanced", 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 0, 2024-09-15T22:45:10.807 INFO:teuthology.orchestra.run.smithi134.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "min": "", 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "max": "", 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "enum_allowed": [], 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "desc": "", 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "long_desc": "", 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tags": [], 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "see_also": [] 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "services": {}, 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "always_on_modules": { 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "octopus": [ 2024-09-15T22:45:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: "balancer", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "devicehealth", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscaler", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "progress", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_support", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "status", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "telemetry", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "volumes" 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "pacific": [ 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "balancer", 2024-09-15T22:45:10.809 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "devicehealth", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscaler", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "progress", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_support", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "status", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "telemetry", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "volumes" 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "quincy": [ 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "balancer", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "devicehealth", 2024-09-15T22:45:10.810 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscaler", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "progress", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_support", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "status", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "telemetry", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "volumes" 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "reef": [ 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "balancer", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "devicehealth", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscaler", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "progress", 2024-09-15T22:45:10.811 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_support", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "status", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "telemetry", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "volumes" 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "squid": [ 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "balancer", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "devicehealth", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "orchestrator", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscaler", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "progress", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_support", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "status", 2024-09-15T22:45:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: "telemetry", 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "volumes" 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "last_failure_osd_epoch": 0, 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "active_clients": [ 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "devicehealth", 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1996904897 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "libcephsqlite", 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 2765650614 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "rbd_support", 2024-09-15T22:45:10.814 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 2745699943 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 2376424591 2024-09-15T22:45:10.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 698139707 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.816 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 59152253 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.817 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1326277956 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1946867643 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4237567819 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "volumes", 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:10.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:0", 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1495337979 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:10.820 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:10.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 msgr2=0x7fc83406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 0x7fc83406ead0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc844008850 tx=0x7fc844008040 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 msgr2=0x7fc8541e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 shutdown_connections 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fc83406c610 0x7fc83406ead0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc85415ed20 0x7fc8541476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85415e940 0x7fc8541e7860 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 --2- 172.21.15.134:0/1149004317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540cef90 0x7fc8541e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 >> 172.21.15.134:0/1149004317 conn(0x7fc8540b6240 msgr2=0x7fc8540b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 shutdown_connections 2024-09-15T22:45:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:09.948+0000 7fc859318640 1 -- 172.21.15.134:0/1149004317 wait complete. 2024-09-15T22:45:10.826 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail y 2024-09-15T22:45:10.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.928+0000 7fd71d23c640 1 Processor -- start 2024-09-15T22:45:10.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.928+0000 7fd71d23c640 1 -- start start 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71d23c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7180b8f90 0x7fd7180b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71d23c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7180b7170 con 0x7fd71815ed20 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71d23c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7180b7aa0 con 0x7fd71815e940 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71d23c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd7180d3660 con 0x7fd7180b8f90 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7180b8f90 0x7fd7180b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd70e59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd71815ed20 0x7fd7180b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43074/0 (socket says 172.21.15.134:43074) 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd71759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7180b8f90 0x7fd7180b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59048/0 (socket says 172.21.15.134:59048) 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.929+0000 7fd70e59c640 1 -- 172.21.15.134:0/3753014977 learned_addr learned my addr 172.21.15.134:0/3753014977 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71759e640 1 -- 172.21.15.134:0/3753014977 >> v1:172.21.15.177:6789/0 conn(0x7fd71815e940 legacy=0x7fd7180d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71759e640 1 -- 172.21.15.134:0/3753014977 >> v1:172.21.15.134:6789/0 conn(0x7fd71815ed20 legacy=0x7fd7180b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71759e640 1 -- 172.21.15.134:0/3753014977 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7180d3940 con 0x7fd7180b8f90 2024-09-15T22:45:10.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71659c640 1 -- 172.21.15.134:0/3753014977 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493443484 0 0) 0x7fd700001110 con 0x7fd71815ed20 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71759e640 1 --2- 172.21.15.134:0/3753014977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7180b8f90 0x7fd7180b3930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd710009d90 tx=0x7fd71002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48bfe41b396c000 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.930+0000 7fd71659c640 1 -- 172.21.15.134:0/3753014977 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710007740 con 0x7fd7180b8f90 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71659c640 1 -- 172.21.15.134:0/3753014977 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7100078e0 con 0x7fd7180b8f90 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71659c640 1 -- 172.21.15.134:0/3753014977 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710007cb0 con 0x7fd7180b8f90 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 -- 172.21.15.134:0/3753014977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7180b8f90 msgr2=0x7fd7180b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 --2- 172.21.15.134:0/3753014977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7180b8f90 0x7fd7180b3930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd710009d90 tx=0x7fd71002a730 comp rx=0 tx=0).stop 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 -- 172.21.15.134:0/3753014977 shutdown_connections 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 --2- 172.21.15.134:0/3753014977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7180b8f90 0x7fd7180b3930 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 -- 172.21.15.134:0/3753014977 >> 172.21.15.134:0/3753014977 conn(0x7fd7180b6240 msgr2=0x7fd7180b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 -- 172.21.15.134:0/3753014977 shutdown_connections 2024-09-15T22:45:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.931+0000 7fd71d23c640 1 -- 172.21.15.134:0/3753014977 wait complete. 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.932+0000 7fd71d23c640 1 Processor -- start 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 -- start start 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7180b8f90 0x7fd718158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd71815e940 0x7fd7181f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d3310 con 0x7fd71815ed20 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d3f00 con 0x7fd71815e940 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.933+0000 7fd71d23c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180d1ef0 con 0x7fd7180b8f90 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59062/0 (socket says 172.21.15.134:59062) 2024-09-15T22:45:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 -- 172.21.15.134:0/1882159746 learned_addr learned my addr 172.21.15.134:0/1882159746 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd716d9d640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7180b8f90 0x7fd718158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 -- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7180b8f90 msgr2=0x7fd718158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7180b8f90 0x7fd718158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd70e59c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd71815e940 0x7fd7181f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 -- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd71815e940 msgr2=0x7fd7181f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd71815e940 0x7fd7181f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 -- 172.21.15.134:0/1882159746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71814b4a0 con 0x7fd71815ed20 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71759e640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd710009d90 tx=0x7fd710004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710040070 con 0x7fd71815ed20 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd710031c40 con 0x7fd71815ed20 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71814b780 con 0x7fd71815ed20 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710003990 con 0x7fd71815ed20 2024-09-15T22:45:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.934+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181f8a10 con 0x7fd71815ed20 2024-09-15T22:45:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.935+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7180cef90 con 0x7fd71815ed20 2024-09-15T22:45:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.936+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) ==== 91152+0+0 (secure 0 0 0) 0x7fd710039040 con 0x7fd71815ed20 2024-09-15T22:45:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.936+0000 7fd70ffff640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 0x7fd6f806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.936+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5796+0+0 (secure 0 0 0) 0x7fd7100acd50 con 0x7fd71815ed20 2024-09-15T22:45:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.936+0000 7fd716d9d640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 0x7fd6f806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.937+0000 7fd716d9d640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 0x7fd6f806ead0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd708003d90 tx=0x7fd708009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:10.941+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd71007afd0 con 0x7fd71815ed20 2024-09-15T22:45:11.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.151+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr fail", "who": "y"} v 0) -- 0x7fd7180ba6b0 con 0x7fd71815ed20 2024-09-15T22:45:11.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.154+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr fail", "who": "y"}]=0 v12) ==== 68+0+0 (secure 0 0 0) 0x7fd71007a8d0 con 0x7fd71815ed20 2024-09-15T22:45:11.157 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.156+0000 7faca6247640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-15T22:45:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mgrmap(e 12) ==== 45448+0+0 (secure 0 0 0) 0x7fd710076f40 con 0x7fd71815ed20 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd70ffff640 1 -- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 msgr2=0x7fd6f806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd70ffff640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 0x7fd6f806ead0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd708003d90 tx=0x7fd708009040 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 msgr2=0x7fd71814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd710009d90 tx=0x7fd710004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 shutdown_connections 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:6824/210106985,v1:172.21.15.134:6825/210106985] conn(0x7fd6f806c610 0x7fd6f806ead0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71815ed20 0x7fd71814aa50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd71815e940 0x7fd7181f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 --2- 172.21.15.134:0/1882159746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7180b8f90 0x7fd718158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 >> 172.21.15.134:0/1882159746 conn(0x7fd7180b6240 msgr2=0x7fd718160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.158+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 shutdown_connections 2024-09-15T22:45:11.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.159+0000 7fd71d23c640 1 -- 172.21.15.134:0/1882159746 wait complete. 2024-09-15T22:45:11.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.245 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:45:11.243+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:11.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.303+0000 7fbb0b2d0640 1 Processor -- start 2024-09-15T22:45:11.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.303+0000 7fbb0b2d0640 1 -- start start 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.304+0000 7fbb0b2d0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 0x7fbb040b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.304+0000 7fbb0b2d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb040d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0b2d0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb04073da0 con 0x7fbb040d0a80 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0b2d0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbb04074060 con 0x7fbb0415c690 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0b2d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbb040b6aa0 con 0x7fbb040b1980 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0986d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbb040d0a80 0x7fbb040b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43080/0 (socket says 172.21.15.134:43080) 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0986d640 1 -- 172.21.15.134:0/2533176776 learned_addr learned my addr 172.21.15.134:0/2533176776 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0886b640 1 --2- 172.21.15.134:0/2533176776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb040d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0906c640 1 --2- 172.21.15.134:0/2533176776 >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 0x7fbb040b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbafbfff640 1 -- 172.21.15.134:0/2533176776 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848090932 0 0) 0x7fbb04073da0 con 0x7fbb040d0a80 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbafbfff640 1 -- 172.21.15.134:0/2533176776 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf0003520 con 0x7fbb040d0a80 2024-09-15T22:45:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0886b640 1 -- 172.21.15.134:0/2533176776 >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 msgr2=0x7fbb040b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0886b640 1 --2- 172.21.15.134:0/2533176776 >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 0x7fbb040b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0886b640 1 -- 172.21.15.134:0/2533176776 >> v1:172.21.15.134:6789/0 conn(0x7fbb040d0a80 legacy=0x7fbb040b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0886b640 1 -- 172.21.15.134:0/2533176776 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb040733a0 con 0x7fbb040b1980 2024-09-15T22:45:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.305+0000 7fbb0906c640 1 --2- 172.21.15.134:0/2533176776 >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 0x7fbb040b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.306+0000 7fbb0886b640 1 --2- 172.21.15.134:0/2533176776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb040d0540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40097a0 tx=0x7fbaf402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab8e23775358042 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.306+0000 7fbafbfff640 1 -- 172.21.15.134:0/2533176776 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4037070 con 0x7fbb040b1980 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.306+0000 7fbafbfff640 1 -- 172.21.15.134:0/2533176776 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4032440 con 0x7fbb040b1980 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.306+0000 7fbafbfff640 1 -- 172.21.15.134:0/2533176776 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4032810 con 0x7fbb040b1980 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/2533176776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 msgr2=0x7fbb040d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/2533176776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb040d0540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40097a0 tx=0x7fbaf402a180 comp rx=0 tx=0).stop 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/2533176776 shutdown_connections 2024-09-15T22:45:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/2533176776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb040d0540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/2533176776 >> v2:172.21.15.177:3300/0 conn(0x7fbb0415c690 0x7fbb040b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/2533176776 >> 172.21.15.134:0/2533176776 conn(0x7fbb04062630 msgr2=0x7fbb04062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.310 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fca7c60e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/2533176776 shutdown_connections 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.307+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/2533176776 wait complete. 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.308+0000 7fbb0b2d0640 1 Processor -- start 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.308+0000 7fbb0b2d0640 1 -- start start 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb0415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0415c690 0x7fbb041443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040b4b20 con 0x7fbb040d0a80 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040b49a0 con 0x7fbb0415c690 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0b2d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbb040b6fc0 con 0x7fbb040b1980 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59072/0 (socket says 172.21.15.134:59072) 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 -- 172.21.15.134:0/3114715210 learned_addr learned my addr 172.21.15.134:0/3114715210 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0986d640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0415c690 0x7fbb041443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0906c640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb0415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 -- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 msgr2=0x7fbb0415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb0415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 -- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0415c690 msgr2=0x7fbb041443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0415c690 0x7fbb041443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 -- 172.21.15.134:0/3114715210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0406d760 con 0x7fbb040d0a80 2024-09-15T22:45:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbb0886b640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4035040 tx=0x7fbaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.309+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4041030 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.310+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf403d4e0 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.310+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0406da40 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.310+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4037040 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.310+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0406e000 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.311+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) ==== 45448+0+0 (secure 0 0 0) 0x7fbaf4044070 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.311+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7fbaf406bf70 con 0x7fbb040d0a80 2024-09-15T22:45:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.311+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb040d0540 con 0x7fbb040d0a80 2024-09-15T22:45:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.315+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaf4045570 con 0x7fbb040d0a80 2024-09-15T22:45:11.351 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.350+0000 7fca7c60e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:11.486 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.485+0000 7fca7c60e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:45:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.523+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb04062c60 con 0x7fbb040d0a80 2024-09-15T22:45:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.524+0000 7fbaf9ffb640 1 -- 172.21.15.134:0/3114715210 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7fbaf403d8f0 con 0x7fbb040d0a80 2024-09-15T22:45:11.525 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:11.526 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 msgr2=0x7fbb04143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4035040 tx=0x7fbaf40046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 shutdown_connections 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0415c690 0x7fbb041443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb040d0a80 0x7fbb04143e80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 --2- 172.21.15.134:0/3114715210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb040b1980 0x7fbb0415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 >> 172.21.15.134:0/3114715210 conn(0x7fbb04062630 msgr2=0x7fbb04159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 shutdown_connections 2024-09-15T22:45:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.526+0000 7fbb0b2d0640 1 -- 172.21.15.134:0/3114715210 wait complete. 2024-09-15T22:45:11.536 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.535+0000 7fca7c60e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:45:11.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-15T22:45:11.650 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.649+0000 7fca7c60e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:11.657 INFO:teuthology.orchestra.run.smithi134.stdout:[{"id":5869,"entity":{"name":{"type":"client","num":5869},"addr":{"type":"any","addr":"172.21.15.177:0","nonce":1078792213}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.401990719,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9981686622185242,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5869 172.21.15.177:0/1078792213","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"x","hostname":"smithi177","pid":"36091","root":"/"}},{"id":6393,"entity":{"name":{"type":"client","num":6393},"addr":{"type":"any","addr":"172.21.15.177:0","nonce":719476588}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.401990719,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9981686622185242,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6393 172.21.15.177:0/719476588","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"8921c8ef947807b717db041d85f0761b7914d5fc","ceph_version":"ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)","entity_id":"x","hostname":"smithi177","pid":"36091","root":"/"}}] 2024-09-15T22:45:11.658 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi177", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36091", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.177:0", "nonce": 1078792213, "type": "any" }, "name": { "num": 5869, "type": "client" } }, "id": 5869, "inst": "client.5869 172.21.15.177:0/1078792213", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9981686622185242 }, "state": "open", "uptime": 0.401990719 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi177", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36091", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.177:0", "nonce": 719476588, "type": "any" }, "name": { "num": 6393, "type": "client" } }, "id": 6393, "inst": "client.6393 172.21.15.177:0/719476588", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9981686622185242 }, "state": "open", "uptime": 0.401990719 } ] 2024-09-15T22:45:11.658 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-15T22:45:11.658 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:45:11.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:11.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:11.748 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:11.747+0000 7fca7c60e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:45:11.762 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:45:11.762 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:11.763 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:11.763 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:11.778 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:11.778 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:11.778 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:11.778 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:11.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:11.796 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:11.796 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:11.796 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:11.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:11.834 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:11.834 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:11.834 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:11.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:11.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:11.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.973+0000 7f0b7b1cf640 1 Processor -- start 2024-09-15T22:45:11.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.973+0000 7f0b7b1cf640 1 -- start start 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7b1cf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b740b6db0 0x7f0b740b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7b1cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7b1cf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b74071700 con 0x7f0b74073670 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7b1cf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0b740d1d30 con 0x7f0b740b6db0 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7b1cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740d1a50 con 0x7f0b740d1fa0 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b78f6b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b740b6db0 0x7f0b740b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:48512/0 (socket says 172.21.15.134:48512) 2024-09-15T22:45:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b7976c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0b74073670 0x7f0b7406ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:49890/0 (socket says 172.21.15.134:49890) 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b78f6b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b740b6db0 0x7f0b740b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:52814/0 (socket says 172.21.15.134:52814) 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.974+0000 7f0b73fff640 1 -- 172.21.15.134:0/2046977246 learned_addr learned my addr 172.21.15.134:0/2046977246 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b78f6b640 1 -- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 msgr2=0x7f0b74073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b78f6b640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b78f6b640 1 -- 172.21.15.134:0/2046977246 >> v1:172.21.15.177:6789/0 conn(0x7f0b74073670 legacy=0x7f0b7406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b78f6b640 1 -- 172.21.15.134:0/2046977246 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b74070940 con 0x7f0b740b6db0 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b737fe640 1 -- 172.21.15.134:0/2046977246 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807881679 0 0) 0x7f0b74071700 con 0x7f0b74073670 2024-09-15T22:45:11.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b73fff640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:11.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b78f6b640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740b6db0 0x7f0b740b7190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097a0 tx=0x7f0b6802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da12ebeeb849670 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.975+0000 7f0b737fe640 1 -- 172.21.15.134:0/2046977246 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68037070 con 0x7f0b740b6db0 2024-09-15T22:45:11.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b737fe640 1 -- 172.21.15.134:0/2046977246 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b68032440 con 0x7f0b740b6db0 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b737fe640 1 -- 172.21.15.134:0/2046977246 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68032810 con 0x7f0b740b6db0 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740b6db0 msgr2=0x7f0b740b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740b6db0 0x7f0b740b7190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097a0 tx=0x7f0b6802a210 comp rx=0 tx=0).stop 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2046977246 shutdown_connections 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b740d1fa0 0x7f0b74073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2046977246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740b6db0 0x7f0b740b7190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2046977246 >> 172.21.15.134:0/2046977246 conn(0x7f0b740b4220 msgr2=0x7f0b740b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2046977246 shutdown_connections 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.976+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2046977246 wait complete. 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.977+0000 7f0b7b1cf640 1 Processor -- start 2024-09-15T22:45:11.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.977+0000 7f0b7b1cf640 1 -- start start 2024-09-15T22:45:11.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b74073670 0x7f0b74142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 0x7f0b7415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740711e0 con 0x7f0b740b6db0 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74070f00 con 0x7f0b740d1fa0 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7b1cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740719f0 con 0x7f0b74073670 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59084/0 (socket says 172.21.15.134:59084) 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b73fff640 1 -- 172.21.15.134:0/2101358166 learned_addr learned my addr 172.21.15.134:0/2101358166 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b7976c640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 0x7f0b7415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.978+0000 7f0b78f6b640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b74073670 0x7f0b74142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 -- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b74073670 msgr2=0x7f0b74142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b74073670 0x7f0b74142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 -- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 msgr2=0x7f0b7415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 0x7f0b7415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 -- 172.21.15.134:0/2101358166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b74142700 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b7976c640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 0x7f0b7415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b73fff640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e900 tx=0x7f0b6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60017070 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6000ca00 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b741429e0 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000cdf0 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.979+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741e65d0 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.980+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) ==== 45448+0+0 (secure 0 0 0) 0x7f0b6001a070 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.980+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74073130 con 0x7f0b740b6db0 2024-09-15T22:45:11.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.980+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7f0b6004baa0 con 0x7f0b740b6db0 2024-09-15T22:45:11.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:11.985+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b60024350 con 0x7f0b740b6db0 2024-09-15T22:45:12.027 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:12.026+0000 7fca7c60e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:45:12.073 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:12.071+0000 7fca7c60e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:45:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.161+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7f0b600136b0 con 0x7f0b740b6db0 2024-09-15T22:45:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.161+0000 7f0b717fa640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 0x7f0b580403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.161+0000 7f0b78f6b640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 0x7f0b580403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.164+0000 7f0b78f6b640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 0x7f0b580403a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.196 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:12.194+0000 7fca7c60e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:45:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.195+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b740b2fb0 con 0x7f0b740b6db0 2024-09-15T22:45:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.196+0000 7f0b717fa640 1 -- 172.21.15.134:0/2101358166 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7f0b60024dc0 con 0x7f0b740b6db0 2024-09-15T22:45:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:12.197 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 msgr2=0x7f0b580403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 0x7f0b580403a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 msgr2=0x7f0b74144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e900 tx=0x7f0b6000edc0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 shutdown_connections 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b740d1fa0 0x7f0b7415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b5803dfb0 0x7f0b580403a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b740b6db0 0x7f0b74144670 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 --2- 172.21.15.134:0/2101358166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b74073670 0x7f0b74142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 >> 172.21.15.134:0/2101358166 conn(0x7f0b740b4220 msgr2=0x7f0b740b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 shutdown_connections 2024-09-15T22:45:12.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.198+0000 7f0b7b1cf640 1 -- 172.21.15.134:0/2101358166 wait complete. 2024-09-15T22:45:12.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:12.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.310+0000 7f7ad13c4640 1 Processor -- start 2024-09-15T22:45:12.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.310+0000 7f7ad13c4640 1 -- start start 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 0x7f7acc0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06ed70 0x7f7acc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7acc06c0e0 0x7f7acc072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7acc15f5b0 con 0x7f7acc06c0e0 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7acc06f5a0 con 0x7f7acc15e7a0 2024-09-15T22:45:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7ad13c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc15ef60 con 0x7f7acc06ed70 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7acb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7acc06c0e0 0x7f7acc072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7acb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7acc06c0e0 0x7f7acc072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59094/0 (socket says 172.21.15.134:59094) 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.311+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1395181661 learned_addr learned my addr 172.21.15.134:0/1395181661 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7ac3fff640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06ed70 0x7f7acc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1395181661 >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 0x7f7acc0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1395181661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06ed70 msgr2=0x7f7acc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06ed70 0x7f7acc06bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1395181661 >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 msgr2=0x7f7acc0cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1395181661 >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 0x7f7acc0cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1395181661 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc15f240 con 0x7f7acc06c0e0 2024-09-15T22:45:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1395181661 >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 0x7f7acc0cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.312+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc06c0e0 0x7f7acc072050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0b5790 tx=0x7f7ac402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7802367e52883f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7aca7fc640 1 -- 172.21.15.134:0/1395181661 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4036070 con 0x7f7acc06c0e0 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7aca7fc640 1 -- 172.21.15.134:0/1395181661 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac4031600 con 0x7f7acc06c0e0 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7aca7fc640 1 -- 172.21.15.134:0/1395181661 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40319d0 con 0x7f7acc06c0e0 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1395181661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc06c0e0 msgr2=0x7f7acc072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc06c0e0 0x7f7acc072050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0b5790 tx=0x7f7ac402a6a0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1395181661 shutdown_connections 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc06c0e0 0x7f7acc072050 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1395181661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06ed70 0x7f7acc06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1395181661 >> v2:172.21.15.177:3300/0 conn(0x7f7acc15e7a0 0x7f7acc0cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1395181661 >> 172.21.15.134:0/1395181661 conn(0x7f7acc062c60 msgr2=0x7f7acc0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1395181661 shutdown_connections 2024-09-15T22:45:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.313+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1395181661 wait complete. 2024-09-15T22:45:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.314+0000 7f7ad13c4640 1 Processor -- start 2024-09-15T22:45:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 -- start start 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 0x7f7acc0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 0x7f7acc0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc06f330 con 0x7f7acc15e7a0 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc06f1b0 con 0x7f7acc06ed70 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7ad13c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc072590 con 0x7f7acc06c0e0 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7acb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7acb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59100/0 (socket says 172.21.15.134:59100) 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.315+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1556713704 learned_addr learned my addr 172.21.15.134:0/1556713704 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 0x7f7acc0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ac3fff640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 0x7f7acc0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 msgr2=0x7f7acc0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 0x7f7acc0aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 msgr2=0x7f7acc0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 0x7f7acc0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 -- 172.21.15.134:0/1556713704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc1f7d20 con 0x7f7acc15e7a0 2024-09-15T22:45:12.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ac3fff640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 0x7f7acc0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 0x7f7acc0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7acb7fe640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009f40 tx=0x7f7ac4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac403f020 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac4037040 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4036070 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc1f8000 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.316+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc1f85c0 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.317+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7f7ac4042020 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.317+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7acc0cf600 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.317+0000 7f7ac37fe640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 0x7f7aac03a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.317+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7f7ac406c140 con 0x7f7acc15e7a0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.318+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 0x7f7aac03a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.318+0000 7f7acaffd640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 0x7f7aac03a6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7abc006fd0 tx=0x7f7abc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.322+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7acc0cf600 con 0x7f7acc15e7a0 2024-09-15T22:45:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.530+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7acc072050 con 0x7f7acc15e7a0 2024-09-15T22:45:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.530+0000 7f7ac37fe640 1 -- 172.21.15.134:0/1556713704 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7f7ac4049030 con 0x7f7acc15e7a0 2024-09-15T22:45:12.532 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:12.532 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:12.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 msgr2=0x7f7aac03a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 0x7f7aac03a6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7abc006fd0 tx=0x7f7abc008040 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 msgr2=0x7f7acc1e52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009f40 tx=0x7f7ac4004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 shutdown_connections 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7aac038200 0x7f7aac03a6c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7acc15e7a0 0x7f7acc1e52f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7acc06ed70 0x7f7acc0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 --2- 172.21.15.134:0/1556713704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7acc06c0e0 0x7f7acc0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 >> 172.21.15.134:0/1556713704 conn(0x7f7acc062c60 msgr2=0x7f7acc15d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 shutdown_connections 2024-09-15T22:45:12.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.533+0000 7f7ad13c4640 1 -- 172.21.15.134:0/1556713704 wait complete. 2024-09-15T22:45:12.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:12.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.644+0000 7fe1c50ae640 1 Processor -- start 2024-09-15T22:45:12.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.644+0000 7fe1c50ae640 1 -- start start 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1c50ae640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe1c015e940 0x7fe1c00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1c50ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1c015ed20 0x7fe1c00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1c50ae640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c00b7170 con 0x7fe1c00cef90 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1c50ae640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c00d1ae0 con 0x7fe1c015ed20 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1c50ae640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c00b7aa0 con 0x7fe1c015e940 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1be59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1c015ed20 0x7fe1c00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1bf59e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe1c00cef90 0x7fe1c00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43086/0 (socket says 172.21.15.134:43086) 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1bf59e640 1 -- 172.21.15.134:0/690305077 learned_addr learned my addr 172.21.15.134:0/690305077 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1bed9d640 1 --2- 172.21.15.134:0/690305077 >> v2:172.21.15.177:3300/0 conn(0x7fe1c015e940 0x7fe1c00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1be59c640 1 -- 172.21.15.134:0/690305077 >> v2:172.21.15.177:3300/0 conn(0x7fe1c015e940 msgr2=0x7fe1c00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1be59c640 1 --2- 172.21.15.134:0/690305077 >> v2:172.21.15.177:3300/0 conn(0x7fe1c015e940 0x7fe1c00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1be59c640 1 -- 172.21.15.134:0/690305077 >> v1:172.21.15.134:6789/0 conn(0x7fe1c00cef90 legacy=0x7fe1c00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.645+0000 7fe1be59c640 1 -- 172.21.15.134:0/690305077 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c00d3660 con 0x7fe1c015ed20 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.646+0000 7fe1be59c640 1 --2- 172.21.15.134:0/690305077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c015ed20 0x7fe1c00d15a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00509d0 tx=0x7fe1b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37204bb6f61543be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.646+0000 7fe1bdd9b640 1 -- 172.21.15.134:0/690305077 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0037070 con 0x7fe1c015ed20 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.646+0000 7fe1bdd9b640 1 -- 172.21.15.134:0/690305077 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b0032440 con 0x7fe1c015ed20 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.646+0000 7fe1bdd9b640 1 -- 172.21.15.134:0/690305077 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0032810 con 0x7fe1c015ed20 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 -- 172.21.15.134:0/690305077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c015ed20 msgr2=0x7fe1c00d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/690305077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c015ed20 0x7fe1c00d15a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00509d0 tx=0x7fe1b002a230 comp rx=0 tx=0).stop 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 -- 172.21.15.134:0/690305077 shutdown_connections 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/690305077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c015ed20 0x7fe1c00d15a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/690305077 >> v2:172.21.15.177:3300/0 conn(0x7fe1c015e940 0x7fe1c00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 -- 172.21.15.134:0/690305077 >> 172.21.15.134:0/690305077 conn(0x7fe1c00b6240 msgr2=0x7fe1c00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 -- 172.21.15.134:0/690305077 shutdown_connections 2024-09-15T22:45:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.647+0000 7fe1c50ae640 1 -- 172.21.15.134:0/690305077 wait complete. 2024-09-15T22:45:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.648+0000 7fe1c50ae640 1 Processor -- start 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 -- start start 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1c015e940 0x7fe1c00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1c015ed20 0x7fe1c00afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00d3f00 con 0x7fe1c00cef90 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00d3c20 con 0x7fe1c015e940 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1c50ae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c00d3310 con 0x7fe1c015ed20 2024-09-15T22:45:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1bed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1bed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59116/0 (socket says 172.21.15.134:59116) 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1bed9d640 1 -- 172.21.15.134:0/3309224441 learned_addr learned my addr 172.21.15.134:0/3309224441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.649+0000 7fe1be59c640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1c015e940 0x7fe1c00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bf59e640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1c015ed20 0x7fe1c00afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 -- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1c015ed20 msgr2=0x7fe1c00afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1c015ed20 0x7fe1c00afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 -- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1c015e940 msgr2=0x7fe1c00ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1c015e940 0x7fe1c00ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 -- 172.21.15.134:0/3309224441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c00ae4c0 con 0x7fe1c00cef90 2024-09-15T22:45:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1bed9d640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800d830 tx=0x7fe1a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800b6c0 con 0x7fe1c00cef90 2024-09-15T22:45:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8019070 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c00ae7a0 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800ba80 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.650+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c00aed60 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.651+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7fe1a801e460 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.651+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c00d1ef0 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.651+0000 7fe1b77fe640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 0x7fe1a003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.651+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7fe1a804c120 con 0x7fe1c00cef90 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.652+0000 7fe1be59c640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 0x7fe1a003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.652+0000 7fe1be59c640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 0x7fe1a003a6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0034000 tx=0x7fe1b002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.660+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1a801d580 con 0x7fe1c00cef90 2024-09-15T22:45:12.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.833+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1c00ba6b0 con 0x7fe1c00cef90 2024-09-15T22:45:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.835+0000 7fe1b77fe640 1 -- 172.21.15.134:0/3309224441 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17668 (secure 0 0 0) 0x7fe1a801d7e0 con 0x7fe1c00cef90 2024-09-15T22:45:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:12.837 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:11.152983+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:56.017103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:57.030116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"11.5","mappings":[{"from":1,"to":4}]},{"pgid":"11.27","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/1946867643":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/59152253":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1536265329":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1495337979":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1996904897":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2765650614":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6825/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2376424591":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6824/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2745699943":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/4237567819":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1326277956":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/698139707":"2024-09-16T22:45:11.152915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 msgr2=0x7fe1a003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 0x7fe1a003a6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0034000 tx=0x7fe1b002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 msgr2=0x7fe1c0153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800d830 tx=0x7fe1a800dcf0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 shutdown_connections 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1c015ed20 0x7fe1c00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1c015e940 0x7fe1c00ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe1a0038200 0x7fe1a003a6c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.837+0000 7fe1c50ae640 1 --2- 172.21.15.134:0/3309224441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c00cef90 0x7fe1c0153c10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.838+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 >> 172.21.15.134:0/3309224441 conn(0x7fe1c00b6240 msgr2=0x7fe1c00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.838+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 shutdown_connections 2024-09-15T22:45:12.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.838+0000 7fe1c50ae640 1 -- 172.21.15.134:0/3309224441 wait complete. 2024-09-15T22:45:12.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:45:12.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:12.944 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:12.942+0000 7fca7c60e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:45:12.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.952+0000 7efe82f28640 1 Processor -- start 2024-09-15T22:45:12.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.952+0000 7efe82f28640 1 -- start start 2024-09-15T22:45:12.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.953+0000 7efe82f28640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 0x7efe7c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.953+0000 7efe82f28640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.953+0000 7efe82f28640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7c06cd50 con 0x7efe7c15eb20 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.953+0000 7efe82f28640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efe7c06d610 con 0x7efe7c073c20 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.953+0000 7efe82f28640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c06cfc0 con 0x7efe7c0b5690 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe814c5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe7bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 0x7efe7c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe814c5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:52864/0 (socket says 172.21.15.134:52864) 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe814c5640 1 -- 172.21.15.134:0/2639039023 learned_addr learned my addr 172.21.15.134:0/2639039023 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe80cc4640 1 --1- 172.21.15.134:0/2639039023 >> v1:172.21.15.177:6789/0 conn(0x7efe7c15eb20 0x7efe7c0b6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:49904/0 (socket says 172.21.15.134:49904) 2024-09-15T22:45:12.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe7bfff640 1 -- 172.21.15.134:0/2639039023 >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 msgr2=0x7efe7c06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe7bfff640 1 --2- 172.21.15.134:0/2639039023 >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe7bfff640 1 -- 172.21.15.134:0/2639039023 >> v1:172.21.15.177:6789/0 conn(0x7efe7c15eb20 legacy=0x7efe7c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe7bfff640 1 -- 172.21.15.134:0/2639039023 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c06d2a0 con 0x7efe7c0b5690 2024-09-15T22:45:12.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.954+0000 7efe814c5640 1 --2- 172.21.15.134:0/2639039023 >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.955+0000 7efe7bfff640 1 --2- 172.21.15.134:0/2639039023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 0x7efe7c06daa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe680097a0 tx=0x7efe6802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363e5a481639abc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.955+0000 7efe7b7fe640 1 -- 172.21.15.134:0/2639039023 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68037070 con 0x7efe7c0b5690 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.955+0000 7efe7b7fe640 1 -- 172.21.15.134:0/2639039023 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe68032440 con 0x7efe7c0b5690 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.955+0000 7efe7b7fe640 1 -- 172.21.15.134:0/2639039023 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68032810 con 0x7efe7c0b5690 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 -- 172.21.15.134:0/2639039023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 msgr2=0x7efe7c06daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 --2- 172.21.15.134:0/2639039023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 0x7efe7c06daa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe680097a0 tx=0x7efe6802a180 comp rx=0 tx=0).stop 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 -- 172.21.15.134:0/2639039023 shutdown_connections 2024-09-15T22:45:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 --2- 172.21.15.134:0/2639039023 >> v2:172.21.15.177:3300/0 conn(0x7efe7c073c20 0x7efe7c06dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 --2- 172.21.15.134:0/2639039023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c0b5690 0x7efe7c06daa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 -- 172.21.15.134:0/2639039023 >> 172.21.15.134:0/2639039023 conn(0x7efe7c062630 msgr2=0x7efe7c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 -- 172.21.15.134:0/2639039023 shutdown_connections 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.956+0000 7efe82f28640 1 -- 172.21.15.134:0/2639039023 wait complete. 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.957+0000 7efe82f28640 1 Processor -- start 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.957+0000 7efe82f28640 1 -- start start 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 0x7efe7c148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c15eb20 0x7efe7c0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0b7650 con 0x7efe7c0b5690 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0b74d0 con 0x7efe7c073c20 2024-09-15T22:45:12.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe82f28640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c0b77d0 con 0x7efe7c15eb20 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59130/0 (socket says 172.21.15.134:59130) 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 -- 172.21.15.134:0/2082937700 learned_addr learned my addr 172.21.15.134:0/2082937700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe80cc4640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 0x7efe7c148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe814c5640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c15eb20 0x7efe7c0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 -- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c15eb20 msgr2=0x7efe7c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c15eb20 0x7efe7c0cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 -- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 msgr2=0x7efe7c148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 0x7efe7c148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 -- 172.21.15.134:0/2082937700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c1f7b20 con 0x7efe7c0b5690 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe80cc4640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 0x7efe7c148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:12.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.958+0000 7efe7bfff640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efe68035040 tx=0x7efe680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.959+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68037040 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.959+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe68030500 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.959+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680308d0 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.959+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c1f7dc0 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.959+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c1f8380 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.960+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7efe68044020 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.960+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c0d1fe0 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.960+0000 7efe797fa640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 0x7efe6003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.960+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7efe6806bc90 con 0x7efe7c0b5690 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.960+0000 7efe80cc4640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 0x7efe6003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.961+0000 7efe80cc4640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 0x7efe6003a6c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe70007fd0 tx=0x7efe70007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:12.965+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe6803ac90 con 0x7efe7c0b5690 2024-09-15T22:45:12.991 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:12.989+0000 7fca7c60e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:45:13.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.167+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 14) ==== 45783+0+0 (secure 0 0 0) 0x7efe680a0d50 con 0x7efe7c0b5690 2024-09-15T22:45:13.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.175+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe7c15d080 con 0x7efe7c0b5690 2024-09-15T22:45:13.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.175+0000 7efe797fa640 1 -- 172.21.15.134:0/2082937700 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7efe68038d70 con 0x7efe7c0b5690 2024-09-15T22:45:13.177 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:13.177 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:13.177 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 msgr2=0x7efe6003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 0x7efe6003a6c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe70007fd0 tx=0x7efe70007e80 comp rx=0 tx=0).stop 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 msgr2=0x7efe7c0cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efe68035040 tx=0x7efe680046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 shutdown_connections 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe7c15eb20 0x7efe7c0cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe60038200 0x7efe6003a6c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe7c0b5690 0x7efe7c0cd730 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 --2- 172.21.15.134:0/2082937700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe7c073c20 0x7efe7c148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.177+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 >> 172.21.15.134:0/2082937700 conn(0x7efe7c062630 msgr2=0x7efe7c15db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.178+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 shutdown_connections 2024-09-15T22:45:13.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.178+0000 7efe82f28640 1 -- 172.21.15.134:0/2082937700 wait complete. 2024-09-15T22:45:13.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.293+0000 7f54e2586640 1 Processor -- start 2024-09-15T22:45:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.293+0000 7f54e2586640 1 -- start start 2024-09-15T22:45:13.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e2586640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f54dc15ed20 0x7f54dc0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e2586640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54dc0cef90 0x7f54dc0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e2586640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54dc0b7170 con 0x7f54dc15e940 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e2586640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc0b7aa0 con 0x7f54dc0cef90 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e2586640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc0d3660 con 0x7f54dc15ed20 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54dbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f54dc15e940 0x7f54dc0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43094/0 (socket says 172.21.15.134:43094) 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54dbfff640 1 -- 172.21.15.134:0/2355279316 learned_addr learned my addr 172.21.15.134:0/2355279316 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e0b23640 1 --2- 172.21.15.134:0/2355279316 >> v2:172.21.15.134:3300/0 conn(0x7f54dc0cef90 0x7f54dc0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54db7fe640 1 --2- 172.21.15.134:0/2355279316 >> v2:172.21.15.177:3300/0 conn(0x7f54dc15ed20 0x7f54dc0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e0b23640 1 -- 172.21.15.134:0/2355279316 >> v2:172.21.15.177:3300/0 conn(0x7f54dc15ed20 msgr2=0x7f54dc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e0b23640 1 --2- 172.21.15.134:0/2355279316 >> v2:172.21.15.177:3300/0 conn(0x7f54dc15ed20 0x7f54dc0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e0b23640 1 -- 172.21.15.134:0/2355279316 >> v1:172.21.15.134:6789/0 conn(0x7f54dc15e940 legacy=0x7f54dc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54e0b23640 1 -- 172.21.15.134:0/2355279316 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc0d3940 con 0x7f54dc0cef90 2024-09-15T22:45:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.294+0000 7f54daffd640 1 -- 172.21.15.134:0/2355279316 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237115885 0 0) 0x7f54cc001110 con 0x7f54dc15e940 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.295+0000 7f54e0b23640 1 --2- 172.21.15.134:0/2355279316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc0cef90 0x7f54dc0b3760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06e900 tx=0x7f54d402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e019e9480e3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.295+0000 7f54daffd640 1 -- 172.21.15.134:0/2355279316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4007740 con 0x7f54dc0cef90 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.295+0000 7f54daffd640 1 -- 172.21.15.134:0/2355279316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40078e0 con 0x7f54dc0cef90 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.295+0000 7f54daffd640 1 -- 172.21.15.134:0/2355279316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4007cb0 con 0x7f54dc0cef90 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 -- 172.21.15.134:0/2355279316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc0cef90 msgr2=0x7f54dc0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 --2- 172.21.15.134:0/2355279316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc0cef90 0x7f54dc0b3760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06e900 tx=0x7f54d402a710 comp rx=0 tx=0).stop 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 -- 172.21.15.134:0/2355279316 shutdown_connections 2024-09-15T22:45:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 --2- 172.21.15.134:0/2355279316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc0cef90 0x7f54dc0b3760 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 --2- 172.21.15.134:0/2355279316 >> v2:172.21.15.177:3300/0 conn(0x7f54dc15ed20 0x7f54dc0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 -- 172.21.15.134:0/2355279316 >> 172.21.15.134:0/2355279316 conn(0x7f54dc0b6240 msgr2=0x7f54dc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 -- 172.21.15.134:0/2355279316 shutdown_connections 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.296+0000 7f54e2586640 1 -- 172.21.15.134:0/2355279316 wait complete. 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.297+0000 7f54e2586640 1 Processor -- start 2024-09-15T22:45:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.297+0000 7f54e2586640 1 -- start start 2024-09-15T22:45:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54dc0cef90 0x7f54dc15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54dc15ed20 0x7f54dc158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0d3310 con 0x7f54dc15e940 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0d3f00 con 0x7f54dc0cef90 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e2586640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc0d1ef0 con 0x7f54dc15ed20 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59146/0 (socket says 172.21.15.134:59146) 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 -- 172.21.15.134:0/1915223737 learned_addr learned my addr 172.21.15.134:0/1915223737 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54dbfff640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54dc0cef90 0x7f54dc15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54e0b23640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54dc15ed20 0x7f54dc158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 -- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54dc15ed20 msgr2=0x7f54dc158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54dc15ed20 0x7f54dc158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 -- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54dc0cef90 msgr2=0x7f54dc15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54dc0cef90 0x7f54dc15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 -- 172.21.15.134:0/1915223737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc1e73c0 con 0x7f54dc15e940 2024-09-15T22:45:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.298+0000 7f54db7fe640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e840 tx=0x7f54c400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.299+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4017070 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.299+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c400c940 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.299+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c400cd10 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.299+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc15b830 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.299+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc1e7940 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.300+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc0d1060 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.300+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) ==== 45783+0+0 (secure 0 0 0) 0x7f54c401a070 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.300+0000 7f54d8ff9640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 0x7f54bc03a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.300+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7f54c404bc90 con 0x7f54dc15e940 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.300+0000 7f54dbfff640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 0x7f54bc03a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.301+0000 7f54dbfff640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 0x7f54bc03a930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54cc000f60 tx=0x7f54cc007b50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.305+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54c4011350 con 0x7f54dc15e940 2024-09-15T22:45:13.325 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.324+0000 7fca7c60e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:45:13.412 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.411+0000 7fca7c60e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:45:13.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.511+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54dc0b8ea0 con 0x7f54dc15e940 2024-09-15T22:45:13.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.512+0000 7f54d8ff9640 1 -- 172.21.15.134:0/1915223737 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5234 (secure 0 0 0) 0x7f54c4013c70 con 0x7f54dc15e940 2024-09-15T22:45:13.514 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:13.514 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"btime":"2024-09-15T22:45:06:755961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:44:58.056856+0000","modified":"2024-09-15T22:45:00.054597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6836/1551084696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1551084696},{"type":"v1","addr":"172.21.15.134:6836","nonce":1551084696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6117,"qdb_cluster":[6117]},"id":5}]} 2024-09-15T22:45:13.514 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-09-15T22:45:13.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 msgr2=0x7f54bc03a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 0x7f54bc03a930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54cc000f60 tx=0x7f54cc007b50 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 msgr2=0x7f54dc0cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e840 tx=0x7f54c400ed00 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 shutdown_connections 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54dc15ed20 0x7f54dc158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f54bc038470 0x7f54bc03a930 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54dc15e940 0x7f54dc0cda60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 --2- 172.21.15.134:0/1915223737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54dc0cef90 0x7f54dc15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 >> 172.21.15.134:0/1915223737 conn(0x7f54dc0b6240 msgr2=0x7f54dc0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 shutdown_connections 2024-09-15T22:45:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.514+0000 7f54e2586640 1 -- 172.21.15.134:0/1915223737 wait complete. 2024-09-15T22:45:13.522 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.521+0000 7fca7c60e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:13.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:13.569 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.567+0000 7fca7c60e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:45:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.625+0000 7f439cd6d640 1 Processor -- start 2024-09-15T22:45:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.625+0000 7f439cd6d640 1 -- start start 2024-09-15T22:45:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439cd6d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f439806e570 0x7f43980712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439cd6d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f43980b6a20 0x7f43980b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439cd6d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398071830 con 0x7f439815c250 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439cd6d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f43980b7870 con 0x7f439806e570 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439cd6d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f43980708a0 con 0x7f43980b6a20 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f439806e570 0x7f43980712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439659c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f439815c250 0x7f439815f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43104/0 (socket says 172.21.15.134:43104) 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f439806e570 0x7f43980712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59162/0 (socket says 172.21.15.134:59162) 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f439659c640 1 -- 172.21.15.134:0/1338190792 learned_addr learned my addr 172.21.15.134:0/1338190792 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4396d9d640 1 --2- 172.21.15.134:0/1338190792 >> v2:172.21.15.177:3300/0 conn(0x7f43980b6a20 0x7f43980b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 -- 172.21.15.134:0/1338190792 >> v2:172.21.15.177:3300/0 conn(0x7f43980b6a20 msgr2=0x7f43980b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 --2- 172.21.15.134:0/1338190792 >> v2:172.21.15.177:3300/0 conn(0x7f43980b6a20 0x7f43980b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 -- 172.21.15.134:0/1338190792 >> v1:172.21.15.134:6789/0 conn(0x7f439815c250 legacy=0x7f439815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.626+0000 7f4395d9b640 1 -- 172.21.15.134:0/1338190792 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439806ea10 con 0x7f439806e570 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.627+0000 7f4395d9b640 1 --2- 172.21.15.134:0/1338190792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f43980712f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f43980b41b0 tx=0x7f438c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bbee6b9f57b9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.627+0000 7f439559a640 1 -- 172.21.15.134:0/1338190792 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c037070 con 0x7f439806e570 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.627+0000 7f439559a640 1 -- 172.21.15.134:0/1338190792 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438c032440 con 0x7f439806e570 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.627+0000 7f439559a640 1 -- 172.21.15.134:0/1338190792 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c032810 con 0x7f439806e570 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 -- 172.21.15.134:0/1338190792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 msgr2=0x7f43980712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 --2- 172.21.15.134:0/1338190792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f43980712f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f43980b41b0 tx=0x7f438c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 -- 172.21.15.134:0/1338190792 shutdown_connections 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 --2- 172.21.15.134:0/1338190792 >> v2:172.21.15.177:3300/0 conn(0x7f43980b6a20 0x7f43980b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 --2- 172.21.15.134:0/1338190792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f43980712f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 -- 172.21.15.134:0/1338190792 >> 172.21.15.134:0/1338190792 conn(0x7f43980b4220 msgr2=0x7f43980b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 -- 172.21.15.134:0/1338190792 shutdown_connections 2024-09-15T22:45:13.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.628+0000 7f439cd6d640 1 -- 172.21.15.134:0/1338190792 wait complete. 2024-09-15T22:45:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.629+0000 7f439cd6d640 1 Processor -- start 2024-09-15T22:45:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.629+0000 7f439cd6d640 1 -- start start 2024-09-15T22:45:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43980b6a20 0x7f4398154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439815c250 0x7f4398153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4398070af0 con 0x7f439806e570 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4398070e60 con 0x7f439815c250 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439cd6d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f439815c630 con 0x7f43980b6a20 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59170/0 (socket says 172.21.15.134:59170) 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 -- 172.21.15.134:0/2129301920 learned_addr learned my addr 172.21.15.134:0/2129301920 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 -- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43980b6a20 msgr2=0x7f4398154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43980b6a20 0x7f4398154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 -- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439815c250 msgr2=0x7f4398153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439815c250 0x7f4398153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 -- 172.21.15.134:0/2129301920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398152af0 con 0x7f439806e570 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.630+0000 7f439659c640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f438800c400 tx=0x7f438800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.631+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388017070 con 0x7f439806e570 2024-09-15T22:45:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.631+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388005ce0 con 0x7f439806e570 2024-09-15T22:45:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.631+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43880072f0 con 0x7f439806e570 2024-09-15T22:45:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.631+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4398152dd0 con 0x7f439806e570 2024-09-15T22:45:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.631+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4398156670 con 0x7f439806e570 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.632+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) ==== 45783+0+0 (secure 0 0 0) 0x7f438801a070 con 0x7f439806e570 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.632+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980712f0 con 0x7f439806e570 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.632+0000 7f4386ffd640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 0x7f437803a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.632+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7f438804b220 con 0x7f439806e570 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.632+0000 7f4395d9b640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 0x7f437803a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.633+0000 7f4395d9b640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 0x7f437803a930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f438c034000 tx=0x7f438c02c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.637+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4388019e10 con 0x7f439806e570 2024-09-15T22:45:13.684 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.683+0000 7fca7c60e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:45:13.739 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.738+0000 7fca7c60e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:45:13.782 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.780+0000 7fca7c60e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:45:13.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.811+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43980b7650 con 0x7f439806e570 2024-09-15T22:45:13.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.812+0000 7f4386ffd640 1 -- 172.21.15.134:0/2129301920 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17668 (secure 0 0 0) 0x7f4388010e10 con 0x7f439806e570 2024-09-15T22:45:13.814 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:11.152983+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:44:56.017103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T22:44:57.030116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"11.5","mappings":[{"from":1,"to":4}]},{"pgid":"11.27","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/1946867643":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/59152253":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1536265329":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1495337979":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1996904897":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2765650614":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6825/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2376424591":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6824/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2745699943":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/4237567819":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1326277956":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/698139707":"2024-09-16T22:45:11.152915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.814+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 msgr2=0x7f437803a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 0x7f437803a930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f438c034000 tx=0x7f438c02c000 comp rx=0 tx=0).stop 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 msgr2=0x7f4398151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f438800c400 tx=0x7f438800c8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 shutdown_connections 2024-09-15T22:45:13.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439815c250 0x7f4398153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43980b6a20 0x7f4398154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4378038470 0x7f437803a930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 --2- 172.21.15.134:0/2129301920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439806e570 0x7f4398151100 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 >> 172.21.15.134:0/2129301920 conn(0x7f43980b4220 msgr2=0x7f4398160f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 shutdown_connections 2024-09-15T22:45:13.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.815+0000 7f439cd6d640 1 -- 172.21.15.134:0/2129301920 wait complete. 2024-09-15T22:45:13.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:45:13.899 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.898+0000 7fca7c60e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:45:13.950 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:13.948+0000 7fca7c60e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:45:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.967+0000 7f22d0f2c640 1 Processor -- start 2024-09-15T22:45:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.967+0000 7f22d0f2c640 1 -- start start 2024-09-15T22:45:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.968+0000 7f22d0f2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f22cc15ed20 0x7f22cc0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.968+0000 7f22d0f2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22cc0cef90 0x7f22cc0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.968+0000 7f22d0f2c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc0b7170 con 0x7f22cc15e940 2024-09-15T22:45:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.968+0000 7f22d0f2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0b7aa0 con 0x7f22cc0cef90 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.968+0000 7f22d0f2c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0d3660 con 0x7f22cc15ed20 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22cc0cef90 0x7f22cc0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22cc0cef90 0x7f22cc0b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59174/0 (socket says 172.21.15.134:59174) 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 -- 172.21.15.134:0/218555452 learned_addr learned my addr 172.21.15.134:0/218555452 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22c9d9b640 1 --2- 172.21.15.134:0/218555452 >> v2:172.21.15.177:3300/0 conn(0x7f22cc15ed20 0x7f22cc0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 -- 172.21.15.134:0/218555452 >> v2:172.21.15.177:3300/0 conn(0x7f22cc15ed20 msgr2=0x7f22cc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 --2- 172.21.15.134:0/218555452 >> v2:172.21.15.177:3300/0 conn(0x7f22cc15ed20 0x7f22cc0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 -- 172.21.15.134:0/218555452 >> v1:172.21.15.177:6789/0 conn(0x7f22cc15e940 legacy=0x7f22cc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.969+0000 7f22cad9d640 1 -- 172.21.15.134:0/218555452 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc0d3940 con 0x7f22cc0cef90 2024-09-15T22:45:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.970+0000 7f22cad9d640 1 --2- 172.21.15.134:0/218555452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc0cef90 0x7f22cc0b3760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06e900 tx=0x7f22c402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ed6ae51c55ca18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.970+0000 7f22c959a640 1 -- 172.21.15.134:0/218555452 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4037070 con 0x7f22cc0cef90 2024-09-15T22:45:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.970+0000 7f22c959a640 1 -- 172.21.15.134:0/218555452 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c402ae50 con 0x7f22cc0cef90 2024-09-15T22:45:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.970+0000 7f22c959a640 1 -- 172.21.15.134:0/218555452 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4032860 con 0x7f22cc0cef90 2024-09-15T22:45:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 -- 172.21.15.134:0/218555452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc0cef90 msgr2=0x7f22cc0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/218555452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc0cef90 0x7f22cc0b3760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06e900 tx=0x7f22c402a300 comp rx=0 tx=0).stop 2024-09-15T22:45:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 -- 172.21.15.134:0/218555452 shutdown_connections 2024-09-15T22:45:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/218555452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc0cef90 0x7f22cc0b3760 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/218555452 >> v2:172.21.15.177:3300/0 conn(0x7f22cc15ed20 0x7f22cc0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 -- 172.21.15.134:0/218555452 >> 172.21.15.134:0/218555452 conn(0x7f22cc0b6240 msgr2=0x7f22cc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 -- 172.21.15.134:0/218555452 shutdown_connections 2024-09-15T22:45:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.971+0000 7f22d0f2c640 1 -- 172.21.15.134:0/218555452 wait complete. 2024-09-15T22:45:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.973+0000 7f22d0f2c640 1 Processor -- start 2024-09-15T22:45:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.973+0000 7f22d0f2c640 1 -- start start 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 0x7f22cc14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22cc15ed20 0x7f22cc15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0d3310 con 0x7f22cc15e940 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0d3f00 con 0x7f22cc0cef90 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc0d1ef0 con 0x7f22cc15ed20 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59190/0 (socket says 172.21.15.134:59190) 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 -- 172.21.15.134:0/1987481568 learned_addr learned my addr 172.21.15.134:0/1987481568 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22cad9d640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22cc15ed20 0x7f22cc15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22ca59c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 0x7f22cc14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 -- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22cc15ed20 msgr2=0x7f22cc15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22cc15ed20 0x7f22cc15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 -- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 msgr2=0x7f22cc14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 0x7f22cc14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 -- 172.21.15.134:0/1987481568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc158a00 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22ca59c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 0x7f22cc14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c9d9b640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f22b400e840 tx=0x7f22b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4017070 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b400c940 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.975+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc158ce0 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.976+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b400cd10 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.976+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc159580 con 0x7f22cc15e940 2024-09-15T22:45:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.977+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) ==== 45783+0+0 (secure 0 0 0) 0x7f22b401a070 con 0x7f22cc15e940 2024-09-15T22:45:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.976+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22cc0d1060 con 0x7f22cc15e940 2024-09-15T22:45:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.977+0000 7f22c2ffd640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 0x7f22ac03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.977+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6355+0+0 (secure 0 0 0) 0x7f22b404c060 con 0x7f22cc15e940 2024-09-15T22:45:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.977+0000 7f22ca59c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 0x7f22ac03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.978+0000 7f22ca59c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 0x7f22ac03a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001e00 tx=0x7f22bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:13.981+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22b4024350 con 0x7f22cc15e940 2024-09-15T22:45:14.003 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:14.001+0000 7fca7c60e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:45:14.057 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:14.056+0000 7fca7c60e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:14.101 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:14.100+0000 7fca7c60e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:45:14.144 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:14.143+0000 7fca7c60e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:45:14.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.189+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f22cc0ba6b0 con 0x7f22cc15e940 2024-09-15T22:45:14.190 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:45:14.189+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:45:14.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.191+0000 7f22c2ffd640 1 -- 172.21.15.134:0/1987481568 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7f22b4013c70 con 0x7f22cc15e940 2024-09-15T22:45:14.192 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:45:14.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 msgr2=0x7f22ac03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 0x7f22ac03a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001e00 tx=0x7f22bc009040 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 msgr2=0x7f22cc0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f22b400e840 tx=0x7f22b400ed00 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 shutdown_connections 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22cc15ed20 0x7f22cc15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f22ac038440 0x7f22ac03a900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22cc15e940 0x7f22cc0ce330 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 --2- 172.21.15.134:0/1987481568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22cc0cef90 0x7f22cc14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 >> 172.21.15.134:0/1987481568 conn(0x7f22cc0b6240 msgr2=0x7f22cc0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 shutdown_connections 2024-09-15T22:45:14.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.194+0000 7f22d0f2c640 1 -- 172.21.15.134:0/1987481568 wait complete. 2024-09-15T22:45:14.198 INFO:tasks.ceph.mds.a.smithi134.stderr: -7195> 2024-09-15T22:45:03.968+0000 7f935ca7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:45:14.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:45:14.231 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:45:14.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.331+0000 7f1a16586640 1 Processor -- start 2024-09-15T22:45:14.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.331+0000 7f1a16586640 1 -- start start 2024-09-15T22:45:14.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a16586640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 0x7f1a1006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a16586640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a100cf9a0 con 0x7f1a100b3290 2024-09-15T22:45:14.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a16586640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a10162210 con 0x7f1a10161e30 2024-09-15T22:45:14.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a16586640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a100cfcf0 con 0x7f1a100b3d50 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a14b23640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1a100b3290 0x7f1a100b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43114/0 (socket says 172.21.15.134:43114) 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.332+0000 7f1a14b23640 1 -- 172.21.15.134:0/2429971781 learned_addr learned my addr 172.21.15.134:0/2429971781 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0f7fe640 1 --2- 172.21.15.134:0/2429971781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 0x7f1a1006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735354393 0 0) 0x7f1a100cf9a0 con 0x7f1a100b3290 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19fc003520 con 0x7f1a100b3290 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115277010 0 0) 0x7f1a10162210 con 0x7f1a10161e30 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a100cf9a0 con 0x7f1a10161e30 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0f7fe640 1 -- 172.21.15.134:0/2429971781 >> v1:172.21.15.177:6789/0 conn(0x7f1a10161e30 legacy=0x7f1a100d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0f7fe640 1 -- 172.21.15.134:0/2429971781 >> v1:172.21.15.134:6789/0 conn(0x7f1a100b3290 legacy=0x7f1a100b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.333+0000 7f1a0f7fe640 1 -- 172.21.15.134:0/2429971781 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100d5210 con 0x7f1a100b3d50 2024-09-15T22:45:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a0f7fe640 1 --2- 172.21.15.134:0/2429971781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 0x7f1a1006d8c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f80097d0 tx=0x7f19f802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6235684a37cfb05f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8037070 con 0x7f1a100b3d50 2024-09-15T22:45:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f8032440 con 0x7f1a100b3d50 2024-09-15T22:45:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a0effd640 1 -- 172.21.15.134:0/2429971781 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80327f0 con 0x7f1a100b3d50 2024-09-15T22:45:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 -- 172.21.15.134:0/2429971781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 msgr2=0x7f1a1006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 --2- 172.21.15.134:0/2429971781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 0x7f1a1006d8c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f80097d0 tx=0x7f19f802a210 comp rx=0 tx=0).stop 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 -- 172.21.15.134:0/2429971781 shutdown_connections 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 --2- 172.21.15.134:0/2429971781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3d50 0x7f1a1006d8c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 -- 172.21.15.134:0/2429971781 >> 172.21.15.134:0/2429971781 conn(0x7f1a100d1870 msgr2=0x7f1a100d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.334+0000 7f1a16586640 1 -- 172.21.15.134:0/2429971781 shutdown_connections 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.335+0000 7f1a16586640 1 -- 172.21.15.134:0/2429971781 wait complete. 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.336+0000 7f1a16586640 1 Processor -- start 2024-09-15T22:45:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.336+0000 7f1a16586640 1 -- start start 2024-09-15T22:45:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3290 0x7f1a100abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a100b3d50 0x7f1a10151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1006de00 con 0x7f1a10161e30 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100b3950 con 0x7f1a100b3d50 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a16586640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1006df80 con 0x7f1a100b3290 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59216/0 (socket says 172.21.15.134:59216) 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 -- 172.21.15.134:0/4286663153 learned_addr learned my addr 172.21.15.134:0/4286663153 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a0ffff640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3290 0x7f1a100abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a0f7fe640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a100b3d50 0x7f1a10151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 -- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3290 msgr2=0x7f1a100abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3290 0x7f1a100abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 -- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a100b3d50 msgr2=0x7f1a10151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a100b3d50 0x7f1a10151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 -- 172.21.15.134:0/4286663153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100cd5b0 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a14b23640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800caa0 tx=0x7f1a0800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08017070 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.337+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0800ac20 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.338+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08012640 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.338+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a100cd890 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.338+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a100cde50 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.339+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) ==== 45783+0+0 (secure 0 0 0) 0x7f1a0801a070 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.339+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a100ce050 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.339+0000 7f1a0cff9640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 0x7f19f003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.339+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6441+0+0 (secure 0 0 0) 0x7f1a0804bc40 con 0x7f1a10161e30 2024-09-15T22:45:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.339+0000 7f1a0ffff640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 0x7f19f003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.340+0000 7f1a0ffff640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 0x7f19f003a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1a000011e0 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.348+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a100ce050 con 0x7f1a10161e30 2024-09-15T22:45:14.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:14.555+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1a10162210 con 0x7f1a10161e30 2024-09-15T22:45:14.735 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-15T22:45:14.734+0000 7fca7c60e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:45:15.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.198+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f1a080078c0 con 0x7f1a10161e30 2024-09-15T22:45:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.202+0000 7f1a0cff9640 1 -- 172.21.15.134:0/4286663153 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f1a0805d160 con 0x7f1a10161e30 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 msgr2=0x7f19f003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 0x7f19f003a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1a000011e0 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 msgr2=0x7f1a100ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800caa0 tx=0x7f1a0800cf60 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 shutdown_connections 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19f0038440 0x7f19f003a900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a10161e30 0x7f1a100ce370 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a100b3d50 0x7f1a10151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 --2- 172.21.15.134:0/4286663153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a100b3290 0x7f1a100abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 >> 172.21.15.134:0/4286663153 conn(0x7f1a100d1870 msgr2=0x7f1a100b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 shutdown_connections 2024-09-15T22:45:15.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.205+0000 7f1a16586640 1 -- 172.21.15.134:0/4286663153 wait complete. 2024-09-15T22:45:15.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:45:15.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.321+0000 7f94d6fe4640 1 Processor -- start 2024-09-15T22:45:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.321+0000 7f94d6fe4640 1 -- start start 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d6fe4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 0x7f94d0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d6fe4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d015c970 con 0x7f94d006f130 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d6fe4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d015bbb0 con 0x7f94d015f9f0 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d6fe4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f94d015fef0 con 0x7f94d015b370 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d5581640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f94d006f130 0x7f94d00ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43122/0 (socket says 172.21.15.134:43122) 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d5581640 1 -- 172.21.15.134:0/3713196316 learned_addr learned my addr 172.21.15.134:0/3713196316 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94d4d80640 1 --2- 172.21.15.134:0/3713196316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 0x7f94d0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.322+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99351531 0 0) 0x7f94d015c970 con 0x7f94d006f130 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b8003520 con 0x7f94d006f130 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725948692 0 0) 0x7f94d015bbb0 con 0x7f94d015f9f0 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d015c970 con 0x7f94d015f9f0 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94d4d80640 1 -- 172.21.15.134:0/3713196316 >> v1:172.21.15.177:6789/0 conn(0x7f94d015f9f0 legacy=0x7f94d006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928361227 0 0) 0x7f94b8003520 con 0x7f94d006f130 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94d4d80640 1 -- 172.21.15.134:0/3713196316 >> v1:172.21.15.134:6789/0 conn(0x7f94d006f130 legacy=0x7f94d00ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94d4d80640 1 -- 172.21.15.134:0/3713196316 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d015be90 con 0x7f94d015b370 2024-09-15T22:45:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.323+0000 7f94d4d80640 1 --2- 172.21.15.134:0/3713196316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 0x7f94d0072560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0097d0 tx=0x7f94cc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdcc1c4fef8082b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc037070 con 0x7f94d015b370 2024-09-15T22:45:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc02ab90 con 0x7f94d015b370 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94c77fe640 1 -- 172.21.15.134:0/3713196316 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c80019f0 con 0x7f94d015b370 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3713196316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 msgr2=0x7f94d0072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3713196316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 0x7f94d0072560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0097d0 tx=0x7f94cc02a100 comp rx=0 tx=0).stop 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3713196316 shutdown_connections 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3713196316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015b370 0x7f94d0072560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3713196316 >> 172.21.15.134:0/3713196316 conn(0x7f94d006bba0 msgr2=0x7f94d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3713196316 shutdown_connections 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.324+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3713196316 wait complete. 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.325+0000 7f94d6fe4640 1 Processor -- start 2024-09-15T22:45:15.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.325+0000 7f94d6fe4640 1 -- start start 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d006f130 0x7f94d00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015f9f0 0x7f94d0154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94d00731b0 con 0x7f94d015b370 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94d015c450 con 0x7f94d006f130 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d6fe4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f94d015b750 con 0x7f94d015f9f0 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59222/0 (socket says 172.21.15.134:59222) 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94c7fff640 1 -- 172.21.15.134:0/3510932316 learned_addr learned my addr 172.21.15.134:0/3510932316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d5581640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015f9f0 0x7f94d0154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.326+0000 7f94d4d80640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d006f130 0x7f94d00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 -- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015f9f0 msgr2=0x7f94d0154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015f9f0 0x7f94d0154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 -- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d006f130 msgr2=0x7f94d00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d006f130 0x7f94d00af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 -- 172.21.15.134:0/3510932316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d00af9e0 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c7fff640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f94c000c430 tx=0x7f94c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0017070 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c00052d0 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d0152440 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0003830 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.327+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d0152a00 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.328+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d0072560 con 0x7f94d015b370 2024-09-15T22:45:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.329+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f94c001a070 con 0x7f94d015b370 2024-09-15T22:45:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.329+0000 7f94c57fa640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 0x7f94bc06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.329+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6441+0+0 (secure 0 0 0) 0x7f94c008ac40 con 0x7f94d015b370 2024-09-15T22:45:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.329+0000 7f94d4d80640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 0x7f94bc06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.329+0000 7f94d4d80640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 0x7f94bc06e8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:15.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.333+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94d00af9e0 con 0x7f94d015b370 2024-09-15T22:45:15.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:15.498+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f94d00b12e0 con 0x7f94d015b370 2024-09-15T22:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.203+0000 7f94c57fa640 1 -- 172.21.15.134:0/3510932316 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f94c0058a30 con 0x7f94d015b370 2024-09-15T22:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.207+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 msgr2=0x7f94bc06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.207+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 0x7f94bc06e8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.207+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 msgr2=0x7f94d0154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.207+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f94c000c430 tx=0x7f94c000c8f0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 shutdown_connections 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d015f9f0 0x7f94d0154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f94bc06c400 0x7f94bc06e8c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d015b370 0x7f94d0154010 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 --2- 172.21.15.134:0/3510932316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d006f130 0x7f94d00af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 >> 172.21.15.134:0/3510932316 conn(0x7f94d006bba0 msgr2=0x7f94d00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 shutdown_connections 2024-09-15T22:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.208+0000 7f94d6fe4640 1 -- 172.21.15.134:0/3510932316 wait complete. 2024-09-15T22:45:16.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.329+0000 7f772441e640 1 Processor -- start 2024-09-15T22:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.329+0000 7f772441e640 1 -- start start 2024-09-15T22:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f772441e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 0x7f771c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f772441e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 0x7f771c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f772441e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771c0b3570 con 0x7f771c0ccb80 2024-09-15T22:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f772441e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f771c0b3850 con 0x7f771c0b4e20 2024-09-15T22:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f772441e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f771c0b3b30 con 0x7f771c072d10 2024-09-15T22:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77229bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 0x7f771c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77219b9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 0x7f771c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77221ba640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f771c0ccb80 0x7f771c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48468/0 (socket says 172.21.15.134:48468) 2024-09-15T22:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77221ba640 1 -- 172.21.15.134:0/1879305025 learned_addr learned my addr 172.21.15.134:0/1879305025 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77229bb640 1 -- 172.21.15.134:0/1879305025 >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 msgr2=0x7f771c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.330+0000 7f77229bb640 1 --2- 172.21.15.134:0/1879305025 >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 0x7f771c15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.331+0000 7f77229bb640 1 -- 172.21.15.134:0/1879305025 >> v1:172.21.15.177:6789/0 conn(0x7f771c0ccb80 legacy=0x7f771c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.331+0000 7f77229bb640 1 -- 172.21.15.134:0/1879305025 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c0b3e10 con 0x7f771c072d10 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.331+0000 7f77219b9640 1 --2- 172.21.15.134:0/1879305025 >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 0x7f771c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.331+0000 7f77229bb640 1 --2- 172.21.15.134:0/1879305025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 0x7f771c06db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7714009d90 tx=0x7f771402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb2c0d0f8586935 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.331+0000 7f77211b8640 1 -- 172.21.15.134:0/1879305025 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714007740 con 0x7f771c072d10 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f77211b8640 1 -- 172.21.15.134:0/1879305025 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77140078e0 con 0x7f771c072d10 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f77211b8640 1 -- 172.21.15.134:0/1879305025 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714007cb0 con 0x7f771c072d10 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 -- 172.21.15.134:0/1879305025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 msgr2=0x7f771c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 --2- 172.21.15.134:0/1879305025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 0x7f771c06db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7714009d90 tx=0x7f771402a660 comp rx=0 tx=0).stop 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 -- 172.21.15.134:0/1879305025 shutdown_connections 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 --2- 172.21.15.134:0/1879305025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c072d10 0x7f771c06db10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 --2- 172.21.15.134:0/1879305025 >> v2:172.21.15.177:3300/0 conn(0x7f771c0b4e20 0x7f771c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 -- 172.21.15.134:0/1879305025 >> 172.21.15.134:0/1879305025 conn(0x7f771c06bba0 msgr2=0x7f771c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 -- 172.21.15.134:0/1879305025 shutdown_connections 2024-09-15T22:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.332+0000 7f772441e640 1 -- 172.21.15.134:0/1879305025 wait complete. 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.333+0000 7f772441e640 1 Processor -- start 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.333+0000 7f772441e640 1 -- start start 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 0x7f771c13c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 0x7f771c13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0ccf60 con 0x7f771c0ccb80 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b43d0 con 0x7f771c072d10 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f772441e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f771c06d080 con 0x7f771c0b4e20 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f77229bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f77229bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35528/0 (socket says 172.21.15.134:35528) 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f77229bb640 1 -- 172.21.15.134:0/776995571 learned_addr learned my addr 172.21.15.134:0/776995571 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f77221ba640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 0x7f771c13c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.334+0000 7f77219b9640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 0x7f771c13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 -- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 msgr2=0x7f771c13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 0x7f771c13cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 -- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 msgr2=0x7f771c13c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 0x7f771c13c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 -- 172.21.15.134:0/776995571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c0ce990 con 0x7f771c0ccb80 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77221ba640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 0x7f771c13c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77219b9640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 0x7f771c13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f77229bb640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f771402ac50 tx=0x7f7714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714040070 con 0x7f771c0ccb80 2024-09-15T22:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714031c60 con 0x7f771c0ccb80 2024-09-15T22:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c0cec50 con 0x7f771c0ccb80 2024-09-15T22:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714009450 con 0x7f771c0ccb80 2024-09-15T22:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.335+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c0cf210 con 0x7f771c0ccb80 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.336+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c06d4e0 con 0x7f771c0ccb80 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.336+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f7714039040 con 0x7f771c0ccb80 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.337+0000 7f7712ffd640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 0x7f770006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.337+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5974+0+0 (secure 0 0 0) 0x7f77140acbe0 con 0x7f771c0ccb80 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.337+0000 7f77221ba640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 0x7f770006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.338+0000 7f77221ba640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 0x7f770006e890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7718000f60 tx=0x7f7718009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.341+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f771407b020 con 0x7f771c0ccb80 2024-09-15T22:45:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:16.506+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f771c159d50 con 0x7f771c0ccb80 2024-09-15T22:45:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.210+0000 7f7712ffd640 1 -- 172.21.15.134:0/776995571 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7f771407a920 con 0x7f771c0ccb80 2024-09-15T22:45:17.211 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 msgr2=0x7f770006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 0x7f770006e890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7718000f60 tx=0x7f7718009040 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 msgr2=0x7f771c15bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f771402ac50 tx=0x7f7714004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 shutdown_connections 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f770006c3d0 0x7f770006e890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f771c0ccb80 0x7f771c15bd90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f771c0b4e20 0x7f771c13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 --2- 172.21.15.134:0/776995571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f771c072d10 0x7f771c13c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 >> 172.21.15.134:0/776995571 conn(0x7f771c06bba0 msgr2=0x7f771c06ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 shutdown_connections 2024-09-15T22:45:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.212+0000 7f772441e640 1 -- 172.21.15.134:0/776995571 wait complete. 2024-09-15T22:45:17.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:45:17.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.337+0000 7f84bcd68640 1 Processor -- start 2024-09-15T22:45:17.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.337+0000 7f84bcd68640 1 -- start start 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84bcd68640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84b80b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84bcd68640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84b80715b0 0x7f84b815b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84bcd68640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b8071de0 con 0x7f84b815b9b0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84bcd68640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f84b80720c0 con 0x7f84b80715b0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84bcd68640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84b80723a0 con 0x7f84b815b090 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b6d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f84b815b9b0 0x7f84b806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56250/0 (socket says 172.21.15.134:56250) 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b6d9d640 1 -- 172.21.15.134:0/2669137033 learned_addr learned my addr 172.21.15.134:0/2669137033 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2669137033 >> v2:172.21.15.177:3300/0 conn(0x7f84b80715b0 0x7f84b815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b659c640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84b80b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74006202 0 0) 0x7f84b8071de0 con 0x7f84b815b9b0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a0003520 con 0x7f84b815b9b0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1626001383 0 0) 0x7f84a0003520 con 0x7f84b815b9b0 2024-09-15T22:45:17.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 msgr2=0x7f84b80b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84b80b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 >> v2:172.21.15.177:3300/0 conn(0x7f84b80715b0 msgr2=0x7f84b815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 --2- 172.21.15.134:0/2669137033 >> v2:172.21.15.177:3300/0 conn(0x7f84b80715b0 0x7f84b815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b8072680 con 0x7f84b815b9b0 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f84b00019f0 con 0x7f84b815b9b0 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 >> v1:172.21.15.134:6789/0 conn(0x7f84b815b9b0 legacy=0x7f84b806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.338+0000 7f84b559a640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80720c0 con 0x7f84a00039b0 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80723a0 con 0x7f84a0004d40 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84a000b9c0 con 0x7f84b815b090 2024-09-15T22:45:17.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b6d9d640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 -- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 msgr2=0x7f84a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 -- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a0004d40 msgr2=0x7f84a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b659c640 1 -- 172.21.15.134:0/2669137033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a0003520 con 0x7f84a00039b0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.339+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b815b090 0x7f84a0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84b659c640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84a0003dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009ac0 tx=0x7f84a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a17e02a229ea355 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8036070 con 0x7f84a00039b0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a8031400 con 0x7f84a00039b0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84b559a640 1 -- 172.21.15.134:0/2669137033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8009690 con 0x7f84a00039b0 2024-09-15T22:45:17.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 -- 172.21.15.134:0/2669137033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 msgr2=0x7f84a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2669137033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84a0003dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009ac0 tx=0x7f84a0005830 comp rx=0 tx=0).stop 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84b6d9d640 1 -- 172.21.15.134:0/2669137033 reap_dead start 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 -- 172.21.15.134:0/2669137033 shutdown_connections 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 -- 172.21.15.134:0/2669137033 >> 172.21.15.134:0/2669137033 conn(0x7f84b806bba0 msgr2=0x7f84b806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 -- 172.21.15.134:0/2669137033 shutdown_connections 2024-09-15T22:45:17.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.340+0000 7f84bcd68640 1 -- 172.21.15.134:0/2669137033 wait complete. 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 Processor -- start 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 -- start start 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b8146f80 0x7f84b8147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b80aa970 0x7f84b80aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80719f0 con 0x7f84a00039b0 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84b815bdd0 con 0x7f84b8146f80 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84bcd68640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84b8071b70 con 0x7f84b80aa970 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.342+0000 7f84b659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35554/0 (socket says 172.21.15.134:35554) 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 -- 172.21.15.134:0/2725217103 learned_addr learned my addr 172.21.15.134:0/2725217103 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:17.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b8146f80 0x7f84b8147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b6d9d640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b80aa970 0x7f84b80aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 -- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b80aa970 msgr2=0x7f84b80aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b80aa970 0x7f84b80aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 -- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b8146f80 msgr2=0x7f84b8147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b8146f80 0x7f84b8147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 -- 172.21.15.134:0/2725217103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b8147940 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84b659c640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f84a8034040 tx=0x7f84a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8040020 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a8003940 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b81502e0 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8036040 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.343+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b80ab910 con 0x7f84a00039b0 2024-09-15T22:45:17.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.344+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b815b470 con 0x7f84a00039b0 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.345+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f84a8043020 con 0x7f84a00039b0 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.345+0000 7f84a6ffd640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 0x7f849806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.345+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7f84a80ab530 con 0x7f84a00039b0 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.345+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 0x7f849806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.346+0000 7f84b5d9b640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 0x7f849806e8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84b81f62e0 tx=0x7f84ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.350+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84a804a070 con 0x7f84a00039b0 2024-09-15T22:45:17.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.514+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f84b806ea40 con 0x7f84a00039b0 2024-09-15T22:45:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.517+0000 7f84a6ffd640 1 -- 172.21.15.134:0/2725217103 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f84a80796a0 con 0x7f84a00039b0 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 msgr2=0x7f849806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 0x7f849806e8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84b81f62e0 tx=0x7f84ac008040 comp rx=0 tx=0).stop 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 msgr2=0x7f84b8154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f84a8034040 tx=0x7f84a8004730 comp rx=0 tx=0).stop 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 shutdown_connections 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b80aa970 0x7f84b80aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b8146f80 0x7f84b8147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849806c400 0x7f849806e8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 --2- 172.21.15.134:0/2725217103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a00039b0 0x7f84b8154510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 >> 172.21.15.134:0/2725217103 conn(0x7f84b806bba0 msgr2=0x7f84b81556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.519+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 shutdown_connections 2024-09-15T22:45:17.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.520+0000 7f84bcd68640 1 -- 172.21.15.134:0/2725217103 wait complete. 2024-09-15T22:45:17.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-15T22:45:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.628+0000 7f6385c45640 1 Processor -- start 2024-09-15T22:45:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.628+0000 7f6385c45640 1 -- start start 2024-09-15T22:45:17.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f6385c45640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 0x7f63800cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f6385c45640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6380151c50 0x7f638015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f6385c45640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63800cd5f0 con 0x7f638006c1f0 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f6385c45640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63800cd8d0 con 0x7f6380151c50 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f6385c45640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63800cdbb0 con 0x7f638006be10 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6380151c50 0x7f638015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f638006c1f0 0x7f6380151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56256/0 (socket says 172.21.15.134:56256) 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637effd640 1 -- 172.21.15.134:0/3008443895 learned_addr learned my addr 172.21.15.134:0/3008443895 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637f7fe640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 0x7f63800cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637ffff640 1 -- 172.21.15.134:0/3008443895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 msgr2=0x7f63800cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637ffff640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 0x7f63800cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637ffff640 1 -- 172.21.15.134:0/3008443895 >> v1:172.21.15.134:6789/0 conn(0x7f638006c1f0 legacy=0x7f6380151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637e7fc640 1 -- 172.21.15.134:0/3008443895 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286359198 0 0) 0x7f63800cd5f0 con 0x7f638006c1f0 2024-09-15T22:45:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637ffff640 1 -- 172.21.15.134:0/3008443895 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63800cde90 con 0x7f6380151c50 2024-09-15T22:45:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.629+0000 7f637f7fe640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 0x7f63800cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.630+0000 7f637ffff640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6380151c50 0x7f638015baa0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6378009d90 tx=0x7f637802b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb5c890a82e9b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.630+0000 7f637e7fc640 1 -- 172.21.15.134:0/3008443895 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378037070 con 0x7f6380151c50 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.630+0000 7f637e7fc640 1 -- 172.21.15.134:0/3008443895 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6378007740 con 0x7f6380151c50 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.630+0000 7f637e7fc640 1 -- 172.21.15.134:0/3008443895 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378007b10 con 0x7f6380151c50 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 -- 172.21.15.134:0/3008443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6380151c50 msgr2=0x7f638015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6380151c50 0x7f638015baa0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6378009d90 tx=0x7f637802b770 comp rx=0 tx=0).stop 2024-09-15T22:45:17.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 -- 172.21.15.134:0/3008443895 shutdown_connections 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6380151c50 0x7f638015baa0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 --2- 172.21.15.134:0/3008443895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f638006be10 0x7f63800cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 -- 172.21.15.134:0/3008443895 >> 172.21.15.134:0/3008443895 conn(0x7f6380062cc0 msgr2=0x7f638006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 -- 172.21.15.134:0/3008443895 shutdown_connections 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.631+0000 7f6385c45640 1 -- 172.21.15.134:0/3008443895 wait complete. 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.632+0000 7f6385c45640 1 Processor -- start 2024-09-15T22:45:17.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.632+0000 7f6385c45640 1 -- start start 2024-09-15T22:45:17.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f638006c1f0 0x7f63801f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6380151c50 0x7f6380159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63800d0310 con 0x7f638006be10 2024-09-15T22:45:17.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63800ce690 con 0x7f638006c1f0 2024-09-15T22:45:17.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63800d0490 con 0x7f6380151c50 2024-09-15T22:45:17.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35574/0 (socket says 172.21.15.134:35574) 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 -- 172.21.15.134:0/591625671 learned_addr learned my addr 172.21.15.134:0/591625671 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 -- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6380151c50 msgr2=0x7f6380159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6380151c50 0x7f6380159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 -- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f638006c1f0 msgr2=0x7f63801f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f638006c1f0 0x7f63801f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 -- 172.21.15.134:0/591625671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6380152200 con 0x7f638006be10 2024-09-15T22:45:17.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f637f7fe640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f637400e810 tx=0x7f637400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637400f040 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6374004030 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63801524a0 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374004400 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.633+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801f2cc0 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.634+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63801f2fb0 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.635+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f637400c6d0 con 0x7f638006be10 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.635+0000 7f6367fff640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 0x7f636c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.635+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7f637408b410 con 0x7f638006be10 2024-09-15T22:45:17.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.636+0000 7f637effd640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 0x7f636c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.636+0000 7f637effd640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 0x7f636c06e890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6370007fd0 tx=0x7f6370007920 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.639+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6374017020 con 0x7f638006be10 2024-09-15T22:45:17.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:17.870+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7f63800d0890 con 0x7f638006be10 2024-09-15T22:45:18.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.211+0000 7f6367fff640 1 -- 172.21.15.134:0/591625671 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v217) ==== 131+0+0 (secure 0 0 0) 0x7f6374059a30 con 0x7f638006be10 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 msgr2=0x7f636c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 0x7f636c06e890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6370007fd0 tx=0x7f6370007920 comp rx=0 tx=0).stop 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 msgr2=0x7f63800af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f637400e810 tx=0x7f637400ecd0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 shutdown_connections 2024-09-15T22:45:18.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6380151c50 0x7f6380159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f638006c1f0 0x7f63801f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f636c06c3d0 0x7f636c06e890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 --2- 172.21.15.134:0/591625671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f638006be10 0x7f63800af050 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 >> 172.21.15.134:0/591625671 conn(0x7f6380062cc0 msgr2=0x7f638006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 shutdown_connections 2024-09-15T22:45:18.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.214+0000 7f6385c45640 1 -- 172.21.15.134:0/591625671 wait complete. 2024-09-15T22:45:18.227 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-15T22:45:18.227 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-15T22:45:18.227 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:45:18.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:18.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 Processor -- start 2024-09-15T22:45:18.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 -- start start 2024-09-15T22:45:18.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ac015ed20 0x7f3ac00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 0x7f3ac00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac00b7170 con 0x7f3ac015e940 2024-09-15T22:45:18.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac00b7aa0 con 0x7f3ac015ed20 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.327+0000 7f3ac7245640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac00d3660 con 0x7f3ac00cef90 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ac015ed20 0x7f3ac00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3ac4fe1640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3ac015e940 0x7f3ac00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56260/0 (socket says 172.21.15.134:56260) 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3ac4fe1640 1 -- 172.21.15.134:0/1335046276 learned_addr learned my addr 172.21.15.134:0/1335046276 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3ac57e2640 1 --2- 172.21.15.134:0/1335046276 >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 0x7f3ac00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abffff640 1 -- 172.21.15.134:0/1335046276 >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 msgr2=0x7f3ac00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abffff640 1 --2- 172.21.15.134:0/1335046276 >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 0x7f3ac00b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abffff640 1 -- 172.21.15.134:0/1335046276 >> v1:172.21.15.134:6789/0 conn(0x7f3ac015e940 legacy=0x7f3ac00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abffff640 1 -- 172.21.15.134:0/1335046276 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac00d3940 con 0x7f3ac015ed20 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3abf7fe640 1 -- 172.21.15.134:0/1335046276 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567230095 0 0) 0x7f3ab8001110 con 0x7f3ac015e940 2024-09-15T22:45:18.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.328+0000 7f3ac57e2640 1 --2- 172.21.15.134:0/1335046276 >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 0x7f3ac00b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:18.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3abffff640 1 --2- 172.21.15.134:0/1335046276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac015ed20 0x7f3ac00b3220 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3ac006d070 tx=0x7f3ab002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843eb0904e7b0cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3abf7fe640 1 -- 172.21.15.134:0/1335046276 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0007740 con 0x7f3ac015ed20 2024-09-15T22:45:18.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3abf7fe640 1 -- 172.21.15.134:0/1335046276 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab00078e0 con 0x7f3ac015ed20 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3abf7fe640 1 -- 172.21.15.134:0/1335046276 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0007cb0 con 0x7f3ac015ed20 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 -- 172.21.15.134:0/1335046276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac015ed20 msgr2=0x7f3ac00b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 --2- 172.21.15.134:0/1335046276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac015ed20 0x7f3ac00b3220 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3ac006d070 tx=0x7f3ab002a710 comp rx=0 tx=0).stop 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 -- 172.21.15.134:0/1335046276 shutdown_connections 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 --2- 172.21.15.134:0/1335046276 >> v2:172.21.15.177:3300/0 conn(0x7f3ac00cef90 0x7f3ac00b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 --2- 172.21.15.134:0/1335046276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac015ed20 0x7f3ac00b3220 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 -- 172.21.15.134:0/1335046276 >> 172.21.15.134:0/1335046276 conn(0x7f3ac00b6240 msgr2=0x7f3ac00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.329+0000 7f3ac7245640 1 -- 172.21.15.134:0/1335046276 shutdown_connections 2024-09-15T22:45:18.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.330+0000 7f3ac7245640 1 -- 172.21.15.134:0/1335046276 wait complete. 2024-09-15T22:45:18.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 Processor -- start 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 -- start start 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac015e940 0x7f3ac00abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ac015ed20 0x7f3ac0157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac00d3310 con 0x7f3ac00cef90 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac00d3f00 con 0x7f3ac015e940 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.331+0000 7f3ac7245640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac00d1ef0 con 0x7f3ac015ed20 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35590/0 (socket says 172.21.15.134:35590) 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 -- 172.21.15.134:0/23726725 learned_addr learned my addr 172.21.15.134:0/23726725 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3abffff640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac015e940 0x7f3ac00abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac57e2640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ac015ed20 0x7f3ac0157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 -- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ac015ed20 msgr2=0x7f3ac0157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ac015ed20 0x7f3ac0157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 -- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac015e940 msgr2=0x7f3ac00abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac015e940 0x7f3ac00abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 -- 172.21.15.134:0/23726725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac015a2a0 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac4fe1640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c780 tx=0x7f3ab800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8018070 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab80072d0 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac015a560 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80047e0 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.332+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac015ab20 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.333+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac00d1060 con 0x7f3ac00cef90 2024-09-15T22:45:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.334+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3ab801b070 con 0x7f3ac00cef90 2024-09-15T22:45:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.334+0000 7f3abd7fa640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 0x7f3aa006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.334+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7f3ab808a780 con 0x7f3ac00cef90 2024-09-15T22:45:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.334+0000 7f3abffff640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 0x7f3aa006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.335+0000 7f3abffff640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 0x7f3aa006e890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0034000 tx=0x7f3ab0033040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.338+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ac00b7170 con 0x7f3ac00cef90 2024-09-15T22:45:18.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.508+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ac00ba6b0 con 0x7f3ac00cef90 2024-09-15T22:45:18.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.508+0000 7f3abd7fa640 1 -- 172.21.15.134:0/23726725 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+13891 (secure 0 0 0) 0x7f3ab8058f40 con 0x7f3ac00cef90 2024-09-15T22:45:18.510 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:18.510 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":79,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:17.205179+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6834/1551084696":"2024-09-16T22:45:14.190566+0000","172.21.15.134:0/698139707":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/4237567819":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6836/1551084696":"2024-09-16T22:45:14.190566+0000","172.21.15.134:0/2745699943":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6824/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2376424591":"2024-09-16T22:45:11.152915+0000","172.21.15.134:6825/210106985":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/2765650614":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1996904897":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1326277956":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1495337979":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1536265329":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/59152253":"2024-09-16T22:45:11.152915+0000","172.21.15.134:0/1946867643":"2024-09-16T22:45:11.152915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:18.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.510+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 msgr2=0x7f3aa006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.510+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 0x7f3aa006e890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0034000 tx=0x7f3ab0033040 comp rx=0 tx=0).stop 2024-09-15T22:45:18.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.510+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 msgr2=0x7f3ac015b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.510+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c780 tx=0x7f3ab800cc40 comp rx=0 tx=0).stop 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 shutdown_connections 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ac015ed20 0x7f3ac0157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac015e940 0x7f3ac00abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3aa006c3d0 0x7f3aa006e890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 --2- 172.21.15.134:0/23726725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac00cef90 0x7f3ac015b280 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 >> 172.21.15.134:0/23726725 conn(0x7f3ac00b6240 msgr2=0x7f3ac00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 shutdown_connections 2024-09-15T22:45:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.511+0000 7f3ac7245640 1 -- 172.21.15.134:0/23726725 wait complete. 2024-09-15T22:45:18.524 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:45:18.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:45:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.624+0000 7eff4729b640 1 Processor -- start 2024-09-15T22:45:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.624+0000 7eff4729b640 1 -- start start 2024-09-15T22:45:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff4729b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff400b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff4729b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff400b43f0 con 0x7eff4015c370 2024-09-15T22:45:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff4729b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4015c7d0 con 0x7eff4006f130 2024-09-15T22:45:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff4729b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7eff400b3630 con 0x7eff40158e50 2024-09-15T22:45:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff44836640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7eff4015c370 0x7eff4006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56274/0 (socket says 172.21.15.134:56274) 2024-09-15T22:45:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff44836640 1 -- 172.21.15.134:0/1581104046 learned_addr learned my addr 172.21.15.134:0/1581104046 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff45037640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff400b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.625+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306002035 0 0) 0x7eff400b43f0 con 0x7eff4015c370 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c003520 con 0x7eff4015c370 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2486232069 0 0) 0x7eff2c003520 con 0x7eff4015c370 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 msgr2=0x7eff400b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff400b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 >> v1:172.21.15.177:6789/0 conn(0x7eff4006f130 legacy=0x7eff400ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff400b3910 con 0x7eff4015c370 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7eff300016c0 con 0x7eff4015c370 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 >> v1:172.21.15.134:6789/0 conn(0x7eff4015c370 legacy=0x7eff4006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c0039e0 0x7eff2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff2c004d40 0x7eff2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff400b3630 con 0x7eff2c004d40 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c00b9c0 con 0x7eff2c0039e0 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7eff2c00bbc0 con 0x7eff40158e50 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff2c004d40 0x7eff2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45037640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c0039e0 0x7eff2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff44836640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 -- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 msgr2=0x7eff2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff40158e50 0x7eff2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 -- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c0039e0 msgr2=0x7eff2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c0039e0 0x7eff2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.626+0000 7eff45838640 1 -- 172.21.15.134:0/1581104046 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c003520 con 0x7eff2c004d40 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff45838640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff2c004d40 0x7eff2c0051c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff38001fe0 tx=0x7eff2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceddab3b3add0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38036070 con 0x7eff2c004d40 2024-09-15T22:45:18.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38031600 con 0x7eff2c004d40 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff37fff640 1 -- 172.21.15.134:0/1581104046 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38001be0 con 0x7eff2c004d40 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 -- 172.21.15.134:0/1581104046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff2c004d40 msgr2=0x7eff2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 --2- 172.21.15.134:0/1581104046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff2c004d40 0x7eff2c0051c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff38001fe0 tx=0x7eff2c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff45838640 1 -- 172.21.15.134:0/1581104046 reap_dead start 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 -- 172.21.15.134:0/1581104046 shutdown_connections 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 -- 172.21.15.134:0/1581104046 >> 172.21.15.134:0/1581104046 conn(0x7eff4006bba0 msgr2=0x7eff4006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 -- 172.21.15.134:0/1581104046 shutdown_connections 2024-09-15T22:45:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.628+0000 7eff4729b640 1 -- 172.21.15.134:0/1581104046 wait complete. 2024-09-15T22:45:18.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.629+0000 7eff4729b640 1 Processor -- start 2024-09-15T22:45:18.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.629+0000 7eff4729b640 1 -- start start 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c004d40 0x7eff401f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff401f4170 0x7eff40159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff40159230 con 0x7eff401f6f60 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff400b3ed0 con 0x7eff401f4170 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff4729b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7eff400b5050 con 0x7eff2c004d40 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35616/0 (socket says 172.21.15.134:35616) 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 -- 172.21.15.134:0/3271103199 learned_addr learned my addr 172.21.15.134:0/3271103199 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45037640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c004d40 0x7eff401f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff44836640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff401f4170 0x7eff40159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 -- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c004d40 msgr2=0x7eff401f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c004d40 0x7eff401f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 -- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff401f4170 msgr2=0x7eff40159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff401f4170 0x7eff40159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 -- 172.21.15.134:0/3271103199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4015add0 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.630+0000 7eff45838640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff38002100 tx=0x7eff38001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.631+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38042070 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.631+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38003970 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.631+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff401f46e0 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.631+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38036040 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.631+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff401f4ca0 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.632+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff400b5480 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.632+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7eff38045070 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.633+0000 7eff35ffb640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 0x7eff2406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.633+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7eff380aad30 con 0x7eff401f6f60 2024-09-15T22:45:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.633+0000 7eff45037640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 0x7eff2406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.634+0000 7eff45037640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 0x7eff2406e890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff4015a870 tx=0x7eff3c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.637+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff38078e00 con 0x7eff401f6f60 2024-09-15T22:45:18.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.800+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7eff40071490 con 0x7eff401f6f60 2024-09-15T22:45:18.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.800+0000 7eff35ffb640 1 -- 172.21.15.134:0/3271103199 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7eff3807d100 con 0x7eff401f6f60 2024-09-15T22:45:18.801 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 msgr2=0x7eff2406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 0x7eff2406e890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff4015a870 tx=0x7eff3c009190 comp rx=0 tx=0).stop 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 msgr2=0x7eff4006e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff38002100 tx=0x7eff38001630 comp rx=0 tx=0).stop 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 shutdown_connections 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7eff2406c3d0 0x7eff2406e890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff401f6f60 0x7eff4006e020 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff401f4170 0x7eff40159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 --2- 172.21.15.134:0/3271103199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c004d40 0x7eff401f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.802+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 >> 172.21.15.134:0/3271103199 conn(0x7eff4006bba0 msgr2=0x7eff4006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.803+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 shutdown_connections 2024-09-15T22:45:18.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.803+0000 7eff4729b640 1 -- 172.21.15.134:0/3271103199 wait complete. 2024-09-15T22:45:18.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-15T22:45:18.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.910+0000 7f155014b640 1 Processor -- start 2024-09-15T22:45:18.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 -- start start 2024-09-15T22:45:18.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f15480d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f154815ce80 0x7f15481594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15480d0bc0 con 0x7f154815ca40 2024-09-15T22:45:18.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f154815d390 con 0x7f154815ce80 2024-09-15T22:45:18.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.911+0000 7f155014b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f154815d670 con 0x7f15480d02a0 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154e6e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f154815ce80 0x7f15481594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154d6e6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f154815ca40 0x7f154815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56286/0 (socket says 172.21.15.134:56286) 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154d6e6640 1 -- 172.21.15.134:0/3136945247 learned_addr learned my addr 172.21.15.134:0/3136945247 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154dee7640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f15480d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154e6e8640 1 -- 172.21.15.134:0/3136945247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 msgr2=0x7f15480d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154e6e8640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f15480d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154e6e8640 1 -- 172.21.15.134:0/3136945247 >> v1:172.21.15.134:6789/0 conn(0x7f154815ca40 legacy=0x7f154815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154cee5640 1 -- 172.21.15.134:0/3136945247 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062428171 0 0) 0x7f15480d0bc0 con 0x7f154815ca40 2024-09-15T22:45:18.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.912+0000 7f154e6e8640 1 -- 172.21.15.134:0/3136945247 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154815d950 con 0x7f154815ce80 2024-09-15T22:45:18.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f154e6e8640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f15481594c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ed6712125fc269 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f154cee5640 1 -- 172.21.15.134:0/3136945247 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538037070 con 0x7f154815ce80 2024-09-15T22:45:18.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f154cee5640 1 -- 172.21.15.134:0/3136945247 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153802ae50 con 0x7f154815ce80 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f154cee5640 1 -- 172.21.15.134:0/3136945247 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538032660 con 0x7f154815ce80 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 -- 172.21.15.134:0/3136945247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 msgr2=0x7f15481594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f15481594c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802a100 comp rx=0 tx=0).stop 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 -- 172.21.15.134:0/3136945247 shutdown_connections 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f15481594c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 --2- 172.21.15.134:0/3136945247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f15480d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 -- 172.21.15.134:0/3136945247 >> 172.21.15.134:0/3136945247 conn(0x7f1548062cc0 msgr2=0x7f154806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.913+0000 7f155014b640 1 -- 172.21.15.134:0/3136945247 shutdown_connections 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.914+0000 7f155014b640 1 -- 172.21.15.134:0/3136945247 wait complete. 2024-09-15T22:45:18.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 Processor -- start 2024-09-15T22:45:18.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 -- start start 2024-09-15T22:45:18.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f1548157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 0x7f1548146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f154815eb40 con 0x7f154815ce80 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f154815df10 con 0x7f154815ca40 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f155014b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1548155b90 con 0x7f15480d02a0 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.915+0000 7f154e6e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35622/0 (socket says 172.21.15.134:35622) 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 -- 172.21.15.134:0/3722734325 learned_addr learned my addr 172.21.15.134:0/3722734325 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154dee7640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f1548157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154d6e6640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 0x7f1548146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 -- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 msgr2=0x7f1548157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f1548157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 -- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 msgr2=0x7f1548146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 0x7f1548146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 -- 172.21.15.134:0/3722734325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15480727a0 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154d6e6640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 0x7f1548146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f154e6e8640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f15380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538037040 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538004030 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538004420 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1548072a80 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.916+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1548073040 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.917+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15480b4790 con 0x7f154815ce80 2024-09-15T22:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.918+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f1538003610 con 0x7f154815ce80 2024-09-15T22:45:18.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.918+0000 7f15467fc640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 0x7f153406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:18.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.918+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7f15380ac220 con 0x7f154815ce80 2024-09-15T22:45:18.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.918+0000 7f154dee7640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 0x7f153406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:18.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.919+0000 7f154dee7640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 0x7f153406e890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15400079a0 tx=0x7f1540008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:18.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:18.922+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f153807a9e0 con 0x7f154815ce80 2024-09-15T22:45:19.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.153+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f154806d0d0 con 0x7f154815ce80 2024-09-15T22:45:19.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.215+0000 7f15467fc640 1 -- 172.21.15.134:0/3722734325 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v218) ==== 149+0+0 (secure 0 0 0) 0x7f153807a2e0 con 0x7f154815ce80 2024-09-15T22:45:19.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 msgr2=0x7f153406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 0x7f153406e890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15400079a0 tx=0x7f1540008040 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 msgr2=0x7f1548073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f15380046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 shutdown_connections 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f153406c3d0 0x7f153406e890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f154815ce80 0x7f1548073840 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f154815ca40 0x7f1548146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 --2- 172.21.15.134:0/3722734325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15480d02a0 0x7f1548157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 >> 172.21.15.134:0/3722734325 conn(0x7f1548062cc0 msgr2=0x7f1548150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 shutdown_connections 2024-09-15T22:45:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.218+0000 7f155014b640 1 -- 172.21.15.134:0/3722734325 wait complete. 2024-09-15T22:45:19.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:45:19.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 Processor -- start 2024-09-15T22:45:19.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 -- start start 2024-09-15T22:45:19.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dfc0b3d50 0x7f4dfc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dfc0cf9a0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4dfc0cfcf0 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.330+0000 7f4e0247b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc162210 con 0x7f4dfc161e30 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dfc0b3d50 0x7f4dfc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4e00a18640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4dfc0b3290 0x7f4dfc0b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56300/0 (socket says 172.21.15.134:56300) 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4e00a18640 1 -- 172.21.15.134:0/2864961311 learned_addr learned my addr 172.21.15.134:0/2864961311 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfbfff640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfb7fe640 1 -- 172.21.15.134:0/2864961311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 msgr2=0x7f4dfc0d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfb7fe640 1 -- 172.21.15.134:0/2864961311 >> v1:172.21.15.134:6789/0 conn(0x7f4dfc0b3290 legacy=0x7f4dfc0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfb7fe640 1 -- 172.21.15.134:0/2864961311 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0d5210 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.331+0000 7f4dfbfff640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:19.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc06d8c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4df00097a0 tx=0x7f4df002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc39e343280a5c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4dfaffd640 1 -- 172.21.15.134:0/2864961311 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0037070 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4dfaffd640 1 -- 172.21.15.134:0/2864961311 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0032440 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4dfaffd640 1 -- 172.21.15.134:0/2864961311 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0032810 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 -- 172.21.15.134:0/2864961311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3d50 msgr2=0x7f4dfc06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc06d8c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4df00097a0 tx=0x7f4df002a180 comp rx=0 tx=0).stop 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 -- 172.21.15.134:0/2864961311 shutdown_connections 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc06d8c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 --2- 172.21.15.134:0/2864961311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 -- 172.21.15.134:0/2864961311 >> 172.21.15.134:0/2864961311 conn(0x7f4dfc0d1870 msgr2=0x7f4dfc0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 -- 172.21.15.134:0/2864961311 shutdown_connections 2024-09-15T22:45:19.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.332+0000 7f4e0247b640 1 -- 172.21.15.134:0/2864961311 wait complete. 2024-09-15T22:45:19.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.333+0000 7f4e0247b640 1 Processor -- start 2024-09-15T22:45:19.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 -- start start 2024-09-15T22:45:19.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0d39e0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0b3950 con 0x7f4dfc0b3d50 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4e0247b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc0abe50 con 0x7f4dfc161e30 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.334+0000 7f4dfbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35648/0 (socket says 172.21.15.134:35648) 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 -- 172.21.15.134:0/764321359 learned_addr learned my addr 172.21.15.134:0/764321359 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4e00a18640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 -- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 msgr2=0x7f4dfc0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 -- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 msgr2=0x7f4dfc0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 -- 172.21.15.134:0/764321359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0ac130 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4dfbfff640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c7f0 tx=0x7f4dec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec015070 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec0079d0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dfc0ac410 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec007da0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.335+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dfc0ac9d0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.336+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dfc0d34a0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.337+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f4dec018070 con 0x7f4dfc0b3290 2024-09-15T22:45:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.337+0000 7f4df8ff9640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 0x7f4de806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.337+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7f4dec08b4b0 con 0x7f4dfc0b3290 2024-09-15T22:45:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.337+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 0x7f4de806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.338+0000 7f4dfb7fe640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 0x7f4de806e890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4df0034000 tx=0x7f4df002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.341+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4dec059b60 con 0x7f4dfc0b3290 2024-09-15T22:45:19.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.505+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4dfc0acc10 con 0x7f4dfc0b3290 2024-09-15T22:45:19.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.508+0000 7f4df8ff9640 1 -- 172.21.15.134:0/764321359 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f4dfc0acc10 con 0x7f4dfc0b3290 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 msgr2=0x7f4de806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 0x7f4de806e890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4df0034000 tx=0x7f4df002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 msgr2=0x7f4dfc154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c7f0 tx=0x7f4dec00cbf0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 shutdown_connections 2024-09-15T22:45:19.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4dfc161e30 0x7f4dfc0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc0b3d50 0x7f4dfc0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4de806c3d0 0x7f4de806e890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 --2- 172.21.15.134:0/764321359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dfc0b3290 0x7f4dfc154bd0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.510+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 >> 172.21.15.134:0/764321359 conn(0x7f4dfc0d1870 msgr2=0x7f4dfc0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.511+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 shutdown_connections 2024-09-15T22:45:19.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.511+0000 7f4e0247b640 1 -- 172.21.15.134:0/764321359 wait complete. 2024-09-15T22:45:19.523 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:45:19.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:19.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:19.632 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:45:19.632 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:19.632 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:19.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:19.648 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:19.649 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:19.666 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:19.666 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:19.666 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:19.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:19.705 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:19.705 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:19.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:19.725 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:45:19.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:19.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.841+0000 7fab58331640 1 Processor -- start 2024-09-15T22:45:19.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.841+0000 7fab58331640 1 -- start start 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab58331640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab500d02a0 0x7fab500d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab58331640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab58331640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab500d0bc0 con 0x7fab5015ca40 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab58331640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fab5015d390 con 0x7fab500d02a0 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab58331640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab5015d670 con 0x7fab5015ceb0 2024-09-15T22:45:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab568ce640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab500d02a0 0x7fab500d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab500d02a0 0x7fab500d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42524/0 (socket says 172.21.15.134:42524) 2024-09-15T22:45:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab558cc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fab5015ca40 0x7fab5015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48492/0 (socket says 172.21.15.134:48492) 2024-09-15T22:45:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 -- 172.21.15.134:0/380131604 learned_addr learned my addr 172.21.15.134:0/380131604 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab568ce640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:40922/0 (socket says 172.21.15.134:40922) 2024-09-15T22:45:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 -- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 msgr2=0x7fab501594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 -- 172.21.15.134:0/380131604 >> v1:172.21.15.177:6789/0 conn(0x7fab5015ca40 legacy=0x7fab5015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab560cd640 1 -- 172.21.15.134:0/380131604 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5015d950 con 0x7fab500d02a0 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.842+0000 7fab568ce640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.843+0000 7fab560cd640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab500d02a0 0x7fab500d0680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d92ad241b0120a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.843+0000 7fab550cb640 1 -- 172.21.15.134:0/380131604 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c037070 con 0x7fab500d02a0 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.843+0000 7fab550cb640 1 -- 172.21.15.134:0/380131604 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c032440 con 0x7fab500d02a0 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.843+0000 7fab550cb640 1 -- 172.21.15.134:0/380131604 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c032810 con 0x7fab500d02a0 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 -- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab500d02a0 msgr2=0x7fab500d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab500d02a0 0x7fab500d0680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 -- 172.21.15.134:0/380131604 shutdown_connections 2024-09-15T22:45:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab5015ceb0 0x7fab501594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 --2- 172.21.15.134:0/380131604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab500d02a0 0x7fab500d0680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 -- 172.21.15.134:0/380131604 >> 172.21.15.134:0/380131604 conn(0x7fab50062cc0 msgr2=0x7fab5006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 -- 172.21.15.134:0/380131604 shutdown_connections 2024-09-15T22:45:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.844+0000 7fab58331640 1 -- 172.21.15.134:0/380131604 wait complete. 2024-09-15T22:45:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.845+0000 7fab58331640 1 Processor -- start 2024-09-15T22:45:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.845+0000 7fab58331640 1 -- start start 2024-09-15T22:45:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 0x7fab50147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab5015ceb0 0x7fab500aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab5015eb40 con 0x7fab5015ca40 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab5015df10 con 0x7fab5015ceb0 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab58331640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab50155b90 con 0x7fab500d02a0 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35652/0 (socket says 172.21.15.134:35652) 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 -- 172.21.15.134:0/1267364553 learned_addr learned my addr 172.21.15.134:0/1267364553 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab560cd640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 0x7fab50147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab568ce640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab5015ceb0 0x7fab500aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 -- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 msgr2=0x7fab50147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 0x7fab50147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 -- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab5015ceb0 msgr2=0x7fab500aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab5015ceb0 0x7fab500aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab558cc640 1 -- 172.21.15.134:0/1267364553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab501f7c90 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.846+0000 7fab560cd640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 0x7fab50147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab558cc640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c400 tx=0x7fab4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab400074e0 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab40007680 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab501f7f70 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40004a00 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.847+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab501f8530 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.848+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab500b4790 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.848+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fab4001a020 con 0x7fab5015ca40 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.849+0000 7fab46ffd640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 0x7fab3406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.849+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5502+0+0 (secure 0 0 0) 0x7fab4008acb0 con 0x7fab5015ca40 2024-09-15T22:45:19.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.849+0000 7fab560cd640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 0x7fab3406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.849+0000 7fab560cd640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 0x7fab3406e890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034000 tx=0x7fab4c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:19.853+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab40059470 con 0x7fab5015ca40 2024-09-15T22:45:20.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.052+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab5006d480 con 0x7fab5015ca40 2024-09-15T22:45:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.053+0000 7fab46ffd640 1 -- 172.21.15.134:0/1267364553 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3917 (secure 0 0 0) 0x7fab40058d70 con 0x7fab5015ca40 2024-09-15T22:45:20.055 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:20.055 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":39,"btime":"2024-09-15T22:45:15:192841+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3525276845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3525276845},{"type":"v1","addr":"172.21.15.177:6834","nonce":3525276845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5698,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/927932764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":927932764},{"type":"v1","addr":"172.21.15.177:6835","nonce":927932764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2822953935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2822953935},{"type":"v1","addr":"172.21.15.134:6837","nonce":2822953935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6456,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/985757684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":985757684},{"type":"v1","addr":"172.21.15.134:6825","nonce":985757684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-09-15T22:45:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 39 2024-09-15T22:45:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 msgr2=0x7fab3406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 0x7fab3406e890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034000 tx=0x7fab4c02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 msgr2=0x7fab500ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c400 tx=0x7fab4000c8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 shutdown_connections 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab5015ceb0 0x7fab500aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab3406c3d0 0x7fab3406e890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab5015ca40 0x7fab500ae910 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 --2- 172.21.15.134:0/1267364553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab500d02a0 0x7fab50147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 >> 172.21.15.134:0/1267364553 conn(0x7fab50062cc0 msgr2=0x7fab5006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 shutdown_connections 2024-09-15T22:45:20.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.055+0000 7fab58331640 1 -- 172.21.15.134:0/1267364553 wait complete. 2024-09-15T22:45:20.068 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:45:20.068 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:45:20.068 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:45:20.068 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:20.068 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:45:20.068 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:45:20.069 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:45:20.069 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:20.069 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:45:20.069 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:45:20.069 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:45:20.069 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:20.069 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:45:20.069 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:45:20.070 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:45:20.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:20.077 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:45:20.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:45:20.079 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:45:20.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:45:20.081 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:45:20.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:45:20.082 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:45:20.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:45:20.120 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:45:20.121 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:20.121 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:45:20.121 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:20.124 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:45:20.124 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:20.125 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:45:20.125 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:20.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:45:20.195 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:45:20.196 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:45:20.207 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:45:20.207 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:45:20.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.228+0000 7fd36f3fd640 1 Processor -- start 2024-09-15T22:45:20.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.228+0000 7fd36f3fd640 1 -- start start 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36f3fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd3680d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36f3fd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd36815ed20 0x7fd3680d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36f3fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3680b7170 con 0x7fd3680cef90 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36f3fd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd3680d1ae0 con 0x7fd36815ed20 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36f3fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680b7aa0 con 0x7fd36815e940 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd36815ed20 0x7fd3680d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd36815ed20 0x7fd3680d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35692/0 (socket says 172.21.15.134:35692) 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 -- 172.21.15.134:0/1236333129 learned_addr learned my addr 172.21.15.134:0/1236333129 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36d99a640 1 --1- 172.21.15.134:0/1236333129 >> v1:172.21.15.134:6789/0 conn(0x7fd3680cef90 0x7fd3680b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56312/0 (socket says 172.21.15.134:56312) 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36d199640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd3680d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd35ffff640 1 -- 172.21.15.134:0/1236333129 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585033885 0 0) 0x7fd360001490 con 0x7fd3680cef90 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd35ffff640 1 -- 172.21.15.134:0/1236333129 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd354003520 con 0x7fd3680cef90 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 -- 172.21.15.134:0/1236333129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 msgr2=0x7fd3680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd3680d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 -- 172.21.15.134:0/1236333129 >> v1:172.21.15.134:6789/0 conn(0x7fd3680cef90 legacy=0x7fd3680b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36c998640 1 -- 172.21.15.134:0/1236333129 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680d3660 con 0x7fd36815ed20 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.229+0000 7fd36d199640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd3680d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.230+0000 7fd36c998640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680d15a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd358009870 tx=0x7fd35802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3409b51602b65b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.232+0000 7fd35ffff640 1 -- 172.21.15.134:0/1236333129 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358037070 con 0x7fd36815ed20 2024-09-15T22:45:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.232+0000 7fd35ffff640 1 -- 172.21.15.134:0/1236333129 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35802ae50 con 0x7fd36815ed20 2024-09-15T22:45:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.232+0000 7fd35ffff640 1 -- 172.21.15.134:0/1236333129 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358032840 con 0x7fd36815ed20 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 -- 172.21.15.134:0/1236333129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 msgr2=0x7fd3680d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680d15a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd358009870 tx=0x7fd35802a300 comp rx=0 tx=0).stop 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 -- 172.21.15.134:0/1236333129 shutdown_connections 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680d15a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/1236333129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd3680d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 -- 172.21.15.134:0/1236333129 >> 172.21.15.134:0/1236333129 conn(0x7fd3680b6240 msgr2=0x7fd3680b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 -- 172.21.15.134:0/1236333129 shutdown_connections 2024-09-15T22:45:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.233+0000 7fd36f3fd640 1 -- 172.21.15.134:0/1236333129 wait complete. 2024-09-15T22:45:20.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.234+0000 7fd36f3fd640 1 Processor -- start 2024-09-15T22:45:20.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 -- start start 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3680cef90 0x7fd368157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd368156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680d3f00 con 0x7fd36815ed20 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680d3c20 con 0x7fd3680cef90 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36f3fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680d3310 con 0x7fd36815e940 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36d99a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36d99a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35700/0 (socket says 172.21.15.134:35700) 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36d99a640 1 -- 172.21.15.134:0/2124293666 learned_addr learned my addr 172.21.15.134:0/2124293666 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36c998640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd368156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.235+0000 7fd36d199640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3680cef90 0x7fd368157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 -- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 msgr2=0x7fd368156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd368156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 -- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3680cef90 msgr2=0x7fd368157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3680cef90 0x7fd368157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 -- 172.21.15.134:0/2124293666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680cc2b0 con 0x7fd36815ed20 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36d99a640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c760 tx=0x7fd36000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360017070 con 0x7fd36815ed20 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36000a640 con 0x7fd36815ed20 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36815b2a0 con 0x7fd36815ed20 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000aa30 con 0x7fd36815ed20 2024-09-15T22:45:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.236+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3680cea00 con 0x7fd36815ed20 2024-09-15T22:45:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.237+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3680d1ef0 con 0x7fd36815ed20 2024-09-15T22:45:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.238+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fd36001a070 con 0x7fd36815ed20 2024-09-15T22:45:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.238+0000 7fd35dffb640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 0x7fd34c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.238+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5502+0+0 (secure 0 0 0) 0x7fd36008aad0 con 0x7fd36815ed20 2024-09-15T22:45:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.238+0000 7fd36d199640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 0x7fd34c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.239+0000 7fd36d199640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 0x7fd34c06e890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd368159b10 tx=0x7fd364009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.243+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3680b7170 con 0x7fd36815ed20 2024-09-15T22:45:20.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:20.419+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd3680ba6b0 con 0x7fd36815ed20 2024-09-15T22:45:21.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.231+0000 7fd35dffb640 1 -- 172.21.15.134:0/2124293666 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) ==== 97+0+0 (secure 0 0 0) 0x7fd360058bb0 con 0x7fd36815ed20 2024-09-15T22:45:21.234 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 msgr2=0x7fd34c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 0x7fd34c06e890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd368159b10 tx=0x7fd364009190 comp rx=0 tx=0).stop 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 msgr2=0x7fd3680cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c760 tx=0x7fd36000cc20 comp rx=0 tx=0).stop 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 shutdown_connections 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd34c06c3d0 0x7fd34c06e890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd36815ed20 0x7fd3680cca70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd36815e940 0x7fd368156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 --2- 172.21.15.134:0/2124293666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3680cef90 0x7fd368157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 >> 172.21.15.134:0/2124293666 conn(0x7fd3680b6240 msgr2=0x7fd3680d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 shutdown_connections 2024-09-15T22:45:21.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.235+0000 7fd36f3fd640 1 -- 172.21.15.134:0/2124293666 wait complete. 2024-09-15T22:45:21.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:45:21.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.353+0000 7faeec877640 1 Processor -- start 2024-09-15T22:45:21.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.353+0000 7faeec877640 1 -- start start 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeec877640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee815ca40 0x7faee815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeec877640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faee815ce80 0x7faee81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeec877640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee815d390 con 0x7faee80d02a0 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeec877640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faee815d670 con 0x7faee815ce80 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeec877640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faee815d950 con 0x7faee815ca40 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faee815ce80 0x7faee81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee659c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faee80d02a0 0x7faee80d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56316/0 (socket says 172.21.15.134:56316) 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee659c640 1 -- 172.21.15.134:0/420272171 learned_addr learned my addr 172.21.15.134:0/420272171 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faee815ce80 0x7faee81594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35704/0 (socket says 172.21.15.134:35704) 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faeddd9b640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee815ca40 0x7faee815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 -- 172.21.15.134:0/420272171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee815ca40 msgr2=0x7faee815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:21.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee815ca40 0x7faee815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 -- 172.21.15.134:0/420272171 >> v1:172.21.15.134:6789/0 conn(0x7faee80d02a0 legacy=0x7faee80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee5d9b640 1 -- 172.21.15.134:0/420272171 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627380659 0 0) 0x7faee815d390 con 0x7faee80d02a0 2024-09-15T22:45:21.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.354+0000 7faee6d9d640 1 -- 172.21.15.134:0/420272171 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee815dc30 con 0x7faee815ce80 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.355+0000 7faee6d9d640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee81594c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e7a33f1580be01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.355+0000 7faee5d9b640 1 -- 172.21.15.134:0/420272171 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0031600 con 0x7faee815ce80 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.355+0000 7faee5d9b640 1 -- 172.21.15.134:0/420272171 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00317a0 con 0x7faee815ce80 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.355+0000 7faee5d9b640 1 -- 172.21.15.134:0/420272171 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0031b70 con 0x7faee815ce80 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 -- 172.21.15.134:0/420272171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 msgr2=0x7faee81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee81594c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 -- 172.21.15.134:0/420272171 shutdown_connections 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee81594c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 --2- 172.21.15.134:0/420272171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee815ca40 0x7faee815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 -- 172.21.15.134:0/420272171 >> 172.21.15.134:0/420272171 conn(0x7faee8062cc0 msgr2=0x7faee806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 -- 172.21.15.134:0/420272171 shutdown_connections 2024-09-15T22:45:21.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.356+0000 7faeec877640 1 -- 172.21.15.134:0/420272171 wait complete. 2024-09-15T22:45:21.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.357+0000 7faeec877640 1 Processor -- start 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.357+0000 7faeec877640 1 -- start start 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80d02a0 0x7faee80b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee815ca40 0x7faee814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faee8155d10 con 0x7faee815ce80 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faee8155b90 con 0x7faee815ca40 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeec877640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faee80b4790 con 0x7faee80d02a0 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faee6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faee6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35720/0 (socket says 172.21.15.134:35720) 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faee6d9d640 1 -- 172.21.15.134:0/4235090181 learned_addr learned my addr 172.21.15.134:0/4235090181 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faee659c640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80d02a0 0x7faee80b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.358+0000 7faeddd9b640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee815ca40 0x7faee814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 -- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80d02a0 msgr2=0x7faee80b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80d02a0 0x7faee80b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 -- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee815ca40 msgr2=0x7faee814c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee815ca40 0x7faee814c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 -- 172.21.15.134:0/4235090181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee814b1d0 con 0x7faee815ce80 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faee6d9d640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faee0009eb0 tx=0x7faee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0040070 con 0x7faee815ce80 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0030b60 con 0x7faee815ce80 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee814b4a0 con 0x7faee815ce80 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0009450 con 0x7faee815ce80 2024-09-15T22:45:21.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.359+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee814ba60 con 0x7faee815ce80 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.360+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee80d0680 con 0x7faee815ce80 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.361+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7faee0039040 con 0x7faee815ce80 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.361+0000 7faedf7fe640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 0x7faec806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.361+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7faee00ac910 con 0x7faee815ce80 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.361+0000 7faee659c640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 0x7faec806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.362+0000 7faee659c640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 0x7faec806e890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faed8007fd0 tx=0x7faed8007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.365+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faee007abf0 con 0x7faee815ce80 2024-09-15T22:45:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.593+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faee815c4e0 con 0x7faee815ce80 2024-09-15T22:45:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.594+0000 7faedf7fe640 1 -- 172.21.15.134:0/4235090181 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7faee007eef0 con 0x7faee815ce80 2024-09-15T22:45:21.595 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:21.595 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:21.595 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:45:21.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:45:21.596 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.599 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:45:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:21.606 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:45:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:21.609 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 msgr2=0x7faec806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 0x7faec806e890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faed8007fd0 tx=0x7faed8007de0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 msgr2=0x7faee8148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faee0009eb0 tx=0x7faee0004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 shutdown_connections 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faec806c3d0 0x7faec806e890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee815ce80 0x7faee8148ac0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee815ca40 0x7faee814c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 --2- 172.21.15.134:0/4235090181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80d02a0 0x7faee80b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 >> 172.21.15.134:0/4235090181 conn(0x7faee8062cc0 msgr2=0x7faee80ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 shutdown_connections 2024-09-15T22:45:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.596+0000 7faeec877640 1 -- 172.21.15.134:0/4235090181 wait complete. 2024-09-15T22:45:21.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:45:21.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:45:21.657 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:45:21.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.711+0000 7f9b58f52640 1 Processor -- start 2024-09-15T22:45:21.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.711+0000 7f9b58f52640 1 -- start start 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b5415e940 0x7f9b540d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415ed20 0x7f9b540d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 0x7f9b540b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9b540d1ae0 con 0x7f9b5415e940 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9b540b7170 con 0x7f9b540cef90 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b58f52640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9b540b7aa0 con 0x7f9b5415ed20 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b5415e940 0x7f9b540d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b5415e940 0x7f9b540d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35728/0 (socket says 172.21.15.134:35728) 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 -- 172.21.15.134:0/3243740065 learned_addr learned my addr 172.21.15.134:0/3243740065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b52d9d640 1 --2- 172.21.15.134:0/3243740065 >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 0x7f9b540b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b4bfff640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415ed20 0x7f9b540d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 -- 172.21.15.134:0/3243740065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415ed20 msgr2=0x7f9b540d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415ed20 0x7f9b540d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 -- 172.21.15.134:0/3243740065 >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 msgr2=0x7f9b540b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 --2- 172.21.15.134:0/3243740065 >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 0x7f9b540b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b5259c640 1 -- 172.21.15.134:0/3243740065 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b540d3660 con 0x7f9b5415e940 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.712+0000 7f9b52d9d640 1 --2- 172.21.15.134:0/3243740065 >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 0x7f9b540b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b5259c640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b5415e940 0x7f9b540d1060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9b54073e20 tx=0x7f9b4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81de78e462648dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b51d9b640 1 -- 172.21.15.134:0/3243740065 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44037070 con 0x7f9b5415e940 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b51d9b640 1 -- 172.21.15.134:0/3243740065 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b44032440 con 0x7f9b5415e940 2024-09-15T22:45:21.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b51d9b640 1 -- 172.21.15.134:0/3243740065 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44032810 con 0x7f9b5415e940 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b58f52640 1 -- 172.21.15.134:0/3243740065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b5415e940 msgr2=0x7f9b540d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.713+0000 7f9b58f52640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b5415e940 0x7f9b540d1060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9b54073e20 tx=0x7f9b4402a270 comp rx=0 tx=0).stop 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 -- 172.21.15.134:0/3243740065 shutdown_connections 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 --2- 172.21.15.134:0/3243740065 >> v2:172.21.15.177:3300/0 conn(0x7f9b540cef90 0x7f9b540b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415ed20 0x7f9b540d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 --2- 172.21.15.134:0/3243740065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b5415e940 0x7f9b540d1060 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 -- 172.21.15.134:0/3243740065 >> 172.21.15.134:0/3243740065 conn(0x7f9b540b6240 msgr2=0x7f9b540b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 -- 172.21.15.134:0/3243740065 shutdown_connections 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.714+0000 7f9b58f52640 1 -- 172.21.15.134:0/3243740065 wait complete. 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.715+0000 7f9b58f52640 1 Processor -- start 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.715+0000 7f9b58f52640 1 -- start start 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415e940 0x7f9b540ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b5415ed20 0x7f9b540ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b540d3f00 con 0x7f9b540cef90 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b540d3c20 con 0x7f9b5415ed20 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9b540d1ef0 con 0x7f9b5415e940 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35742/0 (socket says 172.21.15.134:35742) 2024-09-15T22:45:21.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 -- 172.21.15.134:0/690870531 learned_addr learned my addr 172.21.15.134:0/690870531 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b4bfff640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415e940 0x7f9b540ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 -- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415e940 msgr2=0x7f9b540ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415e940 0x7f9b540ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 -- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b5415ed20 msgr2=0x7f9b540ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b5415ed20 0x7f9b540ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 -- 172.21.15.134:0/690870531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b541f54d0 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b5259c640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9b4402a2b0 tx=0x7f9b440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44037040 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b44042070 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b541f57b0 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44030bb0 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.716+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b541f5d70 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.717+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b540d0b80 con 0x7f9b540cef90 2024-09-15T22:45:21.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.718+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f9b44047460 con 0x7f9b540cef90 2024-09-15T22:45:21.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.718+0000 7f9b4affd640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 0x7f9b3406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.718+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7f9b440abe40 con 0x7f9b540cef90 2024-09-15T22:45:21.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.718+0000 7f9b4bfff640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 0x7f9b3406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.719+0000 7f9b4bfff640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 0x7f9b3406e890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9b54158620 tx=0x7f9b3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.722+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b540d0b80 con 0x7f9b540cef90 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.888+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9b540d0580 con 0x7f9b540cef90 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.888+0000 7f9b4affd640 1 -- 172.21.15.134:0/690870531 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7f9b540d0580 con 0x7f9b540cef90 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:21.890 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.890+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 msgr2=0x7f9b3406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.890+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 0x7f9b3406e890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9b54158620 tx=0x7f9b3c008040 comp rx=0 tx=0).stop 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.890+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 msgr2=0x7f9b541f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.890+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9b4402a2b0 tx=0x7f9b440046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 shutdown_connections 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b5415ed20 0x7f9b540ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b5415e940 0x7f9b540ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b3406c3d0 0x7f9b3406e890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 --2- 172.21.15.134:0/690870531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b540cef90 0x7f9b541f4bf0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 >> 172.21.15.134:0/690870531 conn(0x7f9b540b6240 msgr2=0x7f9b540b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 shutdown_connections 2024-09-15T22:45:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:21.891+0000 7f9b58f52640 1 -- 172.21.15.134:0/690870531 wait complete. 2024-09-15T22:45:21.903 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:45:21.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:45:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.044+0000 7f8b84168640 1 Processor -- start 2024-09-15T22:45:22.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.044+0000 7f8b84168640 1 -- start start 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b84168640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c15e770 0x7f8b7c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b84168640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b84168640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7c0b6b30 con 0x7f8b7c0b6710 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b84168640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7c15eb50 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b84168640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c0d2320 con 0x7f8b7c15e770 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b82705640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b82705640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35756/0 (socket says 172.21.15.134:35756) 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.045+0000 7f8b82705640 1 -- 172.21.15.134:0/484867073 learned_addr learned my addr 172.21.15.134:0/484867073 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b81f04640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c15e770 0x7f8b7c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b82705640 1 -- 172.21.15.134:0/484867073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c15e770 msgr2=0x7f8b7c0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b82705640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c15e770 0x7f8b7c0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b82705640 1 -- 172.21.15.134:0/484867073 >> v1:172.21.15.134:6789/0 conn(0x7f8b7c0b6710 legacy=0x7f8b7c0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b82705640 1 -- 172.21.15.134:0/484867073 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c0d25e0 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b80f02640 1 -- 172.21.15.134:0/484867073 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386911017 0 0) 0x7f8b7c0b6b30 con 0x7f8b7c0b6710 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.046+0000 7f8b82705640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009870 tx=0x7f8b7402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347b1e8aac386caa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b80f02640 1 -- 172.21.15.134:0/484867073 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74037070 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b80f02640 1 -- 172.21.15.134:0/484867073 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74032440 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b80f02640 1 -- 172.21.15.134:0/484867073 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74032810 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 -- 172.21.15.134:0/484867073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c0b3b40 msgr2=0x7f8b7c0d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009870 tx=0x7f8b7402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 -- 172.21.15.134:0/484867073 shutdown_connections 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c0d33a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 --2- 172.21.15.134:0/484867073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c15e770 0x7f8b7c0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 -- 172.21.15.134:0/484867073 >> 172.21.15.134:0/484867073 conn(0x7f8b7c062a50 msgr2=0x7f8b7c062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 -- 172.21.15.134:0/484867073 shutdown_connections 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.047+0000 7f8b84168640 1 -- 172.21.15.134:0/484867073 wait complete. 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.048+0000 7f8b84168640 1 Processor -- start 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.048+0000 7f8b84168640 1 -- start start 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c0b6710 0x7f8b7c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0d2e80 con 0x7f8b7c15e770 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0d2ba0 con 0x7f8b7c0b3b40 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b84168640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c0b76a0 con 0x7f8b7c0b6710 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35770/0 (socket says 172.21.15.134:35770) 2024-09-15T22:45:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 -- 172.21.15.134:0/2920308207 learned_addr learned my addr 172.21.15.134:0/2920308207 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b81703640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c0b6710 0x7f8b7c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b81f04640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 -- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c0b6710 msgr2=0x7f8b7c160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c0b6710 0x7f8b7c160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 -- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b7c0b3b40 msgr2=0x7f8b7c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.049+0000 7f8b82705640 1 -- 172.21.15.134:0/2920308207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c15ef20 con 0x7f8b7c15e770 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b82705640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b740090b0 tx=0x7f8b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74037040 con 0x7f8b7c15e770 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74004230 con 0x7f8b7c15e770 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c15f200 con 0x7f8b7c15e770 2024-09-15T22:45:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74003610 con 0x7f8b7c15e770 2024-09-15T22:45:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.050+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c15f7c0 con 0x7f8b7c15e770 2024-09-15T22:45:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.051+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c0b61d0 con 0x7f8b7c15e770 2024-09-15T22:45:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.051+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f8b7402ad10 con 0x7f8b7c15e770 2024-09-15T22:45:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.052+0000 7f8b727fc640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 0x7f8b6006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.052+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7f8b740abc10 con 0x7f8b7c15e770 2024-09-15T22:45:22.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.052+0000 7f8b81f04640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 0x7f8b6006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.053+0000 7f8b81f04640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 0x7f8b6006e890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b780099c0 tx=0x7f8b78003990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.056+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b7407a6f0 con 0x7f8b7c15e770 2024-09-15T22:45:22.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.222+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8b7c0b4f60 con 0x7f8b7c15e770 2024-09-15T22:45:22.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.512+0000 7f8b727fc640 1 -- 172.21.15.134:0/2920308207 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7f8b74079ff0 con 0x7f8b7c15e770 2024-09-15T22:45:22.514 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:45:22.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 msgr2=0x7f8b6006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 0x7f8b6006e890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b780099c0 tx=0x7f8b78003990 comp rx=0 tx=0).stop 2024-09-15T22:45:22.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 msgr2=0x7f8b7c152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b740090b0 tx=0x7f8b740046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 shutdown_connections 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6006c3d0 0x7f8b6006e890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b7c15e770 0x7f8b7c152d00 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b7c0b6710 0x7f8b7c160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 --2- 172.21.15.134:0/2920308207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b7c0b3b40 0x7f8b7c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 >> 172.21.15.134:0/2920308207 conn(0x7f8b7c062a50 msgr2=0x7f8b7c0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 shutdown_connections 2024-09-15T22:45:22.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.515+0000 7f8b84168640 1 -- 172.21.15.134:0/2920308207 wait complete. 2024-09-15T22:45:22.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:45:22.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.634+0000 7fd7468a5640 1 Processor -- start 2024-09-15T22:45:22.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.634+0000 7fd7468a5640 1 -- start start 2024-09-15T22:45:22.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd7468a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd7400cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd7468a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd74006d4f0 0x7fd74006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd7468a5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7400b4240 con 0x7fd740145d90 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd7468a5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd74006d080 con 0x7fd74006d4f0 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd7468a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd7400b4520 con 0x7fd7400cf5d0 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd73ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd740145d90 0x7fd7400ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56334/0 (socket says 172.21.15.134:56334) 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.635+0000 7fd73ffff640 1 -- 172.21.15.134:0/3860733117 learned_addr learned my addr 172.21.15.134:0/3860733117 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd7400cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd744e42640 1 --2- 172.21.15.134:0/3860733117 >> v2:172.21.15.177:3300/0 conn(0x7fd74006d4f0 0x7fd74006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411641995 0 0) 0x7fd7400b4240 con 0x7fd740145d90 2024-09-15T22:45:22.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd72c003520 con 0x7fd740145d90 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246269876 0 0) 0x7fd72c003520 con 0x7fd740145d90 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 msgr2=0x7fd7400cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd7400cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 >> v2:172.21.15.177:3300/0 conn(0x7fd74006d4f0 msgr2=0x7fd74006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 --2- 172.21.15.134:0/3860733117 >> v2:172.21.15.177:3300/0 conn(0x7fd74006d4f0 0x7fd74006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7400b4800 con 0x7fd740145d90 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd730001670 con 0x7fd740145d90 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 >> v1:172.21.15.134:6789/0 conn(0x7fd740145d90 legacy=0x7fd7400ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd72c0039b0 0x7fd72c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd72c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7400b4520 con 0x7fd72c004800 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c00b9c0 con 0x7fd72c0039b0 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd72c00bb40 con 0x7fd7400cf5d0 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd73ffff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd72c0039b0 0x7fd72c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd744e42640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd72c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 -- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 msgr2=0x7fd72c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd72c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 -- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd72c0039b0 msgr2=0x7fd72c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd72c0039b0 0x7fd72c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd737fff640 1 -- 172.21.15.134:0/3860733117 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c003520 con 0x7fd72c004800 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.636+0000 7fd744e42640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400cf5d0 0x7fd72c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:22.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.637+0000 7fd737fff640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd72c004c80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd728009ac0 tx=0x7fd72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02f9572673dde93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.637+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728036070 con 0x7fd72c004800 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.637+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728031400 con 0x7fd72c004800 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.637+0000 7fd73f7fe640 1 -- 172.21.15.134:0/3860733117 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728009690 con 0x7fd72c004800 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 -- 172.21.15.134:0/3860733117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 msgr2=0x7fd72c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3860733117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd72c004c80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd728009ac0 tx=0x7fd72c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd744e42640 1 -- 172.21.15.134:0/3860733117 reap_dead start 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 -- 172.21.15.134:0/3860733117 shutdown_connections 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 -- 172.21.15.134:0/3860733117 >> 172.21.15.134:0/3860733117 conn(0x7fd74006bba0 msgr2=0x7fd74006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 -- 172.21.15.134:0/3860733117 shutdown_connections 2024-09-15T22:45:22.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.638+0000 7fd7468a5640 1 -- 172.21.15.134:0/3860733117 wait complete. 2024-09-15T22:45:22.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.639+0000 7fd7468a5640 1 Processor -- start 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.639+0000 7fd7468a5640 1 -- start start 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400c6fa0 0x7fd7400c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd740072560 0x7fd7400729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7400b5610 con 0x7fd72c004800 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7400cd660 con 0x7fd740072560 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd7468a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd7400b5790 con 0x7fd7400c6fa0 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35798/0 (socket says 172.21.15.134:35798) 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 -- 172.21.15.134:0/3447757709 learned_addr learned my addr 172.21.15.134:0/3447757709 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd744e42640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd740072560 0x7fd7400729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd737fff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400c6fa0 0x7fd7400c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 -- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400c6fa0 msgr2=0x7fd7400c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400c6fa0 0x7fd7400c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 -- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd740072560 msgr2=0x7fd7400729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd740072560 0x7fd7400729e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 -- 172.21.15.134:0/3447757709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7401f4140 con 0x7fd72c004800 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.640+0000 7fd73ffff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd730007310 tx=0x7fd7300077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.641+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000f9c0 con 0x7fd72c004800 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.641+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730018070 con 0x7fd72c004800 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.641+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7401f43e0 con 0x7fd72c004800 2024-09-15T22:45:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.641+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000fd80 con 0x7fd72c004800 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.641+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401f49a0 con 0x7fd72c004800 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.642+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd740146170 con 0x7fd72c004800 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.642+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fd73001d460 con 0x7fd72c004800 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.643+0000 7fd73d7fa640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 0x7fd72006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.643+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5227+0+0 (secure 0 0 0) 0x7fd73008be60 con 0x7fd72c004800 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.643+0000 7fd737fff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 0x7fd72006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.644+0000 7fd737fff640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 0x7fd72006e890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd728033000 tx=0x7fd728008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.647+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7300bad50 con 0x7fd72c004800 2024-09-15T22:45:22.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:22.813+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd7400ccd60 con 0x7fd72c004800 2024-09-15T22:45:23.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.519+0000 7fd73d7fa640 1 -- 172.21.15.134:0/3447757709 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7fd73005a780 con 0x7fd72c004800 2024-09-15T22:45:23.521 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.521+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 msgr2=0x7fd72006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.521+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 0x7fd72006e890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd728033000 tx=0x7fd728008030 comp rx=0 tx=0).stop 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 msgr2=0x7fd7400aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd730007310 tx=0x7fd7300077d0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 shutdown_connections 2024-09-15T22:45:23.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd740072560 0x7fd7400729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7400c6fa0 0x7fd7400c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd72006c3d0 0x7fd72006e890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 --2- 172.21.15.134:0/3447757709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd72c004800 0x7fd7400aeb50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 >> 172.21.15.134:0/3447757709 conn(0x7fd74006bba0 msgr2=0x7fd7400b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 shutdown_connections 2024-09-15T22:45:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.522+0000 7fd7468a5640 1 -- 172.21.15.134:0/3447757709 wait complete. 2024-09-15T22:45:23.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:45:23.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.644+0000 7fe9a9a3c640 1 Processor -- start 2024-09-15T22:45:23.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.644+0000 7fe9a9a3c640 1 -- start start 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a9a3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe9a415c680 0x7fe9a4073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a9a3c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe9a415d750 0x7fe9a415db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a9a3c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a4071620 con 0x7fe9a415ca60 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a9a3c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a4071900 con 0x7fe9a415c680 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a9a3c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a415cf50 con 0x7fe9a415d750 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe9a415c680 0x7fe9a4073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe9a415c680 0x7fe9a4073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35808/0 (socket says 172.21.15.134:35808) 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a2ffd640 1 -- 172.21.15.134:0/1497313421 learned_addr learned my addr 172.21.15.134:0/1497313421 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:23.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a37fe640 1 --2- 172.21.15.134:0/1497313421 >> v2:172.21.15.177:3300/0 conn(0x7fe9a415d750 0x7fe9a415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a2ffd640 1 -- 172.21.15.134:0/1497313421 >> v2:172.21.15.177:3300/0 conn(0x7fe9a415d750 msgr2=0x7fe9a415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.645+0000 7fe9a2ffd640 1 --2- 172.21.15.134:0/1497313421 >> v2:172.21.15.177:3300/0 conn(0x7fe9a415d750 0x7fe9a415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a2ffd640 1 -- 172.21.15.134:0/1497313421 >> v1:172.21.15.177:6789/0 conn(0x7fe9a415ca60 legacy=0x7fe9a4070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a2ffd640 1 -- 172.21.15.134:0/1497313421 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a415d230 con 0x7fe9a415c680 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a2ffd640 1 --2- 172.21.15.134:0/1497313421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415c680 0x7fe9a4073e20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40b7b50 tx=0x7fe99402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68b48fc8a9f16ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a27fc640 1 -- 172.21.15.134:0/1497313421 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994037070 con 0x7fe9a415c680 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a27fc640 1 -- 172.21.15.134:0/1497313421 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe994032440 con 0x7fe9a415c680 2024-09-15T22:45:23.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.646+0000 7fe9a27fc640 1 -- 172.21.15.134:0/1497313421 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994032810 con 0x7fe9a415c680 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1497313421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415c680 msgr2=0x7fe9a4073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1497313421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415c680 0x7fe9a4073e20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40b7b50 tx=0x7fe99402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1497313421 shutdown_connections 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1497313421 >> v2:172.21.15.177:3300/0 conn(0x7fe9a415d750 0x7fe9a415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1497313421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415c680 0x7fe9a4073e20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1497313421 >> 172.21.15.134:0/1497313421 conn(0x7fe9a406f370 msgr2=0x7fe9a406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1497313421 shutdown_connections 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.647+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1497313421 wait complete. 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.648+0000 7fe9a9a3c640 1 Processor -- start 2024-09-15T22:45:23.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.648+0000 7fe9a9a3c640 1 -- start start 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a415c680 0x7fe9a41f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 0x7fe9a406e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a40b4700 con 0x7fe9a415d750 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a40b4580 con 0x7fe9a415c680 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a9a3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a40b4880 con 0x7fe9a415ca60 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35814/0 (socket says 172.21.15.134:35814) 2024-09-15T22:45:23.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a37fe640 1 -- 172.21.15.134:0/1218852885 learned_addr learned my addr 172.21.15.134:0/1218852885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.649+0000 7fe9a2ffd640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a415c680 0x7fe9a41f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe99a7fc640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 0x7fe9a406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 -- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 msgr2=0x7fe9a406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 0x7fe9a406e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 -- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a415c680 msgr2=0x7fe9a41f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a415c680 0x7fe9a41f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 -- 172.21.15.134:0/1218852885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a406d770 con 0x7fe9a415d750 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe99a7fc640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 0x7fe9a406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a37fe640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe99c007e90 tx=0x7fe99c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c014420 con 0x7fe9a415d750 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c019070 con 0x7fe9a415d750 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a406da50 con 0x7fe9a415d750 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c014800 con 0x7fe9a415d750 2024-09-15T22:45:23.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.650+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a406e010 con 0x7fe9a415d750 2024-09-15T22:45:23.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.651+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a40d36e0 con 0x7fe9a415d750 2024-09-15T22:45:23.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.652+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fe99c0149a0 con 0x7fe9a415d750 2024-09-15T22:45:23.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.652+0000 7fe9a0ff9640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 0x7fe98406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.652+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5609+0+0 (secure 0 0 0) 0x7fe99c08be10 con 0x7fe9a415d750 2024-09-15T22:45:23.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.652+0000 7fe9a2ffd640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 0x7fe98406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.653+0000 7fe9a2ffd640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 0x7fe98406e890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe994034000 tx=0x7fe99402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:23.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.657+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe99c05a440 con 0x7fe9a415d750 2024-09-15T22:45:23.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:23.857+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe9a4069160 con 0x7fe9a415d750 2024-09-15T22:45:24.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.521+0000 7fe9a0ff9640 1 -- 172.21.15.134:0/1218852885 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v41) ==== 174+0+0 (secure 0 0 0) 0x7fe99c059d40 con 0x7fe9a415d750 2024-09-15T22:45:24.522 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 12 and data pool 13 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 msgr2=0x7fe98406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 0x7fe98406e890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe994034000 tx=0x7fe99402e000 comp rx=0 tx=0).stop 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 msgr2=0x7fe9a4149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe99c007e90 tx=0x7fe99c00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 shutdown_connections 2024-09-15T22:45:24.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe98406c3d0 0x7fe98406e890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a415d750 0x7fe9a4149460 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9a415ca60 0x7fe9a406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 --2- 172.21.15.134:0/1218852885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a415c680 0x7fe9a41f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 >> 172.21.15.134:0/1218852885 conn(0x7fe9a406f370 msgr2=0x7fe9a40b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 shutdown_connections 2024-09-15T22:45:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.524+0000 7fe9a9a3c640 1 -- 172.21.15.134:0/1218852885 wait complete. 2024-09-15T22:45:24.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:24.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.636+0000 7f98cbc8d640 1 Processor -- start 2024-09-15T22:45:24.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 -- start start 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 0x7f98c40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98c406c1f0 0x7f98c415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c40cd5f0 con 0x7f98c4151540 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f98c40cd8d0 con 0x7f98c406c1f0 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.637+0000 7f98cbc8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98c40cdbb0 con 0x7f98c406be10 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98c406c1f0 0x7f98c415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98c406c1f0 0x7f98c415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35826/0 (socket says 172.21.15.134:35826) 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 -- 172.21.15.134:0/3637130800 learned_addr learned my addr 172.21.15.134:0/3637130800 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9a29640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 0x7f98c40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 -- 172.21.15.134:0/3637130800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 msgr2=0x7f98c40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 0x7f98c40cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 -- 172.21.15.134:0/3637130800 >> v1:172.21.15.177:6789/0 conn(0x7f98c4151540 legacy=0x7f98c415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9228640 1 -- 172.21.15.134:0/3637130800 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c40cde90 con 0x7f98c406c1f0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.638+0000 7f98c9a29640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 0x7f98c40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98c9228640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c415baa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009870 tx=0x7f98b402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6715624bbdba49f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98c8a27640 1 -- 172.21.15.134:0/3637130800 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4037070 con 0x7f98c406c1f0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98c8a27640 1 -- 172.21.15.134:0/3637130800 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4032440 con 0x7f98c406c1f0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98c8a27640 1 -- 172.21.15.134:0/3637130800 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4032810 con 0x7f98c406c1f0 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 -- 172.21.15.134:0/3637130800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 msgr2=0x7f98c415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c415baa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009870 tx=0x7f98b402a210 comp rx=0 tx=0).stop 2024-09-15T22:45:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 -- 172.21.15.134:0/3637130800 shutdown_connections 2024-09-15T22:45:24.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c415baa0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/3637130800 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c406be10 0x7f98c40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 -- 172.21.15.134:0/3637130800 >> 172.21.15.134:0/3637130800 conn(0x7f98c4062cc0 msgr2=0x7f98c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 -- 172.21.15.134:0/3637130800 shutdown_connections 2024-09-15T22:45:24.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.639+0000 7f98cbc8d640 1 -- 172.21.15.134:0/3637130800 wait complete. 2024-09-15T22:45:24.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.640+0000 7f98cbc8d640 1 Processor -- start 2024-09-15T22:45:24.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.640+0000 7f98cbc8d640 1 -- start start 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 0x7f98c4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 0x7f98c4157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41519d0 con 0x7f98c406c1f0 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98c40ce690 con 0x7f98c406be10 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98cbc8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98c4151b50 con 0x7f98c4151540 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98c9228640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98c9228640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35828/0 (socket says 172.21.15.134:35828) 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.641+0000 7f98c9228640 1 -- 172.21.15.134:0/4101250964 learned_addr learned my addr 172.21.15.134:0/4101250964 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9a29640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 0x7f98c4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 -- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 msgr2=0x7f98c4157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98ca22a640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 0x7f98c4157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 0x7f98c4157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 -- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 msgr2=0x7f98c4150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 0x7f98c4150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 -- 172.21.15.134:0/4101250964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c40728e0 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9a29640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 0x7f98c4150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98ca22a640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 0x7f98c4157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98c9228640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009870 tx=0x7f98b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4037040 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4042070 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c4156230 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4030bb0 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.642+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c41567f0 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.643+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c40cd010 con 0x7f98c406c1f0 2024-09-15T22:45:24.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.643+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f98b4047460 con 0x7f98c406c1f0 2024-09-15T22:45:24.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.644+0000 7f98ba7fc640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 0x7f98a806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.644+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f98b40ac0f0 con 0x7f98c406c1f0 2024-09-15T22:45:24.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.644+0000 7f98c9a29640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 0x7f98a806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.645+0000 7f98c9a29640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 0x7f98a806e890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98bc006fd0 tx=0x7f98bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.648+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98c40728e0 con 0x7f98c406c1f0 2024-09-15T22:45:24.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.814+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98c415ab90 con 0x7f98c406c1f0 2024-09-15T22:45:24.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.816+0000 7f98ba7fc640 1 -- 172.21.15.134:0/4101250964 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16781 (secure 0 0 0) 0x7f98b407a7e0 con 0x7f98c406c1f0 2024-09-15T22:45:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:24.817 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":87,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:23.858351+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:22.241856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:22.832685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.817+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 msgr2=0x7f98a806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 0x7f98a806e890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98bc006fd0 tx=0x7f98bc008040 comp rx=0 tx=0).stop 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 msgr2=0x7f98c4157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009870 tx=0x7f98b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 shutdown_connections 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98c4151540 0x7f98c4157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98a806c3d0 0x7f98a806e890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98c406c1f0 0x7f98c4157980 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 --2- 172.21.15.134:0/4101250964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98c406be10 0x7f98c4150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 >> 172.21.15.134:0/4101250964 conn(0x7f98c4062cc0 msgr2=0x7f98c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 shutdown_connections 2024-09-15T22:45:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.818+0000 7f98cbc8d640 1 -- 172.21.15.134:0/4101250964 wait complete. 2024-09-15T22:45:24.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:24.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.926+0000 7f3efe142640 1 Processor -- start 2024-09-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.926+0000 7f3efe142640 1 -- start start 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3efe142640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ef80cf070 0x7f3ef80cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3efe142640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef8073120 0x7f3ef80735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3efe142640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef80ce740 con 0x7f3ef815c180 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3efe142640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef8072640 con 0x7f3ef80cf070 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3efe142640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef8072920 con 0x7f3ef8073120 2024-09-15T22:45:24.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3ef815c180 0x7f3ef80cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56348/0 (socket says 172.21.15.134:56348) 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef77fe640 1 -- 172.21.15.134:0/2755376717 learned_addr learned my addr 172.21.15.134:0/2755376717 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877112805 0 0) 0x7f3ef80ce740 con 0x7f3ef815c180 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee0003520 con 0x7f3ef815c180 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> v2:172.21.15.177:3300/0 conn(0x7f3ef80cf070 0x7f3ef80cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.927+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef8073120 0x7f3ef80735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 164322093 0 0) 0x7f3ee0003520 con 0x7f3ef815c180 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef8073120 msgr2=0x7f3ef80735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef8073120 0x7f3ef80735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 >> v2:172.21.15.177:3300/0 conn(0x7f3ef80cf070 msgr2=0x7f3ef80cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 --2- 172.21.15.134:0/2755376717 >> v2:172.21.15.177:3300/0 conn(0x7f3ef80cf070 0x7f3ef80cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef8072c00 con 0x7f3ef815c180 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f3ee8001a10 con 0x7f3ef815c180 2024-09-15T22:45:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> v2:172.21.15.177:3300/0 conn(0x7f3ef80cf070 0x7f3ef80cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 >> v1:172.21.15.134:6789/0 conn(0x7f3ef815c180 legacy=0x7f3ef80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee0004800 0x7f3ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee00051c0 0x7f3ee000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8072640 con 0x7f3ee0004800 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8072920 con 0x7f3ee00051c0 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee000c090 con 0x7f3ee00039b0 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef8073120 0x7f3ef80735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee0004800 0x7f3ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef77fe640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee00051c0 0x7f3ee000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 -- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ee00039b0 msgr2=0x7f3ee0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 -- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee00051c0 msgr2=0x7f3ee000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee00051c0 0x7f3ee000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.928+0000 7f3ef6ffd640 1 -- 172.21.15.134:0/2755376717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee0003520 con 0x7f3ee0004800 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee0004800 0x7f3ee0004c80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80cfa20 tx=0x7f3ee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefdd383b89ed352 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec037070 con 0x7f3ee0004800 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec02ad00 con 0x7f3ee0004800 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3ef67fc640 1 -- 172.21.15.134:0/2755376717 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00f040 con 0x7f3ee0004800 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3efe142640 1 -- 172.21.15.134:0/2755376717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee0004800 msgr2=0x7f3ee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3efe142640 1 --2- 172.21.15.134:0/2755376717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee0004800 0x7f3ee0004c80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80cfa20 tx=0x7f3ee0005830 comp rx=0 tx=0).stop 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3ef7fff640 1 -- 172.21.15.134:0/2755376717 reap_dead start 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3efe142640 1 -- 172.21.15.134:0/2755376717 shutdown_connections 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.929+0000 7f3efe142640 1 -- 172.21.15.134:0/2755376717 >> 172.21.15.134:0/2755376717 conn(0x7f3ef8062cc0 msgr2=0x7f3ef806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.930+0000 7f3efe142640 1 -- 172.21.15.134:0/2755376717 shutdown_connections 2024-09-15T22:45:24.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.930+0000 7f3efe142640 1 -- 172.21.15.134:0/2755376717 wait complete. 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.931+0000 7f3efe142640 1 Processor -- start 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.931+0000 7f3efe142640 1 -- start start 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee0004800 0x7f3ef8156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef80ae0a0 0x7f3ef80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef80722f0 con 0x7f3ef80ae520 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef80ced00 con 0x7f3ee0004800 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef815c560 con 0x7f3ef80ae0a0 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35844/0 (socket says 172.21.15.134:35844) 2024-09-15T22:45:24.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 -- 172.21.15.134:0/1612034201 learned_addr learned my addr 172.21.15.134:0/1612034201 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef77fe640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee0004800 0x7f3ef8156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef6ffd640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef80ae0a0 0x7f3ef80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 -- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef80ae0a0 msgr2=0x7f3ef80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef80ae0a0 0x7f3ef80b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 -- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee0004800 msgr2=0x7f3ef8156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee0004800 0x7f3ef8156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 -- 172.21.15.134:0/1612034201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef80ad360 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3ef7fff640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8071d80 tx=0x7f3ef00108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000e050 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef001b070 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000f040 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef80ad5e0 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.932+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef80ad8a0 con 0x7f3ef80ae520 2024-09-15T22:45:24.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.933+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef80cf4e0 con 0x7f3ef80ae520 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.934+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3ef0015aa0 con 0x7f3ef80ae520 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.934+0000 7f3edffff640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 0x7f3ee406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.934+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f3ef008b300 con 0x7f3ef80ae520 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.935+0000 7f3ef77fe640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 0x7f3ee406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.935+0000 7f3ef77fe640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 0x7f3ee406e8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8000f80 tx=0x7f3ee8006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:24.938+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ef80ad360 con 0x7f3ef80ae520 2024-09-15T22:45:25.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.104+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ef80b02a0 con 0x7f3ef80ae520 2024-09-15T22:45:25.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.106+0000 7f3edffff640 1 -- 172.21.15.134:0/1612034201 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16781 (secure 0 0 0) 0x7f3ef0059850 con 0x7f3ef80ae520 2024-09-15T22:45:25.107 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:25.108 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":87,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:23.858351+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:22.241856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:22.832685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:25.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 msgr2=0x7f3ee406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 0x7f3ee406e8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8000f80 tx=0x7f3ee8006040 comp rx=0 tx=0).stop 2024-09-15T22:45:25.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 msgr2=0x7f3ef80b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8071d80 tx=0x7f3ef00108c0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 shutdown_connections 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3ee406c400 0x7f3ee406e8c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef80ae520 0x7f3ef80b2780 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ef80ae0a0 0x7f3ef80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 --2- 172.21.15.134:0/1612034201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee0004800 0x7f3ef8156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 >> 172.21.15.134:0/1612034201 conn(0x7f3ef8062cc0 msgr2=0x7f3ef80b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 shutdown_connections 2024-09-15T22:45:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.108+0000 7f3efe142640 1 -- 172.21.15.134:0/1612034201 wait complete. 2024-09-15T22:45:25.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:45:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.221+0000 7f11b0ab7640 1 Processor -- start 2024-09-15T22:45:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.221+0000 7f11b0ab7640 1 -- start start 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11b0ab7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f11ac148020 0x7f11ac0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11b0ab7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ac148400 con 0x7f11ac0b4b90 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11b0ab7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ac0b53e0 con 0x7f11ac0ae8e0 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11b0ab7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f11ac0b5ff0 con 0x7f11ac148020 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a1d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f11ac0b4b90 0x7f11ac0b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56358/0 (socket says 172.21.15.134:56358) 2024-09-15T22:45:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a1d9b640 1 -- 172.21.15.134:0/2807973166 learned_addr learned my addr 172.21.15.134:0/2807973166 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11aa59c640 1 --2- 172.21.15.134:0/2807973166 >> v2:172.21.15.177:3300/0 conn(0x7f11ac148020 0x7f11ac0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384908377 0 0) 0x7f11ac148400 con 0x7f11ac0b4b90 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1198003520 con 0x7f11ac0b4b90 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444866986 0 0) 0x7f11ac0b53e0 con 0x7f11ac0ae8e0 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ac148400 con 0x7f11ac0ae8e0 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 661274108 0 0) 0x7f1198003520 con 0x7f11ac0b4b90 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11aa59c640 1 -- 172.21.15.134:0/2807973166 >> v1:172.21.15.177:6789/0 conn(0x7f11ac0ae8e0 legacy=0x7f11ac0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11aa59c640 1 -- 172.21.15.134:0/2807973166 >> v1:172.21.15.134:6789/0 conn(0x7f11ac0b4b90 legacy=0x7f11ac0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.222+0000 7f11aa59c640 1 -- 172.21.15.134:0/2807973166 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac0b56c0 con 0x7f11ac148020 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.223+0000 7f11aa59c640 1 --2- 172.21.15.134:0/2807973166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac0b0b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f119c0097a0 tx=0x7f119c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946ed08c9cc291e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.223+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c037070 con 0x7f11ac148020 2024-09-15T22:45:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.223+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c02ac50 con 0x7f11ac148020 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.223+0000 7f11a9d9b640 1 -- 172.21.15.134:0/2807973166 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194001670 con 0x7f11ac148020 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 -- 172.21.15.134:0/2807973166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 msgr2=0x7f11ac0b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/2807973166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac0b0b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f119c0097a0 tx=0x7f119c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 -- 172.21.15.134:0/2807973166 shutdown_connections 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/2807973166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac0b0b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 -- 172.21.15.134:0/2807973166 >> 172.21.15.134:0/2807973166 conn(0x7f11ac06d0d0 msgr2=0x7f11ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 -- 172.21.15.134:0/2807973166 shutdown_connections 2024-09-15T22:45:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.224+0000 7f11b0ab7640 1 -- 172.21.15.134:0/2807973166 wait complete. 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.225+0000 7f11b0ab7640 1 Processor -- start 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.225+0000 7f11b0ab7640 1 -- start start 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 0x7f11ac144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0b5000 con 0x7f11ac0b4b90 2024-09-15T22:45:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0b5c80 con 0x7f11ac148020 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11b0ab7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11ac0b5180 con 0x7f11ac0ae8e0 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35852/0 (socket says 172.21.15.134:35852) 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 -- 172.21.15.134:0/3218603345 learned_addr learned my addr 172.21.15.134:0/3218603345 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11aad9d640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11aa59c640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 0x7f11ac144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 -- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 msgr2=0x7f11ac144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 0x7f11ac144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 -- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 msgr2=0x7f11ac142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.226+0000 7f11a1d9b640 1 -- 172.21.15.134:0/3218603345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac143670 con 0x7f11ac0b4b90 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11aa59c640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 0x7f11ac144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11a1d9b640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f119400c5a0 tx=0x7f119400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194017070 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194005ce0 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac143950 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940072b0 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.227+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac143f10 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.228+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ac0b0b30 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.228+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f119401a070 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.229+0000 7f11a37fe640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 0x7f118c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.229+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f119408aa60 con 0x7f11ac0b4b90 2024-09-15T22:45:25.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.229+0000 7f11aa59c640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 0x7f118c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.229+0000 7f11aa59c640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 0x7f118c06e890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f119c034000 tx=0x7f119c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.233+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1194059150 con 0x7f11ac0b4b90 2024-09-15T22:45:25.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.433+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f11ac0aee60 con 0x7f11ac0b4b90 2024-09-15T22:45:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.527+0000 7f11a37fe640 1 -- 172.21.15.134:0/3218603345 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) ==== 118+0+0 (secure 0 0 0) 0x7f1194058a50 con 0x7f11ac0b4b90 2024-09-15T22:45:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 msgr2=0x7f118c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 0x7f118c06e890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f119c034000 tx=0x7f119c02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 msgr2=0x7f11ac140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f119400c5a0 tx=0x7f119400ca60 comp rx=0 tx=0).stop 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 shutdown_connections 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11ac148020 0x7f11ac142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f118c06c3d0 0x7f118c06e890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11ac0b4b90 0x7f11ac140580 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 --2- 172.21.15.134:0/3218603345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11ac0ae8e0 0x7f11ac144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 >> 172.21.15.134:0/3218603345 conn(0x7f11ac06d0d0 msgr2=0x7f11ac06e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 shutdown_connections 2024-09-15T22:45:25.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.529+0000 7f11b0ab7640 1 -- 172.21.15.134:0/3218603345 wait complete. 2024-09-15T22:45:25.541 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:45:25.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:45:25.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.641+0000 7f566d1b9640 1 Processor -- start 2024-09-15T22:45:25.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.641+0000 7f566d1b9640 1 -- start start 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.642+0000 7f566d1b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f56680713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.642+0000 7f566d1b9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56680b1ca0 0x7f56680b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.642+0000 7f566d1b9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5668071a70 con 0x7f56680b6830 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.642+0000 7f566d1b9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f56680b55c0 con 0x7f56680b1ca0 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.642+0000 7f566d1b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f56680b5810 con 0x7f566815c720 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56680b1ca0 0x7f56680b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f5666d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f56680713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f566759e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f56680b6830 0x7f56680b6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48558/0 (socket says 172.21.15.134:48558) 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56680b1ca0 0x7f56680b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42676/0 (socket says 172.21.15.134:42676) 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f566759e640 1 -- 172.21.15.134:0/4148147443 learned_addr learned my addr 172.21.15.134:0/4148147443 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 -- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 msgr2=0x7f56680713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f56680713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 -- 172.21.15.134:0/4148147443 >> v1:172.21.15.177:6789/0 conn(0x7f56680b6830 legacy=0x7f56680b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f565e59c640 1 -- 172.21.15.134:0/4148147443 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56680b5af0 con 0x7f56680b1ca0 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.643+0000 7f5666d9d640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f56680713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f565e59c640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b1ca0 0x7f56680b62f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f56500097a0 tx=0x7f565002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d52a889062394cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566659c640 1 -- 172.21.15.134:0/4148147443 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650037070 con 0x7f56680b1ca0 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566659c640 1 -- 172.21.15.134:0/4148147443 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5650032440 con 0x7f56680b1ca0 2024-09-15T22:45:25.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566659c640 1 -- 172.21.15.134:0/4148147443 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650032810 con 0x7f56680b1ca0 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 -- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b1ca0 msgr2=0x7f56680b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b1ca0 0x7f56680b62f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f56500097a0 tx=0x7f565002a180 comp rx=0 tx=0).stop 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 -- 172.21.15.134:0/4148147443 shutdown_connections 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b1ca0 0x7f56680b62f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 --2- 172.21.15.134:0/4148147443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f56680713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 -- 172.21.15.134:0/4148147443 >> 172.21.15.134:0/4148147443 conn(0x7f56680d2550 msgr2=0x7f56680d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 -- 172.21.15.134:0/4148147443 shutdown_connections 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.644+0000 7f566d1b9640 1 -- 172.21.15.134:0/4148147443 wait complete. 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.646+0000 7f566d1b9640 1 Processor -- start 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.646+0000 7f566d1b9640 1 -- start start 2024-09-15T22:45:25.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b6830 0x7f5668158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f5668158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56680b74b0 con 0x7f56680b1ca0 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56680d2290 con 0x7f56680b6830 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f56680b7630 con 0x7f566815c720 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35860/0 (socket says 172.21.15.134:35860) 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 -- 172.21.15.134:0/1914011320 learned_addr learned my addr 172.21.15.134:0/1914011320 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566759e640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f5668158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f565e59c640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b6830 0x7f5668158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 -- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 msgr2=0x7f5668158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f5668158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 -- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b6830 msgr2=0x7f5668158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b6830 0x7f5668158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 -- 172.21.15.134:0/1914011320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56681488f0 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f5666d9d640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f565800ebe0 tx=0x7f565800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658017070 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565800cc30 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.647+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566806cf00 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.648+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658013470 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.648+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566806d4c0 con 0x7f56680b1ca0 2024-09-15T22:45:25.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.649+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56680b62f0 con 0x7f56680b1ca0 2024-09-15T22:45:25.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.649+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f565801a070 con 0x7f56680b1ca0 2024-09-15T22:45:25.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.649+0000 7f565ffff640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 0x7f564806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.649+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f565808b4e0 con 0x7f56680b1ca0 2024-09-15T22:45:25.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.650+0000 7f565e59c640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 0x7f564806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.650+0000 7f565e59c640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 0x7f564806e890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5650034000 tx=0x7f565002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.654+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5658059470 con 0x7f56680b1ca0 2024-09-15T22:45:25.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:25.851+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f56680d08f0 con 0x7f56680b1ca0 2024-09-15T22:45:26.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.528+0000 7f565ffff640 1 -- 172.21.15.134:0/1914011320 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7f565805d770 con 0x7f56680b1ca0 2024-09-15T22:45:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 msgr2=0x7f564806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 0x7f564806e890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5650034000 tx=0x7f565002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 msgr2=0x7f56681483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f565800ebe0 tx=0x7f565800c520 comp rx=0 tx=0).stop 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 shutdown_connections 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f566815c720 0x7f5668158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56680b6830 0x7f5668158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f564806c3d0 0x7f564806e890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 --2- 172.21.15.134:0/1914011320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56680b1ca0 0x7f56681483b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 >> 172.21.15.134:0/1914011320 conn(0x7f56680d2550 msgr2=0x7f56680b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 shutdown_connections 2024-09-15T22:45:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.531+0000 7f566d1b9640 1 -- 172.21.15.134:0/1914011320 wait complete. 2024-09-15T22:45:26.545 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:45:26.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:26.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.648+0000 7f231f16d640 1 Processor -- start 2024-09-15T22:45:26.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.648+0000 7f231f16d640 1 -- start start 2024-09-15T22:45:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2318156880 0x7f23180cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180b65c0 0x7f2318160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23180aff30 0x7f23180b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f23180b08c0 con 0x7f2318156880 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f23180ce150 con 0x7f23180aff30 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231f16d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f23180ce430 con 0x7f23180b65c0 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2318156880 0x7f23180cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2318156880 0x7f23180cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38980/0 (socket says 172.21.15.134:38980) 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 -- 172.21.15.134:0/3866931978 learned_addr learned my addr 172.21.15.134:0/3866931978 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f230ffff640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180b65c0 0x7f2318160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231d70a640 1 --2- 172.21.15.134:0/3866931978 >> v2:172.21.15.177:3300/0 conn(0x7f23180aff30 0x7f23180b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 -- 172.21.15.134:0/3866931978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180b65c0 msgr2=0x7f2318160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180b65c0 0x7f2318160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 -- 172.21.15.134:0/3866931978 >> v2:172.21.15.177:3300/0 conn(0x7f23180aff30 msgr2=0x7f23180b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 --2- 172.21.15.134:0/3866931978 >> v2:172.21.15.177:3300/0 conn(0x7f23180aff30 0x7f23180b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.649+0000 7f231cf09640 1 -- 172.21.15.134:0/3866931978 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231815ff30 con 0x7f2318156880 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.650+0000 7f231cf09640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180cdae0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f23180b3f10 tx=0x7f231402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77007524a2154c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.650+0000 7f230f7fe640 1 -- 172.21.15.134:0/3866931978 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314036070 con 0x7f2318156880 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.650+0000 7f230f7fe640 1 -- 172.21.15.134:0/3866931978 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314031600 con 0x7f2318156880 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.650+0000 7f230f7fe640 1 -- 172.21.15.134:0/3866931978 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140319d0 con 0x7f2318156880 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 -- 172.21.15.134:0/3866931978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 msgr2=0x7f23180cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180cdae0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f23180b3f10 tx=0x7f231402a610 comp rx=0 tx=0).stop 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 -- 172.21.15.134:0/3866931978 shutdown_connections 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 --2- 172.21.15.134:0/3866931978 >> v2:172.21.15.177:3300/0 conn(0x7f23180aff30 0x7f23180b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180b65c0 0x7f2318160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 --2- 172.21.15.134:0/3866931978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180cdae0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 -- 172.21.15.134:0/3866931978 >> 172.21.15.134:0/3866931978 conn(0x7f231806cae0 msgr2=0x7f231806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 -- 172.21.15.134:0/3866931978 shutdown_connections 2024-09-15T22:45:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.651+0000 7f231f16d640 1 -- 172.21.15.134:0/3866931978 wait complete. 2024-09-15T22:45:26.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.652+0000 7f231f16d640 1 Processor -- start 2024-09-15T22:45:26.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.652+0000 7f231f16d640 1 -- start start 2024-09-15T22:45:26.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180aff30 0x7f23180b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 0x7f2318152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b6a30 con 0x7f2318156880 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2318156c60 con 0x7f23180b65c0 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2318160c70 con 0x7f23180aff30 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38982/0 (socket says 172.21.15.134:38982) 2024-09-15T22:45:26.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 -- 172.21.15.134:0/3114848723 learned_addr learned my addr 172.21.15.134:0/3114848723 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:26.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231cf09640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180aff30 0x7f23180b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f230ffff640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 0x7f2318152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 -- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180aff30 msgr2=0x7f23180b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180aff30 0x7f23180b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 -- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 msgr2=0x7f2318152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 0x7f2318152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 -- 172.21.15.134:0/3114848723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2318152e90 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f230ffff640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 0x7f2318152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231d70a640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f231000d5d0 tx=0x7f231000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100125f0 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2310019070 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23180b46d0 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.653+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100129f0 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.654+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23180b4c90 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.654+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23180ce710 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.655+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f2310012b90 con 0x7f2318156880 2024-09-15T22:45:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.655+0000 7f230d7fa640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 0x7f230406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.655+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f231008b950 con 0x7f2318156880 2024-09-15T22:45:26.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.656+0000 7f231cf09640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 0x7f230406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.656+0000 7f231cf09640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 0x7f230406e890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2314033000 tx=0x7f2314009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.660+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2310059fc0 con 0x7f2318156880 2024-09-15T22:45:26.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.858+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2318076030 con 0x7f2318156880 2024-09-15T22:45:26.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.859+0000 7f230d7fa640 1 -- 172.21.15.134:0/3114848723 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5234 (secure 0 0 0) 0x7f23100598c0 con 0x7f2318156880 2024-09-15T22:45:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:26.861 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":43,"btime":"2024-09-15T22:45:26:527976+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3275361990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3275361990},{"type":"v1","addr":"172.21.15.177:6834","nonce":3275361990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:26.861 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 43 2024-09-15T22:45:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 msgr2=0x7f230406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 0x7f230406e890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2314033000 tx=0x7f2314009000 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 msgr2=0x7f23180b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f231000d5d0 tx=0x7f231000da90 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 shutdown_connections 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f230406c3d0 0x7f230406e890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2318156880 0x7f23180b5770 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23180b65c0 0x7f2318152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 --2- 172.21.15.134:0/3114848723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23180aff30 0x7f23180b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 >> 172.21.15.134:0/3114848723 conn(0x7f231806cae0 msgr2=0x7f231806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 shutdown_connections 2024-09-15T22:45:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.861+0000 7f231f16d640 1 -- 172.21.15.134:0/3114848723 wait complete. 2024-09-15T22:45:26.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:26.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.971+0000 7f37a855b640 1 Processor -- start 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.971+0000 7f37a855b640 1 -- start start 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a855b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37a015e500 0x7f37a00b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a855b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 0x7f37a00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a855b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a0074200 con 0x7f37a0073cb0 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a855b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f37a00b6e80 con 0x7f37a015e500 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a855b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f37a00b7160 con 0x7f37a015e8e0 2024-09-15T22:45:26.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37a015e500 0x7f37a00b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37a015e500 0x7f37a00b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38988/0 (socket says 172.21.15.134:38988) 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 -- 172.21.15.134:0/144641414 learned_addr learned my addr 172.21.15.134:0/144641414 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a5af6640 1 --2- 172.21.15.134:0/144641414 >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 0x7f37a00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 -- 172.21.15.134:0/144641414 >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 msgr2=0x7f37a00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 --2- 172.21.15.134:0/144641414 >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 0x7f37a00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 -- 172.21.15.134:0/144641414 >> v1:172.21.15.177:6789/0 conn(0x7f37a0073cb0 legacy=0x7f37a01622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a62f7640 1 -- 172.21.15.134:0/144641414 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a00b7440 con 0x7f37a015e500 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.972+0000 7f37a5af6640 1 --2- 172.21.15.134:0/144641414 >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 0x7f37a00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.973+0000 7f37a62f7640 1 --2- 172.21.15.134:0/144641414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e500 0x7f37a00b4460 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f379c009e50 tx=0x7f379c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b9b459ecf8ed80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.973+0000 7f37a52f5640 1 -- 172.21.15.134:0/144641414 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c036070 con 0x7f37a015e500 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.973+0000 7f37a52f5640 1 -- 172.21.15.134:0/144641414 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c031600 con 0x7f37a015e500 2024-09-15T22:45:26.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.973+0000 7f37a52f5640 1 -- 172.21.15.134:0/144641414 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c02ae60 con 0x7f37a015e500 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 -- 172.21.15.134:0/144641414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e500 msgr2=0x7f37a00b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 --2- 172.21.15.134:0/144641414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e500 0x7f37a00b4460 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f379c009e50 tx=0x7f379c02a680 comp rx=0 tx=0).stop 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 -- 172.21.15.134:0/144641414 shutdown_connections 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 --2- 172.21.15.134:0/144641414 >> v2:172.21.15.177:3300/0 conn(0x7f37a015e8e0 0x7f37a00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 --2- 172.21.15.134:0/144641414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e500 0x7f37a00b4460 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 -- 172.21.15.134:0/144641414 >> 172.21.15.134:0/144641414 conn(0x7f37a0062810 msgr2=0x7f37a0062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:26.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 -- 172.21.15.134:0/144641414 shutdown_connections 2024-09-15T22:45:26.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.974+0000 7f37a855b640 1 -- 172.21.15.134:0/144641414 wait complete. 2024-09-15T22:45:26.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.975+0000 7f37a855b640 1 Processor -- start 2024-09-15T22:45:26.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.975+0000 7f37a855b640 1 -- start start 2024-09-15T22:45:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a0073cb0 0x7f37a01f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a015e500 0x7f37a0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37a006ce30 con 0x7f37a015e8e0 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37a006ccb0 con 0x7f37a0073cb0 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a855b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f37a00d1cf0 con 0x7f37a015e500 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38992/0 (socket says 172.21.15.134:38992) 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 -- 172.21.15.134:0/41666809 learned_addr learned my addr 172.21.15.134:0/41666809 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a5af6640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a015e500 0x7f37a0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a62f7640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a0073cb0 0x7f37a01f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 -- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a015e500 msgr2=0x7f37a0153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a015e500 0x7f37a0153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 -- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a0073cb0 msgr2=0x7f37a01f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a0073cb0 0x7f37a01f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 -- 172.21.15.134:0/41666809 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a01f5760 con 0x7f37a015e8e0 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f37a6af8640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f379800c410 tx=0x7f379800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798011790 con 0x7f37a015e8e0 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3798017070 con 0x7f37a015e8e0 2024-09-15T22:45:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.976+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798011bb0 con 0x7f37a015e8e0 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.977+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a00cc4c0 con 0x7f37a015e8e0 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.977+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a00cca80 con 0x7f37a015e8e0 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.978+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a00b4460 con 0x7f37a015e8e0 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.978+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f379801c460 con 0x7f37a015e8e0 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.979+0000 7f3796ffd640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 0x7f378406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:26.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.979+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f379808af80 con 0x7f37a015e8e0 2024-09-15T22:45:26.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.979+0000 7f37a62f7640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 0x7f378406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:26.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.979+0000 7f37a62f7640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 0x7f378406e890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f379c033000 tx=0x7f379c009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:26.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:26.983+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3798021020 con 0x7f37a015e8e0 2024-09-15T22:45:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.147+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37a0069160 con 0x7f37a015e8e0 2024-09-15T22:45:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.149+0000 7f3796ffd640 1 -- 172.21.15.134:0/41666809 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16768 (secure 0 0 0) 0x7f3798059020 con 0x7f37a015e8e0 2024-09-15T22:45:27.150 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:27.151 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":88,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:25.245917+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:22.241856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:22.832685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 msgr2=0x7f378406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 0x7f378406e890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f379c033000 tx=0x7f379c009000 comp rx=0 tx=0).stop 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 msgr2=0x7f37a01540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f379800c410 tx=0x7f379800c8d0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 shutdown_connections 2024-09-15T22:45:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f378406c3d0 0x7f378406e890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a015e8e0 0x7f37a01540e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a015e500 0x7f37a0153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 --2- 172.21.15.134:0/41666809 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a0073cb0 0x7f37a01f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 >> 172.21.15.134:0/41666809 conn(0x7f37a0062810 msgr2=0x7f37a00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 shutdown_connections 2024-09-15T22:45:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.151+0000 7f37a855b640 1 -- 172.21.15.134:0/41666809 wait complete. 2024-09-15T22:45:27.163 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:45:27.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:27.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.261+0000 7f0df01bd640 1 Processor -- start 2024-09-15T22:45:27.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.261+0000 7f0df01bd640 1 -- start start 2024-09-15T22:45:27.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0df01bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 0x7f0de80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0df01bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0de815ceb0 0x7f0de81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0df01bd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de80d0bc0 con 0x7f0de815ca40 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0df01bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0de815d390 con 0x7f0de815ceb0 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0df01bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0de815d670 con 0x7f0de80d02a0 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0de815ceb0 0x7f0de81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0de815ceb0 0x7f0de81594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39006/0 (socket says 172.21.15.134:39006) 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 -- 172.21.15.134:0/2567981615 learned_addr learned my addr 172.21.15.134:0/2567981615 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dedf59640 1 --2- 172.21.15.134:0/2567981615 >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 0x7f0de80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 -- 172.21.15.134:0/2567981615 >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 msgr2=0x7f0de80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 --2- 172.21.15.134:0/2567981615 >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 0x7f0de80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.262+0000 7f0dee75a640 1 -- 172.21.15.134:0/2567981615 >> v1:172.21.15.177:6789/0 conn(0x7f0de815ca40 legacy=0x7f0de815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0dee75a640 1 -- 172.21.15.134:0/2567981615 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de815d950 con 0x7f0de815ceb0 2024-09-15T22:45:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0dedf59640 1 --2- 172.21.15.134:0/2567981615 >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 0x7f0de80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0dee75a640 1 --2- 172.21.15.134:0/2567981615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de815ceb0 0x7f0de81594c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0de806f030 tx=0x7f0de002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bcb731904ca653 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0decf57640 1 -- 172.21.15.134:0/2567981615 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0039070 con 0x7f0de815ceb0 2024-09-15T22:45:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0decf57640 1 -- 172.21.15.134:0/2567981615 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de000b2e0 con 0x7f0de815ceb0 2024-09-15T22:45:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.263+0000 7f0decf57640 1 -- 172.21.15.134:0/2567981615 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0009820 con 0x7f0de815ceb0 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 -- 172.21.15.134:0/2567981615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de815ceb0 msgr2=0x7f0de81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2567981615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de815ceb0 0x7f0de81594c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0de806f030 tx=0x7f0de002c860 comp rx=0 tx=0).stop 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 -- 172.21.15.134:0/2567981615 shutdown_connections 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2567981615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de815ceb0 0x7f0de81594c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2567981615 >> v2:172.21.15.177:3300/0 conn(0x7f0de80d02a0 0x7f0de80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 -- 172.21.15.134:0/2567981615 >> 172.21.15.134:0/2567981615 conn(0x7f0de8062cc0 msgr2=0x7f0de806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 -- 172.21.15.134:0/2567981615 shutdown_connections 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.264+0000 7f0df01bd640 1 -- 172.21.15.134:0/2567981615 wait complete. 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.265+0000 7f0df01bd640 1 Processor -- start 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.265+0000 7f0df01bd640 1 -- start start 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 0x7f0de814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 0x7f0de8153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0de815eb40 con 0x7f0de80d02a0 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0de815df10 con 0x7f0de815ceb0 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0df01bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0de8155b90 con 0x7f0de815ca40 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39010/0 (socket says 172.21.15.134:39010) 2024-09-15T22:45:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 -- 172.21.15.134:0/2226819326 learned_addr learned my addr 172.21.15.134:0/2226819326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dee75a640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 0x7f0de8153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0ded758640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 0x7f0de814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 -- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 msgr2=0x7f0de814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 0x7f0de814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 -- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 msgr2=0x7f0de8153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 0x7f0de8153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 -- 172.21.15.134:0/2226819326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de814f770 con 0x7f0de80d02a0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dee75a640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 0x7f0de8153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0ded758640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 0x7f0de814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.266+0000 7f0dedf59640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c820 tx=0x7f0de400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.267+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4015070 con 0x7f0de80d02a0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.267+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4007a30 con 0x7f0de80d02a0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.267+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de814fa50 con 0x7f0de80d02a0 2024-09-15T22:45:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.267+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4007e00 con 0x7f0de80d02a0 2024-09-15T22:45:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.267+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de80b0290 con 0x7f0de80d02a0 2024-09-15T22:45:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.268+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de80b4790 con 0x7f0de80d02a0 2024-09-15T22:45:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.268+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f0de4018070 con 0x7f0de80d02a0 2024-09-15T22:45:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.269+0000 7f0dde7fc640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 0x7f0dcc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.269+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f0de408b620 con 0x7f0de80d02a0 2024-09-15T22:45:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.269+0000 7f0ded758640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 0x7f0dcc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.269+0000 7f0ded758640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 0x7f0dcc06e890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0de815a9d0 tx=0x7f0dd8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.273+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0de4059c00 con 0x7f0de80d02a0 2024-09-15T22:45:27.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.434+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0de814d450 con 0x7f0dcc06c3d0 2024-09-15T22:45:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.441+0000 7f0dde7fc640 1 -- 172.21.15.134:0/2226819326 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252081 (secure 0 0 0) 0x7f0dd80568d0 con 0x7f0dcc06c3d0 2024-09-15T22:45:27.445 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:27.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 msgr2=0x7f0dcc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 0x7f0dcc06e890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0de815a9d0 tx=0x7f0dd8009040 comp rx=0 tx=0).stop 2024-09-15T22:45:27.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 msgr2=0x7f0de8149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c820 tx=0x7f0de400cc20 comp rx=0 tx=0).stop 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 shutdown_connections 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0de815ceb0 0x7f0de8153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0de815ca40 0x7f0de814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0dcc06c3d0 0x7f0dcc06e890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 --2- 172.21.15.134:0/2226819326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de80d02a0 0x7f0de8149960 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.443+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 >> 172.21.15.134:0/2226819326 conn(0x7f0de8062cc0 msgr2=0x7f0de80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.444+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 shutdown_connections 2024-09-15T22:45:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.444+0000 7f0df01bd640 1 -- 172.21.15.134:0/2226819326 wait complete. 2024-09-15T22:45:27.456 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:45:27.181739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250832,"kb_used_data":9608,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723888,"statfs":{"total":773094113280,"available":772837261312,"internally_reserved":0,"allocated":9838592,"data_stored":4867436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.666590"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473340+0000","last_change":"2024-09-15T22:45:24.264213+0000","last_active":"2024-09-15T22:45:25.473340+0000","last_peered":"2024-09-15T22:45:25.473340+0000","last_clean":"2024-09-15T22:45:25.473340+0000","last_became_active":"2024-09-15T22:45:24.263803+0000","last_became_peered":"2024-09-15T22:45:24.263803+0000","last_unstale":"2024-09-15T22:45:25.473340+0000","last_undegraded":"2024-09-15T22:45:25.473340+0000","last_fullsized":"2024-09-15T22:45:25.473340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:41.698762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254488+0000","last_change":"2024-09-15T22:45:24.262614+0000","last_active":"2024-09-15T22:45:25.254488+0000","last_peered":"2024-09-15T22:45:25.254488+0000","last_clean":"2024-09-15T22:45:25.254488+0000","last_became_active":"2024-09-15T22:45:24.262335+0000","last_became_peered":"2024-09-15T22:45:24.262335+0000","last_unstale":"2024-09-15T22:45:25.254488+0000","last_undegraded":"2024-09-15T22:45:25.254488+0000","last_fullsized":"2024-09-15T22:45:25.254488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:44.942153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249494+0000","last_change":"2024-09-15T22:45:24.263011+0000","last_active":"2024-09-15T22:45:25.249494+0000","last_peered":"2024-09-15T22:45:25.249494+0000","last_clean":"2024-09-15T22:45:25.249494+0000","last_became_active":"2024-09-15T22:45:24.262389+0000","last_became_peered":"2024-09-15T22:45:24.262389+0000","last_unstale":"2024-09-15T22:45:25.249494+0000","last_undegraded":"2024-09-15T22:45:25.249494+0000","last_fullsized":"2024-09-15T22:45:25.249494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:53.321715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473014+0000","last_change":"2024-09-15T22:45:24.264735+0000","last_active":"2024-09-15T22:45:25.473014+0000","last_peered":"2024-09-15T22:45:25.473014+0000","last_clean":"2024-09-15T22:45:25.473014+0000","last_became_active":"2024-09-15T22:45:24.263301+0000","last_became_peered":"2024-09-15T22:45:24.263301+0000","last_unstale":"2024-09-15T22:45:25.473014+0000","last_undegraded":"2024-09-15T22:45:25.473014+0000","last_fullsized":"2024-09-15T22:45:25.473014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:11.142360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472583+0000","last_change":"2024-09-15T22:45:24.253888+0000","last_active":"2024-09-15T22:45:25.472583+0000","last_peered":"2024-09-15T22:45:25.472583+0000","last_clean":"2024-09-15T22:45:25.472583+0000","last_became_active":"2024-09-15T22:45:24.253596+0000","last_became_peered":"2024-09-15T22:45:24.253596+0000","last_unstale":"2024-09-15T22:45:25.472583+0000","last_undegraded":"2024-09-15T22:45:25.472583+0000","last_fullsized":"2024-09-15T22:45:25.472583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:13.284697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249677+0000","last_change":"2024-09-15T22:45:24.262640+0000","last_active":"2024-09-15T22:45:25.249677+0000","last_peered":"2024-09-15T22:45:25.249677+0000","last_clean":"2024-09-15T22:45:25.249677+0000","last_became_active":"2024-09-15T22:45:24.262326+0000","last_became_peered":"2024-09-15T22:45:24.262326+0000","last_unstale":"2024-09-15T22:45:25.249677+0000","last_undegraded":"2024-09-15T22:45:25.249677+0000","last_fullsized":"2024-09-15T22:45:25.249677+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:20.133635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.253980+0000","last_change":"2024-09-15T22:45:24.260392+0000","last_active":"2024-09-15T22:45:25.253980+0000","last_peered":"2024-09-15T22:45:25.253980+0000","last_clean":"2024-09-15T22:45:25.253980+0000","last_became_active":"2024-09-15T22:45:24.260068+0000","last_became_peered":"2024-09-15T22:45:24.260068+0000","last_unstale":"2024-09-15T22:45:25.253980+0000","last_undegraded":"2024-09-15T22:45:25.253980+0000","last_fullsized":"2024-09-15T22:45:25.253980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:45.890216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472182+0000","last_change":"2024-09-15T22:45:24.263913+0000","last_active":"2024-09-15T22:45:25.472182+0000","last_peered":"2024-09-15T22:45:25.472182+0000","last_clean":"2024-09-15T22:45:25.472182+0000","last_became_active":"2024-09-15T22:45:24.263681+0000","last_became_peered":"2024-09-15T22:45:24.263681+0000","last_unstale":"2024-09-15T22:45:25.472182+0000","last_undegraded":"2024-09-15T22:45:25.472182+0000","last_fullsized":"2024-09-15T22:45:25.472182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:29.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473395+0000","last_change":"2024-09-15T22:45:24.264369+0000","last_active":"2024-09-15T22:45:25.473395+0000","last_peered":"2024-09-15T22:45:25.473395+0000","last_clean":"2024-09-15T22:45:25.473395+0000","last_became_active":"2024-09-15T22:45:24.264105+0000","last_became_peered":"2024-09-15T22:45:24.264105+0000","last_unstale":"2024-09-15T22:45:25.473395+0000","last_undegraded":"2024-09-15T22:45:25.473395+0000","last_fullsized":"2024-09-15T22:45:25.473395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:48.452778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249800+0000","last_change":"2024-09-15T22:45:24.264257+0000","last_active":"2024-09-15T22:45:25.249800+0000","last_peered":"2024-09-15T22:45:25.249800+0000","last_clean":"2024-09-15T22:45:25.249800+0000","last_became_active":"2024-09-15T22:45:24.262468+0000","last_became_peered":"2024-09-15T22:45:24.262468+0000","last_unstale":"2024-09-15T22:45:25.249800+0000","last_undegraded":"2024-09-15T22:45:25.249800+0000","last_fullsized":"2024-09-15T22:45:25.249800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:53.429490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254937+0000","last_change":"2024-09-15T22:45:24.269208+0000","last_active":"2024-09-15T22:45:25.254937+0000","last_peered":"2024-09-15T22:45:25.254937+0000","last_clean":"2024-09-15T22:45:25.254937+0000","last_became_active":"2024-09-15T22:45:24.269000+0000","last_became_peered":"2024-09-15T22:45:24.269000+0000","last_unstale":"2024-09-15T22:45:25.254937+0000","last_undegraded":"2024-09-15T22:45:25.254937+0000","last_fullsized":"2024-09-15T22:45:25.254937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:08.092663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472372+0000","last_change":"2024-09-15T22:45:24.259476+0000","last_active":"2024-09-15T22:45:25.472372+0000","last_peered":"2024-09-15T22:45:25.472372+0000","last_clean":"2024-09-15T22:45:25.472372+0000","last_became_active":"2024-09-15T22:45:24.258981+0000","last_became_peered":"2024-09-15T22:45:24.258981+0000","last_unstale":"2024-09-15T22:45:25.472372+0000","last_undegraded":"2024-09-15T22:45:25.472372+0000","last_fullsized":"2024-09-15T22:45:25.472372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:18.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472718+0000","last_change":"2024-09-15T22:45:24.262417+0000","last_active":"2024-09-15T22:45:25.472718+0000","last_peered":"2024-09-15T22:45:25.472718+0000","last_clean":"2024-09-15T22:45:25.472718+0000","last_became_active":"2024-09-15T22:45:24.262158+0000","last_became_peered":"2024-09-15T22:45:24.262158+0000","last_unstale":"2024-09-15T22:45:25.472718+0000","last_undegraded":"2024-09-15T22:45:25.472718+0000","last_fullsized":"2024-09-15T22:45:25.472718+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:05.775653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472142+0000","last_change":"2024-09-15T22:45:24.262728+0000","last_active":"2024-09-15T22:45:25.472142+0000","last_peered":"2024-09-15T22:45:25.472142+0000","last_clean":"2024-09-15T22:45:25.472142+0000","last_became_active":"2024-09-15T22:45:24.262225+0000","last_became_peered":"2024-09-15T22:45:24.262225+0000","last_unstale":"2024-09-15T22:45:25.472142+0000","last_undegraded":"2024-09-15T22:45:25.472142+0000","last_fullsized":"2024-09-15T22:45:25.472142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:28.992720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254489+0000","last_change":"2024-09-15T22:45:24.260288+0000","last_active":"2024-09-15T22:45:25.254489+0000","last_peered":"2024-09-15T22:45:25.254489+0000","last_clean":"2024-09-15T22:45:25.254489+0000","last_became_active":"2024-09-15T22:45:24.259786+0000","last_became_peered":"2024-09-15T22:45:24.259786+0000","last_unstale":"2024-09-15T22:45:25.254489+0000","last_undegraded":"2024-09-15T22:45:25.254489+0000","last_fullsized":"2024-09-15T22:45:25.254489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:58.562563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249372+0000","last_change":"2024-09-15T22:45:24.262215+0000","last_active":"2024-09-15T22:45:25.249372+0000","last_peered":"2024-09-15T22:45:25.249372+0000","last_clean":"2024-09-15T22:45:25.249372+0000","last_became_active":"2024-09-15T22:45:24.261936+0000","last_became_peered":"2024-09-15T22:45:24.261936+0000","last_unstale":"2024-09-15T22:45:25.249372+0000","last_undegraded":"2024-09-15T22:45:25.249372+0000","last_fullsized":"2024-09-15T22:45:25.249372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:14.177874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472487+0000","last_change":"2024-09-15T22:45:24.259254+0000","last_active":"2024-09-15T22:45:25.472487+0000","last_peered":"2024-09-15T22:45:25.472487+0000","last_clean":"2024-09-15T22:45:25.472487+0000","last_became_active":"2024-09-15T22:45:24.258985+0000","last_became_peered":"2024-09-15T22:45:24.258985+0000","last_unstale":"2024-09-15T22:45:25.472487+0000","last_undegraded":"2024-09-15T22:45:25.472487+0000","last_fullsized":"2024-09-15T22:45:25.472487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.800668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254837+0000","last_change":"2024-09-15T22:45:24.258963+0000","last_active":"2024-09-15T22:45:25.254837+0000","last_peered":"2024-09-15T22:45:25.254837+0000","last_clean":"2024-09-15T22:45:25.254837+0000","last_became_active":"2024-09-15T22:45:24.258681+0000","last_became_peered":"2024-09-15T22:45:24.258681+0000","last_unstale":"2024-09-15T22:45:25.254837+0000","last_undegraded":"2024-09-15T22:45:25.254837+0000","last_fullsized":"2024-09-15T22:45:25.254837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:00.632766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472623+0000","last_change":"2024-09-15T22:45:24.261175+0000","last_active":"2024-09-15T22:45:25.472623+0000","last_peered":"2024-09-15T22:45:25.472623+0000","last_clean":"2024-09-15T22:45:25.472623+0000","last_became_active":"2024-09-15T22:45:24.260877+0000","last_became_peered":"2024-09-15T22:45:24.260877+0000","last_unstale":"2024-09-15T22:45:25.472623+0000","last_undegraded":"2024-09-15T22:45:25.472623+0000","last_fullsized":"2024-09-15T22:45:25.472623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:29.150324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472470+0000","last_change":"2024-09-15T22:45:24.261942+0000","last_active":"2024-09-15T22:45:25.472470+0000","last_peered":"2024-09-15T22:45:25.472470+0000","last_clean":"2024-09-15T22:45:25.472470+0000","last_became_active":"2024-09-15T22:45:24.261630+0000","last_became_peered":"2024-09-15T22:45:24.261630+0000","last_unstale":"2024-09-15T22:45:25.472470+0000","last_undegraded":"2024-09-15T22:45:25.472470+0000","last_fullsized":"2024-09-15T22:45:25.472470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:59.963050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472892+0000","last_change":"2024-09-15T22:45:24.266291+0000","last_active":"2024-09-15T22:45:25.472892+0000","last_peered":"2024-09-15T22:45:25.472892+0000","last_clean":"2024-09-15T22:45:25.472892+0000","last_became_active":"2024-09-15T22:45:24.266020+0000","last_became_peered":"2024-09-15T22:45:24.266020+0000","last_unstale":"2024-09-15T22:45:25.472892+0000","last_undegraded":"2024-09-15T22:45:25.472892+0000","last_fullsized":"2024-09-15T22:45:25.472892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:26.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472274+0000","last_change":"2024-09-15T22:45:24.261514+0000","last_active":"2024-09-15T22:45:25.472274+0000","last_peered":"2024-09-15T22:45:25.472274+0000","last_clean":"2024-09-15T22:45:25.472274+0000","last_became_active":"2024-09-15T22:45:24.261205+0000","last_became_peered":"2024-09-15T22:45:24.261205+0000","last_unstale":"2024-09-15T22:45:25.472274+0000","last_undegraded":"2024-09-15T22:45:25.472274+0000","last_fullsized":"2024-09-15T22:45:25.472274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:25.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472453+0000","last_change":"2024-09-15T22:45:24.256525+0000","last_active":"2024-09-15T22:45:25.472453+0000","last_peered":"2024-09-15T22:45:25.472453+0000","last_clean":"2024-09-15T22:45:25.472453+0000","last_became_active":"2024-09-15T22:45:24.256258+0000","last_became_peered":"2024-09-15T22:45:24.256258+0000","last_unstale":"2024-09-15T22:45:25.472453+0000","last_undegraded":"2024-09-15T22:45:25.472453+0000","last_fullsized":"2024-09-15T22:45:25.472453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:49.321133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254086+0000","last_change":"2024-09-15T22:45:24.266157+0000","last_active":"2024-09-15T22:45:25.254086+0000","last_peered":"2024-09-15T22:45:25.254086+0000","last_clean":"2024-09-15T22:45:25.254086+0000","last_became_active":"2024-09-15T22:45:24.265899+0000","last_became_peered":"2024-09-15T22:45:24.265899+0000","last_unstale":"2024-09-15T22:45:25.254086+0000","last_undegraded":"2024-09-15T22:45:25.254086+0000","last_fullsized":"2024-09-15T22:45:25.254086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:34.373361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254987+0000","last_change":"2024-09-15T22:45:24.267350+0000","last_active":"2024-09-15T22:45:25.254987+0000","last_peered":"2024-09-15T22:45:25.254987+0000","last_clean":"2024-09-15T22:45:25.254987+0000","last_became_active":"2024-09-15T22:45:24.267064+0000","last_became_peered":"2024-09-15T22:45:24.267064+0000","last_unstale":"2024-09-15T22:45:25.254987+0000","last_undegraded":"2024-09-15T22:45:25.254987+0000","last_fullsized":"2024-09-15T22:45:25.254987+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.160229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472875+0000","last_change":"2024-09-15T22:45:24.253594+0000","last_active":"2024-09-15T22:45:25.472875+0000","last_peered":"2024-09-15T22:45:25.472875+0000","last_clean":"2024-09-15T22:45:25.472875+0000","last_became_active":"2024-09-15T22:45:24.253306+0000","last_became_peered":"2024-09-15T22:45:24.253306+0000","last_unstale":"2024-09-15T22:45:25.472875+0000","last_undegraded":"2024-09-15T22:45:25.472875+0000","last_fullsized":"2024-09-15T22:45:25.472875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.904564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472954+0000","last_change":"2024-09-15T22:45:24.259811+0000","last_active":"2024-09-15T22:45:25.472954+0000","last_peered":"2024-09-15T22:45:25.472954+0000","last_clean":"2024-09-15T22:45:25.472954+0000","last_became_active":"2024-09-15T22:45:24.259478+0000","last_became_peered":"2024-09-15T22:45:24.259478+0000","last_unstale":"2024-09-15T22:45:25.472954+0000","last_undegraded":"2024-09-15T22:45:25.472954+0000","last_fullsized":"2024-09-15T22:45:25.472954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:23.412552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473250+0000","last_change":"2024-09-15T22:45:24.259082+0000","last_active":"2024-09-15T22:45:25.473250+0000","last_peered":"2024-09-15T22:45:25.473250+0000","last_clean":"2024-09-15T22:45:25.473250+0000","last_became_active":"2024-09-15T22:45:24.258836+0000","last_became_peered":"2024-09-15T22:45:24.258836+0000","last_unstale":"2024-09-15T22:45:25.473250+0000","last_undegraded":"2024-09-15T22:45:25.473250+0000","last_fullsized":"2024-09-15T22:45:25.473250+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:45.951169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472905+0000","last_change":"2024-09-15T22:45:24.265619+0000","last_active":"2024-09-15T22:45:25.472905+0000","last_peered":"2024-09-15T22:45:25.472905+0000","last_clean":"2024-09-15T22:45:25.472905+0000","last_became_active":"2024-09-15T22:45:24.265353+0000","last_became_peered":"2024-09-15T22:45:24.265353+0000","last_unstale":"2024-09-15T22:45:25.472905+0000","last_undegraded":"2024-09-15T22:45:25.472905+0000","last_fullsized":"2024-09-15T22:45:25.472905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:40.741321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472366+0000","last_change":"2024-09-15T22:45:24.262485+0000","last_active":"2024-09-15T22:45:25.472366+0000","last_peered":"2024-09-15T22:45:25.472366+0000","last_clean":"2024-09-15T22:45:25.472366+0000","last_became_active":"2024-09-15T22:45:24.261881+0000","last_became_peered":"2024-09-15T22:45:24.261881+0000","last_unstale":"2024-09-15T22:45:25.472366+0000","last_undegraded":"2024-09-15T22:45:25.472366+0000","last_fullsized":"2024-09-15T22:45:25.472366+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:49.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249271+0000","last_change":"2024-09-15T22:45:24.260600+0000","last_active":"2024-09-15T22:45:25.249271+0000","last_peered":"2024-09-15T22:45:25.249271+0000","last_clean":"2024-09-15T22:45:25.249271+0000","last_became_active":"2024-09-15T22:45:24.260312+0000","last_became_peered":"2024-09-15T22:45:24.260312+0000","last_unstale":"2024-09-15T22:45:25.249271+0000","last_undegraded":"2024-09-15T22:45:25.249271+0000","last_fullsized":"2024-09-15T22:45:25.249271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:44.964104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249295+0000","last_change":"2024-09-15T22:45:24.260693+0000","last_active":"2024-09-15T22:45:25.249295+0000","last_peered":"2024-09-15T22:45:25.249295+0000","last_clean":"2024-09-15T22:45:25.249295+0000","last_became_active":"2024-09-15T22:45:24.260449+0000","last_became_peered":"2024-09-15T22:45:24.260449+0000","last_unstale":"2024-09-15T22:45:25.249295+0000","last_undegraded":"2024-09-15T22:45:25.249295+0000","last_fullsized":"2024-09-15T22:45:25.249295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:29.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472715+0000","last_change":"2024-09-15T22:45:24.259699+0000","last_active":"2024-09-15T22:45:25.472715+0000","last_peered":"2024-09-15T22:45:25.472715+0000","last_clean":"2024-09-15T22:45:25.472715+0000","last_became_active":"2024-09-15T22:45:24.259422+0000","last_became_peered":"2024-09-15T22:45:24.259422+0000","last_unstale":"2024-09-15T22:45:25.472715+0000","last_undegraded":"2024-09-15T22:45:25.472715+0000","last_fullsized":"2024-09-15T22:45:25.472715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:53.429490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473190+0000","last_change":"2024-09-15T22:45:23.532870+0000","last_active":"2024-09-15T22:45:25.473190+0000","last_peered":"2024-09-15T22:45:25.473190+0000","last_clean":"2024-09-15T22:45:25.473190+0000","last_became_active":"2024-09-15T22:45:23.532616+0000","last_became_peered":"2024-09-15T22:45:23.532616+0000","last_unstale":"2024-09-15T22:45:25.473190+0000","last_undegraded":"2024-09-15T22:45:25.473190+0000","last_fullsized":"2024-09-15T22:45:25.473190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:10.140484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473476+0000","last_change":"2024-09-15T22:45:24.265515+0000","last_active":"2024-09-15T22:45:25.473476+0000","last_peered":"2024-09-15T22:45:25.473476+0000","last_clean":"2024-09-15T22:45:25.473476+0000","last_became_active":"2024-09-15T22:45:24.265274+0000","last_became_peered":"2024-09-15T22:45:24.265274+0000","last_unstale":"2024-09-15T22:45:25.473476+0000","last_undegraded":"2024-09-15T22:45:25.473476+0000","last_fullsized":"2024-09-15T22:45:25.473476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:07.039036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249562+0000","last_change":"2024-09-15T22:45:23.536271+0000","last_active":"2024-09-15T22:45:25.249562+0000","last_peered":"2024-09-15T22:45:25.249562+0000","last_clean":"2024-09-15T22:45:25.249562+0000","last_became_active":"2024-09-15T22:45:23.535976+0000","last_became_peered":"2024-09-15T22:45:23.535976+0000","last_unstale":"2024-09-15T22:45:25.249562+0000","last_undegraded":"2024-09-15T22:45:25.249562+0000","last_fullsized":"2024-09-15T22:45:25.249562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:23.804830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472508+0000","last_change":"2024-09-15T22:45:24.261120+0000","last_active":"2024-09-15T22:45:25.472508+0000","last_peered":"2024-09-15T22:45:25.472508+0000","last_clean":"2024-09-15T22:45:25.472508+0000","last_became_active":"2024-09-15T22:45:24.260678+0000","last_became_peered":"2024-09-15T22:45:24.260678+0000","last_unstale":"2024-09-15T22:45:25.472508+0000","last_undegraded":"2024-09-15T22:45:25.472508+0000","last_fullsized":"2024-09-15T22:45:25.472508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:20.133635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254913+0000","last_change":"2024-09-15T22:45:23.543061+0000","last_active":"2024-09-15T22:45:25.254913+0000","last_peered":"2024-09-15T22:45:25.254913+0000","last_clean":"2024-09-15T22:45:25.254913+0000","last_became_active":"2024-09-15T22:45:23.542835+0000","last_became_peered":"2024-09-15T22:45:23.542835+0000","last_unstale":"2024-09-15T22:45:25.254913+0000","last_undegraded":"2024-09-15T22:45:25.254913+0000","last_fullsized":"2024-09-15T22:45:25.254913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.158649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473498+0000","last_change":"2024-09-15T22:45:24.263191+0000","last_active":"2024-09-15T22:45:25.473498+0000","last_peered":"2024-09-15T22:45:25.473498+0000","last_clean":"2024-09-15T22:45:25.473498+0000","last_became_active":"2024-09-15T22:45:24.262941+0000","last_became_peered":"2024-09-15T22:45:24.262941+0000","last_unstale":"2024-09-15T22:45:25.473498+0000","last_undegraded":"2024-09-15T22:45:25.473498+0000","last_fullsized":"2024-09-15T22:45:25.473498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:30.992627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473092+0000","last_change":"2024-09-15T22:45:23.535920+0000","last_active":"2024-09-15T22:45:25.473092+0000","last_peered":"2024-09-15T22:45:25.473092+0000","last_clean":"2024-09-15T22:45:25.473092+0000","last_became_active":"2024-09-15T22:45:23.535607+0000","last_became_peered":"2024-09-15T22:45:23.535607+0000","last_unstale":"2024-09-15T22:45:25.473092+0000","last_undegraded":"2024-09-15T22:45:25.473092+0000","last_fullsized":"2024-09-15T22:45:25.473092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:58.064170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472591+0000","last_change":"2024-09-15T22:45:24.263713+0000","last_active":"2024-09-15T22:45:25.472591+0000","last_peered":"2024-09-15T22:45:25.472591+0000","last_clean":"2024-09-15T22:45:25.472591+0000","last_became_active":"2024-09-15T22:45:24.263463+0000","last_became_peered":"2024-09-15T22:45:24.263463+0000","last_unstale":"2024-09-15T22:45:25.472591+0000","last_undegraded":"2024-09-15T22:45:25.472591+0000","last_fullsized":"2024-09-15T22:45:25.472591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:06.416410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472202+0000","last_change":"2024-09-15T22:45:23.543432+0000","last_active":"2024-09-15T22:45:25.472202+0000","last_peered":"2024-09-15T22:45:25.472202+0000","last_clean":"2024-09-15T22:45:25.472202+0000","last_became_active":"2024-09-15T22:45:23.543155+0000","last_became_peered":"2024-09-15T22:45:23.543155+0000","last_unstale":"2024-09-15T22:45:25.472202+0000","last_undegraded":"2024-09-15T22:45:25.472202+0000","last_fullsized":"2024-09-15T22:45:25.472202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:49.793053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249611+0000","last_change":"2024-09-15T22:45:24.262447+0000","last_active":"2024-09-15T22:45:25.249611+0000","last_peered":"2024-09-15T22:45:25.249611+0000","last_clean":"2024-09-15T22:45:25.249611+0000","last_became_active":"2024-09-15T22:45:24.262196+0000","last_became_peered":"2024-09-15T22:45:24.262196+0000","last_unstale":"2024-09-15T22:45:25.249611+0000","last_undegraded":"2024-09-15T22:45:25.249611+0000","last_fullsized":"2024-09-15T22:45:25.249611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:18.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249698+0000","last_change":"2024-09-15T22:45:23.537692+0000","last_active":"2024-09-15T22:45:25.249698+0000","last_peered":"2024-09-15T22:45:25.249698+0000","last_clean":"2024-09-15T22:45:25.249698+0000","last_became_active":"2024-09-15T22:45:23.537364+0000","last_became_peered":"2024-09-15T22:45:23.537364+0000","last_unstale":"2024-09-15T22:45:25.249698+0000","last_undegraded":"2024-09-15T22:45:25.249698+0000","last_fullsized":"2024-09-15T22:45:25.249698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.382754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472215+0000","last_change":"2024-09-15T22:45:24.262245+0000","last_active":"2024-09-15T22:45:25.472215+0000","last_peered":"2024-09-15T22:45:25.472215+0000","last_clean":"2024-09-15T22:45:25.472215+0000","last_became_active":"2024-09-15T22:45:24.262007+0000","last_became_peered":"2024-09-15T22:45:24.262007+0000","last_unstale":"2024-09-15T22:45:25.472215+0000","last_undegraded":"2024-09-15T22:45:25.472215+0000","last_fullsized":"2024-09-15T22:45:25.472215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:27.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472240+0000","last_change":"2024-09-15T22:45:23.538462+0000","last_active":"2024-09-15T22:45:25.472240+0000","last_peered":"2024-09-15T22:45:25.472240+0000","last_clean":"2024-09-15T22:45:25.472240+0000","last_became_active":"2024-09-15T22:45:23.538191+0000","last_became_peered":"2024-09-15T22:45:23.538191+0000","last_unstale":"2024-09-15T22:45:25.472240+0000","last_undegraded":"2024-09-15T22:45:25.472240+0000","last_fullsized":"2024-09-15T22:45:25.472240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:16.325970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472135+0000","last_change":"2024-09-15T22:45:24.264459+0000","last_active":"2024-09-15T22:45:25.472135+0000","last_peered":"2024-09-15T22:45:25.472135+0000","last_clean":"2024-09-15T22:45:25.472135+0000","last_became_active":"2024-09-15T22:45:24.261913+0000","last_became_peered":"2024-09-15T22:45:24.261913+0000","last_unstale":"2024-09-15T22:45:25.472135+0000","last_undegraded":"2024-09-15T22:45:25.472135+0000","last_fullsized":"2024-09-15T22:45:25.472135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:58.657027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.471946+0000","last_change":"2024-09-15T22:45:23.536284+0000","last_active":"2024-09-15T22:45:25.471946+0000","last_peered":"2024-09-15T22:45:25.471946+0000","last_clean":"2024-09-15T22:45:25.471946+0000","last_became_active":"2024-09-15T22:45:23.535966+0000","last_became_peered":"2024-09-15T22:45:23.535966+0000","last_unstale":"2024-09-15T22:45:25.471946+0000","last_undegraded":"2024-09-15T22:45:25.471946+0000","last_fullsized":"2024-09-15T22:45:25.471946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:43.595402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472905+0000","last_change":"2024-09-15T22:45:24.258552+0000","last_active":"2024-09-15T22:45:25.472905+0000","last_peered":"2024-09-15T22:45:25.472905+0000","last_clean":"2024-09-15T22:45:25.472905+0000","last_became_active":"2024-09-15T22:45:24.258153+0000","last_became_peered":"2024-09-15T22:45:24.258153+0000","last_unstale":"2024-09-15T22:45:25.472905+0000","last_undegraded":"2024-09-15T22:45:25.472905+0000","last_fullsized":"2024-09-15T22:45:25.472905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:06.712571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473561+0000","last_change":"2024-09-15T22:45:23.536619+0000","last_active":"2024-09-15T22:45:25.473561+0000","last_peered":"2024-09-15T22:45:25.473561+0000","last_clean":"2024-09-15T22:45:25.473561+0000","last_became_active":"2024-09-15T22:45:23.536349+0000","last_became_peered":"2024-09-15T22:45:23.536349+0000","last_unstale":"2024-09-15T22:45:25.473561+0000","last_undegraded":"2024-09-15T22:45:25.473561+0000","last_fullsized":"2024-09-15T22:45:25.473561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:35.184258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473535+0000","last_change":"2024-09-15T22:45:24.260851+0000","last_active":"2024-09-15T22:45:25.473535+0000","last_peered":"2024-09-15T22:45:25.473535+0000","last_clean":"2024-09-15T22:45:25.473535+0000","last_became_active":"2024-09-15T22:45:24.260613+0000","last_became_peered":"2024-09-15T22:45:24.260613+0000","last_unstale":"2024-09-15T22:45:25.473535+0000","last_undegraded":"2024-09-15T22:45:25.473535+0000","last_fullsized":"2024-09-15T22:45:25.473535+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:03.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249654+0000","last_change":"2024-09-15T22:45:23.540398+0000","last_active":"2024-09-15T22:45:25.249654+0000","last_peered":"2024-09-15T22:45:25.249654+0000","last_clean":"2024-09-15T22:45:25.249654+0000","last_became_active":"2024-09-15T22:45:23.540187+0000","last_became_peered":"2024-09-15T22:45:23.540187+0000","last_unstale":"2024-09-15T22:45:25.249654+0000","last_undegraded":"2024-09-15T22:45:25.249654+0000","last_fullsized":"2024-09-15T22:45:25.249654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:49.793053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254600+0000","last_change":"2024-09-15T22:45:24.267346+0000","last_active":"2024-09-15T22:45:25.254600+0000","last_peered":"2024-09-15T22:45:25.254600+0000","last_clean":"2024-09-15T22:45:25.254600+0000","last_became_active":"2024-09-15T22:45:24.266962+0000","last_became_peered":"2024-09-15T22:45:24.266962+0000","last_unstale":"2024-09-15T22:45:25.254600+0000","last_undegraded":"2024-09-15T22:45:25.254600+0000","last_fullsized":"2024-09-15T22:45:25.254600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:18.012918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473524+0000","last_change":"2024-09-15T22:45:23.542360+0000","last_active":"2024-09-15T22:45:25.473524+0000","last_peered":"2024-09-15T22:45:25.473524+0000","last_clean":"2024-09-15T22:45:25.473524+0000","last_became_active":"2024-09-15T22:45:23.542088+0000","last_became_peered":"2024-09-15T22:45:23.542088+0000","last_unstale":"2024-09-15T22:45:25.473524+0000","last_undegraded":"2024-09-15T22:45:25.473524+0000","last_fullsized":"2024-09-15T22:45:25.473524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:39.214347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472983+0000","last_change":"2024-09-15T22:45:24.261743+0000","last_active":"2024-09-15T22:45:25.472983+0000","last_peered":"2024-09-15T22:45:25.472983+0000","last_clean":"2024-09-15T22:45:25.472983+0000","last_became_active":"2024-09-15T22:45:24.261501+0000","last_became_peered":"2024-09-15T22:45:24.261501+0000","last_unstale":"2024-09-15T22:45:25.472983+0000","last_undegraded":"2024-09-15T22:45:25.472983+0000","last_fullsized":"2024-09-15T22:45:25.472983+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:42.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472609+0000","last_change":"2024-09-15T22:45:23.540183+0000","last_active":"2024-09-15T22:45:25.472609+0000","last_peered":"2024-09-15T22:45:25.472609+0000","last_clean":"2024-09-15T22:45:25.472609+0000","last_became_active":"2024-09-15T22:45:23.539928+0000","last_became_peered":"2024-09-15T22:45:23.539928+0000","last_unstale":"2024-09-15T22:45:25.472609+0000","last_undegraded":"2024-09-15T22:45:25.472609+0000","last_fullsized":"2024-09-15T22:45:25.472609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:27.237842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254719+0000","last_change":"2024-09-15T22:45:24.259732+0000","last_active":"2024-09-15T22:45:25.254719+0000","last_peered":"2024-09-15T22:45:25.254719+0000","last_clean":"2024-09-15T22:45:25.254719+0000","last_became_active":"2024-09-15T22:45:24.259383+0000","last_became_peered":"2024-09-15T22:45:24.259383+0000","last_unstale":"2024-09-15T22:45:25.254719+0000","last_undegraded":"2024-09-15T22:45:25.254719+0000","last_fullsized":"2024-09-15T22:45:25.254719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:39.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473024+0000","last_change":"2024-09-15T22:45:23.536363+0000","last_active":"2024-09-15T22:45:25.473024+0000","last_peered":"2024-09-15T22:45:25.473024+0000","last_clean":"2024-09-15T22:45:25.473024+0000","last_became_active":"2024-09-15T22:45:23.535650+0000","last_became_peered":"2024-09-15T22:45:23.535650+0000","last_unstale":"2024-09-15T22:45:25.473024+0000","last_undegraded":"2024-09-15T22:45:25.473024+0000","last_fullsized":"2024-09-15T22:45:25.473024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.581041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473230+0000","last_change":"2024-09-15T22:45:24.260172+0000","last_active":"2024-09-15T22:45:25.473230+0000","last_peered":"2024-09-15T22:45:25.473230+0000","last_clean":"2024-09-15T22:45:25.473230+0000","last_became_active":"2024-09-15T22:45:24.259893+0000","last_became_peered":"2024-09-15T22:45:24.259893+0000","last_unstale":"2024-09-15T22:45:25.473230+0000","last_undegraded":"2024-09-15T22:45:25.473230+0000","last_fullsized":"2024-09-15T22:45:25.473230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:06.712571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254344+0000","last_change":"2024-09-15T22:45:23.540210+0000","last_active":"2024-09-15T22:45:25.254344+0000","last_peered":"2024-09-15T22:45:25.254344+0000","last_clean":"2024-09-15T22:45:25.254344+0000","last_became_active":"2024-09-15T22:45:23.539940+0000","last_became_peered":"2024-09-15T22:45:23.539940+0000","last_unstale":"2024-09-15T22:45:25.254344+0000","last_undegraded":"2024-09-15T22:45:25.254344+0000","last_fullsized":"2024-09-15T22:45:25.254344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:29.990752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472286+0000","last_change":"2024-09-15T22:45:24.263275+0000","last_active":"2024-09-15T22:45:25.472286+0000","last_peered":"2024-09-15T22:45:25.472286+0000","last_clean":"2024-09-15T22:45:25.472286+0000","last_became_active":"2024-09-15T22:45:24.262951+0000","last_became_peered":"2024-09-15T22:45:24.262951+0000","last_unstale":"2024-09-15T22:45:25.472286+0000","last_undegraded":"2024-09-15T22:45:25.472286+0000","last_fullsized":"2024-09-15T22:45:25.472286+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:27.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249280+0000","last_change":"2024-09-15T22:45:23.534612+0000","last_active":"2024-09-15T22:45:25.249280+0000","last_peered":"2024-09-15T22:45:25.249280+0000","last_clean":"2024-09-15T22:45:25.249280+0000","last_became_active":"2024-09-15T22:45:23.534277+0000","last_became_peered":"2024-09-15T22:45:23.534277+0000","last_unstale":"2024-09-15T22:45:25.249280+0000","last_undegraded":"2024-09-15T22:45:25.249280+0000","last_fullsized":"2024-09-15T22:45:25.249280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:06.037160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.253960+0000","last_change":"2024-09-15T22:45:24.264279+0000","last_active":"2024-09-15T22:45:25.253960+0000","last_peered":"2024-09-15T22:45:25.253960+0000","last_clean":"2024-09-15T22:45:25.253960+0000","last_became_active":"2024-09-15T22:45:24.264043+0000","last_became_peered":"2024-09-15T22:45:24.264043+0000","last_unstale":"2024-09-15T22:45:25.253960+0000","last_undegraded":"2024-09-15T22:45:25.253960+0000","last_fullsized":"2024-09-15T22:45:25.253960+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:34.424524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254296+0000","last_change":"2024-09-15T22:45:23.534344+0000","last_active":"2024-09-15T22:45:25.254296+0000","last_peered":"2024-09-15T22:45:25.254296+0000","last_clean":"2024-09-15T22:45:25.254296+0000","last_became_active":"2024-09-15T22:45:23.533605+0000","last_became_peered":"2024-09-15T22:45:23.533605+0000","last_unstale":"2024-09-15T22:45:25.254296+0000","last_undegraded":"2024-09-15T22:45:25.254296+0000","last_fullsized":"2024-09-15T22:45:25.254296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:55.618443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472776+0000","last_change":"2024-09-15T22:45:24.257937+0000","last_active":"2024-09-15T22:45:25.472776+0000","last_peered":"2024-09-15T22:45:25.472776+0000","last_clean":"2024-09-15T22:45:25.472776+0000","last_became_active":"2024-09-15T22:45:24.257653+0000","last_became_peered":"2024-09-15T22:45:24.257653+0000","last_unstale":"2024-09-15T22:45:25.472776+0000","last_undegraded":"2024-09-15T22:45:25.472776+0000","last_fullsized":"2024-09-15T22:45:25.472776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:25.120857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473276+0000","last_change":"2024-09-15T22:45:23.541002+0000","last_active":"2024-09-15T22:45:25.473276+0000","last_peered":"2024-09-15T22:45:25.473276+0000","last_clean":"2024-09-15T22:45:25.473276+0000","last_became_active":"2024-09-15T22:45:23.540752+0000","last_became_peered":"2024-09-15T22:45:23.540752+0000","last_unstale":"2024-09-15T22:45:25.473276+0000","last_undegraded":"2024-09-15T22:45:25.473276+0000","last_fullsized":"2024-09-15T22:45:25.473276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:47.397391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249659+0000","last_change":"2024-09-15T22:45:24.263067+0000","last_active":"2024-09-15T22:45:25.249659+0000","last_peered":"2024-09-15T22:45:25.249659+0000","last_clean":"2024-09-15T22:45:25.249659+0000","last_became_active":"2024-09-15T22:45:24.262791+0000","last_became_peered":"2024-09-15T22:45:24.262791+0000","last_unstale":"2024-09-15T22:45:25.249659+0000","last_undegraded":"2024-09-15T22:45:25.249659+0000","last_fullsized":"2024-09-15T22:45:25.249659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.800668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472845+0000","last_change":"2024-09-15T22:45:23.534817+0000","last_active":"2024-09-15T22:45:25.472845+0000","last_peered":"2024-09-15T22:45:25.472845+0000","last_clean":"2024-09-15T22:45:25.472845+0000","last_became_active":"2024-09-15T22:45:23.534448+0000","last_became_peered":"2024-09-15T22:45:23.534448+0000","last_unstale":"2024-09-15T22:45:25.472845+0000","last_undegraded":"2024-09-15T22:45:25.472845+0000","last_fullsized":"2024-09-15T22:45:25.472845+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:09.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472294+0000","last_change":"2024-09-15T22:45:24.257633+0000","last_active":"2024-09-15T22:45:25.472294+0000","last_peered":"2024-09-15T22:45:25.472294+0000","last_clean":"2024-09-15T22:45:25.472294+0000","last_became_active":"2024-09-15T22:45:24.257339+0000","last_became_peered":"2024-09-15T22:45:24.257339+0000","last_unstale":"2024-09-15T22:45:25.472294+0000","last_undegraded":"2024-09-15T22:45:25.472294+0000","last_fullsized":"2024-09-15T22:45:25.472294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:14.177874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472496+0000","last_change":"2024-09-15T22:45:23.535797+0000","last_active":"2024-09-15T22:45:25.472496+0000","last_peered":"2024-09-15T22:45:25.472496+0000","last_clean":"2024-09-15T22:45:25.472496+0000","last_became_active":"2024-09-15T22:45:23.535512+0000","last_became_peered":"2024-09-15T22:45:23.535512+0000","last_unstale":"2024-09-15T22:45:25.472496+0000","last_undegraded":"2024-09-15T22:45:25.472496+0000","last_fullsized":"2024-09-15T22:45:25.472496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:39.214347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254094+0000","last_change":"2024-09-15T22:45:24.263452+0000","last_active":"2024-09-15T22:45:25.254094+0000","last_peered":"2024-09-15T22:45:25.254094+0000","last_clean":"2024-09-15T22:45:25.254094+0000","last_became_active":"2024-09-15T22:45:24.262455+0000","last_became_peered":"2024-09-15T22:45:24.262455+0000","last_unstale":"2024-09-15T22:45:25.254094+0000","last_undegraded":"2024-09-15T22:45:25.254094+0000","last_fullsized":"2024-09-15T22:45:25.254094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:23.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472357+0000","last_change":"2024-09-15T22:45:23.532721+0000","last_active":"2024-09-15T22:45:25.472357+0000","last_peered":"2024-09-15T22:45:25.472357+0000","last_clean":"2024-09-15T22:45:25.472357+0000","last_became_active":"2024-09-15T22:45:23.532331+0000","last_became_peered":"2024-09-15T22:45:23.532331+0000","last_unstale":"2024-09-15T22:45:25.472357+0000","last_undegraded":"2024-09-15T22:45:25.472357+0000","last_fullsized":"2024-09-15T22:45:25.472357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:35.184258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472806+0000","last_change":"2024-09-15T22:45:24.260384+0000","last_active":"2024-09-15T22:45:25.472806+0000","last_peered":"2024-09-15T22:45:25.472806+0000","last_clean":"2024-09-15T22:45:25.472806+0000","last_became_active":"2024-09-15T22:45:24.259863+0000","last_became_peered":"2024-09-15T22:45:24.259863+0000","last_unstale":"2024-09-15T22:45:25.472806+0000","last_undegraded":"2024-09-15T22:45:25.472806+0000","last_fullsized":"2024-09-15T22:45:25.472806+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:21.805483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254355+0000","last_change":"2024-09-15T22:45:23.537687+0000","last_active":"2024-09-15T22:45:25.254355+0000","last_peered":"2024-09-15T22:45:25.254355+0000","last_clean":"2024-09-15T22:45:25.254355+0000","last_became_active":"2024-09-15T22:45:23.537353+0000","last_became_peered":"2024-09-15T22:45:23.537353+0000","last_unstale":"2024-09-15T22:45:25.254355+0000","last_undegraded":"2024-09-15T22:45:25.254355+0000","last_fullsized":"2024-09-15T22:45:25.254355+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:02.713441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.471978+0000","last_change":"2024-09-15T22:45:24.259921+0000","last_active":"2024-09-15T22:45:25.471978+0000","last_peered":"2024-09-15T22:45:25.471978+0000","last_clean":"2024-09-15T22:45:25.471978+0000","last_became_active":"2024-09-15T22:45:24.259614+0000","last_became_peered":"2024-09-15T22:45:24.259614+0000","last_unstale":"2024-09-15T22:45:25.471978+0000","last_undegraded":"2024-09-15T22:45:25.471978+0000","last_fullsized":"2024-09-15T22:45:25.471978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:13.460180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254421+0000","last_change":"2024-09-15T22:45:23.534367+0000","last_active":"2024-09-15T22:45:25.254421+0000","last_peered":"2024-09-15T22:45:25.254421+0000","last_clean":"2024-09-15T22:45:25.254421+0000","last_became_active":"2024-09-15T22:45:23.533453+0000","last_became_peered":"2024-09-15T22:45:23.533453+0000","last_unstale":"2024-09-15T22:45:25.254421+0000","last_undegraded":"2024-09-15T22:45:25.254421+0000","last_fullsized":"2024-09-15T22:45:25.254421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:49.670511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472313+0000","last_change":"2024-09-15T22:45:24.260726+0000","last_active":"2024-09-15T22:45:25.472313+0000","last_peered":"2024-09-15T22:45:25.472313+0000","last_clean":"2024-09-15T22:45:25.472313+0000","last_became_active":"2024-09-15T22:45:24.260474+0000","last_became_peered":"2024-09-15T22:45:24.260474+0000","last_unstale":"2024-09-15T22:45:25.472313+0000","last_undegraded":"2024-09-15T22:45:25.472313+0000","last_fullsized":"2024-09-15T22:45:25.472313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:53.321715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472081+0000","last_change":"2024-09-15T22:45:23.534616+0000","last_active":"2024-09-15T22:45:25.472081+0000","last_peered":"2024-09-15T22:45:25.472081+0000","last_clean":"2024-09-15T22:45:25.472081+0000","last_became_active":"2024-09-15T22:45:23.534344+0000","last_became_peered":"2024-09-15T22:45:23.534344+0000","last_unstale":"2024-09-15T22:45:25.472081+0000","last_undegraded":"2024-09-15T22:45:25.472081+0000","last_fullsized":"2024-09-15T22:45:25.472081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:55.105018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472908+0000","last_change":"2024-09-15T22:45:24.257456+0000","last_active":"2024-09-15T22:45:25.472908+0000","last_peered":"2024-09-15T22:45:25.472908+0000","last_clean":"2024-09-15T22:45:25.472908+0000","last_became_active":"2024-09-15T22:45:24.257228+0000","last_became_peered":"2024-09-15T22:45:24.257228+0000","last_unstale":"2024-09-15T22:45:25.472908+0000","last_undegraded":"2024-09-15T22:45:25.472908+0000","last_fullsized":"2024-09-15T22:45:25.472908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:35.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472617+0000","last_change":"2024-09-15T22:45:23.531234+0000","last_active":"2024-09-15T22:45:25.472617+0000","last_peered":"2024-09-15T22:45:25.472617+0000","last_clean":"2024-09-15T22:45:25.472617+0000","last_became_active":"2024-09-15T22:45:23.530933+0000","last_became_peered":"2024-09-15T22:45:23.530933+0000","last_unstale":"2024-09-15T22:45:25.472617+0000","last_undegraded":"2024-09-15T22:45:25.472617+0000","last_fullsized":"2024-09-15T22:45:25.472617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:23.366980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473178+0000","last_change":"2024-09-15T22:45:24.257369+0000","last_active":"2024-09-15T22:45:25.473178+0000","last_peered":"2024-09-15T22:45:25.473178+0000","last_clean":"2024-09-15T22:45:25.473178+0000","last_became_active":"2024-09-15T22:45:24.257120+0000","last_became_peered":"2024-09-15T22:45:24.257120+0000","last_unstale":"2024-09-15T22:45:25.473178+0000","last_undegraded":"2024-09-15T22:45:25.473178+0000","last_fullsized":"2024-09-15T22:45:25.473178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:08.218425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:26.527193+0000","last_change":"2024-09-15T22:45:23.532704+0000","last_active":"2024-09-15T22:45:26.527193+0000","last_peered":"2024-09-15T22:45:26.527193+0000","last_clean":"2024-09-15T22:45:26.527193+0000","last_became_active":"2024-09-15T22:45:23.532403+0000","last_became_peered":"2024-09-15T22:45:23.532403+0000","last_unstale":"2024-09-15T22:45:26.527193+0000","last_undegraded":"2024-09-15T22:45:26.527193+0000","last_fullsized":"2024-09-15T22:45:26.527193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:03.402951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473174+0000","last_change":"2024-09-15T22:45:24.252299+0000","last_active":"2024-09-15T22:45:25.473174+0000","last_peered":"2024-09-15T22:45:25.473174+0000","last_clean":"2024-09-15T22:45:25.473174+0000","last_became_active":"2024-09-15T22:45:24.252040+0000","last_became_peered":"2024-09-15T22:45:24.252040+0000","last_unstale":"2024-09-15T22:45:25.473174+0000","last_undegraded":"2024-09-15T22:45:25.473174+0000","last_fullsized":"2024-09-15T22:45:25.473174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:11.243653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472388+0000","last_change":"2024-09-15T22:45:23.539273+0000","last_active":"2024-09-15T22:45:25.472388+0000","last_peered":"2024-09-15T22:45:25.472388+0000","last_clean":"2024-09-15T22:45:25.472388+0000","last_became_active":"2024-09-15T22:45:23.539002+0000","last_became_peered":"2024-09-15T22:45:23.539002+0000","last_unstale":"2024-09-15T22:45:25.472388+0000","last_undegraded":"2024-09-15T22:45:25.472388+0000","last_fullsized":"2024-09-15T22:45:25.472388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:23.804830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249618+0000","last_change":"2024-09-15T22:45:24.263191+0000","last_active":"2024-09-15T22:45:25.249618+0000","last_peered":"2024-09-15T22:45:25.249618+0000","last_clean":"2024-09-15T22:45:25.249618+0000","last_became_active":"2024-09-15T22:45:24.262490+0000","last_became_peered":"2024-09-15T22:45:24.262490+0000","last_unstale":"2024-09-15T22:45:25.249618+0000","last_undegraded":"2024-09-15T22:45:25.249618+0000","last_fullsized":"2024-09-15T22:45:25.249618+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:49.321133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249477+0000","last_change":"2024-09-15T22:45:23.535791+0000","last_active":"2024-09-15T22:45:25.249477+0000","last_peered":"2024-09-15T22:45:25.249477+0000","last_clean":"2024-09-15T22:45:25.249477+0000","last_became_active":"2024-09-15T22:45:23.535525+0000","last_became_peered":"2024-09-15T22:45:23.535525+0000","last_unstale":"2024-09-15T22:45:25.249477+0000","last_undegraded":"2024-09-15T22:45:25.249477+0000","last_fullsized":"2024-09-15T22:45:25.249477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:29.990752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472616+0000","last_change":"2024-09-15T22:45:24.266175+0000","last_active":"2024-09-15T22:45:25.472616+0000","last_peered":"2024-09-15T22:45:25.472616+0000","last_clean":"2024-09-15T22:45:25.472616+0000","last_became_active":"2024-09-15T22:45:24.265824+0000","last_became_peered":"2024-09-15T22:45:24.265824+0000","last_unstale":"2024-09-15T22:45:25.472616+0000","last_undegraded":"2024-09-15T22:45:25.472616+0000","last_fullsized":"2024-09-15T22:45:25.472616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:29.150324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254656+0000","last_change":"2024-09-15T22:45:23.539510+0000","last_active":"2024-09-15T22:45:25.254656+0000","last_peered":"2024-09-15T22:45:25.254656+0000","last_clean":"2024-09-15T22:45:25.254656+0000","last_became_active":"2024-09-15T22:45:23.539171+0000","last_became_peered":"2024-09-15T22:45:23.539171+0000","last_unstale":"2024-09-15T22:45:25.254656+0000","last_undegraded":"2024-09-15T22:45:25.254656+0000","last_fullsized":"2024-09-15T22:45:25.254656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:06.037160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254424+0000","last_change":"2024-09-15T22:45:24.266115+0000","last_active":"2024-09-15T22:45:25.254424+0000","last_peered":"2024-09-15T22:45:25.254424+0000","last_clean":"2024-09-15T22:45:25.254424+0000","last_became_active":"2024-09-15T22:45:24.265835+0000","last_became_peered":"2024-09-15T22:45:24.265835+0000","last_unstale":"2024-09-15T22:45:25.254424+0000","last_undegraded":"2024-09-15T22:45:25.254424+0000","last_fullsized":"2024-09-15T22:45:25.254424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:29.585441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249749+0000","last_change":"2024-09-15T22:45:23.535115+0000","last_active":"2024-09-15T22:45:25.249749+0000","last_peered":"2024-09-15T22:45:25.249749+0000","last_clean":"2024-09-15T22:45:25.249749+0000","last_became_active":"2024-09-15T22:45:23.534858+0000","last_became_peered":"2024-09-15T22:45:23.534858+0000","last_unstale":"2024-09-15T22:45:25.249749+0000","last_undegraded":"2024-09-15T22:45:25.249749+0000","last_fullsized":"2024-09-15T22:45:25.249749+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:02.713441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472355+0000","last_change":"2024-09-15T22:45:24.265196+0000","last_active":"2024-09-15T22:45:25.472355+0000","last_peered":"2024-09-15T22:45:25.472355+0000","last_clean":"2024-09-15T22:45:25.472355+0000","last_became_active":"2024-09-15T22:45:24.264841+0000","last_became_peered":"2024-09-15T22:45:24.264841+0000","last_unstale":"2024-09-15T22:45:25.472355+0000","last_undegraded":"2024-09-15T22:45:25.472355+0000","last_fullsized":"2024-09-15T22:45:25.472355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:49.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472717+0000","last_change":"2024-09-15T22:45:23.539566+0000","last_active":"2024-09-15T22:45:25.472717+0000","last_peered":"2024-09-15T22:45:25.472717+0000","last_clean":"2024-09-15T22:45:25.472717+0000","last_became_active":"2024-09-15T22:45:23.539324+0000","last_became_peered":"2024-09-15T22:45:23.539324+0000","last_unstale":"2024-09-15T22:45:25.472717+0000","last_undegraded":"2024-09-15T22:45:25.472717+0000","last_fullsized":"2024-09-15T22:45:25.472717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:09.375281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472425+0000","last_change":"2024-09-15T22:45:24.263770+0000","last_active":"2024-09-15T22:45:25.472425+0000","last_peered":"2024-09-15T22:45:25.472425+0000","last_clean":"2024-09-15T22:45:25.472425+0000","last_became_active":"2024-09-15T22:45:24.263501+0000","last_became_peered":"2024-09-15T22:45:24.263501+0000","last_unstale":"2024-09-15T22:45:25.472425+0000","last_undegraded":"2024-09-15T22:45:25.472425+0000","last_fullsized":"2024-09-15T22:45:25.472425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:59.963050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472835+0000","last_change":"2024-09-15T22:45:23.542657+0000","last_active":"2024-09-15T22:45:25.472835+0000","last_peered":"2024-09-15T22:45:25.472835+0000","last_clean":"2024-09-15T22:45:25.472835+0000","last_became_active":"2024-09-15T22:45:23.542357+0000","last_became_peered":"2024-09-15T22:45:23.542357+0000","last_unstale":"2024-09-15T22:45:25.472835+0000","last_undegraded":"2024-09-15T22:45:25.472835+0000","last_fullsized":"2024-09-15T22:45:25.472835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.382754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254594+0000","last_change":"2024-09-15T22:45:24.267124+0000","last_active":"2024-09-15T22:45:25.254594+0000","last_peered":"2024-09-15T22:45:25.254594+0000","last_clean":"2024-09-15T22:45:25.254594+0000","last_became_active":"2024-09-15T22:45:24.266824+0000","last_became_peered":"2024-09-15T22:45:24.266824+0000","last_unstale":"2024-09-15T22:45:25.254594+0000","last_undegraded":"2024-09-15T22:45:25.254594+0000","last_fullsized":"2024-09-15T22:45:25.254594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:13.002612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473054+0000","last_change":"2024-09-15T22:45:23.537299+0000","last_active":"2024-09-15T22:45:25.473054+0000","last_peered":"2024-09-15T22:45:25.473054+0000","last_clean":"2024-09-15T22:45:25.473054+0000","last_became_active":"2024-09-15T22:45:23.537055+0000","last_became_peered":"2024-09-15T22:45:23.537055+0000","last_unstale":"2024-09-15T22:45:25.473054+0000","last_undegraded":"2024-09-15T22:45:25.473054+0000","last_fullsized":"2024-09-15T22:45:25.473054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:39.613732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":330,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472406+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:45:25.472406+0000","last_peered":"2024-09-15T22:45:25.472406+0000","last_clean":"2024-09-15T22:45:25.472406+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:45:25.472406+0000","last_undegraded":"2024-09-15T22:45:25.472406+0000","last_fullsized":"2024-09-15T22:45:25.472406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":460305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1081344,"data_stored":460907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1683456,"data_stored":1052249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1077248,"data_stored":460269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1085440,"data_stored":460909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":460235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1671168,"data_stored":1050693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":461869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:27.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:27.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.594+0000 7f0e2ff8d640 1 Processor -- start 2024-09-15T22:45:27.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 -- start start 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e2815e940 0x7f0e280d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e280b7170 con 0x7f0e280cef90 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0e280d1ae0 con 0x7f0e2815e940 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.595+0000 7f0e2ff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280b7aa0 con 0x7f0e2815ed20 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e2815e940 0x7f0e280d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e2815e940 0x7f0e280d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39022/0 (socket says 172.21.15.134:39022) 2024-09-15T22:45:27.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 -- 172.21.15.134:0/440215328 learned_addr learned my addr 172.21.15.134:0/440215328 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 -- 172.21.15.134:0/440215328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 msgr2=0x7f0e280d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 --2- 172.21.15.134:0/440215328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 -- 172.21.15.134:0/440215328 >> v1:172.21.15.177:6789/0 conn(0x7f0e280cef90 legacy=0x7f0e280b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 -- 172.21.15.134:0/440215328 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e280d3660 con 0x7f0e2815e940 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.596+0000 7f0e2dd29640 1 --2- 172.21.15.134:0/440215328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2815e940 0x7f0e280d1060 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009e50 tx=0x7f0e1802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b25898c8e4a19b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2cd27640 1 -- 172.21.15.134:0/440215328 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18036070 con 0x7f0e2815e940 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2cd27640 1 -- 172.21.15.134:0/440215328 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18031600 con 0x7f0e2815e940 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2cd27640 1 -- 172.21.15.134:0/440215328 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180319d0 con 0x7f0e2815e940 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/440215328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2815e940 msgr2=0x7f0e280d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/440215328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2815e940 0x7f0e280d1060 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009e50 tx=0x7f0e1802a750 comp rx=0 tx=0).stop 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/440215328 shutdown_connections 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/440215328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/440215328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2815e940 0x7f0e280d1060 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/440215328 >> 172.21.15.134:0/440215328 conn(0x7f0e280b6240 msgr2=0x7f0e280b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/440215328 shutdown_connections 2024-09-15T22:45:27.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.597+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/440215328 wait complete. 2024-09-15T22:45:27.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.598+0000 7f0e2ff8d640 1 Processor -- start 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.598+0000 7f0e2ff8d640 1 -- start start 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2815e940 0x7f0e28154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280d3f00 con 0x7f0e280cef90 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280d3c20 con 0x7f0e2815e940 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2ff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280d3310 con 0x7f0e2815ed20 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2dd29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2dd29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39026/0 (socket says 172.21.15.134:39026) 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2dd29640 1 -- 172.21.15.134:0/365410929 learned_addr learned my addr 172.21.15.134:0/365410929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2e52a640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.599+0000 7f0e2d528640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2815e940 0x7f0e28154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 -- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 msgr2=0x7f0e280b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 -- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2815e940 msgr2=0x7f0e28154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2815e940 0x7f0e28154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 -- 172.21.15.134:0/365410929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e28154e50 con 0x7f0e280cef90 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2e52a640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2dd29640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034040 tx=0x7f0e18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18041020 con 0x7f0e280cef90 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18007800 con 0x7f0e280cef90 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e281f87a0 con 0x7f0e280cef90 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18036040 con 0x7f0e280cef90 2024-09-15T22:45:27.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.600+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e281f8d60 con 0x7f0e280cef90 2024-09-15T22:45:27.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.601+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e280b9f00 con 0x7f0e280cef90 2024-09-15T22:45:27.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.601+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f0e18044020 con 0x7f0e280cef90 2024-09-15T22:45:27.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.602+0000 7f0e267fc640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 0x7f0e1406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.602+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f0e180ac4c0 con 0x7f0e280cef90 2024-09-15T22:45:27.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.602+0000 7f0e2d528640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 0x7f0e1406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.603+0000 7f0e2d528640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 0x7f0e1406e890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009890 tx=0x7f0e1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.606+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e280b9f00 con 0x7f0e280cef90 2024-09-15T22:45:27.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.770+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e280d1f80 con 0x7f0e1406c3d0 2024-09-15T22:45:27.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.776+0000 7f0e267fc640 1 -- 172.21.15.134:0/365410929 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252081 (secure 0 0 0) 0x7f0e280d1f80 con 0x7f0e1406c3d0 2024-09-15T22:45:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:27.781 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 msgr2=0x7f0e1406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 0x7f0e1406e890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009890 tx=0x7f0e1c008040 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 msgr2=0x7f0e28159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034040 tx=0x7f0e18004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 shutdown_connections 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2815ed20 0x7f0e280b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e2815e940 0x7f0e28154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1406c3d0 0x7f0e1406e890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 --2- 172.21.15.134:0/365410929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e280cef90 0x7f0e28159720 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.779+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 >> 172.21.15.134:0/365410929 conn(0x7f0e280b6240 msgr2=0x7f0e280b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.780+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 shutdown_connections 2024-09-15T22:45:27.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.780+0000 7f0e2ff8d640 1 -- 172.21.15.134:0/365410929 wait complete. 2024-09-15T22:45:27.792 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:45:27.181739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250832,"kb_used_data":9608,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723888,"statfs":{"total":773094113280,"available":772837261312,"internally_reserved":0,"allocated":9838592,"data_stored":4867436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.666590"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473340+0000","last_change":"2024-09-15T22:45:24.264213+0000","last_active":"2024-09-15T22:45:25.473340+0000","last_peered":"2024-09-15T22:45:25.473340+0000","last_clean":"2024-09-15T22:45:25.473340+0000","last_became_active":"2024-09-15T22:45:24.263803+0000","last_became_peered":"2024-09-15T22:45:24.263803+0000","last_unstale":"2024-09-15T22:45:25.473340+0000","last_undegraded":"2024-09-15T22:45:25.473340+0000","last_fullsized":"2024-09-15T22:45:25.473340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:41.698762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254488+0000","last_change":"2024-09-15T22:45:24.262614+0000","last_active":"2024-09-15T22:45:25.254488+0000","last_peered":"2024-09-15T22:45:25.254488+0000","last_clean":"2024-09-15T22:45:25.254488+0000","last_became_active":"2024-09-15T22:45:24.262335+0000","last_became_peered":"2024-09-15T22:45:24.262335+0000","last_unstale":"2024-09-15T22:45:25.254488+0000","last_undegraded":"2024-09-15T22:45:25.254488+0000","last_fullsized":"2024-09-15T22:45:25.254488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:44.942153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249494+0000","last_change":"2024-09-15T22:45:24.263011+0000","last_active":"2024-09-15T22:45:25.249494+0000","last_peered":"2024-09-15T22:45:25.249494+0000","last_clean":"2024-09-15T22:45:25.249494+0000","last_became_active":"2024-09-15T22:45:24.262389+0000","last_became_peered":"2024-09-15T22:45:24.262389+0000","last_unstale":"2024-09-15T22:45:25.249494+0000","last_undegraded":"2024-09-15T22:45:25.249494+0000","last_fullsized":"2024-09-15T22:45:25.249494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:53.321715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473014+0000","last_change":"2024-09-15T22:45:24.264735+0000","last_active":"2024-09-15T22:45:25.473014+0000","last_peered":"2024-09-15T22:45:25.473014+0000","last_clean":"2024-09-15T22:45:25.473014+0000","last_became_active":"2024-09-15T22:45:24.263301+0000","last_became_peered":"2024-09-15T22:45:24.263301+0000","last_unstale":"2024-09-15T22:45:25.473014+0000","last_undegraded":"2024-09-15T22:45:25.473014+0000","last_fullsized":"2024-09-15T22:45:25.473014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:11.142360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472583+0000","last_change":"2024-09-15T22:45:24.253888+0000","last_active":"2024-09-15T22:45:25.472583+0000","last_peered":"2024-09-15T22:45:25.472583+0000","last_clean":"2024-09-15T22:45:25.472583+0000","last_became_active":"2024-09-15T22:45:24.253596+0000","last_became_peered":"2024-09-15T22:45:24.253596+0000","last_unstale":"2024-09-15T22:45:25.472583+0000","last_undegraded":"2024-09-15T22:45:25.472583+0000","last_fullsized":"2024-09-15T22:45:25.472583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:13.284697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249677+0000","last_change":"2024-09-15T22:45:24.262640+0000","last_active":"2024-09-15T22:45:25.249677+0000","last_peered":"2024-09-15T22:45:25.249677+0000","last_clean":"2024-09-15T22:45:25.249677+0000","last_became_active":"2024-09-15T22:45:24.262326+0000","last_became_peered":"2024-09-15T22:45:24.262326+0000","last_unstale":"2024-09-15T22:45:25.249677+0000","last_undegraded":"2024-09-15T22:45:25.249677+0000","last_fullsized":"2024-09-15T22:45:25.249677+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:20.133635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.253980+0000","last_change":"2024-09-15T22:45:24.260392+0000","last_active":"2024-09-15T22:45:25.253980+0000","last_peered":"2024-09-15T22:45:25.253980+0000","last_clean":"2024-09-15T22:45:25.253980+0000","last_became_active":"2024-09-15T22:45:24.260068+0000","last_became_peered":"2024-09-15T22:45:24.260068+0000","last_unstale":"2024-09-15T22:45:25.253980+0000","last_undegraded":"2024-09-15T22:45:25.253980+0000","last_fullsized":"2024-09-15T22:45:25.253980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:45.890216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472182+0000","last_change":"2024-09-15T22:45:24.263913+0000","last_active":"2024-09-15T22:45:25.472182+0000","last_peered":"2024-09-15T22:45:25.472182+0000","last_clean":"2024-09-15T22:45:25.472182+0000","last_became_active":"2024-09-15T22:45:24.263681+0000","last_became_peered":"2024-09-15T22:45:24.263681+0000","last_unstale":"2024-09-15T22:45:25.472182+0000","last_undegraded":"2024-09-15T22:45:25.472182+0000","last_fullsized":"2024-09-15T22:45:25.472182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:29.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473395+0000","last_change":"2024-09-15T22:45:24.264369+0000","last_active":"2024-09-15T22:45:25.473395+0000","last_peered":"2024-09-15T22:45:25.473395+0000","last_clean":"2024-09-15T22:45:25.473395+0000","last_became_active":"2024-09-15T22:45:24.264105+0000","last_became_peered":"2024-09-15T22:45:24.264105+0000","last_unstale":"2024-09-15T22:45:25.473395+0000","last_undegraded":"2024-09-15T22:45:25.473395+0000","last_fullsized":"2024-09-15T22:45:25.473395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:48.452778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249800+0000","last_change":"2024-09-15T22:45:24.264257+0000","last_active":"2024-09-15T22:45:25.249800+0000","last_peered":"2024-09-15T22:45:25.249800+0000","last_clean":"2024-09-15T22:45:25.249800+0000","last_became_active":"2024-09-15T22:45:24.262468+0000","last_became_peered":"2024-09-15T22:45:24.262468+0000","last_unstale":"2024-09-15T22:45:25.249800+0000","last_undegraded":"2024-09-15T22:45:25.249800+0000","last_fullsized":"2024-09-15T22:45:25.249800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:53.429490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254937+0000","last_change":"2024-09-15T22:45:24.269208+0000","last_active":"2024-09-15T22:45:25.254937+0000","last_peered":"2024-09-15T22:45:25.254937+0000","last_clean":"2024-09-15T22:45:25.254937+0000","last_became_active":"2024-09-15T22:45:24.269000+0000","last_became_peered":"2024-09-15T22:45:24.269000+0000","last_unstale":"2024-09-15T22:45:25.254937+0000","last_undegraded":"2024-09-15T22:45:25.254937+0000","last_fullsized":"2024-09-15T22:45:25.254937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:08.092663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472372+0000","last_change":"2024-09-15T22:45:24.259476+0000","last_active":"2024-09-15T22:45:25.472372+0000","last_peered":"2024-09-15T22:45:25.472372+0000","last_clean":"2024-09-15T22:45:25.472372+0000","last_became_active":"2024-09-15T22:45:24.258981+0000","last_became_peered":"2024-09-15T22:45:24.258981+0000","last_unstale":"2024-09-15T22:45:25.472372+0000","last_undegraded":"2024-09-15T22:45:25.472372+0000","last_fullsized":"2024-09-15T22:45:25.472372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:18.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472718+0000","last_change":"2024-09-15T22:45:24.262417+0000","last_active":"2024-09-15T22:45:25.472718+0000","last_peered":"2024-09-15T22:45:25.472718+0000","last_clean":"2024-09-15T22:45:25.472718+0000","last_became_active":"2024-09-15T22:45:24.262158+0000","last_became_peered":"2024-09-15T22:45:24.262158+0000","last_unstale":"2024-09-15T22:45:25.472718+0000","last_undegraded":"2024-09-15T22:45:25.472718+0000","last_fullsized":"2024-09-15T22:45:25.472718+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:05.775653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472142+0000","last_change":"2024-09-15T22:45:24.262728+0000","last_active":"2024-09-15T22:45:25.472142+0000","last_peered":"2024-09-15T22:45:25.472142+0000","last_clean":"2024-09-15T22:45:25.472142+0000","last_became_active":"2024-09-15T22:45:24.262225+0000","last_became_peered":"2024-09-15T22:45:24.262225+0000","last_unstale":"2024-09-15T22:45:25.472142+0000","last_undegraded":"2024-09-15T22:45:25.472142+0000","last_fullsized":"2024-09-15T22:45:25.472142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:28.992720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254489+0000","last_change":"2024-09-15T22:45:24.260288+0000","last_active":"2024-09-15T22:45:25.254489+0000","last_peered":"2024-09-15T22:45:25.254489+0000","last_clean":"2024-09-15T22:45:25.254489+0000","last_became_active":"2024-09-15T22:45:24.259786+0000","last_became_peered":"2024-09-15T22:45:24.259786+0000","last_unstale":"2024-09-15T22:45:25.254489+0000","last_undegraded":"2024-09-15T22:45:25.254489+0000","last_fullsized":"2024-09-15T22:45:25.254489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:58.562563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249372+0000","last_change":"2024-09-15T22:45:24.262215+0000","last_active":"2024-09-15T22:45:25.249372+0000","last_peered":"2024-09-15T22:45:25.249372+0000","last_clean":"2024-09-15T22:45:25.249372+0000","last_became_active":"2024-09-15T22:45:24.261936+0000","last_became_peered":"2024-09-15T22:45:24.261936+0000","last_unstale":"2024-09-15T22:45:25.249372+0000","last_undegraded":"2024-09-15T22:45:25.249372+0000","last_fullsized":"2024-09-15T22:45:25.249372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:14.177874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472487+0000","last_change":"2024-09-15T22:45:24.259254+0000","last_active":"2024-09-15T22:45:25.472487+0000","last_peered":"2024-09-15T22:45:25.472487+0000","last_clean":"2024-09-15T22:45:25.472487+0000","last_became_active":"2024-09-15T22:45:24.258985+0000","last_became_peered":"2024-09-15T22:45:24.258985+0000","last_unstale":"2024-09-15T22:45:25.472487+0000","last_undegraded":"2024-09-15T22:45:25.472487+0000","last_fullsized":"2024-09-15T22:45:25.472487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.800668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254837+0000","last_change":"2024-09-15T22:45:24.258963+0000","last_active":"2024-09-15T22:45:25.254837+0000","last_peered":"2024-09-15T22:45:25.254837+0000","last_clean":"2024-09-15T22:45:25.254837+0000","last_became_active":"2024-09-15T22:45:24.258681+0000","last_became_peered":"2024-09-15T22:45:24.258681+0000","last_unstale":"2024-09-15T22:45:25.254837+0000","last_undegraded":"2024-09-15T22:45:25.254837+0000","last_fullsized":"2024-09-15T22:45:25.254837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:00.632766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472623+0000","last_change":"2024-09-15T22:45:24.261175+0000","last_active":"2024-09-15T22:45:25.472623+0000","last_peered":"2024-09-15T22:45:25.472623+0000","last_clean":"2024-09-15T22:45:25.472623+0000","last_became_active":"2024-09-15T22:45:24.260877+0000","last_became_peered":"2024-09-15T22:45:24.260877+0000","last_unstale":"2024-09-15T22:45:25.472623+0000","last_undegraded":"2024-09-15T22:45:25.472623+0000","last_fullsized":"2024-09-15T22:45:25.472623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:29.150324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472470+0000","last_change":"2024-09-15T22:45:24.261942+0000","last_active":"2024-09-15T22:45:25.472470+0000","last_peered":"2024-09-15T22:45:25.472470+0000","last_clean":"2024-09-15T22:45:25.472470+0000","last_became_active":"2024-09-15T22:45:24.261630+0000","last_became_peered":"2024-09-15T22:45:24.261630+0000","last_unstale":"2024-09-15T22:45:25.472470+0000","last_undegraded":"2024-09-15T22:45:25.472470+0000","last_fullsized":"2024-09-15T22:45:25.472470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:59.963050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472892+0000","last_change":"2024-09-15T22:45:24.266291+0000","last_active":"2024-09-15T22:45:25.472892+0000","last_peered":"2024-09-15T22:45:25.472892+0000","last_clean":"2024-09-15T22:45:25.472892+0000","last_became_active":"2024-09-15T22:45:24.266020+0000","last_became_peered":"2024-09-15T22:45:24.266020+0000","last_unstale":"2024-09-15T22:45:25.472892+0000","last_undegraded":"2024-09-15T22:45:25.472892+0000","last_fullsized":"2024-09-15T22:45:25.472892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:26.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472274+0000","last_change":"2024-09-15T22:45:24.261514+0000","last_active":"2024-09-15T22:45:25.472274+0000","last_peered":"2024-09-15T22:45:25.472274+0000","last_clean":"2024-09-15T22:45:25.472274+0000","last_became_active":"2024-09-15T22:45:24.261205+0000","last_became_peered":"2024-09-15T22:45:24.261205+0000","last_unstale":"2024-09-15T22:45:25.472274+0000","last_undegraded":"2024-09-15T22:45:25.472274+0000","last_fullsized":"2024-09-15T22:45:25.472274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:25.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472453+0000","last_change":"2024-09-15T22:45:24.256525+0000","last_active":"2024-09-15T22:45:25.472453+0000","last_peered":"2024-09-15T22:45:25.472453+0000","last_clean":"2024-09-15T22:45:25.472453+0000","last_became_active":"2024-09-15T22:45:24.256258+0000","last_became_peered":"2024-09-15T22:45:24.256258+0000","last_unstale":"2024-09-15T22:45:25.472453+0000","last_undegraded":"2024-09-15T22:45:25.472453+0000","last_fullsized":"2024-09-15T22:45:25.472453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:49.321133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254086+0000","last_change":"2024-09-15T22:45:24.266157+0000","last_active":"2024-09-15T22:45:25.254086+0000","last_peered":"2024-09-15T22:45:25.254086+0000","last_clean":"2024-09-15T22:45:25.254086+0000","last_became_active":"2024-09-15T22:45:24.265899+0000","last_became_peered":"2024-09-15T22:45:24.265899+0000","last_unstale":"2024-09-15T22:45:25.254086+0000","last_undegraded":"2024-09-15T22:45:25.254086+0000","last_fullsized":"2024-09-15T22:45:25.254086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:34.373361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254987+0000","last_change":"2024-09-15T22:45:24.267350+0000","last_active":"2024-09-15T22:45:25.254987+0000","last_peered":"2024-09-15T22:45:25.254987+0000","last_clean":"2024-09-15T22:45:25.254987+0000","last_became_active":"2024-09-15T22:45:24.267064+0000","last_became_peered":"2024-09-15T22:45:24.267064+0000","last_unstale":"2024-09-15T22:45:25.254987+0000","last_undegraded":"2024-09-15T22:45:25.254987+0000","last_fullsized":"2024-09-15T22:45:25.254987+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.160229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472875+0000","last_change":"2024-09-15T22:45:24.253594+0000","last_active":"2024-09-15T22:45:25.472875+0000","last_peered":"2024-09-15T22:45:25.472875+0000","last_clean":"2024-09-15T22:45:25.472875+0000","last_became_active":"2024-09-15T22:45:24.253306+0000","last_became_peered":"2024-09-15T22:45:24.253306+0000","last_unstale":"2024-09-15T22:45:25.472875+0000","last_undegraded":"2024-09-15T22:45:25.472875+0000","last_fullsized":"2024-09-15T22:45:25.472875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.904564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472954+0000","last_change":"2024-09-15T22:45:24.259811+0000","last_active":"2024-09-15T22:45:25.472954+0000","last_peered":"2024-09-15T22:45:25.472954+0000","last_clean":"2024-09-15T22:45:25.472954+0000","last_became_active":"2024-09-15T22:45:24.259478+0000","last_became_peered":"2024-09-15T22:45:24.259478+0000","last_unstale":"2024-09-15T22:45:25.472954+0000","last_undegraded":"2024-09-15T22:45:25.472954+0000","last_fullsized":"2024-09-15T22:45:25.472954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:23.412552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473250+0000","last_change":"2024-09-15T22:45:24.259082+0000","last_active":"2024-09-15T22:45:25.473250+0000","last_peered":"2024-09-15T22:45:25.473250+0000","last_clean":"2024-09-15T22:45:25.473250+0000","last_became_active":"2024-09-15T22:45:24.258836+0000","last_became_peered":"2024-09-15T22:45:24.258836+0000","last_unstale":"2024-09-15T22:45:25.473250+0000","last_undegraded":"2024-09-15T22:45:25.473250+0000","last_fullsized":"2024-09-15T22:45:25.473250+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:45.951169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472905+0000","last_change":"2024-09-15T22:45:24.265619+0000","last_active":"2024-09-15T22:45:25.472905+0000","last_peered":"2024-09-15T22:45:25.472905+0000","last_clean":"2024-09-15T22:45:25.472905+0000","last_became_active":"2024-09-15T22:45:24.265353+0000","last_became_peered":"2024-09-15T22:45:24.265353+0000","last_unstale":"2024-09-15T22:45:25.472905+0000","last_undegraded":"2024-09-15T22:45:25.472905+0000","last_fullsized":"2024-09-15T22:45:25.472905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:40.741321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472366+0000","last_change":"2024-09-15T22:45:24.262485+0000","last_active":"2024-09-15T22:45:25.472366+0000","last_peered":"2024-09-15T22:45:25.472366+0000","last_clean":"2024-09-15T22:45:25.472366+0000","last_became_active":"2024-09-15T22:45:24.261881+0000","last_became_peered":"2024-09-15T22:45:24.261881+0000","last_unstale":"2024-09-15T22:45:25.472366+0000","last_undegraded":"2024-09-15T22:45:25.472366+0000","last_fullsized":"2024-09-15T22:45:25.472366+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:49.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249271+0000","last_change":"2024-09-15T22:45:24.260600+0000","last_active":"2024-09-15T22:45:25.249271+0000","last_peered":"2024-09-15T22:45:25.249271+0000","last_clean":"2024-09-15T22:45:25.249271+0000","last_became_active":"2024-09-15T22:45:24.260312+0000","last_became_peered":"2024-09-15T22:45:24.260312+0000","last_unstale":"2024-09-15T22:45:25.249271+0000","last_undegraded":"2024-09-15T22:45:25.249271+0000","last_fullsized":"2024-09-15T22:45:25.249271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:44.964104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249295+0000","last_change":"2024-09-15T22:45:24.260693+0000","last_active":"2024-09-15T22:45:25.249295+0000","last_peered":"2024-09-15T22:45:25.249295+0000","last_clean":"2024-09-15T22:45:25.249295+0000","last_became_active":"2024-09-15T22:45:24.260449+0000","last_became_peered":"2024-09-15T22:45:24.260449+0000","last_unstale":"2024-09-15T22:45:25.249295+0000","last_undegraded":"2024-09-15T22:45:25.249295+0000","last_fullsized":"2024-09-15T22:45:25.249295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:29.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472715+0000","last_change":"2024-09-15T22:45:24.259699+0000","last_active":"2024-09-15T22:45:25.472715+0000","last_peered":"2024-09-15T22:45:25.472715+0000","last_clean":"2024-09-15T22:45:25.472715+0000","last_became_active":"2024-09-15T22:45:24.259422+0000","last_became_peered":"2024-09-15T22:45:24.259422+0000","last_unstale":"2024-09-15T22:45:25.472715+0000","last_undegraded":"2024-09-15T22:45:25.472715+0000","last_fullsized":"2024-09-15T22:45:25.472715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:53.429490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473190+0000","last_change":"2024-09-15T22:45:23.532870+0000","last_active":"2024-09-15T22:45:25.473190+0000","last_peered":"2024-09-15T22:45:25.473190+0000","last_clean":"2024-09-15T22:45:25.473190+0000","last_became_active":"2024-09-15T22:45:23.532616+0000","last_became_peered":"2024-09-15T22:45:23.532616+0000","last_unstale":"2024-09-15T22:45:25.473190+0000","last_undegraded":"2024-09-15T22:45:25.473190+0000","last_fullsized":"2024-09-15T22:45:25.473190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:10.140484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473476+0000","last_change":"2024-09-15T22:45:24.265515+0000","last_active":"2024-09-15T22:45:25.473476+0000","last_peered":"2024-09-15T22:45:25.473476+0000","last_clean":"2024-09-15T22:45:25.473476+0000","last_became_active":"2024-09-15T22:45:24.265274+0000","last_became_peered":"2024-09-15T22:45:24.265274+0000","last_unstale":"2024-09-15T22:45:25.473476+0000","last_undegraded":"2024-09-15T22:45:25.473476+0000","last_fullsized":"2024-09-15T22:45:25.473476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:07.039036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249562+0000","last_change":"2024-09-15T22:45:23.536271+0000","last_active":"2024-09-15T22:45:25.249562+0000","last_peered":"2024-09-15T22:45:25.249562+0000","last_clean":"2024-09-15T22:45:25.249562+0000","last_became_active":"2024-09-15T22:45:23.535976+0000","last_became_peered":"2024-09-15T22:45:23.535976+0000","last_unstale":"2024-09-15T22:45:25.249562+0000","last_undegraded":"2024-09-15T22:45:25.249562+0000","last_fullsized":"2024-09-15T22:45:25.249562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:23.804830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472508+0000","last_change":"2024-09-15T22:45:24.261120+0000","last_active":"2024-09-15T22:45:25.472508+0000","last_peered":"2024-09-15T22:45:25.472508+0000","last_clean":"2024-09-15T22:45:25.472508+0000","last_became_active":"2024-09-15T22:45:24.260678+0000","last_became_peered":"2024-09-15T22:45:24.260678+0000","last_unstale":"2024-09-15T22:45:25.472508+0000","last_undegraded":"2024-09-15T22:45:25.472508+0000","last_fullsized":"2024-09-15T22:45:25.472508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:20.133635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254913+0000","last_change":"2024-09-15T22:45:23.543061+0000","last_active":"2024-09-15T22:45:25.254913+0000","last_peered":"2024-09-15T22:45:25.254913+0000","last_clean":"2024-09-15T22:45:25.254913+0000","last_became_active":"2024-09-15T22:45:23.542835+0000","last_became_peered":"2024-09-15T22:45:23.542835+0000","last_unstale":"2024-09-15T22:45:25.254913+0000","last_undegraded":"2024-09-15T22:45:25.254913+0000","last_fullsized":"2024-09-15T22:45:25.254913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.158649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473498+0000","last_change":"2024-09-15T22:45:24.263191+0000","last_active":"2024-09-15T22:45:25.473498+0000","last_peered":"2024-09-15T22:45:25.473498+0000","last_clean":"2024-09-15T22:45:25.473498+0000","last_became_active":"2024-09-15T22:45:24.262941+0000","last_became_peered":"2024-09-15T22:45:24.262941+0000","last_unstale":"2024-09-15T22:45:25.473498+0000","last_undegraded":"2024-09-15T22:45:25.473498+0000","last_fullsized":"2024-09-15T22:45:25.473498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:30.992627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473092+0000","last_change":"2024-09-15T22:45:23.535920+0000","last_active":"2024-09-15T22:45:25.473092+0000","last_peered":"2024-09-15T22:45:25.473092+0000","last_clean":"2024-09-15T22:45:25.473092+0000","last_became_active":"2024-09-15T22:45:23.535607+0000","last_became_peered":"2024-09-15T22:45:23.535607+0000","last_unstale":"2024-09-15T22:45:25.473092+0000","last_undegraded":"2024-09-15T22:45:25.473092+0000","last_fullsized":"2024-09-15T22:45:25.473092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:58.064170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472591+0000","last_change":"2024-09-15T22:45:24.263713+0000","last_active":"2024-09-15T22:45:25.472591+0000","last_peered":"2024-09-15T22:45:25.472591+0000","last_clean":"2024-09-15T22:45:25.472591+0000","last_became_active":"2024-09-15T22:45:24.263463+0000","last_became_peered":"2024-09-15T22:45:24.263463+0000","last_unstale":"2024-09-15T22:45:25.472591+0000","last_undegraded":"2024-09-15T22:45:25.472591+0000","last_fullsized":"2024-09-15T22:45:25.472591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:06.416410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472202+0000","last_change":"2024-09-15T22:45:23.543432+0000","last_active":"2024-09-15T22:45:25.472202+0000","last_peered":"2024-09-15T22:45:25.472202+0000","last_clean":"2024-09-15T22:45:25.472202+0000","last_became_active":"2024-09-15T22:45:23.543155+0000","last_became_peered":"2024-09-15T22:45:23.543155+0000","last_unstale":"2024-09-15T22:45:25.472202+0000","last_undegraded":"2024-09-15T22:45:25.472202+0000","last_fullsized":"2024-09-15T22:45:25.472202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:49.793053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249611+0000","last_change":"2024-09-15T22:45:24.262447+0000","last_active":"2024-09-15T22:45:25.249611+0000","last_peered":"2024-09-15T22:45:25.249611+0000","last_clean":"2024-09-15T22:45:25.249611+0000","last_became_active":"2024-09-15T22:45:24.262196+0000","last_became_peered":"2024-09-15T22:45:24.262196+0000","last_unstale":"2024-09-15T22:45:25.249611+0000","last_undegraded":"2024-09-15T22:45:25.249611+0000","last_fullsized":"2024-09-15T22:45:25.249611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:18.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249698+0000","last_change":"2024-09-15T22:45:23.537692+0000","last_active":"2024-09-15T22:45:25.249698+0000","last_peered":"2024-09-15T22:45:25.249698+0000","last_clean":"2024-09-15T22:45:25.249698+0000","last_became_active":"2024-09-15T22:45:23.537364+0000","last_became_peered":"2024-09-15T22:45:23.537364+0000","last_unstale":"2024-09-15T22:45:25.249698+0000","last_undegraded":"2024-09-15T22:45:25.249698+0000","last_fullsized":"2024-09-15T22:45:25.249698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.382754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472215+0000","last_change":"2024-09-15T22:45:24.262245+0000","last_active":"2024-09-15T22:45:25.472215+0000","last_peered":"2024-09-15T22:45:25.472215+0000","last_clean":"2024-09-15T22:45:25.472215+0000","last_became_active":"2024-09-15T22:45:24.262007+0000","last_became_peered":"2024-09-15T22:45:24.262007+0000","last_unstale":"2024-09-15T22:45:25.472215+0000","last_undegraded":"2024-09-15T22:45:25.472215+0000","last_fullsized":"2024-09-15T22:45:25.472215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:27.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472240+0000","last_change":"2024-09-15T22:45:23.538462+0000","last_active":"2024-09-15T22:45:25.472240+0000","last_peered":"2024-09-15T22:45:25.472240+0000","last_clean":"2024-09-15T22:45:25.472240+0000","last_became_active":"2024-09-15T22:45:23.538191+0000","last_became_peered":"2024-09-15T22:45:23.538191+0000","last_unstale":"2024-09-15T22:45:25.472240+0000","last_undegraded":"2024-09-15T22:45:25.472240+0000","last_fullsized":"2024-09-15T22:45:25.472240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:16.325970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472135+0000","last_change":"2024-09-15T22:45:24.264459+0000","last_active":"2024-09-15T22:45:25.472135+0000","last_peered":"2024-09-15T22:45:25.472135+0000","last_clean":"2024-09-15T22:45:25.472135+0000","last_became_active":"2024-09-15T22:45:24.261913+0000","last_became_peered":"2024-09-15T22:45:24.261913+0000","last_unstale":"2024-09-15T22:45:25.472135+0000","last_undegraded":"2024-09-15T22:45:25.472135+0000","last_fullsized":"2024-09-15T22:45:25.472135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:58.657027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.471946+0000","last_change":"2024-09-15T22:45:23.536284+0000","last_active":"2024-09-15T22:45:25.471946+0000","last_peered":"2024-09-15T22:45:25.471946+0000","last_clean":"2024-09-15T22:45:25.471946+0000","last_became_active":"2024-09-15T22:45:23.535966+0000","last_became_peered":"2024-09-15T22:45:23.535966+0000","last_unstale":"2024-09-15T22:45:25.471946+0000","last_undegraded":"2024-09-15T22:45:25.471946+0000","last_fullsized":"2024-09-15T22:45:25.471946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:43.595402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472905+0000","last_change":"2024-09-15T22:45:24.258552+0000","last_active":"2024-09-15T22:45:25.472905+0000","last_peered":"2024-09-15T22:45:25.472905+0000","last_clean":"2024-09-15T22:45:25.472905+0000","last_became_active":"2024-09-15T22:45:24.258153+0000","last_became_peered":"2024-09-15T22:45:24.258153+0000","last_unstale":"2024-09-15T22:45:25.472905+0000","last_undegraded":"2024-09-15T22:45:25.472905+0000","last_fullsized":"2024-09-15T22:45:25.472905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:06.712571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473561+0000","last_change":"2024-09-15T22:45:23.536619+0000","last_active":"2024-09-15T22:45:25.473561+0000","last_peered":"2024-09-15T22:45:25.473561+0000","last_clean":"2024-09-15T22:45:25.473561+0000","last_became_active":"2024-09-15T22:45:23.536349+0000","last_became_peered":"2024-09-15T22:45:23.536349+0000","last_unstale":"2024-09-15T22:45:25.473561+0000","last_undegraded":"2024-09-15T22:45:25.473561+0000","last_fullsized":"2024-09-15T22:45:25.473561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:35.184258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473535+0000","last_change":"2024-09-15T22:45:24.260851+0000","last_active":"2024-09-15T22:45:25.473535+0000","last_peered":"2024-09-15T22:45:25.473535+0000","last_clean":"2024-09-15T22:45:25.473535+0000","last_became_active":"2024-09-15T22:45:24.260613+0000","last_became_peered":"2024-09-15T22:45:24.260613+0000","last_unstale":"2024-09-15T22:45:25.473535+0000","last_undegraded":"2024-09-15T22:45:25.473535+0000","last_fullsized":"2024-09-15T22:45:25.473535+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:03.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249654+0000","last_change":"2024-09-15T22:45:23.540398+0000","last_active":"2024-09-15T22:45:25.249654+0000","last_peered":"2024-09-15T22:45:25.249654+0000","last_clean":"2024-09-15T22:45:25.249654+0000","last_became_active":"2024-09-15T22:45:23.540187+0000","last_became_peered":"2024-09-15T22:45:23.540187+0000","last_unstale":"2024-09-15T22:45:25.249654+0000","last_undegraded":"2024-09-15T22:45:25.249654+0000","last_fullsized":"2024-09-15T22:45:25.249654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:49.793053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254600+0000","last_change":"2024-09-15T22:45:24.267346+0000","last_active":"2024-09-15T22:45:25.254600+0000","last_peered":"2024-09-15T22:45:25.254600+0000","last_clean":"2024-09-15T22:45:25.254600+0000","last_became_active":"2024-09-15T22:45:24.266962+0000","last_became_peered":"2024-09-15T22:45:24.266962+0000","last_unstale":"2024-09-15T22:45:25.254600+0000","last_undegraded":"2024-09-15T22:45:25.254600+0000","last_fullsized":"2024-09-15T22:45:25.254600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:18.012918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473524+0000","last_change":"2024-09-15T22:45:23.542360+0000","last_active":"2024-09-15T22:45:25.473524+0000","last_peered":"2024-09-15T22:45:25.473524+0000","last_clean":"2024-09-15T22:45:25.473524+0000","last_became_active":"2024-09-15T22:45:23.542088+0000","last_became_peered":"2024-09-15T22:45:23.542088+0000","last_unstale":"2024-09-15T22:45:25.473524+0000","last_undegraded":"2024-09-15T22:45:25.473524+0000","last_fullsized":"2024-09-15T22:45:25.473524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:39.214347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472983+0000","last_change":"2024-09-15T22:45:24.261743+0000","last_active":"2024-09-15T22:45:25.472983+0000","last_peered":"2024-09-15T22:45:25.472983+0000","last_clean":"2024-09-15T22:45:25.472983+0000","last_became_active":"2024-09-15T22:45:24.261501+0000","last_became_peered":"2024-09-15T22:45:24.261501+0000","last_unstale":"2024-09-15T22:45:25.472983+0000","last_undegraded":"2024-09-15T22:45:25.472983+0000","last_fullsized":"2024-09-15T22:45:25.472983+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:42.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472609+0000","last_change":"2024-09-15T22:45:23.540183+0000","last_active":"2024-09-15T22:45:25.472609+0000","last_peered":"2024-09-15T22:45:25.472609+0000","last_clean":"2024-09-15T22:45:25.472609+0000","last_became_active":"2024-09-15T22:45:23.539928+0000","last_became_peered":"2024-09-15T22:45:23.539928+0000","last_unstale":"2024-09-15T22:45:25.472609+0000","last_undegraded":"2024-09-15T22:45:25.472609+0000","last_fullsized":"2024-09-15T22:45:25.472609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:27.237842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254719+0000","last_change":"2024-09-15T22:45:24.259732+0000","last_active":"2024-09-15T22:45:25.254719+0000","last_peered":"2024-09-15T22:45:25.254719+0000","last_clean":"2024-09-15T22:45:25.254719+0000","last_became_active":"2024-09-15T22:45:24.259383+0000","last_became_peered":"2024-09-15T22:45:24.259383+0000","last_unstale":"2024-09-15T22:45:25.254719+0000","last_undegraded":"2024-09-15T22:45:25.254719+0000","last_fullsized":"2024-09-15T22:45:25.254719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:39.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473024+0000","last_change":"2024-09-15T22:45:23.536363+0000","last_active":"2024-09-15T22:45:25.473024+0000","last_peered":"2024-09-15T22:45:25.473024+0000","last_clean":"2024-09-15T22:45:25.473024+0000","last_became_active":"2024-09-15T22:45:23.535650+0000","last_became_peered":"2024-09-15T22:45:23.535650+0000","last_unstale":"2024-09-15T22:45:25.473024+0000","last_undegraded":"2024-09-15T22:45:25.473024+0000","last_fullsized":"2024-09-15T22:45:25.473024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.581041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473230+0000","last_change":"2024-09-15T22:45:24.260172+0000","last_active":"2024-09-15T22:45:25.473230+0000","last_peered":"2024-09-15T22:45:25.473230+0000","last_clean":"2024-09-15T22:45:25.473230+0000","last_became_active":"2024-09-15T22:45:24.259893+0000","last_became_peered":"2024-09-15T22:45:24.259893+0000","last_unstale":"2024-09-15T22:45:25.473230+0000","last_undegraded":"2024-09-15T22:45:25.473230+0000","last_fullsized":"2024-09-15T22:45:25.473230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:06.712571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254344+0000","last_change":"2024-09-15T22:45:23.540210+0000","last_active":"2024-09-15T22:45:25.254344+0000","last_peered":"2024-09-15T22:45:25.254344+0000","last_clean":"2024-09-15T22:45:25.254344+0000","last_became_active":"2024-09-15T22:45:23.539940+0000","last_became_peered":"2024-09-15T22:45:23.539940+0000","last_unstale":"2024-09-15T22:45:25.254344+0000","last_undegraded":"2024-09-15T22:45:25.254344+0000","last_fullsized":"2024-09-15T22:45:25.254344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:29.990752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472286+0000","last_change":"2024-09-15T22:45:24.263275+0000","last_active":"2024-09-15T22:45:25.472286+0000","last_peered":"2024-09-15T22:45:25.472286+0000","last_clean":"2024-09-15T22:45:25.472286+0000","last_became_active":"2024-09-15T22:45:24.262951+0000","last_became_peered":"2024-09-15T22:45:24.262951+0000","last_unstale":"2024-09-15T22:45:25.472286+0000","last_undegraded":"2024-09-15T22:45:25.472286+0000","last_fullsized":"2024-09-15T22:45:25.472286+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:27.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249280+0000","last_change":"2024-09-15T22:45:23.534612+0000","last_active":"2024-09-15T22:45:25.249280+0000","last_peered":"2024-09-15T22:45:25.249280+0000","last_clean":"2024-09-15T22:45:25.249280+0000","last_became_active":"2024-09-15T22:45:23.534277+0000","last_became_peered":"2024-09-15T22:45:23.534277+0000","last_unstale":"2024-09-15T22:45:25.249280+0000","last_undegraded":"2024-09-15T22:45:25.249280+0000","last_fullsized":"2024-09-15T22:45:25.249280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:06.037160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.253960+0000","last_change":"2024-09-15T22:45:24.264279+0000","last_active":"2024-09-15T22:45:25.253960+0000","last_peered":"2024-09-15T22:45:25.253960+0000","last_clean":"2024-09-15T22:45:25.253960+0000","last_became_active":"2024-09-15T22:45:24.264043+0000","last_became_peered":"2024-09-15T22:45:24.264043+0000","last_unstale":"2024-09-15T22:45:25.253960+0000","last_undegraded":"2024-09-15T22:45:25.253960+0000","last_fullsized":"2024-09-15T22:45:25.253960+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:34.424524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254296+0000","last_change":"2024-09-15T22:45:23.534344+0000","last_active":"2024-09-15T22:45:25.254296+0000","last_peered":"2024-09-15T22:45:25.254296+0000","last_clean":"2024-09-15T22:45:25.254296+0000","last_became_active":"2024-09-15T22:45:23.533605+0000","last_became_peered":"2024-09-15T22:45:23.533605+0000","last_unstale":"2024-09-15T22:45:25.254296+0000","last_undegraded":"2024-09-15T22:45:25.254296+0000","last_fullsized":"2024-09-15T22:45:25.254296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:55.618443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472776+0000","last_change":"2024-09-15T22:45:24.257937+0000","last_active":"2024-09-15T22:45:25.472776+0000","last_peered":"2024-09-15T22:45:25.472776+0000","last_clean":"2024-09-15T22:45:25.472776+0000","last_became_active":"2024-09-15T22:45:24.257653+0000","last_became_peered":"2024-09-15T22:45:24.257653+0000","last_unstale":"2024-09-15T22:45:25.472776+0000","last_undegraded":"2024-09-15T22:45:25.472776+0000","last_fullsized":"2024-09-15T22:45:25.472776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:25.120857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473276+0000","last_change":"2024-09-15T22:45:23.541002+0000","last_active":"2024-09-15T22:45:25.473276+0000","last_peered":"2024-09-15T22:45:25.473276+0000","last_clean":"2024-09-15T22:45:25.473276+0000","last_became_active":"2024-09-15T22:45:23.540752+0000","last_became_peered":"2024-09-15T22:45:23.540752+0000","last_unstale":"2024-09-15T22:45:25.473276+0000","last_undegraded":"2024-09-15T22:45:25.473276+0000","last_fullsized":"2024-09-15T22:45:25.473276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:47.397391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249659+0000","last_change":"2024-09-15T22:45:24.263067+0000","last_active":"2024-09-15T22:45:25.249659+0000","last_peered":"2024-09-15T22:45:25.249659+0000","last_clean":"2024-09-15T22:45:25.249659+0000","last_became_active":"2024-09-15T22:45:24.262791+0000","last_became_peered":"2024-09-15T22:45:24.262791+0000","last_unstale":"2024-09-15T22:45:25.249659+0000","last_undegraded":"2024-09-15T22:45:25.249659+0000","last_fullsized":"2024-09-15T22:45:25.249659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.800668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472845+0000","last_change":"2024-09-15T22:45:23.534817+0000","last_active":"2024-09-15T22:45:25.472845+0000","last_peered":"2024-09-15T22:45:25.472845+0000","last_clean":"2024-09-15T22:45:25.472845+0000","last_became_active":"2024-09-15T22:45:23.534448+0000","last_became_peered":"2024-09-15T22:45:23.534448+0000","last_unstale":"2024-09-15T22:45:25.472845+0000","last_undegraded":"2024-09-15T22:45:25.472845+0000","last_fullsized":"2024-09-15T22:45:25.472845+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:09.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472294+0000","last_change":"2024-09-15T22:45:24.257633+0000","last_active":"2024-09-15T22:45:25.472294+0000","last_peered":"2024-09-15T22:45:25.472294+0000","last_clean":"2024-09-15T22:45:25.472294+0000","last_became_active":"2024-09-15T22:45:24.257339+0000","last_became_peered":"2024-09-15T22:45:24.257339+0000","last_unstale":"2024-09-15T22:45:25.472294+0000","last_undegraded":"2024-09-15T22:45:25.472294+0000","last_fullsized":"2024-09-15T22:45:25.472294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:14.177874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472496+0000","last_change":"2024-09-15T22:45:23.535797+0000","last_active":"2024-09-15T22:45:25.472496+0000","last_peered":"2024-09-15T22:45:25.472496+0000","last_clean":"2024-09-15T22:45:25.472496+0000","last_became_active":"2024-09-15T22:45:23.535512+0000","last_became_peered":"2024-09-15T22:45:23.535512+0000","last_unstale":"2024-09-15T22:45:25.472496+0000","last_undegraded":"2024-09-15T22:45:25.472496+0000","last_fullsized":"2024-09-15T22:45:25.472496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:39.214347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254094+0000","last_change":"2024-09-15T22:45:24.263452+0000","last_active":"2024-09-15T22:45:25.254094+0000","last_peered":"2024-09-15T22:45:25.254094+0000","last_clean":"2024-09-15T22:45:25.254094+0000","last_became_active":"2024-09-15T22:45:24.262455+0000","last_became_peered":"2024-09-15T22:45:24.262455+0000","last_unstale":"2024-09-15T22:45:25.254094+0000","last_undegraded":"2024-09-15T22:45:25.254094+0000","last_fullsized":"2024-09-15T22:45:25.254094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:23.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472357+0000","last_change":"2024-09-15T22:45:23.532721+0000","last_active":"2024-09-15T22:45:25.472357+0000","last_peered":"2024-09-15T22:45:25.472357+0000","last_clean":"2024-09-15T22:45:25.472357+0000","last_became_active":"2024-09-15T22:45:23.532331+0000","last_became_peered":"2024-09-15T22:45:23.532331+0000","last_unstale":"2024-09-15T22:45:25.472357+0000","last_undegraded":"2024-09-15T22:45:25.472357+0000","last_fullsized":"2024-09-15T22:45:25.472357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:35.184258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472806+0000","last_change":"2024-09-15T22:45:24.260384+0000","last_active":"2024-09-15T22:45:25.472806+0000","last_peered":"2024-09-15T22:45:25.472806+0000","last_clean":"2024-09-15T22:45:25.472806+0000","last_became_active":"2024-09-15T22:45:24.259863+0000","last_became_peered":"2024-09-15T22:45:24.259863+0000","last_unstale":"2024-09-15T22:45:25.472806+0000","last_undegraded":"2024-09-15T22:45:25.472806+0000","last_fullsized":"2024-09-15T22:45:25.472806+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:21.805483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254355+0000","last_change":"2024-09-15T22:45:23.537687+0000","last_active":"2024-09-15T22:45:25.254355+0000","last_peered":"2024-09-15T22:45:25.254355+0000","last_clean":"2024-09-15T22:45:25.254355+0000","last_became_active":"2024-09-15T22:45:23.537353+0000","last_became_peered":"2024-09-15T22:45:23.537353+0000","last_unstale":"2024-09-15T22:45:25.254355+0000","last_undegraded":"2024-09-15T22:45:25.254355+0000","last_fullsized":"2024-09-15T22:45:25.254355+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:02.713441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.471978+0000","last_change":"2024-09-15T22:45:24.259921+0000","last_active":"2024-09-15T22:45:25.471978+0000","last_peered":"2024-09-15T22:45:25.471978+0000","last_clean":"2024-09-15T22:45:25.471978+0000","last_became_active":"2024-09-15T22:45:24.259614+0000","last_became_peered":"2024-09-15T22:45:24.259614+0000","last_unstale":"2024-09-15T22:45:25.471978+0000","last_undegraded":"2024-09-15T22:45:25.471978+0000","last_fullsized":"2024-09-15T22:45:25.471978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:13.460180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254421+0000","last_change":"2024-09-15T22:45:23.534367+0000","last_active":"2024-09-15T22:45:25.254421+0000","last_peered":"2024-09-15T22:45:25.254421+0000","last_clean":"2024-09-15T22:45:25.254421+0000","last_became_active":"2024-09-15T22:45:23.533453+0000","last_became_peered":"2024-09-15T22:45:23.533453+0000","last_unstale":"2024-09-15T22:45:25.254421+0000","last_undegraded":"2024-09-15T22:45:25.254421+0000","last_fullsized":"2024-09-15T22:45:25.254421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:49.670511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472313+0000","last_change":"2024-09-15T22:45:24.260726+0000","last_active":"2024-09-15T22:45:25.472313+0000","last_peered":"2024-09-15T22:45:25.472313+0000","last_clean":"2024-09-15T22:45:25.472313+0000","last_became_active":"2024-09-15T22:45:24.260474+0000","last_became_peered":"2024-09-15T22:45:24.260474+0000","last_unstale":"2024-09-15T22:45:25.472313+0000","last_undegraded":"2024-09-15T22:45:25.472313+0000","last_fullsized":"2024-09-15T22:45:25.472313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:53.321715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472081+0000","last_change":"2024-09-15T22:45:23.534616+0000","last_active":"2024-09-15T22:45:25.472081+0000","last_peered":"2024-09-15T22:45:25.472081+0000","last_clean":"2024-09-15T22:45:25.472081+0000","last_became_active":"2024-09-15T22:45:23.534344+0000","last_became_peered":"2024-09-15T22:45:23.534344+0000","last_unstale":"2024-09-15T22:45:25.472081+0000","last_undegraded":"2024-09-15T22:45:25.472081+0000","last_fullsized":"2024-09-15T22:45:25.472081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:55.105018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472908+0000","last_change":"2024-09-15T22:45:24.257456+0000","last_active":"2024-09-15T22:45:25.472908+0000","last_peered":"2024-09-15T22:45:25.472908+0000","last_clean":"2024-09-15T22:45:25.472908+0000","last_became_active":"2024-09-15T22:45:24.257228+0000","last_became_peered":"2024-09-15T22:45:24.257228+0000","last_unstale":"2024-09-15T22:45:25.472908+0000","last_undegraded":"2024-09-15T22:45:25.472908+0000","last_fullsized":"2024-09-15T22:45:25.472908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:35.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472617+0000","last_change":"2024-09-15T22:45:23.531234+0000","last_active":"2024-09-15T22:45:25.472617+0000","last_peered":"2024-09-15T22:45:25.472617+0000","last_clean":"2024-09-15T22:45:25.472617+0000","last_became_active":"2024-09-15T22:45:23.530933+0000","last_became_peered":"2024-09-15T22:45:23.530933+0000","last_unstale":"2024-09-15T22:45:25.472617+0000","last_undegraded":"2024-09-15T22:45:25.472617+0000","last_fullsized":"2024-09-15T22:45:25.472617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:23.366980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473178+0000","last_change":"2024-09-15T22:45:24.257369+0000","last_active":"2024-09-15T22:45:25.473178+0000","last_peered":"2024-09-15T22:45:25.473178+0000","last_clean":"2024-09-15T22:45:25.473178+0000","last_became_active":"2024-09-15T22:45:24.257120+0000","last_became_peered":"2024-09-15T22:45:24.257120+0000","last_unstale":"2024-09-15T22:45:25.473178+0000","last_undegraded":"2024-09-15T22:45:25.473178+0000","last_fullsized":"2024-09-15T22:45:25.473178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:08.218425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:26.527193+0000","last_change":"2024-09-15T22:45:23.532704+0000","last_active":"2024-09-15T22:45:26.527193+0000","last_peered":"2024-09-15T22:45:26.527193+0000","last_clean":"2024-09-15T22:45:26.527193+0000","last_became_active":"2024-09-15T22:45:23.532403+0000","last_became_peered":"2024-09-15T22:45:23.532403+0000","last_unstale":"2024-09-15T22:45:26.527193+0000","last_undegraded":"2024-09-15T22:45:26.527193+0000","last_fullsized":"2024-09-15T22:45:26.527193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:03.402951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473174+0000","last_change":"2024-09-15T22:45:24.252299+0000","last_active":"2024-09-15T22:45:25.473174+0000","last_peered":"2024-09-15T22:45:25.473174+0000","last_clean":"2024-09-15T22:45:25.473174+0000","last_became_active":"2024-09-15T22:45:24.252040+0000","last_became_peered":"2024-09-15T22:45:24.252040+0000","last_unstale":"2024-09-15T22:45:25.473174+0000","last_undegraded":"2024-09-15T22:45:25.473174+0000","last_fullsized":"2024-09-15T22:45:25.473174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:11.243653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472388+0000","last_change":"2024-09-15T22:45:23.539273+0000","last_active":"2024-09-15T22:45:25.472388+0000","last_peered":"2024-09-15T22:45:25.472388+0000","last_clean":"2024-09-15T22:45:25.472388+0000","last_became_active":"2024-09-15T22:45:23.539002+0000","last_became_peered":"2024-09-15T22:45:23.539002+0000","last_unstale":"2024-09-15T22:45:25.472388+0000","last_undegraded":"2024-09-15T22:45:25.472388+0000","last_fullsized":"2024-09-15T22:45:25.472388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:23.804830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249618+0000","last_change":"2024-09-15T22:45:24.263191+0000","last_active":"2024-09-15T22:45:25.249618+0000","last_peered":"2024-09-15T22:45:25.249618+0000","last_clean":"2024-09-15T22:45:25.249618+0000","last_became_active":"2024-09-15T22:45:24.262490+0000","last_became_peered":"2024-09-15T22:45:24.262490+0000","last_unstale":"2024-09-15T22:45:25.249618+0000","last_undegraded":"2024-09-15T22:45:25.249618+0000","last_fullsized":"2024-09-15T22:45:25.249618+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:49.321133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249477+0000","last_change":"2024-09-15T22:45:23.535791+0000","last_active":"2024-09-15T22:45:25.249477+0000","last_peered":"2024-09-15T22:45:25.249477+0000","last_clean":"2024-09-15T22:45:25.249477+0000","last_became_active":"2024-09-15T22:45:23.535525+0000","last_became_peered":"2024-09-15T22:45:23.535525+0000","last_unstale":"2024-09-15T22:45:25.249477+0000","last_undegraded":"2024-09-15T22:45:25.249477+0000","last_fullsized":"2024-09-15T22:45:25.249477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:29.990752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472616+0000","last_change":"2024-09-15T22:45:24.266175+0000","last_active":"2024-09-15T22:45:25.472616+0000","last_peered":"2024-09-15T22:45:25.472616+0000","last_clean":"2024-09-15T22:45:25.472616+0000","last_became_active":"2024-09-15T22:45:24.265824+0000","last_became_peered":"2024-09-15T22:45:24.265824+0000","last_unstale":"2024-09-15T22:45:25.472616+0000","last_undegraded":"2024-09-15T22:45:25.472616+0000","last_fullsized":"2024-09-15T22:45:25.472616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:29.150324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254656+0000","last_change":"2024-09-15T22:45:23.539510+0000","last_active":"2024-09-15T22:45:25.254656+0000","last_peered":"2024-09-15T22:45:25.254656+0000","last_clean":"2024-09-15T22:45:25.254656+0000","last_became_active":"2024-09-15T22:45:23.539171+0000","last_became_peered":"2024-09-15T22:45:23.539171+0000","last_unstale":"2024-09-15T22:45:25.254656+0000","last_undegraded":"2024-09-15T22:45:25.254656+0000","last_fullsized":"2024-09-15T22:45:25.254656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:06.037160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254424+0000","last_change":"2024-09-15T22:45:24.266115+0000","last_active":"2024-09-15T22:45:25.254424+0000","last_peered":"2024-09-15T22:45:25.254424+0000","last_clean":"2024-09-15T22:45:25.254424+0000","last_became_active":"2024-09-15T22:45:24.265835+0000","last_became_peered":"2024-09-15T22:45:24.265835+0000","last_unstale":"2024-09-15T22:45:25.254424+0000","last_undegraded":"2024-09-15T22:45:25.254424+0000","last_fullsized":"2024-09-15T22:45:25.254424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:29.585441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.249749+0000","last_change":"2024-09-15T22:45:23.535115+0000","last_active":"2024-09-15T22:45:25.249749+0000","last_peered":"2024-09-15T22:45:25.249749+0000","last_clean":"2024-09-15T22:45:25.249749+0000","last_became_active":"2024-09-15T22:45:23.534858+0000","last_became_peered":"2024-09-15T22:45:23.534858+0000","last_unstale":"2024-09-15T22:45:25.249749+0000","last_undegraded":"2024-09-15T22:45:25.249749+0000","last_fullsized":"2024-09-15T22:45:25.249749+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:02.713441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472355+0000","last_change":"2024-09-15T22:45:24.265196+0000","last_active":"2024-09-15T22:45:25.472355+0000","last_peered":"2024-09-15T22:45:25.472355+0000","last_clean":"2024-09-15T22:45:25.472355+0000","last_became_active":"2024-09-15T22:45:24.264841+0000","last_became_peered":"2024-09-15T22:45:24.264841+0000","last_unstale":"2024-09-15T22:45:25.472355+0000","last_undegraded":"2024-09-15T22:45:25.472355+0000","last_fullsized":"2024-09-15T22:45:25.472355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:49.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472717+0000","last_change":"2024-09-15T22:45:23.539566+0000","last_active":"2024-09-15T22:45:25.472717+0000","last_peered":"2024-09-15T22:45:25.472717+0000","last_clean":"2024-09-15T22:45:25.472717+0000","last_became_active":"2024-09-15T22:45:23.539324+0000","last_became_peered":"2024-09-15T22:45:23.539324+0000","last_unstale":"2024-09-15T22:45:25.472717+0000","last_undegraded":"2024-09-15T22:45:25.472717+0000","last_fullsized":"2024-09-15T22:45:25.472717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:09.375281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472425+0000","last_change":"2024-09-15T22:45:24.263770+0000","last_active":"2024-09-15T22:45:25.472425+0000","last_peered":"2024-09-15T22:45:25.472425+0000","last_clean":"2024-09-15T22:45:25.472425+0000","last_became_active":"2024-09-15T22:45:24.263501+0000","last_became_peered":"2024-09-15T22:45:24.263501+0000","last_unstale":"2024-09-15T22:45:25.472425+0000","last_undegraded":"2024-09-15T22:45:25.472425+0000","last_fullsized":"2024-09-15T22:45:25.472425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:59.963050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472835+0000","last_change":"2024-09-15T22:45:23.542657+0000","last_active":"2024-09-15T22:45:25.472835+0000","last_peered":"2024-09-15T22:45:25.472835+0000","last_clean":"2024-09-15T22:45:25.472835+0000","last_became_active":"2024-09-15T22:45:23.542357+0000","last_became_peered":"2024-09-15T22:45:23.542357+0000","last_unstale":"2024-09-15T22:45:25.472835+0000","last_undegraded":"2024-09-15T22:45:25.472835+0000","last_fullsized":"2024-09-15T22:45:25.472835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.382754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.254594+0000","last_change":"2024-09-15T22:45:24.267124+0000","last_active":"2024-09-15T22:45:25.254594+0000","last_peered":"2024-09-15T22:45:25.254594+0000","last_clean":"2024-09-15T22:45:25.254594+0000","last_became_active":"2024-09-15T22:45:24.266824+0000","last_became_peered":"2024-09-15T22:45:24.266824+0000","last_unstale":"2024-09-15T22:45:25.254594+0000","last_undegraded":"2024-09-15T22:45:25.254594+0000","last_fullsized":"2024-09-15T22:45:25.254594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:23.513768+0000","last_clean_scrub_stamp":"2024-09-15T22:45:23.513768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:13.002612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.473054+0000","last_change":"2024-09-15T22:45:23.537299+0000","last_active":"2024-09-15T22:45:25.473054+0000","last_peered":"2024-09-15T22:45:25.473054+0000","last_clean":"2024-09-15T22:45:25.473054+0000","last_became_active":"2024-09-15T22:45:23.537055+0000","last_became_peered":"2024-09-15T22:45:23.537055+0000","last_unstale":"2024-09-15T22:45:25.473054+0000","last_undegraded":"2024-09-15T22:45:25.473054+0000","last_fullsized":"2024-09-15T22:45:25.473054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:22.511892+0000","last_clean_scrub_stamp":"2024-09-15T22:45:22.511892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:39.613732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":330,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.472406+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:45:25.472406+0000","last_peered":"2024-09-15T22:45:25.472406+0000","last_clean":"2024-09-15T22:45:25.472406+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:45:25.472406+0000","last_undegraded":"2024-09-15T22:45:25.472406+0000","last_fullsized":"2024-09-15T22:45:25.472406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":460305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1081344,"data_stored":460907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1683456,"data_stored":1052249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1077248,"data_stored":460269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1085440,"data_stored":460909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":460235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1671168,"data_stored":1050693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":461869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:27.795 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:45:27.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:45:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.938+0000 7f48f6b81640 1 Processor -- start 2024-09-15T22:45:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.938+0000 7f48f6b81640 1 -- start start 2024-09-15T22:45:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f6b81640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48f0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f6b81640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f48f015f9f0 0x7f48f00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f6b81640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f015c970 con 0x7f48f015b370 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f6b81640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f48f015fef0 con 0x7f48f015f9f0 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f6b81640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f48f015bbb0 con 0x7f48f006f130 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f491d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f48f015b370 0x7f48f006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47704/0 (socket says 172.21.15.134:47704) 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f491d640 1 -- 172.21.15.134:0/1428615012 learned_addr learned my addr 172.21.15.134:0/1428615012 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185457581 0 0) 0x7f48f015c970 con 0x7f48f015b370 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e0003520 con 0x7f48f015b370 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48effff640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48f0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> v2:172.21.15.177:3300/0 conn(0x7f48f015f9f0 0x7f48f00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1645486677 0 0) 0x7f48e0003520 con 0x7f48f015b370 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 msgr2=0x7f48f0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48f0072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 >> v2:172.21.15.177:3300/0 conn(0x7f48f015f9f0 msgr2=0x7f48f00ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 --2- 172.21.15.134:0/1428615012 >> v2:172.21.15.177:3300/0 conn(0x7f48f015f9f0 0x7f48f00ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f015be90 con 0x7f48f015b370 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f48e4001670 con 0x7f48f015b370 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 >> v1:172.21.15.134:6789/0 conn(0x7f48f015b370 legacy=0x7f48f006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48e00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e0003f50 0x7f48e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48f015fef0 con 0x7f48e0004d40 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48f015bbb0 con 0x7f48e0003f50 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f48e000dd00 con 0x7f48f006f130 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.939+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> v2:172.21.15.177:3300/0 conn(0x7f48f015f9f0 0x7f48f00ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48effff640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e0003f50 0x7f48e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f491d640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48e00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 -- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 msgr2=0x7f48e00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f006f130 0x7f48e00039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 -- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e0003f50 msgr2=0x7f48e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e0003f50 0x7f48e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 -- 172.21.15.134:0/1428615012 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e0003520 con 0x7f48e0004d40 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.940+0000 7f48f511e640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48e00051c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f48f015fe20 tx=0x7f48e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230d8aad0fe14443 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8009c70 con 0x7f48e0004d40 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e802c620 con 0x7f48e0004d40 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48ef7fe640 1 -- 172.21.15.134:0/1428615012 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e802c9d0 con 0x7f48e0004d40 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 -- 172.21.15.134:0/1428615012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 msgr2=0x7f48e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 --2- 172.21.15.134:0/1428615012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48e00051c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f48f015fe20 tx=0x7f48e0005830 comp rx=0 tx=0).stop 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f511e640 1 -- 172.21.15.134:0/1428615012 reap_dead start 2024-09-15T22:45:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 -- 172.21.15.134:0/1428615012 shutdown_connections 2024-09-15T22:45:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 -- 172.21.15.134:0/1428615012 >> 172.21.15.134:0/1428615012 conn(0x7f48f006bba0 msgr2=0x7f48f006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 -- 172.21.15.134:0/1428615012 shutdown_connections 2024-09-15T22:45:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.941+0000 7f48f6b81640 1 -- 172.21.15.134:0/1428615012 wait complete. 2024-09-15T22:45:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.942+0000 7f48f6b81640 1 Processor -- start 2024-09-15T22:45:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.942+0000 7f48f6b81640 1 -- start start 2024-09-15T22:45:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 0x7f48f00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 0x7f48f0151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00731b0 con 0x7f48e0004d40 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48f015c450 con 0x7f48f00b52b0 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f6b81640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f48f015b750 con 0x7f48f00b4e30 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f491d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f491d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39036/0 (socket says 172.21.15.134:39036) 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.943+0000 7f48f491d640 1 -- 172.21.15.134:0/4082987746 learned_addr learned my addr 172.21.15.134:0/4082987746 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f511e640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 0x7f48f0151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48effff640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 0x7f48f00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 -- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 msgr2=0x7f48f00b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 0x7f48f00b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 -- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 msgr2=0x7f48f0151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 0x7f48f0151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 -- 172.21.15.134:0/4082987746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f015e0c0 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f511e640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 0x7f48f0151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48effff640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 0x7f48f00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f491d640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f48e4007340 tx=0x7f48e4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e400f9c0 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4018070 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e400fdc0 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f015e3a0 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.944+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f015e960 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.945+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f0071b90 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.945+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f48e401d460 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.946+0000 7f48ed7fa640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 0x7f48d406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.946+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f48e408b7d0 con 0x7f48e0004d40 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.946+0000 7f48effff640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 0x7f48d406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.947+0000 7f48effff640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 0x7f48d406e890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48f0072aa0 tx=0x7f48dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:27.950+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48f0071b90 con 0x7f48e0004d40 2024-09-15T22:45:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.177+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f48f0072560 con 0x7f48e0004d40 2024-09-15T22:45:28.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.181+0000 7f48ed7fa640 1 -- 172.21.15.134:0/4082987746 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f48e4059e30 con 0x7f48e0004d40 2024-09-15T22:45:28.184 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:45:28.184 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:45:28.184 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:45:28.184 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:45:28.184 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:45:28.185 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:45:28.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 msgr2=0x7f48d406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 0x7f48d406e890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48f0072aa0 tx=0x7f48dc008040 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 msgr2=0x7f48f01f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f48e4007340 tx=0x7f48e4007800 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 shutdown_connections 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f00b52b0 0x7f48f0151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48f00b4e30 0x7f48f00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f48d406c3d0 0x7f48d406e890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 --2- 172.21.15.134:0/4082987746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e0004d40 0x7f48f01f01c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 >> 172.21.15.134:0/4082987746 conn(0x7f48f006bba0 msgr2=0x7f48f006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 shutdown_connections 2024-09-15T22:45:28.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.184+0000 7f48f6b81640 1 -- 172.21.15.134:0/4082987746 wait complete. 2024-09-15T22:45:28.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.292+0000 7fade73a6640 1 Processor -- start 2024-09-15T22:45:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.292+0000 7fade73a6640 1 -- start start 2024-09-15T22:45:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade73a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fade00d1ee0 0x7fade0073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade73a6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade0160420 con 0x7fade015c3b0 2024-09-15T22:45:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade73a6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade0160700 con 0x7fade00d08c0 2024-09-15T22:45:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade73a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fade0161030 con 0x7fade00d1ee0 2024-09-15T22:45:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade5142640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fade015c3b0 0x7fade0073110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47716/0 (socket says 172.21.15.134:47716) 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.293+0000 7fade5142640 1 -- 172.21.15.134:0/3543442384 learned_addr learned my addr 172.21.15.134:0/3543442384 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938731337 0 0) 0x7fade0160420 con 0x7fade015c3b0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc003520 con 0x7fade015c3b0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade4941640 1 --2- 172.21.15.134:0/3543442384 >> v2:172.21.15.177:3300/0 conn(0x7fade00d1ee0 0x7fade0073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2406072643 0 0) 0x7fadcc003520 con 0x7fade015c3b0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 >> v2:172.21.15.177:3300/0 conn(0x7fade00d1ee0 msgr2=0x7fade0073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 --2- 172.21.15.134:0/3543442384 >> v2:172.21.15.177:3300/0 conn(0x7fade00d1ee0 0x7fade0073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 >> v1:172.21.15.177:6789/0 conn(0x7fade00d08c0 legacy=0x7fade00d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade01609e0 con 0x7fade015c3b0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7faddc001670 con 0x7fade015c3b0 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 >> v1:172.21.15.134:6789/0 conn(0x7fade015c3b0 legacy=0x7fade0073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fadcc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004800 0x7fadcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc0051c0 0x7fadcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fade0161030 con 0x7fadcc0039b0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc00c0f0 con 0x7fadcc004800 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc00c2f0 con 0x7fadcc0051c0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fadcc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade4941640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004800 0x7fadcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5943640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc0051c0 0x7fadcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 -- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc0051c0 msgr2=0x7fadcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc0051c0 0x7fadcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 -- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004800 msgr2=0x7fadcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004800 0x7fadcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5142640 1 -- 172.21.15.134:0/3543442384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc003520 con 0x7fadcc0039b0 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.294+0000 7fade5943640 1 -- 172.21.15.134:0/3543442384 reap_dead start 2024-09-15T22:45:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.295+0000 7fade5142640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fadcc003db0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faddc00c210 tx=0x7fadcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a20136e574d000 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.295+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc007d10 con 0x7fadcc0039b0 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.295+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc005ad0 con 0x7fadcc0039b0 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.295+0000 7fadd7fff640 1 -- 172.21.15.134:0/3543442384 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc007070 con 0x7fadcc0039b0 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 -- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 msgr2=0x7fadcc003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fadcc003db0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faddc00c210 tx=0x7fadcc005830 comp rx=0 tx=0).stop 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 -- 172.21.15.134:0/3543442384 shutdown_connections 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 --2- 172.21.15.134:0/3543442384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fadcc003db0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 -- 172.21.15.134:0/3543442384 >> 172.21.15.134:0/3543442384 conn(0x7fade00b4300 msgr2=0x7fade00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 -- 172.21.15.134:0/3543442384 shutdown_connections 2024-09-15T22:45:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.296+0000 7fade73a6640 1 -- 172.21.15.134:0/3543442384 wait complete. 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.297+0000 7fade73a6640 1 Processor -- start 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.297+0000 7fade73a6640 1 -- start start 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade00c82d0 0x7fade00b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 0x7fade01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fade0160060 con 0x7fadcc0039b0 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fade01601e0 con 0x7fade0155d50 2024-09-15T22:45:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fade015c790 con 0x7fade00c82d0 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39054/0 (socket says 172.21.15.134:39054) 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 -- 172.21.15.134:0/2694166807 learned_addr learned my addr 172.21.15.134:0/2694166807 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade4941640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade00c82d0 0x7fade00b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5943640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 0x7fade01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 -- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade00c82d0 msgr2=0x7fade00b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade00c82d0 0x7fade00b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 -- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 msgr2=0x7fade01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 0x7fade01561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 -- 172.21.15.134:0/2694166807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade006ce30 con 0x7fadcc0039b0 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5943640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 0x7fade01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade5142640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faddc02add0 tx=0x7fade01605f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc040020 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc001630 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00b78f0 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.298+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc037040 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.299+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade00c8b30 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.300+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade00b6780 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.300+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7faddc043020 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.301+0000 7fadd5ffb640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 0x7fadc406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.301+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7faddc0ab0e0 con 0x7fadcc0039b0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.301+0000 7fade4941640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 0x7fadc406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.301+0000 7fade4941640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 0x7fadc406e890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade0157c00 tx=0x7fadd0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.305+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faddc0797d0 con 0x7fadcc0039b0 2024-09-15T22:45:28.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.503+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade00cf1f0 con 0x7fadcc0039b0 2024-09-15T22:45:28.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.504+0000 7fadd5ffb640 1 -- 172.21.15.134:0/2694166807 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5234 (secure 0 0 0) 0x7faddc0790d0 con 0x7fadcc0039b0 2024-09-15T22:45:28.505 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:28.506 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":43,"btime":"2024-09-15T22:45:26:527976+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3275361990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3275361990},{"type":"v1","addr":"172.21.15.177:6834","nonce":3275361990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:28.506 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 43 2024-09-15T22:45:28.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 msgr2=0x7fadc406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 0x7fadc406e890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade0157c00 tx=0x7fadd0008040 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 msgr2=0x7fade0150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faddc02add0 tx=0x7fade01605f0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 shutdown_connections 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade0155d50 0x7fade01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade00c82d0 0x7fade00b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadc406c3d0 0x7fadc406e890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 --2- 172.21.15.134:0/2694166807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc0039b0 0x7fade0150cb0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 >> 172.21.15.134:0/2694166807 conn(0x7fade00b4300 msgr2=0x7fade0158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 shutdown_connections 2024-09-15T22:45:28.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:28.506+0000 7fade73a6640 1 -- 172.21.15.134:0/2694166807 wait complete. 2024-09-15T22:45:28.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:45:23.858674+0000', 'modified': '2024-09-15T22:45:25.852604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6534}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6534': {'gid': 6534, 'name': 'a', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/1978323940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6825', 'nonce': 1978323940}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1978323940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6534, 'qdb_cluster': [6534]} 2024-09-15T22:45:28.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:45:28.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.025+0000 7fb3d80af640 1 Processor -- start 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.025+0000 7fb3d80af640 1 -- start start 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d80af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d80af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d80af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d00ce150 con 0x7fb3d00b65c0 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d80af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d00b08a0 con 0x7fb3d00aff30 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d80af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00ce430 con 0x7fb3d0156880 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d5e4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d664c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d5e4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:48468/0 (socket says 172.21.15.134:48468) 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d564a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb3d00b65c0 0x7fb3d0160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:37058/0 (socket says 172.21.15.134:37058) 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d664c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:44182/0 (socket says 172.21.15.134:44182) 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.026+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/383928923 learned_addr learned my addr 172.21.15.134:0/383928923 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/383928923 >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 msgr2=0x7fb3d00b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/383928923 >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/383928923 >> v1:172.21.15.177:6789/0 conn(0x7fb3d00b65c0 legacy=0x7fb3d0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/383928923 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d015ff30 con 0x7fb3d0156880 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d664c640 1 --2- 172.21.15.134:0/383928923 >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.027+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/383928923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009870 tx=0x7fb3cc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff06ff484cabbc30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d4e49640 1 -- 172.21.15.134:0/383928923 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc037070 con 0x7fb3d0156880 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d4e49640 1 -- 172.21.15.134:0/383928923 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc032440 con 0x7fb3d0156880 2024-09-15T22:45:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d4e49640 1 -- 172.21.15.134:0/383928923 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032810 con 0x7fb3d0156880 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 -- 172.21.15.134:0/383928923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 msgr2=0x7fb3d00cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 --2- 172.21.15.134:0/383928923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009870 tx=0x7fb3cc02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 -- 172.21.15.134:0/383928923 shutdown_connections 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 --2- 172.21.15.134:0/383928923 >> v2:172.21.15.177:3300/0 conn(0x7fb3d00aff30 0x7fb3d00b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 --2- 172.21.15.134:0/383928923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d0156880 0x7fb3d00cdae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 -- 172.21.15.134:0/383928923 >> 172.21.15.134:0/383928923 conn(0x7fb3d006cae0 msgr2=0x7fb3d006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 -- 172.21.15.134:0/383928923 shutdown_connections 2024-09-15T22:45:29.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.028+0000 7fb3d80af640 1 -- 172.21.15.134:0/383928923 wait complete. 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.029+0000 7fb3d80af640 1 Processor -- start 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.029+0000 7fb3d80af640 1 -- start start 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d00aff30 0x7fb3d00af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d00b65c0 0x7fb3d0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00b6a00 con 0x7fb3d0156880 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d0156c60 con 0x7fb3d00aff30 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d80af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00ce710 con 0x7fb3d00b65c0 2024-09-15T22:45:29.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39062/0 (socket says 172.21.15.134:39062) 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.030+0000 7fb3d664c640 1 -- 172.21.15.134:0/2211425343 learned_addr learned my addr 172.21.15.134:0/2211425343 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d00aff30 0x7fb3d00af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d564a640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d00b65c0 0x7fb3d0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 -- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d00b65c0 msgr2=0x7fb3d0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d00b65c0 0x7fb3d0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 -- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d00aff30 msgr2=0x7fb3d00af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d00aff30 0x7fb3d00af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 -- 172.21.15.134:0/2211425343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d0155f40 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d664c640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800efc0 tx=0x7fb3c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3c67fc640 1 -- 172.21.15.134:0/2211425343 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8018030 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3c67fc640 1 -- 172.21.15.134:0/2211425343 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c800cdf0 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d01594e0 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3c67fc640 1 -- 172.21.15.134:0/2211425343 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8003bb0 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.031+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d00b4300 con 0x7fb3d0156880 2024-09-15T22:45:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.033+0000 7fb3c67fc640 1 -- 172.21.15.134:0/2211425343 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fb3c801b070 con 0x7fb3d0156880 2024-09-15T22:45:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.033+0000 7fb3c67fc640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 0x7fb3b406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.033+0000 7fb3c67fc640 1 -- 172.21.15.134:0/2211425343 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c808c100 con 0x7fb3d0156880 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.033+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 0x7fb3b406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.034+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 0x7fb3b406e890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.034+0000 7fb3dae42740 1 Processor -- start 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.034+0000 7fb3dae42740 1 -- start start 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223773a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559223690520 con 0x55922372ba80 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5592236383e0 con 0x55922372fa50 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55922368c4e0 con 0x55922372e2c0 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39072/0 (socket says 172.21.15.134:39072) 2024-09-15T22:45:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 -- 172.21.15.134:0/3514352429 learned_addr learned my addr 172.21.15.134:0/3514352429 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223773a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d664c640 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 -- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 msgr2=0x559223773a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223773a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 -- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 msgr2=0x5592237288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237288b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 -- 172.21.15.134:0/3514352429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592236532f0 con 0x55922372ba80 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0005cc0 tx=0x7fb3c0007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ade354ff983b656 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3b37fe640 1 -- 172.21.15.134:0/3514352429 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0019070 con 0x55922372ba80 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3b37fe640 1 -- 172.21.15.134:0/3514352429 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0001700 con 0x55922372ba80 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.035+0000 7fb3b37fe640 1 -- 172.21.15.134:0/3514352429 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0001ab0 con 0x55922372ba80 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 -- 172.21.15.134:0/3514352429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 msgr2=0x55922372e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0005cc0 tx=0x7fb3c0007420 comp rx=0 tx=0).stop 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 -- 172.21.15.134:0/3514352429 shutdown_connections 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372ba80 0x55922372e6a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3514352429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223773a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 -- 172.21.15.134:0/3514352429 >> 172.21.15.134:0/3514352429 conn(0x55922372aa80 msgr2=0x559223772f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 -- 172.21.15.134:0/3514352429 shutdown_connections 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.036+0000 7fb3dae42740 1 -- 172.21.15.134:0/3514352429 wait complete. 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.037+0000 7fb3dae42740 1 -- start start 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.037+0000 7fb3dae42740 1 Processor -- start 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223786970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x559223752bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559223729f20 con 0x5592237592e0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559223619450 con 0x55922372fa50 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x559223774290 con 0x55922372e2c0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 10 client.0 _ll_register_callbacks cb 0x5592233a2ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39082/0 (socket says 172.21.15.134:39082) 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 -- 172.21.15.134:0/712443762 learned_addr learned my addr 172.21.15.134:0/712443762 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223786970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d564a640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x559223752bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 -- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 msgr2=0x559223786970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223786970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 -- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 msgr2=0x559223752bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x559223752bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 -- 172.21.15.134:0/712443762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592233a32d0 con 0x5592237592e0 2024-09-15T22:45:29.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d564a640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x559223752bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223786970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3d664c640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800c990 tx=0x7fb3c805a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02916413264d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80595a0 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c8055ca0 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c0001700 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.038+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb3c8055ec0 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 10 client.6663 fetch_fsmap learned FSMap version 43 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55922346d6b0 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0001700 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7fb3c807a070 con 0x5592237592e0 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 10 client.6663 fetch_fsmap finished waiting for FSMap version 43 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 10 client.6663 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:29.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 20 client.6663 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223751870 0x559223751c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 4 client.6663 mds_command: new command op to 6534 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 --> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55922369dc50 con 0x559223751870 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223751870 0x559223751c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223751870 0x559223751c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8b10fe9de7e54b server_cookie=4e2411bf0b8334f6 in_seq=0 out_seq=0 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.039+0000 7fb3b0ff9640 10 client.6663 ms_handle_connect on v2:172.21.15.134:6825/1978323940 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/712443762 <== mds.0 v2:172.21.15.134:6825/1978323940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55922369dc50 con 0x559223751870 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3b0ff9640 10 client.6663 handle_command_reply: tid=0 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 client.6663 shutdown 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 msgr2=0x559223750dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800c990 tx=0x7fb3c805a090 comp rx=0 tx=0).stop 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 shutdown_connections 2024-09-15T22:45:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223751870 0x559223751c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223750dd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x559223752bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3b0ff9640 0 client.6663 ms_handle_reset on v2:172.21.15.134:6825/1978323940 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 --2- 172.21.15.134:0/712443762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223786970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 >> 172.21.15.134:0/712443762 conn(0x55922372ba80 msgr2=0x559223776160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 shutdown_connections 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 1 -- 172.21.15.134:0/712443762 wait complete. 2024-09-15T22:45:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.040+0000 7fb3dae42740 20 client.6663 trim_cache size 0 max 16384 2024-09-15T22:45:29.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.058+0000 7fb3dae42740 1 Processor -- start 2024-09-15T22:45:29.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.058+0000 7fb3dae42740 1 -- start start 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223774a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d01ffc70 con 0x5592237592e0 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d0068710 con 0x55922372fa50 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d015b890 con 0x55922372e2c0 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39084/0 (socket says 172.21.15.134:39084) 2024-09-15T22:45:29.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 -- 172.21.15.134:0/1762312983 learned_addr learned my addr 172.21.15.134:0/1762312983 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d564a640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223774a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 -- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 msgr2=0x559223774a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223774a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 -- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 msgr2=0x5592237868c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237868c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 -- 172.21.15.134:0/1762312983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592237599f0 con 0x5592237592e0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d564a640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237868c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3d664c640 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801d000 tx=0x7fb3c8071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5251d6b42c878711 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3b2ffd640 1 -- 172.21.15.134:0/1762312983 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8081070 con 0x5592237592e0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3b2ffd640 1 -- 172.21.15.134:0/1762312983 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c8088070 con 0x5592237592e0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.059+0000 7fb3b2ffd640 1 -- 172.21.15.134:0/1762312983 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80590a0 con 0x5592237592e0 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- 172.21.15.134:0/1762312983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 msgr2=0x559223751c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801d000 tx=0x7fb3c8071000 comp rx=0 tx=0).stop 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- 172.21.15.134:0/1762312983 shutdown_connections 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5592237592e0 0x559223751c50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x5592237868c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 --2- 172.21.15.134:0/1762312983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55922372e2c0 0x559223774a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- 172.21.15.134:0/1762312983 >> 172.21.15.134:0/1762312983 conn(0x55922372ba80 msgr2=0x5592237585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- 172.21.15.134:0/1762312983 shutdown_connections 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- 172.21.15.134:0/1762312983 wait complete. 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.060+0000 7fb3dae42740 1 -- start start 2024-09-15T22:45:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 Processor -- start 2024-09-15T22:45:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x55922376fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592237592e0 0x5592237f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5592237514a0 con 0x55922372e2c0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559223753340 con 0x55922372fa50 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5592237575c0 con 0x5592237592e0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.061+0000 7fb3dae42740 10 client.0 _ll_register_callbacks cb 0x7fb3c8009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39100/0 (socket says 172.21.15.134:39100) 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/3042985577 learned_addr learned my addr 172.21.15.134:0/3042985577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x55922376fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d664c640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592237592e0 0x5592237f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592237592e0 msgr2=0x5592237f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592237592e0 0x5592237f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 msgr2=0x55922376fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x55922376fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 -- 172.21.15.134:0/3042985577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559223752610 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3d5e4b640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0090b0 tx=0x7fb3cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b682f843c6fee29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc037040 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fb3cc032b90 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c8088070 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb3cc032d90 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3dae42740 10 client.6669 fetch_fsmap learned FSMap version 43 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55922375aa70 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c8088070 con 0x55922372e2c0 2024-09-15T22:45:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.062+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7fb3cc049070 con 0x55922372e2c0 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 10 client.6669 fetch_fsmap finished waiting for FSMap version 43 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 10 client.6669 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 20 client.6669 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223771640 0x559223772860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 4 client.6669 mds_command: new command op to 6534 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 --> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] -- command(tid 0: {"prefix": "status"}) -- 0x559223697fa0 con 0x559223771640 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223771640 0x559223772860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3b0ff9640 10 client.6669 ms_handle_connect on v2:172.21.15.134:6825/1978323940 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3d564a640 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223771640 0x559223772860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ac53fe00cb670a3 server_cookie=c482e6fa4a0c0c53 in_seq=0 out_seq=0 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3b0ff9640 1 -- 172.21.15.134:0/3042985577 <== mds.0 v2:172.21.15.134:6825/1978323940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559223697fa0 con 0x559223771640 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3b0ff9640 10 client.6669 handle_command_reply: tid=0 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 client.6669 shutdown 2024-09-15T22:45:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 msgr2=0x55922372c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0090b0 tx=0x7fb3cc004730 comp rx=0 tx=0).stop 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 shutdown_connections 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:6825/1978323940,v1:172.21.15.134:6835/1978323940] conn(0x559223771640 0x559223772860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592237592e0 0x5592237f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922372fa50 0x55922376fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 --2- 172.21.15.134:0/3042985577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55922372e2c0 0x55922372c7a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3b0ff9640 0 client.6669 ms_handle_reset on v2:172.21.15.134:6825/1978323940 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 >> 172.21.15.134:0/3042985577 conn(0x55922372ba80 msgr2=0x559223797130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 shutdown_connections 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.063+0000 7fb3dae42740 1 -- 172.21.15.134:0/3042985577 wait complete. 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3dae42740 20 client.6669 trim_cache size 0 max 16384 2024-09-15T22:45:29.071 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 6534, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 4.5417540819999997, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 43, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 88, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 88, 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 8.8679383190000003 2024-09-15T22:45:29.072 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 msgr2=0x7fb3b406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 0x7fb3b406e890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 msgr2=0x7fb3d0155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800efc0 tx=0x7fb3c800c490 comp rx=0 tx=0).stop 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 shutdown_connections 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb3b406c3d0 0x7fb3b406e890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3d0156880 0x7fb3d0155a00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3d00b65c0 0x7fb3d0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 --2- 172.21.15.134:0/2211425343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d00aff30 0x7fb3d00af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 >> 172.21.15.134:0/2211425343 conn(0x7fb3d006cae0 msgr2=0x7fb3d015e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 shutdown_connections 2024-09-15T22:45:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.064+0000 7fb3d80af640 1 -- 172.21.15.134:0/2211425343 wait complete. 2024-09-15T22:45:29.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:45:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.174+0000 7fb255e27640 1 Processor -- start 2024-09-15T22:45:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.174+0000 7fb255e27640 1 -- start start 2024-09-15T22:45:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.174+0000 7fb255e27640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb25015f210 0x7fb2500ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.174+0000 7fb255e27640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb25015f5f0 0x7fb2500713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb255e27640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2500af960 con 0x7fb25015fa60 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb255e27640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb2500aee20 con 0x7fb25015f5f0 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb255e27640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb2500af0c0 con 0x7fb25015f210 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb25015f5f0 0x7fb2500713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb25015f5f0 0x7fb2500713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39104/0 (socket says 172.21.15.134:39104) 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 -- 172.21.15.134:0/1618178438 learned_addr learned my addr 172.21.15.134:0/1618178438 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb25015fa60 0x7fb250162390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47726/0 (socket says 172.21.15.134:47726) 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24f7fe640 1 --2- 172.21.15.134:0/1618178438 >> v2:172.21.15.177:3300/0 conn(0x7fb25015f210 0x7fb2500ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 -- 172.21.15.134:0/1618178438 >> v2:172.21.15.177:3300/0 conn(0x7fb25015f210 msgr2=0x7fb2500ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 --2- 172.21.15.134:0/1618178438 >> v2:172.21.15.177:3300/0 conn(0x7fb25015f210 0x7fb2500ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 -- 172.21.15.134:0/1618178438 >> v1:172.21.15.134:6789/0 conn(0x7fb25015fa60 legacy=0x7fb250162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.175+0000 7fb24effd640 1 -- 172.21.15.134:0/1618178438 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2500af3a0 con 0x7fb25015f5f0 2024-09-15T22:45:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb24effd640 1 --2- 172.21.15.134:0/1618178438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015f5f0 0x7fb2500713c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb2500b31f0 tx=0x7fb24402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e95ef1d10b49ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb24e7fc640 1 -- 172.21.15.134:0/1618178438 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244037070 con 0x7fb25015f5f0 2024-09-15T22:45:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb24e7fc640 1 -- 172.21.15.134:0/1618178438 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb244032440 con 0x7fb25015f5f0 2024-09-15T22:45:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb24e7fc640 1 -- 172.21.15.134:0/1618178438 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244032810 con 0x7fb25015f5f0 2024-09-15T22:45:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 -- 172.21.15.134:0/1618178438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015f5f0 msgr2=0x7fb2500713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 --2- 172.21.15.134:0/1618178438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015f5f0 0x7fb2500713c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb2500b31f0 tx=0x7fb24402a270 comp rx=0 tx=0).stop 2024-09-15T22:45:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 -- 172.21.15.134:0/1618178438 shutdown_connections 2024-09-15T22:45:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 --2- 172.21.15.134:0/1618178438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015f5f0 0x7fb2500713c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 --2- 172.21.15.134:0/1618178438 >> v2:172.21.15.177:3300/0 conn(0x7fb25015f210 0x7fb2500ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 -- 172.21.15.134:0/1618178438 >> 172.21.15.134:0/1618178438 conn(0x7fb2500b2480 msgr2=0x7fb2500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 -- 172.21.15.134:0/1618178438 shutdown_connections 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.176+0000 7fb255e27640 1 -- 172.21.15.134:0/1618178438 wait complete. 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.177+0000 7fb255e27640 1 Processor -- start 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 -- start start 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 0x7fb2501e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb25015f5f0 0x7fb25014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb25006ea20 con 0x7fb25015fa60 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb25006d4f0 con 0x7fb25015f5f0 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.178+0000 7fb255e27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb25006eba0 con 0x7fb25015f210 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39114/0 (socket says 172.21.15.134:39114) 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 -- 172.21.15.134:0/3386818722 learned_addr learned my addr 172.21.15.134:0/3386818722 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24effd640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb25015f5f0 0x7fb25014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24f7fe640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 0x7fb2501e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 -- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 msgr2=0x7fb2501e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 0x7fb2501e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 -- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb25015f5f0 msgr2=0x7fb25014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb25015f5f0 0x7fb25014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 -- 172.21.15.134:0/3386818722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25015b250 con 0x7fb25015fa60 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24f7fe640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 0x7fb2501e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb24ffff640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c6c0 tx=0x7fb24800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248018070 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb248004d60 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24800a840 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25015b530 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.179+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25015baf0 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.180+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2500ae8e0 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.181+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fb24801b070 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.181+0000 7fb237fff640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 0x7fb23c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.181+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fb24808aa80 con 0x7fb25015fa60 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.181+0000 7fb24f7fe640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 0x7fb23c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.182+0000 7fb24f7fe640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 0x7fb23c06e890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb240006fd0 tx=0x7fb240008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.185+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb248058a90 con 0x7fb25015fa60 2024-09-15T22:45:29.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.386+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2500762b0 con 0x7fb25015fa60 2024-09-15T22:45:29.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.386+0000 7fb237fff640 1 -- 172.21.15.134:0/3386818722 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7fb24805cd90 con 0x7fb25015fa60 2024-09-15T22:45:29.388 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:45:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 msgr2=0x7fb23c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 0x7fb23c06e890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb240006fd0 tx=0x7fb240008040 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 msgr2=0x7fb25015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c6c0 tx=0x7fb24800cb80 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 shutdown_connections 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb23c06c3d0 0x7fb23c06e890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb25015fa60 0x7fb25015aae0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb25015f5f0 0x7fb25014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 --2- 172.21.15.134:0/3386818722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb25015f210 0x7fb2501e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 >> 172.21.15.134:0/3386818722 conn(0x7fb2500b2480 msgr2=0x7fb2500d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 shutdown_connections 2024-09-15T22:45:29.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29.388+0000 7fb255e27640 1 -- 172.21.15.134:0/3386818722 wait complete. 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:29.400 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:45:29.401 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:45:29.401 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:29.401 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:29.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.401 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:45:29.417 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:45:29.418 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42564sec preferred_lft 42564sec 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:45:29.419 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.420 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:29.481 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:45:29.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.483 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:45:29.541 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:45:29.541 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:29.541 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:29.541 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:29.541 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:29.542 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:45:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:29.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:29.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.667 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:45:29.683 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:45:29.683 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:45:29.683 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:29.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:45:29.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:29.749 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:29.805 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:29.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:29.806 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:29.860 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:45:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:29.943 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:29.944 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:29.944 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:29.957 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:45:29.958 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:45:29.961 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:45:29.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:29.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:30.026 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:30.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:30.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:30.127 INFO:teuthology.orchestra.run.smithi134.stdout:client6109 2024-09-15T22:45:30.127 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:30.127 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:30.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:45:30.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.281+0000 7f9c3620e640 1 Processor -- start 2024-09-15T22:45:30.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.281+0000 7f9c3620e640 1 -- start start 2024-09-15T22:45:30.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c3620e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9c300cf070 0x7f9c300cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c3620e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9c30073120 0x7f9c30073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c3620e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c300ce740 con 0x7f9c3015c180 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c3620e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30072640 con 0x7f9c30073120 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c3620e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30072920 con 0x7f9c300cf070 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9c30073120 0x7f9c30073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9c3015c180 0x7f9c300cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47740/0 (socket says 172.21.15.134:47740) 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9c30073120 0x7f9c30073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39120/0 (socket says 172.21.15.134:39120) 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2f7fe640 1 -- 172.21.15.134:0/2553646185 learned_addr learned my addr 172.21.15.134:0/2553646185 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 -- 172.21.15.134:0/2553646185 >> v2:172.21.15.177:3300/0 conn(0x7f9c300cf070 msgr2=0x7f9c300cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 --2- 172.21.15.134:0/2553646185 >> v2:172.21.15.177:3300/0 conn(0x7f9c300cf070 0x7f9c300cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 -- 172.21.15.134:0/2553646185 >> v1:172.21.15.134:6789/0 conn(0x7f9c3015c180 legacy=0x7f9c300cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2ffff640 1 -- 172.21.15.134:0/2553646185 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30072c00 con 0x7f9c30073120 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.282+0000 7f9c2e7fc640 1 -- 172.21.15.134:0/2553646185 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801168231 0 0) 0x7f9c300ce740 con 0x7f9c3015c180 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.283+0000 7f9c2ffff640 1 --2- 172.21.15.134:0/2553646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c30073120 0x7f9c30073560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006f430 tx=0x7f9c2802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692fa91acb51254c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.283+0000 7f9c2e7fc640 1 -- 172.21.15.134:0/2553646185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28007740 con 0x7f9c30073120 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.283+0000 7f9c2e7fc640 1 -- 172.21.15.134:0/2553646185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c280078e0 con 0x7f9c30073120 2024-09-15T22:45:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.283+0000 7f9c2e7fc640 1 -- 172.21.15.134:0/2553646185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28007cb0 con 0x7f9c30073120 2024-09-15T22:45:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 -- 172.21.15.134:0/2553646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c30073120 msgr2=0x7f9c30073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 --2- 172.21.15.134:0/2553646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c30073120 0x7f9c30073560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006f430 tx=0x7f9c2802a5f0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 -- 172.21.15.134:0/2553646185 shutdown_connections 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 --2- 172.21.15.134:0/2553646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c30073120 0x7f9c30073560 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 --2- 172.21.15.134:0/2553646185 >> v2:172.21.15.177:3300/0 conn(0x7f9c300cf070 0x7f9c300cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 -- 172.21.15.134:0/2553646185 >> 172.21.15.134:0/2553646185 conn(0x7f9c30062cc0 msgr2=0x7f9c3006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 -- 172.21.15.134:0/2553646185 shutdown_connections 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.284+0000 7f9c3620e640 1 -- 172.21.15.134:0/2553646185 wait complete. 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.285+0000 7f9c3620e640 1 Processor -- start 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.285+0000 7f9c3620e640 1 -- start start 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 0x7f9c300b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 0x7f9c30152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c300722f0 con 0x7f9c300cf070 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9c300ced00 con 0x7f9c3015c180 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3015c560 con 0x7f9c30073120 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39130/0 (socket says 172.21.15.134:39130) 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 -- 172.21.15.134:0/4032613060 learned_addr learned my addr 172.21.15.134:0/4032613060 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2f7fe640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 0x7f9c300b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2ffff640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 0x7f9c30152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 -- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 msgr2=0x7f9c300b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 0x7f9c300b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 -- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 msgr2=0x7f9c30152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 0x7f9c30152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 -- 172.21.15.134:0/4032613060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30152650 con 0x7f9c300cf070 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2f7fe640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 0x7f9c300b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2ffff640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 0x7f9c30152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c2effd640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400b450 tx=0x7f9c2400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24015020 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24011890 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3015dc90 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.286+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24011c80 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.287+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3015e4f0 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.287+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c300cf4e0 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.288+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f9c24018020 con 0x7f9c300cf070 2024-09-15T22:45:30.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.288+0000 7f9c17fff640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 0x7f9c1c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.288+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f9c2408b720 con 0x7f9c300cf070 2024-09-15T22:45:30.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.289+0000 7f9c2f7fe640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 0x7f9c1c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.289+0000 7f9c2f7fe640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 0x7f9c1c06e890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c20000f60 tx=0x7f9c20007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.292+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c2401f020 con 0x7f9c300cf070 2024-09-15T22:45:30.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.492+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9c3015b9a0 con 0x7f9c300cf070 2024-09-15T22:45:30.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.492+0000 7f9c17fff640 1 -- 172.21.15.134:0/4032613060 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7f9c30152650 con 0x7f9c300cf070 2024-09-15T22:45:30.494 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 msgr2=0x7f9c1c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 0x7f9c1c06e890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c20000f60 tx=0x7f9c20007ca0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 msgr2=0x7f9c3015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400b450 tx=0x7f9c2400b910 comp rx=0 tx=0).stop 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 shutdown_connections 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3015c180 0x7f9c30152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c1c06c3d0 0x7f9c1c06e890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300cf070 0x7f9c3015efb0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 --2- 172.21.15.134:0/4032613060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c30073120 0x7f9c300b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 >> 172.21.15.134:0/4032613060 conn(0x7f9c30062cc0 msgr2=0x7f9c300cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 shutdown_connections 2024-09-15T22:45:30.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:30.494+0000 7f9c3620e640 1 -- 172.21.15.134:0/4032613060 wait complete. 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:30.507 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:30.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.507 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:45:30.516 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:45:30.515+0000 7ff63ab70640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:30.528 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:30.529 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42552sec preferred_lft 42552sec 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.530 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:30.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.531 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:30.596 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:45:30.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.598 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:45:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:45:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:30.658 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:45:30.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:30.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:30.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.788 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:45:30.804 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:45:30.804 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:45:30.805 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:30.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.805 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:45:30.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:30.871 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:30.926 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:45:30.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:30.926 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:30.981 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:45:30.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:30.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:31.064 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:31.064 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:31.064 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:45:31.078 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:45:31.079 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:45:31.079 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:45:31.079 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:45:31.079 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:45:31.079 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:45:31.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:45:31.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:31.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:31.146 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:31.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:45:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:31.242 INFO:teuthology.orchestra.run.smithi177.stdout:client6690 2024-09-15T22:45:31.242 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:31.242 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:31.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:45:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.371+0000 7f6d0122e640 1 Processor -- start 2024-09-15T22:45:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.372+0000 7f6d0122e640 1 -- start start 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.372+0000 7f6d0122e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cfc0b49a0 0x7f6cfc169400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.372+0000 7f6d0122e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0740b0 con 0x7f6cfc15e840 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.372+0000 7f6d0122e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc06cf00 con 0x7f6cfc073bb0 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.372+0000 7f6d0122e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc0b1da0 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfb59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cfc0b49a0 0x7f6cfc169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6cfc15e840 0x7f6cfc073250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47748/0 (socket says 172.21.15.134:47748) 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfb59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cfc0b49a0 0x7f6cfc169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39132/0 (socket says 172.21.15.134:39132) 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfad9d640 1 -- 172.21.15.134:0/2545601074 learned_addr learned my addr 172.21.15.134:0/2545601074 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:31.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfb59e640 1 -- 172.21.15.134:0/2545601074 >> v1:172.21.15.177:6789/0 conn(0x7f6cfc073bb0 legacy=0x7f6cfc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfb59e640 1 -- 172.21.15.134:0/2545601074 >> v1:172.21.15.134:6789/0 conn(0x7f6cfc15e840 legacy=0x7f6cfc073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.373+0000 7f6cfb59e640 1 -- 172.21.15.134:0/2545601074 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc06d1e0 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6cfb59e640 1 --2- 172.21.15.134:0/2545601074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc169400 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2ace874c0fcaaf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6cf9d9b640 1 -- 172.21.15.134:0/2545601074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4031600 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6cf9d9b640 1 -- 172.21.15.134:0/2545601074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf40317a0 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6cf9d9b640 1 -- 172.21.15.134:0/2545601074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4031b70 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 -- 172.21.15.134:0/2545601074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc0b49a0 msgr2=0x7f6cfc169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 --2- 172.21.15.134:0/2545601074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc169400 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 -- 172.21.15.134:0/2545601074 shutdown_connections 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 --2- 172.21.15.134:0/2545601074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc169400 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 -- 172.21.15.134:0/2545601074 >> 172.21.15.134:0/2545601074 conn(0x7f6cfc062630 msgr2=0x7f6cfc062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 -- 172.21.15.134:0/2545601074 shutdown_connections 2024-09-15T22:45:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.374+0000 7f6d0122e640 1 -- 172.21.15.134:0/2545601074 wait complete. 2024-09-15T22:45:31.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.376+0000 7f6d0122e640 1 Processor -- start 2024-09-15T22:45:31.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.376+0000 7f6d0122e640 1 -- start start 2024-09-15T22:45:31.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cfc073bb0 0x7f6cfc1f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc06d550 con 0x7f6cfc15e840 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc06ccb0 con 0x7f6cfc0b49a0 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6d0122e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc06e9f0 con 0x7f6cfc073bb0 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39148/0 (socket says 172.21.15.134:39148) 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 -- 172.21.15.134:0/1906946885 learned_addr learned my addr 172.21.15.134:0/1906946885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfa59c640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfad9d640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cfc073bb0 0x7f6cfc1f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 -- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cfc073bb0 msgr2=0x7f6cfc1f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cfc073bb0 0x7f6cfc1f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 -- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0b49a0 msgr2=0x7f6cfc161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 -- 172.21.15.134:0/1906946885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc1f7860 con 0x7f6cfc15e840 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6cfb59e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009eb0 tx=0x7f6cf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4040070 con 0x7f6cfc15e840 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.377+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4030b60 con 0x7f6cfc15e840 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.378+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1f8580 con 0x7f6cfc15e840 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.378+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4045460 con 0x7f6cfc15e840 2024-09-15T22:45:31.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.378+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc161b80 con 0x7f6cfc15e840 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.379+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc0b4290 con 0x7f6cfc15e840 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.379+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f6cf4039040 con 0x7f6cfc15e840 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.380+0000 7f6ce37fe640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 0x7f6ce806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.380+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f6cf40acf20 con 0x7f6cfc15e840 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.380+0000 7f6cfad9d640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 0x7f6ce806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.380+0000 7f6cfad9d640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 0x7f6ce806e890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6cec005880 tx=0x7f6cec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:31.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.384+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cf407b510 con 0x7f6cfc15e840 2024-09-15T22:45:31.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:31.587+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f6cfc0d2f50 con 0x7f6cfc15e840 2024-09-15T22:45:32.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.556+0000 7f6ce37fe640 1 -- 172.21.15.134:0/1906946885 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v44) ==== 136+0+0 (secure 0 0 0) 0x7f6cf4043e40 con 0x7f6cfc15e840 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 msgr2=0x7f6ce806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 0x7f6ce806e890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6cec005880 tx=0x7f6cec009040 comp rx=0 tx=0).stop 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 msgr2=0x7f6cfc151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009eb0 tx=0x7f6cf4004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 shutdown_connections 2024-09-15T22:45:32.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ce806c3d0 0x7f6ce806e890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cfc15e840 0x7f6cfc151e00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cfc0b49a0 0x7f6cfc161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 --2- 172.21.15.134:0/1906946885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cfc073bb0 0x7f6cfc1f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.558+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 >> 172.21.15.134:0/1906946885 conn(0x7f6cfc062630 msgr2=0x7f6cfc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.559+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 shutdown_connections 2024-09-15T22:45:32.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.559+0000 7f6d0122e640 1 -- 172.21.15.134:0/1906946885 wait complete. 2024-09-15T22:45:32.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:45:32.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.675+0000 7fca233cd640 1 Processor -- start 2024-09-15T22:45:32.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.675+0000 7fca233cd640 1 -- start start 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca233cd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 0x7fca1c162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca233cd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fca1c15eff0 0x7fca1c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca233cd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c15f520 con 0x7fca1c15ebb0 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca233cd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c15fae0 con 0x7fca1c15eff0 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca233cd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c15f800 con 0x7fca1c162860 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca2196a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fca1c15eff0 0x7fca1c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca20968640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fca1c15ebb0 0x7fca1c0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47752/0 (socket says 172.21.15.134:47752) 2024-09-15T22:45:32.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.676+0000 7fca20968640 1 -- 172.21.15.134:0/2109644262 learned_addr learned my addr 172.21.15.134:0/2109644262 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca21169640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 0x7fca1c162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca2196a640 1 -- 172.21.15.134:0/2109644262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 msgr2=0x7fca1c162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca2196a640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 0x7fca1c162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca2196a640 1 -- 172.21.15.134:0/2109644262 >> v1:172.21.15.134:6789/0 conn(0x7fca1c15ebb0 legacy=0x7fca1c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca2196a640 1 -- 172.21.15.134:0/2109644262 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c0b2b00 con 0x7fca1c15eff0 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca1bfff640 1 -- 172.21.15.134:0/2109644262 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007918656 0 0) 0x7fca1c15f520 con 0x7fca1c15ebb0 2024-09-15T22:45:32.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca21169640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 0x7fca1c162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:32.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca2196a640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15eff0 0x7fca1c06bba0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fca140097a0 tx=0x7fca1402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6bdb22f45403b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:32.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca1bfff640 1 -- 172.21.15.134:0/2109644262 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14037070 con 0x7fca1c15eff0 2024-09-15T22:45:32.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.677+0000 7fca1bfff640 1 -- 172.21.15.134:0/2109644262 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1402ae50 con 0x7fca1c15eff0 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca1bfff640 1 -- 172.21.15.134:0/2109644262 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14032660 con 0x7fca1c15eff0 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 -- 172.21.15.134:0/2109644262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15eff0 msgr2=0x7fca1c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15eff0 0x7fca1c06bba0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fca140097a0 tx=0x7fca1402a100 comp rx=0 tx=0).stop 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 -- 172.21.15.134:0/2109644262 shutdown_connections 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15eff0 0x7fca1c06bba0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 --2- 172.21.15.134:0/2109644262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c162860 0x7fca1c162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 -- 172.21.15.134:0/2109644262 >> 172.21.15.134:0/2109644262 conn(0x7fca1c06ce90 msgr2=0x7fca1c06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 -- 172.21.15.134:0/2109644262 shutdown_connections 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.678+0000 7fca233cd640 1 -- 172.21.15.134:0/2109644262 wait complete. 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.679+0000 7fca233cd640 1 Processor -- start 2024-09-15T22:45:32.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.679+0000 7fca233cd640 1 -- start start 2024-09-15T22:45:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 0x7fca1c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca1c162860 0x7fca1c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c06c0e0 con 0x7fca1c15ebb0 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c0b3a10 con 0x7fca1c162860 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca233cd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c06c260 con 0x7fca1c15eff0 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39164/0 (socket says 172.21.15.134:39164) 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 -- 172.21.15.134:0/3853020429 learned_addr learned my addr 172.21.15.134:0/3853020429 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca20968640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 0x7fca1c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 -- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 msgr2=0x7fca1c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca2196a640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca1c162860 0x7fca1c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 0x7fca1c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 -- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca1c162860 msgr2=0x7fca1c158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca1c162860 0x7fca1c158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca21169640 1 -- 172.21.15.134:0/3853020429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c1ead10 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.680+0000 7fca20968640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 0x7fca1c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca21169640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00ce00 tx=0x7fca0c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00f890 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c00fa30 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c1571c0 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00fe40 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.681+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c157780 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.682+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1c06bba0 con 0x7fca1c15ebb0 2024-09-15T22:45:32.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.682+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fca0c018400 con 0x7fca1c15ebb0 2024-09-15T22:45:32.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.683+0000 7fca19ffb640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 0x7fca0806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:32.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.683+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fca0c08c450 con 0x7fca1c15ebb0 2024-09-15T22:45:32.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.683+0000 7fca20968640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 0x7fca0806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:32.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.683+0000 7fca20968640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 0x7fca0806e8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca1c1eb030 tx=0x7fca10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:32.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.687+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca0c014030 con 0x7fca1c15ebb0 2024-09-15T22:45:32.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.875+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fca1c0af980 con 0x7fca0806c400 2024-09-15T22:45:32.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.877+0000 7fca19ffb640 1 -- 172.21.15.134:0/3853020429 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fca1c0af980 con 0x7fca0806c400 2024-09-15T22:45:32.879 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:45:32.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:32.879 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:45:32.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:32.879 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 msgr2=0x7fca0806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 0x7fca0806e8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca1c1eb030 tx=0x7fca10009040 comp rx=0 tx=0).stop 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 msgr2=0x7fca1c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00ce00 tx=0x7fca0c00a650 comp rx=0 tx=0).stop 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 shutdown_connections 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca1c162860 0x7fca1c158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca1c15eff0 0x7fca1c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fca0806c400 0x7fca0806e8c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 --2- 172.21.15.134:0/3853020429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c15ebb0 0x7fca1c154f40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 >> 172.21.15.134:0/3853020429 conn(0x7fca1c06ce90 msgr2=0x7fca1c0b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:32.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 shutdown_connections 2024-09-15T22:45:32.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.879+0000 7fca233cd640 1 -- 172.21.15.134:0/3853020429 wait complete. 2024-09-15T22:45:32.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:45:33.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.997+0000 7fab11d9d640 1 Processor -- start 2024-09-15T22:45:33.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.997+0000 7fab11d9d640 1 -- start start 2024-09-15T22:45:33.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab11d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c15c6f0 0x7fab0c0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab11d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab0c0b76f0 0x7fab0c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab11d9d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0c0cf5b0 con 0x7fab0c15c310 2024-09-15T22:45:33.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab11d9d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fab0c06f6b0 con 0x7fab0c0b76f0 2024-09-15T22:45:33.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab11d9d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c0cf890 con 0x7fab0c15c6f0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.998+0000 7fab1159c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab0c0b76f0 0x7fab0c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab0c0b76f0 0x7fab0c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39168/0 (socket says 172.21.15.134:39168) 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 -- 172.21.15.134:0/18328988 learned_addr learned my addr 172.21.15.134:0/18328988 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab0bfff640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c15c6f0 0x7fab0c0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 -- 172.21.15.134:0/18328988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c15c6f0 msgr2=0x7fab0c0ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c15c6f0 0x7fab0c0ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 -- 172.21.15.134:0/18328988 >> v1:172.21.15.177:6789/0 conn(0x7fab0c15c310 legacy=0x7fab0c15d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:32.999+0000 7fab1159c640 1 -- 172.21.15.134:0/18328988 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c0cfb70 con 0x7fab0c0b76f0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab1159c640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c0b76f0 0x7fab0c072fa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fab04009870 tx=0x7fab0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e3455dca344206 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab0b7fe640 1 -- 172.21.15.134:0/18328988 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04037070 con 0x7fab0c0b76f0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab0b7fe640 1 -- 172.21.15.134:0/18328988 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab04032440 con 0x7fab0c0b76f0 2024-09-15T22:45:33.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab0b7fe640 1 -- 172.21.15.134:0/18328988 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04032810 con 0x7fab0c0b76f0 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 -- 172.21.15.134:0/18328988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c0b76f0 msgr2=0x7fab0c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c0b76f0 0x7fab0c072fa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fab04009870 tx=0x7fab0402a250 comp rx=0 tx=0).stop 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 -- 172.21.15.134:0/18328988 shutdown_connections 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c0b76f0 0x7fab0c072fa0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 --2- 172.21.15.134:0/18328988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c15c6f0 0x7fab0c0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 -- 172.21.15.134:0/18328988 >> 172.21.15.134:0/18328988 conn(0x7fab0c062630 msgr2=0x7fab0c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 -- 172.21.15.134:0/18328988 shutdown_connections 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.000+0000 7fab11d9d640 1 -- 172.21.15.134:0/18328988 wait complete. 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.001+0000 7fab11d9d640 1 Processor -- start 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 -- start start 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c0b76f0 0x7fab0c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c15c6f0 0x7fab0c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c073660 con 0x7fab0c15c310 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c0734e0 con 0x7fab0c15c6f0 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab11d9d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c0737e0 con 0x7fab0c0b76f0 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.002+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39172/0 (socket says 172.21.15.134:39172) 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 -- 172.21.15.134:0/702647377 learned_addr learned my addr 172.21.15.134:0/702647377 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab1159c640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c15c6f0 0x7fab0c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab10d9b640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c0b76f0 0x7fab0c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 -- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c0b76f0 msgr2=0x7fab0c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c0b76f0 0x7fab0c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 -- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c15c6f0 msgr2=0x7fab0c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c15c6f0 0x7fab0c0c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 -- 172.21.15.134:0/702647377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c0c9d80 con 0x7fab0c15c310 2024-09-15T22:45:33.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab0bfff640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d7d0 tx=0x7faaf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4004020 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf40041e0 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c0c7530 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40043d0 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.003+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c0c7af0 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.004+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0c072fa0 con 0x7fab0c15c310 2024-09-15T22:45:33.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.005+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7faaf401b020 con 0x7fab0c15c310 2024-09-15T22:45:33.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.005+0000 7fab097fa640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 0x7faaec06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.005+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7faaf408b3b0 con 0x7fab0c15c310 2024-09-15T22:45:33.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.005+0000 7fab10d9b640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 0x7faaec06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.006+0000 7fab10d9b640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 0x7faaec06e890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faafc001ca0 tx=0x7faafc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.009+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaf4059a10 con 0x7fab0c15c310 2024-09-15T22:45:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.175+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fab0c15bac0 con 0x7fab0c15c310 2024-09-15T22:45:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.175+0000 7fab097fa640 1 -- 172.21.15.134:0/702647377 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7faaf4059310 con 0x7fab0c15c310 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 msgr2=0x7faaec06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 0x7faaec06e890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faafc001ca0 tx=0x7faafc009040 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 msgr2=0x7fab0c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d7d0 tx=0x7faaf400dc90 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 shutdown_connections 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c15c6f0 0x7fab0c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faaec06c3d0 0x7faaec06e890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab0c15c310 0x7fab0c14f750 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 --2- 172.21.15.134:0/702647377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab0c0b76f0 0x7fab0c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 >> 172.21.15.134:0/702647377 conn(0x7fab0c062630 msgr2=0x7fab0c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 shutdown_connections 2024-09-15T22:45:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.177+0000 7fab11d9d640 1 -- 172.21.15.134:0/702647377 wait complete. 2024-09-15T22:45:33.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-15T22:45:33.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.290+0000 7fa97f92c640 1 Processor -- start 2024-09-15T22:45:33.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.290+0000 7fa97f92c640 1 -- start start 2024-09-15T22:45:33.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97f92c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa978148020 0x7fa9780b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97f92c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa978148400 con 0x7fa9780b4b90 2024-09-15T22:45:33.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97f92c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9780b53e0 con 0x7fa9780ae8e0 2024-09-15T22:45:33.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97f92c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa9780b5ff0 con 0x7fa978148020 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97d6c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa978148020 0x7fa9780b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97cec7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa9780b4b90 0x7fa9780b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47756/0 (socket says 172.21.15.134:47756) 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97d6c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa978148020 0x7fa9780b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39174/0 (socket says 172.21.15.134:39174) 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97cec7640 1 -- 172.21.15.134:0/3470010321 learned_addr learned my addr 172.21.15.134:0/3470010321 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97d6c8640 1 -- 172.21.15.134:0/3470010321 >> v1:172.21.15.177:6789/0 conn(0x7fa9780ae8e0 legacy=0x7fa9780aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97d6c8640 1 -- 172.21.15.134:0/3470010321 >> v1:172.21.15.134:6789/0 conn(0x7fa9780b4b90 legacy=0x7fa9780b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa97d6c8640 1 -- 172.21.15.134:0/3470010321 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9780b56c0 con 0x7fa978148020 2024-09-15T22:45:33.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.291+0000 7fa96ffff640 1 -- 172.21.15.134:0/3470010321 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248710433 0 0) 0x7fa978148400 con 0x7fa9780b4b90 2024-09-15T22:45:33.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.292+0000 7fa97d6c8640 1 --2- 172.21.15.134:0/3470010321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978148020 0x7fa9780b0b30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa9740097a0 tx=0x7fa97402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf33a406b1dfd057 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.292+0000 7fa96ffff640 1 -- 172.21.15.134:0/3470010321 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974037070 con 0x7fa978148020 2024-09-15T22:45:33.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.292+0000 7fa96ffff640 1 -- 172.21.15.134:0/3470010321 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa974032440 con 0x7fa978148020 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.292+0000 7fa96ffff640 1 -- 172.21.15.134:0/3470010321 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974032810 con 0x7fa978148020 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 -- 172.21.15.134:0/3470010321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978148020 msgr2=0x7fa9780b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 --2- 172.21.15.134:0/3470010321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978148020 0x7fa9780b0b30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa9740097a0 tx=0x7fa97402a230 comp rx=0 tx=0).stop 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 -- 172.21.15.134:0/3470010321 shutdown_connections 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 --2- 172.21.15.134:0/3470010321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978148020 0x7fa9780b0b30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 -- 172.21.15.134:0/3470010321 >> 172.21.15.134:0/3470010321 conn(0x7fa97806d0d0 msgr2=0x7fa97806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 -- 172.21.15.134:0/3470010321 shutdown_connections 2024-09-15T22:45:33.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.293+0000 7fa97f92c640 1 -- 172.21.15.134:0/3470010321 wait complete. 2024-09-15T22:45:33.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.294+0000 7fa97f92c640 1 Processor -- start 2024-09-15T22:45:33.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.294+0000 7fa97f92c640 1 -- start start 2024-09-15T22:45:33.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9780ae8e0 0x7fa978144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9780b4b90 0x7fa97815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa978148020 0x7fa978142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780b5000 con 0x7fa9780b4b90 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780b5c80 con 0x7fa9780ae8e0 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa9780b5180 con 0x7fa978148020 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9780b4b90 0x7fa97815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9780b4b90 0x7fa97815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39176/0 (socket says 172.21.15.134:39176) 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 -- 172.21.15.134:0/708795065 learned_addr learned my addr 172.21.15.134:0/708795065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97d6c8640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9780ae8e0 0x7fa978144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97dec9640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa978148020 0x7fa978142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 -- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa978148020 msgr2=0x7fa978142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa978148020 0x7fa978142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 -- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9780ae8e0 msgr2=0x7fa978144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9780ae8e0 0x7fa978144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 -- 172.21.15.134:0/708795065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781436b0 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97cec7640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9780b4b90 0x7fa97815ddd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c4a0 tx=0x7fa96800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968018070 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680074e0 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 -- 172.21.15.134:0/708795065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa978143990 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968004a20 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.295+0000 7fa97f92c640 1 -- 172.21.15.134:0/708795065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa978143f50 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.296+0000 7fa97f92c640 1 -- 172.21.15.134:0/708795065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9780b0b30 con 0x7fa9780b4b90 2024-09-15T22:45:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.297+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fa96801b070 con 0x7fa9780b4b90 2024-09-15T22:45:33.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.297+0000 7fa96dffb640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa95c06c3d0 0x7fa95c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.298+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fa96808a880 con 0x7fa9780b4b90 2024-09-15T22:45:33.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.298+0000 7fa97d6c8640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa95c06c3d0 0x7fa95c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.298+0000 7fa97d6c8640 1 --2- 172.21.15.134:0/708795065 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa95c06c3d0 0x7fa95c06e890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa974034000 tx=0x7fa97402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.302+0000 7fa96dffb640 1 -- 172.21.15.134:0/708795065 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa968058890 con 0x7fa9780b4b90 2024-09-15T22:45:33.489 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-15T22:45:33.489 INFO:teuthology.orchestra.run.smithi134.stderr:fs volume create [] : Create a CephFS volume 2024-09-15T22:45:33.489 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-15T22:45:33.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T22:45:33.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-15T22:45:33.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.594+0000 7fefe6e77640 1 Processor -- start 2024-09-15T22:45:33.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.594+0000 7fefe6e77640 1 -- start start 2024-09-15T22:45:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe6e77640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fefe006f130 0x7fefe00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe6e77640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe015c820 con 0x7fefe0158e50 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe6e77640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe00b43f0 con 0x7fefe015c370 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe6e77640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fefe00b3630 con 0x7fefe006f130 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe4c13640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fefe0158e50 0x7fefe006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47766/0 (socket says 172.21.15.134:47766) 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefe4c13640 1 -- 172.21.15.134:0/3704593939 learned_addr learned my addr 172.21.15.134:0/3704593939 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd7fff640 1 --2- 172.21.15.134:0/3704593939 >> v2:172.21.15.177:3300/0 conn(0x7fefe006f130 0x7fefe00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424611739 0 0) 0x7fefdc001110 con 0x7fefe0158e50 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefc8005730 con 0x7fefe0158e50 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2395392748 0 0) 0x7fefc8005730 con 0x7fefe0158e50 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 >> v2:172.21.15.177:3300/0 conn(0x7fefe006f130 msgr2=0x7fefe00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 --2- 172.21.15.134:0/3704593939 >> v2:172.21.15.177:3300/0 conn(0x7fefe006f130 0x7fefe00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 >> v1:172.21.15.177:6789/0 conn(0x7fefe015c370 legacy=0x7fefe00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe00b3910 con 0x7fefe0158e50 2024-09-15T22:45:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fefdc001840 con 0x7fefe0158e50 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 >> v1:172.21.15.134:6789/0 conn(0x7fefe0158e50 legacy=0x7fefe006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8005bc0 0x7fefc8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 0x7fefc8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc80073d0 0x7fefc800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefe00b3630 con 0x7fefc8006a10 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fefc800e370 con 0x7fefc80073d0 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.595+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fefc800e570 con 0x7fefc8005bc0 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 0x7fefc8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefe4c13640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8005bc0 0x7fefc8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefe5414640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc80073d0 0x7fefc800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 -- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8005bc0 msgr2=0x7fefc8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8005bc0 0x7fefc8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 -- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc80073d0 msgr2=0x7fefc800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:33.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc80073d0 0x7fefc800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefe5414640 1 -- 172.21.15.134:0/3704593939 reap_dead start 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.596+0000 7fefd7fff640 1 -- 172.21.15.134:0/3704593939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc8005730 con 0x7fefc8006a10 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefd7fff640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 0x7fefc8006e90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009a80 tx=0x7fefc8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3192174e16285cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0036070 con 0x7fefc8006a10 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd0005990 con 0x7fefc8006a10 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefd77fe640 1 -- 172.21.15.134:0/3704593939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0009680 con 0x7fefc8006a10 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 -- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 msgr2=0x7fefc8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 0x7fefc8006e90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009a80 tx=0x7fefc8007a40 comp rx=0 tx=0).stop 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 -- 172.21.15.134:0/3704593939 shutdown_connections 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 --2- 172.21.15.134:0/3704593939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8006a10 0x7fefc8006e90 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 -- 172.21.15.134:0/3704593939 >> 172.21.15.134:0/3704593939 conn(0x7fefe006bba0 msgr2=0x7fefe006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 -- 172.21.15.134:0/3704593939 shutdown_connections 2024-09-15T22:45:33.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.597+0000 7fefe6e77640 1 -- 172.21.15.134:0/3704593939 wait complete. 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 Processor -- start 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 -- start start 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8006a10 0x7fefe01593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 0x7fefe013fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0159230 con 0x7fefe0140310 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fefe00b3ed0 con 0x7fefe01598f0 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.599+0000 7fefe6e77640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fefe00b5050 con 0x7fefc8006a10 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39196/0 (socket says 172.21.15.134:39196) 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 -- 172.21.15.134:0/2794708942 learned_addr learned my addr 172.21.15.134:0/2794708942 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe4c13640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8006a10 0x7fefe01593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefd7fff640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 0x7fefe013fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 -- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8006a10 msgr2=0x7fefe01593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8006a10 0x7fefe01593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 -- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 msgr2=0x7fefe013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 0x7fefe013fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 -- 172.21.15.134:0/2794708942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe01407c0 con 0x7fefe0140310 2024-09-15T22:45:33.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefd7fff640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 0x7fefe013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe5414640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fefe00cd4d0 tx=0x7fefd800fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd801a070 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd8006b50 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe013eff0 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8003970 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.600+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe015a070 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.601+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe00b5380 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.602+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fefd801d070 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.602+0000 7fefd57fa640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 0x7fefcc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.602+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fefd808a960 con 0x7fefe0140310 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.602+0000 7fefe4c13640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 0x7fefcc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.603+0000 7fefe4c13640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 0x7fefcc06e890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fefe015cf20 tx=0x7fefdc001270 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.606+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefd8059050 con 0x7fefe0140310 2024-09-15T22:45:33.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:33.796+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) -- 0x7fefe0158490 con 0x7fefcc06c3d0 2024-09-15T22:45:36.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.587+0000 7fefd57fa640 1 -- 172.21.15.134:0/2794708942 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7fefe0158490 con 0x7fefcc06c3d0 2024-09-15T22:45:36.589 INFO:teuthology.orchestra.run.smithi134.stderr:Volume created successfully (no MDS daemons created) 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 msgr2=0x7fefcc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 0x7fefcc06e890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fefe015cf20 tx=0x7fefdc001270 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 msgr2=0x7fefe014f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fefe00cd4d0 tx=0x7fefd800fb20 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 shutdown_connections 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fefcc06c3d0 0x7fefcc06e890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefe0140310 0x7fefe014f800 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe01598f0 0x7fefe013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 --2- 172.21.15.134:0/2794708942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefc8006a10 0x7fefe01593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.591+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 >> 172.21.15.134:0/2794708942 conn(0x7fefe006bba0 msgr2=0x7fefe006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:36.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.592+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 shutdown_connections 2024-09-15T22:45:36.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.592+0000 7fefe6e77640 1 -- 172.21.15.134:0/2794708942 wait complete. 2024-09-15T22:45:36.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-15T22:45:36.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.716+0000 7fbdcc149640 1 Processor -- start 2024-09-15T22:45:36.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.716+0000 7fbdcc149640 1 -- start start 2024-09-15T22:45:36.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdcc149640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 0x7fbdc40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdcc149640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbdc4072290 0x7fbdc40726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdcc149640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc406dc40 con 0x7fbdc4161cc0 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdcc149640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc40af300 con 0x7fbdc4072290 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdcc149640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc406e570 con 0x7fbdc40b57d0 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdca6e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbdc4072290 0x7fbdc40726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdc9ee5640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbdc4161cc0 0x7fbdc40aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34520/0 (socket says 172.21.15.134:34520) 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdc9ee5640 1 -- 172.21.15.134:0/3853839583 learned_addr learned my addr 172.21.15.134:0/3853839583 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3853839583 >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 msgr2=0x7fbdc40b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdc96e4640 1 --2- 172.21.15.134:0/3853839583 >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 0x7fbdc40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdca6e6640 1 --2- 172.21.15.134:0/3853839583 >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 0x7fbdc40b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3853839583 >> v1:172.21.15.134:6789/0 conn(0x7fbdc4161cc0 legacy=0x7fbdc40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdc8ee3640 1 -- 172.21.15.134:0/3853839583 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892367964 0 0) 0x7fbdc406dc40 con 0x7fbdc4161cc0 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3853839583 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc406df20 con 0x7fbdc4072290 2024-09-15T22:45:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.717+0000 7fbdc96e4640 1 --2- 172.21.15.134:0/3853839583 >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 0x7fbdc40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdca6e6640 1 --2- 172.21.15.134:0/3853839583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4072290 0x7fbdc40726c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40b3fa0 tx=0x7fbdbc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1916822fc556a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdc8ee3640 1 -- 172.21.15.134:0/3853839583 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc007740 con 0x7fbdc4072290 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdc8ee3640 1 -- 172.21.15.134:0/3853839583 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0078e0 con 0x7fbdc4072290 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdc8ee3640 1 -- 172.21.15.134:0/3853839583 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc007cb0 con 0x7fbdc4072290 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdcc149640 1 -- 172.21.15.134:0/3853839583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4072290 msgr2=0x7fbdc40726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.718+0000 7fbdcc149640 1 --2- 172.21.15.134:0/3853839583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4072290 0x7fbdc40726c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40b3fa0 tx=0x7fbdbc02a680 comp rx=0 tx=0).stop 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 -- 172.21.15.134:0/3853839583 shutdown_connections 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 --2- 172.21.15.134:0/3853839583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4072290 0x7fbdc40726c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 --2- 172.21.15.134:0/3853839583 >> v2:172.21.15.177:3300/0 conn(0x7fbdc40b57d0 0x7fbdc40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 -- 172.21.15.134:0/3853839583 >> 172.21.15.134:0/3853839583 conn(0x7fbdc406bba0 msgr2=0x7fbdc406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 -- 172.21.15.134:0/3853839583 shutdown_connections 2024-09-15T22:45:36.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.719+0000 7fbdcc149640 1 -- 172.21.15.134:0/3853839583 wait complete. 2024-09-15T22:45:36.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.720+0000 7fbdcc149640 1 Processor -- start 2024-09-15T22:45:36.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.720+0000 7fbdcc149640 1 -- start start 2024-09-15T22:45:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdc4072290 0x7fbdc40cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdc40b57d0 0x7fbdc40b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4161cc0 0x7fbdc41f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc40b4a60 con 0x7fbdc4161cc0 2024-09-15T22:45:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4072c00 con 0x7fbdc40b57d0 2024-09-15T22:45:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc40b4be0 con 0x7fbdc4072290 2024-09-15T22:45:36.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4161cc0 0x7fbdc41f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4161cc0 0x7fbdc41f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48752/0 (socket says 172.21.15.134:48752) 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3770648259 learned_addr learned my addr 172.21.15.134:0/3770648259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdc96e4640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdc40b57d0 0x7fbdc40b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdc9ee5640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdc4072290 0x7fbdc40cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdc4072290 msgr2=0x7fbdc40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdc4072290 0x7fbdc40cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdc40b57d0 msgr2=0x7fbdc40b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdc40b57d0 0x7fbdc40b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 -- 172.21.15.134:0/3770648259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40ce3e0 con 0x7fbdc4161cc0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdca6e6640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdc4161cc0 0x7fbdc41f6a30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc02ac70 tx=0x7fbdbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc040070 con 0x7fbdc4161cc0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc031c40 con 0x7fbdc4161cc0 2024-09-15T22:45:36.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc003990 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 -- 172.21.15.134:0/3770648259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc40ce6c0 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.721+0000 7fbdcc149640 1 -- 172.21.15.134:0/3770648259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc40cec80 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.722+0000 7fbdcc149640 1 -- 172.21.15.134:0/3770648259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc40726c0 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.723+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fbdbc039040 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.723+0000 7fbdba7fc640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda806c3d0 0x7fbda806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.723+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6543+0+0 (secure 0 0 0) 0x7fbdbc0accc0 con 0x7fbdc4161cc0 2024-09-15T22:45:36.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.723+0000 7fbdc9ee5640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda806c3d0 0x7fbda806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.724+0000 7fbdc9ee5640 1 --2- 172.21.15.134:0/3770648259 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda806c3d0 0x7fbda806e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0007fd0 tx=0x7fbdc0007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:36.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:36.728+0000 7fbdba7fc640 1 -- 172.21.15.134:0/3770648259 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdbc07a880 con 0x7fbdc4161cc0 2024-09-15T22:45:36.915 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-15T22:45:36.915 INFO:teuthology.orchestra.run.smithi134.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-15T22:45:36.916 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-15T22:45:36.919 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T22:45:36.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-15T22:45:37.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.020+0000 7f492f1d6640 1 Processor -- start 2024-09-15T22:45:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.020+0000 7f492f1d6640 1 -- start start 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492f1d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49280d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492f1d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49280d28f0 0x7f492806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492f1d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49280d2d80 con 0x7f492815e950 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492f1d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f492815ed30 con 0x7f49280d28f0 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492f1d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f49280d0f40 con 0x7f49280b5590 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492d773640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49280d28f0 0x7f492806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492d773640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49280d28f0 0x7f492806dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48754/0 (socket says 172.21.15.134:48754) 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492d773640 1 -- 172.21.15.134:0/3647586801 learned_addr learned my addr 172.21.15.134:0/3647586801 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f4927fff640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49280d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.021+0000 7f492d773640 1 -- 172.21.15.134:0/3647586801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 msgr2=0x7f49280d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f492d773640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49280d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f492d773640 1 -- 172.21.15.134:0/3647586801 >> v1:172.21.15.177:6789/0 conn(0x7f492815e950 legacy=0x7f49280d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f492d773640 1 -- 172.21.15.134:0/3647586801 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49280d1220 con 0x7f49280d28f0 2024-09-15T22:45:37.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f4927fff640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49280d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f492d773640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f492806dc20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4920009870 tx=0x7f492002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c78871d28330ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f49277fe640 1 -- 172.21.15.134:0/3647586801 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920037070 con 0x7f49280d28f0 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f49277fe640 1 -- 172.21.15.134:0/3647586801 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920032440 con 0x7f49280d28f0 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.022+0000 7f49277fe640 1 -- 172.21.15.134:0/3647586801 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920032810 con 0x7f49280d28f0 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 -- 172.21.15.134:0/3647586801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 msgr2=0x7f492806dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f492806dc20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4920009870 tx=0x7f492002a270 comp rx=0 tx=0).stop 2024-09-15T22:45:37.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 -- 172.21.15.134:0/3647586801 shutdown_connections 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f492806dc20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 --2- 172.21.15.134:0/3647586801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49280d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 -- 172.21.15.134:0/3647586801 >> 172.21.15.134:0/3647586801 conn(0x7f492806f310 msgr2=0x7f492806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 -- 172.21.15.134:0/3647586801 shutdown_connections 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.023+0000 7f492f1d6640 1 -- 172.21.15.134:0/3647586801 wait complete. 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.024+0000 7f492f1d6640 1 Processor -- start 2024-09-15T22:45:37.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.024+0000 7f492f1d6640 1 -- start start 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49281f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f49280cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f492815e950 0x7f492814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49280b59b0 con 0x7f49280d28f0 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f492806d700 con 0x7f492815e950 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492f1d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f49280cf410 con 0x7f49280b5590 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f49280cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f49280cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48762/0 (socket says 172.21.15.134:48762) 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 -- 172.21.15.134:0/1963380727 learned_addr learned my addr 172.21.15.134:0/1963380727 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492cf72640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49281f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492d773640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f492815e950 0x7f492814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 -- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 msgr2=0x7f49281f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49281f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 -- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f492815e950 msgr2=0x7f492814c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f492815e950 0x7f492814c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f4927fff640 1 -- 172.21.15.134:0/1963380727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49280cc960 con 0x7f49280d28f0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.025+0000 7f492cf72640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49280b5590 0x7f49281f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f4927fff640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49280d28f0 0x7f49280cdca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4910007ef0 tx=0x7f491000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491001a070 con 0x7f49280d28f0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4910003b90 con 0x7f49280d28f0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910004030 con 0x7f49280d28f0 2024-09-15T22:45:37.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f492f1d6640 1 -- 172.21.15.134:0/1963380727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49281f8770 con 0x7f49280d28f0 2024-09-15T22:45:37.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.026+0000 7f492f1d6640 1 -- 172.21.15.134:0/1963380727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49280ccee0 con 0x7f49280d28f0 2024-09-15T22:45:37.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.027+0000 7f492f1d6640 1 -- 172.21.15.134:0/1963380727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492806d040 con 0x7f49280d28f0 2024-09-15T22:45:37.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.027+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f491001d070 con 0x7f49280d28f0 2024-09-15T22:45:37.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.028+0000 7f49257fa640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f490806c3d0 0x7f490806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.028+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6543+0+0 (secure 0 0 0) 0x7f491008bb20 con 0x7f49280d28f0 2024-09-15T22:45:37.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.028+0000 7f492cf72640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f490806c3d0 0x7f490806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.029+0000 7f492cf72640 1 --2- 172.21.15.134:0/1963380727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f490806c3d0 0x7f490806e890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4918001700 tx=0x7f4918009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.032+0000 7f49257fa640 1 -- 172.21.15.134:0/1963380727 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4910010070 con 0x7f49280d28f0 2024-09-15T22:45:37.222 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-15T22:45:37.223 INFO:teuthology.orchestra.run.smithi134.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-15T22:45:37.223 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-15T22:45:37.226 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T22:45:37.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-15T22:45:37.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.327+0000 7fe275077640 1 Processor -- start 2024-09-15T22:45:37.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.327+0000 7fe275077640 1 -- start start 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2700b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2700d04a0 0x7fe2700d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 0x7fe2700d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe2700d2da0 con 0x7fe2700d04a0 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe27015ed30 con 0x7fe2700d23b0 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe275077640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe2700d0f40 con 0x7fe27015e950 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.328+0000 7fe26e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2700d04a0 0x7fe2700d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2700d04a0 0x7fe2700d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48768/0 (socket says 172.21.15.134:48768) 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 -- 172.21.15.134:0/390617606 learned_addr learned my addr 172.21.15.134:0/390617606 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26ed9d640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2700b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26f59e640 1 --2- 172.21.15.134:0/390617606 >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 0x7fe2700d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 -- 172.21.15.134:0/390617606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 msgr2=0x7fe2700b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2700b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 -- 172.21.15.134:0/390617606 >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 msgr2=0x7fe2700d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 --2- 172.21.15.134:0/390617606 >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 0x7fe2700d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26e59c640 1 -- 172.21.15.134:0/390617606 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2700d1220 con 0x7fe2700d04a0 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.329+0000 7fe26f59e640 1 --2- 172.21.15.134:0/390617606 >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 0x7fe2700d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe26e59c640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d04a0 0x7fe2700d08c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe2700d02d0 tx=0x7fe26402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25f80326e38b0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe26dd9b640 1 -- 172.21.15.134:0/390617606 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264037070 con 0x7fe2700d04a0 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe26dd9b640 1 -- 172.21.15.134:0/390617606 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe264032440 con 0x7fe2700d04a0 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe26dd9b640 1 -- 172.21.15.134:0/390617606 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264032810 con 0x7fe2700d04a0 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 -- 172.21.15.134:0/390617606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d04a0 msgr2=0x7fe2700d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d04a0 0x7fe2700d08c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe2700d02d0 tx=0x7fe26402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 -- 172.21.15.134:0/390617606 shutdown_connections 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 --2- 172.21.15.134:0/390617606 >> v2:172.21.15.177:3300/0 conn(0x7fe2700d23b0 0x7fe2700d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d04a0 0x7fe2700d08c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 --2- 172.21.15.134:0/390617606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2700b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 -- 172.21.15.134:0/390617606 >> 172.21.15.134:0/390617606 conn(0x7fe27006f310 msgr2=0x7fe27006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:37.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 -- 172.21.15.134:0/390617606 shutdown_connections 2024-09-15T22:45:37.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.330+0000 7fe275077640 1 -- 172.21.15.134:0/390617606 wait complete. 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.332+0000 7fe275077640 1 Processor -- start 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.332+0000 7fe275077640 1 -- start start 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2700d04a0 0x7fe2700cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2701f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2700cf410 con 0x7fe2700d23b0 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe27006d700 con 0x7fe2700d04a0 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe27006d040 con 0x7fe27015e950 2024-09-15T22:45:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48774/0 (socket says 172.21.15.134:48774) 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 -- 172.21.15.134:0/983994261 learned_addr learned my addr 172.21.15.134:0/983994261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26ed9d640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2700d04a0 0x7fe2700cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26f59e640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2701f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 -- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 msgr2=0x7fe2701f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2701f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 -- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2700d04a0 msgr2=0x7fe2700cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2700d04a0 0x7fe2700cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 -- 172.21.15.134:0/983994261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2700cbe50 con 0x7fe2700d23b0 2024-09-15T22:45:37.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26f59e640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2701f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe26e59c640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe26402a220 tx=0x7fe2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264041020 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2640306c0 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe270160910 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264037040 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.333+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe270160ed0 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.334+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2700d08c0 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.335+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fe264044020 con 0x7fe2700d23b0 2024-09-15T22:45:37.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.336+0000 7fe2577fe640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 0x7fe25c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:37.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.336+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6543+0+0 (secure 0 0 0) 0x7fe2640ac090 con 0x7fe2700d23b0 2024-09-15T22:45:37.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.336+0000 7fe26ed9d640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 0x7fe25c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:37.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.336+0000 7fe26ed9d640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 0x7fe25c06e890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2600079a0 tx=0x7fe260008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:37.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.340+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe26404b030 con 0x7fe2700d23b0 2024-09-15T22:45:37.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:37.526+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7fe27006e830 con 0x7fe25c06c3d0 2024-09-15T22:45:37.532 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:45:37.531+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:45:37.565 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:45:40.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.549+0000 7fe2577fe640 1 -- 172.21.15.134:0/983994261 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+78 (secure 0 0 0) 0x7fe27006e830 con 0x7fe25c06c3d0 2024-09-15T22:45:40.551 INFO:teuthology.orchestra.run.smithi134.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-15T22:45:40.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 msgr2=0x7fe25c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 0x7fe25c06e890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2600079a0 tx=0x7fe260008040 comp rx=0 tx=0).stop 2024-09-15T22:45:40.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 msgr2=0x7fe2701f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe26402a220 tx=0x7fe2640046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 shutdown_connections 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27015e950 0x7fe2701f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe25c06c3d0 0x7fe25c06e890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2700d23b0 0x7fe2701f7630 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 --2- 172.21.15.134:0/983994261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2700d04a0 0x7fe2700cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 >> 172.21.15.134:0/983994261 conn(0x7fe27006f310 msgr2=0x7fe27015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 shutdown_connections 2024-09-15T22:45:40.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.552+0000 7fe275077640 1 -- 172.21.15.134:0/983994261 wait complete. 2024-09-15T22:45:40.567 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:45:40.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:40.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:40.659 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:45:40.659 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:40.659 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:40.659 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:40.677 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:40.677 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:40.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:45:40.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.875+0000 7f96ad2e6640 1 Processor -- start 2024-09-15T22:45:40.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.875+0000 7f96ad2e6640 1 -- start start 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96ad2e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96a80b4b70 0x7f96a80d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96ad2e6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a8074200 con 0x7f96a815e500 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96ad2e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80b6e80 con 0x7f96a815e8e0 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96ad2e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f96a80b7160 con 0x7f96a80b4b70 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f969e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96a80b4b70 0x7f96a80d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96a6ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f96a815e500 0x7f96a80b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34528/0 (socket says 172.21.15.134:34528) 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f96a6ffd640 1 -- 172.21.15.134:0/1314348577 learned_addr learned my addr 172.21.15.134:0/1314348577 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f969e7fc640 1 -- 172.21.15.134:0/1314348577 >> v1:172.21.15.177:6789/0 conn(0x7f96a815e8e0 legacy=0x7f96a80d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f969e7fc640 1 -- 172.21.15.134:0/1314348577 >> v1:172.21.15.134:6789/0 conn(0x7f96a815e500 legacy=0x7f96a80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.876+0000 7f969e7fc640 1 -- 172.21.15.134:0/1314348577 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80b7440 con 0x7f96a80b4b70 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.877+0000 7f969e7fc640 1 --2- 172.21.15.134:0/1314348577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a80d2460 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f96900097d0 tx=0x7f969002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8481bee2b601ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.877+0000 7f96a67fc640 1 -- 172.21.15.134:0/1314348577 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690037070 con 0x7f96a80b4b70 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.877+0000 7f96a67fc640 1 -- 172.21.15.134:0/1314348577 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690032440 con 0x7f96a80b4b70 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.877+0000 7f96a67fc640 1 -- 172.21.15.134:0/1314348577 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690032810 con 0x7f96a80b4b70 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1314348577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 msgr2=0x7f96a80d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1314348577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a80d2460 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f96900097d0 tx=0x7f969002a180 comp rx=0 tx=0).stop 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1314348577 shutdown_connections 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1314348577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a80d2460 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1314348577 >> 172.21.15.134:0/1314348577 conn(0x7f96a8062810 msgr2=0x7f96a8062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1314348577 shutdown_connections 2024-09-15T22:45:40.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.878+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1314348577 wait complete. 2024-09-15T22:45:40.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.879+0000 7f96ad2e6640 1 Processor -- start 2024-09-15T22:45:40.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.879+0000 7f96ad2e6640 1 -- start start 2024-09-15T22:45:40.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a815e500 0x7f96a8154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a815e8e0 0x7f96a80b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96a806ce30 con 0x7f96a80b4b70 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96a806ccb0 con 0x7f96a815e500 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96ad2e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f96a8073cb0 con 0x7f96a815e8e0 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48800/0 (socket says 172.21.15.134:48800) 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 -- 172.21.15.134:0/1575936192 learned_addr learned my addr 172.21.15.134:0/1575936192 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f969e7fc640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a815e500 0x7f96a8154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 -- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a815e8e0 msgr2=0x7f96a80b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a815e8e0 0x7f96a80b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 -- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a815e500 msgr2=0x7f96a8154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a815e500 0x7f96a8154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 -- 172.21.15.134:0/1575936192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a81556f0 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.880+0000 7f96a6ffd640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f969800c400 tx=0x7f969800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.881+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698017070 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.881+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9698005ce0 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.881+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980072f0 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.881+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a81559d0 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.881+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a8155f90 con 0x7f96a80b4b70 2024-09-15T22:45:40.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.882+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a80d1cf0 con 0x7f96a80b4b70 2024-09-15T22:45:40.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.882+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f969801a070 con 0x7f96a80b4b70 2024-09-15T22:45:40.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.883+0000 7f969ffff640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 0x7f968806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.883+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f969808a9b0 con 0x7f96a80b4b70 2024-09-15T22:45:40.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.883+0000 7f969e7fc640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 0x7f968806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.883+0000 7f969e7fc640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 0x7f968806e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9690034000 tx=0x7f969002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:40.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:40.887+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9698059040 con 0x7f96a80b4b70 2024-09-15T22:45:41.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.064+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96a8069160 con 0x7f96a80b4b70 2024-09-15T22:45:41.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.065+0000 7f969ffff640 1 -- 172.21.15.134:0/1575936192 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) ==== 80+0+124 (secure 0 0 0) 0x7f9698058940 con 0x7f96a80b4b70 2024-09-15T22:45:41.066 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.177:6834/3275361990 2024-09-16T22:45:37.532338+0000 2024-09-15T22:45:41.066 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.177:6832/3275361990 2024-09-16T22:45:37.532338+0000 2024-09-15T22:45:41.066 INFO:teuthology.orchestra.run.smithi134.stderr:listed 2 entries 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.066+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 msgr2=0x7f968806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.066+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 0x7f968806e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9690034000 tx=0x7f969002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.066+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 msgr2=0x7f96a8157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.066+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f969800c400 tx=0x7f969800c8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.066+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 shutdown_connections 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a815e8e0 0x7f96a80b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a815e500 0x7f96a8154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f968806c3d0 0x7f968806e890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 --2- 172.21.15.134:0/1575936192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96a80b4b70 0x7f96a8157cd0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 >> 172.21.15.134:0/1575936192 conn(0x7f96a8062810 msgr2=0x7f96a815bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:41.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 shutdown_connections 2024-09-15T22:45:41.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.067+0000 7f96ad2e6640 1 -- 172.21.15.134:0/1575936192 wait complete. 2024-09-15T22:45:41.079 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:45:41.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:41.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:41.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:45:41.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:41.109 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:45:41.165 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:41.165 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:41.165 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:41.186 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:41.187 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:41.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:45:41.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.345+0000 7f3b6b09b640 1 Processor -- start 2024-09-15T22:45:41.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.345+0000 7f3b6b09b640 1 -- start start 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.345+0000 7f3b6b09b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b6415e940 0x7f3b640d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.345+0000 7f3b6b09b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 0x7f3b640d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b6b09b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b640b7170 con 0x7f3b640cef90 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b6b09b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3b640d1ae0 con 0x7f3b6415e940 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b6b09b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3b640b7aa0 con 0x7f3b6415ed20 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b68e37640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b6415e940 0x7f3b640d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b69638640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3b640cef90 0x7f3b640b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34530/0 (socket says 172.21.15.134:34530) 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b69638640 1 -- 172.21.15.134:0/3876508240 learned_addr learned my addr 172.21.15.134:0/3876508240 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b63fff640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 0x7f3b640d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b68e37640 1 -- 172.21.15.134:0/3876508240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 msgr2=0x7f3b640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b68e37640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 0x7f3b640d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b68e37640 1 -- 172.21.15.134:0/3876508240 >> v1:172.21.15.134:6789/0 conn(0x7f3b640cef90 legacy=0x7f3b640b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b68e37640 1 -- 172.21.15.134:0/3876508240 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640d3660 con 0x7f3b6415e940 2024-09-15T22:45:41.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b637fe640 1 -- 172.21.15.134:0/3876508240 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773687342 0 0) 0x7f3b5c001490 con 0x7f3b640cef90 2024-09-15T22:45:41.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.346+0000 7f3b63fff640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 0x7f3b640d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:41.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b68e37640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b640d1060 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f3b580097a0 tx=0x7f3b5802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51d0a5c56b56d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b637fe640 1 -- 172.21.15.134:0/3876508240 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58037070 con 0x7f3b6415e940 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b637fe640 1 -- 172.21.15.134:0/3876508240 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58032440 con 0x7f3b6415e940 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b637fe640 1 -- 172.21.15.134:0/3876508240 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58032810 con 0x7f3b6415e940 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3876508240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 msgr2=0x7f3b640d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b640d1060 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f3b580097a0 tx=0x7f3b5802a210 comp rx=0 tx=0).stop 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3876508240 shutdown_connections 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b6415ed20 0x7f3b640d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3876508240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b640d1060 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3876508240 >> 172.21.15.134:0/3876508240 conn(0x7f3b640b6240 msgr2=0x7f3b640b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3876508240 shutdown_connections 2024-09-15T22:45:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.347+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3876508240 wait complete. 2024-09-15T22:45:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 Processor -- start 2024-09-15T22:45:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 -- start start 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b640cef90 0x7f3b641f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415ed20 0x7f3b64157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b640d3f00 con 0x7f3b6415e940 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b640d3c20 con 0x7f3b6415ed20 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.349+0000 7f3b6b09b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3b640d3310 con 0x7f3b640cef90 2024-09-15T22:45:41.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48810/0 (socket says 172.21.15.134:48810) 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 -- 172.21.15.134:0/3456669846 learned_addr learned my addr 172.21.15.134:0/3456669846 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b68e37640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b640cef90 0x7f3b641f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b69638640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415ed20 0x7f3b64157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 -- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b640cef90 msgr2=0x7f3b641f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b640cef90 0x7f3b641f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 -- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415ed20 msgr2=0x7f3b64157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415ed20 0x7f3b64157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 -- 172.21.15.134:0/3456669846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b641f5530 con 0x7f3b6415e940 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b63fff640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c820 tx=0x7f3b5000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50015070 con 0x7f3b6415e940 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50007a30 con 0x7f3b6415e940 2024-09-15T22:45:41.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b641f5810 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50007e00 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.350+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b641f5dd0 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.351+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b640d1f80 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.352+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3b50018070 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.352+0000 7f3b617fa640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 0x7f3b4806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.352+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f3b5008b710 con 0x7f3b6415e940 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.352+0000 7f3b68e37640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 0x7f3b4806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.353+0000 7f3b68e37640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 0x7f3b4806e890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b58034000 tx=0x7f3b5802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.356+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b50059c00 con 0x7f3b6415e940 2024-09-15T22:45:41.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.532+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b640b96d0 con 0x7f3b6415e940 2024-09-15T22:45:41.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.532+0000 7f3b617fa640 1 -- 172.21.15.134:0/3456669846 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) ==== 80+0+124 (secure 0 0 0) 0x7f3b50059500 con 0x7f3b6415e940 2024-09-15T22:45:41.534 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.177:6834/3275361990 2024-09-16T22:45:37.532338+0000 2024-09-15T22:45:41.534 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.177:6832/3275361990 2024-09-16T22:45:37.532338+0000 2024-09-15T22:45:41.534 INFO:teuthology.orchestra.run.smithi134.stderr:listed 2 entries 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 msgr2=0x7f3b4806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 0x7f3b4806e890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b58034000 tx=0x7f3b5802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 msgr2=0x7f3b641588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c820 tx=0x7f3b5000cc20 comp rx=0 tx=0).stop 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 shutdown_connections 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415ed20 0x7f3b64157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3b4806c3d0 0x7f3b4806e890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6415e940 0x7f3b641588c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 --2- 172.21.15.134:0/3456669846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b640cef90 0x7f3b641f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.534+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 >> 172.21.15.134:0/3456669846 conn(0x7f3b640b6240 msgr2=0x7f3b640b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:41.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.535+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 shutdown_connections 2024-09-15T22:45:41.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.535+0000 7f3b6b09b640 1 -- 172.21.15.134:0/3456669846 wait complete. 2024-09-15T22:45:41.548 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:45:41.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:41.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:45:41.581 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:45:41.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:41.582 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:45:41.640 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:41.640 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:41.640 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:41.656 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:41.656 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:45:41.656 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:41.656 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:41.697 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:41.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:41.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.794+0000 7fe979731640 1 Processor -- start 2024-09-15T22:45:41.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.794+0000 7fe979731640 1 -- start start 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe979731640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe97415e940 0x7fe9740d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe979731640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415ed20 0x7fe9740d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe979731640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9740b7170 con 0x7fe9740cef90 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe979731640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe9740d1ae0 con 0x7fe97415e940 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe979731640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe9740b7aa0 con 0x7fe97415ed20 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe972ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe97415e940 0x7fe9740d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe9737fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe9740cef90 0x7fe9740b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:36874/0 (socket says 172.21.15.134:36874) 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe9727fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415ed20 0x7fe9740d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.795+0000 7fe9737fe640 1 -- 172.21.15.134:0/1698900118 learned_addr learned my addr 172.21.15.134:0/1698900118 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:41.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe972ffd640 1 -- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415ed20 msgr2=0x7fe9740d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:41.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe972ffd640 1 --2- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415ed20 0x7fe9740d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe972ffd640 1 -- 172.21.15.134:0/1698900118 >> v1:172.21.15.177:6789/0 conn(0x7fe9740cef90 legacy=0x7fe9740b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe971ffb640 1 -- 172.21.15.134:0/1698900118 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236717545 0 0) 0x7fe96c001490 con 0x7fe9740cef90 2024-09-15T22:45:41.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe972ffd640 1 -- 172.21.15.134:0/1698900118 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740d3660 con 0x7fe97415e940 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.796+0000 7fe972ffd640 1 --2- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415e940 0x7fe9740d1060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097a0 tx=0x7fe96402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3beb909add4b285 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe971ffb640 1 -- 172.21.15.134:0/1698900118 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964037070 con 0x7fe97415e940 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe971ffb640 1 -- 172.21.15.134:0/1698900118 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964032440 con 0x7fe97415e940 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe971ffb640 1 -- 172.21.15.134:0/1698900118 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964032810 con 0x7fe97415e940 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 -- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415e940 msgr2=0x7fe9740d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 --2- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415e940 0x7fe9740d1060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097a0 tx=0x7fe96402a210 comp rx=0 tx=0).stop 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 -- 172.21.15.134:0/1698900118 shutdown_connections 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 --2- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415ed20 0x7fe9740d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 --2- 172.21.15.134:0/1698900118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415e940 0x7fe9740d1060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 -- 172.21.15.134:0/1698900118 >> 172.21.15.134:0/1698900118 conn(0x7fe9740b6240 msgr2=0x7fe9740b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:41.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 -- 172.21.15.134:0/1698900118 shutdown_connections 2024-09-15T22:45:41.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.797+0000 7fe979731640 1 -- 172.21.15.134:0/1698900118 wait complete. 2024-09-15T22:45:41.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.798+0000 7fe979731640 1 Processor -- start 2024-09-15T22:45:41.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.798+0000 7fe979731640 1 -- start start 2024-09-15T22:45:41.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415e940 0x7fe9741e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415ed20 0x7fe9740ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740d3f00 con 0x7fe9740cef90 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740d3c20 con 0x7fe97415ed20 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe979731640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe9740d3310 con 0x7fe97415e940 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48824/0 (socket says 172.21.15.134:48824) 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe972ffd640 1 -- 172.21.15.134:0/1084346185 learned_addr learned my addr 172.21.15.134:0/1084346185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe9727fc640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415e940 0x7fe9741e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.799+0000 7fe9737fe640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415ed20 0x7fe9740ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 -- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415e940 msgr2=0x7fe9741e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415e940 0x7fe9741e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 -- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415ed20 msgr2=0x7fe9740ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415ed20 0x7fe9740ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 -- 172.21.15.134:0/1084346185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe974155dd0 con 0x7fe9740cef90 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe972ffd640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe964035040 tx=0x7fe9640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964037050 con 0x7fe9740cef90 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964038040 con 0x7fe9740cef90 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964004490 con 0x7fe9740cef90 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9741e7a40 con 0x7fe9740cef90 2024-09-15T22:45:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.800+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9741e8000 con 0x7fe9740cef90 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.801+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9740d1ef0 con 0x7fe9740cef90 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.802+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fe96403c6d0 con 0x7fe9740cef90 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.802+0000 7fe95b7fe640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 0x7fe96006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.802+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7fe9640abe50 con 0x7fe9740cef90 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.802+0000 7fe9727fc640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 0x7fe96006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:41.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.803+0000 7fe9727fc640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 0x7fe96006e890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ceb10 tx=0x7fe968009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:41.806+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe964079e90 con 0x7fe9740cef90 2024-09-15T22:45:42.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.005+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9740ba6b0 con 0x7fe9740cef90 2024-09-15T22:45:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.006+0000 7fe95b7fe640 1 -- 172.21.15.134:0/1084346185 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7fe96407e190 con 0x7fe9740cef90 2024-09-15T22:45:42.007 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:42.007 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"btime":"2024-09-15T22:45:38:533903+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3684606781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3684606781},{"type":"v1","addr":"172.21.15.177:6834","nonce":3684606781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 47 2024-09-15T22:45:42.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 msgr2=0x7fe96006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 0x7fe96006e890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ceb10 tx=0x7fe968009190 comp rx=0 tx=0).stop 2024-09-15T22:45:42.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 msgr2=0x7fe974155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe964035040 tx=0x7fe9640046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 shutdown_connections 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe97415ed20 0x7fe9740ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe97415e940 0x7fe9741e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe96006c3d0 0x7fe96006e890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 --2- 172.21.15.134:0/1084346185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9740cef90 0x7fe974155890 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 >> 172.21.15.134:0/1084346185 conn(0x7fe9740b6240 msgr2=0x7fe9740b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 shutdown_connections 2024-09-15T22:45:42.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.008+0000 7fe979731640 1 -- 172.21.15.134:0/1084346185 wait complete. 2024-09-15T22:45:42.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:42.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.117+0000 7fe8cc467640 1 Processor -- start 2024-09-15T22:45:42.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.117+0000 7fe8cc467640 1 -- start start 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 0x7fe8c40affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe8c40cd300 0x7fe8c406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8c406f010 0x7fe8c41622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c415ecf0 con 0x7fe8c406f010 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c415c6e0 con 0x7fe8c40cd300 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8cc467640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c415efb0 con 0x7fe8c415c300 2024-09-15T22:45:42.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8c406f010 0x7fe8c41622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8c406f010 0x7fe8c41622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48826/0 (socket says 172.21.15.134:48826) 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 -- 172.21.15.134:0/1661929835 learned_addr learned my addr 172.21.15.134:0/1661929835 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8c9a02640 1 --2- 172.21.15.134:0/1661929835 >> v2:172.21.15.177:3300/0 conn(0x7fe8c40cd300 0x7fe8c406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8ca203640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 0x7fe8c40affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 -- 172.21.15.134:0/1661929835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 msgr2=0x7fe8c40affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 0x7fe8c40affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 -- 172.21.15.134:0/1661929835 >> v2:172.21.15.177:3300/0 conn(0x7fe8c40cd300 msgr2=0x7fe8c406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 --2- 172.21.15.134:0/1661929835 >> v2:172.21.15.177:3300/0 conn(0x7fe8c40cd300 0x7fe8c406ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8caa04640 1 -- 172.21.15.134:0/1661929835 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c415f290 con 0x7fe8c406f010 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.118+0000 7fe8ca203640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 0x7fe8c40affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:42.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.119+0000 7fe8caa04640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c406f010 0x7fe8c41622e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4069700 tx=0x7fe8bc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0e285670be46af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.119+0000 7fe8c9201640 1 -- 172.21.15.134:0/1661929835 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc036070 con 0x7fe8c406f010 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.119+0000 7fe8c9201640 1 -- 172.21.15.134:0/1661929835 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8bc031600 con 0x7fe8c406f010 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.119+0000 7fe8c9201640 1 -- 172.21.15.134:0/1661929835 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0319d0 con 0x7fe8c406f010 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 -- 172.21.15.134:0/1661929835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c406f010 msgr2=0x7fe8c41622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c406f010 0x7fe8c41622e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4069700 tx=0x7fe8bc02a610 comp rx=0 tx=0).stop 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 -- 172.21.15.134:0/1661929835 shutdown_connections 2024-09-15T22:45:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c406f010 0x7fe8c41622e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 --2- 172.21.15.134:0/1661929835 >> v2:172.21.15.177:3300/0 conn(0x7fe8c40cd300 0x7fe8c406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 --2- 172.21.15.134:0/1661929835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c415c300 0x7fe8c40affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 -- 172.21.15.134:0/1661929835 >> 172.21.15.134:0/1661929835 conn(0x7fe8c406cae0 msgr2=0x7fe8c406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 -- 172.21.15.134:0/1661929835 shutdown_connections 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.120+0000 7fe8cc467640 1 -- 172.21.15.134:0/1661929835 wait complete. 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 Processor -- start 2024-09-15T22:45:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 -- start start 2024-09-15T22:45:42.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 0x7fe8c414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 0x7fe8c41618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4071880 con 0x7fe8c40cd300 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c415f850 con 0x7fe8c415c300 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8cc467640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c40b0500 con 0x7fe8c406f010 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8c9a02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8c9a02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48836/0 (socket says 172.21.15.134:48836) 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.122+0000 7fe8c9a02640 1 -- 172.21.15.134:0/3236410107 learned_addr learned my addr 172.21.15.134:0/3236410107 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8ca203640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 0x7fe8c414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8caa04640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 0x7fe8c41618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 -- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 msgr2=0x7fe8c414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 0x7fe8c414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 -- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 msgr2=0x7fe8c41618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 0x7fe8c41618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 -- 172.21.15.134:0/3236410107 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c41538a0 con 0x7fe8c40cd300 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8ca203640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 0x7fe8c414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8caa04640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 0x7fe8c41618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8c9a02640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400e8a0 tx=0x7fe8b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4017070 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b400c940 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c4154ae0 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400cd10 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.123+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c4152dc0 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.124+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c406ead0 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.125+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fe8b401a070 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.125+0000 7fe8baffd640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 0x7fe8a806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.125+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7fe8b408b4a0 con 0x7fe8c40cd300 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.125+0000 7fe8ca203640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 0x7fe8a806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.126+0000 7fe8ca203640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 0x7fe8a806e890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006fd0 tx=0x7fe8c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.129+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8b4059b30 con 0x7fe8c40cd300 2024-09-15T22:45:42.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.331+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8c40b64b0 con 0x7fe8c40cd300 2024-09-15T22:45:42.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.332+0000 7fe8baffd640 1 -- 172.21.15.134:0/3236410107 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7fe8b4059430 con 0x7fe8c40cd300 2024-09-15T22:45:42.333 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:42.333 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"btime":"2024-09-15T22:45:38:533903+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3684606781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3684606781},{"type":"v1","addr":"172.21.15.177:6834","nonce":3684606781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:42.333 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 47 2024-09-15T22:45:42.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 msgr2=0x7fe8a806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 0x7fe8a806e890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006fd0 tx=0x7fe8c0008040 comp rx=0 tx=0).stop 2024-09-15T22:45:42.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 msgr2=0x7fe8c41613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400e8a0 tx=0x7fe8b400ed60 comp rx=0 tx=0).stop 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 shutdown_connections 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c415c300 0x7fe8c41618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8a806c3d0 0x7fe8a806e890 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c40cd300 0x7fe8c41613b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 --2- 172.21.15.134:0/3236410107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8c406f010 0x7fe8c414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 >> 172.21.15.134:0/3236410107 conn(0x7fe8c406cae0 msgr2=0x7fe8c406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 shutdown_connections 2024-09-15T22:45:42.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.334+0000 7fe8cc467640 1 -- 172.21.15.134:0/3236410107 wait complete. 2024-09-15T22:45:42.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:42.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.443+0000 7f32eff8d640 1 Processor -- start 2024-09-15T22:45:42.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.443+0000 7f32eff8d640 1 -- start start 2024-09-15T22:45:42.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32e815c300 0x7f32e80affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32e80cd300 0x7f32e806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f32e815ecf0 con 0x7f32e80cd300 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f32e815c6e0 con 0x7f32e815c300 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32eff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f32e815efb0 con 0x7f32e806f010 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32e80cd300 0x7f32e806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32e80cd300 0x7f32e806ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48838/0 (socket says 172.21.15.134:48838) 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 -- 172.21.15.134:0/1189245989 learned_addr learned my addr 172.21.15.134:0/1189245989 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32edd29640 1 --2- 172.21.15.134:0/1189245989 >> v2:172.21.15.177:3300/0 conn(0x7f32e815c300 0x7f32e80affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ee52a640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 -- 172.21.15.134:0/1189245989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 msgr2=0x7f32e81622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 -- 172.21.15.134:0/1189245989 >> v2:172.21.15.177:3300/0 conn(0x7f32e815c300 msgr2=0x7f32e80affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 --2- 172.21.15.134:0/1189245989 >> v2:172.21.15.177:3300/0 conn(0x7f32e815c300 0x7f32e80affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.444+0000 7f32ed528640 1 -- 172.21.15.134:0/1189245989 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e815f290 con 0x7f32e80cd300 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32ed528640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e806ead0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f32e8069490 tx=0x7f32dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b18866bc21f402 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32ecd27640 1 -- 172.21.15.134:0/1189245989 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc037070 con 0x7f32e80cd300 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32ecd27640 1 -- 172.21.15.134:0/1189245989 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc032440 con 0x7f32e80cd300 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32ecd27640 1 -- 172.21.15.134:0/1189245989 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc032810 con 0x7f32e80cd300 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 -- 172.21.15.134:0/1189245989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 msgr2=0x7f32e806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e806ead0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f32e8069490 tx=0x7f32dc02a140 comp rx=0 tx=0).stop 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 -- 172.21.15.134:0/1189245989 shutdown_connections 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 --2- 172.21.15.134:0/1189245989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e806ead0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 --2- 172.21.15.134:0/1189245989 >> v2:172.21.15.177:3300/0 conn(0x7f32e815c300 0x7f32e80affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.445+0000 7f32eff8d640 1 -- 172.21.15.134:0/1189245989 >> 172.21.15.134:0/1189245989 conn(0x7f32e806cae0 msgr2=0x7f32e806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.446+0000 7f32eff8d640 1 -- 172.21.15.134:0/1189245989 shutdown_connections 2024-09-15T22:45:42.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.446+0000 7f32eff8d640 1 -- 172.21.15.134:0/1189245989 wait complete. 2024-09-15T22:45:42.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 Processor -- start 2024-09-15T22:45:42.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 -- start start 2024-09-15T22:45:42.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 0x7f32e815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32e8071880 con 0x7f32e80cd300 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815f850 con 0x7f32e815c300 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.447+0000 7f32eff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f32e80b0500 con 0x7f32e806f010 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48840/0 (socket says 172.21.15.134:48840) 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 -- 172.21.15.134:0/903403368 learned_addr learned my addr 172.21.15.134:0/903403368 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32edd29640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ee52a640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 0x7f32e815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 -- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 msgr2=0x7f32e81566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 -- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 msgr2=0x7f32e815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 0x7f32e815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 -- 172.21.15.134:0/903403368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8156f20 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ee52a640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 0x7f32e815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32ed528640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000c00 tx=0x7f32dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc041020 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0306c0 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc037040 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e8157200 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.448+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e81577c0 con 0x7f32e80cd300 2024-09-15T22:45:42.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.449+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e806ead0 con 0x7f32e80cd300 2024-09-15T22:45:42.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.450+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f32dc044020 con 0x7f32e80cd300 2024-09-15T22:45:42.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.450+0000 7f32e67fc640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 0x7f32d406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.450+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f32dc0abd60 con 0x7f32e80cd300 2024-09-15T22:45:42.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.451+0000 7f32edd29640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 0x7f32d406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.451+0000 7f32edd29640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 0x7f32d406e8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32d8003b80 tx=0x7f32d80098d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.455+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32dc04b030 con 0x7f32e80cd300 2024-09-15T22:45:42.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.623+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32e8160030 con 0x7f32e80cd300 2024-09-15T22:45:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.624+0000 7f32e67fc640 1 -- 172.21.15.134:0/903403368 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16899 (secure 0 0 0) 0x7f32dc07a360 con 0x7f32e80cd300 2024-09-15T22:45:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:42.626 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":95,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:40.536845+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:22.241856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:22.832685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6834/3275361990":"2024-09-16T22:45:37.532338+0000","172.21.15.177:6832/3275361990":"2024-09-16T22:45:37.532338+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.626+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 msgr2=0x7f32d406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.626+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 0x7f32d406e8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32d8003b80 tx=0x7f32d80098d0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 msgr2=0x7f32e814b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000c00 tx=0x7f32dc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 shutdown_connections 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32e815c300 0x7f32e815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f32d406c400 0x7f32d406e8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32e80cd300 0x7f32e814b5c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 --2- 172.21.15.134:0/903403368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32e806f010 0x7f32e81566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 >> 172.21.15.134:0/903403368 conn(0x7f32e806cae0 msgr2=0x7f32e81556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 shutdown_connections 2024-09-15T22:45:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.627+0000 7f32eff8d640 1 -- 172.21.15.134:0/903403368 wait complete. 2024-09-15T22:45:42.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:45:42.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:42.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.736+0000 7fdf0a952640 1 Processor -- start 2024-09-15T22:45:42.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.736+0000 7fdf0a952640 1 -- start start 2024-09-15T22:45:42.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf0a952640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf0a952640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 0x7fdf040ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf0a952640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0415ecf0 con 0x7fdf0415c300 2024-09-15T22:45:42.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf0a952640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0415c6e0 con 0x7fdf0406f010 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf0a952640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0415efb0 con 0x7fdf040cd300 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf08eef640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 0x7fdf040ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:39536/0 (socket says 172.21.15.134:39536) 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf037fe640 1 -- 172.21.15.134:0/183435415 learned_addr learned my addr 172.21.15.134:0/183435415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.737+0000 7fdf03fff640 1 --1- 172.21.15.134:0/183435415 >> v1:172.21.15.177:6789/0 conn(0x7fdf0415c300 0x7fdf040affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:36886/0 (socket says 172.21.15.134:36886) 2024-09-15T22:45:42.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf037fe640 1 -- 172.21.15.134:0/183435415 >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 msgr2=0x7fdf040ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf037fe640 1 --2- 172.21.15.134:0/183435415 >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 0x7fdf040ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf037fe640 1 -- 172.21.15.134:0/183435415 >> v1:172.21.15.177:6789/0 conn(0x7fdf0415c300 legacy=0x7fdf040affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf037fe640 1 -- 172.21.15.134:0/183435415 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0415f290 con 0x7fdf040cd300 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf08eef640 1 --2- 172.21.15.134:0/183435415 >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 0x7fdf040ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf037fe640 1 --2- 172.21.15.134:0/183435415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81280bf253b299fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.738+0000 7fdf02ffd640 1 -- 172.21.15.134:0/183435415 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8037070 con 0x7fdf040cd300 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf02ffd640 1 -- 172.21.15.134:0/183435415 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8032440 con 0x7fdf040cd300 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf02ffd640 1 -- 172.21.15.134:0/183435415 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8032810 con 0x7fdf040cd300 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 -- 172.21.15.134:0/183435415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 msgr2=0x7fdf0406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 --2- 172.21.15.134:0/183435415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef802a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 -- 172.21.15.134:0/183435415 shutdown_connections 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 --2- 172.21.15.134:0/183435415 >> v2:172.21.15.177:3300/0 conn(0x7fdf0406f010 0x7fdf040ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 --2- 172.21.15.134:0/183435415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf0406ead0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 -- 172.21.15.134:0/183435415 >> 172.21.15.134:0/183435415 conn(0x7fdf0406cae0 msgr2=0x7fdf0406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 -- 172.21.15.134:0/183435415 shutdown_connections 2024-09-15T22:45:42.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.739+0000 7fdf0a952640 1 -- 172.21.15.134:0/183435415 wait complete. 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.740+0000 7fdf0a952640 1 Processor -- start 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.740+0000 7fdf0a952640 1 -- start start 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf040b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 0x7fdf040b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04071880 con 0x7fdf0406f010 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0415f850 con 0x7fdf0415c300 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf0a952640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf040aee20 con 0x7fdf040cd300 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48856/0 (socket says 172.21.15.134:48856) 2024-09-15T22:45:42.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf03fff640 1 -- 172.21.15.134:0/685955021 learned_addr learned my addr 172.21.15.134:0/685955021 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf08eef640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 0x7fdf040b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.741+0000 7fdf037fe640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf040b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 -- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 msgr2=0x7fdf040b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf040b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 -- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 msgr2=0x7fdf040b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 0x7fdf040b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 -- 172.21.15.134:0/685955021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0415fbd0 con 0x7fdf0406f010 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf08eef640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 0x7fdf040b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf037fe640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf040b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf03fff640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c3c0 tx=0x7fdef400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40074e0 con 0x7fdf0406f010 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef4007680 con 0x7fdf0406f010 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf041f5780 con 0x7fdf0406f010 2024-09-15T22:45:42.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4004a00 con 0x7fdf0406f010 2024-09-15T22:45:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.742+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf04160150 con 0x7fdf0406f010 2024-09-15T22:45:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.743+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf04161db0 con 0x7fdf0406f010 2024-09-15T22:45:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.744+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fdef401a020 con 0x7fdf0406f010 2024-09-15T22:45:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.744+0000 7fdf00ff9640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 0x7fdef006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.744+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7fdef408ac30 con 0x7fdf0406f010 2024-09-15T22:45:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.745+0000 7fdf037fe640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 0x7fdef006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.745+0000 7fdf037fe640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 0x7fdef006e890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdef8034000 tx=0x7fdef802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.749+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdef4059240 con 0x7fdf0406f010 2024-09-15T22:45:42.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.948+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf040ae8e0 con 0x7fdf0406f010 2024-09-15T22:45:42.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.949+0000 7fdf00ff9640 1 -- 172.21.15.134:0/685955021 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7fdef4058b40 con 0x7fdf0406f010 2024-09-15T22:45:42.950 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:42.950 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"btime":"2024-09-15T22:45:38:533903+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3684606781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3684606781},{"type":"v1","addr":"172.21.15.177:6834","nonce":3684606781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:42.951 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 47 2024-09-15T22:45:42.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 msgr2=0x7fdef006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 0x7fdef006e890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdef8034000 tx=0x7fdef802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 msgr2=0x7fdf04145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c3c0 tx=0x7fdef400c7c0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 shutdown_connections 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0415c300 0x7fdf040b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf040cd300 0x7fdf040b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdef006c3d0 0x7fdef006e890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 --2- 172.21.15.134:0/685955021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0406f010 0x7fdf04145750 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 >> 172.21.15.134:0/685955021 conn(0x7fdf0406cae0 msgr2=0x7fdf0406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 shutdown_connections 2024-09-15T22:45:42.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:42.951+0000 7fdf0a952640 1 -- 172.21.15.134:0/685955021 wait complete. 2024-09-15T22:45:42.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:43.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.060+0000 7f9128113640 1 Processor -- start 2024-09-15T22:45:43.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.060+0000 7f9128113640 1 -- start start 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9128113640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f912015c3d0 0x7f91200b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9128113640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91200b5a60 con 0x7f91200ce910 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9128113640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91200b5d00 con 0x7f91200b3550 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9128113640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f91200b5fe0 con 0x7f912015c3d0 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f91266b0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f91200ce910 0x7f912015c7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34546/0 (socket says 172.21.15.134:34546) 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f91266b0640 1 -- 172.21.15.134:0/2454871555 learned_addr learned my addr 172.21.15.134:0/2454871555 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:43.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9125eaf640 1 --2- 172.21.15.134:0/2454871555 >> v2:172.21.15.177:3300/0 conn(0x7f912015c3d0 0x7f91200b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988701622 0 0) 0x7f91200b5a60 con 0x7f91200ce910 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f910c003520 con 0x7f91200ce910 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1915053492 0 0) 0x7f910c003520 con 0x7f91200ce910 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 >> v2:172.21.15.177:3300/0 conn(0x7f912015c3d0 msgr2=0x7f91200b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 --2- 172.21.15.134:0/2454871555 >> v2:172.21.15.177:3300/0 conn(0x7f912015c3d0 0x7f91200b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 >> v1:172.21.15.177:6789/0 conn(0x7f91200b3550 legacy=0x7f91200ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91200b62c0 con 0x7f91200ce910 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f9118001a10 con 0x7f91200ce910 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 >> v1:172.21.15.134:6789/0 conn(0x7f91200ce910 legacy=0x7f912015c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f910c0039b0 0x7f910c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f910c004800 0x7f910c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f910c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91200b5fe0 con 0x7f910c0051c0 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f910c00c010 con 0x7f910c0039b0 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.061+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f910c00c210 con 0x7f910c004800 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f910c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f9125eaf640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f910c0039b0 0x7f910c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91256ae640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f910c004800 0x7f910c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 -- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f910c004800 msgr2=0x7f910c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f910c004800 0x7f910c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 -- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f910c0039b0 msgr2=0x7f910c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f910c0039b0 0x7f910c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 -- 172.21.15.134:0/2454871555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91200b62c0 con 0x7f910c0051c0 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f9125eaf640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f910c0039b0 0x7f910c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.062+0000 7f91266b0640 1 -- 172.21.15.134:0/2454871555 reap_dead start 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f91266b0640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f910c00b9c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f911800a960 tx=0x7f910c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46360d9ff49a1ede server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c009690 con 0x7f910c0051c0 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911802f070 con 0x7f910c0051c0 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9124ead640 1 -- 172.21.15.134:0/2454871555 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911800a560 con 0x7f910c0051c0 2024-09-15T22:45:43.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 -- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 msgr2=0x7f910c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f910c00b9c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f911800a960 tx=0x7f910c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 -- 172.21.15.134:0/2454871555 shutdown_connections 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 --2- 172.21.15.134:0/2454871555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f910c00b9c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 -- 172.21.15.134:0/2454871555 >> 172.21.15.134:0/2454871555 conn(0x7f912006ce90 msgr2=0x7f912006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 -- 172.21.15.134:0/2454871555 shutdown_connections 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.063+0000 7f9128113640 1 -- 172.21.15.134:0/2454871555 wait complete. 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.064+0000 7f9128113640 1 Processor -- start 2024-09-15T22:45:43.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 -- start start 2024-09-15T22:45:43.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91201f1b20 0x7f9120156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 0x7f91200ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91200b3b10 con 0x7f910c0051c0 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91200b3990 con 0x7f91200abed0 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9128113640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f91200b3c90 con 0x7f91201f1b20 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9125eaf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9125eaf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48876/0 (socket says 172.21.15.134:48876) 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f9125eaf640 1 -- 172.21.15.134:0/215445673 learned_addr learned my addr 172.21.15.134:0/215445673 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f91256ae640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91201f1b20 0x7f9120156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.065+0000 7f91266b0640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 0x7f91200ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 -- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91201f1b20 msgr2=0x7f9120156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91201f1b20 0x7f9120156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 -- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 msgr2=0x7f91200ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 0x7f91200ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 -- 172.21.15.134:0/215445673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91201f2290 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f91266b0640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 0x7f91200ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9125eaf640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f911c011960 tx=0x7f911c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c00fa90 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c00fc30 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91201f2570 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c014440 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.066+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91200aa670 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.067+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91201f2a90 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.067+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f911c012040 con 0x7f910c0051c0 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.068+0000 7f91167fc640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 0x7f910406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.068+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f911c08bb70 con 0x7f910c0051c0 2024-09-15T22:45:43.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.068+0000 7f91256ae640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 0x7f910406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.069+0000 7f91256ae640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 0x7f910406e890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9110000c00 tx=0x7f9110009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.072+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91201f2a90 con 0x7f910c0051c0 2024-09-15T22:45:43.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.269+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f912006c4f0 con 0x7f910c0051c0 2024-09-15T22:45:43.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.269+0000 7f91167fc640 1 -- 172.21.15.134:0/215445673 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7f911c019030 con 0x7f910c0051c0 2024-09-15T22:45:43.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:43.271 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"btime":"2024-09-15T22:45:38:533903+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3684606781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3684606781},{"type":"v1","addr":"172.21.15.177:6834","nonce":3684606781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:23.858674+0000","modified":"2024-09-15T22:45:25.852604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1978323940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1978323940},{"type":"v1","addr":"172.21.15.134:6835","nonce":1978323940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6534,"qdb_cluster":[6534]},"id":6}]} 2024-09-15T22:45:43.271 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 47 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 msgr2=0x7f910406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 0x7f910406e890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9110000c00 tx=0x7f9110009040 comp rx=0 tx=0).stop 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 msgr2=0x7f91200b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f911c011960 tx=0x7f911c011e20 comp rx=0 tx=0).stop 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 shutdown_connections 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91200abed0 0x7f91200ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91201f1b20 0x7f9120156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f910406c3d0 0x7f910406e890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 --2- 172.21.15.134:0/215445673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c0051c0 0x7f91200b0630 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 >> 172.21.15.134:0/215445673 conn(0x7f912006ce90 msgr2=0x7f912006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 shutdown_connections 2024-09-15T22:45:43.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.271+0000 7f9128113640 1 -- 172.21.15.134:0/215445673 wait complete. 2024-09-15T22:45:43.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:43.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.382+0000 7f9466d52640 1 Processor -- start 2024-09-15T22:45:43.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.382+0000 7f9466d52640 1 -- start start 2024-09-15T22:45:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f9466d52640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f946015ea10 0x7f94600d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f9466d52640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600d0fe0 con 0x7f94600d0ba0 2024-09-15T22:45:43.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f9466d52640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600af5a0 con 0x7f94600aeff0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f9466d52640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f94600ce810 con 0x7f946015ea10 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f945ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f94600d0ba0 0x7f94600ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34552/0 (socket says 172.21.15.134:34552) 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f945ffff640 1 -- 172.21.15.134:0/1564269016 learned_addr learned my addr 172.21.15.134:0/1564269016 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f9464aee640 1 --2- 172.21.15.134:0/1564269016 >> v2:172.21.15.177:3300/0 conn(0x7f946015ea10 0x7f94600d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.383+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931822823 0 0) 0x7f94600d0fe0 con 0x7f94600d0ba0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9448003520 con 0x7f94600d0ba0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1310990579 0 0) 0x7f9448003520 con 0x7f94600d0ba0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 >> v2:172.21.15.177:3300/0 conn(0x7f946015ea10 msgr2=0x7f94600d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 --2- 172.21.15.134:0/1564269016 >> v2:172.21.15.177:3300/0 conn(0x7f946015ea10 0x7f94600d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 >> v1:172.21.15.177:6789/0 conn(0x7f94600aeff0 legacy=0x7f94600cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600af880 con 0x7f94600d0ba0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f9454001670 con 0x7f94600d0ba0 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 >> v1:172.21.15.134:6789/0 conn(0x7f94600d0ba0 legacy=0x7f94600ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480039b0 0x7f9448003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9448004800 0x7f9448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f944800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94600ce810 con 0x7f94480051c0 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f944800c160 con 0x7f9448004800 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f944800c360 con 0x7f94480039b0 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f944800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f9464aee640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480039b0 0x7f9448003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f945ffff640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9448004800 0x7f9448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 -- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480039b0 msgr2=0x7f9448003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480039b0 0x7f9448003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 -- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9448004800 msgr2=0x7f9448004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9448004800 0x7f9448004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.384+0000 7f94652ef640 1 -- 172.21.15.134:0/1564269016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9448003520 con 0x7f94480051c0 2024-09-15T22:45:43.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.385+0000 7f94652ef640 1 -- 172.21.15.134:0/1564269016 reap_dead start 2024-09-15T22:45:43.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.385+0000 7f94652ef640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f944800b9c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9458001e50 tx=0x7f9448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af33f2903a40336 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.385+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458001a70 con 0x7f94480051c0 2024-09-15T22:45:43.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.385+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9458003970 con 0x7f94480051c0 2024-09-15T22:45:43.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.385+0000 7f945f7fe640 1 -- 172.21.15.134:0/1564269016 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458003d60 con 0x7f94480051c0 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 -- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 msgr2=0x7f944800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f944800b9c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9458001e50 tx=0x7f9448005830 comp rx=0 tx=0).stop 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 -- 172.21.15.134:0/1564269016 shutdown_connections 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 --2- 172.21.15.134:0/1564269016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f944800b9c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 -- 172.21.15.134:0/1564269016 >> 172.21.15.134:0/1564269016 conn(0x7f94600b2480 msgr2=0x7f94600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 -- 172.21.15.134:0/1564269016 shutdown_connections 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.386+0000 7f9466d52640 1 -- 172.21.15.134:0/1564269016 wait complete. 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.387+0000 7f9466d52640 1 Processor -- start 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.387+0000 7f9466d52640 1 -- start start 2024-09-15T22:45:43.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480051c0 0x7f9460161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946015f3d0 0x7f94601598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94600d0660 con 0x7f946006f580 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94600ced40 con 0x7f946015f3d0 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9466d52640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f94600d07e0 con 0x7f94480051c0 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48902/0 (socket says 172.21.15.134:48902) 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 -- 172.21.15.134:0/549569150 learned_addr learned my addr 172.21.15.134:0/549569150 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f9464aee640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480051c0 0x7f9460161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f94652ef640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946015f3d0 0x7f94601598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 -- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480051c0 msgr2=0x7f9460161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480051c0 0x7f9460161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 -- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946015f3d0 msgr2=0x7f94601598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946015f3d0 0x7f94601598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 -- 172.21.15.134:0/549569150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946006e7c0 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.388+0000 7f945ffff640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9454001e80 tx=0x7f9454007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.389+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400f960 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.389+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9454018070 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.389+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946006eaa0 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.389+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400fd60 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.389+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946006f060 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.390+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94600ae8e0 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.390+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f945401d460 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.391+0000 7f945d7fa640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 0x7f944c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.391+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f945408b4c0 con 0x7f946006f580 2024-09-15T22:45:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.391+0000 7f9464aee640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 0x7f944c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.391+0000 7f9464aee640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 0x7f944c06e890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9450009b40 tx=0x7f9450009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.395+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9454059b80 con 0x7f946006f580 2024-09-15T22:45:43.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.561+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94600d1250 con 0x7f946006f580 2024-09-15T22:45:43.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.562+0000 7f945d7fa640 1 -- 172.21.15.134:0/549569150 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16899 (secure 0 0 0) 0x7f9454059480 con 0x7f946006f580 2024-09-15T22:45:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:43.564 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":95,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:40.536845+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:22.241856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:22.832685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6834/3275361990":"2024-09-16T22:45:37.532338+0000","172.21.15.177:6832/3275361990":"2024-09-16T22:45:37.532338+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:43.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 msgr2=0x7f944c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 0x7f944c06e890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9450009b40 tx=0x7f9450009190 comp rx=0 tx=0).stop 2024-09-15T22:45:43.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 msgr2=0x7f9460156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9454001e80 tx=0x7f9454007660 comp rx=0 tx=0).stop 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 shutdown_connections 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946015f3d0 0x7f94601598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f944c06c3d0 0x7f944c06e890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f946006f580 0x7f9460156560 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 --2- 172.21.15.134:0/549569150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94480051c0 0x7f9460161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 >> 172.21.15.134:0/549569150 conn(0x7f94600b2480 msgr2=0x7f94600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 shutdown_connections 2024-09-15T22:45:43.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.564+0000 7f9466d52640 1 -- 172.21.15.134:0/549569150 wait complete. 2024-09-15T22:45:43.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:45:43.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.676+0000 7f664135f640 1 Processor -- start 2024-09-15T22:45:43.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.676+0000 7f664135f640 1 -- start start 2024-09-15T22:45:43.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f664135f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f663c0b3550 0x7f663c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f664135f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f663c0ce200 0x7f663c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f664135f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663c0b5a60 con 0x7f663c15c3d0 2024-09-15T22:45:43.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f664135f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f663c0b3ed0 con 0x7f663c0b3550 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f664135f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f663c0b5d00 con 0x7f663c0ce200 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f663c0b3550 0x7f663c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f663c0b3550 0x7f663c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48912/0 (socket says 172.21.15.134:48912) 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f663c15c3d0 0x7f663c0b67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34568/0 (socket says 172.21.15.134:34568) 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 -- 172.21.15.134:0/3440054203 learned_addr learned my addr 172.21.15.134:0/3440054203 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663b7fe640 1 --2- 172.21.15.134:0/3440054203 >> v2:172.21.15.177:3300/0 conn(0x7f663c0ce200 0x7f663c0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 -- 172.21.15.134:0/3440054203 >> v2:172.21.15.177:3300/0 conn(0x7f663c0ce200 msgr2=0x7f663c0ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 --2- 172.21.15.134:0/3440054203 >> v2:172.21.15.177:3300/0 conn(0x7f663c0ce200 0x7f663c0ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 -- 172.21.15.134:0/3440054203 >> v1:172.21.15.134:6789/0 conn(0x7f663c15c3d0 legacy=0x7f663c0b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f6639ffb640 1 -- 172.21.15.134:0/3440054203 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641104873 0 0) 0x7f663c0b5a60 con 0x7f663c15c3d0 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.677+0000 7f663a7fc640 1 -- 172.21.15.134:0/3440054203 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c0b5fe0 con 0x7f663c0b3550 2024-09-15T22:45:43.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.678+0000 7f663a7fc640 1 --2- 172.21.15.134:0/3440054203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c0b3990 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b4050 tx=0x7f662402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372b47be9839f474 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.678+0000 7f6639ffb640 1 -- 172.21.15.134:0/3440054203 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624037070 con 0x7f663c0b3550 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.678+0000 7f6639ffb640 1 -- 172.21.15.134:0/3440054203 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6624032440 con 0x7f663c0b3550 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.678+0000 7f6639ffb640 1 -- 172.21.15.134:0/3440054203 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624032810 con 0x7f663c0b3550 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 -- 172.21.15.134:0/3440054203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 msgr2=0x7f663c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 --2- 172.21.15.134:0/3440054203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c0b3990 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b4050 tx=0x7f662402a270 comp rx=0 tx=0).stop 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 -- 172.21.15.134:0/3440054203 shutdown_connections 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 --2- 172.21.15.134:0/3440054203 >> v2:172.21.15.177:3300/0 conn(0x7f663c0ce200 0x7f663c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 --2- 172.21.15.134:0/3440054203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c0b3990 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 -- 172.21.15.134:0/3440054203 >> 172.21.15.134:0/3440054203 conn(0x7f663c06ce90 msgr2=0x7f663c06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 -- 172.21.15.134:0/3440054203 shutdown_connections 2024-09-15T22:45:43.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.679+0000 7f664135f640 1 -- 172.21.15.134:0/3440054203 wait complete. 2024-09-15T22:45:43.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.680+0000 7f664135f640 1 Processor -- start 2024-09-15T22:45:43.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.680+0000 7f664135f640 1 -- start start 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 0x7f663c1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 0x7f663c146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f663c0cf0f0 con 0x7f663c0b3550 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f663c0cef70 con 0x7f663c0ce200 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f664135f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f663c0ceb90 con 0x7f663c15c3d0 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48922/0 (socket says 172.21.15.134:48922) 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 -- 172.21.15.134:0/197812034 learned_addr learned my addr 172.21.15.134:0/197812034 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663a7fc640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 0x7f663c1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663b7fe640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 0x7f663c146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 -- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 msgr2=0x7f663c146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 0x7f663c146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 -- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 msgr2=0x7f663c1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 0x7f663c1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 -- 172.21.15.134:0/197812034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c1f64c0 con 0x7f663c0b3550 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663a7fc640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 0x7f663c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663b7fe640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 0x7f663c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.681+0000 7f663affd640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f663400c7c0 tx=0x7f663400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.682+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634018070 con 0x7f663c0b3550 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.682+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663400a640 con 0x7f663c0b3550 2024-09-15T22:45:43.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.682+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663400aa30 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.682+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c1e4b70 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.682+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1e5410 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.683+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663c0b3990 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.683+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f663401b070 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.684+0000 7f66337fe640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 0x7f661c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.684+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5795+0+0 (secure 0 0 0) 0x7f663408ac10 con 0x7f663c0b3550 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.684+0000 7f663a7fc640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 0x7f661c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.685+0000 7f663a7fc640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 0x7f661c06e890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6624034000 tx=0x7f662402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.688+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66340592a0 con 0x7f663c0b3550 2024-09-15T22:45:43.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.887+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f663c075f90 con 0x7f663c0b3550 2024-09-15T22:45:43.888 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:45:43.887+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:45:43.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.890+0000 7f66337fe640 1 -- 172.21.15.134:0/197812034 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f6634058ba0 con 0x7f663c0b3550 2024-09-15T22:45:43.892 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 msgr2=0x7f661c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 0x7f661c06e890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6624034000 tx=0x7f662402e000 comp rx=0 tx=0).stop 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 msgr2=0x7f663c156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f663400c7c0 tx=0x7f663400cc80 comp rx=0 tx=0).stop 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 shutdown_connections 2024-09-15T22:45:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f663c15c3d0 0x7f663c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c0ce200 0x7f663c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f661c06c3d0 0x7f661c06e890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 --2- 172.21.15.134:0/197812034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f663c0b3550 0x7f663c156d00 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 >> 172.21.15.134:0/197812034 conn(0x7f663c06ce90 msgr2=0x7f663c15e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 shutdown_connections 2024-09-15T22:45:43.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:43.893+0000 7f664135f640 1 -- 172.21.15.134:0/197812034 wait complete. 2024-09-15T22:45:43.899 INFO:tasks.ceph.mds.a.smithi134.stderr: -1070> 2024-09-15T22:45:30.515+0000 7ff63ab70640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:45:43.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:45:43.924 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:45:44.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.005+0000 7f2d83be8640 1 Processor -- start 2024-09-15T22:45:44.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.006+0000 7f2d83be8640 1 -- start start 2024-09-15T22:45:44.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.006+0000 7f2d83be8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d7c161e30 0x7f2d7c0d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.006+0000 7f2d83be8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c0cf9a0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.006+0000 7f2d83be8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c162210 con 0x7f2d7c06dfd0 2024-09-15T22:45:44.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.006+0000 7f2d83be8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d7c0cfcf0 con 0x7f2d7c161e30 2024-09-15T22:45:44.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81984640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d7c161e30 0x7f2d7c0d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81183640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2d7c0b3d50 0x7f2d7c06d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:34574/0 (socket says 172.21.15.134:34574) 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81183640 1 -- 172.21.15.134:0/1978510810 learned_addr learned my addr 172.21.15.134:0/1978510810 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81984640 1 -- 172.21.15.134:0/1978510810 >> v1:172.21.15.177:6789/0 conn(0x7f2d7c06dfd0 legacy=0x7f2d7c0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81984640 1 -- 172.21.15.134:0/1978510810 >> v1:172.21.15.134:6789/0 conn(0x7f2d7c0b3d50 legacy=0x7f2d7c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d80982640 1 -- 172.21.15.134:0/1978510810 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656151116 0 0) 0x7f2d7c0cf9a0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.007+0000 7f2d81984640 1 -- 172.21.15.134:0/1978510810 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c0d5210 con 0x7f2d7c161e30 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d81984640 1 --2- 172.21.15.134:0/1978510810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c161e30 0x7f2d7c0d34a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2d780097a0 tx=0x7f2d7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fab2a515e23aad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d80982640 1 -- 172.21.15.134:0/1978510810 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78037070 con 0x7f2d7c161e30 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d80982640 1 -- 172.21.15.134:0/1978510810 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d78032440 con 0x7f2d7c161e30 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d80982640 1 -- 172.21.15.134:0/1978510810 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78032810 con 0x7f2d7c161e30 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 -- 172.21.15.134:0/1978510810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c161e30 msgr2=0x7f2d7c0d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1978510810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c161e30 0x7f2d7c0d34a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2d780097a0 tx=0x7f2d7802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 -- 172.21.15.134:0/1978510810 shutdown_connections 2024-09-15T22:45:44.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1978510810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c161e30 0x7f2d7c0d34a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 -- 172.21.15.134:0/1978510810 >> 172.21.15.134:0/1978510810 conn(0x7f2d7c0d1870 msgr2=0x7f2d7c0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:44.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 -- 172.21.15.134:0/1978510810 shutdown_connections 2024-09-15T22:45:44.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.008+0000 7f2d83be8640 1 -- 172.21.15.134:0/1978510810 wait complete. 2024-09-15T22:45:44.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.009+0000 7f2d83be8640 1 Processor -- start 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.009+0000 7f2d83be8640 1 -- start start 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7c06dfd0 0x7f2d7c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 0x7f2d7c144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0d39e0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0b3950 con 0x7f2d7c06dfd0 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d83be8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c1f4370 con 0x7f2d7c161e30 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d81183640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d81183640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48932/0 (socket says 172.21.15.134:48932) 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d81183640 1 -- 172.21.15.134:0/1647482701 learned_addr learned my addr 172.21.15.134:0/1647482701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d81984640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7c06dfd0 0x7f2d7c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.010+0000 7f2d82185640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 0x7f2d7c144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 -- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 msgr2=0x7f2d7c144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 0x7f2d7c144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 -- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7c06dfd0 msgr2=0x7f2d7c0b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7c06dfd0 0x7f2d7c0b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 -- 172.21.15.134:0/1647482701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c0c87b0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d82185640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 0x7f2d7c144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d81183640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c490 tx=0x7f2d6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c018070 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0074e0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c0cd490 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004a20 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.011+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c0cda50 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.012+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c0d2cf0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.013+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f2d6c01b070 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.013+0000 7f2d727fc640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 0x7f2d6006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.013+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5881+0+0 (secure 0 0 0) 0x7f2d6c08a950 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.013+0000 7f2d81984640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 0x7f2d6006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.014+0000 7f2d81984640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 0x7f2d6006e890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d78034000 tx=0x7f2d7802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.018+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d7c0d2cf0 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.219+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2d7c0cdc50 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.894+0000 7f2d727fc640 1 -- 172.21.15.134:0/1647482701 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f2d6c058820 con 0x7f2d7c0b3d50 2024-09-15T22:45:44.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 msgr2=0x7f2d6006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 0x7f2d6006e890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d78034000 tx=0x7f2d7802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:44.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 msgr2=0x7f2d7c144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c490 tx=0x7f2d6c00c950 comp rx=0 tx=0).stop 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 shutdown_connections 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d7c161e30 0x7f2d7c144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d6006c3d0 0x7f2d6006e890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7c0b3d50 0x7f2d7c144a10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 --2- 172.21.15.134:0/1647482701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7c06dfd0 0x7f2d7c0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 >> 172.21.15.134:0/1647482701 conn(0x7f2d7c0d1870 msgr2=0x7f2d7c0b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 shutdown_connections 2024-09-15T22:45:44.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:44.897+0000 7f2d83be8640 1 -- 172.21.15.134:0/1647482701 wait complete. 2024-09-15T22:45:44.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:45:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.060+0000 7f6a725a6640 1 Processor -- start 2024-09-15T22:45:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.060+0000 7f6a725a6640 1 -- start start 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c145d90 0x7f6a6c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 0x7f6a6c1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c06d080 con 0x7f6a6c0cd490 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c0b4240 con 0x7f6a6c0cfb10 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a725a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b4520 con 0x7f6a6c145d90 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a6b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a6b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48936/0 (socket says 172.21.15.134:48936) 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/238201728 learned_addr learned my addr 172.21.15.134:0/238201728 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a70b43640 1 --2- 172.21.15.134:0/238201728 >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 0x7f6a6c1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.061+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c145d90 0x7f6a6c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/238201728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c145d90 msgr2=0x7f6a6c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c145d90 0x7f6a6c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/238201728 >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 msgr2=0x7f6a6c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 --2- 172.21.15.134:0/238201728 >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 0x7f6a6c1601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/238201728 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0b4800 con 0x7f6a6c0cd490 2024-09-15T22:45:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a70b43640 1 --2- 172.21.15.134:0/238201728 >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 0x7f6a6c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6b7fe640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c15cbc0 tx=0x7f6a6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d40f7cc5395f855 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6affd640 1 -- 172.21.15.134:0/238201728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60037070 con 0x7f6a6c0cd490 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6affd640 1 -- 172.21.15.134:0/238201728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a60032440 con 0x7f6a6c0cd490 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.062+0000 7f6a6affd640 1 -- 172.21.15.134:0/238201728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60032810 con 0x7f6a6c0cd490 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 -- 172.21.15.134:0/238201728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c0cd490 msgr2=0x7f6a6c0cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c15cbc0 tx=0x7f6a6002a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 -- 172.21.15.134:0/238201728 shutdown_connections 2024-09-15T22:45:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 --2- 172.21.15.134:0/238201728 >> v2:172.21.15.177:3300/0 conn(0x7f6a6c0cfb10 0x7f6a6c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c0cf5d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 --2- 172.21.15.134:0/238201728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c145d90 0x7f6a6c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 -- 172.21.15.134:0/238201728 >> 172.21.15.134:0/238201728 conn(0x7f6a6c06bba0 msgr2=0x7f6a6c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 -- 172.21.15.134:0/238201728 shutdown_connections 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.063+0000 7f6a725a6640 1 -- 172.21.15.134:0/238201728 wait complete. 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.064+0000 7f6a725a6640 1 Processor -- start 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.064+0000 7f6a725a6640 1 -- start start 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c13a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c0cfb10 0x7f6a6c136490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b5610 con 0x7f6a6c145d90 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cffc0 con 0x7f6a6c0cd490 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a725a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b5790 con 0x7f6a6c0cfb10 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a70b43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a70b43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48940/0 (socket says 172.21.15.134:48940) 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a70b43640 1 -- 172.21.15.134:0/4126696979 learned_addr learned my addr 172.21.15.134:0/4126696979 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c13a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.065+0000 7f6a70b43640 1 -- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c0cfb10 msgr2=0x7f6a6c136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a70b43640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c0cfb10 0x7f6a6c136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a70b43640 1 -- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 msgr2=0x7f6a6c13a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a70b43640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c13a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a70b43640 1 -- 172.21.15.134:0/4126696979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c13a940 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c13a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a70b43640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6a64007cc0 tx=0x7f6a6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6401a070 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64003990 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c0caa40 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64003d60 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.066+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c0cb000 con 0x7f6a6c145d90 2024-09-15T22:45:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.067+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c146250 con 0x7f6a6c145d90 2024-09-15T22:45:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.067+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f6a6401d070 con 0x7f6a6c145d90 2024-09-15T22:45:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.068+0000 7f6a68ff9640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 0x7f6a5806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.068+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5881+0+0 (secure 0 0 0) 0x7f6a6408b8f0 con 0x7f6a6c145d90 2024-09-15T22:45:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.068+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 0x7f6a5806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.069+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 0x7f6a5806e890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c006fd0 tx=0x7f6a5c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.072+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a64010070 con 0x7f6a6c145d90 2024-09-15T22:45:45.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.242+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a6c0634e0 con 0x7f6a6c145d90 2024-09-15T22:45:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.903+0000 7f6a68ff9640 1 -- 172.21.15.134:0/4126696979 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f6a64059d90 con 0x7f6a6c145d90 2024-09-15T22:45:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:45:45.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 msgr2=0x7f6a5806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 0x7f6a5806e890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c006fd0 tx=0x7f6a5c008040 comp rx=0 tx=0).stop 2024-09-15T22:45:45.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 msgr2=0x7f6a6c1369d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6a64007cc0 tx=0x7f6a6400d4a0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 shutdown_connections 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a5806c3d0 0x7f6a5806e890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c145d90 0x7f6a6c1369d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c0cfb10 0x7f6a6c136490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 --2- 172.21.15.134:0/4126696979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c0cd490 0x7f6a6c13a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 >> 172.21.15.134:0/4126696979 conn(0x7f6a6c06bba0 msgr2=0x7f6a6c15fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 shutdown_connections 2024-09-15T22:45:45.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:45.906+0000 7f6a725a6640 1 -- 172.21.15.134:0/4126696979 wait complete. 2024-09-15T22:45:45.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:45:46.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.029+0000 7fe18adc4640 1 Processor -- start 2024-09-15T22:45:46.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.029+0000 7fe18adc4640 1 -- start start 2024-09-15T22:45:46.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe18adc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 0x7fe184072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe18adc4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe18415f9f0 0x7fe18406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe18adc4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18415c970 con 0x7fe18406ef60 2024-09-15T22:45:46.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe18adc4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe18415fef0 con 0x7fe18415f9f0 2024-09-15T22:45:46.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe18adc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe18415bbb0 con 0x7fe18415b370 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe18415f9f0 0x7fe18406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe18415f9f0 0x7fe18406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48954/0 (socket says 172.21.15.134:48954) 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 -- 172.21.15.134:0/3995400139 learned_addr learned my addr 172.21.15.134:0/3995400139 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe188b60640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 0x7fe184072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 -- 172.21.15.134:0/3995400139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 msgr2=0x7fe184072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 0x7fe184072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 -- 172.21.15.134:0/3995400139 >> v1:172.21.15.177:6789/0 conn(0x7fe18406ef60 legacy=0x7fe184071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe183fff640 1 -- 172.21.15.134:0/3995400139 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18415be90 con 0x7fe18415f9f0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.030+0000 7fe188b60640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 0x7fe184072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.031+0000 7fe183fff640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415f9f0 0x7fe18406ea20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe170009870 tx=0x7fe17002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c36131cf39771d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.031+0000 7fe1837fe640 1 -- 172.21.15.134:0/3995400139 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170037070 con 0x7fe18415f9f0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.031+0000 7fe1837fe640 1 -- 172.21.15.134:0/3995400139 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe170032440 con 0x7fe18415f9f0 2024-09-15T22:45:46.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.031+0000 7fe1837fe640 1 -- 172.21.15.134:0/3995400139 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170032810 con 0x7fe18415f9f0 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 -- 172.21.15.134:0/3995400139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415f9f0 msgr2=0x7fe18406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415f9f0 0x7fe18406ea20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe170009870 tx=0x7fe17002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 -- 172.21.15.134:0/3995400139 shutdown_connections 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415f9f0 0x7fe18406ea20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 --2- 172.21.15.134:0/3995400139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18415b370 0x7fe184072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 -- 172.21.15.134:0/3995400139 >> 172.21.15.134:0/3995400139 conn(0x7fe18406bba0 msgr2=0x7fe18406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 -- 172.21.15.134:0/3995400139 shutdown_connections 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.032+0000 7fe18adc4640 1 -- 172.21.15.134:0/3995400139 wait complete. 2024-09-15T22:45:46.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.033+0000 7fe18adc4640 1 Processor -- start 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.033+0000 7fe18adc4640 1 -- start start 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18406ef60 0x7fe184159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 0x7fe184151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1840731b0 con 0x7fe18415b370 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe18415c450 con 0x7fe18415f9f0 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe18adc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe1840cf4a0 con 0x7fe18406ef60 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48956/0 (socket says 172.21.15.134:48956) 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 -- 172.21.15.134:0/654454783 learned_addr learned my addr 172.21.15.134:0/654454783 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe188b60640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18406ef60 0x7fe184159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe189361640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 0x7fe184151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 -- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18406ef60 msgr2=0x7fe184159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18406ef60 0x7fe184159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 -- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 msgr2=0x7fe184151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 0x7fe184151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 -- 172.21.15.134:0/654454783 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18413ca10 con 0x7fe18415b370 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe189361640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 0x7fe184151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe183fff640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe17002a200 tx=0x7fe1700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170041020 con 0x7fe18415b370 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.034+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1700306c0 con 0x7fe18415b370 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.035+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe184152420 con 0x7fe18415b370 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.035+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170037040 con 0x7fe18415b370 2024-09-15T22:45:46.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.035+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe184151400 con 0x7fe18415b370 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.036+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18415b750 con 0x7fe18415b370 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.036+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fe170044020 con 0x7fe18415b370 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.036+0000 7fe1817fa640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 0x7fe16806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.037+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5443+0+0 (secure 0 0 0) 0x7fe1700abca0 con 0x7fe18415b370 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.037+0000 7fe188b60640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 0x7fe16806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.037+0000 7fe188b60640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 0x7fe16806e890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe178006fd0 tx=0x7fe178008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.041+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe17004b030 con 0x7fe18415b370 2024-09-15T22:45:46.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.205+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe184071ca0 con 0x7fe18415b370 2024-09-15T22:45:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.904+0000 7fe1817fa640 1 -- 172.21.15.134:0/654454783 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7fe184152420 con 0x7fe18415b370 2024-09-15T22:45:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:45:46.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.907+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 msgr2=0x7fe16806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.907+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 0x7fe16806e890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe178006fd0 tx=0x7fe178008040 comp rx=0 tx=0).stop 2024-09-15T22:45:46.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.907+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 msgr2=0x7fe18413c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.907+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe17002a200 tx=0x7fe1700046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 shutdown_connections 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18415f9f0 0x7fe184151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe16806c3d0 0x7fe16806e890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18415b370 0x7fe18413c4d0 secure :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe17002a200 tx=0x7fe1700046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 --2- 172.21.15.134:0/654454783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe18406ef60 0x7fe184159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 >> 172.21.15.134:0/654454783 conn(0x7fe18406bba0 msgr2=0x7fe184071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.908+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 shutdown_connections 2024-09-15T22:45:46.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:46.909+0000 7fe18adc4640 1 -- 172.21.15.134:0/654454783 wait complete. 2024-09-15T22:45:46.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:45:47.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.032+0000 7f9b3690a640 1 Processor -- start 2024-09-15T22:45:47.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.032+0000 7f9b3690a640 1 -- start start 2024-09-15T22:45:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b3690a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b30158e50 0x7f9b300b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b3690a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 0x7f9b300ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b3690a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3015c800 con 0x7f9b3015c370 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b3690a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300b43f0 con 0x7f9b30158e50 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b3690a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300b3630 con 0x7f9b3006f130 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b30158e50 0x7f9b300b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b30158e50 0x7f9b300b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33920/0 (socket says 172.21.15.134:33920) 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 -- 172.21.15.134:0/2654944512 learned_addr learned my addr 172.21.15.134:0/2654944512 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 -- 172.21.15.134:0/2654944512 >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 msgr2=0x7f9b300ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b34ea7640 1 --2- 172.21.15.134:0/2654944512 >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 0x7f9b300ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 --2- 172.21.15.134:0/2654944512 >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 0x7f9b300ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 -- 172.21.15.134:0/2654944512 >> v1:172.21.15.177:6789/0 conn(0x7f9b3015c370 legacy=0x7f9b3006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b2ffff640 1 -- 172.21.15.134:0/2654944512 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b300b3910 con 0x7f9b30158e50 2024-09-15T22:45:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.033+0000 7f9b34ea7640 1 --2- 172.21.15.134:0/2654944512 >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 0x7f9b300ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b2ffff640 1 --2- 172.21.15.134:0/2654944512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b30158e50 0x7f9b300b5050 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9b30069580 tx=0x7f9b2002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f256826851e2d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b2effd640 1 -- 172.21.15.134:0/2654944512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20037070 con 0x7f9b30158e50 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b2effd640 1 -- 172.21.15.134:0/2654944512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20032440 con 0x7f9b30158e50 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b2effd640 1 -- 172.21.15.134:0/2654944512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20032810 con 0x7f9b30158e50 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 -- 172.21.15.134:0/2654944512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b30158e50 msgr2=0x7f9b300b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 --2- 172.21.15.134:0/2654944512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b30158e50 0x7f9b300b5050 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9b30069580 tx=0x7f9b2002a160 comp rx=0 tx=0).stop 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 -- 172.21.15.134:0/2654944512 shutdown_connections 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 --2- 172.21.15.134:0/2654944512 >> v2:172.21.15.177:3300/0 conn(0x7f9b3006f130 0x7f9b300ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 --2- 172.21.15.134:0/2654944512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b30158e50 0x7f9b300b5050 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 -- 172.21.15.134:0/2654944512 >> 172.21.15.134:0/2654944512 conn(0x7f9b3006bba0 msgr2=0x7f9b3006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 -- 172.21.15.134:0/2654944512 shutdown_connections 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.034+0000 7f9b3690a640 1 -- 172.21.15.134:0/2654944512 wait complete. 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 Processor -- start 2024-09-15T22:45:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 -- start start 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b3006f130 0x7f9b30156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b30158e50 0x7f9b300af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30159230 con 0x7f9b3015c370 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b300b3ed0 con 0x7f9b30158e50 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.036+0000 7f9b3690a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9b300ce740 con 0x7f9b3006f130 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33932/0 (socket says 172.21.15.134:33932) 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 -- 172.21.15.134:0/140908070 learned_addr learned my addr 172.21.15.134:0/140908070 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:47.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b2ffff640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b3006f130 0x7f9b30156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b2f7fe640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b30158e50 0x7f9b300af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 -- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b3006f130 msgr2=0x7f9b30156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b3006f130 0x7f9b30156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 -- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b30158e50 msgr2=0x7f9b300af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b30158e50 0x7f9b300af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 -- 172.21.15.134:0/140908070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b300ab4a0 con 0x7f9b3015c370 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b34ea7640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800ce80 tx=0x7f9b2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2801a070 con 0x7f9b3015c370 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2800d880 con 0x7f9b3015c370 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b300ab780 con 0x7f9b3015c370 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800dc70 con 0x7f9b3015c370 2024-09-15T22:45:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.037+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b300abd40 con 0x7f9b3015c370 2024-09-15T22:45:47.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.038+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b300ac120 con 0x7f9b3015c370 2024-09-15T22:45:47.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.039+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f9b2801d070 con 0x7f9b3015c370 2024-09-15T22:45:47.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.039+0000 7f9b2cff9640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 0x7f9b1c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.040+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f9b2808ba10 con 0x7f9b3015c370 2024-09-15T22:45:47.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.040+0000 7f9b2ffff640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 0x7f9b1c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.040+0000 7f9b2ffff640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 0x7f9b1c06e890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.044+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b300ac120 con 0x7f9b3015c370 2024-09-15T22:45:47.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.219+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9b300ce200 con 0x7f9b3015c370 2024-09-15T22:45:47.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.222+0000 7f9b2cff9640 1 -- 172.21.15.134:0/140908070 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f9b28059d50 con 0x7f9b3015c370 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 msgr2=0x7f9b1c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 0x7f9b1c06e890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 msgr2=0x7f9b300af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800ce80 tx=0x7f9b2800a710 comp rx=0 tx=0).stop 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 shutdown_connections 2024-09-15T22:45:47.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.224+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9b1c06c3d0 0x7f9b1c06e890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3015c370 0x7f9b300af5b0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b30158e50 0x7f9b300af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 --2- 172.21.15.134:0/140908070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9b3006f130 0x7f9b30156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 >> 172.21.15.134:0/140908070 conn(0x7f9b3006bba0 msgr2=0x7f9b300cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 shutdown_connections 2024-09-15T22:45:47.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.225+0000 7f9b3690a640 1 -- 172.21.15.134:0/140908070 wait complete. 2024-09-15T22:45:47.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-15T22:45:47.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.334+0000 7f88d93be640 1 Processor -- start 2024-09-15T22:45:47.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.334+0000 7f88d93be640 1 -- start start 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d93be640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88d40b1980 0x7f88d40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d93be640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d40b4290 0x7f88d40b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d93be640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d4073da0 con 0x7f88d415c690 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d93be640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f88d40b4c00 con 0x7f88d40b4290 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d93be640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f88d4074060 con 0x7f88d40b1980 2024-09-15T22:45:47.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d40b4290 0x7f88d40b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d40b4290 0x7f88d40b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33934/0 (socket says 172.21.15.134:33934) 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.335+0000 7f88d37fe640 1 -- 172.21.15.134:0/3586535478 learned_addr learned my addr 172.21.15.134:0/3586535478 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88ca7fc640 1 --2- 172.21.15.134:0/3586535478 >> v2:172.21.15.177:3300/0 conn(0x7f88d40b1980 0x7f88d40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88d37fe640 1 -- 172.21.15.134:0/3586535478 >> v2:172.21.15.177:3300/0 conn(0x7f88d40b1980 msgr2=0x7f88d40b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88d37fe640 1 --2- 172.21.15.134:0/3586535478 >> v2:172.21.15.177:3300/0 conn(0x7f88d40b1980 0x7f88d40b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88d37fe640 1 -- 172.21.15.134:0/3586535478 >> v1:172.21.15.177:6789/0 conn(0x7f88d415c690 legacy=0x7f88d40d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88d37fe640 1 -- 172.21.15.134:0/3586535478 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40b6aa0 con 0x7f88d40b4290 2024-09-15T22:45:47.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.336+0000 7f88d37fe640 1 --2- 172.21.15.134:0/3586535478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d40b4290 0x7f88d40b46c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f88d40ced50 tx=0x7f88cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f0b60932bbdeb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d27fc640 1 -- 172.21.15.134:0/3586535478 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc036070 con 0x7f88d40b4290 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d27fc640 1 -- 172.21.15.134:0/3586535478 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc031600 con 0x7f88d40b4290 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d27fc640 1 -- 172.21.15.134:0/3586535478 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0319d0 con 0x7f88d40b4290 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 -- 172.21.15.134:0/3586535478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d40b4290 msgr2=0x7f88d40b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 --2- 172.21.15.134:0/3586535478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d40b4290 0x7f88d40b46c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f88d40ced50 tx=0x7f88cc02a730 comp rx=0 tx=0).stop 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 -- 172.21.15.134:0/3586535478 shutdown_connections 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 --2- 172.21.15.134:0/3586535478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d40b4290 0x7f88d40b46c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 --2- 172.21.15.134:0/3586535478 >> v2:172.21.15.177:3300/0 conn(0x7f88d40b1980 0x7f88d40b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 -- 172.21.15.134:0/3586535478 >> 172.21.15.134:0/3586535478 conn(0x7f88d4062630 msgr2=0x7f88d4062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 -- 172.21.15.134:0/3586535478 shutdown_connections 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.337+0000 7f88d93be640 1 -- 172.21.15.134:0/3586535478 wait complete. 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.338+0000 7f88d93be640 1 Processor -- start 2024-09-15T22:45:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 -- start start 2024-09-15T22:45:47.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88d40b1980 0x7f88d406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 0x7f88d41f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88d415cbf0 con 0x7f88d415c690 2024-09-15T22:45:47.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88d415ca70 con 0x7f88d40b4290 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d93be640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f88d40d0c50 con 0x7f88d40b1980 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33942/0 (socket says 172.21.15.134:33942) 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.339+0000 7f88d37fe640 1 -- 172.21.15.134:0/753430985 learned_addr learned my addr 172.21.15.134:0/753430985 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88ca7fc640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 0x7f88d41f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 -- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88d40b1980 msgr2=0x7f88d406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d2ffd640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88d40b1980 0x7f88d406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88d40b1980 0x7f88d406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 -- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 msgr2=0x7f88d41f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 0x7f88d41f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 -- 172.21.15.134:0/753430985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d406d290 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88ca7fc640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 0x7f88d41f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d37fe640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f88cc034040 tx=0x7f88cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc036050 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc042070 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d406d570 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc009510 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.340+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d406db30 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.341+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d40b6010 con 0x7f88d415c690 2024-09-15T22:45:47.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.342+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f88cc007bf0 con 0x7f88d415c690 2024-09-15T22:45:47.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.342+0000 7f88cbfff640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 0x7f88b406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:47.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.342+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f88cc0ac180 con 0x7f88d415c690 2024-09-15T22:45:47.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.342+0000 7f88d2ffd640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 0x7f88b406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:47.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.343+0000 7f88d2ffd640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 0x7f88b406e890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88c40015a0 tx=0x7f88c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:47.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.346+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88cc07aa00 con 0x7f88d415c690 2024-09-15T22:45:47.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.576+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f88d4062bb0 con 0x7f88d415c690 2024-09-15T22:45:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.914+0000 7f88cbfff640 1 -- 172.21.15.134:0/753430985 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v244) ==== 146+0+0 (secure 0 0 0) 0x7f88cc07a300 con 0x7f88d415c690 2024-09-15T22:45:47.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 msgr2=0x7f88b406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 0x7f88b406e890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88c40015a0 tx=0x7f88c4009040 comp rx=0 tx=0).stop 2024-09-15T22:45:47.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 msgr2=0x7f88d414e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f88cc034040 tx=0x7f88cc004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 shutdown_connections 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f88b406c3d0 0x7f88b406e890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d415c690 0x7f88d414e2f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d40b4290 0x7f88d41f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 --2- 172.21.15.134:0/753430985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88d40b1980 0x7f88d406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 >> 172.21.15.134:0/753430985 conn(0x7f88d4062630 msgr2=0x7f88d40d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 shutdown_connections 2024-09-15T22:45:47.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:47.917+0000 7f88d93be640 1 -- 172.21.15.134:0/753430985 wait complete. 2024-09-15T22:45:47.930 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-15T22:45:47.930 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-15T22:45:47.930 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:45:47.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:48.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.030+0000 7fab3d4f1640 1 Processor -- start 2024-09-15T22:45:48.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.030+0000 7fab3d4f1640 1 -- start start 2024-09-15T22:45:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab3d4f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab380d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab3d4f1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380b7170 con 0x7fab380cef90 2024-09-15T22:45:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab3d4f1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380b7aa0 con 0x7fab3815ed20 2024-09-15T22:45:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab3d4f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab380d3660 con 0x7fab3815e940 2024-09-15T22:45:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab377fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fab380cef90 0x7fab380b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42428/0 (socket says 172.21.15.134:42428) 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab377fe640 1 -- 172.21.15.134:0/1348488847 learned_addr learned my addr 172.21.15.134:0/1348488847 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab36ffd640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab380d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263876075 0 0) 0x7fab30001490 con 0x7fab380cef90 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab24003520 con 0x7fab380cef90 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526186785 0 0) 0x7fab24003520 con 0x7fab380cef90 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 msgr2=0x7fab380d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab380d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 >> v1:172.21.15.177:6789/0 conn(0x7fab3815ed20 legacy=0x7fab380b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380d3940 con 0x7fab380cef90 2024-09-15T22:45:48.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fab30001bc0 con 0x7fab380cef90 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 >> v1:172.21.15.134:6789/0 conn(0x7fab380cef90 legacy=0x7fab380b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.031+0000 7fab367fc640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab240039e0 0x7fab24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab367fc640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab367fc640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab24004d40 0x7fab240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab380d3660 con 0x7fab24004d40 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab2400b9c0 con 0x7fab240039e0 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab2400bbc0 con 0x7fab3815e940 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab24004d40 0x7fab240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab36ffd640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab240039e0 0x7fab24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab2ffff640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 -- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 msgr2=0x7fab24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab3815e940 0x7fab24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 -- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab240039e0 msgr2=0x7fab24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab240039e0 0x7fab24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.032+0000 7fab377fe640 1 -- 172.21.15.134:0/1348488847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab24003520 con 0x7fab24004d40 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab377fe640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab24004d40 0x7fab240051c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fab3000a9b0 tx=0x7fab24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5306ae806c3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3000a5d0 con 0x7fab24004d40 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3002f070 con 0x7fab24004d40 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab367fc640 1 -- 172.21.15.134:0/1348488847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3002bde0 con 0x7fab24004d40 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 -- 172.21.15.134:0/1348488847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab24004d40 msgr2=0x7fab240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/1348488847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab24004d40 0x7fab240051c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fab3000a9b0 tx=0x7fab24005830 comp rx=0 tx=0).stop 2024-09-15T22:45:48.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab377fe640 1 -- 172.21.15.134:0/1348488847 reap_dead start 2024-09-15T22:45:48.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 -- 172.21.15.134:0/1348488847 shutdown_connections 2024-09-15T22:45:48.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 -- 172.21.15.134:0/1348488847 >> 172.21.15.134:0/1348488847 conn(0x7fab380b6240 msgr2=0x7fab380b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 -- 172.21.15.134:0/1348488847 shutdown_connections 2024-09-15T22:45:48.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.033+0000 7fab3d4f1640 1 -- 172.21.15.134:0/1348488847 wait complete. 2024-09-15T22:45:48.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 Processor -- start 2024-09-15T22:45:48.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 -- start start 2024-09-15T22:45:48.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab24004d40 0x7fab380cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 0x7fab38155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fab380d3310 con 0x7fab380cb800 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab380d3f00 con 0x7fab380cbc80 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab3d4f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fab380d1ef0 con 0x7fab24004d40 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab2ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab2ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33962/0 (socket says 172.21.15.134:33962) 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.035+0000 7fab2ffff640 1 -- 172.21.15.134:0/4157135914 learned_addr learned my addr 172.21.15.134:0/4157135914 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab377fe640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 0x7fab38155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab36ffd640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab24004d40 0x7fab380cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 -- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab24004d40 msgr2=0x7fab380cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab24004d40 0x7fab380cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 -- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 msgr2=0x7fab38155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 0x7fab38155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 -- 172.21.15.134:0/4157135914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380cc1e0 con 0x7fab380cb800 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab377fe640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 0x7fab38155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2ffff640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fab2000f7c0 tx=0x7fab2000fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200050d0 con 0x7fab380cb800 2024-09-15T22:45:48.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab20018070 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2000d730 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab380cc4c0 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.036+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab380cca80 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.037+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab380d1060 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.037+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fab2000d8d0 con 0x7fab380cb800 2024-09-15T22:45:48.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.038+0000 7fab2f7fe640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 0x7fab1806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.038+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7fab2008b210 con 0x7fab380cb800 2024-09-15T22:45:48.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.038+0000 7fab36ffd640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 0x7fab1806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.039+0000 7fab36ffd640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 0x7fab1806e8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3815dd20 tx=0x7fab28009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.042+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab2001a310 con 0x7fab380cb800 2024-09-15T22:45:48.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.208+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab380ba6b0 con 0x7fab380cb800 2024-09-15T22:45:48.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.209+0000 7fab2f7fe640 1 -- 172.21.15.134:0/4157135914 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+13203 (secure 0 0 0) 0x7fab20059b10 con 0x7fab380cb800 2024-09-15T22:45:48.293 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:48.293 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":98,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:46.903790+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6825/1978323940":"2024-09-16T22:45:43.888356+0000","172.21.15.177:6834/3275361990":"2024-09-16T22:45:37.532338+0000","172.21.15.134:6835/1978323940":"2024-09-16T22:45:43.888356+0000","172.21.15.177:6832/3275361990":"2024-09-16T22:45:37.532338+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:48.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 msgr2=0x7fab1806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 0x7fab1806e8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3815dd20 tx=0x7fab28009190 comp rx=0 tx=0).stop 2024-09-15T22:45:48.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 msgr2=0x7fab381558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fab2000f7c0 tx=0x7fab2000fbc0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 shutdown_connections 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cbc80 0x7fab38155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fab1806c400 0x7fab1806e8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab380cb800 0x7fab381558e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 --2- 172.21.15.134:0/4157135914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab24004d40 0x7fab380cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 >> 172.21.15.134:0/4157135914 conn(0x7fab380b6240 msgr2=0x7fab381600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 shutdown_connections 2024-09-15T22:45:48.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.211+0000 7fab3d4f1640 1 -- 172.21.15.134:0/4157135914 wait complete. 2024-09-15T22:45:48.296 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:45:48.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:45:48.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.396+0000 7f97fff78640 1 Processor -- start 2024-09-15T22:45:48.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.396+0000 7f97fff78640 1 -- start start 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fff78640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97f8158e50 0x7f97f80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fff78640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fff78640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f815c800 con 0x7f97f806ef60 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fff78640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f97f806f3d0 con 0x7f97f8158e50 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fff78640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f97f80b43f0 con 0x7f97f815c370 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97f8158e50 0x7f97f80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97f8158e50 0x7f97f80b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33968/0 (socket says 172.21.15.134:33968) 2024-09-15T22:45:48.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 -- 172.21.15.134:0/1058107944 learned_addr learned my addr 172.21.15.134:0/1058107944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fd513640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 -- 172.21.15.134:0/1058107944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 msgr2=0x7f97f806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 -- 172.21.15.134:0/1058107944 >> v1:172.21.15.177:6789/0 conn(0x7f97f806ef60 legacy=0x7f97f815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.397+0000 7f97fdd14640 1 -- 172.21.15.134:0/1058107944 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f80b3630 con 0x7f97f8158e50 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.398+0000 7f97fdd14640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80b5050 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009870 tx=0x7f97f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b59ac7a8b52aea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.398+0000 7f97fcd12640 1 -- 172.21.15.134:0/1058107944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4037070 con 0x7f97f8158e50 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.398+0000 7f97fcd12640 1 -- 172.21.15.134:0/1058107944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f4032440 con 0x7f97f8158e50 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.398+0000 7f97fcd12640 1 -- 172.21.15.134:0/1058107944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4032810 con 0x7f97f8158e50 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 -- 172.21.15.134:0/1058107944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 msgr2=0x7f97f80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80b5050 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009870 tx=0x7f97f402a270 comp rx=0 tx=0).stop 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 -- 172.21.15.134:0/1058107944 shutdown_connections 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 --2- 172.21.15.134:0/1058107944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80b5050 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 -- 172.21.15.134:0/1058107944 >> 172.21.15.134:0/1058107944 conn(0x7f97f806bba0 msgr2=0x7f97f806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 -- 172.21.15.134:0/1058107944 shutdown_connections 2024-09-15T22:45:48.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.399+0000 7f97fff78640 1 -- 172.21.15.134:0/1058107944 wait complete. 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 Processor -- start 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 -- start start 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f806ef60 0x7f97f8165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f8148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97f80b3ed0 con 0x7f97f8158e50 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f97f80b3bf0 con 0x7f97f806ef60 2024-09-15T22:45:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.400+0000 7f97fff78640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f97f8159230 con 0x7f97f815c370 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33978/0 (socket says 172.21.15.134:33978) 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 -- 172.21.15.134:0/927784947 learned_addr learned my addr 172.21.15.134:0/927784947 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fdd14640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f806ef60 0x7f97f8165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fe515640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f8148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 -- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 msgr2=0x7f97f8148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f8148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 -- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f806ef60 msgr2=0x7f97f8165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f806ef60 0x7f97f8165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 -- 172.21.15.134:0/927784947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f814a0a0 con 0x7f97f8158e50 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fd513640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d830 tx=0x7f97e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8005990 con 0x7f97f8158e50 2024-09-15T22:45:48.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e8005b30 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80096a0 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f8152880 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.401+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f8152e40 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.402+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f8153040 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.403+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f97e8009a50 con 0x7f97f8158e50 2024-09-15T22:45:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.403+0000 7f97ee7fc640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 0x7f97dc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.403+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f97e808b660 con 0x7f97f8158e50 2024-09-15T22:45:48.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.404+0000 7f97fdd14640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 0x7f97dc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.404+0000 7f97fdd14640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 0x7f97dc06e890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97f4034000 tx=0x7f97f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.408+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97f8153040 con 0x7f97f8158e50 2024-09-15T22:45:48.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.574+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97f8152690 con 0x7f97f8158e50 2024-09-15T22:45:48.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.575+0000 7f97ee7fc640 1 -- 172.21.15.134:0/927784947 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7f97e80599a0 con 0x7f97f8158e50 2024-09-15T22:45:48.576 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:45:48.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 msgr2=0x7f97dc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 0x7f97dc06e890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97f4034000 tx=0x7f97f402e000 comp rx=0 tx=0).stop 2024-09-15T22:45:48.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 msgr2=0x7f97f80aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d830 tx=0x7f97e800dcf0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 shutdown_connections 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97f815c370 0x7f97f8148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f97dc06c3d0 0x7f97dc06e890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f8158e50 0x7f97f80aeb50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 --2- 172.21.15.134:0/927784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f806ef60 0x7f97f8165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 >> 172.21.15.134:0/927784947 conn(0x7f97f806bba0 msgr2=0x7f97f80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 shutdown_connections 2024-09-15T22:45:48.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.577+0000 7f97fff78640 1 -- 172.21.15.134:0/927784947 wait complete. 2024-09-15T22:45:48.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-15T22:45:48.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.727+0000 7f433aa47640 1 Processor -- start 2024-09-15T22:45:48.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.727+0000 7f433aa47640 1 -- start start 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f433aa47640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f43340d02a0 0x7f43340d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f433aa47640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f43341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f433aa47640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43340d0bc0 con 0x7f433415ca40 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f433aa47640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f433415d390 con 0x7f43340d02a0 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f433aa47640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f433415d670 con 0x7f433415ceb0 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f43337fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f433415ca40 0x7f433415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42434/0 (socket says 172.21.15.134:42434) 2024-09-15T22:45:48.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f43337fe640 1 -- 172.21.15.134:0/2626395613 learned_addr learned my addr 172.21.15.134:0/2626395613 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f43341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.728+0000 7f4333fff640 1 --2- 172.21.15.134:0/2626395613 >> v2:172.21.15.177:3300/0 conn(0x7f43340d02a0 0x7f43340d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757442000 0 0) 0x7f43340d0bc0 con 0x7f433415ca40 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f431c003520 con 0x7f433415ca40 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1644618385 0 0) 0x7f431c003520 con 0x7f433415ca40 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 msgr2=0x7f43341594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f43341594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 >> v2:172.21.15.177:3300/0 conn(0x7f43340d02a0 msgr2=0x7f43340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 --2- 172.21.15.134:0/2626395613 >> v2:172.21.15.177:3300/0 conn(0x7f43340d02a0 0x7f43340d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433415d950 con 0x7f433415ca40 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f43341594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f4328001670 con 0x7f433415ca40 2024-09-15T22:45:48.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 >> v1:172.21.15.134:6789/0 conn(0x7f433415ca40 legacy=0x7f433415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f431c0039b0 0x7f431c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f431c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431c004d40 0x7f431c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f433415d390 con 0x7f431c004d40 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f433415d670 con 0x7f431c0039b0 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f431c00dbd0 con 0x7f433415ceb0 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431c004d40 0x7f431c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4333fff640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f431c0039b0 0x7f431c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f43337fe640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f431c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 -- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 msgr2=0x7f431c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f433415ceb0 0x7f431c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 -- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f431c0039b0 msgr2=0x7f431c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f431c0039b0 0x7f431c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.729+0000 7f4338fe4640 1 -- 172.21.15.134:0/2626395613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c003520 con 0x7f431c004d40 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.730+0000 7f4338fe4640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431c004d40 0x7f431c0051c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f43340b4c00 tx=0x7f431c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88840ad307e9731 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.730+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c033070 con 0x7f431c004d40 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.730+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c003990 con 0x7f431c004d40 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.730+0000 7f4332ffd640 1 -- 172.21.15.134:0/2626395613 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c009de0 con 0x7f431c004d40 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 -- 172.21.15.134:0/2626395613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431c004d40 msgr2=0x7f431c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 --2- 172.21.15.134:0/2626395613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431c004d40 0x7f431c0051c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f43340b4c00 tx=0x7f431c005830 comp rx=0 tx=0).stop 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f4338fe4640 1 -- 172.21.15.134:0/2626395613 reap_dead start 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 -- 172.21.15.134:0/2626395613 shutdown_connections 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 -- 172.21.15.134:0/2626395613 >> 172.21.15.134:0/2626395613 conn(0x7f4334062cc0 msgr2=0x7f433406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 -- 172.21.15.134:0/2626395613 shutdown_connections 2024-09-15T22:45:48.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.731+0000 7f433aa47640 1 -- 172.21.15.134:0/2626395613 wait complete. 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.732+0000 7f433aa47640 1 Processor -- start 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.732+0000 7f433aa47640 1 -- start start 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43341f01b0 0x7f43341569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4334156f20 0x7f43341585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f433415eb40 con 0x7f43341509d0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f433415df10 con 0x7f43341f01b0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f433aa47640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4334155b90 con 0x7f4334156f20 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33992/0 (socket says 172.21.15.134:33992) 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 -- 172.21.15.134:0/1801427111 learned_addr learned my addr 172.21.15.134:0/1801427111 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f43337fe640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43341f01b0 0x7f43341569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4338fe4640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4334156f20 0x7f43341585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 -- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4334156f20 msgr2=0x7f43341585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4334156f20 0x7f43341585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 -- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43341f01b0 msgr2=0x7f43341569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43341f01b0 0x7f43341569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 -- 172.21.15.134:0/1801427111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433415b6c0 con 0x7f43341509d0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.733+0000 7f4333fff640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4324011990 tx=0x7f4324011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432400fa10 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432400fbb0 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4334150db0 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324014440 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43341f0950 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.734+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43340b4790 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.735+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f4324012040 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.735+0000 7f4330ff9640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 0x7f432006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.735+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f432408b8c0 con 0x7f43341509d0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.736+0000 7f43337fe640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 0x7f432006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.736+0000 7f43337fe640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 0x7f432006e8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4328004840 tx=0x7f4328009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.740+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f433415b6c0 con 0x7f43341509d0 2024-09-15T22:45:48.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:48.965+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f43340cfa90 con 0x7f43341509d0 2024-09-15T22:45:49.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.922+0000 7f4330ff9640 1 -- 172.21.15.134:0/1801427111 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v246) ==== 152+0+0 (secure 0 0 0) 0x7f4324019030 con 0x7f43341509d0 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 msgr2=0x7f432006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 0x7f432006e8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4328004840 tx=0x7f4328009040 comp rx=0 tx=0).stop 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 msgr2=0x7f4334150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4324011990 tx=0x7f4324011e50 comp rx=0 tx=0).stop 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 shutdown_connections 2024-09-15T22:45:49.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4334156f20 0x7f43341585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43341f01b0 0x7f43341569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f432006c400 0x7f432006e8c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 --2- 172.21.15.134:0/1801427111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43341509d0 0x7f4334150fd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 >> 172.21.15.134:0/1801427111 conn(0x7f4334062cc0 msgr2=0x7f4334153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 shutdown_connections 2024-09-15T22:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:49.925+0000 7f433aa47640 1 -- 172.21.15.134:0/1801427111 wait complete. 2024-09-15T22:45:49.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:45:50.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.046+0000 7f43bca1e640 1 Processor -- start 2024-09-15T22:45:50.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.046+0000 7f43bca1e640 1 -- start start 2024-09-15T22:45:50.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43bca1e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43b8161e30 0x7f43b80d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43bca1e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f43b80b3d50 0x7f43b806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43bca1e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b80cf9a0 con 0x7f43b80b3290 2024-09-15T22:45:50.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43bca1e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f43b80cfcf0 con 0x7f43b8161e30 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43bca1e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f43b8162210 con 0x7f43b80b3d50 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43b659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43b8161e30 0x7f43b80d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43b659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43b8161e30 0x7f43b80d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34006/0 (socket says 172.21.15.134:34006) 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.047+0000 7f43b659c640 1 -- 172.21.15.134:0/3013104815 learned_addr learned my addr 172.21.15.134:0/3013104815 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.048+0000 7f43b659c640 1 -- 172.21.15.134:0/3013104815 >> v2:172.21.15.177:3300/0 conn(0x7f43b80b3d50 msgr2=0x7f43b806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.048+0000 7f43b659c640 1 --2- 172.21.15.134:0/3013104815 >> v2:172.21.15.177:3300/0 conn(0x7f43b80b3d50 0x7f43b806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.048+0000 7f43b659c640 1 -- 172.21.15.134:0/3013104815 >> v1:172.21.15.177:6789/0 conn(0x7f43b80b3290 legacy=0x7f43b80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.048+0000 7f43b659c640 1 -- 172.21.15.134:0/3013104815 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80d5210 con 0x7f43b8161e30 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.048+0000 7f43b659c640 1 --2- 172.21.15.134:0/3013104815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80d34a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ba8f0 tx=0x7f43a802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926ba06d6636c9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43b559a640 1 -- 172.21.15.134:0/3013104815 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8036070 con 0x7f43b8161e30 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43b559a640 1 -- 172.21.15.134:0/3013104815 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8031600 con 0x7f43b8161e30 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43b559a640 1 -- 172.21.15.134:0/3013104815 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80319d0 con 0x7f43b8161e30 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 -- 172.21.15.134:0/3013104815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 msgr2=0x7f43b80d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 --2- 172.21.15.134:0/3013104815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80d34a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ba8f0 tx=0x7f43a802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 -- 172.21.15.134:0/3013104815 shutdown_connections 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 --2- 172.21.15.134:0/3013104815 >> v2:172.21.15.177:3300/0 conn(0x7f43b80b3d50 0x7f43b806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 --2- 172.21.15.134:0/3013104815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80d34a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 -- 172.21.15.134:0/3013104815 >> 172.21.15.134:0/3013104815 conn(0x7f43b80d1870 msgr2=0x7f43b80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 -- 172.21.15.134:0/3013104815 shutdown_connections 2024-09-15T22:45:50.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.049+0000 7f43bca1e640 1 -- 172.21.15.134:0/3013104815 wait complete. 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 Processor -- start 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 -- start start 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43b80b3290 0x7f43b81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43b80b3d50 0x7f43b80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80d39e0 con 0x7f43b8161e30 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80b3950 con 0x7f43b80b3d50 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43bca1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f43b80ccdf0 con 0x7f43b80b3290 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.051+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34020/0 (socket says 172.21.15.134:34020) 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 -- 172.21.15.134:0/4272263601 learned_addr learned my addr 172.21.15.134:0/4272263601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b5d9b640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43b80b3d50 0x7f43b80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b659c640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43b80b3290 0x7f43b81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 -- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43b80b3290 msgr2=0x7f43b81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43b80b3290 0x7f43b81521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 -- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43b80b3d50 msgr2=0x7f43b80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43b80b3d50 0x7f43b80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 -- 172.21.15.134:0/4272263601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80ce160 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43b6d9d640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c410 tx=0x7f43b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0017070 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b00035f0 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b80ce440 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0003a20 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.052+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b80ca390 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.053+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b80ca5f0 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.054+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f43b001a070 con 0x7f43b8161e30 2024-09-15T22:45:50.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.054+0000 7f43a6ffd640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 0x7f439806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.054+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f43b008a4a0 con 0x7f43b8161e30 2024-09-15T22:45:50.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.054+0000 7f43b659c640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 0x7f439806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.055+0000 7f43b659c640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 0x7f439806e890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43a8033000 tx=0x7f43a8009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.058+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43b00587e0 con 0x7f43b8161e30 2024-09-15T22:45:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.223+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f43b81527f0 con 0x7f43b8161e30 2024-09-15T22:45:50.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.228+0000 7f43a6ffd640 1 -- 172.21.15.134:0/4272263601 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f43b005cae0 con 0x7f43b8161e30 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 msgr2=0x7f439806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 0x7f439806e890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43a8033000 tx=0x7f43a8009000 comp rx=0 tx=0).stop 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 msgr2=0x7f43b80b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c410 tx=0x7f43b000c810 comp rx=0 tx=0).stop 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 shutdown_connections 2024-09-15T22:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f439806c3d0 0x7f439806e890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8161e30 0x7f43b80b7a80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43b80b3d50 0x7f43b80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 --2- 172.21.15.134:0/4272263601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43b80b3290 0x7f43b81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.230+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 >> 172.21.15.134:0/4272263601 conn(0x7f43b80d1870 msgr2=0x7f43b80d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.231+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 shutdown_connections 2024-09-15T22:45:50.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.231+0000 7f43bca1e640 1 -- 172.21.15.134:0/4272263601 wait complete. 2024-09-15T22:45:50.243 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:45:50.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:50.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:45:50.333 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:45:50.333 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:50.333 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:50.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:50.349 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:50.349 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:50.368 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:50.368 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:45:50.368 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:50.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:45:50.405 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:45:50.405 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:50.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:45:50.426 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:45:50.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:50.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 Processor -- start 2024-09-15T22:45:50.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 -- start start 2024-09-15T22:45:50.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c15ed20 0x7f369c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f369c0cef90 0x7f369c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c0b7170 con 0x7f369c15e940 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f369c0b7aa0 con 0x7f369c0cef90 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.543+0000 7f36a1fd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f369c0d3660 con 0x7f369c15ed20 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f369c0cef90 0x7f369c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f369c15e940 0x7f369c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42450/0 (socket says 172.21.15.134:42450) 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369b7fe640 1 -- 172.21.15.134:0/2953369869 learned_addr learned my addr 172.21.15.134:0/2953369869 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369affd640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c15ed20 0x7f369c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369bfff640 1 -- 172.21.15.134:0/2953369869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c15ed20 msgr2=0x7f369c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369bfff640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c15ed20 0x7f369c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369bfff640 1 -- 172.21.15.134:0/2953369869 >> v1:172.21.15.134:6789/0 conn(0x7f369c15e940 legacy=0x7f369c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369bfff640 1 -- 172.21.15.134:0/2953369869 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c0d3940 con 0x7f369c0cef90 2024-09-15T22:45:50.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.544+0000 7f369a7fc640 1 -- 172.21.15.134:0/2953369869 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247006451 0 0) 0x7f368c001110 con 0x7f369c15e940 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f369bfff640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c0cef90 0x7f369c0b3760 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3694009d90 tx=0x7f369402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2dc103ef023915 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f369a7fc640 1 -- 172.21.15.134:0/2953369869 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694007740 con 0x7f369c0cef90 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f369a7fc640 1 -- 172.21.15.134:0/2953369869 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36940078e0 con 0x7f369c0cef90 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f369a7fc640 1 -- 172.21.15.134:0/2953369869 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694007cb0 con 0x7f369c0cef90 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2953369869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c0cef90 msgr2=0x7f369c0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c0cef90 0x7f369c0b3760 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3694009d90 tx=0x7f369402a6f0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2953369869 shutdown_connections 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c0cef90 0x7f369c0b3760 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2953369869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c15ed20 0x7f369c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2953369869 >> 172.21.15.134:0/2953369869 conn(0x7f369c0b6240 msgr2=0x7f369c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2953369869 shutdown_connections 2024-09-15T22:45:50.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.545+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2953369869 wait complete. 2024-09-15T22:45:50.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.546+0000 7f36a1fd6640 1 Processor -- start 2024-09-15T22:45:50.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 -- start start 2024-09-15T22:45:50.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c0cef90 0x7f369c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f369c15e940 0x7f369c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0d3310 con 0x7f369c15ed20 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0d3f00 con 0x7f369c15e940 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.547+0000 7f36a1fd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f369c0d1ef0 con 0x7f369c0cef90 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34040/0 (socket says 172.21.15.134:34040) 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 -- 172.21.15.134:0/2919684870 learned_addr learned my addr 172.21.15.134:0/2919684870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369b7fe640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c0cef90 0x7f369c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369affd640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f369c15e940 0x7f369c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 -- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c0cef90 msgr2=0x7f369c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c0cef90 0x7f369c0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 -- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f369c15e940 msgr2=0x7f369c14a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f369c15e940 0x7f369c14a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 -- 172.21.15.134:0/2919684870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c0ce1e0 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f369bfff640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3694009eb0 tx=0x7f3694004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694040070 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3694031c40 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694009450 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c0cdf00 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.548+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c148b80 con 0x7f369c15ed20 2024-09-15T22:45:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.549+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c0d1060 con 0x7f369c15ed20 2024-09-15T22:45:50.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.550+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3694039040 con 0x7f369c15ed20 2024-09-15T22:45:50.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.550+0000 7f3683fff640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 0x7f368806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.550+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f36940ac330 con 0x7f369c15ed20 2024-09-15T22:45:50.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.550+0000 7f369b7fe640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 0x7f368806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.551+0000 7f369b7fe640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 0x7f368806e890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f60 tx=0x7f368c007970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.554+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f369407ab20 con 0x7f369c15ed20 2024-09-15T22:45:50.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.756+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f369c0ba6b0 con 0x7f369c15ed20 2024-09-15T22:45:50.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.756+0000 7f3683fff640 1 -- 172.21.15.134:0/2919684870 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3920 (secure 0 0 0) 0x7f369407a420 con 0x7f369c15ed20 2024-09-15T22:45:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:50.759 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":49,"btime":"2024-09-15T22:45:44:891778+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/410738687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":410738687},{"type":"v1","addr":"172.21.15.134:6834","nonce":410738687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5504,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2711090759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2711090759},{"type":"v1","addr":"172.21.15.177:6835","nonce":2711090759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3684606781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3684606781},{"type":"v1","addr":"172.21.15.177:6834","nonce":3684606781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1534370996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1534370996},{"type":"v1","addr":"172.21.15.134:6835","nonce":1534370996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-09-15T22:45:50.759 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 49 2024-09-15T22:45:50.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.758+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 msgr2=0x7f368806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.758+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 0x7f368806e890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f60 tx=0x7f368c007970 comp rx=0 tx=0).stop 2024-09-15T22:45:50.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 msgr2=0x7f369c14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3694009eb0 tx=0x7f3694004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 shutdown_connections 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368806c3d0 0x7f368806e890 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f369c15ed20 0x7f369c14ad90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f369c15e940 0x7f369c14a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 --2- 172.21.15.134:0/2919684870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369c0cef90 0x7f369c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 >> 172.21.15.134:0/2919684870 conn(0x7f369c0b6240 msgr2=0x7f369c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:50.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 shutdown_connections 2024-09-15T22:45:50.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.759+0000 7f36a1fd6640 1 -- 172.21.15.134:0/2919684870 wait complete. 2024-09-15T22:45:50.771 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:45:50.771 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:45:50.772 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:45:50.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:50.772 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:45:50.772 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:45:50.772 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:45:50.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:50.772 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:45:50.773 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:45:50.773 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:45:50.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:50.773 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:45:50.773 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:45:50.773 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:45:50.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:45:50.781 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:45:50.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:45:50.782 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:45:50.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:45:50.784 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:45:50.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:45:50.785 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:45:50.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:45:50.825 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:45:50.825 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:50.826 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:45:50.826 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:50.828 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:45:50.828 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:50.828 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:45:50.829 DEBUG:teuthology.parallel:result is None 2024-09-15T22:45:50.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:45:50.900 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:45:50.900 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:45:50.909 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:45:50.909 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:45:50.910 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-09-15T22:45:50.909+0000 7f55923da640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-15T22:45:50.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.932+0000 7ff935e84640 1 Processor -- start 2024-09-15T22:45:50.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 -- start start 2024-09-15T22:45:50.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff93015c690 0x7ff9300b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff9300b1980 0x7ff9300d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300d0a80 0x7ff9300b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff930073da0 con 0x7ff93015c690 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff930074060 con 0x7ff9300b1980 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.933+0000 7ff935e84640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9300b6aa0 con 0x7ff9300d0a80 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff93015c690 0x7ff9300b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff93015c690 0x7ff9300b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34056/0 (socket says 172.21.15.134:34056) 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 -- 172.21.15.134:0/1871022590 learned_addr learned my addr 172.21.15.134:0/1871022590 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff927fff640 1 --2- 172.21.15.134:0/1871022590 >> v2:172.21.15.177:3300/0 conn(0x7ff9300b1980 0x7ff9300d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92ffff640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300d0a80 0x7ff9300b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 -- 172.21.15.134:0/1871022590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300d0a80 msgr2=0x7ff9300b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:50.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300d0a80 0x7ff9300b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 -- 172.21.15.134:0/1871022590 >> v2:172.21.15.177:3300/0 conn(0x7ff9300b1980 msgr2=0x7ff9300d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:50.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/1871022590 >> v2:172.21.15.177:3300/0 conn(0x7ff9300b1980 0x7ff9300d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.934+0000 7ff92f7fe640 1 -- 172.21.15.134:0/1871022590 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9300733a0 con 0x7ff93015c690 2024-09-15T22:45:50.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.935+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff93015c690 0x7ff9300b6010 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff9300ced50 tx=0x7ff92002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c640266e225d2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff92effd640 1 -- 172.21.15.134:0/1871022590 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920037070 con 0x7ff93015c690 2024-09-15T22:45:50.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff92effd640 1 -- 172.21.15.134:0/1871022590 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff920032440 con 0x7ff93015c690 2024-09-15T22:45:50.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff92effd640 1 -- 172.21.15.134:0/1871022590 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920032810 con 0x7ff93015c690 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 -- 172.21.15.134:0/1871022590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff93015c690 msgr2=0x7ff9300b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff93015c690 0x7ff9300b6010 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff9300ced50 tx=0x7ff92002a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 -- 172.21.15.134:0/1871022590 shutdown_connections 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300d0a80 0x7ff9300b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 --2- 172.21.15.134:0/1871022590 >> v2:172.21.15.177:3300/0 conn(0x7ff9300b1980 0x7ff9300d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 --2- 172.21.15.134:0/1871022590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff93015c690 0x7ff9300b6010 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.939+0000 7ff935e84640 1 -- 172.21.15.134:0/1871022590 >> 172.21.15.134:0/1871022590 conn(0x7ff930062630 msgr2=0x7ff930062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:50.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.940+0000 7ff935e84640 1 -- 172.21.15.134:0/1871022590 shutdown_connections 2024-09-15T22:45:50.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.940+0000 7ff935e84640 1 -- 172.21.15.134:0/1871022590 wait complete. 2024-09-15T22:45:50.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.941+0000 7ff935e84640 1 Processor -- start 2024-09-15T22:45:50.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.941+0000 7ff935e84640 1 -- start start 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.941+0000 7ff935e84640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300b1980 0x7ff930142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.941+0000 7ff935e84640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff935e84640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff93015c690 0x7ff9301520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff935e84640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9300b4950 con 0x7ff9300d0a80 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff935e84640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9300b47d0 con 0x7ff93015c690 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff935e84640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9300b4ad0 con 0x7ff9300b1980 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34060/0 (socket says 172.21.15.134:34060) 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 -- 172.21.15.134:0/3520750072 learned_addr learned my addr 172.21.15.134:0/3520750072 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300b1980 0x7ff930142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff92ffff640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff93015c690 0x7ff9301520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 -- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300b1980 msgr2=0x7ff930142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300b1980 0x7ff930142110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 -- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff93015c690 msgr2=0x7ff9301520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff93015c690 0x7ff9301520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 -- 172.21.15.134:0/3520750072 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff930155f60 con 0x7ff9300d0a80 2024-09-15T22:45:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.942+0000 7ff927fff640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff91800e890 tx=0x7ff91800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.947+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918017070 con 0x7ff9300d0a80 2024-09-15T22:45:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.947+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff930156240 con 0x7ff9300d0a80 2024-09-15T22:45:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.947+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff930156800 con 0x7ff9300d0a80 2024-09-15T22:45:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.947+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91800c940 con 0x7ff9300d0a80 2024-09-15T22:45:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.947+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918021060 con 0x7ff9300d0a80 2024-09-15T22:45:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.948+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff914005290 con 0x7ff9300d0a80 2024-09-15T22:45:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.948+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7ff91801a070 con 0x7ff9300d0a80 2024-09-15T22:45:50.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.949+0000 7ff92cff9640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 0x7ff91006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:50.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.949+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5029+0+0 (secure 0 0 0) 0x7ff91808b5d0 con 0x7ff9300d0a80 2024-09-15T22:45:50.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.949+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 0x7ff91006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:50.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.949+0000 7ff92f7fe640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 0x7ff91006e8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff920034000 tx=0x7ff92002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:50.954+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff918059800 con 0x7ff9300d0a80 2024-09-15T22:45:51.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.133+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff914005850 con 0x7ff9300d0a80 2024-09-15T22:45:51.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:45:51.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:45:51.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.952+0000 7ff92cff9640 1 -- 172.21.15.134:0/3520750072 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) ==== 97+0+0 (secure 0 0 0) 0x7ff91805db00 con 0x7ff9300d0a80 2024-09-15T22:45:51.954 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:45:51.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 msgr2=0x7ff91006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 0x7ff91006e8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff920034000 tx=0x7ff92002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 msgr2=0x7ff930151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff91800e890 tx=0x7ff91800ed50 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 shutdown_connections 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff93015c690 0x7ff9301520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff91006c400 0x7ff91006e8c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9300d0a80 0x7ff930151b70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 --2- 172.21.15.134:0/3520750072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9300b1980 0x7ff930142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 >> 172.21.15.134:0/3520750072 conn(0x7ff930062630 msgr2=0x7ff930062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 shutdown_connections 2024-09-15T22:45:51.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:51.955+0000 7ff935e84640 1 -- 172.21.15.134:0/3520750072 wait complete. 2024-09-15T22:45:51.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:45:52.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.068+0000 7f8b870b7640 1 Processor -- start 2024-09-15T22:45:52.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.068+0000 7f8b870b7640 1 -- start start 2024-09-15T22:45:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 0x7f8b800d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 0x7f8b8015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b8015ce80 0x7f8b801594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8b800d0bc0 con 0x7f8b8015ce80 2024-09-15T22:45:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8015d390 con 0x7f8b800d02a0 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b870b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8015d670 con 0x7f8b8015ca40 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b85654640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b8015ce80 0x7f8b801594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b85654640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b8015ce80 0x7f8b801594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34076/0 (socket says 172.21.15.134:34076) 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.069+0000 7f8b85654640 1 -- 172.21.15.134:0/3930196352 learned_addr learned my addr 172.21.15.134:0/3930196352 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 -- 172.21.15.134:0/3930196352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 msgr2=0x7f8b8015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 0x7f8b8015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 0x7f8b8015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b84e53640 1 --2- 172.21.15.134:0/3930196352 >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 0x7f8b800d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 -- 172.21.15.134:0/3930196352 >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 msgr2=0x7f8b800d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 --2- 172.21.15.134:0/3930196352 >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 0x7f8b800d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 -- 172.21.15.134:0/3930196352 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8015d950 con 0x7f8b8015ce80 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 0x7f8b8015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b84e53640 1 --2- 172.21.15.134:0/3930196352 >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 0x7f8b800d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.070+0000 7f8b85654640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b8015ce80 0x7f8b801594c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b8006f030 tx=0x7f8b7802c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772887d62f3bc9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b7f7fe640 1 -- 172.21.15.134:0/3930196352 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78039070 con 0x7f8b8015ce80 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b7f7fe640 1 -- 172.21.15.134:0/3930196352 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b78009600 con 0x7f8b8015ce80 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b7f7fe640 1 -- 172.21.15.134:0/3930196352 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b780099f0 con 0x7f8b8015ce80 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 -- 172.21.15.134:0/3930196352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b8015ce80 msgr2=0x7f8b801594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b8015ce80 0x7f8b801594c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b8006f030 tx=0x7f8b7802c810 comp rx=0 tx=0).stop 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 -- 172.21.15.134:0/3930196352 shutdown_connections 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b8015ce80 0x7f8b801594c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 --2- 172.21.15.134:0/3930196352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ca40 0x7f8b8015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 --2- 172.21.15.134:0/3930196352 >> v2:172.21.15.177:3300/0 conn(0x7f8b800d02a0 0x7f8b800d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 -- 172.21.15.134:0/3930196352 >> 172.21.15.134:0/3930196352 conn(0x7f8b80062cc0 msgr2=0x7f8b8006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 -- 172.21.15.134:0/3930196352 shutdown_connections 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.071+0000 7f8b870b7640 1 -- 172.21.15.134:0/3930196352 wait complete. 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.072+0000 7f8b870b7640 1 Processor -- start 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.072+0000 7f8b870b7640 1 -- start start 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 0x7f8b80151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ce80 0x7f8b801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80155b90 con 0x7f8b800d02a0 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8015df10 con 0x7f8b8015ca40 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b870b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8b80155d10 con 0x7f8b8015ce80 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b84e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b84e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34090/0 (socket says 172.21.15.134:34090) 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.073+0000 7f8b84e53640 1 -- 172.21.15.134:0/1092262560 learned_addr learned my addr 172.21.15.134:0/1092262560 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b85654640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ce80 0x7f8b801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 0x7f8b80151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 -- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ce80 msgr2=0x7f8b801522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ce80 0x7f8b801522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 -- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 msgr2=0x7f8b80151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 0x7f8b80151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 -- 172.21.15.134:0/1092262560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800b1180 con 0x7f8b800d02a0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 0x7f8b80151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b84e53640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c7f0 tx=0x7f8b7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74015070 con 0x7f8b800d02a0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74007820 con 0x7f8b800d02a0 2024-09-15T22:45:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74007c10 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b80156440 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.074+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8014f760 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.075+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b800b4790 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.076+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f8b74018070 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.076+0000 7f8b7d7fa640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 0x7f8b6406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.076+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7f8b7408b3a0 con 0x7f8b800d02a0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.076+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 0x7f8b6406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.077+0000 7f8b7ffff640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 0x7f8b6406e8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c006fd0 tx=0x7f8b6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.080+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b74059c50 con 0x7f8b800d02a0 2024-09-15T22:45:52.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.307+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8b800b5480 con 0x7f8b800d02a0 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.308+0000 7f8b7d7fa640 1 -- 172.21.15.134:0/1092262560 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f8b74059550 con 0x7f8b800d02a0 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.309 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:45:52.310 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:45:52.311 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.312 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.312 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:52.312 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:52.312 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:45:52.314 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.315 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:45:52.316 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:45:52.318 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:45:52.319 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.320 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:52.321 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:45:52.322 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:45:52.324 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:45:52.325 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.327 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.328 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:45:52.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:45:52.330 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:52.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 msgr2=0x7f8b6406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 0x7f8b6406e8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c006fd0 tx=0x7f8b6c008040 comp rx=0 tx=0).stop 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 msgr2=0x7f8b8014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c7f0 tx=0x7f8b7400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 shutdown_connections 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015ce80 0x7f8b801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8015ca40 0x7f8b80151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b6406c400 0x7f8b6406e8c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 --2- 172.21.15.134:0/1092262560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b800d02a0 0x7f8b8014f220 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 >> 172.21.15.134:0/1092262560 conn(0x7f8b80062cc0 msgr2=0x7f8b80150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 shutdown_connections 2024-09-15T22:45:52.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.310+0000 7f8b870b7640 1 -- 172.21.15.134:0/1092262560 wait complete. 2024-09-15T22:45:52.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:45:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.433+0000 7fcafb949640 1 Processor -- start 2024-09-15T22:45:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.433+0000 7fcafb949640 1 -- start start 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcafb949640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcaf40b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcafb949640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcaf40ce910 0x7fcaf40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcafb949640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40b5a60 con 0x7fcaf40b3550 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcafb949640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf40b3ed0 con 0x7fcaf40ce910 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcafb949640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf40b5d00 con 0x7fcaf415c3d0 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaf8ee4640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fcaf40b3550 0x7fcaf40ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42484/0 (socket says 172.21.15.134:42484) 2024-09-15T22:45:52.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaf8ee4640 1 -- 172.21.15.134:0/1467052663 learned_addr learned my addr 172.21.15.134:0/1467052663 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/1467052663 >> v2:172.21.15.177:3300/0 conn(0x7fcaf40ce910 0x7fcaf40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741068426 0 0) 0x7fcaf40b5a60 con 0x7fcaf40b3550 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae0003520 con 0x7fcaf40b3550 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcaf40b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1618336831 0 0) 0x7fcae0003520 con 0x7fcaf40b3550 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 msgr2=0x7fcaf40b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.434+0000 7fcaebfff640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcaf40b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 >> v2:172.21.15.177:3300/0 conn(0x7fcaf40ce910 msgr2=0x7fcaf40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 --2- 172.21.15.134:0/1467052663 >> v2:172.21.15.177:3300/0 conn(0x7fcaf40ce910 0x7fcaf40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40b5fe0 con 0x7fcaf40b3550 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fcae4001670 con 0x7fcaf40b3550 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 >> v1:172.21.15.134:6789/0 conn(0x7fcaf40b3550 legacy=0x7fcaf40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae00039b0 0x7fcae0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcae0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcae0004d40 0x7fcae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40b3ed0 con 0x7fcae00039b0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40b5d00 con 0x7fcae0004d40 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcae000b9c0 con 0x7fcaf415c3d0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae00039b0 0x7fcae0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf8ee4640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcae0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcae0004d40 0x7fcae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 -- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 msgr2=0x7fcae0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcaf415c3d0 0x7fcae0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 -- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcae0004d40 msgr2=0x7fcae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcae0004d40 0x7fcae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf96e5640 1 -- 172.21.15.134:0/1467052663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae0003520 con 0x7fcae00039b0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.435+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcae0004d40 0x7fcae00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae00039b0 0x7fcae0003dd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ac0 tx=0x7fcae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b4bade35deee52 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0036070 con 0x7fcae00039b0 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf0031400 con 0x7fcae00039b0 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcaebfff640 1 -- 172.21.15.134:0/1467052663 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0009690 con 0x7fcae00039b0 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 -- 172.21.15.134:0/1467052663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae00039b0 msgr2=0x7fcae0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 --2- 172.21.15.134:0/1467052663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae00039b0 0x7fcae0003dd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ac0 tx=0x7fcae0005830 comp rx=0 tx=0).stop 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcaf9ee6640 1 -- 172.21.15.134:0/1467052663 reap_dead start 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 -- 172.21.15.134:0/1467052663 shutdown_connections 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 -- 172.21.15.134:0/1467052663 >> 172.21.15.134:0/1467052663 conn(0x7fcaf406ce90 msgr2=0x7fcaf406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 -- 172.21.15.134:0/1467052663 shutdown_connections 2024-09-15T22:45:52.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.436+0000 7fcafb949640 1 -- 172.21.15.134:0/1467052663 wait complete. 2024-09-15T22:45:52.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 Processor -- start 2024-09-15T22:45:52.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 -- start start 2024-09-15T22:45:52.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcae00039b0 0x7fcaf40aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaf415da70 0x7fcaf4148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40cf0f0 con 0x7fcaf415def0 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40cef70 con 0x7fcaf415da70 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcafb949640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf40b67e0 con 0x7fcae00039b0 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcaf9ee6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcaf9ee6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34108/0 (socket says 172.21.15.134:34108) 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.438+0000 7fcaf9ee6640 1 -- 172.21.15.134:0/4178863078 learned_addr learned my addr 172.21.15.134:0/4178863078 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf8ee4640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaf415da70 0x7fcaf4148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcae00039b0 0x7fcaf40aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 -- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcae00039b0 msgr2=0x7fcaf40aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcae00039b0 0x7fcaf40aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 -- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaf415da70 msgr2=0x7fcaf4148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaf415da70 0x7fcaf4148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 -- 172.21.15.134:0/4178863078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf41e7ea0 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcaf9ee6640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b4230 tx=0x7fcaec010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec010d80 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec003990 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf41e6e00 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec003dc0 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.439+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf41e73c0 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.440+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf406e7f0 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.441+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fcaec01e030 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.441+0000 7fcae9ffb640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 0x7fcad806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.441+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7fcaec08b9d0 con 0x7fcaf415def0 2024-09-15T22:45:52.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.441+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 0x7fcad806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.442+0000 7fcaf96e5640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 0x7fcad806e890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0033000 tx=0x7fcaf0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.445+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaf406e7f0 con 0x7fcaf415def0 2024-09-15T22:45:52.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.610+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcaf415fc10 con 0x7fcaf415def0 2024-09-15T22:45:52.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.611+0000 7fcae9ffb640 1 -- 172.21.15.134:0/4178863078 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) ==== 84+0+65 (secure 0 0 0) 0x7fcaf415fc10 con 0x7fcaf415def0 2024-09-15T22:45:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:52.612 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:45:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:45:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:45:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:45:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:45:52.613 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:45:52.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 msgr2=0x7fcad806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 0x7fcad806e890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0033000 tx=0x7fcaf0008030 comp rx=0 tx=0).stop 2024-09-15T22:45:52.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 msgr2=0x7fcaf4149020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b4230 tx=0x7fcaec010590 comp rx=0 tx=0).stop 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 shutdown_connections 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcad806c3d0 0x7fcad806e890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf415def0 0x7fcaf4149020 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaf415da70 0x7fcaf4148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 --2- 172.21.15.134:0/4178863078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcae00039b0 0x7fcaf40aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 >> 172.21.15.134:0/4178863078 conn(0x7fcaf406ce90 msgr2=0x7fcaf406e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 shutdown_connections 2024-09-15T22:45:52.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.613+0000 7fcafb949640 1 -- 172.21.15.134:0/4178863078 wait complete. 2024-09-15T22:45:52.626 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:45:52.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:45:52.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.725+0000 7f2ec3f5f640 1 Processor -- start 2024-09-15T22:45:52.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.726+0000 7f2ec3f5f640 1 -- start start 2024-09-15T22:45:52.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.726+0000 7f2ec3f5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ebc145d90 0x7f2ebc0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.726+0000 7f2ec3f5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ebc0cd490 0x7f2ebc0cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.726+0000 7f2ec3f5f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cfb10 0x7f2ebc1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec3f5f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc06d080 con 0x7f2ebc145d90 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec3f5f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc0b4240 con 0x7f2ebc0cd490 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec3f5f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc0b4520 con 0x7f2ebc0cfb10 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ebc145d90 0x7f2ebc0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ebc145d90 0x7f2ebc0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34122/0 (socket says 172.21.15.134:34122) 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 -- 172.21.15.134:0/1741627722 learned_addr learned my addr 172.21.15.134:0/1741627722 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec24fc640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cfb10 0x7f2ebc1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec14fa640 1 --2- 172.21.15.134:0/1741627722 >> v2:172.21.15.177:3300/0 conn(0x7f2ebc0cd490 0x7f2ebc0cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 -- 172.21.15.134:0/1741627722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cfb10 msgr2=0x7f2ebc1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cfb10 0x7f2ebc1601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 -- 172.21.15.134:0/1741627722 >> v2:172.21.15.177:3300/0 conn(0x7f2ebc0cd490 msgr2=0x7f2ebc0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/1741627722 >> v2:172.21.15.177:3300/0 conn(0x7f2ebc0cd490 0x7f2ebc0cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.727+0000 7f2ec1cfb640 1 -- 172.21.15.134:0/1741627722 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc0b4800 con 0x7f2ebc145d90 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc0ccf50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06ef20 tx=0x7f2eb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e612e7432dd1e080 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec0cf9640 1 -- 172.21.15.134:0/1741627722 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8037070 con 0x7f2ebc145d90 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec0cf9640 1 -- 172.21.15.134:0/1741627722 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8032440 con 0x7f2ebc145d90 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec0cf9640 1 -- 172.21.15.134:0/1741627722 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8032810 con 0x7f2ebc145d90 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/1741627722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 msgr2=0x7f2ebc0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc0ccf50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06ef20 tx=0x7f2eb802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/1741627722 shutdown_connections 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cfb10 0x7f2ebc1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/1741627722 >> v2:172.21.15.177:3300/0 conn(0x7f2ebc0cd490 0x7f2ebc0cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/1741627722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc0ccf50 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/1741627722 >> 172.21.15.134:0/1741627722 conn(0x7f2ebc06bba0 msgr2=0x7f2ebc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/1741627722 shutdown_connections 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.728+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/1741627722 wait complete. 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 Processor -- start 2024-09-15T22:45:52.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 -- start start 2024-09-15T22:45:52.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cd490 0x7f2ebc0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ebc0cfb10 0x7f2ebc141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0b5610 con 0x7f2ebc145d90 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0cffa0 con 0x7f2ebc0cfb10 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec3f5f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc0b5790 con 0x7f2ebc0cd490 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec24fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec24fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34130/0 (socket says 172.21.15.134:34130) 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.730+0000 7f2ec24fc640 1 -- 172.21.15.134:0/970851048 learned_addr learned my addr 172.21.15.134:0/970851048 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec14fa640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ebc0cfb10 0x7f2ebc141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cd490 0x7f2ebc0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 -- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cd490 msgr2=0x7f2ebc0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cd490 0x7f2ebc0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 -- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ebc0cfb10 msgr2=0x7f2ebc141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ebc0cfb10 0x7f2ebc141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 -- 172.21.15.134:0/970851048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc0c59b0 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec24fc640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4007cf0 tx=0x7f2eb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4014420 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb4019070 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc1f4960 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4014820 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.731+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc1f4f00 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.732+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc146200 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.733+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f2eb40149c0 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.733+0000 7f2eae7fc640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 0x7f2ea006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.733+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7f2eb408b800 con 0x7f2ebc145d90 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.733+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 0x7f2ea006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:52.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.734+0000 7f2ec1cfb640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 0x7f2ea006e890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8034000 tx=0x7f2eb802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:52.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.737+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2eb4059bf0 con 0x7f2ebc145d90 2024-09-15T22:45:52.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.905+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2ebc0c5790 con 0x7f2ebc145d90 2024-09-15T22:45:52.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.960+0000 7f2eae7fc640 1 -- 172.21.15.134:0/970851048 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) ==== 138+0+0 (secure 0 0 0) 0x7f2eb405def0 con 0x7f2ebc145d90 2024-09-15T22:45:52.961 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 msgr2=0x7f2ea006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 0x7f2ea006e890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8034000 tx=0x7f2eb802e000 comp rx=0 tx=0).stop 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 msgr2=0x7f2ebc072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4007cf0 tx=0x7f2eb400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 shutdown_connections 2024-09-15T22:45:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2ea006c3d0 0x7f2ea006e890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc145d90 0x7f2ebc072b90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ebc0cfb10 0x7f2ebc141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 --2- 172.21.15.134:0/970851048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ebc0cd490 0x7f2ebc0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.962+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 >> 172.21.15.134:0/970851048 conn(0x7f2ebc06bba0 msgr2=0x7f2ebc0b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.963+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 shutdown_connections 2024-09-15T22:45:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:52.963+0000 7f2ec3f5f640 1 -- 172.21.15.134:0/970851048 wait complete. 2024-09-15T22:45:52.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:45:53.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.081+0000 7faf1cf31640 1 Processor -- start 2024-09-15T22:45:53.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.081+0000 7faf1cf31640 1 -- start start 2024-09-15T22:45:53.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf180b61e0 0x7faf180b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b3b00 0x7faf181625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf180b3540 0x7faf18162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faf180d24f0 con 0x7faf180b3540 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7faf180b6b00 con 0x7faf180b61e0 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1cf31640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf180d20e0 con 0x7faf180b3b00 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf180b3540 0x7faf18162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf180b3540 0x7faf18162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34144/0 (socket says 172.21.15.134:34144) 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 -- 172.21.15.134:0/379292205 learned_addr learned my addr 172.21.15.134:0/379292205 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf15d9b640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b3b00 0x7faf181625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 -- 172.21.15.134:0/379292205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b3b00 msgr2=0x7faf181625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf1659c640 1 --2- 172.21.15.134:0/379292205 >> v2:172.21.15.177:3300/0 conn(0x7faf180b61e0 0x7faf180b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b3b00 0x7faf181625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 -- 172.21.15.134:0/379292205 >> v2:172.21.15.177:3300/0 conn(0x7faf180b61e0 msgr2=0x7faf180b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 --2- 172.21.15.134:0/379292205 >> v2:172.21.15.177:3300/0 conn(0x7faf180b61e0 0x7faf180b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.082+0000 7faf16d9d640 1 -- 172.21.15.134:0/379292205 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180cfa70 con 0x7faf180b3540 2024-09-15T22:45:53.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.083+0000 7faf16d9d640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3540 0x7faf18162b10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faf1806be00 tx=0x7faf1002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135ae8e69d759ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:53.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.083+0000 7faf1559a640 1 -- 172.21.15.134:0/379292205 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10037070 con 0x7faf180b3540 2024-09-15T22:45:53.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.083+0000 7faf1559a640 1 -- 172.21.15.134:0/379292205 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1002ae00 con 0x7faf180b3540 2024-09-15T22:45:53.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.083+0000 7faf1559a640 1 -- 172.21.15.134:0/379292205 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10032660 con 0x7faf180b3540 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 -- 172.21.15.134:0/379292205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3540 msgr2=0x7faf18162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3540 0x7faf18162b10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faf1806be00 tx=0x7faf1002a0b0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 -- 172.21.15.134:0/379292205 shutdown_connections 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3540 0x7faf18162b10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 --2- 172.21.15.134:0/379292205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b3b00 0x7faf181625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 --2- 172.21.15.134:0/379292205 >> v2:172.21.15.177:3300/0 conn(0x7faf180b61e0 0x7faf180b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 -- 172.21.15.134:0/379292205 >> 172.21.15.134:0/379292205 conn(0x7faf180d11e0 msgr2=0x7faf180d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 -- 172.21.15.134:0/379292205 shutdown_connections 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.084+0000 7faf1cf31640 1 -- 172.21.15.134:0/379292205 wait complete. 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.085+0000 7faf1cf31640 1 Processor -- start 2024-09-15T22:45:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.085+0000 7faf1cf31640 1 -- start start 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 0x7faf180cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 0x7faf18150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf1815edc0 con 0x7faf180b3b00 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf180d0030 con 0x7faf180b3540 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1cf31640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf180cbe10 con 0x7faf180b61e0 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34146/0 (socket says 172.21.15.134:34146) 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 -- 172.21.15.134:0/2644535198 learned_addr learned my addr 172.21.15.134:0/2644535198 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf16d9d640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 0x7faf18150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1659c640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 0x7faf180cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 -- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 msgr2=0x7faf18150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 0x7faf18150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 -- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 msgr2=0x7faf180cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 0x7faf180cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf15d9b640 1 -- 172.21.15.134:0/2644535198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180cc0f0 con 0x7faf180b3b00 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf16d9d640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 0x7faf18150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.086+0000 7faf1659c640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 0x7faf180cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf15d9b640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c5a0 tx=0x7faf0c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c004230 con 0x7faf180b3b00 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c0043d0 con 0x7faf180b3b00 2024-09-15T22:45:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf180cc3d0 con 0x7faf180b3b00 2024-09-15T22:45:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c003850 con 0x7faf180b3b00 2024-09-15T22:45:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.087+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf180cc990 con 0x7faf180b3b00 2024-09-15T22:45:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.088+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf180d1d00 con 0x7faf180b3b00 2024-09-15T22:45:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.088+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7faf0c0039f0 con 0x7faf180b3b00 2024-09-15T22:45:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.089+0000 7faf06ffd640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 0x7faef806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:53.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.089+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5227+0+0 (secure 0 0 0) 0x7faf0c08b410 con 0x7faf180b3b00 2024-09-15T22:45:53.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.089+0000 7faf1659c640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 0x7faef806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:53.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.090+0000 7faf1659c640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 0x7faef806e890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf08007fc0 tx=0x7faf080075b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:53.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.093+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf0c015020 con 0x7faf180b3b00 2024-09-15T22:45:53.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.259+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faf180ba6e0 con 0x7faf180b3b00 2024-09-15T22:45:53.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.965+0000 7faf06ffd640 1 -- 172.21.15.134:0/2644535198 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) ==== 170+0+0 (secure 0 0 0) 0x7faf0c059b40 con 0x7faf180b3b00 2024-09-15T22:45:53.967 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:45:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 msgr2=0x7faef806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 0x7faef806e890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf08007fc0 tx=0x7faf080075b0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 msgr2=0x7faf180cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c5a0 tx=0x7faf0c00ca60 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 shutdown_connections 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf180b61e0 0x7faf18150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faef806c3d0 0x7faef806e890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf180b3b00 0x7faf180cceb0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 --2- 172.21.15.134:0/2644535198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf180b3540 0x7faf180cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 >> 172.21.15.134:0/2644535198 conn(0x7faf180d11e0 msgr2=0x7faf180cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.969+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 shutdown_connections 2024-09-15T22:45:53.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:53.970+0000 7faf1cf31640 1 -- 172.21.15.134:0/2644535198 wait complete. 2024-09-15T22:45:53.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:45:54.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.093+0000 7fc932f11640 1 Processor -- start 2024-09-15T22:45:54.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.093+0000 7fc932f11640 1 -- start start 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc932f11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc92c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc932f11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c0b43f0 con 0x7fc92c15c370 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc932f11640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c15c7d0 con 0x7fc92c06f130 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc932f11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c0b3630 con 0x7fc92c158e50 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc92c15c370 0x7fc92c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42486/0 (socket says 172.21.15.134:42486) 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92bfff640 1 -- 172.21.15.134:0/1492478454 learned_addr learned my addr 172.21.15.134:0/1492478454 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:54.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706196611 0 0) 0x7fc92c0b43f0 con 0x7fc92c15c370 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc930cad640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc92c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc91c005730 con 0x7fc92c15c370 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 250650740 0 0) 0x7fc91c005730 con 0x7fc92c15c370 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 msgr2=0x7fc92c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc92c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 >> v1:172.21.15.177:6789/0 conn(0x7fc92c06f130 legacy=0x7fc92c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.094+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c0b3910 con 0x7fc92c15c370 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc9180016c0 con 0x7fc92c15c370 2024-09-15T22:45:54.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 >> v1:172.21.15.134:6789/0 conn(0x7fc92c15c370 legacy=0x7fc92c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c005bf0 0x7fc91c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc91c006a10 0x7fc91c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc91c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0b3630 con 0x7fc91c006a10 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c00dc80 con 0x7fc91c005bf0 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc91c00de80 con 0x7fc92c158e50 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc91c006a10 0x7fc91c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc930cad640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c005bf0 0x7fc91c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc9314ae640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc91c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 -- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 msgr2=0x7fc91c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:54.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc91c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 -- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c005bf0 msgr2=0x7fc91c006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c005bf0 0x7fc91c006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc92bfff640 1 -- 172.21.15.134:0/1492478454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c005730 con 0x7fc91c006a10 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.095+0000 7fc9314ae640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc92c158e50 0x7fc91c0073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc91c006a10 0x7fc91c006e90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc9180010a0 tx=0x7fc91c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc4b650382b08bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918007d10 con 0x7fc91c006a10 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc918005ad0 con 0x7fc91c006a10 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc92b7fe640 1 -- 172.21.15.134:0/1492478454 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918007070 con 0x7fc91c006a10 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 -- 172.21.15.134:0/1492478454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc91c006a10 msgr2=0x7fc91c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 --2- 172.21.15.134:0/1492478454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc91c006a10 0x7fc91c006e90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc9180010a0 tx=0x7fc91c007a40 comp rx=0 tx=0).stop 2024-09-15T22:45:54.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc9314ae640 1 -- 172.21.15.134:0/1492478454 reap_dead start 2024-09-15T22:45:54.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 -- 172.21.15.134:0/1492478454 shutdown_connections 2024-09-15T22:45:54.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 -- 172.21.15.134:0/1492478454 >> 172.21.15.134:0/1492478454 conn(0x7fc92c06bba0 msgr2=0x7fc92c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:54.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 -- 172.21.15.134:0/1492478454 shutdown_connections 2024-09-15T22:45:54.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.096+0000 7fc932f11640 1 -- 172.21.15.134:0/1492478454 wait complete. 2024-09-15T22:45:54.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.097+0000 7fc932f11640 1 Processor -- start 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 -- start start 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc91c006a10 0x7fc92c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 0x7fc92c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c159230 con 0x7fc92c14a840 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0b3ed0 con 0x7fc92c15ed00 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc932f11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c0b5050 con 0x7fc91c006a10 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.098+0000 7fc9314ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34162/0 (socket says 172.21.15.134:34162) 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 -- 172.21.15.134:0/1224458984 learned_addr learned my addr 172.21.15.134:0/1224458984 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:54.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 0x7fc92c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc930cad640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc91c006a10 0x7fc92c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 -- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc91c006a10 msgr2=0x7fc92c151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc91c006a10 0x7fc92c151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 -- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 msgr2=0x7fc92c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 0x7fc92c15f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 -- 172.21.15.134:0/1224458984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c15d860 con 0x7fc92c14a840 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc92bfff640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 0x7fc92c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9314ae640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc924000f80 tx=0x7fc92400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924006b50 con 0x7fc92c14a840 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924006d10 con 0x7fc92c14a840 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924003970 con 0x7fc92c14a840 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c14b1e0 con 0x7fc92c14a840 2024-09-15T22:45:54.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.099+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c15caa0 con 0x7fc92c14a840 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.100+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c0b5480 con 0x7fc92c14a840 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.101+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fc92401a020 con 0x7fc92c14a840 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.101+0000 7fc9297fa640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 0x7fc91006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.101+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5609+0+0 (secure 0 0 0) 0x7fc92408ab90 con 0x7fc92c14a840 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.101+0000 7fc930cad640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 0x7fc91006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.102+0000 7fc930cad640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 0x7fc91006e8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af7e0 tx=0x7fc920008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:54.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.106+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9240592e0 con 0x7fc92c14a840 2024-09-15T22:45:54.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.304+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc92c06dc50 con 0x7fc92c14a840 2024-09-15T22:45:54.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.967+0000 7fc9297fa640 1 -- 172.21.15.134:0/1224458984 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v51) ==== 174+0+0 (secure 0 0 0) 0x7fc924058be0 con 0x7fc92c14a840 2024-09-15T22:45:54.969 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 16 and data pool 17 2024-09-15T22:45:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 msgr2=0x7fc91006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 0x7fc91006e8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af7e0 tx=0x7fc920008040 comp rx=0 tx=0).stop 2024-09-15T22:45:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 msgr2=0x7fc92c14aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc924000f80 tx=0x7fc92400eb90 comp rx=0 tx=0).stop 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 shutdown_connections 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc91006c400 0x7fc91006e8c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92c14a840 0x7fc92c14aca0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c15ed00 0x7fc92c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 --2- 172.21.15.134:0/1224458984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc91c006a10 0x7fc92c151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:54.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.971+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 >> 172.21.15.134:0/1224458984 conn(0x7fc92c06bba0 msgr2=0x7fc92c0ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:54.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.972+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 shutdown_connections 2024-09-15T22:45:54.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:54.972+0000 7fc932f11640 1 -- 172.21.15.134:0/1224458984 wait complete. 2024-09-15T22:45:55.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:55.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.100+0000 7f9870e8d640 1 Processor -- start 2024-09-15T22:45:55.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.100+0000 7f9870e8d640 1 -- start start 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.101+0000 7f9870e8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f986c15eac0 0x7f986c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.101+0000 7f9870e8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.101+0000 7f9870e8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0d26f0 con 0x7f986c0ced90 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.101+0000 7f9870e8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f986c0d29d0 con 0x7f986c15eac0 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.101+0000 7f9870e8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0d2cb0 con 0x7f986c0b68d0 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f986c15eac0 0x7f986c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f9869d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f986c0ced90 0x7f986c0b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42492/0 (socket says 172.21.15.134:42492) 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f9869d9b640 1 -- 172.21.15.134:0/3349359591 learned_addr learned my addr 172.21.15.134:0/3349359591 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986a59c640 1 -- 172.21.15.134:0/3349359591 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 msgr2=0x7f986c0b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986a59c640 1 --2- 172.21.15.134:0/3349359591 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986a59c640 1 -- 172.21.15.134:0/3349359591 >> v1:172.21.15.134:6789/0 conn(0x7f986c0ced90 legacy=0x7f986c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986a59c640 1 -- 172.21.15.134:0/3349359591 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0d2f90 con 0x7f986c15eac0 2024-09-15T22:45:55.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.102+0000 7f986959a640 1 -- 172.21.15.134:0/3349359591 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313226064 0 0) 0x7f986c0d26f0 con 0x7f986c0ced90 2024-09-15T22:45:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f986a59c640 1 --2- 172.21.15.134:0/3349359591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c15eac0 0x7f986c0cfc80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e70eec5f7fbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f986959a640 1 -- 172.21.15.134:0/3349359591 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864007740 con 0x7f986c15eac0 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f986959a640 1 -- 172.21.15.134:0/3349359591 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98640078e0 con 0x7f986c15eac0 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f986959a640 1 -- 172.21.15.134:0/3349359591 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864007cb0 con 0x7f986c15eac0 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 -- 172.21.15.134:0/3349359591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c15eac0 msgr2=0x7f986c0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 --2- 172.21.15.134:0/3349359591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c15eac0 0x7f986c0cfc80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986402a660 comp rx=0 tx=0).stop 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 -- 172.21.15.134:0/3349359591 shutdown_connections 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 --2- 172.21.15.134:0/3349359591 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 --2- 172.21.15.134:0/3349359591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c15eac0 0x7f986c0cfc80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 -- 172.21.15.134:0/3349359591 >> 172.21.15.134:0/3349359591 conn(0x7f986c0d11c0 msgr2=0x7f986c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 -- 172.21.15.134:0/3349359591 shutdown_connections 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.103+0000 7f9870e8d640 1 -- 172.21.15.134:0/3349359591 wait complete. 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 Processor -- start 2024-09-15T22:45:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 -- start start 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c15eac0 0x7f986c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0d2490 con 0x7f986c0ced90 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0d2310 con 0x7f986c15eac0 2024-09-15T22:45:55.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9870e8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0d3790 con 0x7f986c0b68d0 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9869d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9869d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34188/0 (socket says 172.21.15.134:34188) 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.105+0000 7f9869d9b640 1 -- 172.21.15.134:0/8195125 learned_addr learned my addr 172.21.15.134:0/8195125 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f986a59c640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f986ad9d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c15eac0 0x7f986c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 -- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 msgr2=0x7f986c0b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 -- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c15eac0 msgr2=0x7f986c15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c15eac0 0x7f986c15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 -- 172.21.15.134:0/8195125 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0b7eb0 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f986a59c640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9869d9b640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f985400c4d0 tx=0x7f985400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854018070 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9854007500 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c0cae10 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854004a20 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.106+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c0cb3d0 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.107+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c0cfc80 con 0x7f986c0ced90 2024-09-15T22:45:55.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.108+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f985401b070 con 0x7f986c0ced90 2024-09-15T22:45:55.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.108+0000 7f9862ffd640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 0x7f984c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.108+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f985408a870 con 0x7f986c0ced90 2024-09-15T22:45:55.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.108+0000 7f986a59c640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 0x7f984c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.109+0000 7f986a59c640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 0x7f984c06e890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9864034000 tx=0x7f986402f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.113+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9854058f60 con 0x7f986c0ced90 2024-09-15T22:45:55.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.279+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f986c0b6ea0 con 0x7f986c0ced90 2024-09-15T22:45:55.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.280+0000 7f9862ffd640 1 -- 172.21.15.134:0/8195125 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16792 (secure 0 0 0) 0x7f9854058860 con 0x7f986c0ced90 2024-09-15T22:45:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:55.282 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":106,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:54.305523+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:52.924930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:53.279132+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 msgr2=0x7f984c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 0x7f984c06e890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9864034000 tx=0x7f986402f000 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 msgr2=0x7f986c154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f985400c4d0 tx=0x7f985400c990 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 shutdown_connections 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f986c15eac0 0x7f986c15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f984c06c3d0 0x7f984c06e890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f986c0ced90 0x7f986c154be0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 --2- 172.21.15.134:0/8195125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f986c0b68d0 0x7f986c0b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 >> 172.21.15.134:0/8195125 conn(0x7f986c0d11c0 msgr2=0x7f986c156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 shutdown_connections 2024-09-15T22:45:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.282+0000 7f9870e8d640 1 -- 172.21.15.134:0/8195125 wait complete. 2024-09-15T22:45:55.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:55.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.391+0000 7f52507af640 1 Processor -- start 2024-09-15T22:45:55.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.391+0000 7f52507af640 1 -- start start 2024-09-15T22:45:55.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f52507af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f524815e940 0x7f52480d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f52507af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f52480d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f52507af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52480b7170 con 0x7f52480cef90 2024-09-15T22:45:55.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f52507af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f52480d1ae0 con 0x7f524815e940 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f52507af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52480b7aa0 con 0x7f524815ed20 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f524ed4c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f52480cef90 0x7f52480b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42508/0 (socket says 172.21.15.134:42508) 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.392+0000 7f524ed4c640 1 -- 172.21.15.134:0/3490146629 learned_addr learned my addr 172.21.15.134:0/3490146629 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 --2- 172.21.15.134:0/3490146629 >> v2:172.21.15.177:3300/0 conn(0x7f524815e940 0x7f52480d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524dd4a640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f52480d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413414506 0 0) 0x7f5240001490 con 0x7f52480cef90 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234003520 con 0x7f52480cef90 2024-09-15T22:45:55.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2800624124 0 0) 0x7f5234003520 con 0x7f52480cef90 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 msgr2=0x7f52480d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f52480d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 >> v2:172.21.15.177:3300/0 conn(0x7f524815e940 msgr2=0x7f52480d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 --2- 172.21.15.134:0/3490146629 >> v2:172.21.15.177:3300/0 conn(0x7f524815e940 0x7f52480d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52480d3660 con 0x7f52480cef90 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5240001bc0 con 0x7f52480cef90 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 >> v1:172.21.15.134:6789/0 conn(0x7f52480cef90 legacy=0x7f52480b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52340039b0 0x7f5234003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f5234004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5234004d40 0x7f52340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52480b7aa0 con 0x7f52340039b0 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f523400b9c0 con 0x7f5234004d40 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f523400bb40 con 0x7f524815ed20 2024-09-15T22:45:55.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52340039b0 0x7f5234003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524ed4c640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5234004d40 0x7f52340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524dd4a640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f5234004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 -- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 msgr2=0x7f5234004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f524815ed20 0x7f5234004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 -- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5234004d40 msgr2=0x7f52340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5234004d40 0x7f52340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.393+0000 7f524e54b640 1 -- 172.21.15.134:0/3490146629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5234003520 con 0x7f52340039b0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.394+0000 7f524e54b640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52340039b0 0x7f5234003dd0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5244009ac0 tx=0x7f5234005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea67b542d3f6936 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.394+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244036070 con 0x7f52340039b0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.394+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5244031400 con 0x7f52340039b0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.394+0000 7f524d549640 1 -- 172.21.15.134:0/3490146629 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244009690 con 0x7f52340039b0 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 -- 172.21.15.134:0/3490146629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52340039b0 msgr2=0x7f5234003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 --2- 172.21.15.134:0/3490146629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52340039b0 0x7f5234003dd0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5244009ac0 tx=0x7f5234005830 comp rx=0 tx=0).stop 2024-09-15T22:45:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f524ed4c640 1 -- 172.21.15.134:0/3490146629 reap_dead start 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 -- 172.21.15.134:0/3490146629 shutdown_connections 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 -- 172.21.15.134:0/3490146629 >> 172.21.15.134:0/3490146629 conn(0x7f52480b6240 msgr2=0x7f52480b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 -- 172.21.15.134:0/3490146629 shutdown_connections 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.395+0000 7f52507af640 1 -- 172.21.15.134:0/3490146629 wait complete. 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.396+0000 7f52507af640 1 Processor -- start 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.396+0000 7f52507af640 1 -- start start 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52340039b0 0x7f524815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5248159520 0x7f52480b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52480d3f00 con 0x7f5248157f20 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52480d3c20 con 0x7f52340039b0 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f52507af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f52480d3310 con 0x7f5248159520 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34200/0 (socket says 172.21.15.134:34200) 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 -- 172.21.15.134:0/1769992203 learned_addr learned my addr 172.21.15.134:0/1769992203 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524e54b640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52340039b0 0x7f524815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524ed4c640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5248159520 0x7f52480b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 -- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5248159520 msgr2=0x7f52480b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5248159520 0x7f52480b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 -- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52340039b0 msgr2=0x7f524815b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52340039b0 0x7f524815b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.397+0000 7f524dd4a640 1 -- 172.21.15.134:0/1769992203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52480c9000 con 0x7f5248157f20 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f524dd4a640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5238011a00 tx=0x7f5238011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523800faf0 con 0x7f5248157f20 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523800fc90 con 0x7f5248157f20 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238014440 con 0x7f5248157f20 2024-09-15T22:45:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52481f8510 con 0x7f5248157f20 2024-09-15T22:45:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.398+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52481f8ad0 con 0x7f5248157f20 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.399+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524815dd00 con 0x7f5248157f20 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.399+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f5238012040 con 0x7f5248157f20 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.400+0000 7f523effd640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 0x7f522c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.400+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f523808b9e0 con 0x7f5248157f20 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.400+0000 7f524e54b640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 0x7f522c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.400+0000 7f524e54b640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 0x7f522c06e8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5244033000 tx=0x7f5244008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.404+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f524815dd00 con 0x7f5248157f20 2024-09-15T22:45:55.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.569+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52480d1f80 con 0x7f5248157f20 2024-09-15T22:45:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.570+0000 7f523effd640 1 -- 172.21.15.134:0/1769992203 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16792 (secure 0 0 0) 0x7f5238019030 con 0x7f5248157f20 2024-09-15T22:45:55.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:55.571 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":106,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:54.305523+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:52.924930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:53.279132+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:55.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 msgr2=0x7f522c06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 0x7f522c06e8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5244033000 tx=0x7f5244008030 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 msgr2=0x7f52481577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5238011a00 tx=0x7f5238011ec0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 shutdown_connections 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5248159520 0x7f52480b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f522c06c400 0x7f522c06e8c0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5244033000 tx=0x7f5244008030 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5248157f20 0x7f52481577b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 --2- 172.21.15.134:0/1769992203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52340039b0 0x7f524815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 >> 172.21.15.134:0/1769992203 conn(0x7f52480b6240 msgr2=0x7f5248160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 shutdown_connections 2024-09-15T22:45:55.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.572+0000 7f52507af640 1 -- 172.21.15.134:0/1769992203 wait complete. 2024-09-15T22:45:55.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:45:55.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.684+0000 7f3cf2d42640 1 Processor -- start 2024-09-15T22:45:55.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.684+0000 7f3cf2d42640 1 -- start start 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf2d42640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 0x7f3cec06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf2d42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3cec0b50f0 0x7f3cec0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf2d42640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec0ceb10 con 0x7f3cec15c200 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf2d42640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3cec06f210 con 0x7f3cec0b50f0 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf2d42640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec15d9c0 con 0x7f3cec0ce6d0 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf12df640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3cec0b50f0 0x7f3cec0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf0ade640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3cec15c200 0x7f3cec15c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42516/0 (socket says 172.21.15.134:42516) 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.685+0000 7f3cf0ade640 1 -- 172.21.15.134:0/2331165738 learned_addr learned my addr 172.21.15.134:0/2331165738 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3ce3fff640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 0x7f3cec06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3cf12df640 1 -- 172.21.15.134:0/2331165738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 msgr2=0x7f3cec06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3cf12df640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 0x7f3cec06ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3cf12df640 1 -- 172.21.15.134:0/2331165738 >> v1:172.21.15.134:6789/0 conn(0x7f3cec15c200 legacy=0x7f3cec15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3cf12df640 1 -- 172.21.15.134:0/2331165738 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec15d120 con 0x7f3cec0b50f0 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3ce37fe640 1 -- 172.21.15.134:0/2331165738 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255191631 0 0) 0x7f3cec0ceb10 con 0x7f3cec15c200 2024-09-15T22:45:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3ce3fff640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 0x7f3cec06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.686+0000 7f3cf12df640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec0b5540 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcb51f77bb9235f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3ce37fe640 1 -- 172.21.15.134:0/2331165738 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4007740 con 0x7f3cec0b50f0 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3ce37fe640 1 -- 172.21.15.134:0/2331165738 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce40078e0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3ce37fe640 1 -- 172.21.15.134:0/2331165738 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4007cb0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2331165738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 msgr2=0x7f3cec0b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec0b5540 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce402a660 comp rx=0 tx=0).stop 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2331165738 shutdown_connections 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec0b5540 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2331165738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec0ce6d0 0x7f3cec06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2331165738 >> 172.21.15.134:0/2331165738 conn(0x7f3cec062c60 msgr2=0x7f3cec06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2331165738 shutdown_connections 2024-09-15T22:45:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.687+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2331165738 wait complete. 2024-09-15T22:45:55.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.688+0000 7f3cf2d42640 1 Processor -- start 2024-09-15T22:45:55.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.688+0000 7f3cf2d42640 1 -- start start 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cec0ce6d0 0x7f3cec1e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec15c200 0x7f3cec147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec06d5a0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec15d6e0 con 0x7f3cec0ce6d0 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf2d42640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec0b5a80 con 0x7f3cec15c200 2024-09-15T22:45:55.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf0ade640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf0ade640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34210/0 (socket says 172.21.15.134:34210) 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf0ade640 1 -- 172.21.15.134:0/2089582994 learned_addr learned my addr 172.21.15.134:0/2089582994 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3ce3fff640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cec0ce6d0 0x7f3cec1e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.689+0000 7f3cf12df640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec15c200 0x7f3cec147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 -- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec15c200 msgr2=0x7f3cec147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec15c200 0x7f3cec147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 -- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cec0ce6d0 msgr2=0x7f3cec1e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cec0ce6d0 0x7f3cec1e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 -- 172.21.15.134:0/2089582994 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec1e68a0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf0ade640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c460 tx=0x7f3ce800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8018070 con 0x7f3cec0b50f0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce8007500 con 0x7f3cec0b50f0 2024-09-15T22:45:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cec156cc0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8004a20 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.690+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cec1483b0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.691+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cec0b5540 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.691+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3ce801b070 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.692+0000 7f3ce17fa640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 0x7f3cd806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.692+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f3ce808a860 con 0x7f3cec0b50f0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.692+0000 7f3ce3fff640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 0x7f3cd806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.692+0000 7f3ce3fff640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 0x7f3cd806e890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0af7e0 tx=0x7f3cdc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:55.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.696+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ce8058ec0 con 0x7f3cec0b50f0 2024-09-15T22:45:55.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.896+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3cec15f010 con 0x7f3cec0b50f0 2024-09-15T22:45:55.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.986+0000 7f3ce17fa640 1 -- 172.21.15.134:0/2089582994 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) ==== 118+0+0 (secure 0 0 0) 0x7f3ce808a070 con 0x7f3cec0b50f0 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 msgr2=0x7f3cd806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 0x7f3cd806e890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0af7e0 tx=0x7f3cdc008040 comp rx=0 tx=0).stop 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 msgr2=0x7f3cec1e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c460 tx=0x7f3ce800c920 comp rx=0 tx=0).stop 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 shutdown_connections 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cec15c200 0x7f3cec147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cec0ce6d0 0x7f3cec1e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3cd806c3d0 0x7f3cd806e890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 --2- 172.21.15.134:0/2089582994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cec0b50f0 0x7f3cec1e6200 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 >> 172.21.15.134:0/2089582994 conn(0x7f3cec062c60 msgr2=0x7f3cec15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.988+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 shutdown_connections 2024-09-15T22:45:55.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:55.989+0000 7f3cf2d42640 1 -- 172.21.15.134:0/2089582994 wait complete. 2024-09-15T22:45:56.001 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:45:56.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:45:56.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.102+0000 7fb55ddbd640 1 Processor -- start 2024-09-15T22:45:56.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.102+0000 7fb55ddbd640 1 -- start start 2024-09-15T22:45:56.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.102+0000 7fb55ddbd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5580b3d50 0x7fb55806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb55ddbd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb5580b3290 0x7fb55806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb55ddbd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5580cf9a0 con 0x7fb558161e30 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb55ddbd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb5580cfcf0 con 0x7fb5580b3290 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb55ddbd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb558162210 con 0x7fb5580b3d50 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb557fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb5580b3290 0x7fb55806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb5577fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb558161e30 0x7fb5580d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42518/0 (socket says 172.21.15.134:42518) 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb5577fe640 1 -- 172.21.15.134:0/324724689 learned_addr learned my addr 172.21.15.134:0/324724689 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb556ffd640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5580b3d50 0x7fb55806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb557fff640 1 -- 172.21.15.134:0/324724689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5580b3d50 msgr2=0x7fb55806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb557fff640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5580b3d50 0x7fb55806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb557fff640 1 -- 172.21.15.134:0/324724689 >> v1:172.21.15.134:6789/0 conn(0x7fb558161e30 legacy=0x7fb5580d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb557fff640 1 -- 172.21.15.134:0/324724689 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5580d5210 con 0x7fb5580b3290 2024-09-15T22:45:56.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.103+0000 7fb5567fc640 1 -- 172.21.15.134:0/324724689 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188941991 0 0) 0x7fb5580cf9a0 con 0x7fb558161e30 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb557fff640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb55806de00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e23326738f8ef94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb5567fc640 1 -- 172.21.15.134:0/324724689 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550007740 con 0x7fb5580b3290 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb5567fc640 1 -- 172.21.15.134:0/324724689 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5500078e0 con 0x7fb5580b3290 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb5567fc640 1 -- 172.21.15.134:0/324724689 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550007cb0 con 0x7fb5580b3290 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 -- 172.21.15.134:0/324724689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 msgr2=0x7fb55806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb55806de00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55002a660 comp rx=0 tx=0).stop 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 -- 172.21.15.134:0/324724689 shutdown_connections 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb55806de00 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/324724689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5580b3d50 0x7fb55806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 -- 172.21.15.134:0/324724689 >> 172.21.15.134:0/324724689 conn(0x7fb5580d1870 msgr2=0x7fb5580d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:56.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 -- 172.21.15.134:0/324724689 shutdown_connections 2024-09-15T22:45:56.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.104+0000 7fb55ddbd640 1 -- 172.21.15.134:0/324724689 wait complete. 2024-09-15T22:45:56.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.106+0000 7fb55ddbd640 1 Processor -- start 2024-09-15T22:45:56.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.106+0000 7fb55ddbd640 1 -- start start 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.106+0000 7fb55ddbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.106+0000 7fb55ddbd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5580b3d50 0x7fb5580ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 0x7fb5580b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5580b78b0 con 0x7fb5580b3290 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb5580b3950 con 0x7fb5580b3d50 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb5580b7a30 con 0x7fb558161e30 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34222/0 (socket says 172.21.15.134:34222) 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 -- 172.21.15.134:0/3126905990 learned_addr learned my addr 172.21.15.134:0/3126905990 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb557fff640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 0x7fb5580b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb556ffd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5580b3d50 0x7fb5580ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 -- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 msgr2=0x7fb5580b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 0x7fb5580b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 -- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5580b3d50 msgr2=0x7fb5580ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5580b3d50 0x7fb5580ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 -- 172.21.15.134:0/3126905990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5580ca9f0 con 0x7fb5580b3290 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb557fff640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 0x7fb5580b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb5577fe640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c430 tx=0x7fb54800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:56.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480074e0 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5480047e0 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5581f4450 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548004bd0 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.107+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5580ca6e0 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.108+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5580d3480 con 0x7fb5580b3290 2024-09-15T22:45:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.109+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fb548011070 con 0x7fb5580b3290 2024-09-15T22:45:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.109+0000 7fb53ffff640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 0x7fb54406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.109+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fb54808b250 con 0x7fb5580b3290 2024-09-15T22:45:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.109+0000 7fb556ffd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 0x7fb54406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.110+0000 7fb556ffd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 0x7fb54406e890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5580c9d20 tx=0x7fb54c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.114+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5480598b0 con 0x7fb5580b3290 2024-09-15T22:45:56.234 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:45:56.233+0000 7f5083f8f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:45:56.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.316+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb5580d4a40 con 0x7fb5580b3290 2024-09-15T22:45:56.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.987+0000 7fb53ffff640 1 -- 172.21.15.134:0/3126905990 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) ==== 122+0+0 (secure 0 0 0) 0x7fb5480591b0 con 0x7fb5580b3290 2024-09-15T22:45:56.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.989+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 msgr2=0x7fb54406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.989+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 0x7fb54406e890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5580c9d20 tx=0x7fb54c008040 comp rx=0 tx=0).stop 2024-09-15T22:45:56.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 msgr2=0x7fb5581f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c430 tx=0x7fb54800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 shutdown_connections 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb558161e30 0x7fb5580b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5580b3d50 0x7fb5580ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb54406c3d0 0x7fb54406e890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 --2- 172.21.15.134:0/3126905990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5580b3290 0x7fb5581f83c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 >> 172.21.15.134:0/3126905990 conn(0x7fb5580d1870 msgr2=0x7fb55815f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 shutdown_connections 2024-09-15T22:45:56.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:56.990+0000 7fb55ddbd640 1 -- 172.21.15.134:0/3126905990 wait complete. 2024-09-15T22:45:57.004 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:45:57.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.103+0000 7f575cf33640 1 Processor -- start 2024-09-15T22:45:57.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.103+0000 7f575cf33640 1 -- start start 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f575cf33640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57580b5600 0x7f5758073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f575cf33640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 0x7f575806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f575cf33640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575806e8d0 con 0x7f575815e7b0 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f575cf33640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f575806e680 con 0x7f57580b5600 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f575cf33640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f575806ebb0 con 0x7f5758073ff0 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57580b5600 0x7f5758073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57580b5600 0x7f5758073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50400/0 (socket says 172.21.15.134:50400) 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 -- 172.21.15.134:0/3664846322 learned_addr learned my addr 172.21.15.134:0/3664846322 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f5756d9d640 1 --2- 172.21.15.134:0/3664846322 >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 0x7f575806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 -- 172.21.15.134:0/3664846322 >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 msgr2=0x7f575806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 --2- 172.21.15.134:0/3664846322 >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 0x7f575806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 -- 172.21.15.134:0/3664846322 >> v1:172.21.15.177:6789/0 conn(0x7f575815e7b0 legacy=0x7f5758071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f574ffff640 1 -- 172.21.15.134:0/3664846322 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57580732b0 con 0x7f57580b5600 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.104+0000 7f5756d9d640 1 --2- 172.21.15.134:0/3664846322 >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 0x7f575806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f574ffff640 1 --2- 172.21.15.134:0/3664846322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580b5600 0x7f5758073ab0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f57580b4df0 tx=0x7f574002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986c370d6f763a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f5755d9b640 1 -- 172.21.15.134:0/3664846322 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740037070 con 0x7f57580b5600 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f5755d9b640 1 -- 172.21.15.134:0/3664846322 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5740032440 con 0x7f57580b5600 2024-09-15T22:45:57.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f5755d9b640 1 -- 172.21.15.134:0/3664846322 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740032810 con 0x7f57580b5600 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f575cf33640 1 -- 172.21.15.134:0/3664846322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580b5600 msgr2=0x7f5758073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.105+0000 7f575cf33640 1 --2- 172.21.15.134:0/3664846322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580b5600 0x7f5758073ab0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f57580b4df0 tx=0x7f574002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 -- 172.21.15.134:0/3664846322 shutdown_connections 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 --2- 172.21.15.134:0/3664846322 >> v2:172.21.15.177:3300/0 conn(0x7f5758073ff0 0x7f575806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 --2- 172.21.15.134:0/3664846322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580b5600 0x7f5758073ab0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 -- 172.21.15.134:0/3664846322 >> 172.21.15.134:0/3664846322 conn(0x7f57580b4300 msgr2=0x7f57580b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 -- 172.21.15.134:0/3664846322 shutdown_connections 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.106+0000 7f575cf33640 1 -- 172.21.15.134:0/3664846322 wait complete. 2024-09-15T22:45:57.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.107+0000 7f575cf33640 1 Processor -- start 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.107+0000 7f575cf33640 1 -- start start 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57580b5600 0x7f5758157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f575815e7b0 0x7f57581509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f575806d370 con 0x7f57580d14d0 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f575806d1f0 con 0x7f575815e7b0 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f575806d4f0 con 0x7f57580b5600 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50404/0 (socket says 172.21.15.134:50404) 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 -- 172.21.15.134:0/3475560442 learned_addr learned my addr 172.21.15.134:0/3475560442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f574ffff640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f575815e7b0 0x7f57581509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575659c640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57580b5600 0x7f5758157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 -- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57580b5600 msgr2=0x7f5758157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57580b5600 0x7f5758157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 -- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f575815e7b0 msgr2=0x7f57581509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f575815e7b0 0x7f57581509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 -- 172.21.15.134:0/3475560442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57581581e0 con 0x7f57580d14d0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f5756d9d640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f575000cd50 tx=0x7f575000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575000f680 con 0x7f57580d14d0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575000f840 con 0x7f57580d14d0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575000fc30 con 0x7f57580d14d0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57581584c0 con 0x7f57580d14d0 2024-09-15T22:45:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.108+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57581532e0 con 0x7f57580d14d0 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.109+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575806ccb0 con 0x7f57580d14d0 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.110+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f575000e3e0 con 0x7f57580d14d0 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.110+0000 7f574effd640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 0x7f573806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.110+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f575008c450 con 0x7f57580d14d0 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.111+0000 7f575659c640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 0x7f573806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.111+0000 7f575659c640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 0x7f573806e890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5748004ea0 tx=0x7f5748009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.115+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5750014030 con 0x7f57580d14d0 2024-09-15T22:45:57.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.312+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57580b1a90 con 0x7f57580d14d0 2024-09-15T22:45:57.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.313+0000 7f574effd640 1 -- 172.21.15.134:0/3475560442 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5237 (secure 0 0 0) 0x7f575005aa30 con 0x7f57580d14d0 2024-09-15T22:45:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:57.314 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":53,"btime":"2024-09-15T22:45:56:987295+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:45:57.315 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 53 2024-09-15T22:45:57.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 msgr2=0x7f573806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 0x7f573806e890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5748004ea0 tx=0x7f5748009040 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 msgr2=0x7f575815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f575000cd50 tx=0x7f575000a650 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 shutdown_connections 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f573806c3d0 0x7f573806e890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580d14d0 0x7f575815c640 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f575815e7b0 0x7f57581509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 --2- 172.21.15.134:0/3475560442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57580b5600 0x7f5758157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 >> 172.21.15.134:0/3475560442 conn(0x7f57580b4300 msgr2=0x7f57580b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 shutdown_connections 2024-09-15T22:45:57.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.315+0000 7f575cf33640 1 -- 172.21.15.134:0/3475560442 wait complete. 2024-09-15T22:45:57.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:57.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.425+0000 7fcfa379a640 1 Processor -- start 2024-09-15T22:45:57.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.425+0000 7fcfa379a640 1 -- start start 2024-09-15T22:45:57.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa379a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa379a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c073120 0x7fcf9c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa379a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9c0ce740 con 0x7fcf9c15c180 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa379a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c072640 con 0x7fcf9c0cf070 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa379a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c072920 con 0x7fcf9c073120 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50410/0 (socket says 172.21.15.134:50410) 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 -- 172.21.15.134:0/2885355996 learned_addr learned my addr 172.21.15.134:0/2885355996 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa1d37640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c073120 0x7fcf9c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 -- 172.21.15.134:0/2885355996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c073120 msgr2=0x7fcf9c0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c073120 0x7fcf9c0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 -- 172.21.15.134:0/2885355996 >> v1:172.21.15.177:6789/0 conn(0x7fcf9c15c180 legacy=0x7fcf9c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.426+0000 7fcfa0d35640 1 -- 172.21.15.134:0/2885355996 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c072c00 con 0x7fcf9c0cf070 2024-09-15T22:45:57.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa0d35640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009870 tx=0x7fcf8c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257c594677a18ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcf93fff640 1 -- 172.21.15.134:0/2885355996 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c037070 con 0x7fcf9c0cf070 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcf93fff640 1 -- 172.21.15.134:0/2885355996 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c032440 con 0x7fcf9c0cf070 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcf93fff640 1 -- 172.21.15.134:0/2885355996 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c032810 con 0x7fcf9c0cf070 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa379a640 1 -- 172.21.15.134:0/2885355996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c0cf070 msgr2=0x7fcf9c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa379a640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009870 tx=0x7fcf8c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa379a640 1 -- 172.21.15.134:0/2885355996 shutdown_connections 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa379a640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c073120 0x7fcf9c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.427+0000 7fcfa379a640 1 --2- 172.21.15.134:0/2885355996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c0cf4e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.428+0000 7fcfa379a640 1 -- 172.21.15.134:0/2885355996 >> 172.21.15.134:0/2885355996 conn(0x7fcf9c062cc0 msgr2=0x7fcf9c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.428+0000 7fcfa379a640 1 -- 172.21.15.134:0/2885355996 shutdown_connections 2024-09-15T22:45:57.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.428+0000 7fcfa379a640 1 -- 172.21.15.134:0/2885355996 wait complete. 2024-09-15T22:45:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.429+0000 7fcfa379a640 1 Processor -- start 2024-09-15T22:45:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.429+0000 7fcfa379a640 1 -- start start 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.429+0000 7fcfa379a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.429+0000 7fcfa379a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c1f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 0x7fcf9c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0722f0 con 0x7fcf9c073120 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0ced00 con 0x7fcf9c0cf070 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c15c560 con 0x7fcf9c15c180 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50420/0 (socket says 172.21.15.134:50420) 2024-09-15T22:45:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 -- 172.21.15.134:0/732842277 learned_addr learned my addr 172.21.15.134:0/732842277 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa0d35640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c1f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1d37640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 0x7fcf9c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 -- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 msgr2=0x7fcf9c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 0x7fcf9c0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 -- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf9c0cf070 msgr2=0x7fcf9c1f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c1f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 -- 172.21.15.134:0/732842277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c1f4820 con 0x7fcf9c073120 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1d37640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 0x7fcf9c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:57.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa1536640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c430 tx=0x7fcf9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98017070 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf980052d0 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c15ddf0 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98003850 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.430+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c0b1a10 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.431+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c0cf4e0 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.432+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fcf9801a070 con 0x7fcf9c073120 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.432+0000 7fcf91ffb640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 0x7fcf8006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.432+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fcf9808a830 con 0x7fcf9c073120 2024-09-15T22:45:57.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.433+0000 7fcfa0d35640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 0x7fcf8006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.433+0000 7fcfa0d35640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 0x7fcf8006e890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c034000 tx=0x7fcf8c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.437+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf980588d0 con 0x7fcf9c073120 2024-09-15T22:45:57.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.603+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf9c1599c0 con 0x7fcf9c073120 2024-09-15T22:45:57.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.604+0000 7fcf91ffb640 1 -- 172.21.15.134:0/732842277 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+16779 (secure 0 0 0) 0x7fcf9805cbd0 con 0x7fcf9c073120 2024-09-15T22:45:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:57.606 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":107,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:45:55.968265+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:52.924930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:53.279132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:57.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 msgr2=0x7fcf8006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 0x7fcf8006e890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c034000 tx=0x7fcf8c02e000 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 msgr2=0x7fcf9c1f7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c430 tx=0x7fcf9800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 shutdown_connections 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf9c15c180 0x7fcf9c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf9c0cf070 0x7fcf9c1f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf8006c3d0 0x7fcf8006e890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 --2- 172.21.15.134:0/732842277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf9c073120 0x7fcf9c1f7180 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 >> 172.21.15.134:0/732842277 conn(0x7fcf9c062cc0 msgr2=0x7fcf9c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 shutdown_connections 2024-09-15T22:45:57.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.606+0000 7fcfa379a640 1 -- 172.21.15.134:0/732842277 wait complete. 2024-09-15T22:45:57.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:45:57.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:57.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.716+0000 7f80d6450640 1 Processor -- start 2024-09-15T22:45:57.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.717+0000 7f80d6450640 1 -- start start 2024-09-15T22:45:57.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.717+0000 7f80d6450640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80d00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.717+0000 7f80d6450640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d015f520 con 0x7f80d00b3840 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.717+0000 7f80d6450640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d015f800 con 0x7f80d0162860 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.717+0000 7f80d6450640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f80d01630b0 con 0x7f80d0162c40 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80d49ed640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f80d00b3840 0x7f80d006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43932/0 (socket says 172.21.15.134:43932) 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80d49ed640 1 -- 172.21.15.134:0/3253624481 learned_addr learned my addr 172.21.15.134:0/3253624481 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80c7fff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80d00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312664767 0 0) 0x7f80d015f520 con 0x7f80d00b3840 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80bc003520 con 0x7f80d00b3840 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172557088 0 0) 0x7f80d015f800 con 0x7f80d0162860 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d015f520 con 0x7f80d0162860 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3794987900 0 0) 0x7f80bc003520 con 0x7f80d00b3840 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 msgr2=0x7f80d00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80d00b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 >> v1:172.21.15.177:6789/0 conn(0x7f80d0162860 legacy=0x7f80d015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d00b2b00 con 0x7f80d00b3840 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f80c80019f0 con 0x7f80d00b3840 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 >> v1:172.21.15.134:6789/0 conn(0x7f80d00b3840 legacy=0x7f80d006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80bc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0040d0 0x7f80bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80bc004d40 0x7f80bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc00bb50 con 0x7f80bc0040d0 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc00bcd0 con 0x7f80bc004d40 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc00bea0 con 0x7f80d0162c40 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80c7fff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0040d0 0x7f80bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80cffff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80bc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.718+0000 7f80d49ed640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80bc004d40 0x7f80bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 -- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 msgr2=0x7f80bc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80bc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 -- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80bc004d40 msgr2=0x7f80bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80bc004d40 0x7f80bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 -- 172.21.15.134:0/3253624481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc003520 con 0x7f80bc0040d0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80cffff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80d0162c40 0x7f80bc003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80c7fff640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0040d0 0x7f80bc004800 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009ac0 tx=0x7f80bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3022e347c499132 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8036070 con 0x7f80bc0040d0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b8031400 con 0x7f80bc0040d0 2024-09-15T22:45:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.719+0000 7f80cf7fe640 1 -- 172.21.15.134:0/3253624481 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8009690 con 0x7f80bc0040d0 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 -- 172.21.15.134:0/3253624481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0040d0 msgr2=0x7f80bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 --2- 172.21.15.134:0/3253624481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0040d0 0x7f80bc004800 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009ac0 tx=0x7f80bc005830 comp rx=0 tx=0).stop 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d49ed640 1 -- 172.21.15.134:0/3253624481 reap_dead start 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 -- 172.21.15.134:0/3253624481 shutdown_connections 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 -- 172.21.15.134:0/3253624481 >> 172.21.15.134:0/3253624481 conn(0x7f80d006ce90 msgr2=0x7f80d006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 -- 172.21.15.134:0/3253624481 shutdown_connections 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.720+0000 7f80d6450640 1 -- 172.21.15.134:0/3253624481 wait complete. 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.721+0000 7f80d6450640 1 Processor -- start 2024-09-15T22:45:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.721+0000 7f80d6450640 1 -- start start 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80bc0040d0 0x7f80d014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80d0156e60 0x7f80d00d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80d015f2c0 con 0x7f80d01572e0 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80d015fae0 con 0x7f80d0156e60 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d6450640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f80d006c2b0 con 0x7f80bc0040d0 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50444/0 (socket says 172.21.15.134:50444) 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 -- 172.21.15.134:0/430331883 learned_addr learned my addr 172.21.15.134:0/430331883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80c7fff640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80d0156e60 0x7f80d00d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80cffff640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80bc0040d0 0x7f80d014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 -- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80bc0040d0 msgr2=0x7f80d014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80bc0040d0 0x7f80d014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 -- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80d0156e60 msgr2=0x7f80d00d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80d0156e60 0x7f80d00d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 -- 172.21.15.134:0/430331883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d0155dc0 con 0x7f80d01572e0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.722+0000 7f80d49ed640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f80d015c6f0 tx=0x7f80c8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.723+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c800ead0 con 0x7f80d01572e0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.723+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c800ec90 con 0x7f80d01572e0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.723+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d01560a0 con 0x7f80d01572e0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.723+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c8014430 con 0x7f80d01572e0 2024-09-15T22:45:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.723+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d0156660 con 0x7f80d01572e0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.724+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d0155b30 con 0x7f80d01572e0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.724+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f80c80145f0 con 0x7f80d01572e0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.724+0000 7f80cd7fa640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 0x7f80b006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.725+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f80c808b210 con 0x7f80d01572e0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.725+0000 7f80cffff640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 0x7f80b006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.725+0000 7f80cffff640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 0x7f80b006e8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80c0007ae0 tx=0x7f80c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:57.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.729+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80c80592b0 con 0x7f80d01572e0 2024-09-15T22:45:57.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.889+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80d00b3300 con 0x7f80b006c400 2024-09-15T22:45:57.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.896+0000 7f80cd7fa640 1 -- 172.21.15.134:0/430331883 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7f80d00b3300 con 0x7f80b006c400 2024-09-15T22:45:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:57.901 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 msgr2=0x7f80b006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 0x7f80b006e8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80c0007ae0 tx=0x7f80c0009040 comp rx=0 tx=0).stop 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 msgr2=0x7f80d00b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f80d015c6f0 tx=0x7f80c8007bc0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 shutdown_connections 2024-09-15T22:45:57.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f80b006c400 0x7f80b006e8c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80d01572e0 0x7f80d00b1240 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80d0156e60 0x7f80d00d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 --2- 172.21.15.134:0/430331883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80bc0040d0 0x7f80d014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 >> 172.21.15.134:0/430331883 conn(0x7f80d006ce90 msgr2=0x7f80d00b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 shutdown_connections 2024-09-15T22:45:57.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:57.898+0000 7f80d6450640 1 -- 172.21.15.134:0/430331883 wait complete. 2024-09-15T22:45:57.911 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-15T22:45:57.188862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261108,"kb_used_data":11560,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713612,"statfs":{"total":773094113280,"available":772826738688,"internally_reserved":0,"allocated":11837440,"data_stored":5812548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.223854"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973100+0000","last_change":"2024-09-15T22:45:54.989489+0000","last_active":"2024-09-15T22:45:55.973100+0000","last_peered":"2024-09-15T22:45:55.973100+0000","last_clean":"2024-09-15T22:45:55.973100+0000","last_became_active":"2024-09-15T22:45:54.988906+0000","last_became_peered":"2024-09-15T22:45:54.988906+0000","last_unstale":"2024-09-15T22:45:55.973100+0000","last_undegraded":"2024-09-15T22:45:55.973100+0000","last_fullsized":"2024-09-15T22:45:55.973100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:20.566351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276931+0000","last_change":"2024-09-15T22:45:54.989622+0000","last_active":"2024-09-15T22:45:56.276931+0000","last_peered":"2024-09-15T22:45:56.276931+0000","last_clean":"2024-09-15T22:45:56.276931+0000","last_became_active":"2024-09-15T22:45:54.989304+0000","last_became_peered":"2024-09-15T22:45:54.989304+0000","last_unstale":"2024-09-15T22:45:56.276931+0000","last_undegraded":"2024-09-15T22:45:56.276931+0000","last_fullsized":"2024-09-15T22:45:56.276931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:47.959794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976601+0000","last_change":"2024-09-15T22:45:54.986399+0000","last_active":"2024-09-15T22:45:55.976601+0000","last_peered":"2024-09-15T22:45:55.976601+0000","last_clean":"2024-09-15T22:45:55.976601+0000","last_became_active":"2024-09-15T22:45:54.986133+0000","last_became_peered":"2024-09-15T22:45:54.986133+0000","last_unstale":"2024-09-15T22:45:55.976601+0000","last_undegraded":"2024-09-15T22:45:55.976601+0000","last_fullsized":"2024-09-15T22:45:55.976601+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:40.352354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973834+0000","last_change":"2024-09-15T22:45:54.984232+0000","last_active":"2024-09-15T22:45:55.973834+0000","last_peered":"2024-09-15T22:45:55.973834+0000","last_clean":"2024-09-15T22:45:55.973834+0000","last_became_active":"2024-09-15T22:45:54.983925+0000","last_became_peered":"2024-09-15T22:45:54.983925+0000","last_unstale":"2024-09-15T22:45:55.973834+0000","last_undegraded":"2024-09-15T22:45:55.973834+0000","last_fullsized":"2024-09-15T22:45:55.973834+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:52.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277546+0000","last_change":"2024-09-15T22:45:54.994104+0000","last_active":"2024-09-15T22:45:56.277546+0000","last_peered":"2024-09-15T22:45:56.277546+0000","last_clean":"2024-09-15T22:45:56.277546+0000","last_became_active":"2024-09-15T22:45:54.993816+0000","last_became_peered":"2024-09-15T22:45:54.993816+0000","last_unstale":"2024-09-15T22:45:56.277546+0000","last_undegraded":"2024-09-15T22:45:56.277546+0000","last_fullsized":"2024-09-15T22:45:56.277546+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:25.708089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018377+0000","last_change":"2024-09-15T22:45:54.994619+0000","last_active":"2024-09-15T22:45:56.018377+0000","last_peered":"2024-09-15T22:45:56.018377+0000","last_clean":"2024-09-15T22:45:56.018377+0000","last_became_active":"2024-09-15T22:45:54.994337+0000","last_became_peered":"2024-09-15T22:45:54.994337+0000","last_unstale":"2024-09-15T22:45:56.018377+0000","last_undegraded":"2024-09-15T22:45:56.018377+0000","last_fullsized":"2024-09-15T22:45:56.018377+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:52.838160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276961+0000","last_change":"2024-09-15T22:45:54.981497+0000","last_active":"2024-09-15T22:45:56.276961+0000","last_peered":"2024-09-15T22:45:56.276961+0000","last_clean":"2024-09-15T22:45:56.276961+0000","last_became_active":"2024-09-15T22:45:54.981205+0000","last_became_peered":"2024-09-15T22:45:54.981205+0000","last_unstale":"2024-09-15T22:45:56.276961+0000","last_undegraded":"2024-09-15T22:45:56.276961+0000","last_fullsized":"2024-09-15T22:45:56.276961+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:03.989690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277463+0000","last_change":"2024-09-15T22:45:54.983266+0000","last_active":"2024-09-15T22:45:56.277463+0000","last_peered":"2024-09-15T22:45:56.277463+0000","last_clean":"2024-09-15T22:45:56.277463+0000","last_became_active":"2024-09-15T22:45:54.982987+0000","last_became_peered":"2024-09-15T22:45:54.982987+0000","last_unstale":"2024-09-15T22:45:56.277463+0000","last_undegraded":"2024-09-15T22:45:56.277463+0000","last_fullsized":"2024-09-15T22:45:56.277463+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:13.078929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973267+0000","last_change":"2024-09-15T22:45:54.991298+0000","last_active":"2024-09-15T22:45:55.973267+0000","last_peered":"2024-09-15T22:45:55.973267+0000","last_clean":"2024-09-15T22:45:55.973267+0000","last_became_active":"2024-09-15T22:45:54.990761+0000","last_became_peered":"2024-09-15T22:45:54.990761+0000","last_unstale":"2024-09-15T22:45:55.973267+0000","last_undegraded":"2024-09-15T22:45:55.973267+0000","last_fullsized":"2024-09-15T22:45:55.973267+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:02.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277390+0000","last_change":"2024-09-15T22:45:54.994170+0000","last_active":"2024-09-15T22:45:56.277390+0000","last_peered":"2024-09-15T22:45:56.277390+0000","last_clean":"2024-09-15T22:45:56.277390+0000","last_became_active":"2024-09-15T22:45:54.993849+0000","last_became_peered":"2024-09-15T22:45:54.993849+0000","last_unstale":"2024-09-15T22:45:56.277390+0000","last_undegraded":"2024-09-15T22:45:56.277390+0000","last_fullsized":"2024-09-15T22:45:56.277390+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:57.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277675+0000","last_change":"2024-09-15T22:45:54.985344+0000","last_active":"2024-09-15T22:45:56.277675+0000","last_peered":"2024-09-15T22:45:56.277675+0000","last_clean":"2024-09-15T22:45:56.277675+0000","last_became_active":"2024-09-15T22:45:54.985090+0000","last_became_peered":"2024-09-15T22:45:54.985090+0000","last_unstale":"2024-09-15T22:45:56.277675+0000","last_undegraded":"2024-09-15T22:45:56.277675+0000","last_fullsized":"2024-09-15T22:45:56.277675+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:08.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277580+0000","last_change":"2024-09-15T22:45:54.993958+0000","last_active":"2024-09-15T22:45:56.277580+0000","last_peered":"2024-09-15T22:45:56.277580+0000","last_clean":"2024-09-15T22:45:56.277580+0000","last_became_active":"2024-09-15T22:45:54.993633+0000","last_became_peered":"2024-09-15T22:45:54.993633+0000","last_unstale":"2024-09-15T22:45:56.277580+0000","last_undegraded":"2024-09-15T22:45:56.277580+0000","last_fullsized":"2024-09-15T22:45:56.277580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:43.275614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276926+0000","last_change":"2024-09-15T22:45:54.994365+0000","last_active":"2024-09-15T22:45:56.276926+0000","last_peered":"2024-09-15T22:45:56.276926+0000","last_clean":"2024-09-15T22:45:56.276926+0000","last_became_active":"2024-09-15T22:45:54.994083+0000","last_became_peered":"2024-09-15T22:45:54.994083+0000","last_unstale":"2024-09-15T22:45:56.276926+0000","last_undegraded":"2024-09-15T22:45:56.276926+0000","last_fullsized":"2024-09-15T22:45:56.276926+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:48.411078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974083+0000","last_change":"2024-09-15T22:45:54.992497+0000","last_active":"2024-09-15T22:45:55.974083+0000","last_peered":"2024-09-15T22:45:55.974083+0000","last_clean":"2024-09-15T22:45:55.974083+0000","last_became_active":"2024-09-15T22:45:54.992242+0000","last_became_peered":"2024-09-15T22:45:54.992242+0000","last_unstale":"2024-09-15T22:45:55.974083+0000","last_undegraded":"2024-09-15T22:45:55.974083+0000","last_fullsized":"2024-09-15T22:45:55.974083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:48.411078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972463+0000","last_change":"2024-09-15T22:45:54.982518+0000","last_active":"2024-09-15T22:45:55.972463+0000","last_peered":"2024-09-15T22:45:55.972463+0000","last_clean":"2024-09-15T22:45:55.972463+0000","last_became_active":"2024-09-15T22:45:54.982249+0000","last_became_peered":"2024-09-15T22:45:54.982249+0000","last_unstale":"2024-09-15T22:45:55.972463+0000","last_undegraded":"2024-09-15T22:45:55.972463+0000","last_fullsized":"2024-09-15T22:45:55.972463+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:17.013850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277010+0000","last_change":"2024-09-15T22:45:54.989297+0000","last_active":"2024-09-15T22:45:56.277010+0000","last_peered":"2024-09-15T22:45:56.277010+0000","last_clean":"2024-09-15T22:45:56.277010+0000","last_became_active":"2024-09-15T22:45:54.988834+0000","last_became_peered":"2024-09-15T22:45:54.988834+0000","last_unstale":"2024-09-15T22:45:56.277010+0000","last_undegraded":"2024-09-15T22:45:56.277010+0000","last_fullsized":"2024-09-15T22:45:56.277010+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:41.590150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976863+0000","last_change":"2024-09-15T22:45:54.994842+0000","last_active":"2024-09-15T22:45:55.976863+0000","last_peered":"2024-09-15T22:45:55.976863+0000","last_clean":"2024-09-15T22:45:55.976863+0000","last_became_active":"2024-09-15T22:45:54.994580+0000","last_became_peered":"2024-09-15T22:45:54.994580+0000","last_unstale":"2024-09-15T22:45:55.976863+0000","last_undegraded":"2024-09-15T22:45:55.976863+0000","last_fullsized":"2024-09-15T22:45:55.976863+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:53.860342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277119+0000","last_change":"2024-09-15T22:45:54.980680+0000","last_active":"2024-09-15T22:45:56.277119+0000","last_peered":"2024-09-15T22:45:56.277119+0000","last_clean":"2024-09-15T22:45:56.277119+0000","last_became_active":"2024-09-15T22:45:54.980429+0000","last_became_peered":"2024-09-15T22:45:54.980429+0000","last_unstale":"2024-09-15T22:45:56.277119+0000","last_undegraded":"2024-09-15T22:45:56.277119+0000","last_fullsized":"2024-09-15T22:45:56.277119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:31.717887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976866+0000","last_change":"2024-09-15T22:45:54.991161+0000","last_active":"2024-09-15T22:45:55.976866+0000","last_peered":"2024-09-15T22:45:55.976866+0000","last_clean":"2024-09-15T22:45:55.976866+0000","last_became_active":"2024-09-15T22:45:54.990689+0000","last_became_peered":"2024-09-15T22:45:54.990689+0000","last_unstale":"2024-09-15T22:45:55.976866+0000","last_undegraded":"2024-09-15T22:45:55.976866+0000","last_fullsized":"2024-09-15T22:45:55.976866+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:36:13.421484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976516+0000","last_change":"2024-09-15T22:45:54.994121+0000","last_active":"2024-09-15T22:45:55.976516+0000","last_peered":"2024-09-15T22:45:55.976516+0000","last_clean":"2024-09-15T22:45:55.976516+0000","last_became_active":"2024-09-15T22:45:54.993813+0000","last_became_peered":"2024-09-15T22:45:54.993813+0000","last_unstale":"2024-09-15T22:45:55.976516+0000","last_undegraded":"2024-09-15T22:45:55.976516+0000","last_fullsized":"2024-09-15T22:45:55.976516+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:52.253273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277413+0000","last_change":"2024-09-15T22:45:54.984265+0000","last_active":"2024-09-15T22:45:56.277413+0000","last_peered":"2024-09-15T22:45:56.277413+0000","last_clean":"2024-09-15T22:45:56.277413+0000","last_became_active":"2024-09-15T22:45:54.983981+0000","last_became_peered":"2024-09-15T22:45:54.983981+0000","last_unstale":"2024-09-15T22:45:56.277413+0000","last_undegraded":"2024-09-15T22:45:56.277413+0000","last_fullsized":"2024-09-15T22:45:56.277413+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:00.386954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018435+0000","last_change":"2024-09-15T22:45:54.987911+0000","last_active":"2024-09-15T22:45:56.018435+0000","last_peered":"2024-09-15T22:45:56.018435+0000","last_clean":"2024-09-15T22:45:56.018435+0000","last_became_active":"2024-09-15T22:45:54.987614+0000","last_became_peered":"2024-09-15T22:45:54.987614+0000","last_unstale":"2024-09-15T22:45:56.018435+0000","last_undegraded":"2024-09-15T22:45:56.018435+0000","last_fullsized":"2024-09-15T22:45:56.018435+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:05.091079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974044+0000","last_change":"2024-09-15T22:45:54.987054+0000","last_active":"2024-09-15T22:45:55.974044+0000","last_peered":"2024-09-15T22:45:55.974044+0000","last_clean":"2024-09-15T22:45:55.974044+0000","last_became_active":"2024-09-15T22:45:54.986764+0000","last_became_peered":"2024-09-15T22:45:54.986764+0000","last_unstale":"2024-09-15T22:45:55.974044+0000","last_undegraded":"2024-09-15T22:45:55.974044+0000","last_fullsized":"2024-09-15T22:45:55.974044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:35.428696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972535+0000","last_change":"2024-09-15T22:45:54.989645+0000","last_active":"2024-09-15T22:45:55.972535+0000","last_peered":"2024-09-15T22:45:55.972535+0000","last_clean":"2024-09-15T22:45:55.972535+0000","last_became_active":"2024-09-15T22:45:54.989345+0000","last_became_peered":"2024-09-15T22:45:54.989345+0000","last_unstale":"2024-09-15T22:45:55.972535+0000","last_undegraded":"2024-09-15T22:45:55.972535+0000","last_fullsized":"2024-09-15T22:45:55.972535+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:59.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277082+0000","last_change":"2024-09-15T22:45:54.984616+0000","last_active":"2024-09-15T22:45:56.277082+0000","last_peered":"2024-09-15T22:45:56.277082+0000","last_clean":"2024-09-15T22:45:56.277082+0000","last_became_active":"2024-09-15T22:45:54.984348+0000","last_became_peered":"2024-09-15T22:45:54.984348+0000","last_unstale":"2024-09-15T22:45:56.277082+0000","last_undegraded":"2024-09-15T22:45:56.277082+0000","last_fullsized":"2024-09-15T22:45:56.277082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:13.315315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018713+0000","last_change":"2024-09-15T22:45:54.986999+0000","last_active":"2024-09-15T22:45:56.018713+0000","last_peered":"2024-09-15T22:45:56.018713+0000","last_clean":"2024-09-15T22:45:56.018713+0000","last_became_active":"2024-09-15T22:45:54.986719+0000","last_became_peered":"2024-09-15T22:45:54.986719+0000","last_unstale":"2024-09-15T22:45:56.018713+0000","last_undegraded":"2024-09-15T22:45:56.018713+0000","last_fullsized":"2024-09-15T22:45:56.018713+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:54.268549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972933+0000","last_change":"2024-09-15T22:45:54.985901+0000","last_active":"2024-09-15T22:45:55.972933+0000","last_peered":"2024-09-15T22:45:55.972933+0000","last_clean":"2024-09-15T22:45:55.972933+0000","last_became_active":"2024-09-15T22:45:54.985423+0000","last_became_peered":"2024-09-15T22:45:54.985423+0000","last_unstale":"2024-09-15T22:45:55.972933+0000","last_undegraded":"2024-09-15T22:45:55.972933+0000","last_fullsized":"2024-09-15T22:45:55.972933+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:42.316792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018442+0000","last_change":"2024-09-15T22:45:54.995281+0000","last_active":"2024-09-15T22:45:56.018442+0000","last_peered":"2024-09-15T22:45:56.018442+0000","last_clean":"2024-09-15T22:45:56.018442+0000","last_became_active":"2024-09-15T22:45:54.994990+0000","last_became_peered":"2024-09-15T22:45:54.994990+0000","last_unstale":"2024-09-15T22:45:56.018442+0000","last_undegraded":"2024-09-15T22:45:56.018442+0000","last_fullsized":"2024-09-15T22:45:56.018442+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:37.236751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974180+0000","last_change":"2024-09-15T22:45:54.986572+0000","last_active":"2024-09-15T22:45:55.974180+0000","last_peered":"2024-09-15T22:45:55.974180+0000","last_clean":"2024-09-15T22:45:55.974180+0000","last_became_active":"2024-09-15T22:45:54.986314+0000","last_became_peered":"2024-09-15T22:45:54.986314+0000","last_unstale":"2024-09-15T22:45:55.974180+0000","last_undegraded":"2024-09-15T22:45:55.974180+0000","last_fullsized":"2024-09-15T22:45:55.974180+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:36.644809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277658+0000","last_change":"2024-09-15T22:45:54.981066+0000","last_active":"2024-09-15T22:45:56.277658+0000","last_peered":"2024-09-15T22:45:56.277658+0000","last_clean":"2024-09-15T22:45:56.277658+0000","last_became_active":"2024-09-15T22:45:54.980775+0000","last_became_peered":"2024-09-15T22:45:54.980775+0000","last_unstale":"2024-09-15T22:45:56.277658+0000","last_undegraded":"2024-09-15T22:45:56.277658+0000","last_fullsized":"2024-09-15T22:45:56.277658+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.502878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972671+0000","last_change":"2024-09-15T22:45:54.981935+0000","last_active":"2024-09-15T22:45:55.972671+0000","last_peered":"2024-09-15T22:45:55.972671+0000","last_clean":"2024-09-15T22:45:55.972671+0000","last_became_active":"2024-09-15T22:45:54.981602+0000","last_became_peered":"2024-09-15T22:45:54.981602+0000","last_unstale":"2024-09-15T22:45:55.972671+0000","last_undegraded":"2024-09-15T22:45:55.972671+0000","last_fullsized":"2024-09-15T22:45:55.972671+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:33.537545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277048+0000","last_change":"2024-09-15T22:45:54.989148+0000","last_active":"2024-09-15T22:45:56.277048+0000","last_peered":"2024-09-15T22:45:56.277048+0000","last_clean":"2024-09-15T22:45:56.277048+0000","last_became_active":"2024-09-15T22:45:54.988469+0000","last_became_peered":"2024-09-15T22:45:54.988469+0000","last_unstale":"2024-09-15T22:45:56.277048+0000","last_undegraded":"2024-09-15T22:45:56.277048+0000","last_fullsized":"2024-09-15T22:45:56.277048+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:18.847057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973297+0000","last_change":"2024-09-15T22:45:54.983091+0000","last_active":"2024-09-15T22:45:55.973297+0000","last_peered":"2024-09-15T22:45:55.973297+0000","last_clean":"2024-09-15T22:45:55.973297+0000","last_became_active":"2024-09-15T22:45:54.982814+0000","last_became_peered":"2024-09-15T22:45:54.982814+0000","last_unstale":"2024-09-15T22:45:55.973297+0000","last_undegraded":"2024-09-15T22:45:55.973297+0000","last_fullsized":"2024-09-15T22:45:55.973297+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.938600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974442+0000","last_change":"2024-09-15T22:45:53.984520+0000","last_active":"2024-09-15T22:45:55.974442+0000","last_peered":"2024-09-15T22:45:55.974442+0000","last_clean":"2024-09-15T22:45:55.974442+0000","last_became_active":"2024-09-15T22:45:53.984251+0000","last_became_peered":"2024-09-15T22:45:53.984251+0000","last_unstale":"2024-09-15T22:45:55.974442+0000","last_undegraded":"2024-09-15T22:45:55.974442+0000","last_fullsized":"2024-09-15T22:45:55.974442+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:47.918322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974363+0000","last_change":"2024-09-15T22:45:54.992044+0000","last_active":"2024-09-15T22:45:55.974363+0000","last_peered":"2024-09-15T22:45:55.974363+0000","last_clean":"2024-09-15T22:45:55.974363+0000","last_became_active":"2024-09-15T22:45:54.988118+0000","last_became_peered":"2024-09-15T22:45:54.988118+0000","last_unstale":"2024-09-15T22:45:55.974363+0000","last_undegraded":"2024-09-15T22:45:55.974363+0000","last_fullsized":"2024-09-15T22:45:55.974363+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:55.585023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277232+0000","last_change":"2024-09-15T22:45:53.986564+0000","last_active":"2024-09-15T22:45:56.277232+0000","last_peered":"2024-09-15T22:45:56.277232+0000","last_clean":"2024-09-15T22:45:56.277232+0000","last_became_active":"2024-09-15T22:45:53.986276+0000","last_became_peered":"2024-09-15T22:45:53.986276+0000","last_unstale":"2024-09-15T22:45:56.277232+0000","last_undegraded":"2024-09-15T22:45:56.277232+0000","last_fullsized":"2024-09-15T22:45:56.277232+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:36:12.414124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018589+0000","last_change":"2024-09-15T22:45:54.991496+0000","last_active":"2024-09-15T22:45:56.018589+0000","last_peered":"2024-09-15T22:45:56.018589+0000","last_clean":"2024-09-15T22:45:56.018589+0000","last_became_active":"2024-09-15T22:45:54.991213+0000","last_became_peered":"2024-09-15T22:45:54.991213+0000","last_unstale":"2024-09-15T22:45:56.018589+0000","last_undegraded":"2024-09-15T22:45:56.018589+0000","last_fullsized":"2024-09-15T22:45:56.018589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:50.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973016+0000","last_change":"2024-09-15T22:45:53.986436+0000","last_active":"2024-09-15T22:45:55.973016+0000","last_peered":"2024-09-15T22:45:55.973016+0000","last_clean":"2024-09-15T22:45:55.973016+0000","last_became_active":"2024-09-15T22:45:53.986161+0000","last_became_peered":"2024-09-15T22:45:53.986161+0000","last_unstale":"2024-09-15T22:45:55.973016+0000","last_undegraded":"2024-09-15T22:45:55.973016+0000","last_fullsized":"2024-09-15T22:45:55.973016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:35.637449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976673+0000","last_change":"2024-09-15T22:45:54.990959+0000","last_active":"2024-09-15T22:45:55.976673+0000","last_peered":"2024-09-15T22:45:55.976673+0000","last_clean":"2024-09-15T22:45:55.976673+0000","last_became_active":"2024-09-15T22:45:54.990351+0000","last_became_peered":"2024-09-15T22:45:54.990351+0000","last_unstale":"2024-09-15T22:45:55.976673+0000","last_undegraded":"2024-09-15T22:45:55.976673+0000","last_fullsized":"2024-09-15T22:45:55.976673+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:06.139164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974027+0000","last_change":"2024-09-15T22:45:53.986150+0000","last_active":"2024-09-15T22:45:55.974027+0000","last_peered":"2024-09-15T22:45:55.974027+0000","last_clean":"2024-09-15T22:45:55.974027+0000","last_became_active":"2024-09-15T22:45:53.985881+0000","last_became_peered":"2024-09-15T22:45:53.985881+0000","last_unstale":"2024-09-15T22:45:55.974027+0000","last_undegraded":"2024-09-15T22:45:55.974027+0000","last_fullsized":"2024-09-15T22:45:55.974027+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:34.421336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973935+0000","last_change":"2024-09-15T22:45:54.993095+0000","last_active":"2024-09-15T22:45:55.973935+0000","last_peered":"2024-09-15T22:45:55.973935+0000","last_clean":"2024-09-15T22:45:55.973935+0000","last_became_active":"2024-09-15T22:45:54.992829+0000","last_became_peered":"2024-09-15T22:45:54.992829+0000","last_unstale":"2024-09-15T22:45:55.973935+0000","last_undegraded":"2024-09-15T22:45:55.973935+0000","last_fullsized":"2024-09-15T22:45:55.973935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:58.771312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976436+0000","last_change":"2024-09-15T22:45:53.982969+0000","last_active":"2024-09-15T22:45:55.976436+0000","last_peered":"2024-09-15T22:45:55.976436+0000","last_clean":"2024-09-15T22:45:55.976436+0000","last_became_active":"2024-09-15T22:45:53.982685+0000","last_became_peered":"2024-09-15T22:45:53.982685+0000","last_unstale":"2024-09-15T22:45:55.976436+0000","last_undegraded":"2024-09-15T22:45:55.976436+0000","last_fullsized":"2024-09-15T22:45:55.976436+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:02.011176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277336+0000","last_change":"2024-09-15T22:45:54.983658+0000","last_active":"2024-09-15T22:45:56.277336+0000","last_peered":"2024-09-15T22:45:56.277336+0000","last_clean":"2024-09-15T22:45:56.277336+0000","last_became_active":"2024-09-15T22:45:54.983388+0000","last_became_peered":"2024-09-15T22:45:54.983388+0000","last_unstale":"2024-09-15T22:45:56.277336+0000","last_undegraded":"2024-09-15T22:45:56.277336+0000","last_fullsized":"2024-09-15T22:45:56.277336+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:48.050876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973419+0000","last_change":"2024-09-15T22:45:53.984855+0000","last_active":"2024-09-15T22:45:55.973419+0000","last_peered":"2024-09-15T22:45:55.973419+0000","last_clean":"2024-09-15T22:45:55.973419+0000","last_became_active":"2024-09-15T22:45:53.984595+0000","last_became_peered":"2024-09-15T22:45:53.984595+0000","last_unstale":"2024-09-15T22:45:55.973419+0000","last_undegraded":"2024-09-15T22:45:55.973419+0000","last_fullsized":"2024-09-15T22:45:55.973419+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:23.010105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277235+0000","last_change":"2024-09-15T22:45:54.995380+0000","last_active":"2024-09-15T22:45:56.277235+0000","last_peered":"2024-09-15T22:45:56.277235+0000","last_clean":"2024-09-15T22:45:56.277235+0000","last_became_active":"2024-09-15T22:45:54.995146+0000","last_became_peered":"2024-09-15T22:45:54.995146+0000","last_unstale":"2024-09-15T22:45:56.277235+0000","last_undegraded":"2024-09-15T22:45:56.277235+0000","last_fullsized":"2024-09-15T22:45:56.277235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:53.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277199+0000","last_change":"2024-09-15T22:45:53.979842+0000","last_active":"2024-09-15T22:45:56.277199+0000","last_peered":"2024-09-15T22:45:56.277199+0000","last_clean":"2024-09-15T22:45:56.277199+0000","last_became_active":"2024-09-15T22:45:53.979570+0000","last_became_peered":"2024-09-15T22:45:53.979570+0000","last_unstale":"2024-09-15T22:45:56.277199+0000","last_undegraded":"2024-09-15T22:45:56.277199+0000","last_fullsized":"2024-09-15T22:45:56.277199+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:36.229392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277108+0000","last_change":"2024-09-15T22:45:54.983957+0000","last_active":"2024-09-15T22:45:56.277108+0000","last_peered":"2024-09-15T22:45:56.277108+0000","last_clean":"2024-09-15T22:45:56.277108+0000","last_became_active":"2024-09-15T22:45:54.983660+0000","last_became_peered":"2024-09-15T22:45:54.983660+0000","last_unstale":"2024-09-15T22:45:56.277108+0000","last_undegraded":"2024-09-15T22:45:56.277108+0000","last_fullsized":"2024-09-15T22:45:56.277108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.252551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277286+0000","last_change":"2024-09-15T22:45:53.983180+0000","last_active":"2024-09-15T22:45:56.277286+0000","last_peered":"2024-09-15T22:45:56.277286+0000","last_clean":"2024-09-15T22:45:56.277286+0000","last_became_active":"2024-09-15T22:45:53.982846+0000","last_became_peered":"2024-09-15T22:45:53.982846+0000","last_unstale":"2024-09-15T22:45:56.277286+0000","last_undegraded":"2024-09-15T22:45:56.277286+0000","last_fullsized":"2024-09-15T22:45:56.277286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:22.869920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277076+0000","last_change":"2024-09-15T22:45:54.982226+0000","last_active":"2024-09-15T22:45:56.277076+0000","last_peered":"2024-09-15T22:45:56.277076+0000","last_clean":"2024-09-15T22:45:56.277076+0000","last_became_active":"2024-09-15T22:45:54.981934+0000","last_became_peered":"2024-09-15T22:45:54.981934+0000","last_unstale":"2024-09-15T22:45:56.277076+0000","last_undegraded":"2024-09-15T22:45:56.277076+0000","last_fullsized":"2024-09-15T22:45:56.277076+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:36.644809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972916+0000","last_change":"2024-09-15T22:45:53.982342+0000","last_active":"2024-09-15T22:45:55.972916+0000","last_peered":"2024-09-15T22:45:55.972916+0000","last_clean":"2024-09-15T22:45:55.972916+0000","last_became_active":"2024-09-15T22:45:53.981639+0000","last_became_peered":"2024-09-15T22:45:53.981639+0000","last_unstale":"2024-09-15T22:45:55.972916+0000","last_undegraded":"2024-09-15T22:45:55.972916+0000","last_fullsized":"2024-09-15T22:45:55.972916+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:07.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277121+0000","last_change":"2024-09-15T22:45:54.993936+0000","last_active":"2024-09-15T22:45:56.277121+0000","last_peered":"2024-09-15T22:45:56.277121+0000","last_clean":"2024-09-15T22:45:56.277121+0000","last_became_active":"2024-09-15T22:45:54.993561+0000","last_became_peered":"2024-09-15T22:45:54.993561+0000","last_unstale":"2024-09-15T22:45:56.277121+0000","last_undegraded":"2024-09-15T22:45:56.277121+0000","last_fullsized":"2024-09-15T22:45:56.277121+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:38.357470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277445+0000","last_change":"2024-09-15T22:45:53.985024+0000","last_active":"2024-09-15T22:45:56.277445+0000","last_peered":"2024-09-15T22:45:56.277445+0000","last_clean":"2024-09-15T22:45:56.277445+0000","last_became_active":"2024-09-15T22:45:53.984286+0000","last_became_peered":"2024-09-15T22:45:53.984286+0000","last_unstale":"2024-09-15T22:45:56.277445+0000","last_undegraded":"2024-09-15T22:45:56.277445+0000","last_fullsized":"2024-09-15T22:45:56.277445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.760070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018610+0000","last_change":"2024-09-15T22:45:54.986400+0000","last_active":"2024-09-15T22:45:56.018610+0000","last_peered":"2024-09-15T22:45:56.018610+0000","last_clean":"2024-09-15T22:45:56.018610+0000","last_became_active":"2024-09-15T22:45:54.986087+0000","last_became_peered":"2024-09-15T22:45:54.986087+0000","last_unstale":"2024-09-15T22:45:56.018610+0000","last_undegraded":"2024-09-15T22:45:56.018610+0000","last_fullsized":"2024-09-15T22:45:56.018610+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:38.860197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"106'3","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277467+0000","last_change":"2024-09-15T22:45:53.987937+0000","last_active":"2024-09-15T22:45:56.277467+0000","last_peered":"2024-09-15T22:45:56.277467+0000","last_clean":"2024-09-15T22:45:56.277467+0000","last_became_active":"2024-09-15T22:45:53.987613+0000","last_became_peered":"2024-09-15T22:45:53.987613+0000","last_unstale":"2024-09-15T22:45:56.277467+0000","last_undegraded":"2024-09-15T22:45:56.277467+0000","last_fullsized":"2024-09-15T22:45:56.277467+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:28.506476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277674+0000","last_change":"2024-09-15T22:45:54.986177+0000","last_active":"2024-09-15T22:45:56.277674+0000","last_peered":"2024-09-15T22:45:56.277674+0000","last_clean":"2024-09-15T22:45:56.277674+0000","last_became_active":"2024-09-15T22:45:54.985257+0000","last_became_peered":"2024-09-15T22:45:54.985257+0000","last_unstale":"2024-09-15T22:45:56.277674+0000","last_undegraded":"2024-09-15T22:45:56.277674+0000","last_fullsized":"2024-09-15T22:45:56.277674+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:32.804052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"106'6","reported_seq":20,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974014+0000","last_change":"2024-09-15T22:45:53.981679+0000","last_active":"2024-09-15T22:45:55.974014+0000","last_peered":"2024-09-15T22:45:55.974014+0000","last_clean":"2024-09-15T22:45:55.974014+0000","last_became_active":"2024-09-15T22:45:53.980851+0000","last_became_peered":"2024-09-15T22:45:53.980851+0000","last_unstale":"2024-09-15T22:45:55.974014+0000","last_undegraded":"2024-09-15T22:45:55.974014+0000","last_fullsized":"2024-09-15T22:45:55.974014+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:47.403718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277128+0000","last_change":"2024-09-15T22:45:54.989008+0000","last_active":"2024-09-15T22:45:56.277128+0000","last_peered":"2024-09-15T22:45:56.277128+0000","last_clean":"2024-09-15T22:45:56.277128+0000","last_became_active":"2024-09-15T22:45:54.988711+0000","last_became_peered":"2024-09-15T22:45:54.988711+0000","last_unstale":"2024-09-15T22:45:56.277128+0000","last_undegraded":"2024-09-15T22:45:56.277128+0000","last_fullsized":"2024-09-15T22:45:56.277128+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:03.018536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277401+0000","last_change":"2024-09-15T22:45:53.985053+0000","last_active":"2024-09-15T22:45:56.277401+0000","last_peered":"2024-09-15T22:45:56.277401+0000","last_clean":"2024-09-15T22:45:56.277401+0000","last_became_active":"2024-09-15T22:45:53.984794+0000","last_became_peered":"2024-09-15T22:45:53.984794+0000","last_unstale":"2024-09-15T22:45:56.277401+0000","last_undegraded":"2024-09-15T22:45:56.277401+0000","last_fullsized":"2024-09-15T22:45:56.277401+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:54.561287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973988+0000","last_change":"2024-09-15T22:45:54.983839+0000","last_active":"2024-09-15T22:45:55.973988+0000","last_peered":"2024-09-15T22:45:55.973988+0000","last_clean":"2024-09-15T22:45:55.973988+0000","last_became_active":"2024-09-15T22:45:54.982639+0000","last_became_peered":"2024-09-15T22:45:54.982639+0000","last_unstale":"2024-09-15T22:45:55.973988+0000","last_undegraded":"2024-09-15T22:45:55.973988+0000","last_fullsized":"2024-09-15T22:45:55.973988+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:15.496241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976516+0000","last_change":"2024-09-15T22:45:53.988135+0000","last_active":"2024-09-15T22:45:55.976516+0000","last_peered":"2024-09-15T22:45:55.976516+0000","last_clean":"2024-09-15T22:45:55.976516+0000","last_became_active":"2024-09-15T22:45:53.987855+0000","last_became_peered":"2024-09-15T22:45:53.987855+0000","last_unstale":"2024-09-15T22:45:55.976516+0000","last_undegraded":"2024-09-15T22:45:55.976516+0000","last_fullsized":"2024-09-15T22:45:55.976516+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:52.888492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972886+0000","last_change":"2024-09-15T22:45:54.992877+0000","last_active":"2024-09-15T22:45:55.972886+0000","last_peered":"2024-09-15T22:45:55.972886+0000","last_clean":"2024-09-15T22:45:55.972886+0000","last_became_active":"2024-09-15T22:45:54.992577+0000","last_became_peered":"2024-09-15T22:45:54.992577+0000","last_unstale":"2024-09-15T22:45:55.972886+0000","last_undegraded":"2024-09-15T22:45:55.972886+0000","last_fullsized":"2024-09-15T22:45:55.972886+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:53.287690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972315+0000","last_change":"2024-09-15T22:45:53.977876+0000","last_active":"2024-09-15T22:45:55.972315+0000","last_peered":"2024-09-15T22:45:55.972315+0000","last_clean":"2024-09-15T22:45:55.972315+0000","last_became_active":"2024-09-15T22:45:53.977588+0000","last_became_peered":"2024-09-15T22:45:53.977588+0000","last_unstale":"2024-09-15T22:45:55.972315+0000","last_undegraded":"2024-09-15T22:45:55.972315+0000","last_fullsized":"2024-09-15T22:45:55.972315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:07.606646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973478+0000","last_change":"2024-09-15T22:45:54.981020+0000","last_active":"2024-09-15T22:45:55.973478+0000","last_peered":"2024-09-15T22:45:55.973478+0000","last_clean":"2024-09-15T22:45:55.973478+0000","last_became_active":"2024-09-15T22:45:54.980707+0000","last_became_peered":"2024-09-15T22:45:54.980707+0000","last_unstale":"2024-09-15T22:45:55.973478+0000","last_undegraded":"2024-09-15T22:45:55.973478+0000","last_fullsized":"2024-09-15T22:45:55.973478+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:16.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018552+0000","last_change":"2024-09-15T22:45:53.987003+0000","last_active":"2024-09-15T22:45:56.018552+0000","last_peered":"2024-09-15T22:45:56.018552+0000","last_clean":"2024-09-15T22:45:56.018552+0000","last_became_active":"2024-09-15T22:45:53.986709+0000","last_became_peered":"2024-09-15T22:45:53.986709+0000","last_unstale":"2024-09-15T22:45:56.018552+0000","last_undegraded":"2024-09-15T22:45:56.018552+0000","last_fullsized":"2024-09-15T22:45:56.018552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:37.015404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973698+0000","last_change":"2024-09-15T22:45:54.991036+0000","last_active":"2024-09-15T22:45:55.973698+0000","last_peered":"2024-09-15T22:45:55.973698+0000","last_clean":"2024-09-15T22:45:55.973698+0000","last_became_active":"2024-09-15T22:45:54.990344+0000","last_became_peered":"2024-09-15T22:45:54.990344+0000","last_unstale":"2024-09-15T22:45:55.973698+0000","last_undegraded":"2024-09-15T22:45:55.973698+0000","last_fullsized":"2024-09-15T22:45:55.973698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:18.957270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277555+0000","last_change":"2024-09-15T22:45:53.984874+0000","last_active":"2024-09-15T22:45:56.277555+0000","last_peered":"2024-09-15T22:45:56.277555+0000","last_clean":"2024-09-15T22:45:56.277555+0000","last_became_active":"2024-09-15T22:45:53.984628+0000","last_became_peered":"2024-09-15T22:45:53.984628+0000","last_unstale":"2024-09-15T22:45:56.277555+0000","last_undegraded":"2024-09-15T22:45:56.277555+0000","last_fullsized":"2024-09-15T22:45:56.277555+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:48.460728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277668+0000","last_change":"2024-09-15T22:45:54.980040+0000","last_active":"2024-09-15T22:45:56.277668+0000","last_peered":"2024-09-15T22:45:56.277668+0000","last_clean":"2024-09-15T22:45:56.277668+0000","last_became_active":"2024-09-15T22:45:54.979765+0000","last_became_peered":"2024-09-15T22:45:54.979765+0000","last_unstale":"2024-09-15T22:45:56.277668+0000","last_undegraded":"2024-09-15T22:45:56.277668+0000","last_fullsized":"2024-09-15T22:45:56.277668+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:59.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974331+0000","last_change":"2024-09-15T22:45:53.982769+0000","last_active":"2024-09-15T22:45:55.974331+0000","last_peered":"2024-09-15T22:45:55.974331+0000","last_clean":"2024-09-15T22:45:55.974331+0000","last_became_active":"2024-09-15T22:45:53.982511+0000","last_became_peered":"2024-09-15T22:45:53.982511+0000","last_unstale":"2024-09-15T22:45:55.974331+0000","last_undegraded":"2024-09-15T22:45:55.974331+0000","last_fullsized":"2024-09-15T22:45:55.974331+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:18.744631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974200+0000","last_change":"2024-09-15T22:45:54.984560+0000","last_active":"2024-09-15T22:45:55.974200+0000","last_peered":"2024-09-15T22:45:55.974200+0000","last_clean":"2024-09-15T22:45:55.974200+0000","last_became_active":"2024-09-15T22:45:54.984296+0000","last_became_peered":"2024-09-15T22:45:54.984296+0000","last_unstale":"2024-09-15T22:45:55.974200+0000","last_undegraded":"2024-09-15T22:45:55.974200+0000","last_fullsized":"2024-09-15T22:45:55.974200+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:38.357470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974119+0000","last_change":"2024-09-15T22:45:53.976030+0000","last_active":"2024-09-15T22:45:55.974119+0000","last_peered":"2024-09-15T22:45:55.974119+0000","last_clean":"2024-09-15T22:45:55.974119+0000","last_became_active":"2024-09-15T22:45:53.975720+0000","last_became_peered":"2024-09-15T22:45:53.975720+0000","last_unstale":"2024-09-15T22:45:55.974119+0000","last_undegraded":"2024-09-15T22:45:55.974119+0000","last_fullsized":"2024-09-15T22:45:55.974119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:42.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976456+0000","last_change":"2024-09-15T22:45:54.988475+0000","last_active":"2024-09-15T22:45:55.976456+0000","last_peered":"2024-09-15T22:45:55.976456+0000","last_clean":"2024-09-15T22:45:55.976456+0000","last_became_active":"2024-09-15T22:45:54.988220+0000","last_became_peered":"2024-09-15T22:45:54.988220+0000","last_unstale":"2024-09-15T22:45:55.976456+0000","last_undegraded":"2024-09-15T22:45:55.976456+0000","last_fullsized":"2024-09-15T22:45:55.976456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:36.223443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277517+0000","last_change":"2024-09-15T22:45:53.984492+0000","last_active":"2024-09-15T22:45:56.277517+0000","last_peered":"2024-09-15T22:45:56.277517+0000","last_clean":"2024-09-15T22:45:56.277517+0000","last_became_active":"2024-09-15T22:45:53.984202+0000","last_became_peered":"2024-09-15T22:45:53.984202+0000","last_unstale":"2024-09-15T22:45:56.277517+0000","last_undegraded":"2024-09-15T22:45:56.277517+0000","last_fullsized":"2024-09-15T22:45:56.277517+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:26.023347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973348+0000","last_change":"2024-09-15T22:45:54.983308+0000","last_active":"2024-09-15T22:45:55.973348+0000","last_peered":"2024-09-15T22:45:55.973348+0000","last_clean":"2024-09-15T22:45:55.973348+0000","last_became_active":"2024-09-15T22:45:54.983013+0000","last_became_peered":"2024-09-15T22:45:54.983013+0000","last_unstale":"2024-09-15T22:45:55.973348+0000","last_undegraded":"2024-09-15T22:45:55.973348+0000","last_fullsized":"2024-09-15T22:45:55.973348+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:22.637016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973528+0000","last_change":"2024-09-15T22:45:53.988270+0000","last_active":"2024-09-15T22:45:55.973528+0000","last_peered":"2024-09-15T22:45:55.973528+0000","last_clean":"2024-09-15T22:45:55.973528+0000","last_became_active":"2024-09-15T22:45:53.987961+0000","last_became_peered":"2024-09-15T22:45:53.987961+0000","last_unstale":"2024-09-15T22:45:55.973528+0000","last_undegraded":"2024-09-15T22:45:55.973528+0000","last_fullsized":"2024-09-15T22:45:55.973528+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:06.711314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974007+0000","last_change":"2024-09-15T22:45:54.992940+0000","last_active":"2024-09-15T22:45:55.974007+0000","last_peered":"2024-09-15T22:45:55.974007+0000","last_clean":"2024-09-15T22:45:55.974007+0000","last_became_active":"2024-09-15T22:45:54.992667+0000","last_became_peered":"2024-09-15T22:45:54.992667+0000","last_unstale":"2024-09-15T22:45:55.974007+0000","last_undegraded":"2024-09-15T22:45:55.974007+0000","last_fullsized":"2024-09-15T22:45:55.974007+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:08.928014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973377+0000","last_change":"2024-09-15T22:45:53.987587+0000","last_active":"2024-09-15T22:45:55.973377+0000","last_peered":"2024-09-15T22:45:55.973377+0000","last_clean":"2024-09-15T22:45:55.973377+0000","last_became_active":"2024-09-15T22:45:53.987282+0000","last_became_peered":"2024-09-15T22:45:53.987282+0000","last_unstale":"2024-09-15T22:45:55.973377+0000","last_undegraded":"2024-09-15T22:45:55.973377+0000","last_fullsized":"2024-09-15T22:45:55.973377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:38.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277080+0000","last_change":"2024-09-15T22:45:54.996309+0000","last_active":"2024-09-15T22:45:56.277080+0000","last_peered":"2024-09-15T22:45:56.277080+0000","last_clean":"2024-09-15T22:45:56.277080+0000","last_became_active":"2024-09-15T22:45:54.996094+0000","last_became_peered":"2024-09-15T22:45:54.996094+0000","last_unstale":"2024-09-15T22:45:56.277080+0000","last_undegraded":"2024-09-15T22:45:56.277080+0000","last_fullsized":"2024-09-15T22:45:56.277080+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:11.063397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972653+0000","last_change":"2024-09-15T22:45:53.982924+0000","last_active":"2024-09-15T22:45:55.972653+0000","last_peered":"2024-09-15T22:45:55.972653+0000","last_clean":"2024-09-15T22:45:55.972653+0000","last_became_active":"2024-09-15T22:45:53.982647+0000","last_became_peered":"2024-09-15T22:45:53.982647+0000","last_unstale":"2024-09-15T22:45:55.972653+0000","last_undegraded":"2024-09-15T22:45:55.972653+0000","last_fullsized":"2024-09-15T22:45:55.972653+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:37.658855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974273+0000","last_change":"2024-09-15T22:45:54.993018+0000","last_active":"2024-09-15T22:45:55.974273+0000","last_peered":"2024-09-15T22:45:55.974273+0000","last_clean":"2024-09-15T22:45:55.974273+0000","last_became_active":"2024-09-15T22:45:54.992749+0000","last_became_peered":"2024-09-15T22:45:54.992749+0000","last_unstale":"2024-09-15T22:45:55.974273+0000","last_undegraded":"2024-09-15T22:45:55.974273+0000","last_fullsized":"2024-09-15T22:45:55.974273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:30.862456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973015+0000","last_change":"2024-09-15T22:45:53.982385+0000","last_active":"2024-09-15T22:45:55.973015+0000","last_peered":"2024-09-15T22:45:55.973015+0000","last_clean":"2024-09-15T22:45:55.973015+0000","last_became_active":"2024-09-15T22:45:53.982084+0000","last_became_peered":"2024-09-15T22:45:53.982084+0000","last_unstale":"2024-09-15T22:45:55.973015+0000","last_undegraded":"2024-09-15T22:45:55.973015+0000","last_fullsized":"2024-09-15T22:45:55.973015+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:29.855096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018578+0000","last_change":"2024-09-15T22:45:54.986396+0000","last_active":"2024-09-15T22:45:56.018578+0000","last_peered":"2024-09-15T22:45:56.018578+0000","last_clean":"2024-09-15T22:45:56.018578+0000","last_became_active":"2024-09-15T22:45:54.986111+0000","last_became_peered":"2024-09-15T22:45:54.986111+0000","last_unstale":"2024-09-15T22:45:56.018578+0000","last_undegraded":"2024-09-15T22:45:56.018578+0000","last_fullsized":"2024-09-15T22:45:56.018578+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:29.739058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"107'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.975413+0000","last_change":"2024-09-15T22:45:53.983141+0000","last_active":"2024-09-15T22:45:56.975413+0000","last_peered":"2024-09-15T22:45:56.975413+0000","last_clean":"2024-09-15T22:45:56.975413+0000","last_became_active":"2024-09-15T22:45:53.982857+0000","last_became_peered":"2024-09-15T22:45:53.982857+0000","last_unstale":"2024-09-15T22:45:56.975413+0000","last_undegraded":"2024-09-15T22:45:56.975413+0000","last_fullsized":"2024-09-15T22:45:56.975413+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:04.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973185+0000","last_change":"2024-09-15T22:45:54.983240+0000","last_active":"2024-09-15T22:45:55.973185+0000","last_peered":"2024-09-15T22:45:55.973185+0000","last_clean":"2024-09-15T22:45:55.973185+0000","last_became_active":"2024-09-15T22:45:54.982944+0000","last_became_peered":"2024-09-15T22:45:54.982944+0000","last_unstale":"2024-09-15T22:45:55.973185+0000","last_undegraded":"2024-09-15T22:45:55.973185+0000","last_fullsized":"2024-09-15T22:45:55.973185+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:01.265954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973109+0000","last_change":"2024-09-15T22:45:53.985978+0000","last_active":"2024-09-15T22:45:55.973109+0000","last_peered":"2024-09-15T22:45:55.973109+0000","last_clean":"2024-09-15T22:45:55.973109+0000","last_became_active":"2024-09-15T22:45:53.985572+0000","last_became_peered":"2024-09-15T22:45:53.985572+0000","last_unstale":"2024-09-15T22:45:55.973109+0000","last_undegraded":"2024-09-15T22:45:55.973109+0000","last_fullsized":"2024-09-15T22:45:55.973109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:37.350111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974346+0000","last_change":"2024-09-15T22:45:54.993051+0000","last_active":"2024-09-15T22:45:55.974346+0000","last_peered":"2024-09-15T22:45:55.974346+0000","last_clean":"2024-09-15T22:45:55.974346+0000","last_became_active":"2024-09-15T22:45:54.992008+0000","last_became_peered":"2024-09-15T22:45:54.992008+0000","last_unstale":"2024-09-15T22:45:55.974346+0000","last_undegraded":"2024-09-15T22:45:55.974346+0000","last_fullsized":"2024-09-15T22:45:55.974346+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:39.153860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974129+0000","last_change":"2024-09-15T22:45:53.983148+0000","last_active":"2024-09-15T22:45:55.974129+0000","last_peered":"2024-09-15T22:45:55.974129+0000","last_clean":"2024-09-15T22:45:55.974129+0000","last_became_active":"2024-09-15T22:45:53.982814+0000","last_became_peered":"2024-09-15T22:45:53.982814+0000","last_unstale":"2024-09-15T22:45:55.974129+0000","last_undegraded":"2024-09-15T22:45:55.974129+0000","last_fullsized":"2024-09-15T22:45:55.974129+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:46.952434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976420+0000","last_change":"2024-09-15T22:45:54.989400+0000","last_active":"2024-09-15T22:45:55.976420+0000","last_peered":"2024-09-15T22:45:55.976420+0000","last_clean":"2024-09-15T22:45:55.976420+0000","last_became_active":"2024-09-15T22:45:54.989135+0000","last_became_peered":"2024-09-15T22:45:54.989135+0000","last_unstale":"2024-09-15T22:45:55.976420+0000","last_undegraded":"2024-09-15T22:45:55.976420+0000","last_fullsized":"2024-09-15T22:45:55.976420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:43.732486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277464+0000","last_change":"2024-09-15T22:45:53.985078+0000","last_active":"2024-09-15T22:45:56.277464+0000","last_peered":"2024-09-15T22:45:56.277464+0000","last_clean":"2024-09-15T22:45:56.277464+0000","last_became_active":"2024-09-15T22:45:53.984560+0000","last_became_peered":"2024-09-15T22:45:53.984560+0000","last_unstale":"2024-09-15T22:45:56.277464+0000","last_undegraded":"2024-09-15T22:45:56.277464+0000","last_fullsized":"2024-09-15T22:45:56.277464+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:28.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974399+0000","last_change":"2024-09-15T22:45:54.994188+0000","last_active":"2024-09-15T22:45:55.974399+0000","last_peered":"2024-09-15T22:45:55.974399+0000","last_clean":"2024-09-15T22:45:55.974399+0000","last_became_active":"2024-09-15T22:45:54.993927+0000","last_became_peered":"2024-09-15T22:45:54.993927+0000","last_unstale":"2024-09-15T22:45:55.974399+0000","last_undegraded":"2024-09-15T22:45:55.974399+0000","last_fullsized":"2024-09-15T22:45:55.974399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:18.491048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974149+0000","last_change":"2024-09-15T22:45:53.982728+0000","last_active":"2024-09-15T22:45:55.974149+0000","last_peered":"2024-09-15T22:45:55.974149+0000","last_clean":"2024-09-15T22:45:55.974149+0000","last_became_active":"2024-09-15T22:45:53.982291+0000","last_became_peered":"2024-09-15T22:45:53.982291+0000","last_unstale":"2024-09-15T22:45:55.974149+0000","last_undegraded":"2024-09-15T22:45:55.974149+0000","last_fullsized":"2024-09-15T22:45:55.974149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:46.151065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974091+0000","last_change":"2024-09-15T22:45:54.986293+0000","last_active":"2024-09-15T22:45:55.974091+0000","last_peered":"2024-09-15T22:45:55.974091+0000","last_clean":"2024-09-15T22:45:55.974091+0000","last_became_active":"2024-09-15T22:45:54.986029+0000","last_became_peered":"2024-09-15T22:45:54.986029+0000","last_unstale":"2024-09-15T22:45:55.974091+0000","last_undegraded":"2024-09-15T22:45:55.974091+0000","last_fullsized":"2024-09-15T22:45:55.974091+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:47.959794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972821+0000","last_change":"2024-09-15T22:45:53.979582+0000","last_active":"2024-09-15T22:45:55.972821+0000","last_peered":"2024-09-15T22:45:55.972821+0000","last_clean":"2024-09-15T22:45:55.972821+0000","last_became_active":"2024-09-15T22:45:53.978698+0000","last_became_peered":"2024-09-15T22:45:53.978698+0000","last_unstale":"2024-09-15T22:45:55.972821+0000","last_undegraded":"2024-09-15T22:45:55.972821+0000","last_fullsized":"2024-09-15T22:45:55.972821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:49.521031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018363+0000","last_change":"2024-09-15T22:45:54.986194+0000","last_active":"2024-09-15T22:45:56.018363+0000","last_peered":"2024-09-15T22:45:56.018363+0000","last_clean":"2024-09-15T22:45:56.018363+0000","last_became_active":"2024-09-15T22:45:54.985912+0000","last_became_peered":"2024-09-15T22:45:54.985912+0000","last_unstale":"2024-09-15T22:45:56.018363+0000","last_undegraded":"2024-09-15T22:45:56.018363+0000","last_fullsized":"2024-09-15T22:45:56.018363+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:52.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018233+0000","last_change":"2024-09-15T22:45:53.984104+0000","last_active":"2024-09-15T22:45:56.018233+0000","last_peered":"2024-09-15T22:45:56.018233+0000","last_clean":"2024-09-15T22:45:56.018233+0000","last_became_active":"2024-09-15T22:45:53.983835+0000","last_became_peered":"2024-09-15T22:45:53.983835+0000","last_unstale":"2024-09-15T22:45:56.018233+0000","last_undegraded":"2024-09-15T22:45:56.018233+0000","last_fullsized":"2024-09-15T22:45:56.018233+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973884+0000","last_change":"2024-09-15T22:45:54.983811+0000","last_active":"2024-09-15T22:45:55.973884+0000","last_peered":"2024-09-15T22:45:55.973884+0000","last_clean":"2024-09-15T22:45:55.973884+0000","last_became_active":"2024-09-15T22:45:54.983161+0000","last_became_peered":"2024-09-15T22:45:54.983161+0000","last_unstale":"2024-09-15T22:45:55.973884+0000","last_undegraded":"2024-09-15T22:45:55.973884+0000","last_fullsized":"2024-09-15T22:45:55.973884+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.251834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276741+0000","last_change":"2024-09-15T22:45:53.988158+0000","last_active":"2024-09-15T22:45:56.276741+0000","last_peered":"2024-09-15T22:45:56.276741+0000","last_clean":"2024-09-15T22:45:56.276741+0000","last_became_active":"2024-09-15T22:45:53.987824+0000","last_became_peered":"2024-09-15T22:45:53.987824+0000","last_unstale":"2024-09-15T22:45:56.276741+0000","last_undegraded":"2024-09-15T22:45:56.276741+0000","last_fullsized":"2024-09-15T22:45:56.276741+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:52.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":366,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976326+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:45:55.976326+0000","last_peered":"2024-09-15T22:45:55.976326+0000","last_clean":"2024-09-15T22:45:55.976326+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:45:55.976326+0000","last_undegraded":"2024-09-15T22:45:55.976326+0000","last_fullsized":"2024-09-15T22:45:55.976326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1343488,"data_stored":580110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":578374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1925120,"data_stored":1168834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1339392,"data_stored":580076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":578374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1335296,"data_stored":579012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1916928,"data_stored":1168742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1331200,"data_stored":579026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:57.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.049+0000 7f4ffd7c4640 1 Processor -- start 2024-09-15T22:45:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.049+0000 7f4ffd7c4640 1 -- start start 2024-09-15T22:45:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4ffd7c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4ff80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4ffd7c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4ff80cef90 0x7f4ff80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4ffd7c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff80b7170 con 0x7f4ff815ed20 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4ffd7c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff80d1ae0 con 0x7f4ff80cef90 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4ffd7c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80b7aa0 con 0x7f4ff815e940 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4fee7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4ff815ed20 0x7f4ff80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43940/0 (socket says 172.21.15.134:43940) 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.050+0000 7f4fee7fc640 1 -- 172.21.15.134:0/3913829009 learned_addr learned my addr 172.21.15.134:0/3913829009 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/3913829009 >> v2:172.21.15.177:3300/0 conn(0x7f4ff80cef90 0x7f4ff80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4ff80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850694635 0 0) 0x7f4fe0001110 con 0x7f4ff815ed20 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe4003520 con 0x7f4ff815ed20 2024-09-15T22:45:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1911470488 0 0) 0x7f4fe4003520 con 0x7f4ff815ed20 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 msgr2=0x7f4ff80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4ff80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 >> v2:172.21.15.177:3300/0 conn(0x7f4ff80cef90 msgr2=0x7f4ff80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 --2- 172.21.15.134:0/3913829009 >> v2:172.21.15.177:3300/0 conn(0x7f4ff80cef90 0x7f4ff80d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff80d3660 con 0x7f4ff815ed20 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f4fe0001840 con 0x7f4ff815ed20 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/3913829009 >> v2:172.21.15.177:3300/0 conn(0x7f4ff80cef90 0x7f4ff80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4ff80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 >> v1:172.21.15.134:6789/0 conn(0x7f4ff815ed20 legacy=0x7f4ff80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fe40039b0 0x7f4fe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4fe4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80b7aa0 con 0x7f4fe40039b0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe400b9c0 con 0x7f4fe4004d40 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe400bb40 con 0x7f4ff815e940 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fe40039b0 0x7f4fe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4fee7fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4fe4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 -- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 msgr2=0x7f4fe4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4fe4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 -- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe4004d40 msgr2=0x7f4fe40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4ff6ffd640 1 -- 172.21.15.134:0/3913829009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe4003520 con 0x7f4fe40039b0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.051+0000 7f4fee7fc640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff815e940 0x7f4fe4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.052+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fe40039b0 0x7f4fe4003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009c90 tx=0x7f4fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a8df37950cb82c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.052+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8036070 con 0x7f4fe40039b0 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.052+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8031400 con 0x7f4fe40039b0 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.052+0000 7f4ff67fc640 1 -- 172.21.15.134:0/3913829009 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8009860 con 0x7f4fe40039b0 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/3913829009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fe40039b0 msgr2=0x7f4fe4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/3913829009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fe40039b0 0x7f4fe4003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009c90 tx=0x7f4fe4005830 comp rx=0 tx=0).stop 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ff77fe640 1 -- 172.21.15.134:0/3913829009 reap_dead start 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/3913829009 shutdown_connections 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/3913829009 >> 172.21.15.134:0/3913829009 conn(0x7f4ff80b6240 msgr2=0x7f4ff80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/3913829009 shutdown_connections 2024-09-15T22:45:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.053+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/3913829009 wait complete. 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.054+0000 7f4ffd7c4640 1 Processor -- start 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.054+0000 7f4ffd7c4640 1 -- start start 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40039b0 0x7f4ff8157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff80b4dc0 0x7f4ff8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80d3f00 con 0x7f4ff8158700 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80d3c20 con 0x7f4fe40039b0 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ffd7c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80d3310 con 0x7f4ff80b4dc0 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50456/0 (socket says 172.21.15.134:50456) 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 -- 172.21.15.134:0/2206824570 learned_addr learned my addr 172.21.15.134:0/2206824570 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40039b0 0x7f4ff8157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4fee7fc640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff80b4dc0 0x7f4ff8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 -- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff80b4dc0 msgr2=0x7f4ff8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff80b4dc0 0x7f4ff8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 -- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40039b0 msgr2=0x7f4ff8157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40039b0 0x7f4ff8157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 -- 172.21.15.134:0/2206824570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff8157320 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.055+0000 7f4ff77fe640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80d0d90 tx=0x7f4ff000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.056+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0003990 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.056+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0003b30 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.056+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0004020 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.056+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff8157600 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.056+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff8156520 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.057+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80d1ef0 con 0x7f4ff8158700 2024-09-15T22:45:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.057+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f4ff00041c0 con 0x7f4ff8158700 2024-09-15T22:45:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.058+0000 7f4feffff640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 0x7f4fd806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.058+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f4ff008c220 con 0x7f4ff8158700 2024-09-15T22:45:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.058+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 0x7f4fd806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.058+0000 7f4ff6ffd640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 0x7f4fd806e890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8033000 tx=0x7f4fe8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.062+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ff0019030 con 0x7f4ff8158700 2024-09-15T22:45:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.224+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ff80b5360 con 0x7f4fd806c3d0 2024-09-15T22:45:58.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.231+0000 7f4feffff640 1 -- 172.21.15.134:0/2206824570 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7f4fe8045450 con 0x7f4fd806c3d0 2024-09-15T22:45:58.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:58.236 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:45:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 msgr2=0x7f4fd806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 0x7f4fd806e890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8033000 tx=0x7f4fe8008030 comp rx=0 tx=0).stop 2024-09-15T22:45:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 msgr2=0x7f4ff8158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80d0d90 tx=0x7f4ff000f580 comp rx=0 tx=0).stop 2024-09-15T22:45:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 shutdown_connections 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4fd806c3d0 0x7f4fd806e890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ff8158700 0x7f4ff8158b90 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ff80b4dc0 0x7f4ff8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 --2- 172.21.15.134:0/2206824570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40039b0 0x7f4ff8157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 >> 172.21.15.134:0/2206824570 conn(0x7f4ff80b6240 msgr2=0x7f4ff80b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 shutdown_connections 2024-09-15T22:45:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.234+0000 7f4ffd7c4640 1 -- 172.21.15.134:0/2206824570 wait complete. 2024-09-15T22:45:58.246 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-15T22:45:57.188862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261108,"kb_used_data":11560,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713612,"statfs":{"total":773094113280,"available":772826738688,"internally_reserved":0,"allocated":11837440,"data_stored":5812548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.223854"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973100+0000","last_change":"2024-09-15T22:45:54.989489+0000","last_active":"2024-09-15T22:45:55.973100+0000","last_peered":"2024-09-15T22:45:55.973100+0000","last_clean":"2024-09-15T22:45:55.973100+0000","last_became_active":"2024-09-15T22:45:54.988906+0000","last_became_peered":"2024-09-15T22:45:54.988906+0000","last_unstale":"2024-09-15T22:45:55.973100+0000","last_undegraded":"2024-09-15T22:45:55.973100+0000","last_fullsized":"2024-09-15T22:45:55.973100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:20.566351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276931+0000","last_change":"2024-09-15T22:45:54.989622+0000","last_active":"2024-09-15T22:45:56.276931+0000","last_peered":"2024-09-15T22:45:56.276931+0000","last_clean":"2024-09-15T22:45:56.276931+0000","last_became_active":"2024-09-15T22:45:54.989304+0000","last_became_peered":"2024-09-15T22:45:54.989304+0000","last_unstale":"2024-09-15T22:45:56.276931+0000","last_undegraded":"2024-09-15T22:45:56.276931+0000","last_fullsized":"2024-09-15T22:45:56.276931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:47.959794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976601+0000","last_change":"2024-09-15T22:45:54.986399+0000","last_active":"2024-09-15T22:45:55.976601+0000","last_peered":"2024-09-15T22:45:55.976601+0000","last_clean":"2024-09-15T22:45:55.976601+0000","last_became_active":"2024-09-15T22:45:54.986133+0000","last_became_peered":"2024-09-15T22:45:54.986133+0000","last_unstale":"2024-09-15T22:45:55.976601+0000","last_undegraded":"2024-09-15T22:45:55.976601+0000","last_fullsized":"2024-09-15T22:45:55.976601+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:40.352354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973834+0000","last_change":"2024-09-15T22:45:54.984232+0000","last_active":"2024-09-15T22:45:55.973834+0000","last_peered":"2024-09-15T22:45:55.973834+0000","last_clean":"2024-09-15T22:45:55.973834+0000","last_became_active":"2024-09-15T22:45:54.983925+0000","last_became_peered":"2024-09-15T22:45:54.983925+0000","last_unstale":"2024-09-15T22:45:55.973834+0000","last_undegraded":"2024-09-15T22:45:55.973834+0000","last_fullsized":"2024-09-15T22:45:55.973834+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:52.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277546+0000","last_change":"2024-09-15T22:45:54.994104+0000","last_active":"2024-09-15T22:45:56.277546+0000","last_peered":"2024-09-15T22:45:56.277546+0000","last_clean":"2024-09-15T22:45:56.277546+0000","last_became_active":"2024-09-15T22:45:54.993816+0000","last_became_peered":"2024-09-15T22:45:54.993816+0000","last_unstale":"2024-09-15T22:45:56.277546+0000","last_undegraded":"2024-09-15T22:45:56.277546+0000","last_fullsized":"2024-09-15T22:45:56.277546+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:25.708089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018377+0000","last_change":"2024-09-15T22:45:54.994619+0000","last_active":"2024-09-15T22:45:56.018377+0000","last_peered":"2024-09-15T22:45:56.018377+0000","last_clean":"2024-09-15T22:45:56.018377+0000","last_became_active":"2024-09-15T22:45:54.994337+0000","last_became_peered":"2024-09-15T22:45:54.994337+0000","last_unstale":"2024-09-15T22:45:56.018377+0000","last_undegraded":"2024-09-15T22:45:56.018377+0000","last_fullsized":"2024-09-15T22:45:56.018377+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:52.838160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276961+0000","last_change":"2024-09-15T22:45:54.981497+0000","last_active":"2024-09-15T22:45:56.276961+0000","last_peered":"2024-09-15T22:45:56.276961+0000","last_clean":"2024-09-15T22:45:56.276961+0000","last_became_active":"2024-09-15T22:45:54.981205+0000","last_became_peered":"2024-09-15T22:45:54.981205+0000","last_unstale":"2024-09-15T22:45:56.276961+0000","last_undegraded":"2024-09-15T22:45:56.276961+0000","last_fullsized":"2024-09-15T22:45:56.276961+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:03.989690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277463+0000","last_change":"2024-09-15T22:45:54.983266+0000","last_active":"2024-09-15T22:45:56.277463+0000","last_peered":"2024-09-15T22:45:56.277463+0000","last_clean":"2024-09-15T22:45:56.277463+0000","last_became_active":"2024-09-15T22:45:54.982987+0000","last_became_peered":"2024-09-15T22:45:54.982987+0000","last_unstale":"2024-09-15T22:45:56.277463+0000","last_undegraded":"2024-09-15T22:45:56.277463+0000","last_fullsized":"2024-09-15T22:45:56.277463+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:13.078929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973267+0000","last_change":"2024-09-15T22:45:54.991298+0000","last_active":"2024-09-15T22:45:55.973267+0000","last_peered":"2024-09-15T22:45:55.973267+0000","last_clean":"2024-09-15T22:45:55.973267+0000","last_became_active":"2024-09-15T22:45:54.990761+0000","last_became_peered":"2024-09-15T22:45:54.990761+0000","last_unstale":"2024-09-15T22:45:55.973267+0000","last_undegraded":"2024-09-15T22:45:55.973267+0000","last_fullsized":"2024-09-15T22:45:55.973267+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:02.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277390+0000","last_change":"2024-09-15T22:45:54.994170+0000","last_active":"2024-09-15T22:45:56.277390+0000","last_peered":"2024-09-15T22:45:56.277390+0000","last_clean":"2024-09-15T22:45:56.277390+0000","last_became_active":"2024-09-15T22:45:54.993849+0000","last_became_peered":"2024-09-15T22:45:54.993849+0000","last_unstale":"2024-09-15T22:45:56.277390+0000","last_undegraded":"2024-09-15T22:45:56.277390+0000","last_fullsized":"2024-09-15T22:45:56.277390+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:57.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277675+0000","last_change":"2024-09-15T22:45:54.985344+0000","last_active":"2024-09-15T22:45:56.277675+0000","last_peered":"2024-09-15T22:45:56.277675+0000","last_clean":"2024-09-15T22:45:56.277675+0000","last_became_active":"2024-09-15T22:45:54.985090+0000","last_became_peered":"2024-09-15T22:45:54.985090+0000","last_unstale":"2024-09-15T22:45:56.277675+0000","last_undegraded":"2024-09-15T22:45:56.277675+0000","last_fullsized":"2024-09-15T22:45:56.277675+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:08.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277580+0000","last_change":"2024-09-15T22:45:54.993958+0000","last_active":"2024-09-15T22:45:56.277580+0000","last_peered":"2024-09-15T22:45:56.277580+0000","last_clean":"2024-09-15T22:45:56.277580+0000","last_became_active":"2024-09-15T22:45:54.993633+0000","last_became_peered":"2024-09-15T22:45:54.993633+0000","last_unstale":"2024-09-15T22:45:56.277580+0000","last_undegraded":"2024-09-15T22:45:56.277580+0000","last_fullsized":"2024-09-15T22:45:56.277580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:43.275614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276926+0000","last_change":"2024-09-15T22:45:54.994365+0000","last_active":"2024-09-15T22:45:56.276926+0000","last_peered":"2024-09-15T22:45:56.276926+0000","last_clean":"2024-09-15T22:45:56.276926+0000","last_became_active":"2024-09-15T22:45:54.994083+0000","last_became_peered":"2024-09-15T22:45:54.994083+0000","last_unstale":"2024-09-15T22:45:56.276926+0000","last_undegraded":"2024-09-15T22:45:56.276926+0000","last_fullsized":"2024-09-15T22:45:56.276926+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:48.411078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974083+0000","last_change":"2024-09-15T22:45:54.992497+0000","last_active":"2024-09-15T22:45:55.974083+0000","last_peered":"2024-09-15T22:45:55.974083+0000","last_clean":"2024-09-15T22:45:55.974083+0000","last_became_active":"2024-09-15T22:45:54.992242+0000","last_became_peered":"2024-09-15T22:45:54.992242+0000","last_unstale":"2024-09-15T22:45:55.974083+0000","last_undegraded":"2024-09-15T22:45:55.974083+0000","last_fullsized":"2024-09-15T22:45:55.974083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:48.411078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972463+0000","last_change":"2024-09-15T22:45:54.982518+0000","last_active":"2024-09-15T22:45:55.972463+0000","last_peered":"2024-09-15T22:45:55.972463+0000","last_clean":"2024-09-15T22:45:55.972463+0000","last_became_active":"2024-09-15T22:45:54.982249+0000","last_became_peered":"2024-09-15T22:45:54.982249+0000","last_unstale":"2024-09-15T22:45:55.972463+0000","last_undegraded":"2024-09-15T22:45:55.972463+0000","last_fullsized":"2024-09-15T22:45:55.972463+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:17.013850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277010+0000","last_change":"2024-09-15T22:45:54.989297+0000","last_active":"2024-09-15T22:45:56.277010+0000","last_peered":"2024-09-15T22:45:56.277010+0000","last_clean":"2024-09-15T22:45:56.277010+0000","last_became_active":"2024-09-15T22:45:54.988834+0000","last_became_peered":"2024-09-15T22:45:54.988834+0000","last_unstale":"2024-09-15T22:45:56.277010+0000","last_undegraded":"2024-09-15T22:45:56.277010+0000","last_fullsized":"2024-09-15T22:45:56.277010+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:41.590150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976863+0000","last_change":"2024-09-15T22:45:54.994842+0000","last_active":"2024-09-15T22:45:55.976863+0000","last_peered":"2024-09-15T22:45:55.976863+0000","last_clean":"2024-09-15T22:45:55.976863+0000","last_became_active":"2024-09-15T22:45:54.994580+0000","last_became_peered":"2024-09-15T22:45:54.994580+0000","last_unstale":"2024-09-15T22:45:55.976863+0000","last_undegraded":"2024-09-15T22:45:55.976863+0000","last_fullsized":"2024-09-15T22:45:55.976863+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:53.860342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277119+0000","last_change":"2024-09-15T22:45:54.980680+0000","last_active":"2024-09-15T22:45:56.277119+0000","last_peered":"2024-09-15T22:45:56.277119+0000","last_clean":"2024-09-15T22:45:56.277119+0000","last_became_active":"2024-09-15T22:45:54.980429+0000","last_became_peered":"2024-09-15T22:45:54.980429+0000","last_unstale":"2024-09-15T22:45:56.277119+0000","last_undegraded":"2024-09-15T22:45:56.277119+0000","last_fullsized":"2024-09-15T22:45:56.277119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:31.717887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976866+0000","last_change":"2024-09-15T22:45:54.991161+0000","last_active":"2024-09-15T22:45:55.976866+0000","last_peered":"2024-09-15T22:45:55.976866+0000","last_clean":"2024-09-15T22:45:55.976866+0000","last_became_active":"2024-09-15T22:45:54.990689+0000","last_became_peered":"2024-09-15T22:45:54.990689+0000","last_unstale":"2024-09-15T22:45:55.976866+0000","last_undegraded":"2024-09-15T22:45:55.976866+0000","last_fullsized":"2024-09-15T22:45:55.976866+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:36:13.421484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976516+0000","last_change":"2024-09-15T22:45:54.994121+0000","last_active":"2024-09-15T22:45:55.976516+0000","last_peered":"2024-09-15T22:45:55.976516+0000","last_clean":"2024-09-15T22:45:55.976516+0000","last_became_active":"2024-09-15T22:45:54.993813+0000","last_became_peered":"2024-09-15T22:45:54.993813+0000","last_unstale":"2024-09-15T22:45:55.976516+0000","last_undegraded":"2024-09-15T22:45:55.976516+0000","last_fullsized":"2024-09-15T22:45:55.976516+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:52.253273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277413+0000","last_change":"2024-09-15T22:45:54.984265+0000","last_active":"2024-09-15T22:45:56.277413+0000","last_peered":"2024-09-15T22:45:56.277413+0000","last_clean":"2024-09-15T22:45:56.277413+0000","last_became_active":"2024-09-15T22:45:54.983981+0000","last_became_peered":"2024-09-15T22:45:54.983981+0000","last_unstale":"2024-09-15T22:45:56.277413+0000","last_undegraded":"2024-09-15T22:45:56.277413+0000","last_fullsized":"2024-09-15T22:45:56.277413+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:00.386954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018435+0000","last_change":"2024-09-15T22:45:54.987911+0000","last_active":"2024-09-15T22:45:56.018435+0000","last_peered":"2024-09-15T22:45:56.018435+0000","last_clean":"2024-09-15T22:45:56.018435+0000","last_became_active":"2024-09-15T22:45:54.987614+0000","last_became_peered":"2024-09-15T22:45:54.987614+0000","last_unstale":"2024-09-15T22:45:56.018435+0000","last_undegraded":"2024-09-15T22:45:56.018435+0000","last_fullsized":"2024-09-15T22:45:56.018435+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:05.091079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974044+0000","last_change":"2024-09-15T22:45:54.987054+0000","last_active":"2024-09-15T22:45:55.974044+0000","last_peered":"2024-09-15T22:45:55.974044+0000","last_clean":"2024-09-15T22:45:55.974044+0000","last_became_active":"2024-09-15T22:45:54.986764+0000","last_became_peered":"2024-09-15T22:45:54.986764+0000","last_unstale":"2024-09-15T22:45:55.974044+0000","last_undegraded":"2024-09-15T22:45:55.974044+0000","last_fullsized":"2024-09-15T22:45:55.974044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:35.428696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972535+0000","last_change":"2024-09-15T22:45:54.989645+0000","last_active":"2024-09-15T22:45:55.972535+0000","last_peered":"2024-09-15T22:45:55.972535+0000","last_clean":"2024-09-15T22:45:55.972535+0000","last_became_active":"2024-09-15T22:45:54.989345+0000","last_became_peered":"2024-09-15T22:45:54.989345+0000","last_unstale":"2024-09-15T22:45:55.972535+0000","last_undegraded":"2024-09-15T22:45:55.972535+0000","last_fullsized":"2024-09-15T22:45:55.972535+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:59.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277082+0000","last_change":"2024-09-15T22:45:54.984616+0000","last_active":"2024-09-15T22:45:56.277082+0000","last_peered":"2024-09-15T22:45:56.277082+0000","last_clean":"2024-09-15T22:45:56.277082+0000","last_became_active":"2024-09-15T22:45:54.984348+0000","last_became_peered":"2024-09-15T22:45:54.984348+0000","last_unstale":"2024-09-15T22:45:56.277082+0000","last_undegraded":"2024-09-15T22:45:56.277082+0000","last_fullsized":"2024-09-15T22:45:56.277082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:13.315315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018713+0000","last_change":"2024-09-15T22:45:54.986999+0000","last_active":"2024-09-15T22:45:56.018713+0000","last_peered":"2024-09-15T22:45:56.018713+0000","last_clean":"2024-09-15T22:45:56.018713+0000","last_became_active":"2024-09-15T22:45:54.986719+0000","last_became_peered":"2024-09-15T22:45:54.986719+0000","last_unstale":"2024-09-15T22:45:56.018713+0000","last_undegraded":"2024-09-15T22:45:56.018713+0000","last_fullsized":"2024-09-15T22:45:56.018713+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:54.268549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972933+0000","last_change":"2024-09-15T22:45:54.985901+0000","last_active":"2024-09-15T22:45:55.972933+0000","last_peered":"2024-09-15T22:45:55.972933+0000","last_clean":"2024-09-15T22:45:55.972933+0000","last_became_active":"2024-09-15T22:45:54.985423+0000","last_became_peered":"2024-09-15T22:45:54.985423+0000","last_unstale":"2024-09-15T22:45:55.972933+0000","last_undegraded":"2024-09-15T22:45:55.972933+0000","last_fullsized":"2024-09-15T22:45:55.972933+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:42.316792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018442+0000","last_change":"2024-09-15T22:45:54.995281+0000","last_active":"2024-09-15T22:45:56.018442+0000","last_peered":"2024-09-15T22:45:56.018442+0000","last_clean":"2024-09-15T22:45:56.018442+0000","last_became_active":"2024-09-15T22:45:54.994990+0000","last_became_peered":"2024-09-15T22:45:54.994990+0000","last_unstale":"2024-09-15T22:45:56.018442+0000","last_undegraded":"2024-09-15T22:45:56.018442+0000","last_fullsized":"2024-09-15T22:45:56.018442+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:37.236751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974180+0000","last_change":"2024-09-15T22:45:54.986572+0000","last_active":"2024-09-15T22:45:55.974180+0000","last_peered":"2024-09-15T22:45:55.974180+0000","last_clean":"2024-09-15T22:45:55.974180+0000","last_became_active":"2024-09-15T22:45:54.986314+0000","last_became_peered":"2024-09-15T22:45:54.986314+0000","last_unstale":"2024-09-15T22:45:55.974180+0000","last_undegraded":"2024-09-15T22:45:55.974180+0000","last_fullsized":"2024-09-15T22:45:55.974180+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:36.644809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277658+0000","last_change":"2024-09-15T22:45:54.981066+0000","last_active":"2024-09-15T22:45:56.277658+0000","last_peered":"2024-09-15T22:45:56.277658+0000","last_clean":"2024-09-15T22:45:56.277658+0000","last_became_active":"2024-09-15T22:45:54.980775+0000","last_became_peered":"2024-09-15T22:45:54.980775+0000","last_unstale":"2024-09-15T22:45:56.277658+0000","last_undegraded":"2024-09-15T22:45:56.277658+0000","last_fullsized":"2024-09-15T22:45:56.277658+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.502878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972671+0000","last_change":"2024-09-15T22:45:54.981935+0000","last_active":"2024-09-15T22:45:55.972671+0000","last_peered":"2024-09-15T22:45:55.972671+0000","last_clean":"2024-09-15T22:45:55.972671+0000","last_became_active":"2024-09-15T22:45:54.981602+0000","last_became_peered":"2024-09-15T22:45:54.981602+0000","last_unstale":"2024-09-15T22:45:55.972671+0000","last_undegraded":"2024-09-15T22:45:55.972671+0000","last_fullsized":"2024-09-15T22:45:55.972671+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:33.537545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277048+0000","last_change":"2024-09-15T22:45:54.989148+0000","last_active":"2024-09-15T22:45:56.277048+0000","last_peered":"2024-09-15T22:45:56.277048+0000","last_clean":"2024-09-15T22:45:56.277048+0000","last_became_active":"2024-09-15T22:45:54.988469+0000","last_became_peered":"2024-09-15T22:45:54.988469+0000","last_unstale":"2024-09-15T22:45:56.277048+0000","last_undegraded":"2024-09-15T22:45:56.277048+0000","last_fullsized":"2024-09-15T22:45:56.277048+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:18.847057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973297+0000","last_change":"2024-09-15T22:45:54.983091+0000","last_active":"2024-09-15T22:45:55.973297+0000","last_peered":"2024-09-15T22:45:55.973297+0000","last_clean":"2024-09-15T22:45:55.973297+0000","last_became_active":"2024-09-15T22:45:54.982814+0000","last_became_peered":"2024-09-15T22:45:54.982814+0000","last_unstale":"2024-09-15T22:45:55.973297+0000","last_undegraded":"2024-09-15T22:45:55.973297+0000","last_fullsized":"2024-09-15T22:45:55.973297+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.938600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974442+0000","last_change":"2024-09-15T22:45:53.984520+0000","last_active":"2024-09-15T22:45:55.974442+0000","last_peered":"2024-09-15T22:45:55.974442+0000","last_clean":"2024-09-15T22:45:55.974442+0000","last_became_active":"2024-09-15T22:45:53.984251+0000","last_became_peered":"2024-09-15T22:45:53.984251+0000","last_unstale":"2024-09-15T22:45:55.974442+0000","last_undegraded":"2024-09-15T22:45:55.974442+0000","last_fullsized":"2024-09-15T22:45:55.974442+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:47.918322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974363+0000","last_change":"2024-09-15T22:45:54.992044+0000","last_active":"2024-09-15T22:45:55.974363+0000","last_peered":"2024-09-15T22:45:55.974363+0000","last_clean":"2024-09-15T22:45:55.974363+0000","last_became_active":"2024-09-15T22:45:54.988118+0000","last_became_peered":"2024-09-15T22:45:54.988118+0000","last_unstale":"2024-09-15T22:45:55.974363+0000","last_undegraded":"2024-09-15T22:45:55.974363+0000","last_fullsized":"2024-09-15T22:45:55.974363+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:55.585023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277232+0000","last_change":"2024-09-15T22:45:53.986564+0000","last_active":"2024-09-15T22:45:56.277232+0000","last_peered":"2024-09-15T22:45:56.277232+0000","last_clean":"2024-09-15T22:45:56.277232+0000","last_became_active":"2024-09-15T22:45:53.986276+0000","last_became_peered":"2024-09-15T22:45:53.986276+0000","last_unstale":"2024-09-15T22:45:56.277232+0000","last_undegraded":"2024-09-15T22:45:56.277232+0000","last_fullsized":"2024-09-15T22:45:56.277232+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:36:12.414124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018589+0000","last_change":"2024-09-15T22:45:54.991496+0000","last_active":"2024-09-15T22:45:56.018589+0000","last_peered":"2024-09-15T22:45:56.018589+0000","last_clean":"2024-09-15T22:45:56.018589+0000","last_became_active":"2024-09-15T22:45:54.991213+0000","last_became_peered":"2024-09-15T22:45:54.991213+0000","last_unstale":"2024-09-15T22:45:56.018589+0000","last_undegraded":"2024-09-15T22:45:56.018589+0000","last_fullsized":"2024-09-15T22:45:56.018589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:50.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973016+0000","last_change":"2024-09-15T22:45:53.986436+0000","last_active":"2024-09-15T22:45:55.973016+0000","last_peered":"2024-09-15T22:45:55.973016+0000","last_clean":"2024-09-15T22:45:55.973016+0000","last_became_active":"2024-09-15T22:45:53.986161+0000","last_became_peered":"2024-09-15T22:45:53.986161+0000","last_unstale":"2024-09-15T22:45:55.973016+0000","last_undegraded":"2024-09-15T22:45:55.973016+0000","last_fullsized":"2024-09-15T22:45:55.973016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:35.637449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976673+0000","last_change":"2024-09-15T22:45:54.990959+0000","last_active":"2024-09-15T22:45:55.976673+0000","last_peered":"2024-09-15T22:45:55.976673+0000","last_clean":"2024-09-15T22:45:55.976673+0000","last_became_active":"2024-09-15T22:45:54.990351+0000","last_became_peered":"2024-09-15T22:45:54.990351+0000","last_unstale":"2024-09-15T22:45:55.976673+0000","last_undegraded":"2024-09-15T22:45:55.976673+0000","last_fullsized":"2024-09-15T22:45:55.976673+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:06.139164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974027+0000","last_change":"2024-09-15T22:45:53.986150+0000","last_active":"2024-09-15T22:45:55.974027+0000","last_peered":"2024-09-15T22:45:55.974027+0000","last_clean":"2024-09-15T22:45:55.974027+0000","last_became_active":"2024-09-15T22:45:53.985881+0000","last_became_peered":"2024-09-15T22:45:53.985881+0000","last_unstale":"2024-09-15T22:45:55.974027+0000","last_undegraded":"2024-09-15T22:45:55.974027+0000","last_fullsized":"2024-09-15T22:45:55.974027+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:34.421336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973935+0000","last_change":"2024-09-15T22:45:54.993095+0000","last_active":"2024-09-15T22:45:55.973935+0000","last_peered":"2024-09-15T22:45:55.973935+0000","last_clean":"2024-09-15T22:45:55.973935+0000","last_became_active":"2024-09-15T22:45:54.992829+0000","last_became_peered":"2024-09-15T22:45:54.992829+0000","last_unstale":"2024-09-15T22:45:55.973935+0000","last_undegraded":"2024-09-15T22:45:55.973935+0000","last_fullsized":"2024-09-15T22:45:55.973935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:58.771312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976436+0000","last_change":"2024-09-15T22:45:53.982969+0000","last_active":"2024-09-15T22:45:55.976436+0000","last_peered":"2024-09-15T22:45:55.976436+0000","last_clean":"2024-09-15T22:45:55.976436+0000","last_became_active":"2024-09-15T22:45:53.982685+0000","last_became_peered":"2024-09-15T22:45:53.982685+0000","last_unstale":"2024-09-15T22:45:55.976436+0000","last_undegraded":"2024-09-15T22:45:55.976436+0000","last_fullsized":"2024-09-15T22:45:55.976436+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:02.011176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277336+0000","last_change":"2024-09-15T22:45:54.983658+0000","last_active":"2024-09-15T22:45:56.277336+0000","last_peered":"2024-09-15T22:45:56.277336+0000","last_clean":"2024-09-15T22:45:56.277336+0000","last_became_active":"2024-09-15T22:45:54.983388+0000","last_became_peered":"2024-09-15T22:45:54.983388+0000","last_unstale":"2024-09-15T22:45:56.277336+0000","last_undegraded":"2024-09-15T22:45:56.277336+0000","last_fullsized":"2024-09-15T22:45:56.277336+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:48.050876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973419+0000","last_change":"2024-09-15T22:45:53.984855+0000","last_active":"2024-09-15T22:45:55.973419+0000","last_peered":"2024-09-15T22:45:55.973419+0000","last_clean":"2024-09-15T22:45:55.973419+0000","last_became_active":"2024-09-15T22:45:53.984595+0000","last_became_peered":"2024-09-15T22:45:53.984595+0000","last_unstale":"2024-09-15T22:45:55.973419+0000","last_undegraded":"2024-09-15T22:45:55.973419+0000","last_fullsized":"2024-09-15T22:45:55.973419+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:23.010105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277235+0000","last_change":"2024-09-15T22:45:54.995380+0000","last_active":"2024-09-15T22:45:56.277235+0000","last_peered":"2024-09-15T22:45:56.277235+0000","last_clean":"2024-09-15T22:45:56.277235+0000","last_became_active":"2024-09-15T22:45:54.995146+0000","last_became_peered":"2024-09-15T22:45:54.995146+0000","last_unstale":"2024-09-15T22:45:56.277235+0000","last_undegraded":"2024-09-15T22:45:56.277235+0000","last_fullsized":"2024-09-15T22:45:56.277235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:53.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277199+0000","last_change":"2024-09-15T22:45:53.979842+0000","last_active":"2024-09-15T22:45:56.277199+0000","last_peered":"2024-09-15T22:45:56.277199+0000","last_clean":"2024-09-15T22:45:56.277199+0000","last_became_active":"2024-09-15T22:45:53.979570+0000","last_became_peered":"2024-09-15T22:45:53.979570+0000","last_unstale":"2024-09-15T22:45:56.277199+0000","last_undegraded":"2024-09-15T22:45:56.277199+0000","last_fullsized":"2024-09-15T22:45:56.277199+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:36.229392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277108+0000","last_change":"2024-09-15T22:45:54.983957+0000","last_active":"2024-09-15T22:45:56.277108+0000","last_peered":"2024-09-15T22:45:56.277108+0000","last_clean":"2024-09-15T22:45:56.277108+0000","last_became_active":"2024-09-15T22:45:54.983660+0000","last_became_peered":"2024-09-15T22:45:54.983660+0000","last_unstale":"2024-09-15T22:45:56.277108+0000","last_undegraded":"2024-09-15T22:45:56.277108+0000","last_fullsized":"2024-09-15T22:45:56.277108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.252551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277286+0000","last_change":"2024-09-15T22:45:53.983180+0000","last_active":"2024-09-15T22:45:56.277286+0000","last_peered":"2024-09-15T22:45:56.277286+0000","last_clean":"2024-09-15T22:45:56.277286+0000","last_became_active":"2024-09-15T22:45:53.982846+0000","last_became_peered":"2024-09-15T22:45:53.982846+0000","last_unstale":"2024-09-15T22:45:56.277286+0000","last_undegraded":"2024-09-15T22:45:56.277286+0000","last_fullsized":"2024-09-15T22:45:56.277286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:22.869920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277076+0000","last_change":"2024-09-15T22:45:54.982226+0000","last_active":"2024-09-15T22:45:56.277076+0000","last_peered":"2024-09-15T22:45:56.277076+0000","last_clean":"2024-09-15T22:45:56.277076+0000","last_became_active":"2024-09-15T22:45:54.981934+0000","last_became_peered":"2024-09-15T22:45:54.981934+0000","last_unstale":"2024-09-15T22:45:56.277076+0000","last_undegraded":"2024-09-15T22:45:56.277076+0000","last_fullsized":"2024-09-15T22:45:56.277076+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:36.644809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972916+0000","last_change":"2024-09-15T22:45:53.982342+0000","last_active":"2024-09-15T22:45:55.972916+0000","last_peered":"2024-09-15T22:45:55.972916+0000","last_clean":"2024-09-15T22:45:55.972916+0000","last_became_active":"2024-09-15T22:45:53.981639+0000","last_became_peered":"2024-09-15T22:45:53.981639+0000","last_unstale":"2024-09-15T22:45:55.972916+0000","last_undegraded":"2024-09-15T22:45:55.972916+0000","last_fullsized":"2024-09-15T22:45:55.972916+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:07.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277121+0000","last_change":"2024-09-15T22:45:54.993936+0000","last_active":"2024-09-15T22:45:56.277121+0000","last_peered":"2024-09-15T22:45:56.277121+0000","last_clean":"2024-09-15T22:45:56.277121+0000","last_became_active":"2024-09-15T22:45:54.993561+0000","last_became_peered":"2024-09-15T22:45:54.993561+0000","last_unstale":"2024-09-15T22:45:56.277121+0000","last_undegraded":"2024-09-15T22:45:56.277121+0000","last_fullsized":"2024-09-15T22:45:56.277121+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:38.357470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277445+0000","last_change":"2024-09-15T22:45:53.985024+0000","last_active":"2024-09-15T22:45:56.277445+0000","last_peered":"2024-09-15T22:45:56.277445+0000","last_clean":"2024-09-15T22:45:56.277445+0000","last_became_active":"2024-09-15T22:45:53.984286+0000","last_became_peered":"2024-09-15T22:45:53.984286+0000","last_unstale":"2024-09-15T22:45:56.277445+0000","last_undegraded":"2024-09-15T22:45:56.277445+0000","last_fullsized":"2024-09-15T22:45:56.277445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.760070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018610+0000","last_change":"2024-09-15T22:45:54.986400+0000","last_active":"2024-09-15T22:45:56.018610+0000","last_peered":"2024-09-15T22:45:56.018610+0000","last_clean":"2024-09-15T22:45:56.018610+0000","last_became_active":"2024-09-15T22:45:54.986087+0000","last_became_peered":"2024-09-15T22:45:54.986087+0000","last_unstale":"2024-09-15T22:45:56.018610+0000","last_undegraded":"2024-09-15T22:45:56.018610+0000","last_fullsized":"2024-09-15T22:45:56.018610+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:38.860197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"106'3","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277467+0000","last_change":"2024-09-15T22:45:53.987937+0000","last_active":"2024-09-15T22:45:56.277467+0000","last_peered":"2024-09-15T22:45:56.277467+0000","last_clean":"2024-09-15T22:45:56.277467+0000","last_became_active":"2024-09-15T22:45:53.987613+0000","last_became_peered":"2024-09-15T22:45:53.987613+0000","last_unstale":"2024-09-15T22:45:56.277467+0000","last_undegraded":"2024-09-15T22:45:56.277467+0000","last_fullsized":"2024-09-15T22:45:56.277467+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:28.506476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277674+0000","last_change":"2024-09-15T22:45:54.986177+0000","last_active":"2024-09-15T22:45:56.277674+0000","last_peered":"2024-09-15T22:45:56.277674+0000","last_clean":"2024-09-15T22:45:56.277674+0000","last_became_active":"2024-09-15T22:45:54.985257+0000","last_became_peered":"2024-09-15T22:45:54.985257+0000","last_unstale":"2024-09-15T22:45:56.277674+0000","last_undegraded":"2024-09-15T22:45:56.277674+0000","last_fullsized":"2024-09-15T22:45:56.277674+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:32.804052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"106'6","reported_seq":20,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974014+0000","last_change":"2024-09-15T22:45:53.981679+0000","last_active":"2024-09-15T22:45:55.974014+0000","last_peered":"2024-09-15T22:45:55.974014+0000","last_clean":"2024-09-15T22:45:55.974014+0000","last_became_active":"2024-09-15T22:45:53.980851+0000","last_became_peered":"2024-09-15T22:45:53.980851+0000","last_unstale":"2024-09-15T22:45:55.974014+0000","last_undegraded":"2024-09-15T22:45:55.974014+0000","last_fullsized":"2024-09-15T22:45:55.974014+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:47.403718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277128+0000","last_change":"2024-09-15T22:45:54.989008+0000","last_active":"2024-09-15T22:45:56.277128+0000","last_peered":"2024-09-15T22:45:56.277128+0000","last_clean":"2024-09-15T22:45:56.277128+0000","last_became_active":"2024-09-15T22:45:54.988711+0000","last_became_peered":"2024-09-15T22:45:54.988711+0000","last_unstale":"2024-09-15T22:45:56.277128+0000","last_undegraded":"2024-09-15T22:45:56.277128+0000","last_fullsized":"2024-09-15T22:45:56.277128+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:03.018536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277401+0000","last_change":"2024-09-15T22:45:53.985053+0000","last_active":"2024-09-15T22:45:56.277401+0000","last_peered":"2024-09-15T22:45:56.277401+0000","last_clean":"2024-09-15T22:45:56.277401+0000","last_became_active":"2024-09-15T22:45:53.984794+0000","last_became_peered":"2024-09-15T22:45:53.984794+0000","last_unstale":"2024-09-15T22:45:56.277401+0000","last_undegraded":"2024-09-15T22:45:56.277401+0000","last_fullsized":"2024-09-15T22:45:56.277401+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:54.561287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973988+0000","last_change":"2024-09-15T22:45:54.983839+0000","last_active":"2024-09-15T22:45:55.973988+0000","last_peered":"2024-09-15T22:45:55.973988+0000","last_clean":"2024-09-15T22:45:55.973988+0000","last_became_active":"2024-09-15T22:45:54.982639+0000","last_became_peered":"2024-09-15T22:45:54.982639+0000","last_unstale":"2024-09-15T22:45:55.973988+0000","last_undegraded":"2024-09-15T22:45:55.973988+0000","last_fullsized":"2024-09-15T22:45:55.973988+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:15.496241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976516+0000","last_change":"2024-09-15T22:45:53.988135+0000","last_active":"2024-09-15T22:45:55.976516+0000","last_peered":"2024-09-15T22:45:55.976516+0000","last_clean":"2024-09-15T22:45:55.976516+0000","last_became_active":"2024-09-15T22:45:53.987855+0000","last_became_peered":"2024-09-15T22:45:53.987855+0000","last_unstale":"2024-09-15T22:45:55.976516+0000","last_undegraded":"2024-09-15T22:45:55.976516+0000","last_fullsized":"2024-09-15T22:45:55.976516+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:52.888492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972886+0000","last_change":"2024-09-15T22:45:54.992877+0000","last_active":"2024-09-15T22:45:55.972886+0000","last_peered":"2024-09-15T22:45:55.972886+0000","last_clean":"2024-09-15T22:45:55.972886+0000","last_became_active":"2024-09-15T22:45:54.992577+0000","last_became_peered":"2024-09-15T22:45:54.992577+0000","last_unstale":"2024-09-15T22:45:55.972886+0000","last_undegraded":"2024-09-15T22:45:55.972886+0000","last_fullsized":"2024-09-15T22:45:55.972886+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:53.287690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972315+0000","last_change":"2024-09-15T22:45:53.977876+0000","last_active":"2024-09-15T22:45:55.972315+0000","last_peered":"2024-09-15T22:45:55.972315+0000","last_clean":"2024-09-15T22:45:55.972315+0000","last_became_active":"2024-09-15T22:45:53.977588+0000","last_became_peered":"2024-09-15T22:45:53.977588+0000","last_unstale":"2024-09-15T22:45:55.972315+0000","last_undegraded":"2024-09-15T22:45:55.972315+0000","last_fullsized":"2024-09-15T22:45:55.972315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:07.606646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973478+0000","last_change":"2024-09-15T22:45:54.981020+0000","last_active":"2024-09-15T22:45:55.973478+0000","last_peered":"2024-09-15T22:45:55.973478+0000","last_clean":"2024-09-15T22:45:55.973478+0000","last_became_active":"2024-09-15T22:45:54.980707+0000","last_became_peered":"2024-09-15T22:45:54.980707+0000","last_unstale":"2024-09-15T22:45:55.973478+0000","last_undegraded":"2024-09-15T22:45:55.973478+0000","last_fullsized":"2024-09-15T22:45:55.973478+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:16.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018552+0000","last_change":"2024-09-15T22:45:53.987003+0000","last_active":"2024-09-15T22:45:56.018552+0000","last_peered":"2024-09-15T22:45:56.018552+0000","last_clean":"2024-09-15T22:45:56.018552+0000","last_became_active":"2024-09-15T22:45:53.986709+0000","last_became_peered":"2024-09-15T22:45:53.986709+0000","last_unstale":"2024-09-15T22:45:56.018552+0000","last_undegraded":"2024-09-15T22:45:56.018552+0000","last_fullsized":"2024-09-15T22:45:56.018552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:37.015404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973698+0000","last_change":"2024-09-15T22:45:54.991036+0000","last_active":"2024-09-15T22:45:55.973698+0000","last_peered":"2024-09-15T22:45:55.973698+0000","last_clean":"2024-09-15T22:45:55.973698+0000","last_became_active":"2024-09-15T22:45:54.990344+0000","last_became_peered":"2024-09-15T22:45:54.990344+0000","last_unstale":"2024-09-15T22:45:55.973698+0000","last_undegraded":"2024-09-15T22:45:55.973698+0000","last_fullsized":"2024-09-15T22:45:55.973698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:18.957270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277555+0000","last_change":"2024-09-15T22:45:53.984874+0000","last_active":"2024-09-15T22:45:56.277555+0000","last_peered":"2024-09-15T22:45:56.277555+0000","last_clean":"2024-09-15T22:45:56.277555+0000","last_became_active":"2024-09-15T22:45:53.984628+0000","last_became_peered":"2024-09-15T22:45:53.984628+0000","last_unstale":"2024-09-15T22:45:56.277555+0000","last_undegraded":"2024-09-15T22:45:56.277555+0000","last_fullsized":"2024-09-15T22:45:56.277555+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:48.460728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277668+0000","last_change":"2024-09-15T22:45:54.980040+0000","last_active":"2024-09-15T22:45:56.277668+0000","last_peered":"2024-09-15T22:45:56.277668+0000","last_clean":"2024-09-15T22:45:56.277668+0000","last_became_active":"2024-09-15T22:45:54.979765+0000","last_became_peered":"2024-09-15T22:45:54.979765+0000","last_unstale":"2024-09-15T22:45:56.277668+0000","last_undegraded":"2024-09-15T22:45:56.277668+0000","last_fullsized":"2024-09-15T22:45:56.277668+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:59.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974331+0000","last_change":"2024-09-15T22:45:53.982769+0000","last_active":"2024-09-15T22:45:55.974331+0000","last_peered":"2024-09-15T22:45:55.974331+0000","last_clean":"2024-09-15T22:45:55.974331+0000","last_became_active":"2024-09-15T22:45:53.982511+0000","last_became_peered":"2024-09-15T22:45:53.982511+0000","last_unstale":"2024-09-15T22:45:55.974331+0000","last_undegraded":"2024-09-15T22:45:55.974331+0000","last_fullsized":"2024-09-15T22:45:55.974331+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:18.744631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974200+0000","last_change":"2024-09-15T22:45:54.984560+0000","last_active":"2024-09-15T22:45:55.974200+0000","last_peered":"2024-09-15T22:45:55.974200+0000","last_clean":"2024-09-15T22:45:55.974200+0000","last_became_active":"2024-09-15T22:45:54.984296+0000","last_became_peered":"2024-09-15T22:45:54.984296+0000","last_unstale":"2024-09-15T22:45:55.974200+0000","last_undegraded":"2024-09-15T22:45:55.974200+0000","last_fullsized":"2024-09-15T22:45:55.974200+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:38.357470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974119+0000","last_change":"2024-09-15T22:45:53.976030+0000","last_active":"2024-09-15T22:45:55.974119+0000","last_peered":"2024-09-15T22:45:55.974119+0000","last_clean":"2024-09-15T22:45:55.974119+0000","last_became_active":"2024-09-15T22:45:53.975720+0000","last_became_peered":"2024-09-15T22:45:53.975720+0000","last_unstale":"2024-09-15T22:45:55.974119+0000","last_undegraded":"2024-09-15T22:45:55.974119+0000","last_fullsized":"2024-09-15T22:45:55.974119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:42.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976456+0000","last_change":"2024-09-15T22:45:54.988475+0000","last_active":"2024-09-15T22:45:55.976456+0000","last_peered":"2024-09-15T22:45:55.976456+0000","last_clean":"2024-09-15T22:45:55.976456+0000","last_became_active":"2024-09-15T22:45:54.988220+0000","last_became_peered":"2024-09-15T22:45:54.988220+0000","last_unstale":"2024-09-15T22:45:55.976456+0000","last_undegraded":"2024-09-15T22:45:55.976456+0000","last_fullsized":"2024-09-15T22:45:55.976456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:36.223443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277517+0000","last_change":"2024-09-15T22:45:53.984492+0000","last_active":"2024-09-15T22:45:56.277517+0000","last_peered":"2024-09-15T22:45:56.277517+0000","last_clean":"2024-09-15T22:45:56.277517+0000","last_became_active":"2024-09-15T22:45:53.984202+0000","last_became_peered":"2024-09-15T22:45:53.984202+0000","last_unstale":"2024-09-15T22:45:56.277517+0000","last_undegraded":"2024-09-15T22:45:56.277517+0000","last_fullsized":"2024-09-15T22:45:56.277517+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:26.023347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973348+0000","last_change":"2024-09-15T22:45:54.983308+0000","last_active":"2024-09-15T22:45:55.973348+0000","last_peered":"2024-09-15T22:45:55.973348+0000","last_clean":"2024-09-15T22:45:55.973348+0000","last_became_active":"2024-09-15T22:45:54.983013+0000","last_became_peered":"2024-09-15T22:45:54.983013+0000","last_unstale":"2024-09-15T22:45:55.973348+0000","last_undegraded":"2024-09-15T22:45:55.973348+0000","last_fullsized":"2024-09-15T22:45:55.973348+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:22.637016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973528+0000","last_change":"2024-09-15T22:45:53.988270+0000","last_active":"2024-09-15T22:45:55.973528+0000","last_peered":"2024-09-15T22:45:55.973528+0000","last_clean":"2024-09-15T22:45:55.973528+0000","last_became_active":"2024-09-15T22:45:53.987961+0000","last_became_peered":"2024-09-15T22:45:53.987961+0000","last_unstale":"2024-09-15T22:45:55.973528+0000","last_undegraded":"2024-09-15T22:45:55.973528+0000","last_fullsized":"2024-09-15T22:45:55.973528+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:06.711314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974007+0000","last_change":"2024-09-15T22:45:54.992940+0000","last_active":"2024-09-15T22:45:55.974007+0000","last_peered":"2024-09-15T22:45:55.974007+0000","last_clean":"2024-09-15T22:45:55.974007+0000","last_became_active":"2024-09-15T22:45:54.992667+0000","last_became_peered":"2024-09-15T22:45:54.992667+0000","last_unstale":"2024-09-15T22:45:55.974007+0000","last_undegraded":"2024-09-15T22:45:55.974007+0000","last_fullsized":"2024-09-15T22:45:55.974007+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:08.928014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973377+0000","last_change":"2024-09-15T22:45:53.987587+0000","last_active":"2024-09-15T22:45:55.973377+0000","last_peered":"2024-09-15T22:45:55.973377+0000","last_clean":"2024-09-15T22:45:55.973377+0000","last_became_active":"2024-09-15T22:45:53.987282+0000","last_became_peered":"2024-09-15T22:45:53.987282+0000","last_unstale":"2024-09-15T22:45:55.973377+0000","last_undegraded":"2024-09-15T22:45:55.973377+0000","last_fullsized":"2024-09-15T22:45:55.973377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:38.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277080+0000","last_change":"2024-09-15T22:45:54.996309+0000","last_active":"2024-09-15T22:45:56.277080+0000","last_peered":"2024-09-15T22:45:56.277080+0000","last_clean":"2024-09-15T22:45:56.277080+0000","last_became_active":"2024-09-15T22:45:54.996094+0000","last_became_peered":"2024-09-15T22:45:54.996094+0000","last_unstale":"2024-09-15T22:45:56.277080+0000","last_undegraded":"2024-09-15T22:45:56.277080+0000","last_fullsized":"2024-09-15T22:45:56.277080+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:11.063397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972653+0000","last_change":"2024-09-15T22:45:53.982924+0000","last_active":"2024-09-15T22:45:55.972653+0000","last_peered":"2024-09-15T22:45:55.972653+0000","last_clean":"2024-09-15T22:45:55.972653+0000","last_became_active":"2024-09-15T22:45:53.982647+0000","last_became_peered":"2024-09-15T22:45:53.982647+0000","last_unstale":"2024-09-15T22:45:55.972653+0000","last_undegraded":"2024-09-15T22:45:55.972653+0000","last_fullsized":"2024-09-15T22:45:55.972653+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:37.658855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974273+0000","last_change":"2024-09-15T22:45:54.993018+0000","last_active":"2024-09-15T22:45:55.974273+0000","last_peered":"2024-09-15T22:45:55.974273+0000","last_clean":"2024-09-15T22:45:55.974273+0000","last_became_active":"2024-09-15T22:45:54.992749+0000","last_became_peered":"2024-09-15T22:45:54.992749+0000","last_unstale":"2024-09-15T22:45:55.974273+0000","last_undegraded":"2024-09-15T22:45:55.974273+0000","last_fullsized":"2024-09-15T22:45:55.974273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:30.862456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973015+0000","last_change":"2024-09-15T22:45:53.982385+0000","last_active":"2024-09-15T22:45:55.973015+0000","last_peered":"2024-09-15T22:45:55.973015+0000","last_clean":"2024-09-15T22:45:55.973015+0000","last_became_active":"2024-09-15T22:45:53.982084+0000","last_became_peered":"2024-09-15T22:45:53.982084+0000","last_unstale":"2024-09-15T22:45:55.973015+0000","last_undegraded":"2024-09-15T22:45:55.973015+0000","last_fullsized":"2024-09-15T22:45:55.973015+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:29.855096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018578+0000","last_change":"2024-09-15T22:45:54.986396+0000","last_active":"2024-09-15T22:45:56.018578+0000","last_peered":"2024-09-15T22:45:56.018578+0000","last_clean":"2024-09-15T22:45:56.018578+0000","last_became_active":"2024-09-15T22:45:54.986111+0000","last_became_peered":"2024-09-15T22:45:54.986111+0000","last_unstale":"2024-09-15T22:45:56.018578+0000","last_undegraded":"2024-09-15T22:45:56.018578+0000","last_fullsized":"2024-09-15T22:45:56.018578+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:29.739058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"107'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.975413+0000","last_change":"2024-09-15T22:45:53.983141+0000","last_active":"2024-09-15T22:45:56.975413+0000","last_peered":"2024-09-15T22:45:56.975413+0000","last_clean":"2024-09-15T22:45:56.975413+0000","last_became_active":"2024-09-15T22:45:53.982857+0000","last_became_peered":"2024-09-15T22:45:53.982857+0000","last_unstale":"2024-09-15T22:45:56.975413+0000","last_undegraded":"2024-09-15T22:45:56.975413+0000","last_fullsized":"2024-09-15T22:45:56.975413+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:04.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973185+0000","last_change":"2024-09-15T22:45:54.983240+0000","last_active":"2024-09-15T22:45:55.973185+0000","last_peered":"2024-09-15T22:45:55.973185+0000","last_clean":"2024-09-15T22:45:55.973185+0000","last_became_active":"2024-09-15T22:45:54.982944+0000","last_became_peered":"2024-09-15T22:45:54.982944+0000","last_unstale":"2024-09-15T22:45:55.973185+0000","last_undegraded":"2024-09-15T22:45:55.973185+0000","last_fullsized":"2024-09-15T22:45:55.973185+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:01.265954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973109+0000","last_change":"2024-09-15T22:45:53.985978+0000","last_active":"2024-09-15T22:45:55.973109+0000","last_peered":"2024-09-15T22:45:55.973109+0000","last_clean":"2024-09-15T22:45:55.973109+0000","last_became_active":"2024-09-15T22:45:53.985572+0000","last_became_peered":"2024-09-15T22:45:53.985572+0000","last_unstale":"2024-09-15T22:45:55.973109+0000","last_undegraded":"2024-09-15T22:45:55.973109+0000","last_fullsized":"2024-09-15T22:45:55.973109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:37.350111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974346+0000","last_change":"2024-09-15T22:45:54.993051+0000","last_active":"2024-09-15T22:45:55.974346+0000","last_peered":"2024-09-15T22:45:55.974346+0000","last_clean":"2024-09-15T22:45:55.974346+0000","last_became_active":"2024-09-15T22:45:54.992008+0000","last_became_peered":"2024-09-15T22:45:54.992008+0000","last_unstale":"2024-09-15T22:45:55.974346+0000","last_undegraded":"2024-09-15T22:45:55.974346+0000","last_fullsized":"2024-09-15T22:45:55.974346+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:39.153860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974129+0000","last_change":"2024-09-15T22:45:53.983148+0000","last_active":"2024-09-15T22:45:55.974129+0000","last_peered":"2024-09-15T22:45:55.974129+0000","last_clean":"2024-09-15T22:45:55.974129+0000","last_became_active":"2024-09-15T22:45:53.982814+0000","last_became_peered":"2024-09-15T22:45:53.982814+0000","last_unstale":"2024-09-15T22:45:55.974129+0000","last_undegraded":"2024-09-15T22:45:55.974129+0000","last_fullsized":"2024-09-15T22:45:55.974129+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:46.952434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976420+0000","last_change":"2024-09-15T22:45:54.989400+0000","last_active":"2024-09-15T22:45:55.976420+0000","last_peered":"2024-09-15T22:45:55.976420+0000","last_clean":"2024-09-15T22:45:55.976420+0000","last_became_active":"2024-09-15T22:45:54.989135+0000","last_became_peered":"2024-09-15T22:45:54.989135+0000","last_unstale":"2024-09-15T22:45:55.976420+0000","last_undegraded":"2024-09-15T22:45:55.976420+0000","last_fullsized":"2024-09-15T22:45:55.976420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:43.732486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.277464+0000","last_change":"2024-09-15T22:45:53.985078+0000","last_active":"2024-09-15T22:45:56.277464+0000","last_peered":"2024-09-15T22:45:56.277464+0000","last_clean":"2024-09-15T22:45:56.277464+0000","last_became_active":"2024-09-15T22:45:53.984560+0000","last_became_peered":"2024-09-15T22:45:53.984560+0000","last_unstale":"2024-09-15T22:45:56.277464+0000","last_undegraded":"2024-09-15T22:45:56.277464+0000","last_fullsized":"2024-09-15T22:45:56.277464+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:28.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974399+0000","last_change":"2024-09-15T22:45:54.994188+0000","last_active":"2024-09-15T22:45:55.974399+0000","last_peered":"2024-09-15T22:45:55.974399+0000","last_clean":"2024-09-15T22:45:55.974399+0000","last_became_active":"2024-09-15T22:45:54.993927+0000","last_became_peered":"2024-09-15T22:45:54.993927+0000","last_unstale":"2024-09-15T22:45:55.974399+0000","last_undegraded":"2024-09-15T22:45:55.974399+0000","last_fullsized":"2024-09-15T22:45:55.974399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:18.491048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974149+0000","last_change":"2024-09-15T22:45:53.982728+0000","last_active":"2024-09-15T22:45:55.974149+0000","last_peered":"2024-09-15T22:45:55.974149+0000","last_clean":"2024-09-15T22:45:55.974149+0000","last_became_active":"2024-09-15T22:45:53.982291+0000","last_became_peered":"2024-09-15T22:45:53.982291+0000","last_unstale":"2024-09-15T22:45:55.974149+0000","last_undegraded":"2024-09-15T22:45:55.974149+0000","last_fullsized":"2024-09-15T22:45:55.974149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:46.151065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.974091+0000","last_change":"2024-09-15T22:45:54.986293+0000","last_active":"2024-09-15T22:45:55.974091+0000","last_peered":"2024-09-15T22:45:55.974091+0000","last_clean":"2024-09-15T22:45:55.974091+0000","last_became_active":"2024-09-15T22:45:54.986029+0000","last_became_peered":"2024-09-15T22:45:54.986029+0000","last_unstale":"2024-09-15T22:45:55.974091+0000","last_undegraded":"2024-09-15T22:45:55.974091+0000","last_fullsized":"2024-09-15T22:45:55.974091+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:47.959794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.972821+0000","last_change":"2024-09-15T22:45:53.979582+0000","last_active":"2024-09-15T22:45:55.972821+0000","last_peered":"2024-09-15T22:45:55.972821+0000","last_clean":"2024-09-15T22:45:55.972821+0000","last_became_active":"2024-09-15T22:45:53.978698+0000","last_became_peered":"2024-09-15T22:45:53.978698+0000","last_unstale":"2024-09-15T22:45:55.972821+0000","last_undegraded":"2024-09-15T22:45:55.972821+0000","last_fullsized":"2024-09-15T22:45:55.972821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:49.521031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018363+0000","last_change":"2024-09-15T22:45:54.986194+0000","last_active":"2024-09-15T22:45:56.018363+0000","last_peered":"2024-09-15T22:45:56.018363+0000","last_clean":"2024-09-15T22:45:56.018363+0000","last_became_active":"2024-09-15T22:45:54.985912+0000","last_became_peered":"2024-09-15T22:45:54.985912+0000","last_unstale":"2024-09-15T22:45:56.018363+0000","last_undegraded":"2024-09-15T22:45:56.018363+0000","last_fullsized":"2024-09-15T22:45:56.018363+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:52.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.018233+0000","last_change":"2024-09-15T22:45:53.984104+0000","last_active":"2024-09-15T22:45:56.018233+0000","last_peered":"2024-09-15T22:45:56.018233+0000","last_clean":"2024-09-15T22:45:56.018233+0000","last_became_active":"2024-09-15T22:45:53.983835+0000","last_became_peered":"2024-09-15T22:45:53.983835+0000","last_unstale":"2024-09-15T22:45:56.018233+0000","last_undegraded":"2024-09-15T22:45:56.018233+0000","last_fullsized":"2024-09-15T22:45:56.018233+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.973884+0000","last_change":"2024-09-15T22:45:54.983811+0000","last_active":"2024-09-15T22:45:55.973884+0000","last_peered":"2024-09-15T22:45:55.973884+0000","last_clean":"2024-09-15T22:45:55.973884+0000","last_became_active":"2024-09-15T22:45:54.983161+0000","last_became_peered":"2024-09-15T22:45:54.983161+0000","last_unstale":"2024-09-15T22:45:55.973884+0000","last_undegraded":"2024-09-15T22:45:55.973884+0000","last_fullsized":"2024-09-15T22:45:55.973884+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:53.961557+0000","last_clean_scrub_stamp":"2024-09-15T22:45:53.961557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.251834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:56.276741+0000","last_change":"2024-09-15T22:45:53.988158+0000","last_active":"2024-09-15T22:45:56.276741+0000","last_peered":"2024-09-15T22:45:56.276741+0000","last_clean":"2024-09-15T22:45:56.276741+0000","last_became_active":"2024-09-15T22:45:53.987824+0000","last_became_peered":"2024-09-15T22:45:53.987824+0000","last_unstale":"2024-09-15T22:45:56.276741+0000","last_undegraded":"2024-09-15T22:45:56.276741+0000","last_fullsized":"2024-09-15T22:45:56.276741+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:45:52.954198+0000","last_clean_scrub_stamp":"2024-09-15T22:45:52.954198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:52.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":366,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-15T22:45:55.976326+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:45:55.976326+0000","last_peered":"2024-09-15T22:45:55.976326+0000","last_clean":"2024-09-15T22:45:55.976326+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:45:55.976326+0000","last_undegraded":"2024-09-15T22:45:55.976326+0000","last_fullsized":"2024-09-15T22:45:55.976326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1343488,"data_stored":580110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":578374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1925120,"data_stored":1168834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1339392,"data_stored":580076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":578374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1335296,"data_stored":579012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1916928,"data_stored":1168742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1331200,"data_stored":579026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:58.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:45:58.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:45:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.390+0000 7f16517f6640 1 Processor -- start 2024-09-15T22:45:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.390+0000 7f16517f6640 1 -- start start 2024-09-15T22:45:58.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f16517f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c06bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f16517f6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f164c15ed20 0x7f164c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f16517f6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c06c500 con 0x7f164c148100 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f16517f6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f164c0b58a0 con 0x7f164c15ed20 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f16517f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f164c06f270 con 0x7f164c06bba0 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f164c15ed20 0x7f164c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f164c148100 0x7f164c06eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43944/0 (socket says 172.21.15.134:43944) 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164affd640 1 -- 172.21.15.134:0/73341897 learned_addr learned my addr 172.21.15.134:0/73341897 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164b7fe640 1 -- 172.21.15.134:0/73341897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 msgr2=0x7f164c06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164a7fc640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c06bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f1649ffb640 1 -- 172.21.15.134:0/73341897 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77230839 0 0) 0x7f164c06c500 con 0x7f164c148100 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164b7fe640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c06bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164b7fe640 1 -- 172.21.15.134:0/73341897 >> v1:172.21.15.134:6789/0 conn(0x7f164c148100 legacy=0x7f164c06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164b7fe640 1 -- 172.21.15.134:0/73341897 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c0b4800 con 0x7f164c15ed20 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.391+0000 7f164a7fc640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c06bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:58.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.392+0000 7f164b7fe640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c15ed20 0x7f164c15f170 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbb9c088f168463 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.392+0000 7f1649ffb640 1 -- 172.21.15.134:0/73341897 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644007740 con 0x7f164c15ed20 2024-09-15T22:45:58.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.392+0000 7f1649ffb640 1 -- 172.21.15.134:0/73341897 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440078e0 con 0x7f164c15ed20 2024-09-15T22:45:58.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.392+0000 7f1649ffb640 1 -- 172.21.15.134:0/73341897 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644007cb0 con 0x7f164c15ed20 2024-09-15T22:45:58.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 -- 172.21.15.134:0/73341897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c15ed20 msgr2=0x7f164c15f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c15ed20 0x7f164c15f170 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164402a660 comp rx=0 tx=0).stop 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 -- 172.21.15.134:0/73341897 shutdown_connections 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c15ed20 0x7f164c15f170 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 --2- 172.21.15.134:0/73341897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c06bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 -- 172.21.15.134:0/73341897 >> 172.21.15.134:0/73341897 conn(0x7f164c062810 msgr2=0x7f164c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 -- 172.21.15.134:0/73341897 shutdown_connections 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.393+0000 7f16517f6640 1 -- 172.21.15.134:0/73341897 wait complete. 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.394+0000 7f16517f6640 1 Processor -- start 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.394+0000 7f16517f6640 1 -- start start 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f164c15ed20 0x7f164c0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0b4dc0 con 0x7f164c148100 2024-09-15T22:45:58.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1484e0 con 0x7f164c15ed20 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f16517f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f164c0b50a0 con 0x7f164c06bba0 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50460/0 (socket says 172.21.15.134:50460) 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 -- 172.21.15.134:0/4203644737 learned_addr learned my addr 172.21.15.134:0/4203644737 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164affd640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164b7fe640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f164c15ed20 0x7f164c0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 -- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 msgr2=0x7f164c15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 -- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f164c15ed20 msgr2=0x7f164c0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f164c15ed20 0x7f164c0b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164a7fc640 1 -- 172.21.15.134:0/4203644737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c13e0b0 con 0x7f164c148100 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.395+0000 7f164affd640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:58.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f164a7fc640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f164000c820 tx=0x7f164000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640015070 con 0x7f164c148100 2024-09-15T22:45:58.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1640007a30 con 0x7f164c148100 2024-09-15T22:45:58.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c13e390 con 0x7f164c148100 2024-09-15T22:45:58.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640007e00 con 0x7f164c148100 2024-09-15T22:45:58.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.396+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c13e950 con 0x7f164c148100 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.397+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c0b5380 con 0x7f164c148100 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.397+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f1640018070 con 0x7f164c148100 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.397+0000 7f16337fe640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 0x7f163806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.398+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f164008b660 con 0x7f164c148100 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.398+0000 7f164affd640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 0x7f163806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.398+0000 7f164affd640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 0x7f163806e890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f60 tx=0x7f163c007c30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.402+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1640059bb0 con 0x7f164c148100 2024-09-15T22:45:58.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.627+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f164c146b80 con 0x7f164c148100 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.629+0000 7f16337fe640 1 -- 172.21.15.134:0/4203644737 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f16400594b0 con 0x7f164c148100 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:45:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:45:58.631 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:45:58.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 msgr2=0x7f163806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 0x7f163806e890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f60 tx=0x7f163c007c30 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 msgr2=0x7f164c13d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f164000c820 tx=0x7f164000cc20 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 shutdown_connections 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f164c15ed20 0x7f164c0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f163806c3d0 0x7f163806e890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f164c148100 0x7f164c13d6d0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 --2- 172.21.15.134:0/4203644737 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f164c06bba0 0x7f164c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 >> 172.21.15.134:0/4203644737 conn(0x7f164c062810 msgr2=0x7f164c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 shutdown_connections 2024-09-15T22:45:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.631+0000 7f16517f6640 1 -- 172.21.15.134:0/4203644737 wait complete. 2024-09-15T22:45:58.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:45:58.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.740+0000 7f3e5ee8d640 1 Processor -- start 2024-09-15T22:45:58.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.740+0000 7f3e5ee8d640 1 -- start start 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5ee8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e580cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5ee8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e580ce740 con 0x7f3e58073120 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5ee8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e58072640 con 0x7f3e5815c180 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5ee8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e58072920 con 0x7f3e580cf070 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5d42a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3e58073120 0x7f3e5806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43950/0 (socket says 172.21.15.134:43950) 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e5d42a640 1 -- 172.21.15.134:0/1073356524 learned_addr learned my addr 172.21.15.134:0/1073356524 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e57fff640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e580cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129940791 0 0) 0x7f3e580ce740 con 0x7f3e58073120 2024-09-15T22:45:58.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e48003520 con 0x7f3e58073120 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902513217 0 0) 0x7f3e58072640 con 0x7f3e5815c180 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e580ce740 con 0x7f3e5815c180 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849298266 0 0) 0x7f3e48003520 con 0x7f3e58073120 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 msgr2=0x7f3e580cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e580cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 >> v1:172.21.15.177:6789/0 conn(0x7f3e5815c180 legacy=0x7f3e580cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e58072c00 con 0x7f3e58073120 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f3e50001a10 con 0x7f3e58073120 2024-09-15T22:45:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 >> v1:172.21.15.134:6789/0 conn(0x7f3e58073120 legacy=0x7f3e5806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e48003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e48004d40 0x7f3e480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e58072920 con 0x7f3e48003b70 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4800baf0 con 0x7f3e48004d40 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.741+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4800bcf0 con 0x7f3e580cf070 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e48003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5d42a640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e48004d40 0x7f3e480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e57fff640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 -- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 msgr2=0x7f3e48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580cf070 0x7f3e48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 -- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e48004d40 msgr2=0x7f3e480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e48004d40 0x7f3e480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 -- 172.21.15.134:0/1073356524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e48003520 con 0x7f3e48003b70 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.742+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e48003f70 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0018d0 tx=0x7f3e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6193d01fd83bf3f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0014f0 con 0x7f3e48003b70 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0052d0 con 0x7f3e48003b70 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e577fe640 1 -- 172.21.15.134:0/1073356524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c02aca0 con 0x7f3e48003b70 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/1073356524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 msgr2=0x7f3e48003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/1073356524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e48003f70 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0018d0 tx=0x7f3e48005830 comp rx=0 tx=0).stop 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5d42a640 1 -- 172.21.15.134:0/1073356524 reap_dead start 2024-09-15T22:45:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/1073356524 shutdown_connections 2024-09-15T22:45:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/1073356524 >> 172.21.15.134:0/1073356524 conn(0x7f3e58062cc0 msgr2=0x7f3e5806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/1073356524 shutdown_connections 2024-09-15T22:45:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.743+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/1073356524 wait complete. 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.744+0000 7f3e5ee8d640 1 Processor -- start 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.744+0000 7f3e5ee8d640 1 -- start start 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 0x7f3e580aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e580c52b0 0x7f3e580c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e580722f0 con 0x7f3e48003b70 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e580ced00 con 0x7f3e580c52b0 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5ee8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5815c560 con 0x7f3e580ab650 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5cc29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5cc29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50478/0 (socket says 172.21.15.134:50478) 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.745+0000 7f3e5cc29640 1 -- 172.21.15.134:0/3989860679 learned_addr learned my addr 172.21.15.134:0/3989860679 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e57fff640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 0x7f3e580aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5d42a640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e580c52b0 0x7f3e580c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 -- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 msgr2=0x7f3e580aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 0x7f3e580aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 -- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e580c52b0 msgr2=0x7f3e580c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e580c52b0 0x7f3e580c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 -- 172.21.15.134:0/3989860679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e580abae0 con 0x7f3e48003b70 2024-09-15T22:45:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e57fff640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 0x7f3e580aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5cc29640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0018d0 tx=0x7f3e4c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c040020 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c005480 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e580abdc0 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0014f0 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.746+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e580ac380 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.747+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e580cf4b0 con 0x7f3e48003b70 2024-09-15T22:45:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.748+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3e4c043020 con 0x7f3e48003b70 2024-09-15T22:45:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.748+0000 7f3e557fa640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 0x7f3e3c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.748+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f3e4c0ab5d0 con 0x7f3e48003b70 2024-09-15T22:45:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.748+0000 7f3e57fff640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 0x7f3e3c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.749+0000 7f3e57fff640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 0x7f3e3c06e890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e580adcf0 tx=0x7f3e44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:58.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.752+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e4c04a030 con 0x7f3e48003b70 2024-09-15T22:45:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.951+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e580711a0 con 0x7f3e48003b70 2024-09-15T22:45:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.952+0000 7f3e557fa640 1 -- 172.21.15.134:0/3989860679 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5237 (secure 0 0 0) 0x7f3e4c079cc0 con 0x7f3e48003b70 2024-09-15T22:45:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:45:58.954 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":53,"btime":"2024-09-15T22:45:56:987295+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:45:58.954 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 53 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 msgr2=0x7f3e3c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 0x7f3e3c06e890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e580adcf0 tx=0x7f3e44008040 comp rx=0 tx=0).stop 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 msgr2=0x7f3e580acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0018d0 tx=0x7f3e4c0012d0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 shutdown_connections 2024-09-15T22:45:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e580c52b0 0x7f3e580c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e580ab650 0x7f3e580aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e3c06c3d0 0x7f3e3c06e890 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 --2- 172.21.15.134:0/3989860679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e48003b70 0x7f3e580acb80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 >> 172.21.15.134:0/3989860679 conn(0x7f3e58062cc0 msgr2=0x7f3e580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 shutdown_connections 2024-09-15T22:45:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:58.954+0000 7f3e5ee8d640 1 -- 172.21.15.134:0/3989860679 wait complete. 2024-09-15T22:45:59.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:45:54.305835+0000', 'modified': '2024-09-15T22:45:56.317686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6891}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6891': {'gid': 6891, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6834/2420464130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 2420464130}, {'type': 'v1', 'addr': '172.21.15.134:6834', 'nonce': 2420464130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6891, 'qdb_cluster': [6891]} 2024-09-15T22:45:59.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:45:59.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:45:59.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.469+0000 7fd81e19f640 1 Processor -- start 2024-09-15T22:45:59.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.469+0000 7fd81e19f640 1 -- start start 2024-09-15T22:45:59.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd81e19f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd81815e940 0x7fd8180d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd81e19f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8180b7170 con 0x7fd81815ed20 2024-09-15T22:45:59.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd81e19f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8180b7aa0 con 0x7fd8180cef90 2024-09-15T22:45:59.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd81e19f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd8180d3660 con 0x7fd81815e940 2024-09-15T22:45:59.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd81815e940 0x7fd8180d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd81815e940 0x7fd8180d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50482/0 (socket says 172.21.15.134:50482) 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 -- 172.21.15.134:0/2094014732 learned_addr learned my addr 172.21.15.134:0/2094014732 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 -- 172.21.15.134:0/2094014732 >> v1:172.21.15.177:6789/0 conn(0x7fd8180cef90 legacy=0x7fd8180b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 -- 172.21.15.134:0/2094014732 >> v1:172.21.15.134:6789/0 conn(0x7fd81815ed20 legacy=0x7fd8180b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8167fc640 1 -- 172.21.15.134:0/2094014732 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135284426 0 0) 0x7fd808001110 con 0x7fd81815ed20 2024-09-15T22:45:59.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.470+0000 7fd8177fe640 1 -- 172.21.15.134:0/2094014732 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180d3940 con 0x7fd81815e940 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd8177fe640 1 --2- 172.21.15.134:0/2094014732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815e940 0x7fd8180d1060 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd80002a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff7e106d5cf6c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd8167fc640 1 -- 172.21.15.134:0/2094014732 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800037070 con 0x7fd81815e940 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd8167fc640 1 -- 172.21.15.134:0/2094014732 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd800032640 con 0x7fd81815e940 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd8167fc640 1 -- 172.21.15.134:0/2094014732 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800032a10 con 0x7fd81815e940 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 -- 172.21.15.134:0/2094014732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815e940 msgr2=0x7fd8180d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 --2- 172.21.15.134:0/2094014732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815e940 0x7fd8180d1060 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd80002a3c0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 -- 172.21.15.134:0/2094014732 shutdown_connections 2024-09-15T22:45:59.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 --2- 172.21.15.134:0/2094014732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815e940 0x7fd8180d1060 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 -- 172.21.15.134:0/2094014732 >> 172.21.15.134:0/2094014732 conn(0x7fd8180b6240 msgr2=0x7fd8180b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 -- 172.21.15.134:0/2094014732 shutdown_connections 2024-09-15T22:45:59.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.471+0000 7fd81e19f640 1 -- 172.21.15.134:0/2094014732 wait complete. 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 Processor -- start 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 -- start start 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 0x7fd818154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81815e940 0x7fd8180c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180d3310 con 0x7fd81815ed20 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180d3f00 con 0x7fd81815e940 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.473+0000 7fd81e19f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd8180d1ef0 con 0x7fd8180cef90 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50484/0 (socket says 172.21.15.134:50484) 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 -- 172.21.15.134:0/4219309090 learned_addr learned my addr 172.21.15.134:0/4219309090 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd816ffd640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81815e940 0x7fd8180c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 0x7fd818154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 -- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 msgr2=0x7fd818154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 0x7fd818154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 -- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81815e940 msgr2=0x7fd8180c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81815e940 0x7fd8180c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 -- 172.21.15.134:0/4219309090 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8181565c0 con 0x7fd81815ed20 2024-09-15T22:45:59.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 0x7fd818154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd817fff640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd81000c7a0 tx=0x7fd81000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd80ffff640 1 -- 172.21.15.134:0/4219309090 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810003b70 con 0x7fd81815ed20 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd80ffff640 1 -- 172.21.15.134:0/4219309090 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810003d30 con 0x7fd81815ed20 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8180ce880 con 0x7fd81815ed20 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd80ffff640 1 -- 172.21.15.134:0/4219309090 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81000aa90 con 0x7fd81815ed20 2024-09-15T22:45:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.474+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd818156b40 con 0x7fd81815ed20 2024-09-15T22:45:59.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.476+0000 7fd80ffff640 1 -- 172.21.15.134:0/4219309090 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fd81000ac30 con 0x7fd81815ed20 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.476+0000 7fd80ffff640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 0x7fd7f806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.476+0000 7fd80ffff640 1 -- 172.21.15.134:0/4219309090 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd81008b3e0 con 0x7fd81815ed20 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.476+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 0x7fd7f806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.477+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 0x7fd7f806e890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd800034000 tx=0x7fd80002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.477+0000 7fd82101a740 1 Processor -- start 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.477+0000 7fd82101a740 1 -- start start 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e68a80 0x55f717e6b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f717dcd520 con 0x55f717e6b2c0 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f717d753e0 con 0x55f717e6ca50 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f717dc94e0 con 0x55f717e68a80 2024-09-15T22:45:59.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50500/0 (socket says 172.21.15.134:50500) 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 -- 172.21.15.134:0/3774803571 learned_addr learned my addr 172.21.15.134:0/3774803571 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd816ffd640 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e68a80 0x55f717e6b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd817fff640 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 -- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e68a80 msgr2=0x55f717e6b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e68a80 0x55f717e6b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 -- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 msgr2=0x55f717e658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 -- 172.21.15.134:0/3774803571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f717d902f0 con 0x55f717e6b2c0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.478+0000 7fd8177fe640 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd800032870 tx=0x7fd80002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b87f9fd4a3bbc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd80d7fa640 1 -- 172.21.15.134:0/3774803571 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800037040 con 0x55f717e6b2c0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd80d7fa640 1 -- 172.21.15.134:0/3774803571 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80003e660 con 0x55f717e6b2c0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd80d7fa640 1 -- 172.21.15.134:0/3774803571 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80003ea10 con 0x55f717e6b2c0 2024-09-15T22:45:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 -- 172.21.15.134:0/3774803571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 msgr2=0x55f717eb0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd800032870 tx=0x7fd80002c000 comp rx=0 tx=0).stop 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 -- 172.21.15.134:0/3774803571 shutdown_connections 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e68a80 0x55f717e6b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 --2- 172.21.15.134:0/3774803571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717eb0a60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 -- 172.21.15.134:0/3774803571 >> 172.21.15.134:0/3774803571 conn(0x55f717e67a80 msgr2=0x55f717eaff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 -- 172.21.15.134:0/3774803571 shutdown_connections 2024-09-15T22:45:59.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.479+0000 7fd82101a740 1 -- 172.21.15.134:0/3774803571 wait complete. 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.480+0000 7fd82101a740 1 -- start start 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.480+0000 7fd82101a740 1 Processor -- start 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717ead760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e8c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f717e66f20 con 0x55f717ec3260 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f717d56450 con 0x55f717e6ca50 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f717eb1290 con 0x55f717e6b2c0 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd82101a740 10 client.0 _ll_register_callbacks cb 0x55f717adfac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50510/0 (socket says 172.21.15.134:50510) 2024-09-15T22:45:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 -- 172.21.15.134:0/4101570244 learned_addr learned my addr 172.21.15.134:0/4101570244 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717ead760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd816ffd640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e8c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 -- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 msgr2=0x55f717ead760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717ead760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 -- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 msgr2=0x55f717e8c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e8c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 -- 172.21.15.134:0/4101570244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f717ae02d0 con 0x55f717ec3260 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd817fff640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd810061a80 tx=0x7fd810059ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef14535282a2c6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd7f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.481+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81005d780 con 0x55f717ec3260 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd810055a40 con 0x55f717ec3260 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80003e660 con 0x55f717ec3260 2024-09-15T22:45:59.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd810061fb0 con 0x55f717ec3260 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 10 client.7026 fetch_fsmap learned FSMap version 53 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f717baa6b0 con 0x55f717ec3260 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80003e660 con 0x55f717ec3260 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fd8100711d0 con 0x55f717ec3260 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 10 client.7026 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 10 client.7026 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 20 client.7026 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717e95670 0x55f717e92ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 4 client.7026 mds_command: new command op to 6891 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 --> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f717ddac50 con 0x55f717e95670 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717e95670 0x55f717e92ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd7f67fc640 10 client.7026 ms_handle_connect on v2:172.21.15.134:6824/2420464130 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.482+0000 7fd8177fe640 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717e95670 0x55f717e92ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1df6a355df43d8 server_cookie=f3eeb1d62803b635 in_seq=0 out_seq=0 2024-09-15T22:45:59.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd7f67fc640 1 -- 172.21.15.134:0/4101570244 <== mds.0 v2:172.21.15.134:6824/2420464130 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f717ddac50 con 0x55f717e95670 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd7f67fc640 10 client.7026 handle_command_reply: tid=0 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 client.7026 shutdown 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 msgr2=0x55f717e8ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd810061a80 tx=0x7fd810059ad0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 shutdown_connections 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717e95670 0x55f717e92ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e8ba60 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd7f67fc640 0 client.7026 ms_handle_reset on v2:172.21.15.134:6824/2420464130 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e8c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 --2- 172.21.15.134:0/4101570244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717ead760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 >> 172.21.15.134:0/4101570244 conn(0x55f717e68a80 msgr2=0x55f717eaf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 shutdown_connections 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 1 -- 172.21.15.134:0/4101570244 wait complete. 2024-09-15T22:45:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.483+0000 7fd82101a740 20 client.7026 trim_cache size 0 max 16384 2024-09-15T22:45:59.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.501+0000 7fd82101a740 1 Processor -- start 2024-09-15T22:45:59.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.501+0000 7fd82101a740 1 -- start start 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717eae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717ec3260 0x55f717ed3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd818155e90 con 0x55f717e6b2c0 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180b5dd0 con 0x55f717e6ca50 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd818155840 con 0x55f717ec3260 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50512/0 (socket says 172.21.15.134:50512) 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 -- 172.21.15.134:0/2983072157 learned_addr learned my addr 172.21.15.134:0/2983072157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 -- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717ec3260 msgr2=0x55f717ed3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717ec3260 0x55f717ed3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 -- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 msgr2=0x55f717eae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717eae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 -- 172.21.15.134:0/2983072157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f717eb2e80 con 0x55f717e6b2c0 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd8177fe640 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd80003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ef8c2babfbd088 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd80cff9640 1 -- 172.21.15.134:0/2983072157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800037040 con 0x55f717e6b2c0 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd80cff9640 1 -- 172.21.15.134:0/2983072157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80003e660 con 0x55f717e6b2c0 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.502+0000 7fd80cff9640 1 -- 172.21.15.134:0/2983072157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80003eab0 con 0x55f717e6b2c0 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 -- 172.21.15.134:0/2983072157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 msgr2=0x55f717e8e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd80003b000 comp rx=0 tx=0).stop 2024-09-15T22:45:59.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 -- 172.21.15.134:0/2983072157 shutdown_connections 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717ec3260 0x55f717ed3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717eae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 --2- 172.21.15.134:0/2983072157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717e6b2c0 0x55f717e8e0b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 -- 172.21.15.134:0/2983072157 >> 172.21.15.134:0/2983072157 conn(0x55f717e68a80 msgr2=0x55f717eb1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 -- 172.21.15.134:0/2983072157 shutdown_connections 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.503+0000 7fd82101a740 1 -- 172.21.15.134:0/2983072157 wait complete. 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 -- start start 2024-09-15T22:45:59.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 Processor -- start 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717f13e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e918f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f717e8c0e0 con 0x55f717ec3260 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f717e8cea0 con 0x55f717e6ca50 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f717e6a130 con 0x55f717e6b2c0 2024-09-15T22:45:59.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd82101a740 10 client.0 _ll_register_callbacks cb 0x7fd81000ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50516/0 (socket says 172.21.15.134:50516) 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.504+0000 7fd817fff640 1 -- 172.21.15.134:0/20098738 learned_addr learned my addr 172.21.15.134:0/20098738 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd8177fe640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717f13e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd816ffd640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 -- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 msgr2=0x55f717f13e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717f13e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 -- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 msgr2=0x55f717e918f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e918f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 -- 172.21.15.134:0/20098738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f717e8c260 con 0x55f717ec3260 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd8177fe640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717f13e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd816ffd640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e918f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:59.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd817fff640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd810062170 tx=0x7fd8100014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8b57294de3367e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810078030 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd810079e20 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80003e660 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd81005d780 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 10 client.7032 fetch_fsmap learned FSMap version 53 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f717e8bcb0 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80003e660 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fd810058820 con 0x55f717ec3260 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 10 client.7032 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 10 client.7032 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 20 client.7032 populate_metadata read hostname 'smithi134' 2024-09-15T22:45:59.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717f317e0 0x55f717f31bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 4 client.7032 mds_command: new command op to 6891 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.505+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 --> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] -- command(tid 0: {"prefix": "status"}) -- 0x55f717dd4fa0 con 0x55f717f317e0 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd8177fe640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717f317e0 0x55f717f31bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd7f67fc640 10 client.7032 ms_handle_connect on v2:172.21.15.134:6824/2420464130 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd8177fe640 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717f317e0 0x55f717f31bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a06cffaa26702e9 server_cookie=9b53478703af2ce4 in_seq=0 out_seq=0 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd7f67fc640 1 -- 172.21.15.134:0/20098738 <== mds.0 v2:172.21.15.134:6824/2420464130 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55f717dd4fa0 con 0x55f717f317e0 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd7f67fc640 10 client.7032 handle_command_reply: tid=0 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 client.7032 shutdown 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 msgr2=0x55f717e91e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd810062170 tx=0x7fd8100014a0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 shutdown_connections 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:6824/2420464130,v1:172.21.15.134:6834/2420464130] conn(0x55f717f317e0 0x55f717f31bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f717ec3260 0x55f717e91e30 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f717e6ca50 0x55f717e918f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd7f67fc640 0 client.7032 ms_handle_reset on v2:172.21.15.134:6824/2420464130 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 --2- 172.21.15.134:0/20098738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f717e6b2c0 0x55f717f13e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 >> 172.21.15.134:0/20098738 conn(0x55f717e68a80 msgr2=0x55f717eb1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 shutdown_connections 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 1 -- 172.21.15.134:0/20098738 wait complete. 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.506+0000 7fd82101a740 20 client.7032 trim_cache size 0 max 16384 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:45:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 6891, 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 4.5384360099999999, 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 53, 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 107, 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 107, 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 8.6060819029999998 2024-09-15T22:45:59.516 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 msgr2=0x7fd7f806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 0x7fd7f806e890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd800034000 tx=0x7fd80002e000 comp rx=0 tx=0).stop 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 msgr2=0x7fd8180cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd81000c7a0 tx=0x7fd81000cc60 comp rx=0 tx=0).stop 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 shutdown_connections 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd7f806c3d0 0x7fd7f806e890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81815ed20 0x7fd8180cde10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81815e940 0x7fd8180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 --2- 172.21.15.134:0/4219309090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8180cef90 0x7fd818154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 >> 172.21.15.134:0/4219309090 conn(0x7fd8180b6240 msgr2=0x7fd8180b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 shutdown_connections 2024-09-15T22:45:59.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.507+0000 7fd81e19f640 1 -- 172.21.15.134:0/4219309090 wait complete. 2024-09-15T22:45:59.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:45:59.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 Processor -- start 2024-09-15T22:45:59.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 -- start start 2024-09-15T22:45:59.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7b8015e940 0x7f7b800d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b8015ed20 0x7f7b800d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7b800d1ae0 con 0x7f7b8015ed20 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7b800b7170 con 0x7f7b8015e940 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.617+0000 7f7b859bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800b7aa0 con 0x7f7b800cef90 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b8015ed20 0x7f7b800d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b8015ed20 0x7f7b800d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50522/0 (socket says 172.21.15.134:50522) 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3242471944 learned_addr learned my addr 172.21.15.134:0/3242471944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7effd640 1 --2- 172.21.15.134:0/3242471944 >> v2:172.21.15.177:3300/0 conn(0x7f7b8015e940 0x7f7b800d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7f7fe640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3242471944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 msgr2=0x7f7b800b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3242471944 >> v2:172.21.15.177:3300/0 conn(0x7f7b8015e940 msgr2=0x7f7b800d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:59.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3242471944 >> v2:172.21.15.177:3300/0 conn(0x7f7b8015e940 0x7f7b800d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.618+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3242471944 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800d3660 con 0x7f7b8015ed20 2024-09-15T22:45:59.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015ed20 0x7f7b800d15a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7b800509d0 tx=0x7f7b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6d0bd82498b916 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b7dffb640 1 -- 172.21.15.134:0/3242471944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74037070 con 0x7f7b8015ed20 2024-09-15T22:45:59.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b7dffb640 1 -- 172.21.15.134:0/3242471944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74032440 con 0x7f7b8015ed20 2024-09-15T22:45:59.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b7dffb640 1 -- 172.21.15.134:0/3242471944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74032810 con 0x7f7b8015ed20 2024-09-15T22:45:59.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 -- 172.21.15.134:0/3242471944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015ed20 msgr2=0x7f7b800d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015ed20 0x7f7b800d15a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7b800509d0 tx=0x7f7b7402a270 comp rx=0 tx=0).stop 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 -- 172.21.15.134:0/3242471944 shutdown_connections 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3242471944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015ed20 0x7f7b800d15a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3242471944 >> v2:172.21.15.177:3300/0 conn(0x7f7b8015e940 0x7f7b800d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 -- 172.21.15.134:0/3242471944 >> 172.21.15.134:0/3242471944 conn(0x7f7b800b6240 msgr2=0x7f7b800b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 -- 172.21.15.134:0/3242471944 shutdown_connections 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.619+0000 7f7b859bd640 1 -- 172.21.15.134:0/3242471944 wait complete. 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 Processor -- start 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 -- start start 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b8015ed20 0x7f7b801599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800d3f00 con 0x7f7b8015e940 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800d3c20 con 0x7f7b8015ed20 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.621+0000 7f7b859bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800d1ef0 con 0x7f7b800cef90 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50530/0 (socket says 172.21.15.134:50530) 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3527923056 learned_addr learned my addr 172.21.15.134:0/3527923056 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7effd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7f7fe640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b8015ed20 0x7f7b801599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 msgr2=0x7f7b800cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b8015ed20 msgr2=0x7f7b801599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b8015ed20 0x7f7b801599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 -- 172.21.15.134:0/3527923056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8014f1b0 con 0x7f7b8015e940 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b7e7fc640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7b7402a2b0 tx=0x7f7b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74041020 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7403d620 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8015a210 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74037040 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.622+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8015a7d0 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.623+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b800d1060 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.624+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f7b74044020 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.624+0000 7f7b67fff640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 0x7f7b6c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.624+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f7b740abb10 con 0x7f7b8015e940 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.624+0000 7f7b7effd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 0x7f7b6c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:59.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.625+0000 7f7b7effd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 0x7f7b6c06e890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009b40 tx=0x7f7b70009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:59.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.629+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b7404b030 con 0x7f7b8015e940 2024-09-15T22:45:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.826+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b800ba6b0 con 0x7f7b8015e940 2024-09-15T22:45:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.826+0000 7f7b67fff640 1 -- 172.21.15.134:0/3527923056 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f7b74079b20 con 0x7f7b8015e940 2024-09-15T22:45:59.828 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:45:59.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 msgr2=0x7f7b6c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 0x7f7b6c06e890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009b40 tx=0x7f7b70009190 comp rx=0 tx=0).stop 2024-09-15T22:45:59.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 msgr2=0x7f7b8014ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:59.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7b7402a2b0 tx=0x7f7b740046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 shutdown_connections 2024-09-15T22:45:59.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b8015ed20 0x7f7b801599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b6c06c3d0 0x7f7b6c06e890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b8015e940 0x7f7b8014ec70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 --2- 172.21.15.134:0/3527923056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b800cef90 0x7f7b800cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 >> 172.21.15.134:0/3527923056 conn(0x7f7b800b6240 msgr2=0x7f7b8015f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.828+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 shutdown_connections 2024-09-15T22:45:59.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:45:59.829+0000 7f7b859bd640 1 -- 172.21.15.134:0/3527923056 wait complete. 2024-09-15T22:45:59.841 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:45:59.841 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:59.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:45:59.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:45:59.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:59.842 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:45:59.842 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:45:59.842 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:59.842 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:59.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:59.843 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:59.859 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42533sec preferred_lft 42533sec 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.860 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:45:59.861 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:59.862 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:59.922 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:45:59.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:59.924 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:45:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:45:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:59.982 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:46:00.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:46:00.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:00.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.108 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:46:00.124 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:46:00.124 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:46:00.124 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:46:00.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:46:00.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:00.189 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:00.244 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:46:00.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:00.245 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:00.300 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:46:00.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:00.383 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:00.383 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:00.383 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:00.391 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:00.397 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:00.397 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:46:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:46:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:46:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:46:00.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:46:00.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:00.469 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:46:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:46:00.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:00.570 INFO:teuthology.orchestra.run.smithi134.stdout:client5819 2024-09-15T22:46:00.571 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:00.571 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:00.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:46:00.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.723+0000 7f396fe27640 1 Processor -- start 2024-09-15T22:46:00.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 -- start start 2024-09-15T22:46:00.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39680b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39680cef90 0x7f39680b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39680b7170 con 0x7f396815e940 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f39680b7aa0 con 0x7f39680cef90 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.724+0000 7f396fe27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f39680d3660 con 0x7f396815ed20 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39680cef90 0x7f39680b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396dbc3640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f396815e940 0x7f39680d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43956/0 (socket says 172.21.15.134:43956) 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39680cef90 0x7f39680b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50534/0 (socket says 172.21.15.134:50534) 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396dbc3640 1 -- 172.21.15.134:0/1874341345 learned_addr learned my addr 172.21.15.134:0/1874341345 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 -- 172.21.15.134:0/1874341345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 msgr2=0x7f39680b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396d3c2640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39680b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396cbc1640 1 -- 172.21.15.134:0/1874341345 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174349425 0 0) 0x7f3964001110 con 0x7f396815e940 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39680b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 -- 172.21.15.134:0/1874341345 >> v1:172.21.15.134:6789/0 conn(0x7f396815e940 legacy=0x7f39680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396e3c4640 1 -- 172.21.15.134:0/1874341345 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39680d3940 con 0x7f39680cef90 2024-09-15T22:46:00.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.725+0000 7f396d3c2640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39680b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396e3c4640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39680cef90 0x7f39680b3760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3960009d90 tx=0x7f396002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d588f84d50aada6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396cbc1640 1 -- 172.21.15.134:0/1874341345 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960007740 con 0x7f39680cef90 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396cbc1640 1 -- 172.21.15.134:0/1874341345 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39600078e0 con 0x7f39680cef90 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396cbc1640 1 -- 172.21.15.134:0/1874341345 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960007cb0 con 0x7f39680cef90 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 -- 172.21.15.134:0/1874341345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39680cef90 msgr2=0x7f39680b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39680cef90 0x7f39680b3760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3960009d90 tx=0x7f396002a6f0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 -- 172.21.15.134:0/1874341345 shutdown_connections 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39680cef90 0x7f39680b3760 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 --2- 172.21.15.134:0/1874341345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39680b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 -- 172.21.15.134:0/1874341345 >> 172.21.15.134:0/1874341345 conn(0x7f39680b6240 msgr2=0x7f39680b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 -- 172.21.15.134:0/1874341345 shutdown_connections 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.726+0000 7f396fe27640 1 -- 172.21.15.134:0/1874341345 wait complete. 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.727+0000 7f396fe27640 1 Processor -- start 2024-09-15T22:46:00.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.727+0000 7f396fe27640 1 -- start start 2024-09-15T22:46:00.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39680cef90 0x7f39681e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39681f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39680d3310 con 0x7f396815e940 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f39680d3f00 con 0x7f39680cef90 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396fe27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f39680d1ef0 con 0x7f396815ed20 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396d3c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396d3c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50538/0 (socket says 172.21.15.134:50538) 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.728+0000 7f396d3c2640 1 -- 172.21.15.134:0/3394180350 learned_addr learned my addr 172.21.15.134:0/3394180350 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396e3c4640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39681f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 -- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 msgr2=0x7f39681f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39681f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 -- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39680cef90 msgr2=0x7f39681e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396dbc3640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39680cef90 0x7f39681e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39680cef90 0x7f39681e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 -- 172.21.15.134:0/3394180350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3968158960 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396d3c2640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f395800c820 tx=0x7f395800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958015070 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580079d0 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396815b4a0 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958007d80 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.729+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396814c070 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.730+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39680d1060 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.731+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f3958018070 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.731+0000 7f395e7fc640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 0x7f394c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.731+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f395808b4c0 con 0x7f396815e940 2024-09-15T22:46:00.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.731+0000 7f396dbc3640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 0x7f394c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.732+0000 7f396dbc3640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 0x7f394c06e8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3964000f60 tx=0x7f3964009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:00.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.736+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3958059a10 con 0x7f396815e940 2024-09-15T22:46:00.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.935+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39680ba6b0 con 0x7f396815e940 2024-09-15T22:46:00.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.936+0000 7f395e7fc640 1 -- 172.21.15.134:0/3394180350 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f3958059310 con 0x7f396815e940 2024-09-15T22:46:00.937 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:46:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 msgr2=0x7f394c06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 0x7f394c06e8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3964000f60 tx=0x7f3964009040 comp rx=0 tx=0).stop 2024-09-15T22:46:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 msgr2=0x7f39681f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f395800c820 tx=0x7f395800cce0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 shutdown_connections 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f396815ed20 0x7f39681f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f394c06c400 0x7f394c06e8c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396815e940 0x7f39681f4030 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 --2- 172.21.15.134:0/3394180350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39680cef90 0x7f39681e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 >> 172.21.15.134:0/3394180350 conn(0x7f39680b6240 msgr2=0x7f39680cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 shutdown_connections 2024-09-15T22:46:00.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:00.938+0000 7f396fe27640 1 -- 172.21.15.134:0/3394180350 wait complete. 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:46:00.950 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:00.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.950 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:46:00.970 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42522sec preferred_lft 42522sec 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:00.971 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:00.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:00.973 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:46:01.038 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:46:01.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:01.040 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:46:01.098 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:46:01.098 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:46:01.099 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:46:01.099 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:46:01.099 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:46:01.099 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:46:01.099 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:46:01.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:46:01.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:46:01.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:46:01.100 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:46:01.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:46:01.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:01.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:01.231 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:46:01.247 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:46:01.247 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:46:01.247 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:01.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:01.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:46:01.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:01.314 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:01.369 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:01.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:01.370 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:01.425 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:46:01.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:01.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:01.508 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:01.508 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:01.508 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:01.521 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:01.521 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:01.521 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:46:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:46:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:46:01.524 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:46:01.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:01.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:01.589 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:46:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:46:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:client5822 2024-09-15T22:46:01.686 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:01.686 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:01.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:46:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.808+0000 7fb0a5f4b640 1 Processor -- start 2024-09-15T22:46:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.808+0000 7fb0a5f4b640 1 -- start start 2024-09-15T22:46:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb0a5f4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 0x7fb0a00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb0a5f4b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0a00b5c10 0x7fb0a00b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb0a5f4b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a00b0470 con 0x7fb0a00d0820 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb0a5f4b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a00cdc10 con 0x7fb0a00b5c10 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb0a5f4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a00cdef0 con 0x7fb0a015c4b0 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb09effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0a00b5c10 0x7fb0a00b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb09effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0a00b5c10 0x7fb0a00b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50552/0 (socket says 172.21.15.134:50552) 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.809+0000 7fb09effd640 1 -- 172.21.15.134:0/3556289294 learned_addr learned my addr 172.21.15.134:0/3556289294 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09f7fe640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 0x7fb0a00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09effd640 1 -- 172.21.15.134:0/3556289294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 msgr2=0x7fb0a00b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09effd640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 0x7fb0a00b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09effd640 1 -- 172.21.15.134:0/3556289294 >> v1:172.21.15.177:6789/0 conn(0x7fb0a00d0820 legacy=0x7fb0a01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:01.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09effd640 1 -- 172.21.15.134:0/3556289294 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a00ce1d0 con 0x7fb0a00b5c10 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09f7fe640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 0x7fb0a00b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.810+0000 7fb09effd640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a00b5c10 0x7fb0a00b5460 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb094009e50 tx=0x7fb09402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f6f32f37d70632 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb09e7fc640 1 -- 172.21.15.134:0/3556289294 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094036070 con 0x7fb0a00b5c10 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb09e7fc640 1 -- 172.21.15.134:0/3556289294 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094031600 con 0x7fb0a00b5c10 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb09e7fc640 1 -- 172.21.15.134:0/3556289294 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0940319d0 con 0x7fb0a00b5c10 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3556289294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a00b5c10 msgr2=0x7fb0a00b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a00b5c10 0x7fb0a00b5460 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb094009e50 tx=0x7fb09402a710 comp rx=0 tx=0).stop 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3556289294 shutdown_connections 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a00b5c10 0x7fb0a00b5460 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3556289294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a015c4b0 0x7fb0a00b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3556289294 >> 172.21.15.134:0/3556289294 conn(0x7fb0a006c9f0 msgr2=0x7fb0a006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3556289294 shutdown_connections 2024-09-15T22:46:01.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.811+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3556289294 wait complete. 2024-09-15T22:46:01.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.812+0000 7fb0a5f4b640 1 Processor -- start 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 -- start start 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0a00b5c10 0x7fb0a01f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a00d0820 0x7fb0a015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a00ce790 con 0x7fb0a015c4b0 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a015c890 con 0x7fb0a00b5c10 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb0a5f4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a00ce910 con 0x7fb0a00d0820 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50554/0 (socket says 172.21.15.134:50554) 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb09ffff640 1 -- 172.21.15.134:0/3317435496 learned_addr learned my addr 172.21.15.134:0/3317435496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb09effd640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a00d0820 0x7fb0a015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.813+0000 7fb09f7fe640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0a00b5c10 0x7fb0a01f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 -- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a00d0820 msgr2=0x7fb0a015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a00d0820 0x7fb0a015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 -- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0a00b5c10 msgr2=0x7fb0a01f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0a00b5c10 0x7fb0a01f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 -- 172.21.15.134:0/3317435496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a01562d0 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb09ffff640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb098001eb0 tx=0x7fb09800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098017070 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0980052d0 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a01f54d0 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098003810 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.814+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a01f5a90 con 0x7fb0a015c4b0 2024-09-15T22:46:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.815+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a00b4f20 con 0x7fb0a015c4b0 2024-09-15T22:46:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.816+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fb09801a070 con 0x7fb0a015c4b0 2024-09-15T22:46:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.816+0000 7fb087fff640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 0x7fb08c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.816+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fb09808a8c0 con 0x7fb0a015c4b0 2024-09-15T22:46:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.816+0000 7fb09f7fe640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 0x7fb08c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.817+0000 7fb09f7fe640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 0x7fb08c06e890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb090006fd0 tx=0x7fb090008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:01.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:01.820+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0980588d0 con 0x7fb0a015c4b0 2024-09-15T22:46:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:02.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb0a0160380 con 0x7fb0a015c4b0 2024-09-15T22:46:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.019+0000 7fb087fff640 1 -- 172.21.15.134:0/3317435496 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v54) ==== 136+0+0 (secure 0 0 0) 0x7fb09805cbd0 con 0x7fb0a015c4b0 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 msgr2=0x7fb08c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 0x7fb08c06e890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb090006fd0 tx=0x7fb090008040 comp rx=0 tx=0).stop 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 msgr2=0x7fb0a015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb098001eb0 tx=0x7fb09800c890 comp rx=0 tx=0).stop 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 shutdown_connections 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb08c06c3d0 0x7fb08c06e890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a015c4b0 0x7fb0a015e160 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0a00d0820 0x7fb0a015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 --2- 172.21.15.134:0/3317435496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0a00b5c10 0x7fb0a01f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 >> 172.21.15.134:0/3317435496 conn(0x7fb0a006c9f0 msgr2=0x7fb0a00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 shutdown_connections 2024-09-15T22:46:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.023+0000 7fb0a5f4b640 1 -- 172.21.15.134:0/3317435496 wait complete. 2024-09-15T22:46:03.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:46:03.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.143+0000 7fc2999a2640 1 Processor -- start 2024-09-15T22:46:03.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.143+0000 7fc2999a2640 1 -- start start 2024-09-15T22:46:03.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2999a2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc29415c010 0x7fc2940b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2999a2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc29406f9b0 0x7fc29406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2999a2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940b5bb0 con 0x7fc29415f590 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2999a2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940b5e90 con 0x7fc29406f9b0 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2999a2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940b6170 con 0x7fc29415c010 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc29406f9b0 0x7fc29406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc29406f9b0 0x7fc29406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50556/0 (socket says 172.21.15.134:50556) 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 -- 172.21.15.134:0/1881484074 learned_addr learned my addr 172.21.15.134:0/1881484074 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2989a0640 1 --2- 172.21.15.134:0/1881484074 >> v2:172.21.15.177:3300/0 conn(0x7fc29415c010 0x7fc2940b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 -- 172.21.15.134:0/1881484074 >> v2:172.21.15.177:3300/0 conn(0x7fc29415c010 msgr2=0x7fc2940b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 --2- 172.21.15.134:0/1881484074 >> v2:172.21.15.177:3300/0 conn(0x7fc29415c010 0x7fc2940b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 -- 172.21.15.134:0/1881484074 >> v1:172.21.15.177:6789/0 conn(0x7fc29415f590 legacy=0x7fc29406f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.144+0000 7fc2991a1640 1 -- 172.21.15.134:0/1881484074 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940b6450 con 0x7fc29406f9b0 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.145+0000 7fc2991a1640 1 --2- 172.21.15.134:0/1881484074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29406f9b0 0x7fc29406d520 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc294063700 tx=0x7fc28c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02640145ddbb4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.145+0000 7fc28b7fe640 1 -- 172.21.15.134:0/1881484074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c036070 con 0x7fc29406f9b0 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.145+0000 7fc28b7fe640 1 -- 172.21.15.134:0/1881484074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c031600 con 0x7fc29406f9b0 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.145+0000 7fc28b7fe640 1 -- 172.21.15.134:0/1881484074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0319d0 con 0x7fc29406f9b0 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 -- 172.21.15.134:0/1881484074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29406f9b0 msgr2=0x7fc29406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 --2- 172.21.15.134:0/1881484074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29406f9b0 0x7fc29406d520 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc294063700 tx=0x7fc28c02a610 comp rx=0 tx=0).stop 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 -- 172.21.15.134:0/1881484074 shutdown_connections 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 --2- 172.21.15.134:0/1881484074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29406f9b0 0x7fc29406d520 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 --2- 172.21.15.134:0/1881484074 >> v2:172.21.15.177:3300/0 conn(0x7fc29415c010 0x7fc2940b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 -- 172.21.15.134:0/1881484074 >> 172.21.15.134:0/1881484074 conn(0x7fc294062630 msgr2=0x7fc294062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 -- 172.21.15.134:0/1881484074 shutdown_connections 2024-09-15T22:46:03.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.146+0000 7fc2999a2640 1 -- 172.21.15.134:0/1881484074 wait complete. 2024-09-15T22:46:03.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.147+0000 7fc2999a2640 1 Processor -- start 2024-09-15T22:46:03.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.147+0000 7fc2999a2640 1 -- start start 2024-09-15T22:46:03.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 0x7fc2940d1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 0x7fc29415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc29415c570 con 0x7fc29415f590 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc29415c3f0 con 0x7fc29415c010 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2999a2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc29406da60 con 0x7fc29406f9b0 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50566/0 (socket says 172.21.15.134:50566) 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 -- 172.21.15.134:0/307884603 learned_addr learned my addr 172.21.15.134:0/307884603 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc28bfff640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 0x7fc29415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2989a0640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 0x7fc2940d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 -- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 msgr2=0x7fc2940d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 0x7fc2940d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 -- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 msgr2=0x7fc29415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 0x7fc29415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 -- 172.21.15.134:0/307884603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940d2190 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc28bfff640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 0x7fc29415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2989a0640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 0x7fc2940d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.148+0000 7fc2991a1640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009f40 tx=0x7fc28c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.149+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c036050 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.149+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c042070 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.149+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2941f4380 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.149+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c007bd0 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.149+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2940d1eb0 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.150+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29406d520 con 0x7fc29415f590 2024-09-15T22:46:03.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.150+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fc28c047460 con 0x7fc29415f590 2024-09-15T22:46:03.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.151+0000 7fc2897fa640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 0x7fc28006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.151+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fc28c0ac670 con 0x7fc29415f590 2024-09-15T22:46:03.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.151+0000 7fc2989a0640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 0x7fc28006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.151+0000 7fc2989a0640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 0x7fc28006e890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.155+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc28c07abc0 con 0x7fc29415f590 2024-09-15T22:46:03.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.343+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc2940b3950 con 0x7fc28006c3d0 2024-09-15T22:46:03.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.346+0000 7fc2897fa640 1 -- 172.21.15.134:0/307884603 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc2940b3950 con 0x7fc28006c3d0 2024-09-15T22:46:03.348 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:03.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:03.348 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:46:03.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:03.348 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:03.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.347+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 msgr2=0x7fc28006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.347+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 0x7fc28006e890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).stop 2024-09-15T22:46:03.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.347+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 msgr2=0x7fc2941f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.347+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009f40 tx=0x7fc28c004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 shutdown_connections 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc28006c3d0 0x7fc28006e890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29415f590 0x7fc2941f4860 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29415c010 0x7fc29415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 --2- 172.21.15.134:0/307884603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc29406f9b0 0x7fc2940d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 >> 172.21.15.134:0/307884603 conn(0x7fc294062630 msgr2=0x7fc29415c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 shutdown_connections 2024-09-15T22:46:03.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.348+0000 7fc2999a2640 1 -- 172.21.15.134:0/307884603 wait complete. 2024-09-15T22:46:03.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:46:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.460+0000 7ff9a9bff640 1 Processor -- start 2024-09-15T22:46:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.460+0000 7ff9a9bff640 1 -- start start 2024-09-15T22:46:03.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a9bff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a4161cc0 0x7ff9a40aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a9bff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff9a40b57d0 0x7ff9a40b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a9bff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a406dc40 con 0x7ff9a4072290 2024-09-15T22:46:03.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a9bff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a406e570 con 0x7ff9a40b57d0 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a9bff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a406df20 con 0x7ff9a4161cc0 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff9a4072290 0x7ff9a406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43964/0 (socket says 172.21.15.134:43964) 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a3fff640 1 -- 172.21.15.134:0/2093000332 learned_addr learned my addr 172.21.15.134:0/2093000332 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792806779 0 0) 0x7ff9a406dc40 con 0x7ff9a4072290 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.461+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff98c003520 con 0x7ff9a4072290 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a2ffd640 1 --2- 172.21.15.134:0/2093000332 >> v2:172.21.15.177:3300/0 conn(0x7ff9a40b57d0 0x7ff9a40b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a4161cc0 0x7ff9a40aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3816524004 0 0) 0x7ff98c003520 con 0x7ff9a4072290 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a4161cc0 msgr2=0x7ff9a40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a4161cc0 0x7ff9a40aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 >> v2:172.21.15.177:3300/0 conn(0x7ff9a40b57d0 msgr2=0x7ff9a40b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 --2- 172.21.15.134:0/2093000332 >> v2:172.21.15.177:3300/0 conn(0x7ff9a40b57d0 0x7ff9a40b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a406e200 con 0x7ff9a4072290 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7ff99c0019f0 con 0x7ff9a4072290 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a4161cc0 0x7ff9a40aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 >> v1:172.21.15.134:6789/0 conn(0x7ff9a4072290 legacy=0x7ff9a406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff98c0039b0 0x7ff98c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff98c0043a0 0x7ff98c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff98c004fa0 0x7ff98c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a406e570 con 0x7ff98c004fa0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a406df20 con 0x7ff98c0043a0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c00bf30 con 0x7ff98c0039b0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff98c0039b0 0x7ff98c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff98c004fa0 0x7ff98c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a2ffd640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff98c0043a0 0x7ff98c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 -- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff98c0039b0 msgr2=0x7ff98c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff98c0039b0 0x7ff98c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 -- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff98c0043a0 msgr2=0x7ff98c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff98c0043a0 0x7ff98c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a3fff640 1 -- 172.21.15.134:0/2093000332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c003520 con 0x7ff98c004fa0 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.462+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff98c0039b0 0x7ff98c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.463+0000 7ff9a3fff640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff98c004fa0 0x7ff98c00b9c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00a8a0 tx=0x7ff98c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44dd94af4b5fd69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.463+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00a4c0 con 0x7ff98c004fa0 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.463+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c02f070 con 0x7ff98c004fa0 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.463+0000 7ff9a27fc640 1 -- 172.21.15.134:0/2093000332 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c02bd70 con 0x7ff98c004fa0 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 -- 172.21.15.134:0/2093000332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff98c004fa0 msgr2=0x7ff98c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/2093000332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff98c004fa0 0x7ff98c00b9c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00a8a0 tx=0x7ff98c005830 comp rx=0 tx=0).stop 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a3fff640 1 -- 172.21.15.134:0/2093000332 reap_dead start 2024-09-15T22:46:03.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 -- 172.21.15.134:0/2093000332 shutdown_connections 2024-09-15T22:46:03.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 -- 172.21.15.134:0/2093000332 >> 172.21.15.134:0/2093000332 conn(0x7ff9a406bba0 msgr2=0x7ff9a406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 -- 172.21.15.134:0/2093000332 shutdown_connections 2024-09-15T22:46:03.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.464+0000 7ff9a9bff640 1 -- 172.21.15.134:0/2093000332 wait complete. 2024-09-15T22:46:03.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.465+0000 7ff9a9bff640 1 Processor -- start 2024-09-15T22:46:03.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.465+0000 7ff9a9bff640 1 -- start start 2024-09-15T22:46:03.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a41532f0 0x7ff9a4154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4134750 0x7ff9a41558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a406f290 con 0x7ff9a4134f60 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a406f110 con 0x7ff9a4134750 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a9bff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a406f410 con 0x7ff9a41532f0 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50590/0 (socket says 172.21.15.134:50590) 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 -- 172.21.15.134:0/1415445753 learned_addr learned my addr 172.21.15.134:0/1415445753 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a41532f0 0x7ff9a4154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a3fff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4134750 0x7ff9a41558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 -- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a41532f0 msgr2=0x7ff9a4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a41532f0 0x7ff9a4154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 -- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4134750 msgr2=0x7ff9a41558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4134750 0x7ff9a41558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 -- 172.21.15.134:0/1415445753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4132280 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.466+0000 7ff9a2ffd640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff998011960 tx=0x7ff998011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.467+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99800faf0 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.467+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99800fc90 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.467+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998014440 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.467+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a4154bc0 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.467+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a41324f0 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.468+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a40b5c10 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.468+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7ff998012040 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.469+0000 7ff98bfff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 0x7ff99006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.469+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7ff99808bc70 con 0x7ff9a4134f60 2024-09-15T22:46:03.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.469+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 0x7ff99006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.469+0000 7ff9a37fe640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 0x7ff99006e890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9a415a330 tx=0x7ff994008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.473+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff998019030 con 0x7ff9a4134f60 2024-09-15T22:46:03.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.639+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff9a415ef50 con 0x7ff9a4134f60 2024-09-15T22:46:03.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.639+0000 7ff98bfff640 1 -- 172.21.15.134:0/1415445753 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7ff99805a360 con 0x7ff9a4134f60 2024-09-15T22:46:03.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 msgr2=0x7ff99006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 0x7ff99006e890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9a415a330 tx=0x7ff994008040 comp rx=0 tx=0).stop 2024-09-15T22:46:03.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 msgr2=0x7ff9a4134210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff998011960 tx=0x7ff998011e20 comp rx=0 tx=0).stop 2024-09-15T22:46:03.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 shutdown_connections 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4134750 0x7ff9a41558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff99006c3d0 0x7ff99006e890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.641+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a4134f60 0x7ff9a4134210 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.642+0000 7ff9a9bff640 1 --2- 172.21.15.134:0/1415445753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a41532f0 0x7ff9a4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.642+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 >> 172.21.15.134:0/1415445753 conn(0x7ff9a406bba0 msgr2=0x7ff9a415f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.642+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 shutdown_connections 2024-09-15T22:46:03.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:03.642+0000 7ff9a9bff640 1 -- 172.21.15.134:0/1415445753 wait complete. 2024-09-15T22:46:03.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:03.655 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54) 2024-09-15T22:46:03.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:03.687 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/fake) 2024-09-15T22:46:03.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:03.759 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:46:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:46:03.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:03.815 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54) 2024-09-15T22:46:03.884 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:03.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol38420/.meta 2024-09-15T22:46:03.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38420 2024-09-15T22:46:04.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.092+0000 7fc34f359640 1 Processor -- start 2024-09-15T22:46:04.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.092+0000 7fc34f359640 1 -- start start 2024-09-15T22:46:04.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.092+0000 7fc34f359640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3480b3d50 0x7fc34806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34f359640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3480cf9a0 con 0x7fc348161e30 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34f359640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc348162210 con 0x7fc3480b3290 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34f359640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc3480cfcf0 con 0x7fc3480b3d50 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc348161e30 0x7fc3480d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43970/0 (socket says 172.21.15.134:43970) 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 -- 172.21.15.134:0/557093341 learned_addr learned my addr 172.21.15.134:0/557093341 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34c8f4640 1 --2- 172.21.15.134:0/557093341 >> v2:172.21.15.177:3300/0 conn(0x7fc3480b3d50 0x7fc34806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760200544 0 0) 0x7fc3480cf9a0 con 0x7fc348161e30 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334003520 con 0x7fc348161e30 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065971825 0 0) 0x7fc334003520 con 0x7fc348161e30 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 >> v2:172.21.15.177:3300/0 conn(0x7fc3480b3d50 msgr2=0x7fc34806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 --2- 172.21.15.134:0/557093341 >> v2:172.21.15.177:3300/0 conn(0x7fc3480b3d50 0x7fc34806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 >> v1:172.21.15.177:6789/0 conn(0x7fc3480b3290 legacy=0x7fc3480b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480d5210 con 0x7fc348161e30 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc344001670 con 0x7fc348161e30 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 >> v1:172.21.15.134:6789/0 conn(0x7fc348161e30 legacy=0x7fc3480d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc334003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334004800 0x7fc334004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3340051c0 0x7fc33400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480cfcf0 con 0x7fc3340039b0 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc33400c060 con 0x7fc3340051c0 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc33400c260 con 0x7fc334004800 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc334003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d8f6640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3340051c0 0x7fc33400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34c8f4640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334004800 0x7fc334004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 -- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334004800 msgr2=0x7fc334004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334004800 0x7fc334004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 -- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3340051c0 msgr2=0x7fc33400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3340051c0 0x7fc33400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 -- 172.21.15.134:0/557093341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc334003520 con 0x7fc3340039b0 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d8f6640 1 -- 172.21.15.134:0/557093341 reap_dead start 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc334003dd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c210 tx=0x7fc334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca2781c8a71129a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344007d30 con 0x7fc3340039b0 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344005ad0 con 0x7fc3340039b0 2024-09-15T22:46:04.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.094+0000 7fc33ffff640 1 -- 172.21.15.134:0/557093341 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344007070 con 0x7fc3340039b0 2024-09-15T22:46:04.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 -- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 msgr2=0x7fc334003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc334003dd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c210 tx=0x7fc334005830 comp rx=0 tx=0).stop 2024-09-15T22:46:04.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 -- 172.21.15.134:0/557093341 shutdown_connections 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 --2- 172.21.15.134:0/557093341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc334003dd0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 -- 172.21.15.134:0/557093341 >> 172.21.15.134:0/557093341 conn(0x7fc3480d1870 msgr2=0x7fc3480d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 -- 172.21.15.134:0/557093341 shutdown_connections 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.095+0000 7fc34f359640 1 -- 172.21.15.134:0/557093341 wait complete. 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.096+0000 7fc34f359640 1 Processor -- start 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.096+0000 7fc34f359640 1 -- start start 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc348154e80 0x7fc3481f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3480cd610 0x7fc3480cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480d34a0 con 0x7fc3340039b0 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480b3950 con 0x7fc3480cd610 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34f359640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480d3620 con 0x7fc348154e80 2024-09-15T22:46:04.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50602/0 (socket says 172.21.15.134:50602) 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 -- 172.21.15.134:0/3475841052 learned_addr learned my addr 172.21.15.134:0/3475841052 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d8f6640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3480cd610 0x7fc3480cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34c8f4640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc348154e80 0x7fc3481f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 -- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc348154e80 msgr2=0x7fc3481f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc348154e80 0x7fc3481f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 -- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3480cd610 msgr2=0x7fc3480cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3480cd610 0x7fc3480cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.097+0000 7fc34d0f5640 1 -- 172.21.15.134:0/3475841052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc348155300 con 0x7fc3340039b0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc34d0f5640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c210 tx=0x7fc344001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344000ed0 con 0x7fc3340039b0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344042070 con 0x7fc3340039b0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3481f5000 con 0x7fc3340039b0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344007290 con 0x7fc3340039b0 2024-09-15T22:46:04.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.098+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3481f55c0 con 0x7fc3340039b0 2024-09-15T22:46:04.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.099+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3480d39b0 con 0x7fc3340039b0 2024-09-15T22:46:04.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.099+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fc34403b040 con 0x7fc3340039b0 2024-09-15T22:46:04.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.100+0000 7fc33dffb640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 0x7fc32c06ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.100+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fc3440ab5a0 con 0x7fc3340039b0 2024-09-15T22:46:04.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.100+0000 7fc34c8f4640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 0x7fc32c06ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.101+0000 7fc34c8f4640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 0x7fc32c06ea30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3480ce3e0 tx=0x7fc338008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.104+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc344079c90 con 0x7fc3340039b0 2024-09-15T22:46:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.295+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7fc348069190 con 0x7fc32c06c570 2024-09-15T22:46:04.303 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:04.302+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:04.303 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:04.302+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:04.303 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:04.302+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:04.303 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:04.302+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:04.303 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:04.302+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:04.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.340+0000 7fc33dffb640 1 -- 172.21.15.134:0/3475841052 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fc348069190 con 0x7fc32c06c570 2024-09-15T22:46:04.343 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54 2024-09-15T22:46:04.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 msgr2=0x7fc32c06ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 0x7fc32c06ea30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3480ce3e0 tx=0x7fc338008040 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 msgr2=0x7fc348158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c210 tx=0x7fc344001a40 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 shutdown_connections 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3480cd610 0x7fc3480cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc348154e80 0x7fc3481f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc32c06c570 0x7fc32c06ea30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 --2- 172.21.15.134:0/3475841052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3340039b0 0x7fc348158a80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 >> 172.21.15.134:0/3475841052 conn(0x7fc3480d1870 msgr2=0x7fc3480b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 shutdown_connections 2024-09-15T22:46:04.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.342+0000 7fc34f359640 1 -- 172.21.15.134:0/3475841052 wait complete. 2024-09-15T22:46:04.356 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-15T22:46:04.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.453+0000 7f142c0a5640 1 Processor -- start 2024-09-15T22:46:04.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.453+0000 7f142c0a5640 1 -- start start 2024-09-15T22:46:04.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.454+0000 7f142c0a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.454+0000 7f142c0a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.454+0000 7f142c0a5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1424073380 con 0x7f142415ec40 2024-09-15T22:46:04.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.454+0000 7f142c0a5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1424074140 con 0x7f14240b4a40 2024-09-15T22:46:04.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.454+0000 7f142c0a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14240b1e30 con 0x7f142415e860 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429e41640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f142a642640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f142a642640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37576/0 (socket says 172.21.15.134:37576) 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429640640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f142415ec40 0x7f14240b4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:59604/0 (socket says 172.21.15.134:59604) 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f142a642640 1 -- 172.21.15.134:0/3768756273 learned_addr learned my addr 172.21.15.134:0/3768756273 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1428e3f640 1 -- 172.21.15.134:0/3768756273 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814338638 0 0) 0x7f1424073380 con 0x7f142415ec40 2024-09-15T22:46:04.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1428e3f640 1 -- 172.21.15.134:0/3768756273 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1410003520 con 0x7f142415ec40 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429e41640 1 -- 172.21.15.134:0/3768756273 >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 msgr2=0x7f142406cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429e41640 1 --2- 172.21.15.134:0/3768756273 >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429e41640 1 -- 172.21.15.134:0/3768756273 >> v1:172.21.15.177:6789/0 conn(0x7f142415ec40 legacy=0x7f14240b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f1429e41640 1 -- 172.21.15.134:0/3768756273 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1424073660 con 0x7f142415e860 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.455+0000 7f142a642640 1 --2- 172.21.15.134:0/3768756273 >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.456+0000 7f1429e41640 1 --2- 172.21.15.134:0/3768756273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424070bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14200097a0 tx=0x7f142002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c09cd26dee6cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.456+0000 7f1428e3f640 1 -- 172.21.15.134:0/3768756273 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420037070 con 0x7f142415e860 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.456+0000 7f1428e3f640 1 -- 172.21.15.134:0/3768756273 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1420032440 con 0x7f142415e860 2024-09-15T22:46:04.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.456+0000 7f1428e3f640 1 -- 172.21.15.134:0/3768756273 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200327f0 con 0x7f142415e860 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 -- 172.21.15.134:0/3768756273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 msgr2=0x7f1424070bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3768756273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424070bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14200097a0 tx=0x7f142002a180 comp rx=0 tx=0).stop 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 -- 172.21.15.134:0/3768756273 shutdown_connections 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3768756273 >> v2:172.21.15.177:3300/0 conn(0x7f14240b4a40 0x7f142406cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3768756273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424070bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 -- 172.21.15.134:0/3768756273 >> 172.21.15.134:0/3768756273 conn(0x7f142406f370 msgr2=0x7f142406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 -- 172.21.15.134:0/3768756273 shutdown_connections 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.457+0000 7f142c0a5640 1 -- 172.21.15.134:0/3768756273 wait complete. 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 Processor -- start 2024-09-15T22:46:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 -- start start 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f142415ec40 0x7f1424156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1424073c20 con 0x7f14240b4a40 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1424071110 con 0x7f142415ec40 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.458+0000 7f142c0a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14240714c0 con 0x7f142415e860 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50614/0 (socket says 172.21.15.134:50614) 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 -- 172.21.15.134:0/3485492797 learned_addr learned my addr 172.21.15.134:0/3485492797 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429640640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f142a642640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f142415ec40 0x7f1424156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 -- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 msgr2=0x7f1424156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 -- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f142415ec40 msgr2=0x7f1424156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f142415ec40 0x7f1424156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 -- 172.21.15.134:0/3485492797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142414ebe0 con 0x7f14240b4a40 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f1429e41640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f142002a1c0 tx=0x7f14200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420037040 con 0x7f14240b4a40 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1420042070 con 0x7f14240b4a40 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1424157a70 con 0x7f14240b4a40 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142003b930 con 0x7f14240b4a40 2024-09-15T22:46:04.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.459+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142415b4b0 con 0x7f14240b4a40 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.460+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1424070bd0 con 0x7f14240b4a40 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.461+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f142003bad0 con 0x7f14240b4a40 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.461+0000 7f141a7fc640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 0x7f140806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.461+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f14200abd70 con 0x7f14240b4a40 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.461+0000 7f1429640640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 0x7f140806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.462+0000 7f1429640640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 0x7f140806e890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f14240d3880 tx=0x7f1414007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.466+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1420079d00 con 0x7f14240b4a40 2024-09-15T22:46:04.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.655+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f14240b2670 con 0x7f140806c3d0 2024-09-15T22:46:04.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.659+0000 7f141a7fc640 1 -- 172.21.15.134:0/3485492797 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f14240b2670 con 0x7f140806c3d0 2024-09-15T22:46:04.660 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:04.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:04.660 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "subvol38420" 2024-09-15T22:46:04.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:04.661 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 msgr2=0x7f140806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 0x7f140806e890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f14240d3880 tx=0x7f1414007cf0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 msgr2=0x7f142414e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f142002a1c0 tx=0x7f14200046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 shutdown_connections 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f142415ec40 0x7f1424156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f142415e860 0x7f1424156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f140806c3d0 0x7f140806e890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 --2- 172.21.15.134:0/3485492797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14240b4a40 0x7f142414e6a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 >> 172.21.15.134:0/3485492797 conn(0x7f142406f370 msgr2=0x7f142415f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:04.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 shutdown_connections 2024-09-15T22:46:04.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.661+0000 7f142c0a5640 1 -- 172.21.15.134:0/3485492797 wait complete. 2024-09-15T22:46:04.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol38420 2024-09-15T22:46:04.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.774+0000 7f442fa5c640 1 Processor -- start 2024-09-15T22:46:04.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.774+0000 7f442fa5c640 1 -- start start 2024-09-15T22:46:04.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442fa5c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4428158e50 0x7f44280b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442fa5c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 0x7f442806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442fa5c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442815c800 con 0x7f442806ef60 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442fa5c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f442806f3d0 con 0x7f4428158e50 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442fa5c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f44280b43f0 con 0x7f442815c370 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442dff9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f442806ef60 0x7f442815ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43978/0 (socket says 172.21.15.134:43978) 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442dff9640 1 -- 172.21.15.134:0/2081554449 learned_addr learned my addr 172.21.15.134:0/2081554449 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442cff7640 1 --2- 172.21.15.134:0/2081554449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 0x7f442806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442d7f8640 1 --2- 172.21.15.134:0/2081554449 >> v2:172.21.15.177:3300/0 conn(0x7f4428158e50 0x7f44280b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f441ffff640 1 -- 172.21.15.134:0/2081554449 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894767394 0 0) 0x7f442815c800 con 0x7f442806ef60 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f441ffff640 1 -- 172.21.15.134:0/2081554449 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4414003520 con 0x7f442806ef60 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442cff7640 1 -- 172.21.15.134:0/2081554449 >> v2:172.21.15.177:3300/0 conn(0x7f4428158e50 msgr2=0x7f44280b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442cff7640 1 --2- 172.21.15.134:0/2081554449 >> v2:172.21.15.177:3300/0 conn(0x7f4428158e50 0x7f44280b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442cff7640 1 -- 172.21.15.134:0/2081554449 >> v1:172.21.15.134:6789/0 conn(0x7f442806ef60 legacy=0x7f442815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.775+0000 7f442cff7640 1 -- 172.21.15.134:0/2081554449 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44280b3630 con 0x7f442815c370 2024-09-15T22:46:04.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.776+0000 7f442cff7640 1 --2- 172.21.15.134:0/2081554449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 0x7f442806ea20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4418009790 tx=0x7f441802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc59168d48782ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.776+0000 7f441ffff640 1 -- 172.21.15.134:0/2081554449 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418037070 con 0x7f442815c370 2024-09-15T22:46:04.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.776+0000 7f441ffff640 1 -- 172.21.15.134:0/2081554449 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4418032440 con 0x7f442815c370 2024-09-15T22:46:04.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.776+0000 7f441ffff640 1 -- 172.21.15.134:0/2081554449 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44180327f0 con 0x7f442815c370 2024-09-15T22:46:04.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 -- 172.21.15.134:0/2081554449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 msgr2=0x7f442806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 --2- 172.21.15.134:0/2081554449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 0x7f442806ea20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4418009790 tx=0x7f441802a180 comp rx=0 tx=0).stop 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 -- 172.21.15.134:0/2081554449 shutdown_connections 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 --2- 172.21.15.134:0/2081554449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f442815c370 0x7f442806ea20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 --2- 172.21.15.134:0/2081554449 >> v2:172.21.15.177:3300/0 conn(0x7f4428158e50 0x7f44280b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 -- 172.21.15.134:0/2081554449 >> 172.21.15.134:0/2081554449 conn(0x7f442806bba0 msgr2=0x7f442806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 -- 172.21.15.134:0/2081554449 shutdown_connections 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.777+0000 7f442fa5c640 1 -- 172.21.15.134:0/2081554449 wait complete. 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.778+0000 7f442fa5c640 1 Processor -- start 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.778+0000 7f442fa5c640 1 -- start start 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 0x7f4428157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4428158e50 0x7f44281f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44280b3ed0 con 0x7f442815c370 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44280b3bf0 con 0x7f442806ef60 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442fa5c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4428159230 con 0x7f4428158e50 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50626/0 (socket says 172.21.15.134:50626) 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 -- 172.21.15.134:0/3895347658 learned_addr learned my addr 172.21.15.134:0/3895347658 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442d7f8640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 0x7f4428157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442cff7640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4428158e50 0x7f44281f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 -- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4428158e50 msgr2=0x7f44281f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4428158e50 0x7f44281f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 -- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 msgr2=0x7f4428157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 0x7f4428157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442dff9640 1 -- 172.21.15.134:0/3895347658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4428158400 con 0x7f442815c370 2024-09-15T22:46:04.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.779+0000 7f442d7f8640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 0x7f4428157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f442dff9640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f442000cb40 tx=0x7f442000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420017070 con 0x7f442815c370 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442000aca0 con 0x7f442815c370 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4428157e40 con 0x7f442815c370 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420012620 con 0x7f442815c370 2024-09-15T22:46:04.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.780+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44280ad800 con 0x7f442815c370 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.781+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442806ea20 con 0x7f442815c370 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.781+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f442001a070 con 0x7f442815c370 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.782+0000 7f441dffb640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 0x7f440c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.782+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f442008b4b0 con 0x7f442815c370 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.782+0000 7f442d7f8640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 0x7f440c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:04.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.782+0000 7f442d7f8640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 0x7f440c06e890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ac0 tx=0x7f4424008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:04.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.786+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4420059a80 con 0x7f442815c370 2024-09-15T22:46:04.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.977+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7f44280c6080 con 0x7f440c06c3d0 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:04.997+0000 7f441dffb640 1 -- 172.21.15.134:0/3895347658 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+687 (secure 0 0 0) 0x7f44280c6080 con 0x7f440c06c3d0 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "atime": "2024-09-15 22:46:03", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_pcent": "undefined", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_quota": "infinite", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_used": 0, 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "created_at": "2024-09-15 22:46:03", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "ctime": "2024-09-15 22:46:04", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "data_pool": "cephfs_data", 2024-09-15T22:46:04.999 INFO:teuthology.orchestra.run.smithi134.stdout: "features": [ 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-clone", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-autoprotect" 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flavor": 1, 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "gid": 0, 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": 16877, 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_addrs": [ 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.134:6789", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6789", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6790" 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "mtime": "2024-09-15 22:46:03", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "path": "/volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_namespace": "", 2024-09-15T22:46:05.000 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "complete", 2024-09-15T22:46:05.001 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "subvolume", 2024-09-15T22:46:05.001 INFO:teuthology.orchestra.run.smithi134.stdout: "uid": 0 2024-09-15T22:46:05.001 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 msgr2=0x7f440c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 0x7f440c06e890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ac0 tx=0x7f4424008040 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 msgr2=0x7f442806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f442000cb40 tx=0x7f442000a060 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 shutdown_connections 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f440c06c3d0 0x7f440c06e890 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442815c370 0x7f442806db80 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4428158e50 0x7f44281f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 --2- 172.21.15.134:0/3895347658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f442806ef60 0x7f4428157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 >> 172.21.15.134:0/3895347658 conn(0x7f442806bba0 msgr2=0x7f4428071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 shutdown_connections 2024-09-15T22:46:05.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.000+0000 7f442fa5c640 1 -- 172.21.15.134:0/3895347658 wait complete. 2024-09-15T22:46:05.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol38420 10485760 2024-09-15T22:46:05.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.113+0000 7fd587aa5640 1 Processor -- start 2024-09-15T22:46:05.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 -- start start 2024-09-15T22:46:05.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5800d1990 0x7fd580070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd580162260 con 0x7fd5800b5590 2024-09-15T22:46:05.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd5800d2320 con 0x7fd5800d1990 2024-09-15T22:46:05.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.114+0000 7fd587aa5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd580162540 con 0x7fd5800b7540 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:33218/0 (socket says 172.21.15.134:33218) 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd585841640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5800d1990 0x7fd580070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 -- 172.21.15.134:0/4075863613 learned_addr learned my addr 172.21.15.134:0/4075863613 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd585040640 1 --1- 172.21.15.134:0/4075863613 >> v1:172.21.15.177:6789/0 conn(0x7fd5800b5590 0x7fd5800b6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:59618/0 (socket says 172.21.15.134:59618) 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd58483f640 1 -- 172.21.15.134:0/4075863613 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543371047 0 0) 0x7fd580162260 con 0x7fd5800b5590 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 -- 172.21.15.134:0/4075863613 >> v2:172.21.15.177:3300/0 conn(0x7fd5800d1990 msgr2=0x7fd580070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 --2- 172.21.15.134:0/4075863613 >> v2:172.21.15.177:3300/0 conn(0x7fd5800d1990 0x7fd580070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 -- 172.21.15.134:0/4075863613 >> v1:172.21.15.177:6789/0 conn(0x7fd5800b5590 legacy=0x7fd5800b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.115+0000 7fd586042640 1 -- 172.21.15.134:0/4075863613 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd580162820 con 0x7fd5800b7540 2024-09-15T22:46:05.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd586042640 1 --2- 172.21.15.134:0/4075863613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e50 tx=0x7fd57802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900c48106c6fa592 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd58483f640 1 -- 172.21.15.134:0/4075863613 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578036070 con 0x7fd5800b7540 2024-09-15T22:46:05.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd58483f640 1 -- 172.21.15.134:0/4075863613 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd578031600 con 0x7fd5800b7540 2024-09-15T22:46:05.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd58483f640 1 -- 172.21.15.134:0/4075863613 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5780319d0 con 0x7fd5800b7540 2024-09-15T22:46:05.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd587aa5640 1 -- 172.21.15.134:0/4075863613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 msgr2=0x7fd58006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.116+0000 7fd587aa5640 1 --2- 172.21.15.134:0/4075863613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e50 tx=0x7fd57802a680 comp rx=0 tx=0).stop 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 -- 172.21.15.134:0/4075863613 shutdown_connections 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 --2- 172.21.15.134:0/4075863613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800b7540 0x7fd58006cdb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 --2- 172.21.15.134:0/4075863613 >> v2:172.21.15.177:3300/0 conn(0x7fd5800d1990 0x7fd580070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 -- 172.21.15.134:0/4075863613 >> 172.21.15.134:0/4075863613 conn(0x7fd58006f390 msgr2=0x7fd58006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 -- 172.21.15.134:0/4075863613 shutdown_connections 2024-09-15T22:46:05.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.117+0000 7fd587aa5640 1 -- 172.21.15.134:0/4075863613 wait complete. 2024-09-15T22:46:05.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 Processor -- start 2024-09-15T22:46:05.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 -- start start 2024-09-15T22:46:05.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5800b7540 0x7fd58015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800d1990 0x7fd5800ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5800d1d70 con 0x7fd5800b5590 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd580162de0 con 0x7fd5800b7540 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.118+0000 7fd587aa5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd58006d2f0 con 0x7fd5800d1990 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50642/0 (socket says 172.21.15.134:50642) 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 -- 172.21.15.134:0/2699518487 learned_addr learned my addr 172.21.15.134:0/2699518487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585040640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5800b7540 0x7fd58015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd586042640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800d1990 0x7fd5800ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 -- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800d1990 msgr2=0x7fd5800ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800d1990 0x7fd5800ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 -- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5800b7540 msgr2=0x7fd58015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5800b7540 0x7fd58015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 -- 172.21.15.134:0/2699518487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5800aa890 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd585841640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00e8a0 tx=0x7fd57c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c017070 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57c00c940 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5800aab70 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00cd30 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.119+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5800ab130 con 0x7fd5800b5590 2024-09-15T22:46:05.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.120+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58006cdb0 con 0x7fd5800b5590 2024-09-15T22:46:05.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.121+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7fd57c01a070 con 0x7fd5800b5590 2024-09-15T22:46:05.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.121+0000 7fd5767fc640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 0x7fd56406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.121+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd57c08b640 con 0x7fd5800b5590 2024-09-15T22:46:05.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.121+0000 7fd585040640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 0x7fd56406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.122+0000 7fd585040640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 0x7fd56406e8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd5800b42b0 tx=0x7fd570007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.125+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd57c0596e0 con 0x7fd5800b5590 2024-09-15T22:46:05.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.321+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol38420", "new_size": "10485760", "target": ["mon-mgr", ""]}) -- 0x7fd5800b4b10 con 0x7fd56406c400 2024-09-15T22:46:05.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.349+0000 7fd5767fc640 1 -- 172.21.15.134:0/2699518487 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+128 (secure 0 0 0) 0x7fd5800b4b10 con 0x7fd56406c400 2024-09-15T22:46:05.350 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_used": 0 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_quota": 10485760 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_pcent": "0.00" 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:05.351 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:05.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 msgr2=0x7fd56406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 0x7fd56406e8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd5800b42b0 tx=0x7fd570007d50 comp rx=0 tx=0).stop 2024-09-15T22:46:05.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 msgr2=0x7fd5801f5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00e8a0 tx=0x7fd57c00ed60 comp rx=0 tx=0).stop 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 shutdown_connections 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5800d1990 0x7fd5800ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5800b7540 0x7fd58015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd56406c400 0x7fd56406e8c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 --2- 172.21.15.134:0/2699518487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5800b5590 0x7fd5801f5160 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 >> 172.21.15.134:0/2699518487 conn(0x7fd58006f390 msgr2=0x7fd58015d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 shutdown_connections 2024-09-15T22:46:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.351+0000 7fd587aa5640 1 -- 172.21.15.134:0/2699518487 wait complete. 2024-09-15T22:46:05.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol38420 2024-09-15T22:46:05.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.463+0000 7f1eb9fed640 1 Processor -- start 2024-09-15T22:46:05.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.463+0000 7f1eb9fed640 1 -- start start 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb9fed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1eb406f130 0x7f1eb40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb9fed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 0x7f1eb40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb9fed640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb415c820 con 0x7f1eb4158e50 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb9fed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb40b43f0 con 0x7f1eb406f130 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb9fed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb40b3630 con 0x7f1eb415c370 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1eb406f130 0x7f1eb40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb37fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1eb4158e50 0x7f1eb406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:59628/0 (socket says 172.21.15.134:59628) 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1eb406f130 0x7f1eb40b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37634/0 (socket says 172.21.15.134:37634) 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb37fe640 1 -- 172.21.15.134:0/665816382 learned_addr learned my addr 172.21.15.134:0/665816382 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.464+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 0x7f1eb40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb2ffd640 1 -- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 msgr2=0x7f1eb40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb2ffd640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 0x7f1eb40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb2ffd640 1 -- 172.21.15.134:0/665816382 >> v1:172.21.15.177:6789/0 conn(0x7f1eb4158e50 legacy=0x7f1eb406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb2ffd640 1 -- 172.21.15.134:0/665816382 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb40b3910 con 0x7f1eb406f130 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb27fc640 1 -- 172.21.15.134:0/665816382 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707727973 0 0) 0x7f1ea4001490 con 0x7f1eb4158e50 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb3fff640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 0x7f1eb40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb2ffd640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb406f130 0x7f1eb40b5050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009790 tx=0x7f1ea802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56ca04a876c8f1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.465+0000 7f1eb27fc640 1 -- 172.21.15.134:0/665816382 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8037070 con 0x7f1eb406f130 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb27fc640 1 -- 172.21.15.134:0/665816382 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea8032440 con 0x7f1eb406f130 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb27fc640 1 -- 172.21.15.134:0/665816382 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8032810 con 0x7f1eb406f130 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 -- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb406f130 msgr2=0x7f1eb40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb406f130 0x7f1eb40b5050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009790 tx=0x7f1ea802a180 comp rx=0 tx=0).stop 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 -- 172.21.15.134:0/665816382 shutdown_connections 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb415c370 0x7f1eb40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/665816382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb406f130 0x7f1eb40b5050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 -- 172.21.15.134:0/665816382 >> 172.21.15.134:0/665816382 conn(0x7f1eb406bba0 msgr2=0x7f1eb406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 -- 172.21.15.134:0/665816382 shutdown_connections 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.466+0000 7f1eb9fed640 1 -- 172.21.15.134:0/665816382 wait complete. 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.467+0000 7f1eb9fed640 1 Processor -- start 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.467+0000 7f1eb9fed640 1 -- start start 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb406f130 0x7f1eb40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 0x7f1eb415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4159230 con 0x7f1eb415c370 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb40b3ed0 con 0x7f1eb4158e50 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb9fed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb40ce740 con 0x7f1eb406f130 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50644/0 (socket says 172.21.15.134:50644) 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb3fff640 1 -- 172.21.15.134:0/1142853818 learned_addr learned my addr 172.21.15.134:0/1142853818 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb2ffd640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 0x7f1eb415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.468+0000 7f1eb37fe640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb406f130 0x7f1eb40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 -- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb406f130 msgr2=0x7f1eb40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb406f130 0x7f1eb40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 -- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 msgr2=0x7f1eb415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 0x7f1eb415f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 -- 172.21.15.134:0/1142853818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb414b440 con 0x7f1eb415c370 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb2ffd640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 0x7f1eb415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb3fff640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00e8b0 tx=0x7f1eac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac017070 con 0x7f1eb415c370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac004020 con 0x7f1eb415c370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb40ae730 con 0x7f1eb415c370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0043f0 con 0x7f1eb415c370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.469+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb40aa4d0 con 0x7f1eb415c370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.470+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb40ce200 con 0x7f1eb415c370 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.470+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f1eac00c940 con 0x7f1eb415c370 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.471+0000 7f1e9bfff640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 0x7f1ea006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.471+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f1eac08b3c0 con 0x7f1eb415c370 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.471+0000 7f1eb37fe640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 0x7f1ea006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.472+0000 7f1eb37fe640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 0x7f1ea006e890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40012e0 tx=0x7f1ea4007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.475+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1eb40ae730 con 0x7f1eb415c370 2024-09-15T22:46:05.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.665+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7f1eb415dfa0 con 0x7f1ea006c3d0 2024-09-15T22:46:05.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.686+0000 7f1e9bfff640 1 -- 172.21.15.134:0/1142853818 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+680 (secure 0 0 0) 0x7f1eb415dfa0 con 0x7f1ea006c3d0 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "atime": "2024-09-15 22:46:03", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_pcent": "0.00", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_quota": 10485760, 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_used": 0, 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "created_at": "2024-09-15 22:46:03", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "ctime": "2024-09-15 22:46:05", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "data_pool": "cephfs_data", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "features": [ 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-clone", 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-autoprotect" 2024-09-15T22:46:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flavor": 1, 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "gid": 0, 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": 16877, 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_addrs": [ 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.134:6789", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6789", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6790" 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "mtime": "2024-09-15 22:46:03", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "path": "/volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_namespace": "", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "complete", 2024-09-15T22:46:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "subvolume", 2024-09-15T22:46:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "uid": 0 2024-09-15T22:46:05.690 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:05.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 msgr2=0x7f1ea006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 0x7f1ea006e890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40012e0 tx=0x7f1ea4007cf0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 msgr2=0x7f1eb40b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00e8b0 tx=0x7f1eac00ed70 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 shutdown_connections 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1ea006c3d0 0x7f1ea006e890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb415c370 0x7f1eb40b1120 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4158e50 0x7f1eb415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 --2- 172.21.15.134:0/1142853818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1eb406f130 0x7f1eb40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 >> 172.21.15.134:0/1142853818 conn(0x7f1eb406bba0 msgr2=0x7f1eb4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 shutdown_connections 2024-09-15T22:46:05.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.688+0000 7f1eb9fed640 1 -- 172.21.15.134:0/1142853818 wait complete. 2024-09-15T22:46:05.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol38420 --mode 777 --uid 1000 --gid 1000 2024-09-15T22:46:05.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.806+0000 7f8893a0e640 1 Processor -- start 2024-09-15T22:46:05.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.807+0000 7f8893a0e640 1 -- start start 2024-09-15T22:46:05.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.807+0000 7f8893a0e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f888c154ed0 0x7f888c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.807+0000 7f8893a0e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c0cf1f0 0x7f888c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8893a0e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f888c0b2ef0 con 0x7f888c1552b0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8893a0e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f888c0717a0 con 0x7f888c154ed0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8893a0e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f888c071150 con 0x7f888c0cf1f0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f88917aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f888c154ed0 0x7f888c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8890fa9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f888c1552b0 0x7f888c0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43990/0 (socket says 172.21.15.134:43990) 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8890fa9640 1 -- 172.21.15.134:0/4173681196 learned_addr learned my addr 172.21.15.134:0/4173681196 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8891fab640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c0cf1f0 0x7f888c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f88917aa640 1 -- 172.21.15.134:0/4173681196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c0cf1f0 msgr2=0x7f888c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f88917aa640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c0cf1f0 0x7f888c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f88917aa640 1 -- 172.21.15.134:0/4173681196 >> v1:172.21.15.134:6789/0 conn(0x7f888c1552b0 legacy=0x7f888c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f88917aa640 1 -- 172.21.15.134:0/4173681196 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c071430 con 0x7f888c154ed0 2024-09-15T22:46:05.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.808+0000 7f8883fff640 1 -- 172.21.15.134:0/4173681196 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945805663 0 0) 0x7f888c0b2ef0 con 0x7f888c1552b0 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f88917aa640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c154ed0 0x7f888c15c200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f88880097a0 tx=0x7f888802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30a7852dc9ca9f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8883fff640 1 -- 172.21.15.134:0/4173681196 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888037070 con 0x7f888c154ed0 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8883fff640 1 -- 172.21.15.134:0/4173681196 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888032440 con 0x7f888c154ed0 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8883fff640 1 -- 172.21.15.134:0/4173681196 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888032810 con 0x7f888c154ed0 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 -- 172.21.15.134:0/4173681196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c154ed0 msgr2=0x7f888c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c154ed0 0x7f888c15c200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f88880097a0 tx=0x7f888802a180 comp rx=0 tx=0).stop 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 -- 172.21.15.134:0/4173681196 shutdown_connections 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c0cf1f0 0x7f888c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 --2- 172.21.15.134:0/4173681196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c154ed0 0x7f888c15c200 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.809+0000 7f8893a0e640 1 -- 172.21.15.134:0/4173681196 >> 172.21.15.134:0/4173681196 conn(0x7f888c062a80 msgr2=0x7f888c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.810+0000 7f8893a0e640 1 -- 172.21.15.134:0/4173681196 shutdown_connections 2024-09-15T22:46:05.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.810+0000 7f8893a0e640 1 -- 172.21.15.134:0/4173681196 wait complete. 2024-09-15T22:46:05.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 Processor -- start 2024-09-15T22:46:05.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 -- start start 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c154ed0 0x7f888c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f888c1552b0 0x7f888c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f888c06c2b0 con 0x7f888c0cf1f0 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f888c0b2b90 con 0x7f888c1552b0 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f8893a0e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f888c06c430 con 0x7f888c154ed0 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f88917aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f88917aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50662/0 (socket says 172.21.15.134:50662) 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.811+0000 7f88917aa640 1 -- 172.21.15.134:0/1665733837 learned_addr learned my addr 172.21.15.134:0/1665733837 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:05.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8890fa9640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c154ed0 0x7f888c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8891fab640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f888c1552b0 0x7f888c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 -- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c154ed0 msgr2=0x7f888c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c154ed0 0x7f888c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 -- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f888c1552b0 msgr2=0x7f888c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f888c1552b0 0x7f888c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 -- 172.21.15.134:0/1665733837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c14ef00 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f88917aa640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f88880097a0 tx=0x7f88880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888037040 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888004230 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888003610 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c14f1e0 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.812+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c14f7a0 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.813+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888c06c830 con 0x7f888c0cf1f0 2024-09-15T22:46:05.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.814+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 90948+0+0 (secure 0 0 0) 0x7f88880037b0 con 0x7f888c0cf1f0 2024-09-15T22:46:05.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.814+0000 7f8881ffb640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 0x7f887006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.814+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f88880ac700 con 0x7f888c0cf1f0 2024-09-15T22:46:05.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.814+0000 7f8890fa9640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 0x7f887006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.815+0000 7f8890fa9640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 0x7f887006e890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f888c165090 tx=0x7f887c007c00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:05.818+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f888807af10 con 0x7f888c0cf1f0 2024-09-15T22:46:06.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.009+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol38420", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) -- 0x7f888c0cffc0 con 0x7f887006c3d0 2024-09-15T22:46:06.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.031+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f888c0cffc0 con 0x7f887006c3d0 2024-09-15T22:46:06.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 msgr2=0x7f887006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 0x7f887006e890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f888c165090 tx=0x7f887c007c00 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 msgr2=0x7f888c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f88880097a0 tx=0x7f88880046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8881ffb640 1 -- 172.21.15.134:0/1665733837 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 16) ==== 90999+0+0 (secure 0 0 0) 0x7f8888076e80 con 0x7f888c0cf1f0 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 shutdown_connections 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f888c1552b0 0x7f888c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f888c154ed0 0x7f888c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f887006c3d0 0x7f887006e890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 --2- 172.21.15.134:0/1665733837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f888c0cf1f0 0x7f888c152300 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.035+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 >> 172.21.15.134:0/1665733837 conn(0x7f888c062a80 msgr2=0x7f888c15ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.036+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 shutdown_connections 2024-09-15T22:46:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.036+0000 7f8893a0e640 1 -- 172.21.15.134:0/1665733837 wait complete. 2024-09-15T22:46:06.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38420 2024-09-15T22:46:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.147+0000 7fce19f3a640 1 Processor -- start 2024-09-15T22:46:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.147+0000 7fce19f3a640 1 -- start start 2024-09-15T22:46:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce19f3a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fce140b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce19f3a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce140cf9a0 con 0x7fce14161e30 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce19f3a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce14162210 con 0x7fce140b3d50 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce19f3a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fce140cfcf0 con 0x7fce1406dfd0 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce137fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fce14161e30 0x7fce140d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43994/0 (socket says 172.21.15.134:43994) 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.148+0000 7fce137fe640 1 -- 172.21.15.134:0/1380787059 learned_addr learned my addr 172.21.15.134:0/1380787059 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce13fff640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fce140b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590165985 0 0) 0x7fce140cf9a0 con 0x7fce14161e30 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdfc003520 con 0x7fce14161e30 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3620904435 0 0) 0x7fcdfc003520 con 0x7fce14161e30 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 msgr2=0x7fce140b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fce140b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 >> v1:172.21.15.177:6789/0 conn(0x7fce140b3d50 legacy=0x7fce1406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce140d5210 con 0x7fce14161e30 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fce04001690 con 0x7fce14161e30 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 >> v1:172.21.15.134:6789/0 conn(0x7fce14161e30 legacy=0x7fce140d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fcdfc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdfc004390 0x7fcdfc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fcdfc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce140cfcf0 con 0x7fcdfc0039e0 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc00b9f0 con 0x7fcdfc004390 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcdfc00bbf0 con 0x7fce1406dfd0 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fcdfc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdfc004390 0x7fcdfc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce13fff640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fcdfc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 -- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 msgr2=0x7fcdfc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1406dfd0 0x7fcdfc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 -- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdfc004390 msgr2=0x7fcdfc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdfc004390 0x7fcdfc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce137fe640 1 -- 172.21.15.134:0/1380787059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc003520 con 0x7fcdfc0039e0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.149+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdfc004390 0x7fcdfc004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.150+0000 7fce137fe640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fcdfc003dc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c210 tx=0x7fcdfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5477f20fcbc7045 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.150+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04007d60 con 0x7fcdfc0039e0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.150+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04005af0 con 0x7fcdfc0039e0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.150+0000 7fce127fc640 1 -- 172.21.15.134:0/1380787059 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04007070 con 0x7fcdfc0039e0 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 -- 172.21.15.134:0/1380787059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 msgr2=0x7fcdfc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1380787059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fcdfc003dc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c210 tx=0x7fcdfc005830 comp rx=0 tx=0).stop 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce13fff640 1 -- 172.21.15.134:0/1380787059 reap_dead start 2024-09-15T22:46:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 -- 172.21.15.134:0/1380787059 shutdown_connections 2024-09-15T22:46:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 -- 172.21.15.134:0/1380787059 >> 172.21.15.134:0/1380787059 conn(0x7fce140d1870 msgr2=0x7fce140d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 -- 172.21.15.134:0/1380787059 shutdown_connections 2024-09-15T22:46:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.151+0000 7fce19f3a640 1 -- 172.21.15.134:0/1380787059 wait complete. 2024-09-15T22:46:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.152+0000 7fce19f3a640 1 Processor -- start 2024-09-15T22:46:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.152+0000 7fce19f3a640 1 -- start start 2024-09-15T22:46:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 0x7fce141549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce140b9a10 0x7fce140b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce140b3290 con 0x7fcdfc0039e0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fce140b3950 con 0x7fce140b9a10 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce19f3a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fce140b3410 con 0x7fce1415bdb0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50666/0 (socket says 172.21.15.134:50666) 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 -- 172.21.15.134:0/1181613229 learned_addr learned my addr 172.21.15.134:0/1181613229 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce13fff640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce140b9a10 0x7fce140b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 0x7fce141549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 -- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 msgr2=0x7fce141549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 0x7fce141549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 -- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce140b9a10 msgr2=0x7fce140b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce140b9a10 0x7fce140b9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 -- 172.21.15.134:0/1181613229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce14156060 con 0x7fcdfc0039e0 2024-09-15T22:46:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 0x7fce141549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fce137fe640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fce0402ae20 tx=0x7fce04001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.153+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04042020 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.154+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04000ed0 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.154+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce14156340 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.154+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04004e30 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.154+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce14156900 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.154+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce140ba3d0 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.155+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 90999+0+0 (secure 0 0 0) 0x7fce04045020 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.155+0000 7fcdfbfff640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 0x7fce0006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.155+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fce040abd80 con 0x7fcdfc0039e0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.156+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 0x7fce0006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.156+0000 7fce12ffd640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 0x7fce0006e950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce141558f0 tx=0x7fce08009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.160+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce0407a270 con 0x7fcdfc0039e0 2024-09-15T22:46:06.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.350+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7fce14156b00 con 0x7fce0006c490 2024-09-15T22:46:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.376+0000 7fcdfbfff640 1 -- 172.21.15.134:0/1181613229 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fce14156b00 con 0x7fce0006c490 2024-09-15T22:46:06.377 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 msgr2=0x7fce0006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 0x7fce0006e950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce141558f0 tx=0x7fce08009040 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 msgr2=0x7fce14155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fce0402ae20 tx=0x7fce04001a60 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 shutdown_connections 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce140b9a10 0x7fce140b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce1415bdb0 0x7fce141549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fce0006c490 0x7fce0006e950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 --2- 172.21.15.134:0/1181613229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdfc0039e0 0x7fce14155a80 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 >> 172.21.15.134:0/1181613229 conn(0x7fce140d1870 msgr2=0x7fce140cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 shutdown_connections 2024-09-15T22:46:06.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:06.378+0000 7fce19f3a640 1 -- 172.21.15.134:0/1181613229 wait complete. 2024-09-15T22:46:06.390 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol38420 with 8 files each 1MB size under directory volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54 2024-09-15T22:46:06.390 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.391 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:06.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:06.406 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:06.478 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:06.479 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:06.479 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128453 s, 81.6 MB/s 2024-09-15T22:46:06.479 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.479 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:06.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:06.536 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:06.600 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:06.601 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:06.601 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889015 s, 118 MB/s 2024-09-15T22:46:06.602 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.602 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:06.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:06.660 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:06.725 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:06.725 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:06.725 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973499 s, 108 MB/s 2024-09-15T22:46:06.726 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.726 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:06.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:06.782 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:06.847 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:06.847 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:06.847 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846574 s, 124 MB/s 2024-09-15T22:46:06.847 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.848 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:06.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:06.904 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:06.968 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:06.969 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:06.969 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849156 s, 123 MB/s 2024-09-15T22:46:06.970 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:06.970 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:07.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:07.026 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:07.092 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:07.093 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:07.093 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962837 s, 109 MB/s 2024-09-15T22:46:07.093 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:07.093 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:07.149 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:07.214 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:07.215 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:07.215 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999224 s, 105 MB/s 2024-09-15T22:46:07.216 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:07.216 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:07.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:07.273 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:46:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-15T22:46:07.336 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-15T22:46:07.336 INFO:teuthology.orchestra.run.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737615 s, 142 MB/s 2024-09-15T22:46:07.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol38420 subvol_snap84630 2024-09-15T22:46:07.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.478+0000 7fd089f8f640 1 Processor -- start 2024-09-15T22:46:07.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.478+0000 7fd089f8f640 1 -- start start 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd089f8f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0840b5630 0x7fd08406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd089f8f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd089f8f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0840b0470 con 0x7fd08415c4b0 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd089f8f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd0840cdc10 con 0x7fd0840b5630 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd089f8f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840cdef0 con 0x7fd0840b5c10 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd083fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd082ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0840b5630 0x7fd08406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd0837fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd08415c4b0 0x7fd0840b4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:42416/0 (socket says 172.21.15.134:42416) 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd0837fe640 1 -- 172.21.15.134:0/1867761105 learned_addr learned my addr 172.21.15.134:0/1867761105 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd082ffd640 1 -- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 msgr2=0x7fd08406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:07.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd082ffd640 1 --2- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd082ffd640 1 -- 172.21.15.134:0/1867761105 >> v1:172.21.15.177:6789/0 conn(0x7fd08415c4b0 legacy=0x7fd0840b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.479+0000 7fd082ffd640 1 -- 172.21.15.134:0/1867761105 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0840ce1d0 con 0x7fd0840b5630 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.480+0000 7fd082ffd640 1 --2- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd08406de50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097a0 tx=0x7fd07402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3567a8577b5766b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.480+0000 7fd0827fc640 1 -- 172.21.15.134:0/1867761105 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074037070 con 0x7fd0840b5630 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.480+0000 7fd0827fc640 1 -- 172.21.15.134:0/1867761105 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd074032440 con 0x7fd0840b5630 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.480+0000 7fd0827fc640 1 -- 172.21.15.134:0/1867761105 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074032810 con 0x7fd0840b5630 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 -- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 msgr2=0x7fd08406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 --2- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd08406de50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097a0 tx=0x7fd07402a180 comp rx=0 tx=0).stop 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 -- 172.21.15.134:0/1867761105 shutdown_connections 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 --2- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 --2- 172.21.15.134:0/1867761105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd08406de50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 -- 172.21.15.134:0/1867761105 >> 172.21.15.134:0/1867761105 conn(0x7fd08406c9f0 msgr2=0x7fd08406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:07.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 -- 172.21.15.134:0/1867761105 shutdown_connections 2024-09-15T22:46:07.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.481+0000 7fd089f8f640 1 -- 172.21.15.134:0/1867761105 wait complete. 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.482+0000 7fd089f8f640 1 Processor -- start 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.482+0000 7fd089f8f640 1 -- start start 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd084157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0840ce790 con 0x7fd08415c4b0 2024-09-15T22:46:07.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd08415c890 con 0x7fd0840b5630 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd089f8f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840ce910 con 0x7fd0840b5c10 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43586/0 (socket says 172.21.15.134:43586) 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 -- 172.21.15.134:0/2036677309 learned_addr learned my addr 172.21.15.134:0/2036677309 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd0837fe640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd084157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd082ffd640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 -- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 msgr2=0x7fd08415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.483+0000 7fd083fff640 1 -- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 msgr2=0x7fd084157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd083fff640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd084157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd083fff640 1 -- 172.21.15.134:0/2036677309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0841527e0 con 0x7fd08415c4b0 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd083fff640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00efc0 tx=0x7fd07c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c018020 con 0x7fd08415c4b0 2024-09-15T22:46:07.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c014480 con 0x7fd08415c4b0 2024-09-15T22:46:07.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c014870 con 0x7fd08415c4b0 2024-09-15T22:46:07.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd084145050 con 0x7fd08415c4b0 2024-09-15T22:46:07.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.484+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd084142760 con 0x7fd08415c4b0 2024-09-15T22:46:07.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.485+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0840d0820 con 0x7fd08415c4b0 2024-09-15T22:46:07.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.485+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 90999+0+0 (secure 0 0 0) 0x7fd07c005d10 con 0x7fd08415c4b0 2024-09-15T22:46:07.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.486+0000 7fd07bfff640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 0x7fd06406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.486+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd07c08c5e0 con 0x7fd08415c4b0 2024-09-15T22:46:07.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.486+0000 7fd0837fe640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 0x7fd06406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.486+0000 7fd0837fe640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 0x7fd06406e920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd06c007fd0 tx=0x7fd06c007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.490+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd07c022030 con 0x7fd08415c4b0 2024-09-15T22:46:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.682+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "subvol_snap84630", "target": ["mon-mgr", ""]}) -- 0x7fd08415a480 con 0x7fd06406c460 2024-09-15T22:46:07.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.709+0000 7fd07bfff640 1 -- 172.21.15.134:0/2036677309 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd08415a480 con 0x7fd06406c460 2024-09-15T22:46:07.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 msgr2=0x7fd06406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 0x7fd06406e920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd06c007fd0 tx=0x7fd06c007e80 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 msgr2=0x7fd0841600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00efc0 tx=0x7fd07c00c490 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 shutdown_connections 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd06406c460 0x7fd06406e920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd08415c4b0 0x7fd0841600a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0840b5c10 0x7fd08415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 --2- 172.21.15.134:0/2036677309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0840b5630 0x7fd084157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 >> 172.21.15.134:0/2036677309 conn(0x7fd08406c9f0 msgr2=0x7fd08415b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 shutdown_connections 2024-09-15T22:46:07.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.712+0000 7fd089f8f640 1 -- 172.21.15.134:0/2036677309 wait complete. 2024-09-15T22:46:07.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol38420 subvol_snap84630 subvol_clone70620 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.828+0000 7f1fe0e53640 1 Processor -- start 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.828+0000 7f1fe0e53640 1 -- start start 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fe0e53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1fdc15b370 0x7f1fdc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fe0e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 0x7f1fdc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fe0e53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc15c970 con 0x7f1fdc06ef60 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fe0e53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1fdc15fef0 con 0x7f1fdc15b370 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fe0e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc15bbb0 con 0x7f1fdc15f9f0 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fd9d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 0x7f1fdc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fda59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1fdc15b370 0x7f1fdc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fdad9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1fdc06ef60 0x7f1fdc071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:42424/0 (socket says 172.21.15.134:42424) 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fdad9d640 1 -- 172.21.15.134:0/3661614078 learned_addr learned my addr 172.21.15.134:0/3661614078 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fda59c640 1 -- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 msgr2=0x7f1fdc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fda59c640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 0x7f1fdc06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fda59c640 1 -- 172.21.15.134:0/3661614078 >> v1:172.21.15.177:6789/0 conn(0x7f1fdc06ef60 legacy=0x7f1fdc071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fda59c640 1 -- 172.21.15.134:0/3661614078 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc15be90 con 0x7f1fdc15b370 2024-09-15T22:46:07.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.829+0000 7f1fd9d9b640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 0x7f1fdc06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:07.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.830+0000 7f1fda59c640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15b370 0x7f1fdc072560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097a0 tx=0x7f1fcc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4151c9f0bbfbba9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.830+0000 7f1fd959a640 1 -- 172.21.15.134:0/3661614078 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc037070 con 0x7f1fdc15b370 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.830+0000 7f1fd959a640 1 -- 172.21.15.134:0/3661614078 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc02ae50 con 0x7f1fdc15b370 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.830+0000 7f1fd959a640 1 -- 172.21.15.134:0/3661614078 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc032660 con 0x7f1fdc15b370 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 -- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15b370 msgr2=0x7f1fdc072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15b370 0x7f1fdc072560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097a0 tx=0x7f1fcc02a100 comp rx=0 tx=0).stop 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 -- 172.21.15.134:0/3661614078 shutdown_connections 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15f9f0 0x7f1fdc06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/3661614078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15b370 0x7f1fdc072560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 -- 172.21.15.134:0/3661614078 >> 172.21.15.134:0/3661614078 conn(0x7f1fdc06bba0 msgr2=0x7f1fdc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 -- 172.21.15.134:0/3661614078 shutdown_connections 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.831+0000 7f1fe0e53640 1 -- 172.21.15.134:0/3661614078 wait complete. 2024-09-15T22:46:07.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.832+0000 7f1fe0e53640 1 Processor -- start 2024-09-15T22:46:07.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.832+0000 7f1fe0e53640 1 -- start start 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15b370 0x7f1fdc0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15f9f0 0x7f1fdc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc0731b0 con 0x7f1fdc06ef60 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc15c450 con 0x7f1fdc15f9f0 2024-09-15T22:46:07.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fe0e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc0cf4a0 con 0x7f1fdc15b370 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43588/0 (socket says 172.21.15.134:43588) 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 -- 172.21.15.134:0/249574010 learned_addr learned my addr 172.21.15.134:0/249574010 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fdad9d640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15f9f0 0x7f1fdc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fd9d9b640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15b370 0x7f1fdc0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 -- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15b370 msgr2=0x7f1fdc0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15b370 0x7f1fdc0c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 -- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15f9f0 msgr2=0x7f1fdc0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15f9f0 0x7f1fdc0c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.833+0000 7f1fda59c640 1 -- 172.21.15.134:0/249574010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc1f8220 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fda59c640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc02a140 tx=0x7f1fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc041070 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc03c670 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc1f41c0 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc037040 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.834+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc1f4780 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.835+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fdc1f3fb0 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.835+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 90999+0+0 (secure 0 0 0) 0x7f1fcc044070 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.836+0000 7f1fcaffd640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 0x7f1fbc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.836+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f1fcc0abdb0 con 0x7f1fdc06ef60 2024-09-15T22:46:07.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.836+0000 7f1fd9d9b640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 0x7f1fbc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:07.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.837+0000 7f1fd9d9b640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 0x7f1fbc06e920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc072560 tx=0x7f1fd0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:07.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:07.840+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fcc07a2a0 con 0x7f1fdc06ef60 2024-09-15T22:46:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.036+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "subvol_snap84630", "target_sub_name": "subvol_clone70620", "target": ["mon-mgr", ""]}) -- 0x7f1fdc15b750 con 0x7f1fbc06c460 2024-09-15T22:46:08.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.108+0000 7f1fcaffd640 1 -- 172.21.15.134:0/249574010 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1fdc15b750 con 0x7f1fbc06c460 2024-09-15T22:46:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 msgr2=0x7f1fbc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 0x7f1fbc06e920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc072560 tx=0x7f1fd0008040 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 msgr2=0x7f1fdc14bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc02a140 tx=0x7f1fcc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 shutdown_connections 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fdc15f9f0 0x7f1fdc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fdc15b370 0x7f1fdc0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1fbc06c460 0x7f1fbc06e920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 --2- 172.21.15.134:0/249574010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc06ef60 0x7f1fdc14bd30 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 >> 172.21.15.134:0/249574010 conn(0x7f1fdc06bba0 msgr2=0x7f1fdc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 shutdown_connections 2024-09-15T22:46:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.110+0000 7f1fe0e53640 1 -- 172.21.15.134:0/249574010 wait complete. 2024-09-15T22:46:08.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.112+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.112+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.112+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.112+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.112+0000 7f458e48e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone70620 2024-09-15T22:46:08.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.124+0000 7f458cc8b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.124+0000 7f458cc8b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.124+0000 7f458cc8b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.124+0000 7f458cc8b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:08.124+0000 7f458cc8b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:08.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.234+0000 7f8baf2d7640 1 Processor -- start 2024-09-15T22:46:08.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.234+0000 7f8baf2d7640 1 -- start start 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8baf2d7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ba8073150 0x7f8ba80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8baf2d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba80b7190 0x7f8ba806e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8baf2d7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba806d130 con 0x7f8ba815e860 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8baf2d7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba806d410 con 0x7f8ba8073150 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8baf2d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba806d6f0 con 0x7f8ba80b7190 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8bac872640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ba8073150 0x7f8ba80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8bac872640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ba8073150 0x7f8ba80b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43590/0 (socket says 172.21.15.134:43590) 2024-09-15T22:46:08.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8bac872640 1 -- 172.21.15.134:0/669030502 learned_addr learned my addr 172.21.15.134:0/669030502 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:08.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.235+0000 7f8bad874640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba80b7190 0x7f8ba806e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8bac872640 1 -- 172.21.15.134:0/669030502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba80b7190 msgr2=0x7f8ba806e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:08.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8bac872640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba80b7190 0x7f8ba806e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8bac872640 1 -- 172.21.15.134:0/669030502 >> v1:172.21.15.177:6789/0 conn(0x7f8ba815e860 legacy=0x7f8ba815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8bac872640 1 -- 172.21.15.134:0/669030502 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba806d9d0 con 0x7f8ba8073150 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8bac872640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba8073150 0x7f8ba80b6c50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14bf2cbfd35459c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8b9ffff640 1 -- 172.21.15.134:0/669030502 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98037070 con 0x7f8ba8073150 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8b9ffff640 1 -- 172.21.15.134:0/669030502 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b98032440 con 0x7f8ba8073150 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.236+0000 7f8b9ffff640 1 -- 172.21.15.134:0/669030502 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98032810 con 0x7f8ba8073150 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 -- 172.21.15.134:0/669030502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba8073150 msgr2=0x7f8ba80b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba8073150 0x7f8ba80b6c50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802a270 comp rx=0 tx=0).stop 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 -- 172.21.15.134:0/669030502 shutdown_connections 2024-09-15T22:46:08.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba80b7190 0x7f8ba806e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/669030502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba8073150 0x7f8ba80b6c50 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 -- 172.21.15.134:0/669030502 >> 172.21.15.134:0/669030502 conn(0x7f8ba80b4290 msgr2=0x7f8ba80b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:08.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 -- 172.21.15.134:0/669030502 shutdown_connections 2024-09-15T22:46:08.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.237+0000 7f8baf2d7640 1 -- 172.21.15.134:0/669030502 wait complete. 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.238+0000 7f8baf2d7640 1 Processor -- start 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.238+0000 7f8baf2d7640 1 -- start start 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.239+0000 7f8baf2d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba8073150 0x7f8ba814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.239+0000 7f8baf2d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ba80b7190 0x7f8ba81482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.239+0000 7f8baf2d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.239+0000 7f8baf2d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba806cd50 con 0x7f8ba815e860 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.239+0000 7f8baf2d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80b7620 con 0x7f8ba80b7190 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8baf2d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba806ced0 con 0x7f8ba8073150 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43602/0 (socket says 172.21.15.134:43602) 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 -- 172.21.15.134:0/1048794270 learned_addr learned my addr 172.21.15.134:0/1048794270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:08.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bac872640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ba80b7190 0x7f8ba81482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad073640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba8073150 0x7f8ba814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 -- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba8073150 msgr2=0x7f8ba814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba8073150 0x7f8ba814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 -- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ba80b7190 msgr2=0x7f8ba81482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ba80b7190 0x7f8ba81482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 -- 172.21.15.134:0/1048794270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba8148810 con 0x7f8ba815e860 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8bad874640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000efc0 tx=0x7f8ba000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0018020 con 0x7f8ba815e860 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba8148b80 con 0x7f8ba815e860 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0014480 con 0x7f8ba815e860 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.240+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0014870 con 0x7f8ba815e860 2024-09-15T22:46:08.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.241+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba8149140 con 0x7f8ba815e860 2024-09-15T22:46:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.242+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba80b6c50 con 0x7f8ba815e860 2024-09-15T22:46:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.242+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 90999+0+0 (secure 0 0 0) 0x7f8ba0005d10 con 0x7f8ba815e860 2024-09-15T22:46:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.243+0000 7f8b9dffb640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 0x7f8b8c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.243+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba008c290 con 0x7f8ba815e860 2024-09-15T22:46:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.243+0000 7f8bad073640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 0x7f8b8c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.244+0000 7f8bad073640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 0x7f8b8c06e920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40016e0 tx=0x7f8ba4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.247+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ba0022070 con 0x7f8ba815e860 2024-09-15T22:46:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:08.469+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone70620", "target": ["mon-mgr", ""]}) -- 0x7f8ba806e450 con 0x7f8b8c06c460 2024-09-15T22:46:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.052+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f8ba001b020 con 0x7f8ba815e860 2024-09-15T22:46:10.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.916+0000 7f8b9dffb640 1 -- 172.21.15.134:0/1048794270 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f8ba806e450 con 0x7f8b8c06c460 2024-09-15T22:46:10.917 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "status": { 2024-09-15T22:46:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "complete" 2024-09-15T22:46:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:10.918 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 msgr2=0x7f8b8c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 0x7f8b8c06e920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40016e0 tx=0x7f8ba4009040 comp rx=0 tx=0).stop 2024-09-15T22:46:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 msgr2=0x7f8ba80d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000efc0 tx=0x7f8ba000c490 comp rx=0 tx=0).stop 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 shutdown_connections 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8b8c06c460 0x7f8b8c06e920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ba815e860 0x7f8ba80d10d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ba80b7190 0x7f8ba81482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 --2- 172.21.15.134:0/1048794270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ba8073150 0x7f8ba814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 >> 172.21.15.134:0/1048794270 conn(0x7f8ba80b4290 msgr2=0x7f8ba8158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 shutdown_connections 2024-09-15T22:46:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:10.919+0000 7f8baf2d7640 1 -- 172.21.15.134:0/1048794270 wait complete. 2024-09-15T22:46:10.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:10.934 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone70620/.meta) 2024-09-15T22:46:10.963 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:10.963 INFO:teuthology.orchestra.run.smithi134.stdout:version = 2 2024-09-15T22:46:10.963 INFO:teuthology.orchestra.run.smithi134.stdout:type = clone 2024-09-15T22:46:10.964 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd 2024-09-15T22:46:10.964 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:46:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:10.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38420 2024-09-15T22:46:11.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.110+0000 7f90dabd6640 1 Processor -- start 2024-09-15T22:46:11.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.110+0000 7f90dabd6640 1 -- start start 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90dabd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90d40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90dabd6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d4148400 con 0x7f90d40b0b30 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90dabd6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d40b53e0 con 0x7f90d4148020 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90dabd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90d40b5ff0 con 0x7f90d40ae8e0 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90d3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f90d40b0b30 0x7f90d40b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:59708/0 (socket says 172.21.15.134:59708) 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90d3fff640 1 -- 172.21.15.134:0/3283373695 learned_addr learned my addr 172.21.15.134:0/3283373695 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310633256 0 0) 0x7f90d4148400 con 0x7f90d40b0b30 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.111+0000 7f90d9173640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90d40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90bc003520 con 0x7f90d40b0b30 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1341821891 0 0) 0x7f90bc003520 con 0x7f90d40b0b30 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 msgr2=0x7f90d40aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90d40aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 >> v1:172.21.15.177:6789/0 conn(0x7f90d4148020 legacy=0x7f90d40b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d40b56c0 con 0x7f90d40b0b30 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f90c8001a10 con 0x7f90d40b0b30 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 >> v1:172.21.15.134:6789/0 conn(0x7f90d40b0b30 legacy=0x7f90d40b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0039e0 0x7f90bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc004800 0x7f90bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90d40b5ff0 con 0x7f90bc004800 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc00baa0 con 0x7f90bc0039e0 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc00bca0 con 0x7f90d40ae8e0 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc004800 0x7f90bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d8972640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0039e0 0x7f90bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d9173640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 -- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 msgr2=0x7f90bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d40ae8e0 0x7f90bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 -- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0039e0 msgr2=0x7f90bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0039e0 0x7f90bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.112+0000 7f90d3fff640 1 -- 172.21.15.134:0/3283373695 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc003520 con 0x7f90bc004800 2024-09-15T22:46:11.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.113+0000 7f90d3fff640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc004800 0x7f90bc004c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f90d40733d0 tx=0x7f90bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121f62eeccb33a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.113+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c800a480 con 0x7f90bc004800 2024-09-15T22:46:11.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.113+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c802f070 con 0x7f90bc004800 2024-09-15T22:46:11.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.113+0000 7f90d37fe640 1 -- 172.21.15.134:0/3283373695 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c802bc50 con 0x7f90bc004800 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 -- 172.21.15.134:0/3283373695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc004800 msgr2=0x7f90bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 --2- 172.21.15.134:0/3283373695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc004800 0x7f90bc004c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f90d40733d0 tx=0x7f90bc005830 comp rx=0 tx=0).stop 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90d9173640 1 -- 172.21.15.134:0/3283373695 reap_dead start 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 -- 172.21.15.134:0/3283373695 shutdown_connections 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 -- 172.21.15.134:0/3283373695 >> 172.21.15.134:0/3283373695 conn(0x7f90d406d0d0 msgr2=0x7f90d406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 -- 172.21.15.134:0/3283373695 shutdown_connections 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.114+0000 7f90dabd6640 1 -- 172.21.15.134:0/3283373695 wait complete. 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.115+0000 7f90dabd6640 1 Processor -- start 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.115+0000 7f90dabd6640 1 -- start start 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90bc004800 0x7f90d415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d415cf50 0x7f90d413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90d40aed10 con 0x7f90d4144230 2024-09-15T22:46:11.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90d40b5c80 con 0x7f90d415cf50 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90d40aee90 con 0x7f90bc004800 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43622/0 (socket says 172.21.15.134:43622) 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 -- 172.21.15.134:0/2975366981 learned_addr learned my addr 172.21.15.134:0/2975366981 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d9173640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d415cf50 0x7f90d413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d8972640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90bc004800 0x7f90d415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 -- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90bc004800 msgr2=0x7f90d415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90bc004800 0x7f90d415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 -- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d415cf50 msgr2=0x7f90d413e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d415cf50 0x7f90d413e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 -- 172.21.15.134:0/2975366981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d413ce20 con 0x7f90d4144230 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d3fff640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a920 tx=0x7f90d41485d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c800a480 con 0x7f90d4144230 2024-09-15T22:46:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8004d60 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d413d100 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.116+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8001fd0 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.117+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d413d6c0 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.118+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d415d330 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.118+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f90c8034690 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.118+0000 7f90d17fa640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 0x7f90c006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.119+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f90c80ab9b0 con 0x7f90d4144230 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.119+0000 7f90d8972640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 0x7f90c006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.119+0000 7f90d8972640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 0x7f90c006ea70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90c40017e0 tx=0x7f90c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.123+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90c80798d0 con 0x7f90d4144230 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.316+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7f90d40d1030 con 0x7f90c006c5b0 2024-09-15T22:46:11.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.332+0000 7f90d17fa640 1 -- 172.21.15.134:0/2975366981 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f90d40d1030 con 0x7f90c006c5b0 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.334+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 msgr2=0x7f90c006ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 0x7f90c006ea70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90c40017e0 tx=0x7f90c4009040 comp rx=0 tx=0).stop 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 msgr2=0x7f90d415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a920 tx=0x7f90d41485d0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 shutdown_connections 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d415cf50 0x7f90d413e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c5b0 0x7f90c006ea70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d4144230 0x7f90d415ca10 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 --2- 172.21.15.134:0/2975366981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90bc004800 0x7f90d415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 >> 172.21.15.134:0/2975366981 conn(0x7f90d406d0d0 msgr2=0x7f90d406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 shutdown_connections 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.335+0000 7f90dabd6640 1 -- 172.21.15.134:0/2975366981 wait complete. 2024-09-15T22:46:11.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone70620 2024-09-15T22:46:11.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.447+0000 7f37f0718640 1 Processor -- start 2024-09-15T22:46:11.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.448+0000 7f37f0718640 1 -- start start 2024-09-15T22:46:11.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.448+0000 7f37f0718640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37e80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.448+0000 7f37f0718640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e80cf9a0 con 0x7f37e80b3d50 2024-09-15T22:46:11.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37f0718640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e8162210 con 0x7f37e8161e30 2024-09-15T22:46:11.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37f0718640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f37e80cfcf0 con 0x7f37e806dfd0 2024-09-15T22:46:11.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37edcb3640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f37e80b3d50 0x7f37e806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:59724/0 (socket says 172.21.15.134:59724) 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37edcb3640 1 -- 172.21.15.134:0/665197765 learned_addr learned my addr 172.21.15.134:0/665197765 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37eecb5640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37e80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918353328 0 0) 0x7f37e80cf9a0 con 0x7f37e80b3d50 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d4003520 con 0x7f37e80b3d50 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3605111964 0 0) 0x7f37d4003520 con 0x7f37e80b3d50 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 msgr2=0x7f37e80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37e80b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 >> v1:172.21.15.177:6789/0 conn(0x7f37e8161e30 legacy=0x7f37e80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e80d5210 con 0x7f37e80b3d50 2024-09-15T22:46:11.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f37d8001690 con 0x7f37e80b3d50 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 >> v1:172.21.15.134:6789/0 conn(0x7f37e80b3d50 legacy=0x7f37e806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37d4003f60 0x7f37d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d4004d40 0x7f37d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80cfcf0 con 0x7f37d4004d40 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37d400baa0 con 0x7f37d4003f60 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f37d400bca0 con 0x7f37e806dfd0 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37eecb5640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d4004d40 0x7f37d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37ee4b4640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.449+0000 7f37edcb3640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37d4003f60 0x7f37d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 -- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 msgr2=0x7f37d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37e806dfd0 0x7f37d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 -- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37d4003f60 msgr2=0x7f37d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37d4003f60 0x7f37d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 -- 172.21.15.134:0/665197765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d4003520 con 0x7f37d4004d40 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37edcb3640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37d4003f60 0x7f37d4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37eecb5640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d4004d40 0x7f37d40051c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009f90 tx=0x7f37d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e44c81c924a2717 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0009c10 con 0x7f37d4004d40 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e0036070 con 0x7f37d4004d40 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.450+0000 7f37ed4b2640 1 -- 172.21.15.134:0/665197765 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0031850 con 0x7f37d4004d40 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 -- 172.21.15.134:0/665197765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d4004d40 msgr2=0x7f37d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 --2- 172.21.15.134:0/665197765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d4004d40 0x7f37d40051c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009f90 tx=0x7f37d4005830 comp rx=0 tx=0).stop 2024-09-15T22:46:11.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37eecb5640 1 -- 172.21.15.134:0/665197765 reap_dead start 2024-09-15T22:46:11.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 -- 172.21.15.134:0/665197765 shutdown_connections 2024-09-15T22:46:11.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 -- 172.21.15.134:0/665197765 >> 172.21.15.134:0/665197765 conn(0x7f37e80d1870 msgr2=0x7f37e80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 -- 172.21.15.134:0/665197765 shutdown_connections 2024-09-15T22:46:11.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.451+0000 7f37f0718640 1 -- 172.21.15.134:0/665197765 wait complete. 2024-09-15T22:46:11.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.452+0000 7f37f0718640 1 Processor -- start 2024-09-15T22:46:11.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.452+0000 7f37f0718640 1 -- start start 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 0x7f37e815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e81f4cf0 0x7f37e8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80b3290 con 0x7f37e81604e0 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80b3950 con 0x7f37e81f4cf0 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37f0718640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f37e80b3410 con 0x7f37d4004d40 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43636/0 (socket says 172.21.15.134:43636) 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 -- 172.21.15.134:0/2078262709 learned_addr learned my addr 172.21.15.134:0/2078262709 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:11.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37ee4b4640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 0x7f37e815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37eecb5640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e81f4cf0 0x7f37e8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 -- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 msgr2=0x7f37e815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 0x7f37e815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 -- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e81f4cf0 msgr2=0x7f37e8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e81f4cf0 0x7f37e8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37edcb3640 1 -- 172.21.15.134:0/2078262709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e81467c0 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.453+0000 7f37ee4b4640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 0x7f37e815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37edcb3640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000ff0 tx=0x7f37d800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800c870 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8018070 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e8146aa0 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800cc10 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.454+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e8147060 con 0x7f37e81604e0 2024-09-15T22:46:11.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.455+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e806d8c0 con 0x7f37e81604e0 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.455+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f37d801d460 con 0x7f37e81604e0 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.456+0000 7f37deffd640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 0x7f37cc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.456+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f37d808b730 con 0x7f37e81604e0 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.456+0000 7f37ee4b4640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 0x7f37cc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.456+0000 7f37ee4b4640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 0x7f37cc06ea40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37e8160b40 tx=0x7f37e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.460+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37d8059b90 con 0x7f37e81604e0 2024-09-15T22:46:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.651+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone70620", "target": ["mon-mgr", ""]}) -- 0x7f37e8069190 con 0x7f37cc06c580 2024-09-15T22:46:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.658+0000 7f37deffd640 1 -- 172.21.15.134:0/2078262709 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7f37e8069190 con 0x7f37cc06c580 2024-09-15T22:46:11.659 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.659+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 msgr2=0x7f37cc06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.659+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 0x7f37cc06ea40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37e8160b40 tx=0x7f37e4009040 comp rx=0 tx=0).stop 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.659+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 msgr2=0x7f37e81f47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.659+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000ff0 tx=0x7f37d800ec60 comp rx=0 tx=0).stop 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 shutdown_connections 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e81f4cf0 0x7f37e8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f37cc06c580 0x7f37cc06ea40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e81604e0 0x7f37e81f47b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 --2- 172.21.15.134:0/2078262709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37d4004d40 0x7f37e815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 >> 172.21.15.134:0/2078262709 conn(0x7f37e80d1870 msgr2=0x7f37e80b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 shutdown_connections 2024-09-15T22:46:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.660+0000 7f37f0718640 1 -- 172.21.15.134:0/2078262709 wait complete. 2024-09-15T22:46:11.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:11.673 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:11.689 INFO:teuthology.orchestra.run.smithi134.stdout:9 2024-09-15T22:46:11.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:11.690 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd) 2024-09-15T22:46:11.746 INFO:teuthology.orchestra.run.smithi134.stdout:9 2024-09-15T22:46:11.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone70620 2024-09-15T22:46:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 Processor -- start 2024-09-15T22:46:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 -- start start 2024-09-15T22:46:11.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 0x7fd22806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd2280b3290 0x7fd22806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2280cf9a0 con 0x7fd228161e30 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd2280cfcf0 con 0x7fd2280b3290 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.887+0000 7fd22ec2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd228162210 con 0x7fd2280b3d50 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd2280b3290 0x7fd22806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd2280b3290 0x7fd22806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43650/0 (socket says 172.21.15.134:43650) 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 -- 172.21.15.134:0/4270837972 learned_addr learned my addr 172.21.15.134:0/4270837972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 -- 172.21.15.134:0/4270837972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 msgr2=0x7fd22806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd227fff640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 0x7fd22806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 0x7fd22806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 -- 172.21.15.134:0/4270837972 >> v1:172.21.15.177:6789/0 conn(0x7fd228161e30 legacy=0x7fd2280d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd22d1cb640 1 -- 172.21.15.134:0/4270837972 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2280d5210 con 0x7fd2280b3290 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.888+0000 7fd227fff640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 0x7fd22806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22d1cb640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2280b3290 0x7fd22806de00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e50 tx=0x7fd22002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d05d036bd45aad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd2277fe640 1 -- 172.21.15.134:0/4270837972 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220036070 con 0x7fd2280b3290 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd2277fe640 1 -- 172.21.15.134:0/4270837972 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd220031600 con 0x7fd2280b3290 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd2277fe640 1 -- 172.21.15.134:0/4270837972 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200319d0 con 0x7fd2280b3290 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 -- 172.21.15.134:0/4270837972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2280b3290 msgr2=0x7fd22806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2280b3290 0x7fd22806de00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e50 tx=0x7fd22002a6c0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 -- 172.21.15.134:0/4270837972 shutdown_connections 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2280b3290 0x7fd22806de00 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/4270837972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3d50 0x7fd22806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 -- 172.21.15.134:0/4270837972 >> 172.21.15.134:0/4270837972 conn(0x7fd2280d1870 msgr2=0x7fd2280d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 -- 172.21.15.134:0/4270837972 shutdown_connections 2024-09-15T22:46:11.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.889+0000 7fd22ec2e640 1 -- 172.21.15.134:0/4270837972 wait complete. 2024-09-15T22:46:11.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 Processor -- start 2024-09-15T22:46:11.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 -- start start 2024-09-15T22:46:11.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3290 0x7fd228154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2280b3d50 0x7fd2281f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2280b78b0 con 0x7fd228161e30 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2280b3950 con 0x7fd2280b3d50 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.891+0000 7fd22ec2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2280b7a30 con 0x7fd2280b3290 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43660/0 (socket says 172.21.15.134:43660) 2024-09-15T22:46:11.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 -- 172.21.15.134:0/3407208391 learned_addr learned my addr 172.21.15.134:0/3407208391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22c9ca640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3290 0x7fd228154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd227fff640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2280b3d50 0x7fd2281f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 -- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3290 msgr2=0x7fd228154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3290 0x7fd228154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 -- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2280b3d50 msgr2=0x7fd2281f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2280b3d50 0x7fd2281f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 -- 172.21.15.134:0/3407208391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22815a540 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22d1cb640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e50 tx=0x7fd220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220036050 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd220042070 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220009510 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22815a820 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.892+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd228161310 con 0x7fd228161e30 2024-09-15T22:46:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.893+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd228069190 con 0x7fd228161e30 2024-09-15T22:46:11.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.894+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7fd220007bf0 con 0x7fd228161e30 2024-09-15T22:46:11.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.894+0000 7fd2257fa640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 0x7fd20c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.894+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fd2200ac620 con 0x7fd228161e30 2024-09-15T22:46:11.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.894+0000 7fd22c9ca640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 0x7fd20c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.895+0000 7fd22c9ca640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 0x7fd20c06ea40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd21c006fd0 tx=0x7fd21c009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:11.898+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd22007a370 con 0x7fd228161e30 2024-09-15T22:46:12.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.092+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone70620", "target": ["mon-mgr", ""]}) -- 0x7fd2281f5a80 con 0x7fd20c06c580 2024-09-15T22:46:12.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.100+0000 7fd2257fa640 1 -- 172.21.15.134:0/3407208391 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+725 (secure 0 0 0) 0x7fd21c009550 con 0x7fd20c06c580 2024-09-15T22:46:12.101 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "atime": "2024-09-15 22:46:03", 2024-09-15T22:46:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_pcent": "80.00", 2024-09-15T22:46:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_quota": 10485760, 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "bytes_used": 8388608, 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "created_at": "2024-09-15 22:46:08", 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ctime": "2024-09-15 22:46:08", 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "data_pool": "cephfs_data", 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "features": [ 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-clone", 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-autoprotect", 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot-retention" 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flavor": 2, 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "gid": 1000, 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "mode": 16895, 2024-09-15T22:46:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_addrs": [ 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.134:6789", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6789", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "172.21.15.177:6790" 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "mtime": "2024-09-15 22:46:07", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "path": "/volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_namespace": "", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "complete", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "clone", 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "uid": 1000 2024-09-15T22:46:12.103 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:12.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 msgr2=0x7fd20c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 0x7fd20c06ea40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd21c006fd0 tx=0x7fd21c009060 comp rx=0 tx=0).stop 2024-09-15T22:46:12.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 msgr2=0x7fd2280cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e50 tx=0x7fd220004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 shutdown_connections 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20c06c580 0x7fd20c06ea40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd228161e30 0x7fd2280cc8e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2280b3d50 0x7fd2281f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 --2- 172.21.15.134:0/3407208391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2280b3290 0x7fd228154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 >> 172.21.15.134:0/3407208391 conn(0x7fd2280d1870 msgr2=0x7fd22806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 shutdown_connections 2024-09-15T22:46:12.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:12.102+0000 7fd22ec2e640 1 -- 172.21.15.134:0/3407208391 wait complete. 2024-09-15T22:46:12.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.114 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:46:12.130 INFO:teuthology.orchestra.run.smithi134.stderr:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630: ceph.quota.max_bytes: No such attribute 2024-09-15T22:46:12.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.131 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.187 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:46:12.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.187 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.243 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.299 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.2 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.5 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.4 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.7 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.6 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.0 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.3 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run.smithi134.stdout:volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.1 2024-09-15T22:46:12.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.300 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.355 INFO:teuthology.orchestra.run.smithi134.stdout:41ff 2024-09-15T22:46:12.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.356 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/) 2024-09-15T22:46:12.410 INFO:teuthology.orchestra.run.smithi134.stdout:41ff 2024-09-15T22:46:12.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.411 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.466 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.466 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/) 2024-09-15T22:46:12.521 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.522 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.577 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.577 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/) 2024-09-15T22:46:12.632 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.633 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630) 2024-09-15T22:46:12.688 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:12.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.689 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/) 2024-09-15T22:46:12.743 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:12.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.744 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.2) 2024-09-15T22:46:12.801 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:12.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.802 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.2) 2024-09-15T22:46:12.863 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:12.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.863 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.2) 2024-09-15T22:46:12.918 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.919 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.2) 2024-09-15T22:46:12.974 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:12.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:12.974 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.2) 2024-09-15T22:46:13.029 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.030 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.2) 2024-09-15T22:46:13.085 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.086 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.2) 2024-09-15T22:46:13.142 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:13.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.142 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.2) 2024-09-15T22:46:13.197 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:13.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.198 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.5) 2024-09-15T22:46:13.255 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.255 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.5) 2024-09-15T22:46:13.314 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:13.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.315 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.5) 2024-09-15T22:46:13.370 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:13.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.370 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.5) 2024-09-15T22:46:13.425 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:13.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.426 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.5) 2024-09-15T22:46:13.481 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.481 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.5) 2024-09-15T22:46:13.537 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.537 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.5) 2024-09-15T22:46:13.593 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:13.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.593 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.5) 2024-09-15T22:46:13.649 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:13.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.649 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.4) 2024-09-15T22:46:13.705 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:13.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.706 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.4) 2024-09-15T22:46:13.765 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:13.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.766 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.4) 2024-09-15T22:46:13.821 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:13.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.822 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.4) 2024-09-15T22:46:13.877 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:13.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.878 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.4) 2024-09-15T22:46:13.933 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.934 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.4) 2024-09-15T22:46:13.989 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:13.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:13.990 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.4) 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.046 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.4) 2024-09-15T22:46:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:14.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.102 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.7) 2024-09-15T22:46:14.159 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:14.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.160 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.7) 2024-09-15T22:46:14.217 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:14.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.218 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.7) 2024-09-15T22:46:14.274 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:14.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.274 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.7) 2024-09-15T22:46:14.329 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:14.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.330 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.7) 2024-09-15T22:46:14.385 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:14.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.386 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.7) 2024-09-15T22:46:14.441 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.441 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.7) 2024-09-15T22:46:14.497 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:14.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.497 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.7) 2024-09-15T22:46:14.553 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:14.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.553 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.6) 2024-09-15T22:46:14.609 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:14.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.609 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.6) 2024-09-15T22:46:14.665 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:14.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.665 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.6) 2024-09-15T22:46:14.720 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:14.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.721 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.6) 2024-09-15T22:46:14.776 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:14.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.777 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.6) 2024-09-15T22:46:14.832 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:14.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.833 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.6) 2024-09-15T22:46:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:14.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.889 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.6) 2024-09-15T22:46:14.948 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:14.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:14.948 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.6) 2024-09-15T22:46:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:1726440367 2024-09-15T22:46:15.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.004 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.0) 2024-09-15T22:46:15.060 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:15.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.061 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.0) 2024-09-15T22:46:15.116 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:15.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.116 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.0) 2024-09-15T22:46:15.171 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:15.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.172 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.0) 2024-09-15T22:46:15.227 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:15.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.227 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.0) 2024-09-15T22:46:15.283 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.283 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.0) 2024-09-15T22:46:15.338 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:15.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.338 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.0) 2024-09-15T22:46:15.396 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:15.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.396 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.0) 2024-09-15T22:46:15.451 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:15.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.452 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.3) 2024-09-15T22:46:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:15.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.509 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.3) 2024-09-15T22:46:15.565 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:15.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.565 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.3) 2024-09-15T22:46:15.620 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:15.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.621 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.3) 2024-09-15T22:46:15.676 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:15.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.677 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.3) 2024-09-15T22:46:15.732 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:15.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.733 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.3) 2024-09-15T22:46:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:15.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.788 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.3) 2024-09-15T22:46:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:15.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.846 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.3) 2024-09-15T22:46:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:15.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.905 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.1) 2024-09-15T22:46:15.961 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:15.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:15.962 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.1) 2024-09-15T22:46:16.018 INFO:teuthology.orchestra.run.smithi134.stdout:81a4 2024-09-15T22:46:16.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.019 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.1) 2024-09-15T22:46:16.073 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:16.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.074 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.1) 2024-09-15T22:46:16.129 INFO:teuthology.orchestra.run.smithi134.stdout:1000 2024-09-15T22:46:16.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.129 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.1) 2024-09-15T22:46:16.184 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:16.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.184 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.1) 2024-09-15T22:46:16.239 INFO:teuthology.orchestra.run.smithi134.stdout:1333 2024-09-15T22:46:16.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.240 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54/.snap/subvol_snap84630/subvolume_file.1) 2024-09-15T22:46:16.298 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:16.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:16.299 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone70620/74cf4187-3a9f-44a2-9781-212c04727bcd/subvolume_file.1) 2024-09-15T22:46:16.354 INFO:teuthology.orchestra.run.smithi134.stdout:1726440366 2024-09-15T22:46:16.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol38420 fake subvol_clone39651 2024-09-15T22:46:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 Processor -- start 2024-09-15T22:46:16.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 -- start start 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62200cf5d0 0x7f62200cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f622006d4f0 0x7f622006d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62200b4240 con 0x7f6220145d90 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f622006d080 con 0x7f62200cf5d0 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.498+0000 7f6225a47640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f62200b4520 con 0x7f622006d4f0 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621e7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62200cf5d0 0x7f62200cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6220145d90 0x7f62200ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54700/0 (socket says 172.21.15.134:54700) 2024-09-15T22:46:16.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621effd640 1 -- 172.21.15.134:0/2687660913 learned_addr learned my addr 172.21.15.134:0/2687660913 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621e7fc640 1 -- 172.21.15.134:0/2687660913 >> v2:172.21.15.177:3300/0 conn(0x7f622006d4f0 msgr2=0x7f622006d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621e7fc640 1 --2- 172.21.15.134:0/2687660913 >> v2:172.21.15.177:3300/0 conn(0x7f622006d4f0 0x7f622006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621e7fc640 1 -- 172.21.15.134:0/2687660913 >> v1:172.21.15.134:6789/0 conn(0x7f6220145d90 legacy=0x7f62200ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621e7fc640 1 -- 172.21.15.134:0/2687660913 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200b4800 con 0x7f62200cf5d0 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.499+0000 7f621dffb640 1 -- 172.21.15.134:0/2687660913 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390155723 0 0) 0x7f62200b4240 con 0x7f6220145d90 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f621e7fc640 1 --2- 172.21.15.134:0/2687660913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62200cf5d0 0x7f62200cfa40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6220161250 tx=0x7f621002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d6ef0880731e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f621dffb640 1 -- 172.21.15.134:0/2687660913 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f62200cf5d0 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f621dffb640 1 -- 172.21.15.134:0/2687660913 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210032440 con 0x7f62200cf5d0 2024-09-15T22:46:16.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f621dffb640 1 -- 172.21.15.134:0/2687660913 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210032810 con 0x7f62200cf5d0 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 -- 172.21.15.134:0/2687660913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62200cf5d0 msgr2=0x7f62200cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 --2- 172.21.15.134:0/2687660913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62200cf5d0 0x7f62200cfa40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6220161250 tx=0x7f621002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 -- 172.21.15.134:0/2687660913 shutdown_connections 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 --2- 172.21.15.134:0/2687660913 >> v2:172.21.15.177:3300/0 conn(0x7f622006d4f0 0x7f622006d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 --2- 172.21.15.134:0/2687660913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62200cf5d0 0x7f62200cfa40 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 -- 172.21.15.134:0/2687660913 >> 172.21.15.134:0/2687660913 conn(0x7f622006bba0 msgr2=0x7f622006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 -- 172.21.15.134:0/2687660913 shutdown_connections 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.500+0000 7f6225a47640 1 -- 172.21.15.134:0/2687660913 wait complete. 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.502+0000 7f6225a47640 1 Processor -- start 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.502+0000 7f6225a47640 1 -- start start 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.502+0000 7f6225a47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.502+0000 7f6225a47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62200cf5d0 0x7f62200ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6220145d90 0x7f62200acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f62200cd660 con 0x7f622006d4f0 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62200cff80 con 0x7f62200cf5d0 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f62200b5610 con 0x7f6220145d90 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58176/0 (socket says 172.21.15.134:58176) 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 -- 172.21.15.134:0/3411513009 learned_addr learned my addr 172.21.15.134:0/3411513009 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621e7fc640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62200cf5d0 0x7f62200ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 -- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6220145d90 msgr2=0x7f62200acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621f7fe640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6220145d90 0x7f62200acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6220145d90 0x7f62200acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 -- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62200cf5d0 msgr2=0x7f62200ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62200cf5d0 0x7f62200ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 -- 172.21.15.134:0/3411513009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622015ddb0 con 0x7f622006d4f0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f621effd640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f620800c4d0 tx=0x7f620800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208018070 con 0x7f622006d4f0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6208007500 con 0x7f622006d4f0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208004a20 con 0x7f622006d4f0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6220141060 con 0x7f622006d4f0 2024-09-15T22:46:16.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.503+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622015e310 con 0x7f622006d4f0 2024-09-15T22:46:16.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.504+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6220146170 con 0x7f622006d4f0 2024-09-15T22:46:16.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.505+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f620801b070 con 0x7f622006d4f0 2024-09-15T22:46:16.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.505+0000 7f6217fff640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 0x7f620006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.505+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f620808acb0 con 0x7f622006d4f0 2024-09-15T22:46:16.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.505+0000 7f621e7fc640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 0x7f620006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.506+0000 7f621e7fc640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 0x7f620006ea40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.509+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f622015ddb0 con 0x7f622006d4f0 2024-09-15T22:46:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.702+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "fake", "target_sub_name": "subvol_clone39651", "target": ["mon-mgr", ""]}) -- 0x7f622015c8a0 con 0x7f620006c580 2024-09-15T22:46:16.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.761+0000 7f6217fff640 1 -- 172.21.15.134:0/3411513009 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f622015c8a0 con 0x7f620006c580 2024-09-15T22:46:16.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 msgr2=0x7f620006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 0x7f620006ea40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 msgr2=0x7f622015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f620800c4d0 tx=0x7f620800c990 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 shutdown_connections 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6220145d90 0x7f62200acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62200cf5d0 0x7f62200ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f620006c580 0x7f620006ea40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 --2- 172.21.15.134:0/3411513009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f622006d4f0 0x7f622015f0d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 >> 172.21.15.134:0/3411513009 conn(0x7f622006bba0 msgr2=0x7f622006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 shutdown_connections 2024-09-15T22:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.763+0000 7f6225a47640 1 -- 172.21.15.134:0/3411513009 wait complete. 2024-09-15T22:46:16.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone39651 2024-09-15T22:46:16.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.875+0000 7fb6bc78d640 1 Processor -- start 2024-09-15T22:46:16.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.875+0000 7fb6bc78d640 1 -- start start 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bc78d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6b415c5b0 0x7fb6b40b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bc78d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 0x7fb6b406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bc78d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b40d1060 con 0x7fb6b40b3be0 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bc78d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b40b4050 con 0x7fb6b415c5b0 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bc78d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b40d1340 con 0x7fb6b40d0a40 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6b415c5b0 0x7fb6b40b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6b415c5b0 0x7fb6b40b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58188/0 (socket says 172.21.15.134:58188) 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6b9d28640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb6b40b3be0 0x7fb6b40d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54704/0 (socket says 172.21.15.134:54704) 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 -- 172.21.15.134:0/1392380907 learned_addr learned my addr 172.21.15.134:0/1392380907 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 -- 172.21.15.134:0/1392380907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 msgr2=0x7fb6b406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bad2a640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 0x7fb6b406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 0x7fb6b406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 -- 172.21.15.134:0/1392380907 >> v1:172.21.15.134:6789/0 conn(0x7fb6b40b3be0 legacy=0x7fb6b40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6b9527640 1 -- 172.21.15.134:0/1392380907 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484221080 0 0) 0x7fb6b40d1060 con 0x7fb6b40b3be0 2024-09-15T22:46:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6ba529640 1 -- 172.21.15.134:0/1392380907 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b406e2a0 con 0x7fb6b415c5b0 2024-09-15T22:46:16.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.876+0000 7fb6bad2a640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 0x7fb6b406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.877+0000 7fb6ba529640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b415c5b0 0x7fb6b40b36a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098a0 tx=0x7fb6b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dce212e58922c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.877+0000 7fb6b9527640 1 -- 172.21.15.134:0/1392380907 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0037070 con 0x7fb6b415c5b0 2024-09-15T22:46:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.877+0000 7fb6b9527640 1 -- 172.21.15.134:0/1392380907 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0032440 con 0x7fb6b415c5b0 2024-09-15T22:46:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.877+0000 7fb6b9527640 1 -- 172.21.15.134:0/1392380907 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0032810 con 0x7fb6b415c5b0 2024-09-15T22:46:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 -- 172.21.15.134:0/1392380907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b415c5b0 msgr2=0x7fb6b40b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b415c5b0 0x7fb6b40b36a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098a0 tx=0x7fb6b002a200 comp rx=0 tx=0).stop 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 -- 172.21.15.134:0/1392380907 shutdown_connections 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40d0a40 0x7fb6b406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/1392380907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b415c5b0 0x7fb6b40b36a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 -- 172.21.15.134:0/1392380907 >> 172.21.15.134:0/1392380907 conn(0x7fb6b406d0d0 msgr2=0x7fb6b406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 -- 172.21.15.134:0/1392380907 shutdown_connections 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.878+0000 7fb6bc78d640 1 -- 172.21.15.134:0/1392380907 wait complete. 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.879+0000 7fb6bc78d640 1 Processor -- start 2024-09-15T22:46:16.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.879+0000 7fb6bc78d640 1 -- start start 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40b3be0 0x7fb6b4151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6b415c5b0 0x7fb6b415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b406f2c0 con 0x7fb6b40d0a40 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b406e860 con 0x7fb6b415c5b0 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b406f440 con 0x7fb6b40b3be0 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58196/0 (socket says 172.21.15.134:58196) 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 -- 172.21.15.134:0/2538982884 learned_addr learned my addr 172.21.15.134:0/2538982884 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6ba529640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40b3be0 0x7fb6b4151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bad2a640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6b415c5b0 0x7fb6b415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 -- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40b3be0 msgr2=0x7fb6b4151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40b3be0 0x7fb6b4151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 -- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6b415c5b0 msgr2=0x7fb6b415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6b415c5b0 0x7fb6b415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 -- 172.21.15.134:0/2538982884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b415d910 con 0x7fb6b40d0a40 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6b9d28640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400c500 tx=0x7fb6a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4018070 con 0x7fb6b40d0a40 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a4007580 con 0x7fb6b40d0a40 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b415dbf0 con 0x7fb6b40d0a40 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4004a20 con 0x7fb6b40d0a40 2024-09-15T22:46:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.880+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b415e1b0 con 0x7fb6b40d0a40 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.882+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b406ed80 con 0x7fb6b40d0a40 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.882+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7fb6a401b070 con 0x7fb6b40d0a40 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.882+0000 7fb6aaffd640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 0x7fb69806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.883+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7fb6a408abc0 con 0x7fb6b40d0a40 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.883+0000 7fb6ba529640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 0x7fb69806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.883+0000 7fb6ba529640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 0x7fb69806ea40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0034000 tx=0x7fb6b002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:16.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:16.887+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6a4059010 con 0x7fb6b40d0a40 2024-09-15T22:46:17.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:17.088+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone39651", "target": ["mon-mgr", ""]}) -- 0x7fb6b41523e0 con 0x7fb69806c580 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.919+0000 7fb6aaffd640 1 -- 172.21.15.134:0/2538982884 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+153 (secure 0 0 0) 0x7fb6b41523e0 con 0x7fb69806c580 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "status": { 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "pending", 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "source": { 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "volume": "cephfs", 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "subvolume": "subvol38420", 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot": "fake" 2024-09-15T22:46:20.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:20.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:20.922 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 msgr2=0x7fb69806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 0x7fb69806ea40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0034000 tx=0x7fb6b002e000 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 msgr2=0x7fb6b415f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400c500 tx=0x7fb6a400c9c0 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 shutdown_connections 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6b415c5b0 0x7fb6b415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb69806c580 0x7fb69806ea40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6b40d0a40 0x7fb6b415f290 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 --2- 172.21.15.134:0/2538982884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6b40b3be0 0x7fb6b4151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:20.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 >> 172.21.15.134:0/2538982884 conn(0x7fb6b406d0d0 msgr2=0x7fb6b415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:20.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.922+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 shutdown_connections 2024-09-15T22:46:20.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:20.923+0000 7fb6bc78d640 1 -- 172.21.15.134:0/2538982884 wait complete. 2024-09-15T22:46:21.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:46:21.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:46:21.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone39651 2024-09-15T22:46:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.052+0000 7f78bf65c640 1 Processor -- start 2024-09-15T22:46:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.052+0000 7f78bf65c640 1 -- start start 2024-09-15T22:46:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bf65c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f78b80b5590 0x7f78b80d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bf65c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78b806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bf65c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b80d2d80 con 0x7f78b815e950 2024-09-15T22:46:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bf65c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f78b815ed30 con 0x7f78b80b5590 2024-09-15T22:46:22.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bf65c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f78b80d0f40 con 0x7f78b80d28f0 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bd3f8640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f78b815e950 0x7f78b80d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54716/0 (socket says 172.21.15.134:54716) 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.053+0000 7f78bd3f8640 1 -- 172.21.15.134:0/1931208177 learned_addr learned my addr 172.21.15.134:0/1931208177 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1931208177 >> v2:172.21.15.177:3300/0 conn(0x7f78b80b5590 0x7f78b80d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78b806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266948072 0 0) 0x7f78b80d2d80 con 0x7f78b815e950 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a4003520 con 0x7f78b815e950 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2689763839 0 0) 0x7f78a4003520 con 0x7f78b815e950 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 msgr2=0x7f78b806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78b806dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 >> v2:172.21.15.177:3300/0 conn(0x7f78b80b5590 msgr2=0x7f78b80d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 --2- 172.21.15.134:0/1931208177 >> v2:172.21.15.177:3300/0 conn(0x7f78b80b5590 0x7f78b80d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b80d1220 con 0x7f78b815e950 2024-09-15T22:46:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f78b4001670 con 0x7f78b815e950 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1931208177 >> v2:172.21.15.177:3300/0 conn(0x7f78b80b5590 0x7f78b80d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 >> v1:172.21.15.134:6789/0 conn(0x7f78b815e950 legacy=0x7f78b80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78a40039b0 0x7f78a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78b815ed30 con 0x7f78a4004d40 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78b80d0f40 con 0x7f78a40039b0 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f78a400b9c0 con 0x7f78b80d28f0 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bd3f8640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78a40039b0 0x7f78a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 -- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 msgr2=0x7f78a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 -- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78a40039b0 msgr2=0x7f78a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78a40039b0 0x7f78a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bdbf9640 1 -- 172.21.15.134:0/1931208177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4003520 con 0x7f78a4004d40 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.054+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b80d28f0 0x7f78a4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.055+0000 7f78bdbf9640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78a40051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009fc0 tx=0x7f78a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62fd79fe52ea071 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.055+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0009c10 con 0x7f78a4004d40 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.055+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b0036070 con 0x7f78a4004d40 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.055+0000 7f78affff640 1 -- 172.21.15.134:0/1931208177 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0031880 con 0x7f78a4004d40 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 -- 172.21.15.134:0/1931208177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 msgr2=0x7f78a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1931208177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78a40051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009fc0 tx=0x7f78a4005830 comp rx=0 tx=0).stop 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bdbf9640 1 -- 172.21.15.134:0/1931208177 reap_dead start 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 -- 172.21.15.134:0/1931208177 shutdown_connections 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 -- 172.21.15.134:0/1931208177 >> 172.21.15.134:0/1931208177 conn(0x7f78b806f310 msgr2=0x7f78b806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 -- 172.21.15.134:0/1931208177 shutdown_connections 2024-09-15T22:46:22.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.056+0000 7f78bf65c640 1 -- 172.21.15.134:0/1931208177 wait complete. 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.057+0000 7f78bf65c640 1 Processor -- start 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.057+0000 7f78bf65c640 1 -- start start 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b814f230 0x7f78b814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b8160280 0x7f78b8160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78b80b59b0 con 0x7f78a4004d40 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78b806d700 con 0x7f78b8160280 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bf65c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f78b80cf410 con 0x7f78b814f230 2024-09-15T22:46:22.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58202/0 (socket says 172.21.15.134:58202) 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 -- 172.21.15.134:0/1161685134 learned_addr learned my addr 172.21.15.134:0/1161685134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 -- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b814f230 msgr2=0x7f78b814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b814f230 0x7f78b814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 -- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b8160280 msgr2=0x7f78b8160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b8160280 0x7f78b8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 -- 172.21.15.134:0/1161685134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b8160fb0 con 0x7f78a4004d40 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.058+0000 7f78bd3f8640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007340 tx=0x7f78b4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.059+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b401a070 con 0x7f78a4004d40 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.059+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b400f920 con 0x7f78a4004d40 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.059+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b8161290 con 0x7f78a4004d40 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.059+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b400fd10 con 0x7f78a4004d40 2024-09-15T22:46:22.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.059+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b80cc930 con 0x7f78a4004d40 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.060+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b80ccb30 con 0x7f78a4004d40 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.060+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f78b401d070 con 0x7f78a4004d40 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.061+0000 7f78adffb640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 0x7f789c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.061+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f78b408b4b0 con 0x7f78a4004d40 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.061+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 0x7f789c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.062+0000 7f78bcbf7640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 0x7f789c06ea40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78b80ce4f0 tx=0x7f78a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.065+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78b80ccb30 con 0x7f78a4004d40 2024-09-15T22:46:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:22.263+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone39651", "target": ["mon-mgr", ""]}) -- 0x7f78b806d040 con 0x7f789c06c580 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.915+0000 7f78adffb640 1 -- 172.21.15.134:0/1161685134 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f78b806d040 con 0x7f789c06c580 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stdout: "status": { 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "complete" 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:25.917 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 msgr2=0x7f789c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 0x7f789c06ea40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78b80ce4f0 tx=0x7f78a8008040 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 msgr2=0x7f78b814c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007340 tx=0x7f78b4007800 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 shutdown_connections 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b8160280 0x7f78b8160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b814f230 0x7f78b814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f789c06c580 0x7f789c06ea40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 --2- 172.21.15.134:0/1161685134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a4004d40 0x7f78b814c5e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 >> 172.21.15.134:0/1161685134 conn(0x7f78b806f310 msgr2=0x7f78b80b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 shutdown_connections 2024-09-15T22:46:25.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:25.918+0000 7f78bf65c640 1 -- 172.21.15.134:0/1161685134 wait complete. 2024-09-15T22:46:25.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:25.934 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone39651/.meta) 2024-09-15T22:46:25.962 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:25.962 INFO:teuthology.orchestra.run.smithi134.stdout:version = 2 2024-09-15T22:46:25.962 INFO:teuthology.orchestra.run.smithi134.stdout:type = clone 2024-09-15T22:46:25.962 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol_clone39651/b8d9c749-9fe1-4f53-b3b6-89f5a0fb5574 2024-09-15T22:46:25.963 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:46:25.963 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:25.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol38420 subvol_snap84630 2024-09-15T22:46:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.110+0000 7f62c3fed640 1 Processor -- start 2024-09-15T22:46:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 -- start start 2024-09-15T22:46:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 0x7f62bc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62bc15f9f0 0x7f62bc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc15fef0 con 0x7f62bc15f9f0 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc15c970 con 0x7f62bc15b370 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.111+0000 7f62c3fed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc15bbb0 con 0x7f62bc06ef60 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62bc15f9f0 0x7f62bc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62bc15f9f0 0x7f62bc06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58216/0 (socket says 172.21.15.134:58216) 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 -- 172.21.15.134:0/2697322344 learned_addr learned my addr 172.21.15.134:0/2697322344 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1d89640 1 --2- 172.21.15.134:0/2697322344 >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 0x7f62bc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c258a640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 -- 172.21.15.134:0/2697322344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 msgr2=0x7f62bc071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 -- 172.21.15.134:0/2697322344 >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 msgr2=0x7f62bc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 --2- 172.21.15.134:0/2697322344 >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 0x7f62bc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1588640 1 -- 172.21.15.134:0/2697322344 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc15be90 con 0x7f62bc15f9f0 2024-09-15T22:46:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.112+0000 7f62c1d89640 1 --2- 172.21.15.134:0/2697322344 >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 0x7f62bc072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c1588640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15f9f0 0x7f62bc06ea20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0696e0 tx=0x7f62ac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266c512308d507d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c0d87640 1 -- 172.21.15.134:0/2697322344 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac037070 con 0x7f62bc15f9f0 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c0d87640 1 -- 172.21.15.134:0/2697322344 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ac032440 con 0x7f62bc15f9f0 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c0d87640 1 -- 172.21.15.134:0/2697322344 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac032810 con 0x7f62bc15f9f0 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 -- 172.21.15.134:0/2697322344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15f9f0 msgr2=0x7f62bc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15f9f0 0x7f62bc06ea20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0696e0 tx=0x7f62ac02a140 comp rx=0 tx=0).stop 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 -- 172.21.15.134:0/2697322344 shutdown_connections 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 --2- 172.21.15.134:0/2697322344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15f9f0 0x7f62bc06ea20 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 --2- 172.21.15.134:0/2697322344 >> v2:172.21.15.177:3300/0 conn(0x7f62bc15b370 0x7f62bc072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 -- 172.21.15.134:0/2697322344 >> 172.21.15.134:0/2697322344 conn(0x7f62bc06bba0 msgr2=0x7f62bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.113+0000 7f62c3fed640 1 -- 172.21.15.134:0/2697322344 shutdown_connections 2024-09-15T22:46:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.114+0000 7f62c3fed640 1 -- 172.21.15.134:0/2697322344 wait complete. 2024-09-15T22:46:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 Processor -- start 2024-09-15T22:46:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 -- start start 2024-09-15T22:46:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62bc15f9f0 0x7f62bc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc0731b0 con 0x7f62bc15b370 2024-09-15T22:46:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc15c450 con 0x7f62bc15f9f0 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c3fed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc15b750 con 0x7f62bc06ef60 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.115+0000 7f62c1588640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58218/0 (socket says 172.21.15.134:58218) 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 -- 172.21.15.134:0/479979215 learned_addr learned my addr 172.21.15.134:0/479979215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1d89640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c258a640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62bc15f9f0 0x7f62bc15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 -- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 msgr2=0x7f62bc14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 -- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62bc15f9f0 msgr2=0x7f62bc15e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62bc15f9f0 0x7f62bc15e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 -- 172.21.15.134:0/479979215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc15d490 con 0x7f62bc15b370 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c1588640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f62ac02a180 tx=0x7f62ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac037040 con 0x7f62bc15b370 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ac042070 con 0x7f62bc15b370 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc15d770 con 0x7f62bc15b370 2024-09-15T22:46:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0308a0 con 0x7f62bc15b370 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.116+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc15dd30 con 0x7f62bc15b370 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.117+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62bc158700 con 0x7f62bc15b370 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.118+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f62ac030a40 con 0x7f62bc15b370 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.118+0000 7f62b27fc640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 0x7f62a006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.118+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f62ac0ac0e0 con 0x7f62bc15b370 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.118+0000 7f62c1d89640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 0x7f62a006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.119+0000 7f62c1d89640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 0x7f62a006ea40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.122+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62ac07a530 con 0x7f62bc15b370 2024-09-15T22:46:26.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.315+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "subvol_snap84630", "target": ["mon-mgr", ""]}) -- 0x7f62bc158420 con 0x7f62a006c580 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.331+0000 7f62b27fc640 1 -- 172.21.15.134:0/479979215 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+115 (secure 0 0 0) 0x7f62bc158420 con 0x7f62a006c580 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stdout: "created_at": "2024-09-15 22:46:07.705706", 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stdout: "data_pool": "cephfs_data", 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stdout: "has_pending_clones": "no" 2024-09-15T22:46:26.333 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.333+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 msgr2=0x7f62a006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.333+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 0x7f62a006ea40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.333+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 msgr2=0x7f62bc15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.333+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f62ac02a180 tx=0x7f62ac0046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.333+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 shutdown_connections 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62bc15f9f0 0x7f62bc15e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f62a006c580 0x7f62a006ea40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62bc15b370 0x7f62bc15cbb0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 --2- 172.21.15.134:0/479979215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f62bc06ef60 0x7f62bc14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 >> 172.21.15.134:0/479979215 conn(0x7f62bc06bba0 msgr2=0x7f62bc157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:26.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 shutdown_connections 2024-09-15T22:46:26.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.334+0000 7f62c3fed640 1 -- 172.21.15.134:0/479979215 wait complete. 2024-09-15T22:46:26.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol38420 2024-09-15T22:46:26.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.448+0000 7f22447f6640 1 Processor -- start 2024-09-15T22:46:26.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.448+0000 7f22447f6640 1 -- start start 2024-09-15T22:46:26.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f22447f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f223c06f130 0x7f223c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f22447f6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c15f9f0 0x7f223c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f22447f6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223c15c970 con 0x7f223c15b370 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f22447f6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f223c15fef0 con 0x7f223c15f9f0 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f22447f6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f223c15bbb0 con 0x7f223c06f130 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c15f9f0 0x7f223c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c15f9f0 0x7f223c0ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46438/0 (socket says 172.21.15.134:46438) 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 -- 172.21.15.134:0/2685487680 learned_addr learned my addr 172.21.15.134:0/2685487680 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2241d91640 1 --2- 172.21.15.134:0/2685487680 >> v2:172.21.15.177:3300/0 conn(0x7f223c06f130 0x7f223c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 -- 172.21.15.134:0/2685487680 >> v2:172.21.15.177:3300/0 conn(0x7f223c06f130 msgr2=0x7f223c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 --2- 172.21.15.134:0/2685487680 >> v2:172.21.15.177:3300/0 conn(0x7f223c06f130 0x7f223c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 -- 172.21.15.134:0/2685487680 >> v1:172.21.15.177:6789/0 conn(0x7f223c15b370 legacy=0x7f223c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:26.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.449+0000 7f2242d93640 1 -- 172.21.15.134:0/2685487680 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c15be90 con 0x7f223c15f9f0 2024-09-15T22:46:26.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f2242d93640 1 --2- 172.21.15.134:0/2685487680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c0ce490 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f223c0d0470 tx=0x7f223402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c84d12495a3e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f2241590640 1 -- 172.21.15.134:0/2685487680 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234036070 con 0x7f223c15f9f0 2024-09-15T22:46:26.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f2241590640 1 -- 172.21.15.134:0/2685487680 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2234031600 con 0x7f223c15f9f0 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f2241590640 1 -- 172.21.15.134:0/2685487680 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22340319d0 con 0x7f223c15f9f0 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f22447f6640 1 -- 172.21.15.134:0/2685487680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 msgr2=0x7f223c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.450+0000 7f22447f6640 1 --2- 172.21.15.134:0/2685487680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c0ce490 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f223c0d0470 tx=0x7f223402a660 comp rx=0 tx=0).stop 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 -- 172.21.15.134:0/2685487680 shutdown_connections 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 --2- 172.21.15.134:0/2685487680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c0ce490 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 --2- 172.21.15.134:0/2685487680 >> v2:172.21.15.177:3300/0 conn(0x7f223c06f130 0x7f223c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 -- 172.21.15.134:0/2685487680 >> 172.21.15.134:0/2685487680 conn(0x7f223c06bba0 msgr2=0x7f223c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 -- 172.21.15.134:0/2685487680 shutdown_connections 2024-09-15T22:46:26.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.451+0000 7f22447f6640 1 -- 172.21.15.134:0/2685487680 wait complete. 2024-09-15T22:46:26.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 Processor -- start 2024-09-15T22:46:26.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 -- start start 2024-09-15T22:46:26.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c06f130 0x7f223c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15b370 0x7f223c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0731b0 con 0x7f223c15f9f0 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f223c15c450 con 0x7f223c06f130 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.452+0000 7f22447f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f223c15b750 con 0x7f223c15b370 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46450/0 (socket says 172.21.15.134:46450) 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 -- 172.21.15.134:0/2498726847 learned_addr learned my addr 172.21.15.134:0/2498726847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242592640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c06f130 0x7f223c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2241d91640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15b370 0x7f223c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 -- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15b370 msgr2=0x7f223c150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15b370 0x7f223c150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 -- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c06f130 msgr2=0x7f223c14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c06f130 0x7f223c14da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 -- 172.21.15.134:0/2498726847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c14f3d0 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2242d93640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f40 tx=0x7f2234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234041020 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22340077a0 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c14f6b0 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234036040 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.453+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c14fc70 con 0x7f223c15f9f0 2024-09-15T22:46:26.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.454+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c0afa50 con 0x7f223c15f9f0 2024-09-15T22:46:26.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.455+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f2234044020 con 0x7f223c15f9f0 2024-09-15T22:46:26.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.455+0000 7f2232ffd640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 0x7f222006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.455+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f22340ac780 con 0x7f223c15f9f0 2024-09-15T22:46:26.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.455+0000 7f2242592640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 0x7f222006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.456+0000 7f2242592640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 0x7f222006ea40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f223c158810 tx=0x7f222c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.459+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f223404b020 con 0x7f223c15f9f0 2024-09-15T22:46:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.651+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7f223c072560 con 0x7f222006c580 2024-09-15T22:46:26.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.664+0000 7f2232ffd640 1 -- 172.21.15.134:0/2498726847 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+87 (secure 0 0 0) 0x7f223c072560 con 0x7f222006c580 2024-09-15T22:46:26.665 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:26.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "fake" 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "subvol_snap84630" 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:26.666 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:26.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 msgr2=0x7f222006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 0x7f222006ea40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f223c158810 tx=0x7f222c007e30 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 msgr2=0x7f223c1599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f40 tx=0x7f2234004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 shutdown_connections 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c580 0x7f222006ea40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c15f9f0 0x7f223c1599e0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15b370 0x7f223c150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 --2- 172.21.15.134:0/2498726847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c06f130 0x7f223c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 >> 172.21.15.134:0/2498726847 conn(0x7f223c06bba0 msgr2=0x7f223c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 shutdown_connections 2024-09-15T22:46:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.666+0000 7f22447f6640 1 -- 172.21.15.134:0/2498726847 wait complete. 2024-09-15T22:46:26.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol38420 subvol_snap84630 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.780+0000 7f6dea82e640 1 Processor -- start 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.780+0000 7f6dea82e640 1 -- start start 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6dea82e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6de40b5720 0x7f6de40b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6dea82e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de4072760 0x7f6de406da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6dea82e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de416b920 con 0x7f6de40b3ab0 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6dea82e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6de40b5b00 con 0x7f6de40b5720 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6dea82e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40b4030 con 0x7f6de4072760 2024-09-15T22:46:26.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6de3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6de40b5720 0x7f6de40b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6de3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6de40b5720 0x7f6de40b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46464/0 (socket says 172.21.15.134:46464) 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6de37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6de40b3ab0 0x7f6de4072050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37966/0 (socket says 172.21.15.134:37966) 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.781+0000 7f6de3fff640 1 -- 172.21.15.134:0/2383411000 learned_addr learned my addr 172.21.15.134:0/2383411000 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.782+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195500571 0 0) 0x7f6de416b920 con 0x7f6de40b3ab0 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.782+0000 7f6de8dcb640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de4072760 0x7f6de406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dcc003500 con 0x7f6de40b3ab0 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de3fff640 1 -- 172.21.15.134:0/2383411000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de4072760 msgr2=0x7f6de406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de3fff640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de4072760 0x7f6de406da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de3fff640 1 -- 172.21.15.134:0/2383411000 >> v1:172.21.15.134:6789/0 conn(0x7f6de40b3ab0 legacy=0x7f6de4072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3544857401 0 0) 0x7f6dcc003500 con 0x7f6de40b3ab0 2024-09-15T22:46:26.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de3fff640 1 -- 172.21.15.134:0/2383411000 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de40b4310 con 0x7f6de40b5720 2024-09-15T22:46:26.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.854+0000 7f6de3fff640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de40b3570 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b920 tx=0x7f6dd402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25adeef3e58e56d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8001670 con 0x7f6de40b5720 2024-09-15T22:46:26.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd402f510 con 0x7f6de40b5720 2024-09-15T22:46:26.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6de2ffd640 1 -- 172.21.15.134:0/2383411000 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd402f8e0 con 0x7f6de40b5720 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 -- 172.21.15.134:0/2383411000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 msgr2=0x7f6de40b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de40b3570 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b920 tx=0x7f6dd402a680 comp rx=0 tx=0).stop 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 -- 172.21.15.134:0/2383411000 shutdown_connections 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de4072760 0x7f6de406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2383411000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de40b3570 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 -- 172.21.15.134:0/2383411000 >> 172.21.15.134:0/2383411000 conn(0x7f6de40b2270 msgr2=0x7f6de40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 -- 172.21.15.134:0/2383411000 shutdown_connections 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.855+0000 7f6dea82e640 1 -- 172.21.15.134:0/2383411000 wait complete. 2024-09-15T22:46:26.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.856+0000 7f6dea82e640 1 Processor -- start 2024-09-15T22:46:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 -- start start 2024-09-15T22:46:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de4072760 0x7f6de4164da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de40b3ab0 0x7f6de41f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40b4de0 con 0x7f6de40b5720 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6de406d4e0 con 0x7f6de4072760 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.857+0000 7f6dea82e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40cd2e0 con 0x7f6de40b3ab0 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46480/0 (socket says 172.21.15.134:46480) 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 -- 172.21.15.134:0/2291312870 learned_addr learned my addr 172.21.15.134:0/2291312870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de37fe640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de40b3ab0 0x7f6de41f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de3fff640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de4072760 0x7f6de4164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 -- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de40b3ab0 msgr2=0x7f6de41f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de40b3ab0 0x7f6de41f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 -- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de4072760 msgr2=0x7f6de4164da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de4072760 0x7f6de4164da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 -- 172.21.15.134:0/2291312870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de41f43b0 con 0x7f6de40b5720 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de8dcb640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00fdb0 tx=0x7f6ddc00d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc016070 con 0x7f6de40b5720 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00d040 con 0x7f6de40b5720 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00c040 con 0x7f6de40b5720 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de41f4690 con 0x7f6de40b5720 2024-09-15T22:46:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.858+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de41f4f30 con 0x7f6de40b5720 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.859+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de41f5130 con 0x7f6de40b5720 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.860+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f6ddc019070 con 0x7f6de40b5720 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.860+0000 7f6de0ff9640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 0x7f6dd006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.860+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f6ddc08bd60 con 0x7f6de40b5720 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.861+0000 7f6de3fff640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 0x7f6dd006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.861+0000 7f6de3fff640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 0x7f6dd006ea40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034000 tx=0x7f6dd402f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:26.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:26.865+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6de41f5130 con 0x7f6de40b5720 2024-09-15T22:46:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.066+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "subvol_snap84630", "target": ["mon-mgr", ""]}) -- 0x7f6de40b3570 con 0x7f6dd006c580 2024-09-15T22:46:27.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.093+0000 7f6de0ff9640 1 -- 172.21.15.134:0/2291312870 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6de40b3570 con 0x7f6dd006c580 2024-09-15T22:46:27.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 msgr2=0x7f6dd006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 0x7f6dd006ea40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034000 tx=0x7f6dd402f000 comp rx=0 tx=0).stop 2024-09-15T22:46:27.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 msgr2=0x7f6de41f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00fdb0 tx=0x7f6ddc00d5c0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 shutdown_connections 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6dd006c580 0x7f6dd006ea40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de40b5720 0x7f6de41f3a60 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6de40b3ab0 0x7f6de41f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 --2- 172.21.15.134:0/2291312870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de4072760 0x7f6de4164da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.095+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 >> 172.21.15.134:0/2291312870 conn(0x7f6de40b2270 msgr2=0x7f6de40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.096+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 shutdown_connections 2024-09-15T22:46:27.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.096+0000 7f6dea82e640 1 -- 172.21.15.134:0/2291312870 wait complete. 2024-09-15T22:46:27.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol38420 fake 2024-09-15T22:46:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.211+0000 7f59a5e5e640 1 Processor -- start 2024-09-15T22:46:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.211+0000 7f59a5e5e640 1 -- start start 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f59a5e5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59a00b55a0 0x7f59a006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f59a5e5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 0x7f59a00af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f59a5e5e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a006f930 con 0x7f59a01481b0 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f59a5e5e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f59a006c530 con 0x7f59a00b55a0 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f59a5e5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f59a006fc10 con 0x7f59a006c0e0 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59a00b55a0 0x7f59a006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59a00b55a0 0x7f59a006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46490/0 (socket says 172.21.15.134:46490) 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 -- 172.21.15.134:0/1103637109 learned_addr learned my addr 172.21.15.134:0/1103637109 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599ffff640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 0x7f59a00af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 -- 172.21.15.134:0/1103637109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 msgr2=0x7f59a00af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 0x7f59a00af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 -- 172.21.15.134:0/1103637109 >> v1:172.21.15.177:6789/0 conn(0x7f59a01481b0 legacy=0x7f59a006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599effd640 1 -- 172.21.15.134:0/1103637109 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a006fef0 con 0x7f59a00b55a0 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.212+0000 7f599ffff640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 0x7f59a00af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.213+0000 7f599effd640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a00b55a0 0x7f59a006bba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5994009870 tx=0x7f599402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e31fffed074e3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.213+0000 7f599e7fc640 1 -- 172.21.15.134:0/1103637109 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994037070 con 0x7f59a00b55a0 2024-09-15T22:46:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.213+0000 7f599e7fc640 1 -- 172.21.15.134:0/1103637109 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5994032440 con 0x7f59a00b55a0 2024-09-15T22:46:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.213+0000 7f599e7fc640 1 -- 172.21.15.134:0/1103637109 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994032810 con 0x7f59a00b55a0 2024-09-15T22:46:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 -- 172.21.15.134:0/1103637109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a00b55a0 msgr2=0x7f59a006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a00b55a0 0x7f59a006bba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5994009870 tx=0x7f599402a270 comp rx=0 tx=0).stop 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 -- 172.21.15.134:0/1103637109 shutdown_connections 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a006c0e0 0x7f59a00af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/1103637109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a00b55a0 0x7f59a006bba0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 -- 172.21.15.134:0/1103637109 >> 172.21.15.134:0/1103637109 conn(0x7f59a0062810 msgr2=0x7f59a006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 -- 172.21.15.134:0/1103637109 shutdown_connections 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.214+0000 7f59a5e5e640 1 -- 172.21.15.134:0/1103637109 wait complete. 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.215+0000 7f59a5e5e640 1 Processor -- start 2024-09-15T22:46:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.215+0000 7f59a5e5e640 1 -- start start 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b55a0 0x7f59a015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a01481b0 0x7f59a00ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00af870 con 0x7f59a006c0e0 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00aee10 con 0x7f59a01481b0 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f59a5e5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00af9f0 con 0x7f59a00b55a0 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46502/0 (socket says 172.21.15.134:46502) 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 -- 172.21.15.134:0/2240046103 learned_addr learned my addr 172.21.15.134:0/2240046103 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599effd640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b55a0 0x7f59a015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 -- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b55a0 msgr2=0x7f59a015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b55a0 0x7f59a015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599ffff640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a01481b0 0x7f59a00ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 -- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a01481b0 msgr2=0x7f59a00ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a01481b0 0x7f59a00ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.216+0000 7f599f7fe640 1 -- 172.21.15.134:0/2240046103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a015fed0 con 0x7f59a006c0e0 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f599f7fe640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f599000c3c0 tx=0x7f599000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59900052d0 con 0x7f59a006c0e0 2024-09-15T22:46:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990005490 con 0x7f59a006c0e0 2024-09-15T22:46:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990007260 con 0x7f59a006c0e0 2024-09-15T22:46:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a01601b0 con 0x7f59a006c0e0 2024-09-15T22:46:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.217+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a0160770 con 0x7f59a006c0e0 2024-09-15T22:46:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.218+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a00af330 con 0x7f59a006c0e0 2024-09-15T22:46:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.218+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f5990007400 con 0x7f59a006c0e0 2024-09-15T22:46:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.219+0000 7f5987fff640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 0x7f598c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.219+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f599008aeb0 con 0x7f59a006c0e0 2024-09-15T22:46:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.219+0000 7f599effd640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 0x7f598c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.220+0000 7f599effd640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 0x7f598c06ea40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5994034000 tx=0x7f599402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.223+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5990059190 con 0x7f59a006c0e0 2024-09-15T22:46:27.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.418+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol38420", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f59a01609b0 con 0x7f598c06c580 2024-09-15T22:46:27.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.447+0000 7f5987fff640 1 -- 172.21.15.134:0/2240046103 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5994032610 con 0x7f598c06c580 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 msgr2=0x7f598c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 0x7f598c06ea40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5994034000 tx=0x7f599402e000 comp rx=0 tx=0).stop 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 msgr2=0x7f59a015dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f599000c3c0 tx=0x7f599000c880 comp rx=0 tx=0).stop 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 shutdown_connections 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a01481b0 0x7f59a00ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b55a0 0x7f59a015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598c06c580 0x7f598c06ea40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 --2- 172.21.15.134:0/2240046103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a006c0e0 0x7f59a015dfe0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.449+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 >> 172.21.15.134:0/2240046103 conn(0x7f59a0062810 msgr2=0x7f59a01e9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.450+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 shutdown_connections 2024-09-15T22:46:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.450+0000 7f59a5e5e640 1 -- 172.21.15.134:0/2240046103 wait complete. 2024-09-15T22:46:27.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:27.462 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol38420/.meta) 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol38420/76e9b98d-cfdf-47b1-a192-6eaa2fb8ef54 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:46:27.490 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:27.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol38420 2024-09-15T22:46:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.630+0000 7f3da961e640 1 Processor -- start 2024-09-15T22:46:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.630+0000 7f3da961e640 1 -- start start 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da961e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3da415e960 0x7f3da406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da961e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3da40cb2f0 0x7f3da406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da961e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da40d4040 con 0x7f3da406c9f0 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da961e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40b7a40 con 0x7f3da415e960 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da961e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3da40cf750 con 0x7f3da40cb2f0 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3da415e960 0x7f3da406bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3da406c9f0 0x7f3da40d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37974/0 (socket says 172.21.15.134:37974) 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3da415e960 0x7f3da406bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46504/0 (socket says 172.21.15.134:46504) 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da37fe640 1 -- 172.21.15.134:0/3979185716 learned_addr learned my addr 172.21.15.134:0/3979185716 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:27.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 -- 172.21.15.134:0/3979185716 >> v2:172.21.15.177:3300/0 conn(0x7f3da40cb2f0 msgr2=0x7f3da406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da27fc640 1 --2- 172.21.15.134:0/3979185716 >> v2:172.21.15.177:3300/0 conn(0x7f3da40cb2f0 0x7f3da406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da1ffb640 1 -- 172.21.15.134:0/3979185716 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377081332 0 0) 0x7f3da40d4040 con 0x7f3da406c9f0 2024-09-15T22:46:27.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 --2- 172.21.15.134:0/3979185716 >> v2:172.21.15.177:3300/0 conn(0x7f3da40cb2f0 0x7f3da406c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 -- 172.21.15.134:0/3979185716 >> v1:172.21.15.134:6789/0 conn(0x7f3da406c9f0 legacy=0x7f3da40d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.631+0000 7f3da2ffd640 1 -- 172.21.15.134:0/3979185716 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da40cfa30 con 0x7f3da415e960 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.632+0000 7f3da2ffd640 1 --2- 172.21.15.134:0/3979185716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da415e960 0x7f3da406bf70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3da40ba850 tx=0x7f3d9402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9312dfc52ddcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.632+0000 7f3da1ffb640 1 -- 172.21.15.134:0/3979185716 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94037070 con 0x7f3da415e960 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.632+0000 7f3da1ffb640 1 -- 172.21.15.134:0/3979185716 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d94032440 con 0x7f3da415e960 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.632+0000 7f3da1ffb640 1 -- 172.21.15.134:0/3979185716 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94032810 con 0x7f3da415e960 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 -- 172.21.15.134:0/3979185716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da415e960 msgr2=0x7f3da406bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 --2- 172.21.15.134:0/3979185716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da415e960 0x7f3da406bf70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3da40ba850 tx=0x7f3d9402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 -- 172.21.15.134:0/3979185716 shutdown_connections 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 --2- 172.21.15.134:0/3979185716 >> v2:172.21.15.177:3300/0 conn(0x7f3da40cb2f0 0x7f3da406c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 --2- 172.21.15.134:0/3979185716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da415e960 0x7f3da406bf70 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 -- 172.21.15.134:0/3979185716 >> 172.21.15.134:0/3979185716 conn(0x7f3da40d46e0 msgr2=0x7f3da40d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 -- 172.21.15.134:0/3979185716 shutdown_connections 2024-09-15T22:46:27.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.633+0000 7f3da961e640 1 -- 172.21.15.134:0/3979185716 wait complete. 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.634+0000 7f3da961e640 1 Processor -- start 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.634+0000 7f3da961e640 1 -- start start 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3da40cb2f0 0x7f3da40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3da415e960 0x7f3da40ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3da40b8ee0 con 0x7f3da406c9f0 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3da40d3cd0 con 0x7f3da415e960 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da961e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3da40b9060 con 0x7f3da40cb2f0 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46506/0 (socket says 172.21.15.134:46506) 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 -- 172.21.15.134:0/4224554332 learned_addr learned my addr 172.21.15.134:0/4224554332 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:27.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 -- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3da40cb2f0 msgr2=0x7f3da40cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3da40cb2f0 0x7f3da40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 -- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3da415e960 msgr2=0x7f3da40ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3da415e960 0x7f3da40ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 -- 172.21.15.134:0/4224554332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da415f320 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.635+0000 7f3da2ffd640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3d94035040 tx=0x7f3d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.636+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94037040 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.636+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d94004230 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.636+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da415f600 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.636+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94032e20 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.636+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da415fbc0 con 0x7f3da406c9f0 2024-09-15T22:46:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.637+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da40d4040 con 0x7f3da406c9f0 2024-09-15T22:46:27.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.637+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f3d94030770 con 0x7f3da406c9f0 2024-09-15T22:46:27.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.637+0000 7f3d8b7fe640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 0x7f3d9006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.638+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f3d940acce0 con 0x7f3da406c9f0 2024-09-15T22:46:27.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.638+0000 7f3da27fc640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 0x7f3d9006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.638+0000 7f3da27fc640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 0x7f3d9006ea70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3da40d3380 tx=0x7f3d98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.642+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d9407b0e0 con 0x7f3da406c9f0 2024-09-15T22:46:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.830+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol38420", "target": ["mon-mgr", ""]}) -- 0x7f3da40d2d10 con 0x7f3d9006c5b0 2024-09-15T22:46:27.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.868+0000 7f3d8b7fe640 1 -- 172.21.15.134:0/4224554332 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3da40d2d10 con 0x7f3d9006c5b0 2024-09-15T22:46:27.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 msgr2=0x7f3d9006ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 0x7f3d9006ea70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3da40d3380 tx=0x7f3d98008040 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 msgr2=0x7f3da415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3d94035040 tx=0x7f3d940046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 shutdown_connections 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3da415e960 0x7f3da40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3da40cb2f0 0x7f3da40cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3d9006c5b0 0x7f3d9006ea70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 --2- 172.21.15.134:0/4224554332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da406c9f0 0x7f3da415ed40 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 >> 172.21.15.134:0/4224554332 conn(0x7f3da40d46e0 msgr2=0x7f3da40d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 shutdown_connections 2024-09-15T22:46:27.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.871+0000 7f3da961e640 1 -- 172.21.15.134:0/4224554332 wait complete. 2024-09-15T22:46:27.874 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.873+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.874 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.873+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.874 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.873+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.874 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.873+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.874 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.873+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone70620 2024-09-15T22:46:27.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.886+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.886+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.886+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.886+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:27.886+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.989+0000 7faf4142c640 1 Processor -- start 2024-09-15T22:46:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.989+0000 7faf4142c640 1 -- start start 2024-09-15T22:46:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf4142c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf3c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf4142c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf3c0b7ed0 0x7faf3c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf4142c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3c0d4040 con 0x7faf3c15e960 2024-09-15T22:46:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf4142c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7faf3c0b7a40 con 0x7faf3c0b7ed0 2024-09-15T22:46:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf4142c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c0cf750 con 0x7faf3c0cb2f0 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf3affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faf3c15e960 0x7faf3c06bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37976/0 (socket says 172.21.15.134:37976) 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.990+0000 7faf3affd640 1 -- 172.21.15.134:0/1230454628 learned_addr learned my addr 172.21.15.134:0/1230454628 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf3c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953753376 0 0) 0x7faf3c0d4040 con 0x7faf3c15e960 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3b7fe640 1 --2- 172.21.15.134:0/1230454628 >> v2:172.21.15.177:3300/0 conn(0x7faf3c0b7ed0 0x7faf3c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf24003520 con 0x7faf3c15e960 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1956971117 0 0) 0x7faf24003520 con 0x7faf3c15e960 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 msgr2=0x7faf3c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf3c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 >> v2:172.21.15.177:3300/0 conn(0x7faf3c0b7ed0 msgr2=0x7faf3c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 --2- 172.21.15.134:0/1230454628 >> v2:172.21.15.177:3300/0 conn(0x7faf3c0b7ed0 0x7faf3c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c0cfa30 con 0x7faf3c15e960 2024-09-15T22:46:27.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7faf2c001670 con 0x7faf3c15e960 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 >> v1:172.21.15.134:6789/0 conn(0x7faf3c15e960 legacy=0x7faf3c06bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf240039b0 0x7faf24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24004800 0x7faf24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0b7a40 con 0x7faf24004800 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0cf750 con 0x7faf240039b0 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf2400b9c0 con 0x7faf3c0cb2f0 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24004800 0x7faf24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3affd640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf240039b0 0x7faf24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3b7fe640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 -- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 msgr2=0x7faf240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0cb2f0 0x7faf240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 -- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf240039b0 msgr2=0x7faf24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf240039b0 0x7faf24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.991+0000 7faf3a7fc640 1 -- 172.21.15.134:0/1230454628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf24003520 con 0x7faf24004800 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.992+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24004800 0x7faf24004c80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7faf30009a90 tx=0x7faf24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6222acc21f0859 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.992+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30036070 con 0x7faf24004800 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.992+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf30031400 con 0x7faf24004800 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.992+0000 7faf39ffb640 1 -- 172.21.15.134:0/1230454628 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30009690 con 0x7faf24004800 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 -- 172.21.15.134:0/1230454628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24004800 msgr2=0x7faf24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 --2- 172.21.15.134:0/1230454628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24004800 0x7faf24004c80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7faf30009a90 tx=0x7faf24005830 comp rx=0 tx=0).stop 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf3b7fe640 1 -- 172.21.15.134:0/1230454628 reap_dead start 2024-09-15T22:46:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 -- 172.21.15.134:0/1230454628 shutdown_connections 2024-09-15T22:46:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 -- 172.21.15.134:0/1230454628 >> 172.21.15.134:0/1230454628 conn(0x7faf3c0d46e0 msgr2=0x7faf3c0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 -- 172.21.15.134:0/1230454628 shutdown_connections 2024-09-15T22:46:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.993+0000 7faf4142c640 1 -- 172.21.15.134:0/1230454628 wait complete. 2024-09-15T22:46:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.994+0000 7faf4142c640 1 Processor -- start 2024-09-15T22:46:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.994+0000 7faf4142c640 1 -- start start 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf24004800 0x7faf3c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0ccc10 0x7faf3c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c06c680 con 0x7faf3c15df10 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0d3cd0 con 0x7faf24004800 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf4142c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c06c800 con 0x7faf3c0ccc10 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46524/0 (socket says 172.21.15.134:46524) 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 -- 172.21.15.134:0/2271683899 learned_addr learned my addr 172.21.15.134:0/2271683899 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3affd640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf24004800 0x7faf3c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3a7fc640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0ccc10 0x7faf3c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 -- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0ccc10 msgr2=0x7faf3c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0ccc10 0x7faf3c15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 -- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf24004800 msgr2=0x7faf3c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf24004800 0x7faf3c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.995+0000 7faf3b7fe640 1 -- 172.21.15.134:0/2271683899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c0cd120 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf3b7fe640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faf3c1622a0 tx=0x7faf3400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34011e60 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3401d070 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3c0cd400 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34015650 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.996+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c0cd9c0 con 0x7faf3c15df10 2024-09-15T22:46:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.997+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3c0d4040 con 0x7faf3c15df10 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.997+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7faf340157f0 con 0x7faf3c15df10 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.998+0000 7faf237fe640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 0x7faf2806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.998+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7faf3408c240 con 0x7faf3c15df10 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.998+0000 7faf3affd640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 0x7faf2806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:27.998+0000 7faf3affd640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 0x7faf2806ea40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007fd0 tx=0x7faf2c0078f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.002+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf34010040 con 0x7faf3c15df10 2024-09-15T22:46:28.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.190+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone70620", "target": ["mon-mgr", ""]}) -- 0x7faf3c0cf280 con 0x7faf2806c580 2024-09-15T22:46:28.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.207+0000 7faf237fe640 1 -- 172.21.15.134:0/2271683899 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf3c0cf280 con 0x7faf2806c580 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 msgr2=0x7faf2806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 0x7faf2806ea40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007fd0 tx=0x7faf2c0078f0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 msgr2=0x7faf3c1f48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faf3c1622a0 tx=0x7faf3400f580 comp rx=0 tx=0).stop 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 shutdown_connections 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf2806c580 0x7faf2806ea40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf3c15df10 0x7faf3c1f48a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c0ccc10 0x7faf3c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 --2- 172.21.15.134:0/2271683899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf24004800 0x7faf3c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 >> 172.21.15.134:0/2271683899 conn(0x7faf3c0d46e0 msgr2=0x7faf3c0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:28.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 shutdown_connections 2024-09-15T22:46:28.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.209+0000 7faf4142c640 1 -- 172.21.15.134:0/2271683899 wait complete. 2024-09-15T22:46:28.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone39651 2024-09-15T22:46:28.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.324+0000 7fd21a56d640 1 Processor -- start 2024-09-15T22:46:28.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.324+0000 7fd21a56d640 1 -- start start 2024-09-15T22:46:28.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd21a56d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd2140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd21a56d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2140b43f0 con 0x7fd21406f130 2024-09-15T22:46:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd21a56d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21415c7d0 con 0x7fd21415c370 2024-09-15T22:46:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd21a56d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2140b3630 con 0x7fd214158e50 2024-09-15T22:46:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd218b0a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd21406f130 0x7fd2140ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37978/0 (socket says 172.21.15.134:37978) 2024-09-15T22:46:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd218b0a640 1 -- 172.21.15.134:0/2423758616 learned_addr learned my addr 172.21.15.134:0/2423758616 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:28.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd213fff640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd2140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833100547 0 0) 0x7fd2140b43f0 con 0x7fd21406f130 2024-09-15T22:46:28.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1fc003520 con 0x7fd21406f130 2024-09-15T22:46:28.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473867380 0 0) 0x7fd21415c7d0 con 0x7fd21415c370 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2140b43f0 con 0x7fd21415c370 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 340056672 0 0) 0x7fd1fc003520 con 0x7fd21406f130 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 msgr2=0x7fd2140b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd2140b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 >> v1:172.21.15.177:6789/0 conn(0x7fd21415c370 legacy=0x7fd21406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2140b3910 con 0x7fd21406f130 2024-09-15T22:46:28.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd20c0019f0 con 0x7fd21406f130 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 >> v1:172.21.15.134:6789/0 conn(0x7fd21406f130 legacy=0x7fd2140ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1fc003b70 0x7fd1fc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd1fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc004d40 0x7fd1fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2140b3630 con 0x7fd1fc003b70 2024-09-15T22:46:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc00ba70 con 0x7fd1fc004d40 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.325+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd1fc00bc20 con 0x7fd214158e50 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1fc003b70 0x7fd1fc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd218b0a640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc004d40 0x7fd1fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd2137fe640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd1fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 -- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 msgr2=0x7fd1fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd1fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 -- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc004d40 msgr2=0x7fd1fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc004d40 0x7fd1fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 -- 172.21.15.134:0/2423758616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc003520 con 0x7fd1fc003b70 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd2137fe640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd214158e50 0x7fd1fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.326+0000 7fd213fff640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1fc003b70 0x7fd1fc003f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd204009ac0 tx=0x7fd1fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8df6615a20810c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204036070 con 0x7fd1fc003b70 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204031400 con 0x7fd1fc003b70 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd212ffd640 1 -- 172.21.15.134:0/2423758616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204009690 con 0x7fd1fc003b70 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 -- 172.21.15.134:0/2423758616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1fc003b70 msgr2=0x7fd1fc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 --2- 172.21.15.134:0/2423758616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1fc003b70 0x7fd1fc003f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd204009ac0 tx=0x7fd1fc005830 comp rx=0 tx=0).stop 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd218b0a640 1 -- 172.21.15.134:0/2423758616 reap_dead start 2024-09-15T22:46:28.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 -- 172.21.15.134:0/2423758616 shutdown_connections 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 -- 172.21.15.134:0/2423758616 >> 172.21.15.134:0/2423758616 conn(0x7fd21406bba0 msgr2=0x7fd21406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 -- 172.21.15.134:0/2423758616 shutdown_connections 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.327+0000 7fd21a56d640 1 -- 172.21.15.134:0/2423758616 wait complete. 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.328+0000 7fd21a56d640 1 Processor -- start 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 -- start start 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc003b70 0x7fd2140aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 0x7fd214156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd214159230 con 0x7fd214149930 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2140b3ed0 con 0x7fd1fc003b70 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd21a56d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2140b5050 con 0x7fd2141560d0 2024-09-15T22:46:28.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd218b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd218b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46548/0 (socket says 172.21.15.134:46548) 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd218b0a640 1 -- 172.21.15.134:0/3075273653 learned_addr learned my addr 172.21.15.134:0/3075273653 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd213fff640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc003b70 0x7fd2140aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.329+0000 7fd2137fe640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 0x7fd214156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 -- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 msgr2=0x7fd214156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 0x7fd214156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 -- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc003b70 msgr2=0x7fd2140aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc003b70 0x7fd2140aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 -- 172.21.15.134:0/3075273653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd214156cb0 con 0x7fd214149930 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd2137fe640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 0x7fd214156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd218b0a640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fd20c000f80 tx=0x7fd20c00a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00acc0 con 0x7fd214149930 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c019070 con 0x7fd214149930 2024-09-15T22:46:28.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2141f4220 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c013630 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.330+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2141f47e0 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.331+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2140b5480 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.331+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7fd20c0137d0 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.332+0000 7fd210ff9640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 0x7fd20006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.332+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7fd20c08bea0 con 0x7fd214149930 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.332+0000 7fd213fff640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 0x7fd20006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.333+0000 7fd213fff640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 0x7fd20006ea40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd204033000 tx=0x7fd204008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.336+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd20c05a260 con 0x7fd214149930 2024-09-15T22:46:28.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.525+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone39651", "target": ["mon-mgr", ""]}) -- 0x7fd214071400 con 0x7fd20006c580 2024-09-15T22:46:28.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.543+0000 7fd210ff9640 1 -- 172.21.15.134:0/3075273653 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd214071400 con 0x7fd20006c580 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 msgr2=0x7fd20006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 0x7fd20006ea40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd204033000 tx=0x7fd204008030 comp rx=0 tx=0).stop 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 msgr2=0x7fd214149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fd20c000f80 tx=0x7fd20c00a6c0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 shutdown_connections 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd20006c580 0x7fd20006ea40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd214149930 0x7fd214149db0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2141560d0 0x7fd214156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 --2- 172.21.15.134:0/3075273653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1fc003b70 0x7fd2140aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 >> 172.21.15.134:0/3075273653 conn(0x7fd21406bba0 msgr2=0x7fd21406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:28.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 shutdown_connections 2024-09-15T22:46:28.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.545+0000 7fd21a56d640 1 -- 172.21.15.134:0/3075273653 wait complete. 2024-09-15T22:46:28.559 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:46:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:46:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:46:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:28.618 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:46:28.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:46:28.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:46:28.714 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:46:28.714 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:46:28.714 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:28.714 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:28.729 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:28.730 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:28.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:46:28.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.924+0000 7f0f2c480640 1 Processor -- start 2024-09-15T22:46:28.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.924+0000 7f0f2c480640 1 -- start start 2024-09-15T22:46:28.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2c480640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f240cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2c480640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f2406c1f0 0x7f0f2415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2c480640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f240cd5f0 con 0x7f0f2406be10 2024-09-15T22:46:28.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2c480640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0f240cd8d0 con 0x7f0f2406c1f0 2024-09-15T22:46:28.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2c480640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f240cdbb0 con 0x7f0f24151c50 2024-09-15T22:46:28.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2a21c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0f2406be10 0x7f0f24151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37984/0 (socket says 172.21.15.134:37984) 2024-09-15T22:46:28.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.925+0000 7f0f2a21c640 1 -- 172.21.15.134:0/3887147538 learned_addr learned my addr 172.21.15.134:0/3887147538 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:28.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546794806 0 0) 0x7f0f240cd5f0 con 0x7f0f2406be10 2024-09-15T22:46:28.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f0c003520 con 0x7f0f2406be10 2024-09-15T22:46:28.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f240cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2aa1d640 1 --2- 172.21.15.134:0/3887147538 >> v2:172.21.15.177:3300/0 conn(0x7f0f2406c1f0 0x7f0f2415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1621162783 0 0) 0x7f0f0c003520 con 0x7f0f2406be10 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 msgr2=0x7f0f240cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f240cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 >> v2:172.21.15.177:3300/0 conn(0x7f0f2406c1f0 msgr2=0x7f0f2415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 --2- 172.21.15.134:0/3887147538 >> v2:172.21.15.177:3300/0 conn(0x7f0f2406c1f0 0x7f0f2415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f240cde90 con 0x7f0f2406be10 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0f140019f0 con 0x7f0f2406be10 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 >> v1:172.21.15.134:6789/0 conn(0x7f0f2406be10 legacy=0x7f0f24151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f0c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0c004d40 0x7f0f0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240cd8d0 con 0x7f0f0c003fe0 2024-09-15T22:46:28.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240cdbb0 con 0x7f0f0c004d40 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0c00bac0 con 0x7f0f24151c50 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2aa1d640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0c004d40 0x7f0f0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f2a21c640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f0c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 -- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 msgr2=0x7f0f0c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f24151c50 0x7f0f0c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 -- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0c004d40 msgr2=0x7f0f0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0c004d40 0x7f0f0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.926+0000 7f0f29a1b640 1 -- 172.21.15.134:0/3887147538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c003520 con 0x7f0f0c003fe0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.927+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004800 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800ba30 tx=0x7f0f0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f197af74f4a560c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.927+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18030070 con 0x7f0f0c003fe0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.927+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1802ade0 con 0x7f0f0c003fe0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.927+0000 7f0f2921a640 1 -- 172.21.15.134:0/3887147538 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800b600 con 0x7f0f0c003fe0 2024-09-15T22:46:28.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 -- 172.21.15.134:0/3887147538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f0c003fe0 msgr2=0x7f0f0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 --2- 172.21.15.134:0/3887147538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004800 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800ba30 tx=0x7f0f0c005830 comp rx=0 tx=0).stop 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2aa1d640 1 -- 172.21.15.134:0/3887147538 reap_dead start 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 -- 172.21.15.134:0/3887147538 shutdown_connections 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 -- 172.21.15.134:0/3887147538 >> 172.21.15.134:0/3887147538 conn(0x7f0f24062cc0 msgr2=0x7f0f2406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 -- 172.21.15.134:0/3887147538 shutdown_connections 2024-09-15T22:46:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.928+0000 7f0f2c480640 1 -- 172.21.15.134:0/3887147538 wait complete. 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.929+0000 7f0f2c480640 1 Processor -- start 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.929+0000 7f0f2c480640 1 -- start start 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 0x7f0f241429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f24144790 0x7f0f24159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240cd010 con 0x7f0f2415a470 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240ce690 con 0x7f0f24144790 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f240cd190 con 0x7f0f0c003fe0 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46564/0 (socket says 172.21.15.134:46564) 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 -- 172.21.15.134:0/1820419485 learned_addr learned my addr 172.21.15.134:0/1820419485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f29a1b640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f24144790 0x7f0f24159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2a21c640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 0x7f0f241429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 -- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 msgr2=0x7f0f241429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 0x7f0f241429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 -- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f24144790 msgr2=0x7f0f24159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f24144790 0x7f0f24159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 -- 172.21.15.134:0/1820419485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f24150260 con 0x7f0f2415a470 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2a21c640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 0x7f0f241429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2aa1d640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f0f240cc5b0 tx=0x7f0f1c00bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c010780 con 0x7f0f2415a470 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c01b070 con 0x7f0f2415a470 2024-09-15T22:46:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f24150540 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c010ba0 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.930+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f24150b00 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.931+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2415baa0 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.932+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 91101+0+0 (secure 0 0 0) 0x7f0f1c012040 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.932+0000 7f0f22ffd640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 0x7f0f1006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.932+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f0f1c08b6b0 con 0x7f0f2415a470 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.933+0000 7f0f2a21c640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 0x7f0f1006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.933+0000 7f0f2a21c640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 0x7f0f1006ea40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f14004c20 tx=0x7f0f14006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:28.937+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f1c059a70 con 0x7f0f2415a470 2024-09-15T22:46:29.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.117+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f240afd90 con 0x7f0f2415a470 2024-09-15T22:46:29.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.117+0000 7f0f22ffd640 1 -- 172.21.15.134:0/1820419485 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) ==== 80+0+0 (secure 0 0 0) 0x7f0f1c059370 con 0x7f0f2415a470 2024-09-15T22:46:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 msgr2=0x7f0f1006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 0x7f0f1006ea40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f14004c20 tx=0x7f0f14006040 comp rx=0 tx=0).stop 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 msgr2=0x7f0f24148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f0f240cc5b0 tx=0x7f0f1c00bb80 comp rx=0 tx=0).stop 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 shutdown_connections 2024-09-15T22:46:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f1006c580 0x7f0f1006ea40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f2415a470 0x7f0f24148a90 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f24144790 0x7f0f24159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 --2- 172.21.15.134:0/1820419485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f0c003fe0 0x7f0f241429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 >> 172.21.15.134:0/1820419485 conn(0x7f0f24062cc0 msgr2=0x7f0f241590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 shutdown_connections 2024-09-15T22:46:29.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.119+0000 7f0f2c480640 1 -- 172.21.15.134:0/1820419485 wait complete. 2024-09-15T22:46:29.132 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:46:29.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:29.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:29.172 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:46:29.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:29.172 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:46:29.228 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:46:29.228 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:29.228 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:29.246 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:29.246 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:29.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:46:29.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.404+0000 7fe115ea6640 1 Processor -- start 2024-09-15T22:46:29.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.404+0000 7fe115ea6640 1 -- start start 2024-09-15T22:46:29.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.404+0000 7fe115ea6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe1100b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.404+0000 7fe115ea6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe110073840 0x7fe110168d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe115ea6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe110071700 con 0x7fe1100d1fa0 2024-09-15T22:46:29.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe115ea6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe1100d1d30 con 0x7fe110073840 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe115ea6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe1100d1a50 con 0x7fe1100b6db0 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe1100b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe110073840 0x7fe110168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe107fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe1100d1fa0 0x7fe110073130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:60270/0 (socket says 172.21.15.134:60270) 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe107fff640 1 -- 172.21.15.134:0/1486322729 learned_addr learned my addr 172.21.15.134:0/1486322729 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10ffff640 1 -- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 msgr2=0x7fe1100b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10ffff640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe1100b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10ffff640 1 -- 172.21.15.134:0/1486322729 >> v1:172.21.15.177:6789/0 conn(0x7fe1100d1fa0 legacy=0x7fe110073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10ffff640 1 -- 172.21.15.134:0/1486322729 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110070940 con 0x7fe110073840 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.405+0000 7fe10f7fe640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe1100b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.406+0000 7fe10ffff640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe110168d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe108009d90 tx=0x7fe10802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d30b7739df62599 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.406+0000 7fe10effd640 1 -- 172.21.15.134:0/1486322729 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108007740 con 0x7fe110073840 2024-09-15T22:46:29.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.406+0000 7fe10effd640 1 -- 172.21.15.134:0/1486322729 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080078e0 con 0x7fe110073840 2024-09-15T22:46:29.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.406+0000 7fe10effd640 1 -- 172.21.15.134:0/1486322729 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108007cb0 con 0x7fe110073840 2024-09-15T22:46:29.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 -- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 msgr2=0x7fe110168d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe110168d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe108009d90 tx=0x7fe10802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 -- 172.21.15.134:0/1486322729 shutdown_connections 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe110168d50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 --2- 172.21.15.134:0/1486322729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe1100b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 -- 172.21.15.134:0/1486322729 >> 172.21.15.134:0/1486322729 conn(0x7fe1100b4220 msgr2=0x7fe1100b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 -- 172.21.15.134:0/1486322729 shutdown_connections 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.407+0000 7fe115ea6640 1 -- 172.21.15.134:0/1486322729 wait complete. 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.408+0000 7fe115ea6640 1 Processor -- start 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.408+0000 7fe115ea6640 1 -- start start 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe110139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100711e0 con 0x7fe1100d1fa0 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe110070f00 con 0x7fe110073840 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe115ea6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe11006dcc0 con 0x7fe1100b6db0 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39824/0 (socket says 172.21.15.134:39824) 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 -- 172.21.15.134:0/569147794 learned_addr learned my addr 172.21.15.134:0/569147794 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46576/0 (socket says 172.21.15.134:46576) 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe107fff640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe110139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 -- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 msgr2=0x7fe110139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe110139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 -- 172.21.15.134:0/569147794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 msgr2=0x7fe1101e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 -- 172.21.15.134:0/569147794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110159bf0 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10ffff640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10f7fe640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e960 tx=0x7fe10000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100017070 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.409+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10000ca00 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.410+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe110159ef0 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.410+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10000cdd0 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.410+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11015a790 con 0x7fe110073840 2024-09-15T22:46:29.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.410+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1100719f0 con 0x7fe110073840 2024-09-15T22:46:29.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.411+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fe10001a070 con 0x7fe110073840 2024-09-15T22:46:29.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.411+0000 7fe10cff9640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 0x7fe0f006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.412+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7fe10008bdd0 con 0x7fe110073840 2024-09-15T22:46:29.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.412+0000 7fe107fff640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 0x7fe0f006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.412+0000 7fe107fff640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 0x7fe0f006eb60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe110143940 tx=0x7fe0f8007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.416+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1000598c0 con 0x7fe110073840 2024-09-15T22:46:29.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.592+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe11015dc60 con 0x7fe110073840 2024-09-15T22:46:29.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.593+0000 7fe10cff9640 1 -- 172.21.15.134:0/569147794 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) ==== 80+0+0 (secure 0 0 0) 0x7fe10005dbc0 con 0x7fe110073840 2024-09-15T22:46:29.594 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:46:29.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 msgr2=0x7fe0f006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 0x7fe0f006eb60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe110143940 tx=0x7fe0f8007e80 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 msgr2=0x7fe11015acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e960 tx=0x7fe10000ee20 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 shutdown_connections 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0f006c6a0 0x7fe0f006eb60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1100d1fa0 0x7fe1101e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1100b6db0 0x7fe110139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 --2- 172.21.15.134:0/569147794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe110073840 0x7fe11015acb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 >> 172.21.15.134:0/569147794 conn(0x7fe1100b4220 msgr2=0x7fe11015d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 shutdown_connections 2024-09-15T22:46:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.595+0000 7fe115ea6640 1 -- 172.21.15.134:0/569147794 wait complete. 2024-09-15T22:46:29.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:46:29.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:29.607 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:29.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:46:29.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:29.639 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:46:29.696 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:46:29.697 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:29.697 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:29.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:46:29.713 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:46:29.713 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:29.713 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:29.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:46:29.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.854+0000 7f3c29d8d640 1 Processor -- start 2024-09-15T22:46:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.854+0000 7f3c29d8d640 1 -- start start 2024-09-15T22:46:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.854+0000 7f3c29d8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3c2415ed20 0x7f3c240b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.854+0000 7f3c29d8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 0x7f3c240b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c29d8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c240b7170 con 0x7f3c2415e940 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c29d8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3c240b7aa0 con 0x7f3c2415ed20 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c29d8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3c240d3660 con 0x7f3c240cef90 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3c2415ed20 0x7f3c240b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c237fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3c2415e940 0x7f3c240d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37994/0 (socket says 172.21.15.134:37994) 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3c2415ed20 0x7f3c240b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46580/0 (socket says 172.21.15.134:46580) 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c237fe640 1 -- 172.21.15.134:0/3557916447 learned_addr learned my addr 172.21.15.134:0/3557916447 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c23fff640 1 --2- 172.21.15.134:0/3557916447 >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 0x7f3c240b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 -- 172.21.15.134:0/3557916447 >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 msgr2=0x7f3c240b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 --2- 172.21.15.134:0/3557916447 >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 0x7f3c240b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c227fc640 1 -- 172.21.15.134:0/3557916447 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088220758 0 0) 0x7f3c14001110 con 0x7f3c2415e940 2024-09-15T22:46:29.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 -- 172.21.15.134:0/3557916447 >> v1:172.21.15.134:6789/0 conn(0x7f3c2415e940 legacy=0x7f3c240d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c22ffd640 1 -- 172.21.15.134:0/3557916447 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240d3940 con 0x7f3c2415ed20 2024-09-15T22:46:29.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.855+0000 7f3c23fff640 1 --2- 172.21.15.134:0/3557916447 >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 0x7f3c240b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c22ffd640 1 --2- 172.21.15.134:0/3557916447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c240b3220 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406d070 tx=0x7f3c1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8629c0c9a5bb2be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c227fc640 1 -- 172.21.15.134:0/3557916447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18037070 con 0x7f3c2415ed20 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c227fc640 1 -- 172.21.15.134:0/3557916447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18032440 con 0x7f3c2415ed20 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c227fc640 1 -- 172.21.15.134:0/3557916447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18032810 con 0x7f3c2415ed20 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 -- 172.21.15.134:0/3557916447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 msgr2=0x7f3c240b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/3557916447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c240b3220 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406d070 tx=0x7f3c1802a230 comp rx=0 tx=0).stop 2024-09-15T22:46:29.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 -- 172.21.15.134:0/3557916447 shutdown_connections 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/3557916447 >> v2:172.21.15.177:3300/0 conn(0x7f3c240cef90 0x7f3c240b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/3557916447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c240b3220 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 -- 172.21.15.134:0/3557916447 >> 172.21.15.134:0/3557916447 conn(0x7f3c240b6240 msgr2=0x7f3c240b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 -- 172.21.15.134:0/3557916447 shutdown_connections 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.856+0000 7f3c29d8d640 1 -- 172.21.15.134:0/3557916447 wait complete. 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.858+0000 7f3c29d8d640 1 Processor -- start 2024-09-15T22:46:29.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.858+0000 7f3c29d8d640 1 -- start start 2024-09-15T22:46:29.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.858+0000 7f3c29d8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c240cef90 0x7f3c24157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c2415e940 0x7f3c240ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240d3310 con 0x7f3c2415ed20 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240d3f00 con 0x7f3c2415e940 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3c240d1ef0 con 0x7f3c240cef90 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46588/0 (socket says 172.21.15.134:46588) 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 -- 172.21.15.134:0/4223637164 learned_addr learned my addr 172.21.15.134:0/4223637164 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c22ffd640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c2415e940 0x7f3c240ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c237fe640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c240cef90 0x7f3c24157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 -- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c240cef90 msgr2=0x7f3c24157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c240cef90 0x7f3c24157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 -- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c2415e940 msgr2=0x7f3c240ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:29.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c2415e940 0x7f3c240ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 -- 172.21.15.134:0/4223637164 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c24159a30 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c23fff640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00cf20 tx=0x7f3c1c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c01a070 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c00d840 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c00dc30 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c24159cd0 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.859+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c240ab7f0 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.860+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c240d1060 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.861+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f3c1c01d070 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.861+0000 7f3c0bfff640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 0x7f3c1006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.861+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f3c1c08c400 con 0x7f3c2415ed20 2024-09-15T22:46:29.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.861+0000 7f3c237fe640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 0x7f3c1006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:29.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.862+0000 7f3c237fe640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 0x7f3c1006eb60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3c14000f60 tx=0x7f3c14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:29.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:29.865+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c1c05a5c0 con 0x7f3c2415ed20 2024-09-15T22:46:30.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.067+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c240ba6b0 con 0x7f3c2415ed20 2024-09-15T22:46:30.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.067+0000 7f3c0bfff640 1 -- 172.21.15.134:0/4223637164 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7f3c1c059ec0 con 0x7f3c2415ed20 2024-09-15T22:46:30.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:30.069 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":54,"btime":"2024-09-15T22:46:03:016576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:46:30.069 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 54 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 msgr2=0x7f3c1006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 0x7f3c1006eb60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3c14000f60 tx=0x7f3c14009040 comp rx=0 tx=0).stop 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 msgr2=0x7f3c2414e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00cf20 tx=0x7f3c1c00a7d0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 shutdown_connections 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3c1006c6a0 0x7f3c1006eb60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2415ed20 0x7f3c2414e720 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c2415e940 0x7f3c240ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 --2- 172.21.15.134:0/4223637164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c240cef90 0x7f3c24157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.069+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 >> 172.21.15.134:0/4223637164 conn(0x7f3c240b6240 msgr2=0x7f3c24160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.070+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 shutdown_connections 2024-09-15T22:46:30.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.070+0000 7f3c29d8d640 1 -- 172.21.15.134:0/4223637164 wait complete. 2024-09-15T22:46:30.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:30.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.179+0000 7f90e4ee6640 1 Processor -- start 2024-09-15T22:46:30.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.179+0000 7f90e4ee6640 1 -- start start 2024-09-15T22:46:30.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90e0156880 0x7f90e00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 0x7f90e0160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f90e00b0880 con 0x7f90e0156880 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f90e00ce150 con 0x7f90e00b65c0 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90e4ee6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90e00ce430 con 0x7f90e00aff30 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90e0156880 0x7f90e00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90e0156880 0x7f90e00cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46594/0 (socket says 172.21.15.134:46594) 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 -- 172.21.15.134:0/3673206950 learned_addr learned my addr 172.21.15.134:0/3673206950 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90ded9d640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90ddd9b640 1 --2- 172.21.15.134:0/3673206950 >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 0x7f90e0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 -- 172.21.15.134:0/3673206950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 msgr2=0x7f90e00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 -- 172.21.15.134:0/3673206950 >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 msgr2=0x7f90e0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 --2- 172.21.15.134:0/3673206950 >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 0x7f90e0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90de59c640 1 -- 172.21.15.134:0/3673206950 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e015ff30 con 0x7f90e0156880 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90ded9d640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.180+0000 7f90ddd9b640 1 --2- 172.21.15.134:0/3673206950 >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 0x7f90e0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.181+0000 7f90de59c640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e00cdae0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cfa40 tx=0x7f90d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70649551f5b8117 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.181+0000 7f90dd59a640 1 -- 172.21.15.134:0/3673206950 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0037070 con 0x7f90e0156880 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.181+0000 7f90dd59a640 1 -- 172.21.15.134:0/3673206950 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0032440 con 0x7f90e0156880 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.181+0000 7f90dd59a640 1 -- 172.21.15.134:0/3673206950 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0032810 con 0x7f90e0156880 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 -- 172.21.15.134:0/3673206950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 msgr2=0x7f90e00cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e00cdae0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cfa40 tx=0x7f90d002a140 comp rx=0 tx=0).stop 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 -- 172.21.15.134:0/3673206950 shutdown_connections 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/3673206950 >> v2:172.21.15.177:3300/0 conn(0x7f90e00b65c0 0x7f90e0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/3673206950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e00cdae0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 -- 172.21.15.134:0/3673206950 >> 172.21.15.134:0/3673206950 conn(0x7f90e006cae0 msgr2=0x7f90e006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 -- 172.21.15.134:0/3673206950 shutdown_connections 2024-09-15T22:46:30.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.182+0000 7f90e4ee6640 1 -- 172.21.15.134:0/3673206950 wait complete. 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.183+0000 7f90e4ee6640 1 Processor -- start 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.183+0000 7f90e4ee6640 1 -- start start 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e0145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 0x7f90e0142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00b6a30 con 0x7f90e0156880 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0156c60 con 0x7f90e00b65c0 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90e0160c70 con 0x7f90e00aff30 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46608/0 (socket says 172.21.15.134:46608) 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 -- 172.21.15.134:0/1405631237 learned_addr learned my addr 172.21.15.134:0/1405631237 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ddd9b640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 0x7f90e0142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 -- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 msgr2=0x7f90e0145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e0145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 -- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 msgr2=0x7f90e0142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 0x7f90e0142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 -- 172.21.15.134:0/1405631237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e0142970 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ddd9b640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 0x7f90e0142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ded9d640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f90d800cf20 tx=0x7f90d800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d801a070 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d800d840 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d800dc30 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.184+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e01431a0 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.185+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e0143720 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.185+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e00ce710 con 0x7f90e0156880 2024-09-15T22:46:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.186+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f90d801d070 con 0x7f90e0156880 2024-09-15T22:46:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.186+0000 7f90ceffd640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 0x7f90c006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.187+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f90d808c490 con 0x7f90e0156880 2024-09-15T22:46:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.187+0000 7f90de59c640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 0x7f90c006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.187+0000 7f90de59c640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 0x7f90c006eb60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90d0034000 tx=0x7f90d002c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.191+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90d805a5c0 con 0x7f90e0156880 2024-09-15T22:46:30.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.391+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90e015f090 con 0x7f90e0156880 2024-09-15T22:46:30.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.391+0000 7f90ceffd640 1 -- 172.21.15.134:0/1405631237 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7f90d8059ec0 con 0x7f90e0156880 2024-09-15T22:46:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:30.393 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":54,"btime":"2024-09-15T22:46:03:016576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:46:30.393 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 54 2024-09-15T22:46:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.393+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 msgr2=0x7f90c006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.393+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 0x7f90c006eb60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90d0034000 tx=0x7f90d002c000 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.393+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 msgr2=0x7f90e0142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.393+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f90d800cf20 tx=0x7f90d800a7d0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 shutdown_connections 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90c006c6a0 0x7f90c006eb60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90e0156880 0x7f90e0142c60 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00b65c0 0x7f90e0142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 --2- 172.21.15.134:0/1405631237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e00aff30 0x7f90e0145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 >> 172.21.15.134:0/1405631237 conn(0x7f90e006cae0 msgr2=0x7f90e006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 shutdown_connections 2024-09-15T22:46:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.394+0000 7f90e4ee6640 1 -- 172.21.15.134:0/1405631237 wait complete. 2024-09-15T22:46:30.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:30.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.502+0000 7f6215053640 1 Processor -- start 2024-09-15T22:46:30.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.502+0000 7f6215053640 1 -- start start 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f6215053640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f621015c180 0x7f62100cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f6215053640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100ce740 con 0x7f6210073120 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f6215053640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6210072640 con 0x7f62100ce230 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f6215053640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6210072920 con 0x7f621015c180 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f620f59e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6210073120 0x7f621006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38004/0 (socket says 172.21.15.134:38004) 2024-09-15T22:46:30.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f620f59e640 1 -- 172.21.15.134:0/2693810268 learned_addr learned my addr 172.21.15.134:0/2693810268 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f620ed9d640 1 --2- 172.21.15.134:0/2693810268 >> v2:172.21.15.177:3300/0 conn(0x7f621015c180 0x7f62100cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.503+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681050774 0 0) 0x7f62100ce740 con 0x7f6210073120 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f8003520 con 0x7f6210073120 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566362912 0 0) 0x7f6210072640 con 0x7f62100ce230 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62100ce740 con 0x7f62100ce230 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 780635113 0 0) 0x7f61f8003520 con 0x7f6210073120 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 >> v2:172.21.15.177:3300/0 conn(0x7f621015c180 msgr2=0x7f62100cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 --2- 172.21.15.134:0/2693810268 >> v2:172.21.15.177:3300/0 conn(0x7f621015c180 0x7f62100cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 >> v1:172.21.15.177:6789/0 conn(0x7f62100ce230 legacy=0x7f62100cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6210072c00 con 0x7f6210073120 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f62080019f0 con 0x7f6210073120 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 >> v1:172.21.15.134:6789/0 conn(0x7f6210073120 legacy=0x7f621006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f8003b40 0x7f61f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f61f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f80051c0 0x7f61f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6210072920 con 0x7f61f8004800 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61f800c0f0 con 0x7f61f8003b40 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f61f800c2f0 con 0x7f61f80051c0 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f61f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620ed9d640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f8003b40 0x7f61f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620f59e640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f80051c0 0x7f61f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 -- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f80051c0 msgr2=0x7f61f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f80051c0 0x7f61f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 -- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f8003b40 msgr2=0x7f61f8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f8003b40 0x7f61f8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620e59c640 1 -- 172.21.15.134:0/2693810268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f8003520 con 0x7f61f8004800 2024-09-15T22:46:30.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.504+0000 7f620f59e640 1 -- 172.21.15.134:0/2693810268 reap_dead start 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f620e59c640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f61f8004c80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f62040018d0 tx=0x7f61f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33b98edce7ec3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040014f0 con 0x7f61f8004800 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62040052d0 con 0x7f61f8004800 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f620dd9b640 1 -- 172.21.15.134:0/2693810268 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620402ac70 con 0x7f61f8004800 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f6215053640 1 -- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 msgr2=0x7f61f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.505+0000 7f6215053640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f61f8004c80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f62040018d0 tx=0x7f61f8005830 comp rx=0 tx=0).stop 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.506+0000 7f6215053640 1 -- 172.21.15.134:0/2693810268 shutdown_connections 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.506+0000 7f6215053640 1 --2- 172.21.15.134:0/2693810268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f61f8004c80 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.506+0000 7f6215053640 1 -- 172.21.15.134:0/2693810268 >> 172.21.15.134:0/2693810268 conn(0x7f6210062cc0 msgr2=0x7f621006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.506+0000 7f6215053640 1 -- 172.21.15.134:0/2693810268 shutdown_connections 2024-09-15T22:46:30.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.506+0000 7f6215053640 1 -- 172.21.15.134:0/2693810268 wait complete. 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.507+0000 7f6215053640 1 Processor -- start 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.507+0000 7f6215053640 1 -- start start 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 0x7f62101593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62100ae8a0 0x7f62100aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f621015c560 con 0x7f61f8004800 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62100722f0 con 0x7f62100ae8a0 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f621015c6e0 con 0x7f6210145920 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46628/0 (socket says 172.21.15.134:46628) 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 -- 172.21.15.134:0/1993671399 learned_addr learned my addr 172.21.15.134:0/1993671399 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:30.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620f59e640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62100ae8a0 0x7f62100aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620e59c640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 0x7f62101593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 -- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 msgr2=0x7f62101593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 0x7f62101593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 -- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62100ae8a0 msgr2=0x7f62100aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62100ae8a0 0x7f62100aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 -- 172.21.15.134:0/1993671399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62101460c0 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620e59c640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 0x7f62101593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f620ed9d640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a70 tx=0x7f6200011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620000fb50 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620000fcf0 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.508+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6210159b20 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.509+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620000fea0 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.509+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621015a0e0 con 0x7f61f8004800 2024-09-15T22:46:30.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.510+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62100712e0 con 0x7f61f8004800 2024-09-15T22:46:30.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.510+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f6200012040 con 0x7f61f8004800 2024-09-15T22:46:30.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.510+0000 7f61f77fe640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 0x7f61fc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.511+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f620008c1b0 con 0x7f61f8004800 2024-09-15T22:46:30.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.511+0000 7f620e59c640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 0x7f61fc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.511+0000 7f620e59c640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 0x7f61fc06eb60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6204032000 tx=0x7f6204009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.515+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62100712e0 con 0x7f61f8004800 2024-09-15T22:46:30.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.680+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62100cdcf0 con 0x7f61f8004800 2024-09-15T22:46:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.681+0000 7f61f77fe640 1 -- 172.21.15.134:0/1993671399 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16911 (secure 0 0 0) 0x7f6200019030 con 0x7f61f8004800 2024-09-15T22:46:30.682 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:30.683 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":109,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:13.053167+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:52.924930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:53.279132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.7","mappings":[{"from":4,"to":3}]},{"pgid":"17.e","mappings":[{"from":6,"to":1}]},{"pgid":"17.28","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:30.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 msgr2=0x7f61fc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 0x7f61fc06eb60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6204032000 tx=0x7f6204009030 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 msgr2=0x7f621015b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a70 tx=0x7f6200011f30 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 shutdown_connections 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62100ae8a0 0x7f62100aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6210145920 0x7f62101593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61fc06c6a0 0x7f61fc06eb60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 --2- 172.21.15.134:0/1993671399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61f8004800 0x7f621015b750 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 >> 172.21.15.134:0/1993671399 conn(0x7f6210062cc0 msgr2=0x7f62100b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 shutdown_connections 2024-09-15T22:46:30.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.683+0000 7f6215053640 1 -- 172.21.15.134:0/1993671399 wait complete. 2024-09-15T22:46:30.696 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:46:30.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:30.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.793+0000 7f145c1c4640 1 Processor -- start 2024-09-15T22:46:30.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.793+0000 7f145c1c4640 1 -- start start 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14540d02a0 0x7f14540d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f145415ca40 0x7f145415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14541594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f14540d0bc0 con 0x7f145415ca40 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f145415d390 con 0x7f14540d02a0 2024-09-15T22:46:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145c1c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f145415d670 con 0x7f145415ceb0 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145975f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f145415ca40 0x7f145415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145975f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f145415ca40 0x7f145415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46640/0 (socket says 172.21.15.134:46640) 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145975f640 1 -- 172.21.15.134:0/719762888 learned_addr learned my addr 172.21.15.134:0/719762888 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f1459f60640 1 --2- 172.21.15.134:0/719762888 >> v2:172.21.15.177:3300/0 conn(0x7f14540d02a0 0x7f14540d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.794+0000 7f145a761640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14541594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 -- 172.21.15.134:0/719762888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 msgr2=0x7f14541594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14541594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 -- 172.21.15.134:0/719762888 >> v2:172.21.15.177:3300/0 conn(0x7f14540d02a0 msgr2=0x7f14540d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 --2- 172.21.15.134:0/719762888 >> v2:172.21.15.177:3300/0 conn(0x7f14540d02a0 0x7f14540d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 -- 172.21.15.134:0/719762888 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145415d950 con 0x7f145415ca40 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f145975f640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f145415e430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f145406f030 tx=0x7f144402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f345e3df15eb23c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.795+0000 7f1458f5e640 1 -- 172.21.15.134:0/719762888 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444037070 con 0x7f145415ca40 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f1458f5e640 1 -- 172.21.15.134:0/719762888 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1444032440 con 0x7f145415ca40 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f1458f5e640 1 -- 172.21.15.134:0/719762888 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444032810 con 0x7f145415ca40 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 -- 172.21.15.134:0/719762888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 msgr2=0x7f145415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f145415e430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f145406f030 tx=0x7f144402a140 comp rx=0 tx=0).stop 2024-09-15T22:46:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 -- 172.21.15.134:0/719762888 shutdown_connections 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14541594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 --2- 172.21.15.134:0/719762888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f145415e430 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 --2- 172.21.15.134:0/719762888 >> v2:172.21.15.177:3300/0 conn(0x7f14540d02a0 0x7f14540d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 -- 172.21.15.134:0/719762888 >> 172.21.15.134:0/719762888 conn(0x7f1454062cc0 msgr2=0x7f145406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 -- 172.21.15.134:0/719762888 shutdown_connections 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.796+0000 7f145c1c4640 1 -- 172.21.15.134:0/719762888 wait complete. 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.797+0000 7f145c1c4640 1 Processor -- start 2024-09-15T22:46:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.797+0000 7f145c1c4640 1 -- start start 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 0x7f1454149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14540aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1454155b90 con 0x7f145415ca40 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f145415df10 con 0x7f14540d02a0 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145c1c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1454155d10 con 0x7f145415ceb0 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46652/0 (socket says 172.21.15.134:46652) 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 -- 172.21.15.134:0/1648684143 learned_addr learned my addr 172.21.15.134:0/1648684143 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145a761640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14540aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f1459f60640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 0x7f1454149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 -- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 msgr2=0x7f14540aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14540aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 -- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 msgr2=0x7f1454149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 0x7f1454149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f145975f640 1 -- 172.21.15.134:0/1648684143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14540cdc20 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.798+0000 7f1459f60640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 0x7f1454149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f145975f640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f144402a180 tx=0x7f14440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444041020 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144403d620 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14540cdf00 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444037040 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.799+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14540d0850 con 0x7f145415ca40 2024-09-15T22:46:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.800+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14540b4790 con 0x7f145415ca40 2024-09-15T22:46:30.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.800+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f1444044020 con 0x7f145415ca40 2024-09-15T22:46:30.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.801+0000 7f144a7fc640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 0x7f143806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:30.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.801+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f14440ac160 con 0x7f145415ca40 2024-09-15T22:46:30.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.801+0000 7f1459f60640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 0x7f143806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:30.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.801+0000 7f1459f60640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 0x7f143806eb60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14500099a0 tx=0x7f1450008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:30.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:30.805+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f144404b030 con 0x7f145415ca40 2024-09-15T22:46:31.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.009+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1454063470 con 0x7f145415ca40 2024-09-15T22:46:31.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.009+0000 7f144a7fc640 1 -- 172.21.15.134:0/1648684143 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7f144407a3a0 con 0x7f145415ca40 2024-09-15T22:46:31.011 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:31.011 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":54,"btime":"2024-09-15T22:46:03:016576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:46:31.011 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 54 2024-09-15T22:46:31.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 msgr2=0x7f143806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 0x7f143806eb60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14500099a0 tx=0x7f1450008040 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 msgr2=0x7f14540ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f144402a180 tx=0x7f14440046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 shutdown_connections 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f145415ceb0 0x7f14540aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f143806c6a0 0x7f143806eb60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f145415ca40 0x7f14540ae8e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 --2- 172.21.15.134:0/1648684143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14540d02a0 0x7f1454149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 >> 172.21.15.134:0/1648684143 conn(0x7f1454062cc0 msgr2=0x7f1454154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 shutdown_connections 2024-09-15T22:46:31.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.011+0000 7f145c1c4640 1 -- 172.21.15.134:0/1648684143 wait complete. 2024-09-15T22:46:31.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:31.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.120+0000 7f4d57ad2640 1 Processor -- start 2024-09-15T22:46:31.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.120+0000 7f4d57ad2640 1 -- start start 2024-09-15T22:46:31.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d57ad2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4d5015c180 0x7f4d500cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d57ad2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d500ce230 0x7f4d500cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d57ad2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d500ce740 con 0x7f4d500cf5b0 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d57ad2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4d50072640 con 0x7f4d500ce230 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d57ad2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4d50072920 con 0x7f4d5015c180 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d500ce230 0x7f4d500cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d500ce230 0x7f4d500cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46664/0 (socket says 172.21.15.134:46664) 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 -- 172.21.15.134:0/4019315532 learned_addr learned my addr 172.21.15.134:0/4019315532 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5586e640 1 --2- 172.21.15.134:0/4019315532 >> v2:172.21.15.177:3300/0 conn(0x7f4d5015c180 0x7f4d500cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 -- 172.21.15.134:0/4019315532 >> v2:172.21.15.177:3300/0 conn(0x7f4d5015c180 msgr2=0x7f4d500cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 --2- 172.21.15.134:0/4019315532 >> v2:172.21.15.177:3300/0 conn(0x7f4d5015c180 0x7f4d500cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 -- 172.21.15.134:0/4019315532 >> v1:172.21.15.177:6789/0 conn(0x7f4d500cf5b0 legacy=0x7f4d50073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.121+0000 7f4d5506d640 1 -- 172.21.15.134:0/4019315532 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d50072c00 con 0x7f4d500ce230 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.122+0000 7f4d5506d640 1 --2- 172.21.15.134:0/4019315532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d500cf070 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4d5006cc10 tx=0x7f4d4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca3441a330d5951 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.122+0000 7f4d5486c640 1 -- 172.21.15.134:0/4019315532 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44037070 con 0x7f4d500ce230 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.122+0000 7f4d5486c640 1 -- 172.21.15.134:0/4019315532 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d44032440 con 0x7f4d500ce230 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.122+0000 7f4d5486c640 1 -- 172.21.15.134:0/4019315532 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44032810 con 0x7f4d500ce230 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 -- 172.21.15.134:0/4019315532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 msgr2=0x7f4d500cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/4019315532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d500cf070 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4d5006cc10 tx=0x7f4d4402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 -- 172.21.15.134:0/4019315532 shutdown_connections 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/4019315532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d500cf070 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/4019315532 >> v2:172.21.15.177:3300/0 conn(0x7f4d5015c180 0x7f4d500cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 -- 172.21.15.134:0/4019315532 >> 172.21.15.134:0/4019315532 conn(0x7f4d50062cc0 msgr2=0x7f4d5006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 -- 172.21.15.134:0/4019315532 shutdown_connections 2024-09-15T22:46:31.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.123+0000 7f4d57ad2640 1 -- 172.21.15.134:0/4019315532 wait complete. 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.124+0000 7f4d57ad2640 1 Processor -- start 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.124+0000 7f4d57ad2640 1 -- start start 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 0x7f4d500cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d5015c180 0x7f4d500cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5015c560 con 0x7f4d500ce230 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500722f0 con 0x7f4d500cf5b0 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5015c6e0 con 0x7f4d5015c180 2024-09-15T22:46:31.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46666/0 (socket says 172.21.15.134:46666) 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 -- 172.21.15.134:0/1107068218 learned_addr learned my addr 172.21.15.134:0/1107068218 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5506d640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 0x7f4d500cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5606f640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d5015c180 0x7f4d500cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 -- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d5015c180 msgr2=0x7f4d500cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d5015c180 0x7f4d500cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 -- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 msgr2=0x7f4d500cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 0x7f4d500cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 -- 172.21.15.134:0/1107068218 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500ab1e0 con 0x7f4d500ce230 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5506d640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 0x7f4d500cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:31.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d5586e640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800e9b0 tx=0x7f4d4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48017070 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4800c9a0 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501600e0 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.125+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800cd90 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.126+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d50160680 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.126+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d500cf070 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.127+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f4d4801a070 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.127+0000 7f4d4e7fc640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 0x7f4d3c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.128+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5796+0+0 (secure 0 0 0) 0x7f4d4808bc10 con 0x7f4d500ce230 2024-09-15T22:46:31.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.128+0000 7f4d5506d640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 0x7f4d3c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.128+0000 7f4d5506d640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 0x7f4d3c06eb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d44034000 tx=0x7f4d4402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.132+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d48059d40 con 0x7f4d500ce230 2024-09-15T22:46:31.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.334+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d50160b90 con 0x7f4d500ce230 2024-09-15T22:46:31.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.334+0000 7f4d4e7fc640 1 -- 172.21.15.134:0/1107068218 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7f4d48059640 con 0x7f4d500ce230 2024-09-15T22:46:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:31.336 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":54,"btime":"2024-09-15T22:46:03:016576+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:45:54.305835+0000","modified":"2024-09-15T22:45:56.317686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/2420464130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2420464130},{"type":"v1","addr":"172.21.15.134:6834","nonce":2420464130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6891,"qdb_cluster":[6891]},"id":8}]} 2024-09-15T22:46:31.337 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 54 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 msgr2=0x7f4d3c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 0x7f4d3c06eb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d44034000 tx=0x7f4d4402e000 comp rx=0 tx=0).stop 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 msgr2=0x7f4d50073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800e9b0 tx=0x7f4d4800ee70 comp rx=0 tx=0).stop 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 shutdown_connections 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d5015c180 0x7f4d500cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d500cf5b0 0x7f4d500cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d3c06c6a0 0x7f4d3c06eb60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 --2- 172.21.15.134:0/1107068218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d500ce230 0x7f4d50073bf0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.336+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 >> 172.21.15.134:0/1107068218 conn(0x7f4d50062cc0 msgr2=0x7f4d5006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.337+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 shutdown_connections 2024-09-15T22:46:31.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.337+0000 7f4d57ad2640 1 -- 172.21.15.134:0/1107068218 wait complete. 2024-09-15T22:46:31.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:31.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.446+0000 7fdf7b9b9640 1 Processor -- start 2024-09-15T22:46:31.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.446+0000 7fdf7b9b9640 1 -- start start 2024-09-15T22:46:31.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.446+0000 7fdf7b9b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf7b9b9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf7b9b9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf740d0bc0 con 0x7fdf7415ca40 2024-09-15T22:46:31.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf7b9b9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7415d390 con 0x7fdf7415ce80 2024-09-15T22:46:31.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf7b9b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7415d670 con 0x7fdf740d02a0 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79f56640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:40738/0 (socket says 172.21.15.134:40738) 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 -- 172.21.15.134:0/4054000967 learned_addr learned my addr 172.21.15.134:0/4054000967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79f56640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39940/0 (socket says 172.21.15.134:39940) 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf78f54640 1 --1- 172.21.15.134:0/4054000967 >> v1:172.21.15.177:6789/0 conn(0x7fdf7415ca40 0x7fdf7415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:60300/0 (socket says 172.21.15.134:60300) 2024-09-15T22:46:31.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 -- 172.21.15.134:0/4054000967 >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 msgr2=0x7fdf741594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:31.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 --2- 172.21.15.134:0/4054000967 >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 -- 172.21.15.134:0/4054000967 >> v1:172.21.15.177:6789/0 conn(0x7fdf7415ca40 legacy=0x7fdf7415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79755640 1 -- 172.21.15.134:0/4054000967 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7415d950 con 0x7fdf740d02a0 2024-09-15T22:46:31.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.447+0000 7fdf79f56640 1 --2- 172.21.15.134:0/4054000967 >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:31.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.448+0000 7fdf79755640 1 --2- 172.21.15.134:0/4054000967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009870 tx=0x7fdf6c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb5371691968807 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.448+0000 7fdf73fff640 1 -- 172.21.15.134:0/4054000967 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c037070 con 0x7fdf740d02a0 2024-09-15T22:46:31.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.448+0000 7fdf73fff640 1 -- 172.21.15.134:0/4054000967 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c032440 con 0x7fdf740d02a0 2024-09-15T22:46:31.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.448+0000 7fdf73fff640 1 -- 172.21.15.134:0/4054000967 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c032810 con 0x7fdf740d02a0 2024-09-15T22:46:31.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/4054000967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 msgr2=0x7fdf740d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/4054000967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009870 tx=0x7fdf6c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/4054000967 shutdown_connections 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/4054000967 >> v2:172.21.15.177:3300/0 conn(0x7fdf7415ce80 0x7fdf741594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/4054000967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf740d02a0 0x7fdf740d0680 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/4054000967 >> 172.21.15.134:0/4054000967 conn(0x7fdf74062cc0 msgr2=0x7fdf7406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/4054000967 shutdown_connections 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.449+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/4054000967 wait complete. 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.450+0000 7fdf7b9b9640 1 Processor -- start 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.450+0000 7fdf7b9b9640 1 -- start start 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740d02a0 0x7fdf741f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf7415ce80 0x7fdf7415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7415eb40 con 0x7fdf7415ca40 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7415df10 con 0x7fdf740d02a0 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf74155b90 con 0x7fdf7415ce80 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46668/0 (socket says 172.21.15.134:46668) 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 -- 172.21.15.134:0/1630640415 learned_addr learned my addr 172.21.15.134:0/1630640415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf79755640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740d02a0 0x7fdf741f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf79f56640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf7415ce80 0x7fdf7415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 -- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf7415ce80 msgr2=0x7fdf7415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf7415ce80 0x7fdf7415bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 -- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740d02a0 msgr2=0x7fdf741f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740d02a0 0x7fdf741f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 -- 172.21.15.134:0/1630640415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf74158840 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf78f54640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c6a0 tx=0x7fdf6800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf680072e0 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf68016020 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf741f46e0 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.451+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68001380 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.452+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf74158560 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.453+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf740b4790 con 0x7fdf7415ca40 2024-09-15T22:46:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.453+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fdf68001520 con 0x7fdf7415ca40 2024-09-15T22:46:31.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.453+0000 7fdf71ffb640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 0x7fdf6006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.454+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5852+0+0 (secure 0 0 0) 0x7fdf6808e270 con 0x7fdf7415ca40 2024-09-15T22:46:31.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.454+0000 7fdf79755640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 0x7fdf6006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.454+0000 7fdf79755640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 0x7fdf6006eb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c034000 tx=0x7fdf6c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.458+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf68020020 con 0x7fdf7415ca40 2024-09-15T22:46:31.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.624+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf740cef10 con 0x7fdf7415ca40 2024-09-15T22:46:31.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.625+0000 7fdf71ffb640 1 -- 172.21.15.134:0/1630640415 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+17022 (secure 0 0 0) 0x7fdf6805c260 con 0x7fdf7415ca40 2024-09-15T22:46:31.627 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:31.627 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":110,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:31.285815+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:45:52.924930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T22:45:53.279132+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.7","mappings":[{"from":4,"to":3}]},{"pgid":"17.e","mappings":[{"from":6,"to":1}]},{"pgid":"17.28","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.627+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 msgr2=0x7fdf6006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.627+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 0x7fdf6006eb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c034000 tx=0x7fdf6c02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.627+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 msgr2=0x7fdf741578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.627+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c6a0 tx=0x7fdf6800caa0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 shutdown_connections 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf7415ce80 0x7fdf7415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf6006c6d0 0x7fdf6006eb90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf7415ca40 0x7fdf741578e0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 --2- 172.21.15.134:0/1630640415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740d02a0 0x7fdf741f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 >> 172.21.15.134:0/1630640415 conn(0x7fdf74062cc0 msgr2=0x7fdf740cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 shutdown_connections 2024-09-15T22:46:31.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.628+0000 7fdf7b9b9640 1 -- 172.21.15.134:0/1630640415 wait complete. 2024-09-15T22:46:31.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:46:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.741+0000 7f3e27ee4640 1 Processor -- start 2024-09-15T22:46:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.741+0000 7f3e27ee4640 1 -- start start 2024-09-15T22:46:31.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e27ee4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e201594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e27ee4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2015d390 con 0x7f3e2015ca40 2024-09-15T22:46:31.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e27ee4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2015d670 con 0x7f3e200d02a0 2024-09-15T22:46:31.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e27ee4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2015d950 con 0x7f3e2015ceb0 2024-09-15T22:46:31.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e2547f640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3e2015ca40 0x7f3e2015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38008/0 (socket says 172.21.15.134:38008) 2024-09-15T22:46:31.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e2547f640 1 -- 172.21.15.134:0/2113289492 learned_addr learned my addr 172.21.15.134:0/2113289492 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:31.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614525602 0 0) 0x7f3e2015d390 con 0x7f3e2015ca40 2024-09-15T22:46:31.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.742+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e0c003520 con 0x7f3e2015ca40 2024-09-15T22:46:31.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e26481640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e201594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102186530 0 0) 0x7f3e0c003520 con 0x7f3e2015ca40 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 msgr2=0x7f3e201594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e201594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 >> v1:172.21.15.177:6789/0 conn(0x7f3e200d02a0 legacy=0x7f3e200d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2015dc30 con 0x7f3e2015ca40 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f3e10001670 con 0x7f3e2015ca40 2024-09-15T22:46:31.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e26481640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e201594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 >> v1:172.21.15.134:6789/0 conn(0x7f3e2015ca40 legacy=0x7f3e2015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e0c0039e0 0x7f3e0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e0c004d90 0x7f3e0c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2015d950 con 0x7f3e0c0039e0 2024-09-15T22:46:31.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c00bc40 con 0x7f3e0c004d90 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c00be40 con 0x7f3e2015ceb0 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e0c0039e0 0x7f3e0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e2547f640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e26481640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e0c004d90 0x7f3e0c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 -- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 msgr2=0x7f3e0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:31.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e2015ceb0 0x7f3e0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 -- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e0c004d90 msgr2=0x7f3e0c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:31.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e0c004d90 0x7f3e0c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e25c80640 1 -- 172.21.15.134:0/2113289492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c003520 con 0x7f3e0c0039e0 2024-09-15T22:46:31.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.743+0000 7f3e26481640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e0c004d90 0x7f3e0c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:31.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e25c80640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e0c0039e0 0x7f3e0c003e00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c001e20 tx=0x7f3e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f0a075e3ac344c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c001a70 con 0x7f3e0c0039e0 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c02ae10 con 0x7f3e0c0039e0 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e24c7e640 1 -- 172.21.15.134:0/2113289492 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003bb0 con 0x7f3e0c0039e0 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e27ee4640 1 -- 172.21.15.134:0/2113289492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e0c0039e0 msgr2=0x7f3e0c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/2113289492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e0c0039e0 0x7f3e0c003e00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c001e20 tx=0x7f3e0c005830 comp rx=0 tx=0).stop 2024-09-15T22:46:31.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.744+0000 7f3e26481640 1 -- 172.21.15.134:0/2113289492 reap_dead start 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.745+0000 7f3e27ee4640 1 -- 172.21.15.134:0/2113289492 shutdown_connections 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.745+0000 7f3e27ee4640 1 -- 172.21.15.134:0/2113289492 >> 172.21.15.134:0/2113289492 conn(0x7f3e20062cc0 msgr2=0x7f3e2006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.745+0000 7f3e27ee4640 1 -- 172.21.15.134:0/2113289492 shutdown_connections 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.745+0000 7f3e27ee4640 1 -- 172.21.15.134:0/2113289492 wait complete. 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 Processor -- start 2024-09-15T22:46:31.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 -- start start 2024-09-15T22:46:31.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e0c0039e0 0x7f3e200aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 0x7f3e20145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20155b90 con 0x7f3e20145850 2024-09-15T22:46:31.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2015eb40 con 0x7f3e20143d00 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.746+0000 7f3e27ee4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3e20155d10 con 0x7f3e0c0039e0 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46672/0 (socket says 172.21.15.134:46672) 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 -- 172.21.15.134:0/1102728401 learned_addr learned my addr 172.21.15.134:0/1102728401 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e25c80640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e0c0039e0 0x7f3e200aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e2547f640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 0x7f3e20145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 -- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e0c0039e0 msgr2=0x7f3e200aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e0c0039e0 0x7f3e200aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 -- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 msgr2=0x7f3e20145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 0x7f3e20145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 -- 172.21.15.134:0/1102728401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e20144270 con 0x7f3e20145850 2024-09-15T22:46:31.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e2547f640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 0x7f3e20145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e26481640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3e2006cd40 tx=0x7f3e1800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18014890 con 0x7f3e20145850 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1801b070 con 0x7f3e20145850 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18014c30 con 0x7f3e20145850 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e20144550 con 0x7f3e20145850 2024-09-15T22:46:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.747+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e20144b10 con 0x7f3e20145850 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.748+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e20074290 con 0x7f3e20145850 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.749+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f3e18012070 con 0x7f3e20145850 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.749+0000 7f3e167fc640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 0x7f3e0406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.749+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5852+0+0 (secure 0 0 0) 0x7f3e1808b710 con 0x7f3e20145850 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.749+0000 7f3e25c80640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 0x7f3e0406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.750+0000 7f3e25c80640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 0x7f3e0406eb60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c032000 tx=0x7f3e1c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:31.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.753+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e20074290 con 0x7f3e20145850 2024-09-15T22:46:31.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.961+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e200b4790 con 0x7f3e20145850 2024-09-15T22:46:31.962 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:46:31.961+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:46:31.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.963+0000 7f3e167fc640 1 -- 172.21.15.134:0/1102728401 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) ==== 161+0+0 (secure 0 0 0) 0x7f3e18059700 con 0x7f3e20145850 2024-09-15T22:46:31.964 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 msgr2=0x7f3e0406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 0x7f3e0406eb60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c032000 tx=0x7f3e1c02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 msgr2=0x7f3e20071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3e2006cd40 tx=0x7f3e1800f670 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 shutdown_connections 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3e0406c6a0 0x7f3e0406eb60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e20145850 0x7f3e20071070 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e20143d00 0x7f3e20145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 --2- 172.21.15.134:0/1102728401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e0c0039e0 0x7f3e200aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 >> 172.21.15.134:0/1102728401 conn(0x7f3e20062cc0 msgr2=0x7f3e200cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:31.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 shutdown_connections 2024-09-15T22:46:31.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:31.965+0000 7f3e27ee4640 1 -- 172.21.15.134:0/1102728401 wait complete. 2024-09-15T22:46:31.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:46:32.006 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:46:32.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.080+0000 7f193a318640 1 Processor -- start 2024-09-15T22:46:32.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.080+0000 7f193a318640 1 -- start start 2024-09-15T22:46:32.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f193a318640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193415b090 0x7f19340b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:32.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f193a318640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1934071de0 con 0x7f19340715b0 2024-09-15T22:46:32.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f193a318640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340720c0 con 0x7f193406ea00 2024-09-15T22:46:32.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f193a318640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f19340723a0 con 0x7f193415b090 2024-09-15T22:46:32.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f1933fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193415b090 0x7f19340b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f192bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f19340715b0 0x7f193415b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38028/0 (socket says 172.21.15.134:38028) 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f1933fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193415b090 0x7f19340b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46692/0 (socket says 172.21.15.134:46692) 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f192bfff640 1 -- 172.21.15.134:0/3528322052 learned_addr learned my addr 172.21.15.134:0/3528322052 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f1933fff640 1 -- 172.21.15.134:0/3528322052 >> v1:172.21.15.177:6789/0 conn(0x7f193406ea00 legacy=0x7f1934164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f1933fff640 1 -- 172.21.15.134:0/3528322052 >> v1:172.21.15.134:6789/0 conn(0x7f19340715b0 legacy=0x7f193415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f1933fff640 1 -- 172.21.15.134:0/3528322052 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1934072680 con 0x7f193415b090 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.081+0000 7f19337fe640 1 -- 172.21.15.134:0/3528322052 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126467157 0 0) 0x7f1934071de0 con 0x7f19340715b0 2024-09-15T22:46:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f1933fff640 1 --2- 172.21.15.134:0/3528322052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193415b090 0x7f19340b5420 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f192400a940 tx=0x7f192402b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f788265438fc21f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f19337fe640 1 -- 172.21.15.134:0/3528322052 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192400b040 con 0x7f193415b090 2024-09-15T22:46:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f19337fe640 1 -- 172.21.15.134:0/3528322052 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1924030710 con 0x7f193415b090 2024-09-15T22:46:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f19337fe640 1 -- 172.21.15.134:0/3528322052 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924030ae0 con 0x7f193415b090 2024-09-15T22:46:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f193a318640 1 -- 172.21.15.134:0/3528322052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193415b090 msgr2=0x7f19340b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.082+0000 7f193a318640 1 --2- 172.21.15.134:0/3528322052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193415b090 0x7f19340b5420 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f192400a940 tx=0x7f192402b5a0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.083+0000 7f193a318640 1 -- 172.21.15.134:0/3528322052 shutdown_connections 2024-09-15T22:46:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.083+0000 7f193a318640 1 --2- 172.21.15.134:0/3528322052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193415b090 0x7f19340b5420 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.083+0000 7f193a318640 1 -- 172.21.15.134:0/3528322052 >> 172.21.15.134:0/3528322052 conn(0x7f193406bba0 msgr2=0x7f193406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.083+0000 7f193a318640 1 -- 172.21.15.134:0/3528322052 shutdown_connections 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.083+0000 7f193a318640 1 -- 172.21.15.134:0/3528322052 wait complete. 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 Processor -- start 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 -- start start 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19340715b0 0x7f19340c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193415b090 0x7f193414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1934071ba0 con 0x7f193406ea00 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1934071a20 con 0x7f193415b090 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f193a318640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f193415bb80 con 0x7f19340715b0 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.084+0000 7f1933fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46708/0 (socket says 172.21.15.134:46708) 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 -- 172.21.15.134:0/806742712 learned_addr learned my addr 172.21.15.134:0/806742712 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f19388b5640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193415b090 0x7f193414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f192bfff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19340715b0 0x7f19340c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 -- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19340715b0 msgr2=0x7f19340c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19340715b0 0x7f19340c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 -- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193415b090 msgr2=0x7f193414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193415b090 0x7f193414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 -- 172.21.15.134:0/806742712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340c7ca0 con 0x7f193406ea00 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f1933fff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f19240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192403f070 con 0x7f193406ea00 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1924033d50 con 0x7f193406ea00 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192403b670 con 0x7f193406ea00 2024-09-15T22:46:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19340c79c0 con 0x7f193406ea00 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.085+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19340c5880 con 0x7f193406ea00 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.086+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193415b470 con 0x7f193406ea00 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.087+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f1924042070 con 0x7f193406ea00 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.087+0000 7f19317fa640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 0x7f191406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.087+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5910+0+0 (secure 0 0 0) 0x7f19240ac960 con 0x7f193406ea00 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.087+0000 7f192bfff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 0x7f191406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.088+0000 7f192bfff640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 0x7f191406eb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1934150660 tx=0x7f191c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.092+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f193415b470 con 0x7f193406ea00 2024-09-15T22:46:32.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.292+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f19341550b0 con 0x7f193406ea00 2024-09-15T22:46:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.964+0000 7f19317fa640 1 -- 172.21.15.134:0/806742712 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7f19340c7ca0 con 0x7f193406ea00 2024-09-15T22:46:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 msgr2=0x7f191406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 0x7f191406eb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1934150660 tx=0x7f191c009040 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 msgr2=0x7f193414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f19240046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 shutdown_connections 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193415b090 0x7f193414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19340715b0 0x7f19340c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191406c6a0 0x7f191406eb60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 --2- 172.21.15.134:0/806742712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406ea00 0x7f193414cf20 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 >> 172.21.15.134:0/806742712 conn(0x7f193406bba0 msgr2=0x7f19340cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 shutdown_connections 2024-09-15T22:46:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:32.967+0000 7f193a318640 1 -- 172.21.15.134:0/806742712 wait complete. 2024-09-15T22:46:32.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:46:33.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.131+0000 7f0f2fc94640 1 Processor -- start 2024-09-15T22:46:33.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.131+0000 7f0f2fc94640 1 -- start start 2024-09-15T22:46:33.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2fc94640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f280ccb80 0x7f0f2815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2fc94640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f2806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2fc94640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280b3570 con 0x7f0f28072d10 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2fc94640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0f280b3850 con 0x7f0f280ccb80 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2fc94640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f280b3b30 con 0x7f0f280b4e20 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f280ccb80 0x7f0f2815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2d22f640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0f28072d10 0x7f0f280b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38044/0 (socket says 172.21.15.134:38044) 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f280ccb80 0x7f0f2815bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46724/0 (socket says 172.21.15.134:46724) 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2d22f640 1 -- 172.21.15.134:0/2998183793 learned_addr learned my addr 172.21.15.134:0/2998183793 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 -- 172.21.15.134:0/2998183793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 msgr2=0x7f0f2806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2998183793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f2806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 -- 172.21.15.134:0/2998183793 >> v1:172.21.15.134:6789/0 conn(0x7f0f28072d10 legacy=0x7f0f280b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2da30640 1 -- 172.21.15.134:0/2998183793 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f280b3e10 con 0x7f0f280ccb80 2024-09-15T22:46:33.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.132+0000 7f0f2ca2e640 1 -- 172.21.15.134:0/2998183793 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168572343 0 0) 0x7f0f280b3570 con 0x7f0f28072d10 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.133+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2998183793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f2815bbd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097a0 tx=0x7f0f2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a36760a924eb1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.133+0000 7f0f2ca2e640 1 -- 172.21.15.134:0/2998183793 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24037070 con 0x7f0f280ccb80 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.133+0000 7f0f2ca2e640 1 -- 172.21.15.134:0/2998183793 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f24032440 con 0x7f0f280ccb80 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.133+0000 7f0f2ca2e640 1 -- 172.21.15.134:0/2998183793 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24032810 con 0x7f0f280ccb80 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2998183793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 msgr2=0x7f0f2815bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2998183793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f2815bbd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097a0 tx=0x7f0f2402a180 comp rx=0 tx=0).stop 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2998183793 shutdown_connections 2024-09-15T22:46:33.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2998183793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f2806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2998183793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f2815bbd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2998183793 >> 172.21.15.134:0/2998183793 conn(0x7f0f2806bba0 msgr2=0x7f0f2806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2998183793 shutdown_connections 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.134+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2998183793 wait complete. 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.135+0000 7f0f2fc94640 1 Processor -- start 2024-09-15T22:46:33.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.135+0000 7f0f2fc94640 1 -- start start 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 0x7f0f28159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f281e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280ccf60 con 0x7f0f280ccb80 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280b43d0 con 0x7f0f28072d10 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2806e050 con 0x7f0f280b4e20 2024-09-15T22:46:33.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46726/0 (socket says 172.21.15.134:46726) 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 -- 172.21.15.134:0/2906916727 learned_addr learned my addr 172.21.15.134:0/2906916727 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 0x7f0f28159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2d22f640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f281e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 -- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 msgr2=0x7f0f281e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f281e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 -- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 msgr2=0x7f0f28159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 0x7f0f28159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 -- 172.21.15.134:0/2906916727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28156d90 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 0x7f0f28159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2e231640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000ba10 tx=0x7f0f2000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20019070 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2000cae0 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20014440 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.136+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f28157070 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.137+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f28157630 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.138+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2806db10 con 0x7f0f280ccb80 2024-09-15T22:46:33.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.138+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f0f2001c070 con 0x7f0f280ccb80 2024-09-15T22:46:33.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.138+0000 7f0f1e7fc640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 0x7f0f0c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:33.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.138+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5910+0+0 (secure 0 0 0) 0x7f0f2008b7d0 con 0x7f0f280ccb80 2024-09-15T22:46:33.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.139+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 0x7f0f0c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:33.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.139+0000 7f0f2da30640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 0x7f0f0c06eb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f24034000 tx=0x7f0f2402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:33.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.143+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f200599a0 con 0x7f0f280ccb80 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:33.312+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0f280b58a0 con 0x7f0f280ccb80 2024-09-15T22:46:34.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.302+0000 7f0f1e7fc640 1 -- 172.21.15.134:0/2906916727 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) ==== 181+0+0 (secure 0 0 0) 0x7f0f200592a0 con 0x7f0f280ccb80 2024-09-15T22:46:34.303 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:46:34.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 msgr2=0x7f0f0c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:34.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 0x7f0f0c06eb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f24034000 tx=0x7f0f2402e000 comp rx=0 tx=0).stop 2024-09-15T22:46:34.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 msgr2=0x7f0f281f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:34.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000ba10 tx=0x7f0f2000bed0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 shutdown_connections 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f0c06c6a0 0x7f0f0c06eb60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f280ccb80 0x7f0f281f3b40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f280b4e20 0x7f0f281e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 --2- 172.21.15.134:0/2906916727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f28072d10 0x7f0f28159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 >> 172.21.15.134:0/2906916727 conn(0x7f0f2806bba0 msgr2=0x7f0f2806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 shutdown_connections 2024-09-15T22:46:34.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.306+0000 7f0f2fc94640 1 -- 172.21.15.134:0/2906916727 wait complete. 2024-09-15T22:46:34.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:46:34.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.429+0000 7f0dc8766640 1 Processor -- start 2024-09-15T22:46:34.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.429+0000 7f0dc8766640 1 -- start start 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0dc0145d90 0x7f0dc00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dc00cd490 0x7f0dc00cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cfb10 0x7f0dc01601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc006d080 con 0x7f0dc0145d90 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc00b4240 con 0x7f0dc00cd490 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc8766640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc00b4520 con 0x7f0dc00cfb10 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0dc0145d90 0x7f0dc00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0dc0145d90 0x7f0dc00ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46742/0 (socket says 172.21.15.134:46742) 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 -- 172.21.15.134:0/228714616 learned_addr learned my addr 172.21.15.134:0/228714616 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 -- 172.21.15.134:0/228714616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cfb10 msgr2=0x7f0dc01601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:34.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 --2- 172.21.15.134:0/228714616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cfb10 0x7f0dc01601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc5d01640 1 --2- 172.21.15.134:0/228714616 >> v2:172.21.15.177:3300/0 conn(0x7f0dc00cd490 0x7f0dc00cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 -- 172.21.15.134:0/228714616 >> v2:172.21.15.177:3300/0 conn(0x7f0dc00cd490 msgr2=0x7f0dc00cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:34.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 --2- 172.21.15.134:0/228714616 >> v2:172.21.15.177:3300/0 conn(0x7f0dc00cd490 0x7f0dc00cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.430+0000 7f0dc6502640 1 -- 172.21.15.134:0/228714616 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc00b4800 con 0x7f0dc0145d90 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.431+0000 7f0dc6502640 1 --2- 172.21.15.134:0/228714616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc0145d90 0x7f0dc00ccf50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f0dc006ef20 tx=0x7f0dbc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac93c07f7e39a191 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.431+0000 7f0dc5500640 1 -- 172.21.15.134:0/228714616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc037070 con 0x7f0dc0145d90 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.431+0000 7f0dc5500640 1 -- 172.21.15.134:0/228714616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc032440 con 0x7f0dc0145d90 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.431+0000 7f0dc5500640 1 -- 172.21.15.134:0/228714616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc032810 con 0x7f0dc0145d90 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 -- 172.21.15.134:0/228714616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc0145d90 msgr2=0x7f0dc00ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:34.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 --2- 172.21.15.134:0/228714616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc0145d90 0x7f0dc00ccf50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f0dc006ef20 tx=0x7f0dbc02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 -- 172.21.15.134:0/228714616 shutdown_connections 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 --2- 172.21.15.134:0/228714616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cfb10 0x7f0dc01601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 --2- 172.21.15.134:0/228714616 >> v2:172.21.15.177:3300/0 conn(0x7f0dc00cd490 0x7f0dc00cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 --2- 172.21.15.134:0/228714616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc0145d90 0x7f0dc00ccf50 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 -- 172.21.15.134:0/228714616 >> 172.21.15.134:0/228714616 conn(0x7f0dc006bba0 msgr2=0x7f0dc006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 -- 172.21.15.134:0/228714616 shutdown_connections 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.432+0000 7f0dc8766640 1 -- 172.21.15.134:0/228714616 wait complete. 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.433+0000 7f0dc8766640 1 Processor -- start 2024-09-15T22:46:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.433+0000 7f0dc8766640 1 -- start start 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd490 0x7f0dc00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc0145d90 0x7f0dc0160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc00b5610 con 0x7f0dc00cfb10 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc00cffa0 con 0x7f0dc0145d90 2024-09-15T22:46:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc8766640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc00b5790 con 0x7f0dc00cd490 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46758/0 (socket says 172.21.15.134:46758) 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 -- 172.21.15.134:0/2915827488 learned_addr learned my addr 172.21.15.134:0/2915827488 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc6502640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd490 0x7f0dc00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc6d03640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc0145d90 0x7f0dc0160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 -- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd490 msgr2=0x7f0dc00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd490 0x7f0dc00cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 -- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc0145d90 msgr2=0x7f0dc0160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc0145d90 0x7f0dc0160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 -- 172.21.15.134:0/2915827488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc00cca90 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.434+0000 7f0dc5d01640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c820 tx=0x7f0db000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.435+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0015070 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.435+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db0004020 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.435+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc01f4510 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.435+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00043f0 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.435+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc01f4ad0 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.436+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc0146200 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.436+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f0db00077d0 con 0x7f0dc00cfb10 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.437+0000 7f0db6ffd640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 0x7f0da406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.437+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5443+0+0 (secure 0 0 0) 0x7f0db008b880 con 0x7f0dc00cfb10 2024-09-15T22:46:34.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.437+0000 7f0dc6502640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 0x7f0da406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:34.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.437+0000 7f0dc6502640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 0x7f0da406eb60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc034000 tx=0x7f0dbc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:34.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.441+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0db0059a90 con 0x7f0dc00cfb10 2024-09-15T22:46:34.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:34.609+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0dc00cdc20 con 0x7f0dc00cfb10 2024-09-15T22:46:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.307+0000 7f0db6ffd640 1 -- 172.21.15.134:0/2915827488 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) ==== 169+0+0 (secure 0 0 0) 0x7f0db0059390 con 0x7f0dc00cfb10 2024-09-15T22:46:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 msgr2=0x7f0da406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 0x7f0da406eb60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc034000 tx=0x7f0dbc02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 msgr2=0x7f0dc0160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c820 tx=0x7f0db000cce0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 shutdown_connections 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc0145d90 0x7f0dc0160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0da406c6a0 0x7f0da406eb60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dc00cfb10 0x7f0dc0160350 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 --2- 172.21.15.134:0/2915827488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd490 0x7f0dc00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.310+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 >> 172.21.15.134:0/2915827488 conn(0x7f0dc006bba0 msgr2=0x7f0dc00b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.311+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 shutdown_connections 2024-09-15T22:46:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.311+0000 7f0dc8766640 1 -- 172.21.15.134:0/2915827488 wait complete. 2024-09-15T22:46:35.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:46:35.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.426+0000 7f1e04ff8640 1 Processor -- start 2024-09-15T22:46:35.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.426+0000 7f1e04ff8640 1 -- start start 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1e04ff8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e00161e30 0x7f1e000d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1e04ff8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e0006dfd0 0x7f1e000b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1e04ff8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e000cf9a0 con 0x7f1e000b3d50 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1e04ff8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1e000cfcf0 con 0x7f1e00161e30 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1e04ff8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1e00162210 con 0x7f1e0006dfd0 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1dfe59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e00161e30 0x7f1e000d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1dfe59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e00161e30 0x7f1e000d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46770/0 (socket says 172.21.15.134:46770) 2024-09-15T22:46:35.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.427+0000 7f1dfe59c640 1 -- 172.21.15.134:0/3193609157 learned_addr learned my addr 172.21.15.134:0/3193609157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:35.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.428+0000 7f1dfe59c640 1 -- 172.21.15.134:0/3193609157 >> v2:172.21.15.177:3300/0 conn(0x7f1e0006dfd0 msgr2=0x7f1e000b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.428+0000 7f1dfe59c640 1 --2- 172.21.15.134:0/3193609157 >> v2:172.21.15.177:3300/0 conn(0x7f1e0006dfd0 0x7f1e000b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.428+0000 7f1dfe59c640 1 -- 172.21.15.134:0/3193609157 >> v1:172.21.15.177:6789/0 conn(0x7f1e000b3d50 legacy=0x7f1e0006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.428+0000 7f1dfe59c640 1 -- 172.21.15.134:0/3193609157 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000d5210 con 0x7f1e00161e30 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.428+0000 7f1dfe59c640 1 --2- 172.21.15.134:0/3193609157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e000d34a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b3ce0 tx=0x7f1df002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c0bdbad6cee590 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1dfd59a640 1 -- 172.21.15.134:0/3193609157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0036070 con 0x7f1e00161e30 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1dfd59a640 1 -- 172.21.15.134:0/3193609157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df0031600 con 0x7f1e00161e30 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1dfd59a640 1 -- 172.21.15.134:0/3193609157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df00319d0 con 0x7f1e00161e30 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 -- 172.21.15.134:0/3193609157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 msgr2=0x7f1e000d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/3193609157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e000d34a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b3ce0 tx=0x7f1df002a6f0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 -- 172.21.15.134:0/3193609157 shutdown_connections 2024-09-15T22:46:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/3193609157 >> v2:172.21.15.177:3300/0 conn(0x7f1e0006dfd0 0x7f1e000b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/3193609157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e000d34a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 -- 172.21.15.134:0/3193609157 >> 172.21.15.134:0/3193609157 conn(0x7f1e000d1870 msgr2=0x7f1e000d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 -- 172.21.15.134:0/3193609157 shutdown_connections 2024-09-15T22:46:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.429+0000 7f1e04ff8640 1 -- 172.21.15.134:0/3193609157 wait complete. 2024-09-15T22:46:35.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 Processor -- start 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 -- start start 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e0006dfd0 0x7f1e0014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 0x7f1e0015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d39e0 con 0x7f1e00161e30 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000b3950 con 0x7f1e000b3d50 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1e04ff8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0015bf10 con 0x7f1e0006dfd0 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1dfed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1dfed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46786/0 (socket says 172.21.15.134:46786) 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1dfed9d640 1 -- 172.21.15.134:0/1612236663 learned_addr learned my addr 172.21.15.134:0/1612236663 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1dfdd9b640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 0x7f1e0015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.431+0000 7f1dfe59c640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e0006dfd0 0x7f1e0014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 -- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e0006dfd0 msgr2=0x7f1e0014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e0006dfd0 0x7f1e0014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 -- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 msgr2=0x7f1e0015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 0x7f1e0015b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 -- 172.21.15.134:0/1612236663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0015c1f0 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfdd9b640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 0x7f1e0015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1dfed9d640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b410 tx=0x7f1df8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8015020 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df8011830 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011c00 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0015c4d0 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.432+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0014aba0 con 0x7f1e00161e30 2024-09-15T22:46:35.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.433+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0014ada0 con 0x7f1e00161e30 2024-09-15T22:46:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.434+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f1df8018020 con 0x7f1e00161e30 2024-09-15T22:46:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.434+0000 7f1df6ffd640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 0x7f1de006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.434+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7f1df808b830 con 0x7f1e00161e30 2024-09-15T22:46:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.434+0000 7f1dfe59c640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 0x7f1de006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.435+0000 7f1dfe59c640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 0x7f1de006eb60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1df0033000 tx=0x7f1df0009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.438+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1df801f020 con 0x7f1e00161e30 2024-09-15T22:46:35.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.604+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1e000b3290 con 0x7f1e00161e30 2024-09-15T22:46:35.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.607+0000 7f1df6ffd640 1 -- 172.21.15.134:0/1612236663 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f1df80172c0 con 0x7f1e00161e30 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 msgr2=0x7f1de006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 0x7f1de006eb60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1df0033000 tx=0x7f1df0009000 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 msgr2=0x7f1e00149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b410 tx=0x7f1df8009f90 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 shutdown_connections 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1de006c6a0 0x7f1de006eb60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e00161e30 0x7f1e00149d20 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e000b3d50 0x7f1e0015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 --2- 172.21.15.134:0/1612236663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e0006dfd0 0x7f1e0014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 >> 172.21.15.134:0/1612236663 conn(0x7f1e000d1870 msgr2=0x7f1e000b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 shutdown_connections 2024-09-15T22:46:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.609+0000 7f1e04ff8640 1 -- 172.21.15.134:0/1612236663 wait complete. 2024-09-15T22:46:35.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-15T22:46:35.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.722+0000 7f7c4b59e640 1 Processor -- start 2024-09-15T22:46:35.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.722+0000 7f7c4b59e640 1 -- start start 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c4c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4b59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7c4c0708a0 0x7f7c4c073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4b59e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c15ce80 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4b59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c15d160 con 0x7f7c4c0708a0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4b59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c15d440 con 0x7f7c4c06feb0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7c4c0b6bb0 0x7f7c4c0b6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38058/0 (socket says 172.21.15.134:38058) 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4a59c640 1 -- 172.21.15.134:0/834732203 learned_addr learned my addr 172.21.15.134:0/834732203 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360695048 0 0) 0x7f7c4c15ce80 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c34003520 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c4c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4ad9d640 1 --2- 172.21.15.134:0/834732203 >> v2:172.21.15.177:3300/0 conn(0x7f7c4c0708a0 0x7f7c4c073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 236834024 0 0) 0x7f7c34003520 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 msgr2=0x7f7c4c15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c4c15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 >> v2:172.21.15.177:3300/0 conn(0x7f7c4c0708a0 msgr2=0x7f7c4c073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 --2- 172.21.15.134:0/834732203 >> v2:172.21.15.177:3300/0 conn(0x7f7c4c0708a0 0x7f7c4c073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c15d720 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7c3c001670 con 0x7f7c4c0b6bb0 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.723+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 >> v1:172.21.15.134:6789/0 conn(0x7f7c4c0b6bb0 legacy=0x7f7c4c0b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c340039b0 0x7f7c34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c15d160 con 0x7f7c34004800 2024-09-15T22:46:35.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c15d440 con 0x7f7c340039b0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3400ba70 con 0x7f7c4c06feb0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4a59c640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c340039b0 0x7f7c34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c4ad9d640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 -- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 msgr2=0x7f7c340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c06feb0 0x7f7c340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 -- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c340039b0 msgr2=0x7f7c34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c340039b0 0x7f7c34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.724+0000 7f7c49d9b640 1 -- 172.21.15.134:0/834732203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c34003520 con 0x7f7c34004800 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ba00 tx=0x7f7c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b66b9c77cc848f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40030070 con 0x7f7c34004800 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4002ad80 con 0x7f7c34004800 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4959a640 1 -- 172.21.15.134:0/834732203 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000b600 con 0x7f7c34004800 2024-09-15T22:46:35.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 -- 172.21.15.134:0/834732203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c34004800 msgr2=0x7f7c34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/834732203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ba00 tx=0x7f7c34005830 comp rx=0 tx=0).stop 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4ad9d640 1 -- 172.21.15.134:0/834732203 reap_dead start 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 -- 172.21.15.134:0/834732203 shutdown_connections 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 -- 172.21.15.134:0/834732203 >> 172.21.15.134:0/834732203 conn(0x7f7c4c06f390 msgr2=0x7f7c4c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 -- 172.21.15.134:0/834732203 shutdown_connections 2024-09-15T22:46:35.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.725+0000 7f7c4b59e640 1 -- 172.21.15.134:0/834732203 wait complete. 2024-09-15T22:46:35.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 Processor -- start 2024-09-15T22:46:35.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 -- start start 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c34004800 0x7f7c4c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c0ca1b0 0x7f7c4c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c15a2d0 con 0x7f7c4c14dba0 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c15a150 con 0x7f7c34004800 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.727+0000 7f7c4b59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b1de0 con 0x7f7c4c0ca1b0 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46806/0 (socket says 172.21.15.134:46806) 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 -- 172.21.15.134:0/797823888 learned_addr learned my addr 172.21.15.134:0/797823888 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c49d9b640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c0ca1b0 0x7f7c4c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4a59c640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c34004800 0x7f7c4c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 -- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c0ca1b0 msgr2=0x7f7c4c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c0ca1b0 0x7f7c4c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 -- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c34004800 msgr2=0x7f7c4c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c34004800 0x7f7c4c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 -- 172.21.15.134:0/797823888 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c14e560 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4ad9d640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c070660 tx=0x7f7c44007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44014410 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c44019070 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c0ca970 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44014810 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.728+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c0caf30 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.729+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c070d30 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.730+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f7c440149b0 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.730+0000 7f7c3affd640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 0x7f7c2c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.730+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7f7c4408bf90 con 0x7f7c4c14dba0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.730+0000 7f7c4a59c640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 0x7f7c2c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:35.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.731+0000 7f7c4a59c640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 0x7f7c2c06eb90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c007fd0 tx=0x7f7c3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:35.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.734+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c4405a2f0 con 0x7f7c4c14dba0 2024-09-15T22:46:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:35.965+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f7c4c0b5af0 con 0x7f7c4c14dba0 2024-09-15T22:46:36.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.308+0000 7f7c3affd640 1 -- 172.21.15.134:0/797823888 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v288) ==== 149+0+0 (secure 0 0 0) 0x7f7c44059bf0 con 0x7f7c4c14dba0 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 msgr2=0x7f7c2c06eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 0x7f7c2c06eb90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c007fd0 tx=0x7f7c3c009040 comp rx=0 tx=0).stop 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 msgr2=0x7f7c4c14e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c070660 tx=0x7f7c44007700 comp rx=0 tx=0).stop 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 shutdown_connections 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2c06c6d0 0x7f7c2c06eb90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c14dba0 0x7f7c4c14e020 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4c0ca1b0 0x7f7c4c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 --2- 172.21.15.134:0/797823888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c34004800 0x7f7c4c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.310+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 >> 172.21.15.134:0/797823888 conn(0x7f7c4c06f390 msgr2=0x7f7c4c073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:36.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.311+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 shutdown_connections 2024-09-15T22:46:36.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.311+0000 7f7c4b59e640 1 -- 172.21.15.134:0/797823888 wait complete. 2024-09-15T22:46:36.323 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-15T22:46:36.324 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-15T22:46:36.324 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:46:36.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.421+0000 7f8135731640 1 Processor -- start 2024-09-15T22:46:36.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.421+0000 7f8135731640 1 -- start start 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f8135731640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f813015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f8135731640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81300cd5f0 con 0x7f81300d0310 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f8135731640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81300cd8d0 con 0x7f81300d0750 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f8135731640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f813006c520 con 0x7f81300cd010 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f81267fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f81300d0310 0x7f813006be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55322/0 (socket says 172.21.15.134:55322) 2024-09-15T22:46:36.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f81267fc640 1 -- 172.21.15.134:0/321995420 learned_addr learned my addr 172.21.15.134:0/321995420 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f812effd640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f813015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.422+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302133746 0 0) 0x7f81300cd5f0 con 0x7f81300d0310 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f811c003520 con 0x7f81300d0310 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1124387802 0 0) 0x7f811c003520 con 0x7f81300d0310 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 msgr2=0x7f813015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f813015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 >> v1:172.21.15.177:6789/0 conn(0x7f81300d0750 legacy=0x7f8130151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81300cdbb0 con 0x7f81300d0310 2024-09-15T22:46:36.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f8118001670 con 0x7f81300d0310 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 >> v1:172.21.15.134:6789/0 conn(0x7f81300d0310 legacy=0x7f813006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c0039e0 0x7f811c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f811c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f811c004d40 0x7f811c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f813006c520 con 0x7f811c004d40 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f811c00b9c0 con 0x7f811c0039e0 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f811c00ddd0 con 0x7f81300cd010 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f811c004d40 0x7f811c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812effd640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c0039e0 0x7f811c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f81267fc640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f811c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 -- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 msgr2=0x7f811c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81300cd010 0x7f811c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 -- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c0039e0 msgr2=0x7f811c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c0039e0 0x7f811c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.423+0000 7f812f7fe640 1 -- 172.21.15.134:0/321995420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c003520 con 0x7f811c004d40 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.424+0000 7f812f7fe640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f811c004d40 0x7f811c0051c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8128001f60 tx=0x7f811c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb975de0aee62ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.424+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128001b30 con 0x7f811c004d40 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.424+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128031620 con 0x7f811c004d40 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.424+0000 7f812e7fc640 1 -- 172.21.15.134:0/321995420 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128031a10 con 0x7f811c004d40 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 -- 172.21.15.134:0/321995420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f811c004d40 msgr2=0x7f811c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 --2- 172.21.15.134:0/321995420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f811c004d40 0x7f811c0051c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8128001f60 tx=0x7f811c005830 comp rx=0 tx=0).stop 2024-09-15T22:46:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f812f7fe640 1 -- 172.21.15.134:0/321995420 reap_dead start 2024-09-15T22:46:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 -- 172.21.15.134:0/321995420 shutdown_connections 2024-09-15T22:46:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 -- 172.21.15.134:0/321995420 >> 172.21.15.134:0/321995420 conn(0x7f8130062cc0 msgr2=0x7f813006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 -- 172.21.15.134:0/321995420 shutdown_connections 2024-09-15T22:46:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.425+0000 7f8135731640 1 -- 172.21.15.134:0/321995420 wait complete. 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.426+0000 7f8135731640 1 Processor -- start 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.426+0000 7f8135731640 1 -- start start 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 0x7f81300735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8130150270 0x7f8130071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81300ce690 con 0x7f813014fda0 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81300ce170 con 0x7f8130150270 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8130151c50 con 0x7f811c004d40 2024-09-15T22:46:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51108/0 (socket says 172.21.15.134:51108) 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 -- 172.21.15.134:0/1065045674 learned_addr learned my addr 172.21.15.134:0/1065045674 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f812f7fe640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8130150270 0x7f8130071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f812effd640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 0x7f81300735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 -- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 msgr2=0x7f81300735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 0x7f81300735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 -- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8130150270 msgr2=0x7f8130071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8130150270 0x7f8130071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 -- 172.21.15.134:0/1065045674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8130154b40 con 0x7f813014fda0 2024-09-15T22:46:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f812effd640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 0x7f81300735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f81267fc640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8118007340 tx=0x7f8118007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811800f860 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8118018070 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811800fc60 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8130154db0 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.427+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8130152280 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.428+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8130152480 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.429+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f811801c410 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.429+0000 7f8127fff640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 0x7f811006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.430+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7f811808b1d0 con 0x7f813014fda0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.430+0000 7f812effd640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 0x7f811006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.430+0000 7f812effd640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 0x7f811006eb90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8120009bc0 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.434+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8130152480 con 0x7f813014fda0 2024-09-15T22:46:36.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.599+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8130152070 con 0x7f813014fda0 2024-09-15T22:46:36.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.599+0000 7f8127fff640 1 -- 172.21.15.134:0/1065045674 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+13124 (secure 0 0 0) 0x7f81180597e0 con 0x7f813014fda0 2024-09-15T22:46:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:36.601 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":113,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:35.303268+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6834/2420464130":"2024-09-16T22:46:31.962408+0000","172.21.15.134:6824/2420464130":"2024-09-16T22:46:31.962408+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:36.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 msgr2=0x7f811006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 0x7f811006eb90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8120009bc0 tx=0x7f8120008040 comp rx=0 tx=0).stop 2024-09-15T22:46:36.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 msgr2=0x7f8130071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8118007340 tx=0x7f8118007800 comp rx=0 tx=0).stop 2024-09-15T22:46:36.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 shutdown_connections 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8130150270 0x7f8130071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006c6d0 0x7f811006eb90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813014fda0 0x7f8130071410 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 --2- 172.21.15.134:0/1065045674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f811c004d40 0x7f81300735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.601+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 >> 172.21.15.134:0/1065045674 conn(0x7f8130062cc0 msgr2=0x7f81300b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.602+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 shutdown_connections 2024-09-15T22:46:36.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.602+0000 7f8135731640 1 -- 172.21.15.134:0/1065045674 wait complete. 2024-09-15T22:46:36.615 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:46:36.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:46:36.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.715+0000 7f8db6ad9640 1 Processor -- start 2024-09-15T22:46:36.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.715+0000 7f8db6ad9640 1 -- start start 2024-09-15T22:46:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db6ad9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db6ad9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db6ad9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db00715c0 con 0x7f8db00cd3b0 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db6ad9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8db006da30 con 0x7f8db015d790 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db6ad9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8db006d700 con 0x7f8db015d3b0 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8da7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:52284/0 (socket says 172.21.15.134:52284) 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db5076640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8db00cd3b0 0x7f8db00cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:54548/0 (socket says 172.21.15.134:54548) 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8da7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:45362/0 (socket says 172.21.15.134:45362) 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 -- 172.21.15.134:0/1608013134 learned_addr learned my addr 172.21.15.134:0/1608013134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 -- 172.21.15.134:0/1608013134 >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 msgr2=0x7f8db00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 --2- 172.21.15.134:0/1608013134 >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 -- 172.21.15.134:0/1608013134 >> v1:172.21.15.177:6789/0 conn(0x7f8db00cd3b0 legacy=0x7f8db00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8db4875640 1 -- 172.21.15.134:0/1608013134 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db00cde80 con 0x7f8db015d3b0 2024-09-15T22:46:36.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.716+0000 7f8da7fff640 1 --2- 172.21.15.134:0/1608013134 >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.717+0000 7f8db4875640 1 --2- 172.21.15.134:0/1608013134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009870 tx=0x7f8dac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b38102cce7c740d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.717+0000 7f8da77fe640 1 -- 172.21.15.134:0/1608013134 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac037070 con 0x7f8db015d3b0 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.717+0000 7f8da77fe640 1 -- 172.21.15.134:0/1608013134 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac032440 con 0x7f8db015d3b0 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.717+0000 7f8da77fe640 1 -- 172.21.15.134:0/1608013134 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac032810 con 0x7f8db015d3b0 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1608013134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 msgr2=0x7f8db0071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1608013134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009870 tx=0x7f8dac02a270 comp rx=0 tx=0).stop 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1608013134 shutdown_connections 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1608013134 >> v2:172.21.15.177:3300/0 conn(0x7f8db015d790 0x7f8db00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1608013134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db015d3b0 0x7f8db0071080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1608013134 >> 172.21.15.134:0/1608013134 conn(0x7f8db006bba0 msgr2=0x7f8db006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1608013134 shutdown_connections 2024-09-15T22:46:36.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.718+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1608013134 wait complete. 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.719+0000 7f8db6ad9640 1 Processor -- start 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.719+0000 7f8db6ad9640 1 -- start start 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db015d3b0 0x7f8db01561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db0159c60 0x7f8db00ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8db015cbf0 con 0x7f8db00cd3b0 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00cdba0 con 0x7f8db015d3b0 2024-09-15T22:46:36.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db6ad9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8db015cd70 con 0x7f8db0159c60 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51110/0 (socket says 172.21.15.134:51110) 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 -- 172.21.15.134:0/1452307127 learned_addr learned my addr 172.21.15.134:0/1452307127 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8da7fff640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db015d3b0 0x7f8db01561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db5076640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db0159c60 0x7f8db00ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 -- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db0159c60 msgr2=0x7f8db00ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db0159c60 0x7f8db00ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 -- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db015d3b0 msgr2=0x7f8db01561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db015d3b0 0x7f8db01561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 -- 172.21.15.134:0/1452307127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db00aa4d0 con 0x7f8db00cd3b0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.720+0000 7f8db4875640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.721+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac037040 con 0x7f8db00cd3b0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.721+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac042070 con 0x7f8db00cd3b0 2024-09-15T22:46:36.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.721+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac030860 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.721+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db015a1d0 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.721+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db015a790 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.722+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db00d0090 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.722+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f8dac030a00 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.723+0000 7f8da57fa640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 0x7f8d9c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.723+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7f8dac0abe70 con 0x7f8db00cd3b0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.723+0000 7f8da7fff640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 0x7f8d9c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:36.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.723+0000 7f8da7fff640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 0x7f8d9c06eb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009500 tx=0x7f8da0009110 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:36.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.727+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8db00d0090 con 0x7f8db00cd3b0 2024-09-15T22:46:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.894+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8db00cfac0 con 0x7f8db00cd3b0 2024-09-15T22:46:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.895+0000 7f8da57fa640 1 -- 172.21.15.134:0/1452307127 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7f8dac079e30 con 0x7f8db00cd3b0 2024-09-15T22:46:36.897 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 msgr2=0x7f8d9c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 0x7f8d9c06eb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009500 tx=0x7f8da0009110 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 msgr2=0x7f8db015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac0046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 shutdown_connections 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8db0159c60 0x7f8db00ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db015d3b0 0x7f8db01561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d9c06c6a0 0x7f8d9c06eb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 --2- 172.21.15.134:0/1452307127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db00cd3b0 0x7f8db015bcf0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 >> 172.21.15.134:0/1452307127 conn(0x7f8db006bba0 msgr2=0x7f8db006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 shutdown_connections 2024-09-15T22:46:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:36.897+0000 7f8db6ad9640 1 -- 172.21.15.134:0/1452307127 wait complete. 2024-09-15T22:46:36.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-15T22:46:37.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.009+0000 7fbdb6dcf640 1 Processor -- start 2024-09-15T22:46:37.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.009+0000 7fbdb6dcf640 1 -- start start 2024-09-15T22:46:37.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.009+0000 7fbdb6dcf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbdb015ed20 0x7fbdb00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.009+0000 7fbdb6dcf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb00b7170 con 0x7fbdb015e940 2024-09-15T22:46:37.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb6dcf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb00b7aa0 con 0x7fbdb00cef90 2024-09-15T22:46:37.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb6dcf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb00d3660 con 0x7fbdb015ed20 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb4b6b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbdb015e940 0x7fbdb00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55336/0 (socket says 172.21.15.134:55336) 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb4b6b640 1 -- 172.21.15.134:0/154577239 learned_addr learned my addr 172.21.15.134:0/154577239 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaffff640 1 --2- 172.21.15.134:0/154577239 >> v2:172.21.15.177:3300/0 conn(0x7fbdb015ed20 0x7fbdb00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606167754 0 0) 0x7fbda8001110 con 0x7fbdb015e940 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c003520 con 0x7fbdb015e940 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912189930 0 0) 0x7fbdb00b7aa0 con 0x7fbdb00cef90 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda8001110 con 0x7fbdb00cef90 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815739530 0 0) 0x7fbd9c003520 con 0x7fbdb015e940 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 >> v2:172.21.15.177:3300/0 conn(0x7fbdb015ed20 msgr2=0x7fbdb00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:37.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 --2- 172.21.15.134:0/154577239 >> v2:172.21.15.177:3300/0 conn(0x7fbdb015ed20 0x7fbdb00b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 >> v1:172.21.15.177:6789/0 conn(0x7fbdb00cef90 legacy=0x7fbdb00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb00d3940 con 0x7fbdb015e940 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fbda8001840 con 0x7fbdb015e940 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 >> v1:172.21.15.134:6789/0 conn(0x7fbdb015e940 legacy=0x7fbdb00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 0x7fbd9c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb00d3660 con 0x7fbd9c003b90 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c00bfe0 con 0x7fbd9c0051c0 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c00c1e0 con 0x7fbd9c004800 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 0x7fbd9c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdaffff640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.010+0000 7fbdb536c640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 -- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c004800 msgr2=0x7fbd9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 -- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd9c0051c0 msgr2=0x7fbd9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 -- 172.21.15.134:0/154577239 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c003520 con 0x7fbd9c003b90 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb536c640 1 -- 172.21.15.134:0/154577239 reap_dead start 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 0x7fbd9c003f90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c320 tx=0x7fbd9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983fcd8ba8a2762f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8036070 con 0x7fbd9c003b90 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8005af0 con 0x7fbd9c003b90 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.011+0000 7fbdaf7fe640 1 -- 172.21.15.134:0/154577239 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8007dd0 con 0x7fbd9c003b90 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 msgr2=0x7fbd9c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 0x7fbd9c003f90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c320 tx=0x7fbd9c005830 comp rx=0 tx=0).stop 2024-09-15T22:46:37.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/154577239 shutdown_connections 2024-09-15T22:46:37.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/154577239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd9c003b90 0x7fbd9c003f90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/154577239 >> 172.21.15.134:0/154577239 conn(0x7fbdb00b6240 msgr2=0x7fbdb00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/154577239 shutdown_connections 2024-09-15T22:46:37.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.012+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/154577239 wait complete. 2024-09-15T22:46:37.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.013+0000 7fbdb6dcf640 1 Processor -- start 2024-09-15T22:46:37.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.013+0000 7fbdb6dcf640 1 -- start start 2024-09-15T22:46:37.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c003b90 0x7fbdb00c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 0x7fbdb00b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb00d1ef0 con 0x7fbdb0158800 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb00d3f00 con 0x7fbdb00b5590 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb6dcf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb00d2070 con 0x7fbd9c003b90 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51134/0 (socket says 172.21.15.134:51134) 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 -- 172.21.15.134:0/2989785150 learned_addr learned my addr 172.21.15.134:0/2989785150 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c003b90 0x7fbdb00c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb536c640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 0x7fbdb00b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 -- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c003b90 msgr2=0x7fbdb00c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c003b90 0x7fbdb00c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 -- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 msgr2=0x7fbdb00b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 0x7fbdb00b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdaffff640 1 -- 172.21.15.134:0/2989785150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb0158cc0 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.014+0000 7fbdb536c640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 0x7fbdb00b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdaffff640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009fd0 tx=0x7fbda00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda001a030 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda0003990 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0003b60 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb0158fa0 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.015+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb0159560 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.016+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb00d1060 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.016+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fbda001d070 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.017+0000 7fbdad7fa640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 0x7fbd9006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.017+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7fbda008c4f0 con 0x7fbdb0158800 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.017+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 0x7fbd9006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.017+0000 7fbdb4b6b640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 0x7fbd9006eb60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbda8033000 tx=0x7fbda802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.021+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbda005a8e0 con 0x7fbdb0158800 2024-09-15T22:46:37.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.250+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fbdb00ba6b0 con 0x7fbdb0158800 2024-09-15T22:46:37.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.313+0000 7fbdad7fa640 1 -- 172.21.15.134:0/2989785150 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v289) ==== 151+0+0 (secure 0 0 0) 0x7fbda005a1e0 con 0x7fbdb0158800 2024-09-15T22:46:37.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 msgr2=0x7fbd9006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 0x7fbd9006eb60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbda8033000 tx=0x7fbda802e000 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 msgr2=0x7fbdb01616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009fd0 tx=0x7fbda00115a0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 shutdown_connections 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb00b5590 0x7fbdb00b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd9006c6a0 0x7fbd9006eb60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb0158800 0x7fbdb01616d0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 --2- 172.21.15.134:0/2989785150 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd9c003b90 0x7fbdb00c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 >> 172.21.15.134:0/2989785150 conn(0x7fbdb00b6240 msgr2=0x7fbdb00b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 shutdown_connections 2024-09-15T22:46:37.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.315+0000 7fbdb6dcf640 1 -- 172.21.15.134:0/2989785150 wait complete. 2024-09-15T22:46:37.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:46:37.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.427+0000 7efdcad2c640 1 Processor -- start 2024-09-15T22:46:37.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.427+0000 7efdcad2c640 1 -- start start 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdcad2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efdc41417a0 0x7efdc41629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdcad2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 0x7efdc40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdcad2c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc40ae8e0 con 0x7efdc4162340 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdcad2c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efdc4141b80 con 0x7efdc41417a0 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdcad2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efdc40af4f0 con 0x7efdc40af980 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdc3fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 0x7efdc40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdc8ac8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efdc41417a0 0x7efdc41629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdc92c9640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efdc4162340 0x7efdc4143e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:54568/0 (socket says 172.21.15.134:54568) 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.428+0000 7efdc92c9640 1 -- 172.21.15.134:0/1810183309 learned_addr learned my addr 172.21.15.134:0/1810183309 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc8ac8640 1 -- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 msgr2=0x7efdc40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:37.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc8ac8640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 0x7efdc40ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc8ac8640 1 -- 172.21.15.134:0/1810183309 >> v1:172.21.15.177:6789/0 conn(0x7efdc4162340 legacy=0x7efdc4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc8ac8640 1 -- 172.21.15.134:0/1810183309 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc40aebc0 con 0x7efdc41417a0 2024-09-15T22:46:37.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc37fe640 1 -- 172.21.15.134:0/1810183309 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553807911 0 0) 0x7efdc40ae8e0 con 0x7efdc4162340 2024-09-15T22:46:37.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc3fff640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 0x7efdc40ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.429+0000 7efdc8ac8640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc41417a0 0x7efdc41629e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=281d0cb7f5e881a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdc37fe640 1 -- 172.21.15.134:0/1810183309 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8037070 con 0x7efdc41417a0 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdc37fe640 1 -- 172.21.15.134:0/1810183309 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8032440 con 0x7efdc41417a0 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdc37fe640 1 -- 172.21.15.134:0/1810183309 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032810 con 0x7efdc41417a0 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 -- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc41417a0 msgr2=0x7efdc41629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc41417a0 0x7efdc41629e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802a180 comp rx=0 tx=0).stop 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 -- 172.21.15.134:0/1810183309 shutdown_connections 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc40af980 0x7efdc40ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 --2- 172.21.15.134:0/1810183309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc41417a0 0x7efdc41629e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 -- 172.21.15.134:0/1810183309 >> 172.21.15.134:0/1810183309 conn(0x7efdc4062c60 msgr2=0x7efdc406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 -- 172.21.15.134:0/1810183309 shutdown_connections 2024-09-15T22:46:37.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.430+0000 7efdcad2c640 1 -- 172.21.15.134:0/1810183309 wait complete. 2024-09-15T22:46:37.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.431+0000 7efdcad2c640 1 Processor -- start 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.431+0000 7efdcad2c640 1 -- start start 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc41417a0 0x7efdc415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 0x7efdc40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4162f20 con 0x7efdc41f78b0 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdc40af180 con 0x7efdc40b3b60 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdcad2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efdc41630a0 con 0x7efdc41417a0 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdc3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdc3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51150/0 (socket says 172.21.15.134:51150) 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdc3fff640 1 -- 172.21.15.134:0/4118456494 learned_addr learned my addr 172.21.15.134:0/4118456494 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdc8ac8640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc41417a0 0x7efdc415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.432+0000 7efdc92c9640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 0x7efdc40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 -- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc41417a0 msgr2=0x7efdc415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc41417a0 0x7efdc415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 -- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 msgr2=0x7efdc40b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 0x7efdc40b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 -- 172.21.15.134:0/4118456494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc4140a30 con 0x7efdc41f78b0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc92c9640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 0x7efdc40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc3fff640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e900 tx=0x7efdb000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0017070 con 0x7efdc41f78b0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb000c9a0 con 0x7efdc41f78b0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc413feb0 con 0x7efdc41f78b0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000cd70 con 0x7efdc41f78b0 2024-09-15T22:46:37.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.433+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc4140470 con 0x7efdc41f78b0 2024-09-15T22:46:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.434+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc41629e0 con 0x7efdc41f78b0 2024-09-15T22:46:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.434+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7efdb001a070 con 0x7efdc41f78b0 2024-09-15T22:46:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.435+0000 7efdc17fa640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 0x7efda806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.435+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7efdb008b6d0 con 0x7efdc41f78b0 2024-09-15T22:46:37.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.435+0000 7efdc8ac8640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 0x7efda806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.435+0000 7efdc8ac8640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 0x7efda806eb60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdb8034000 tx=0x7efdb802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.439+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb0059b40 con 0x7efdc41f78b0 2024-09-15T22:46:37.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.602+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efdc413e970 con 0x7efdc41f78b0 2024-09-15T22:46:37.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.606+0000 7efdc17fa640 1 -- 172.21.15.134:0/4118456494 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7efdb0059440 con 0x7efdc41f78b0 2024-09-15T22:46:37.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 msgr2=0x7efda806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 0x7efda806eb60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdb8034000 tx=0x7efdb802e000 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 msgr2=0x7efdc41f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e900 tx=0x7efdb000edc0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 shutdown_connections 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdc40b3b60 0x7efdc40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efda806c6a0 0x7efda806eb60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc41f78b0 0x7efdc41f7d30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 --2- 172.21.15.134:0/4118456494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdc41417a0 0x7efdc415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 >> 172.21.15.134:0/4118456494 conn(0x7efdc4062c60 msgr2=0x7efdc413d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 shutdown_connections 2024-09-15T22:46:37.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.608+0000 7efdcad2c640 1 -- 172.21.15.134:0/4118456494 wait complete. 2024-09-15T22:46:37.620 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:46:37.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:46:37.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:46:37.698 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:46:37.698 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:37.698 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:37.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:46:37.715 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:37.715 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:37.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:46:37.757 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:37.757 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:37.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:46:37.772 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:37.772 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:37.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:46:37.815 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:46:37.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:37.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.911+0000 7fa990e53640 1 Processor -- start 2024-09-15T22:46:37.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.912+0000 7fa990e53640 1 -- start start 2024-09-15T22:46:37.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.912+0000 7fa990e53640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa98c15ca40 0x7fa98c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.912+0000 7fa990e53640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98c15d390 con 0x7fa98c15ceb0 2024-09-15T22:46:37.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.912+0000 7fa990e53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98c15d670 con 0x7fa98c0d02a0 2024-09-15T22:46:37.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.912+0000 7fa990e53640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa98c15d950 con 0x7fa98c15ca40 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa989d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa98c15ca40 0x7fa98c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa98ad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa98c15ceb0 0x7fa98c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55346/0 (socket says 172.21.15.134:55346) 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa989d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa98c15ca40 0x7fa98c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51164/0 (socket says 172.21.15.134:51164) 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa98ad9d640 1 -- 172.21.15.134:0/4001278489 learned_addr learned my addr 172.21.15.134:0/4001278489 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa989d9b640 1 -- 172.21.15.134:0/4001278489 >> v1:172.21.15.177:6789/0 conn(0x7fa98c0d02a0 legacy=0x7fa98c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa989d9b640 1 -- 172.21.15.134:0/4001278489 >> v1:172.21.15.134:6789/0 conn(0x7fa98c15ceb0 legacy=0x7fa98c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa989d9b640 1 -- 172.21.15.134:0/4001278489 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c15dc30 con 0x7fa98c15ca40 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.913+0000 7fa98959a640 1 -- 172.21.15.134:0/4001278489 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975943145 0 0) 0x7fa98c15d390 con 0x7fa98c15ceb0 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa989d9b640 1 --2- 172.21.15.134:0/4001278489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c15ca40 0x7fa98c15e430 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0097a0 tx=0x7fa97c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ddbd77f60eebc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa98959a640 1 -- 172.21.15.134:0/4001278489 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c037070 con 0x7fa98c15ca40 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa98959a640 1 -- 172.21.15.134:0/4001278489 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97c02ae50 con 0x7fa98c15ca40 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa98959a640 1 -- 172.21.15.134:0/4001278489 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c032660 con 0x7fa98c15ca40 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 -- 172.21.15.134:0/4001278489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c15ca40 msgr2=0x7fa98c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 --2- 172.21.15.134:0/4001278489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c15ca40 0x7fa98c15e430 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0097a0 tx=0x7fa97c02a140 comp rx=0 tx=0).stop 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 -- 172.21.15.134:0/4001278489 shutdown_connections 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 --2- 172.21.15.134:0/4001278489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c15ca40 0x7fa98c15e430 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 -- 172.21.15.134:0/4001278489 >> 172.21.15.134:0/4001278489 conn(0x7fa98c062cc0 msgr2=0x7fa98c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 -- 172.21.15.134:0/4001278489 shutdown_connections 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.914+0000 7fa990e53640 1 -- 172.21.15.134:0/4001278489 wait complete. 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 Processor -- start 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 -- start start 2024-09-15T22:46:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98c15ca40 0x7fa98c150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98c15ceb0 0x7fa98c1f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c155d10 con 0x7fa98c0d02a0 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c155b90 con 0x7fa98c15ceb0 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.916+0000 7fa990e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c0b4790 con 0x7fa98c15ca40 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51180/0 (socket says 172.21.15.134:51180) 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 -- 172.21.15.134:0/3304592694 learned_addr learned my addr 172.21.15.134:0/3304592694 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa989d9b640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98c15ca40 0x7fa98c150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98ad9d640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98c15ceb0 0x7fa98c1f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 -- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98c15ca40 msgr2=0x7fa98c150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98c15ca40 0x7fa98c150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 -- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98c15ceb0 msgr2=0x7fa98c1f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98c15ceb0 0x7fa98c1f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 -- 172.21.15.134:0/3304592694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c1f2140 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa98a59c640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e790 tx=0x7fa97400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740041f0 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9740043b0 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c150590 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740116b0 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.917+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c14f850 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.918+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa98c1543e0 con 0x7fa98c0d02a0 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.919+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fa974011850 con 0x7fa98c0d02a0 2024-09-15T22:46:37.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.919+0000 7fa982ffd640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 0x7fa96c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.919+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7fa97408e0a0 con 0x7fa98c0d02a0 2024-09-15T22:46:37.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.919+0000 7fa989d9b640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 0x7fa96c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.920+0000 7fa989d9b640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 0x7fa96c06eb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:37.923+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa98c1f2140 con 0x7fa98c0d02a0 2024-09-15T22:46:38.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.120+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa98c0d0b70 con 0x7fa98c0d02a0 2024-09-15T22:46:38.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.121+0000 7fa982ffd640 1 -- 172.21.15.134:0/3304592694 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+3923 (secure 0 0 0) 0x7fa974016030 con 0x7fa98c0d02a0 2024-09-15T22:46:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:38.123 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":56,"btime":"2024-09-15T22:46:32:964083+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3959632397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3959632397},{"type":"v1","addr":"172.21.15.177:6835","nonce":3959632397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1497940203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1497940203},{"type":"v1","addr":"172.21.15.177:6834","nonce":1497940203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1607607792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1607607792},{"type":"v1","addr":"172.21.15.134:6835","nonce":1607607792}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1054108629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1054108629},{"type":"v1","addr":"172.21.15.134:6834","nonce":1054108629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[]} 2024-09-15T22:46:38.123 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 56 2024-09-15T22:46:38.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 msgr2=0x7fa96c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 0x7fa96c06eb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:38.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 msgr2=0x7fa98c1f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e790 tx=0x7fa97400ec50 comp rx=0 tx=0).stop 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 shutdown_connections 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98c15ceb0 0x7fa98c1f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98c15ca40 0x7fa98c150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa96c06c6a0 0x7fa96c06eb60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 --2- 172.21.15.134:0/3304592694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98c0d02a0 0x7fa98c1f1c00 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 >> 172.21.15.134:0/3304592694 conn(0x7fa98c062cc0 msgr2=0x7fa98c0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:38.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 shutdown_connections 2024-09-15T22:46:38.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.123+0000 7fa990e53640 1 -- 172.21.15.134:0/3304592694 wait complete. 2024-09-15T22:46:38.135 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:46:38.136 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:46:38.136 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:46:38.136 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:46:38.136 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:46:38.136 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:46:38.137 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:46:38.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:46:38.137 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:46:38.137 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:46:38.137 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:46:38.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:46:38.138 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:46:38.138 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:46:38.138 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:46:38.138 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:46:38.146 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:46:38.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:46:38.147 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:46:38.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:46:38.149 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:46:38.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:46:38.150 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:46:38.150 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:46:38.189 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:46:38.189 DEBUG:teuthology.parallel:result is None 2024-09-15T22:46:38.189 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:46:38.190 DEBUG:teuthology.parallel:result is None 2024-09-15T22:46:38.193 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:46:38.193 DEBUG:teuthology.parallel:result is None 2024-09-15T22:46:38.193 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:46:38.194 DEBUG:teuthology.parallel:result is None 2024-09-15T22:46:38.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:46:38.263 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:46:38.264 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:46:38.277 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:46:38.278 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:46:38.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.298+0000 7febeb8f1640 1 Processor -- start 2024-09-15T22:46:38.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.298+0000 7febeb8f1640 1 -- start start 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febeb8f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe40b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febeb8f1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febe40b7aa0 0x7febe40b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febeb8f1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe40b6b50 con 0x7febe415e860 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febeb8f1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7febe40d34d0 con 0x7febe40b7aa0 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febeb8f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7febe40d3790 con 0x7febe40b61f0 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febe40b7aa0 0x7febe40b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febe40b7aa0 0x7febe40b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51208/0 (socket says 172.21.15.134:51208) 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe968d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7febe415e860 0x7febe40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55364/0 (socket says 172.21.15.134:55364) 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 -- 172.21.15.134:0/3458171020 learned_addr learned my addr 172.21.15.134:0/3458171020 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe8e8c640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe40b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 -- 172.21.15.134:0/3458171020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 msgr2=0x7febe40b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:38.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe40b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 -- 172.21.15.134:0/3458171020 >> v1:172.21.15.134:6789/0 conn(0x7febe415e860 legacy=0x7febe40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febd7fff640 1 -- 172.21.15.134:0/3458171020 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720177075 0 0) 0x7febe40b6b50 con 0x7febe415e860 2024-09-15T22:46:38.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.299+0000 7febe9e8e640 1 -- 172.21.15.134:0/3458171020 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe40d3a70 con 0x7febe40b7aa0 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.300+0000 7febe9e8e640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe40b7aa0 0x7febe40b7ef0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7febdc009e50 tx=0x7febdc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744880fab6f8c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.300+0000 7febd7fff640 1 -- 172.21.15.134:0/3458171020 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc036070 con 0x7febe40b7aa0 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.300+0000 7febd7fff640 1 -- 172.21.15.134:0/3458171020 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc031600 con 0x7febe40b7aa0 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.300+0000 7febd7fff640 1 -- 172.21.15.134:0/3458171020 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0319d0 con 0x7febe40b7aa0 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 -- 172.21.15.134:0/3458171020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe40b7aa0 msgr2=0x7febe40b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe40b7aa0 0x7febe40b7ef0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7febdc009e50 tx=0x7febdc02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 -- 172.21.15.134:0/3458171020 shutdown_connections 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe40b7aa0 0x7febe40b7ef0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 --2- 172.21.15.134:0/3458171020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe40b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 -- 172.21.15.134:0/3458171020 >> 172.21.15.134:0/3458171020 conn(0x7febe4062c60 msgr2=0x7febe40d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 -- 172.21.15.134:0/3458171020 shutdown_connections 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.301+0000 7febeb8f1640 1 -- 172.21.15.134:0/3458171020 wait complete. 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.302+0000 7febeb8f1640 1 Processor -- start 2024-09-15T22:46:38.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.302+0000 7febeb8f1640 1 -- start start 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe40b7aa0 0x7febe40b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7febe40d4310 con 0x7febe415e860 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febe40d4030 con 0x7febe40b7aa0 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7febe415ec40 con 0x7febe40b61f0 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51222/0 (socket says 172.21.15.134:51222) 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 -- 172.21.15.134:0/2564422296 learned_addr learned my addr 172.21.15.134:0/2564422296 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe968d640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe8e8c640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe40b7aa0 0x7febe40b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 -- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 msgr2=0x7febe414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 -- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe40b7aa0 msgr2=0x7febe40b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe40b7aa0 0x7febe40b9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 -- 172.21.15.134:0/2564422296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe4161a80 con 0x7febe415e860 2024-09-15T22:46:38.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febe9e8e640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7febdc034040 tx=0x7febdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc036050 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc042070 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc009510 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.303+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe4148e30 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.304+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe4161d60 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.305+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe40b3ad0 con 0x7febe415e860 2024-09-15T22:46:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.305+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7febdc007bb0 con 0x7febe415e860 2024-09-15T22:46:38.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.305+0000 7febd5ffb640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 0x7febc806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:38.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.305+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4971+0+0 (secure 0 0 0) 0x7febdc0ac890 con 0x7febe415e860 2024-09-15T22:46:38.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.305+0000 7febe968d640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 0x7febc806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:38.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.306+0000 7febe968d640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 0x7febc806eb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febd8000f60 tx=0x7febd8007c00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:38.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.310+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febdc07abb0 con 0x7febe415e860 2024-09-15T22:46:38.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:38.493+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7febe40d2700 con 0x7febe415e860 2024-09-15T22:46:39.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.334+0000 7febd5ffb640 1 -- 172.21.15.134:0/2564422296 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) ==== 97+0+0 (secure 0 0 0) 0x7febdc07a4b0 con 0x7febe415e860 2024-09-15T22:46:39.335 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:46:39.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 msgr2=0x7febc806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 0x7febc806eb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febd8000f60 tx=0x7febd8007c00 comp rx=0 tx=0).stop 2024-09-15T22:46:39.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 msgr2=0x7febe40b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7febdc034040 tx=0x7febdc004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:39.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 shutdown_connections 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7febc806c6a0 0x7febc806eb60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe415e860 0x7febe40b97d0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe40b7aa0 0x7febe40b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 --2- 172.21.15.134:0/2564422296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febe40b61f0 0x7febe414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 >> 172.21.15.134:0/2564422296 conn(0x7febe4062c60 msgr2=0x7febe40b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 shutdown_connections 2024-09-15T22:46:39.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.337+0000 7febeb8f1640 1 -- 172.21.15.134:0/2564422296 wait complete. 2024-09-15T22:46:39.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:46:39.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.450+0000 7f0387703640 1 Processor -- start 2024-09-15T22:46:39.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.450+0000 7f0387703640 1 -- start start 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0387703640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f03800d02a0 0x7f03800d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0387703640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03800d0bc0 con 0x7f038015ca40 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0387703640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038015d390 con 0x7f038015ceb0 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0387703640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f038015d670 con 0x7f03800d02a0 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f038549f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f03800d02a0 0x7f03800d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0384c9e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f038015ca40 0x7f038015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55370/0 (socket says 172.21.15.134:55370) 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f038549f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f03800d02a0 0x7f03800d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51226/0 (socket says 172.21.15.134:51226) 2024-09-15T22:46:39.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0384c9e640 1 -- 172.21.15.134:0/3338590269 learned_addr learned my addr 172.21.15.134:0/3338590269 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:39.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f038549f640 1 -- 172.21.15.134:0/3338590269 >> v1:172.21.15.177:6789/0 conn(0x7f038015ceb0 legacy=0x7f03801594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f038549f640 1 -- 172.21.15.134:0/3338590269 >> v1:172.21.15.134:6789/0 conn(0x7f038015ca40 legacy=0x7f038015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f0377fff640 1 -- 172.21.15.134:0/3338590269 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799387071 0 0) 0x7f03800d0bc0 con 0x7f038015ca40 2024-09-15T22:46:39.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.451+0000 7f038549f640 1 -- 172.21.15.134:0/3338590269 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038015d950 con 0x7f03800d02a0 2024-09-15T22:46:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.452+0000 7f038549f640 1 --2- 172.21.15.134:0/3338590269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03800d02a0 0x7f03800d0680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94309ff3b811b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.452+0000 7f0377fff640 1 -- 172.21.15.134:0/3338590269 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c037070 con 0x7f03800d02a0 2024-09-15T22:46:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.452+0000 7f0377fff640 1 -- 172.21.15.134:0/3338590269 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c02ae50 con 0x7f03800d02a0 2024-09-15T22:46:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.452+0000 7f0377fff640 1 -- 172.21.15.134:0/3338590269 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c032660 con 0x7f03800d02a0 2024-09-15T22:46:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 -- 172.21.15.134:0/3338590269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03800d02a0 msgr2=0x7f03800d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 --2- 172.21.15.134:0/3338590269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03800d02a0 0x7f03800d0680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02a140 comp rx=0 tx=0).stop 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 -- 172.21.15.134:0/3338590269 shutdown_connections 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 --2- 172.21.15.134:0/3338590269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03800d02a0 0x7f03800d0680 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 -- 172.21.15.134:0/3338590269 >> 172.21.15.134:0/3338590269 conn(0x7f0380062cc0 msgr2=0x7f038006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 -- 172.21.15.134:0/3338590269 shutdown_connections 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.453+0000 7f0387703640 1 -- 172.21.15.134:0/3338590269 wait complete. 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.454+0000 7f0387703640 1 Processor -- start 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.454+0000 7f0387703640 1 -- start start 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03800d02a0 0x7f0380155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038015ceb0 0x7f03801f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f038015eb40 con 0x7f038015ca40 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f038015df10 con 0x7f038015ceb0 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0387703640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0380155b90 con 0x7f03800d02a0 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51238/0 (socket says 172.21.15.134:51238) 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 -- 172.21.15.134:0/1231128991 learned_addr learned my addr 172.21.15.134:0/1231128991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f038549f640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03800d02a0 0x7f0380155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0385ca0640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038015ceb0 0x7f03801f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 -- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03800d02a0 msgr2=0x7f0380155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03800d02a0 0x7f0380155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 -- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038015ceb0 msgr2=0x7f03801f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038015ceb0 0x7f03801f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 -- 172.21.15.134:0/1231128991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03800af2a0 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0384c9e640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f037000c4d0 tx=0x7f037000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370018070 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.455+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370007500 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.456+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0380156500 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.456+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370004a20 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.456+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0380156ac0 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.457+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03800b4790 con 0x7f038015ca40 2024-09-15T22:46:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.457+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f0370004bc0 con 0x7f038015ca40 2024-09-15T22:46:39.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.457+0000 7f0375ffb640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 0x7f036406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.458+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 4885+0+0 (secure 0 0 0) 0x7f037008aae0 con 0x7f038015ca40 2024-09-15T22:46:39.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.458+0000 7f038549f640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 0x7f036406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.458+0000 7f038549f640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 0x7f036406eb90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f037c034000 tx=0x7f037c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.462+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03800af2a0 con 0x7f038015ca40 2024-09-15T22:46:39.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.690+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f038006d3b0 con 0x7f038015ca40 2024-09-15T22:46:39.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.691+0000 7f0375ffb640 1 -- 172.21.15.134:0/1231128991 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f0370058fb0 con 0x7f038015ca40 2024-09-15T22:46:39.692 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:39.692 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:39.692 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:46:39.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:46:39.693 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:46:39.694 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.698 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.699 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:46:39.700 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:46:39.701 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.702 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:46:39.704 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:46:39.706 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 msgr2=0x7f036406eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 0x7f036406eb90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f037c034000 tx=0x7f037c02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 msgr2=0x7f03800af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f037000c4d0 tx=0x7f037000c990 comp rx=0 tx=0).stop 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 shutdown_connections 2024-09-15T22:46:39.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038015ceb0 0x7f03801f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f036406c6d0 0x7f036406eb90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f038015ca40 0x7f03800af5a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 --2- 172.21.15.134:0/1231128991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03800d02a0 0x7f0380155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 >> 172.21.15.134:0/1231128991 conn(0x7f0380062cc0 msgr2=0x7f03800cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 shutdown_connections 2024-09-15T22:46:39.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.693+0000 7f0387703640 1 -- 172.21.15.134:0/1231128991 wait complete. 2024-09-15T22:46:39.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:46:39.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.806+0000 7f0d42450640 1 Processor -- start 2024-09-15T22:46:39.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.806+0000 7f0d42450640 1 -- start start 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d42450640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d3c0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d42450640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c15ecf0 con 0x7f0d3c0cd300 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d42450640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c15c6e0 con 0x7f0d3c06f1e0 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d42450640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c15efb0 con 0x7f0d3c15c300 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d3b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0d3c0cd300 0x7f0d3c06ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55380/0 (socket says 172.21.15.134:55380) 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d3b7fe640 1 -- 172.21.15.134:0/3560061120 learned_addr learned my addr 172.21.15.134:0/3560061120 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d3c0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397421553 0 0) 0x7f0d3c15ecf0 con 0x7f0d3c0cd300 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.807+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003520 con 0x7f0d3c0cd300 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572828398 0 0) 0x7f0d24003520 con 0x7f0d3c0cd300 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 msgr2=0x7f0d3c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d3c0affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 >> v1:172.21.15.177:6789/0 conn(0x7f0d3c06f1e0 legacy=0x7f0d3c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c15f290 con 0x7f0d3c0cd300 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0d30001670 con 0x7f0d3c0cd300 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 >> v1:172.21.15.134:6789/0 conn(0x7f0d3c0cd300 legacy=0x7f0d3c06ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d240039e0 0x7f0d24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d24004d40 0x7f0d240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c15efb0 con 0x7f0d240039e0 2024-09-15T22:46:39.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2400ba70 con 0x7f0d24004d40 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2400bc70 con 0x7f0d3c15c300 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d240039e0 0x7f0d24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3b7fe640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d409ed640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d24004d40 0x7f0d240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 -- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 msgr2=0x7f0d24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 -- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d24004d40 msgr2=0x7f0d240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d24004d40 0x7f0d240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3bfff640 1 -- 172.21.15.134:0/3560061120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d24003520 con 0x7f0d240039e0 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.808+0000 7f0d3b7fe640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c15c300 0x7f0d24004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d240039e0 0x7f0d24003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009ac0 tx=0x7f0d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5d9c428408f856 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c036070 con 0x7f0d240039e0 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c031400 con 0x7f0d240039e0 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d3affd640 1 -- 172.21.15.134:0/3560061120 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c009690 con 0x7f0d240039e0 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d42450640 1 -- 172.21.15.134:0/3560061120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d240039e0 msgr2=0x7f0d24003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d42450640 1 --2- 172.21.15.134:0/3560061120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d240039e0 0x7f0d24003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009ac0 tx=0x7f0d24005830 comp rx=0 tx=0).stop 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.809+0000 7f0d409ed640 1 -- 172.21.15.134:0/3560061120 reap_dead start 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.810+0000 7f0d42450640 1 -- 172.21.15.134:0/3560061120 shutdown_connections 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.810+0000 7f0d42450640 1 -- 172.21.15.134:0/3560061120 >> 172.21.15.134:0/3560061120 conn(0x7f0d3c06cae0 msgr2=0x7f0d3c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.810+0000 7f0d42450640 1 -- 172.21.15.134:0/3560061120 shutdown_connections 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.810+0000 7f0d42450640 1 -- 172.21.15.134:0/3560061120 wait complete. 2024-09-15T22:46:39.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.811+0000 7f0d42450640 1 Processor -- start 2024-09-15T22:46:39.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.811+0000 7f0d42450640 1 -- start start 2024-09-15T22:46:39.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d240039e0 0x7f0d3c161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c0b0c30 0x7f0d3c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c071880 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c15f850 con 0x7f0d240039e0 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0affc0 con 0x7f0d3c0b0c30 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51256/0 (socket says 172.21.15.134:51256) 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 -- 172.21.15.134:0/1120826900 learned_addr learned my addr 172.21.15.134:0/1120826900 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d240039e0 0x7f0d3c161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d409ed640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c0b0c30 0x7f0d3c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 -- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c0b0c30 msgr2=0x7f0d3c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c0b0c30 0x7f0d3c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 -- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d240039e0 msgr2=0x7f0d3c161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d240039e0 0x7f0d3c161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 -- 172.21.15.134:0/1120826900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0b1830 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d3b7fe640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001c10 tx=0x7f0d3000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000ee60 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30018070 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c0b1b10 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000ca40 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.812+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c0b20d0 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.813+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3c0b03a0 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.814+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f0d3000cbe0 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.814+0000 7f0d38ff9640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 0x7f0d2806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.814+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 4885+0+0 (secure 0 0 0) 0x7f0d3008b4e0 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.814+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 0x7f0d2806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.815+0000 7f0d3bfff640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 0x7f0d2806eb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c033000 tx=0x7f0d2c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.818+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d30059350 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.984+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0d3c158e60 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.985+0000 7f0d38ff9640 1 -- 172.21.15.134:0/1120826900 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) ==== 84+0+65 (secure 0 0 0) 0x7f0d3005d650 con 0x7f0d3c14d3e0 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:39.987 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:39.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 msgr2=0x7f0d2806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 0x7f0d2806eb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c033000 tx=0x7f0d2c008030 comp rx=0 tx=0).stop 2024-09-15T22:46:39.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 msgr2=0x7f0d3c14d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001c10 tx=0x7f0d3000ec10 comp rx=0 tx=0).stop 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 shutdown_connections 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d3c0b0c30 0x7f0d3c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0d2806c6a0 0x7f0d2806eb60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c14d3e0 0x7f0d3c14d860 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 --2- 172.21.15.134:0/1120826900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d240039e0 0x7f0d3c161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 >> 172.21.15.134:0/1120826900 conn(0x7f0d3c06cae0 msgr2=0x7f0d3c162270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 shutdown_connections 2024-09-15T22:46:39.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:39.987+0000 7f0d42450640 1 -- 172.21.15.134:0/1120826900 wait complete. 2024-09-15T22:46:39.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:46:39.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:46:40.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.101+0000 7fbdbe606640 1 Processor -- start 2024-09-15T22:46:40.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.101+0000 7fbdbe606640 1 -- start start 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdbe606640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbdb815b370 0x7fbdb8072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdbe606640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb815c970 con 0x7fbdb815f9f0 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdbe606640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb815bbb0 con 0x7fbdb806f130 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdbe606640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb815fef0 con 0x7fbdb815b370 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdb77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbdb815f9f0 0x7fbdb806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55392/0 (socket says 172.21.15.134:55392) 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdb77fe640 1 -- 172.21.15.134:0/3927847209 learned_addr learned my addr 172.21.15.134:0/3927847209 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdb7fff640 1 --2- 172.21.15.134:0/3927847209 >> v2:172.21.15.177:3300/0 conn(0x7fbdb815b370 0x7fbdb8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdb6ffd640 1 -- 172.21.15.134:0/3927847209 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647024103 0 0) 0x7fbdb815c970 con 0x7fbdb815f9f0 2024-09-15T22:46:40.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.102+0000 7fbdb6ffd640 1 -- 172.21.15.134:0/3927847209 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda0003520 con 0x7fbdb815f9f0 2024-09-15T22:46:40.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.103+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3927847209 >> v1:172.21.15.177:6789/0 conn(0x7fbdb806f130 legacy=0x7fbdb80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.103+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3927847209 >> v1:172.21.15.134:6789/0 conn(0x7fbdb815f9f0 legacy=0x7fbdb806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.103+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3927847209 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb815be90 con 0x7fbdb815b370 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.103+0000 7fbdb7fff640 1 --2- 172.21.15.134:0/3927847209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8072560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097a0 tx=0x7fbda802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a409bad0657d9c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.103+0000 7fbdb6ffd640 1 -- 172.21.15.134:0/3927847209 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8037070 con 0x7fbdb815b370 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdb6ffd640 1 -- 172.21.15.134:0/3927847209 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8032440 con 0x7fbdb815b370 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdb6ffd640 1 -- 172.21.15.134:0/3927847209 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80327f0 con 0x7fbdb815b370 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 -- 172.21.15.134:0/3927847209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 msgr2=0x7fbdb8072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3927847209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8072560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097a0 tx=0x7fbda802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 -- 172.21.15.134:0/3927847209 shutdown_connections 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3927847209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8072560 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 -- 172.21.15.134:0/3927847209 >> 172.21.15.134:0/3927847209 conn(0x7fbdb806bba0 msgr2=0x7fbdb806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:40.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 -- 172.21.15.134:0/3927847209 shutdown_connections 2024-09-15T22:46:40.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.104+0000 7fbdbe606640 1 -- 172.21.15.134:0/3927847209 wait complete. 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.105+0000 7fbdbe606640 1 Processor -- start 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.105+0000 7fbdbe606640 1 -- start start 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdb815f9f0 0x7fbdb80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80731b0 con 0x7fbdb806f130 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb815c450 con 0x7fbdb815b370 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbe606640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb815b750 con 0x7fbdb815f9f0 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51266/0 (socket says 172.21.15.134:51266) 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3960957232 learned_addr learned my addr 172.21.15.134:0/3960957232 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdb815f9f0 msgr2=0x7fbdb80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.106+0000 7fbdbcba3640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdb815f9f0 0x7fbdb80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb77fe640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb7fff640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdb815f9f0 0x7fbdb80b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 msgr2=0x7fbdb8158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb7fff640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb7fff640 1 -- 172.21.15.134:0/3960957232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8159690 con 0x7fbdb806f130 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb77fe640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:40.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb7fff640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097a0 tx=0x7fbda80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8037050 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8038040 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb8159970 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8004470 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.107+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb8159f30 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.108+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb8072560 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.108+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fbda803c6d0 con 0x7fbdb806f130 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.109+0000 7fbdb4ff9640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 0x7fbda406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.109+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 4885+0+0 (secure 0 0 0) 0x7fbda80ac1a0 con 0x7fbdb806f130 2024-09-15T22:46:40.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.109+0000 7fbdb77fe640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 0x7fbda406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.110+0000 7fbdb77fe640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 0x7fbda406eb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8154740 tx=0x7fbdac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.113+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbda807a770 con 0x7fbdb806f130 2024-09-15T22:46:40.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.278+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbdb80aa5d0 con 0x7fbdb806f130 2024-09-15T22:46:40.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.609+0000 7fbdb4ff9640 1 -- 172.21.15.134:0/3960957232 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) ==== 138+0+0 (secure 0 0 0) 0x7fbda80aae20 con 0x7fbdb806f130 2024-09-15T22:46:40.610 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 msgr2=0x7fbda406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 0x7fbda406eb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8154740 tx=0x7fbdac009040 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 msgr2=0x7fbdb8154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097a0 tx=0x7fbda80046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 shutdown_connections 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbdb815f9f0 0x7fbdb80b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815b370 0x7fbdb8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbda406c6a0 0x7fbda406eb60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 --2- 172.21.15.134:0/3960957232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb806f130 0x7fbdb8154200 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 >> 172.21.15.134:0/3960957232 conn(0x7fbdb806bba0 msgr2=0x7fbdb80b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 shutdown_connections 2024-09-15T22:46:40.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.611+0000 7fbdbe606640 1 -- 172.21.15.134:0/3960957232 wait complete. 2024-09-15T22:46:40.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:46:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 Processor -- start 2024-09-15T22:46:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 -- start start 2024-09-15T22:46:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc0d80b3b00 0x7fc0d80d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d80d20e0 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d80cfa70 con 0x7fc0d80b61e0 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.733+0000 7fc0dc877640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d80d24f0 con 0x7fc0d80b3b00 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d6d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc0d80b3540 0x7fc0d80d2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55398/0 (socket says 172.21.15.134:55398) 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d6d9d640 1 -- 172.21.15.134:0/641194113 learned_addr learned my addr 172.21.15.134:0/641194113 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0cffff640 1 --2- 172.21.15.134:0/641194113 >> v2:172.21.15.177:3300/0 conn(0x7fc0d80b3b00 0x7fc0d80d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943371886 0 0) 0x7fc0d80d20e0 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0c4003520 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 143515478 0 0) 0x7fc0c4003520 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 >> v2:172.21.15.177:3300/0 conn(0x7fc0d80b3b00 msgr2=0x7fc0d80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 --2- 172.21.15.134:0/641194113 >> v2:172.21.15.177:3300/0 conn(0x7fc0d80b3b00 0x7fc0d80d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 >> v1:172.21.15.177:6789/0 conn(0x7fc0d80b61e0 legacy=0x7fc0d80b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80cfd50 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc0d00019f0 con 0x7fc0d80b3540 2024-09-15T22:46:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 >> v1:172.21.15.134:6789/0 conn(0x7fc0d80b3540 legacy=0x7fc0d80d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c40039b0 0x7fc0c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0c40052e0 0x7fc0c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d80d24f0 con 0x7fc0c4004800 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c400c1b0 con 0x7fc0c40039b0 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c400c3b0 con 0x7fc0c40052e0 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0cffff640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d659c640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c40039b0 0x7fc0c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.734+0000 7fc0d6d9d640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0c40052e0 0x7fc0c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 -- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0c40052e0 msgr2=0x7fc0c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0c40052e0 0x7fc0c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 -- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c40039b0 msgr2=0x7fc0c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c40039b0 0x7fc0c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 -- 172.21.15.134:0/641194113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c4003520 con 0x7fc0c4004800 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0d6d9d640 1 -- 172.21.15.134:0/641194113 reap_dead start 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0cffff640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009a90 tx=0x7fc0c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e809c245113f3718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0036070 con 0x7fc0c4004800 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c0031400 con 0x7fc0c4004800 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.735+0000 7fc0d5d9b640 1 -- 172.21.15.134:0/641194113 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0009690 con 0x7fc0c4004800 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 -- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 msgr2=0x7fc0c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009a90 tx=0x7fc0c4005830 comp rx=0 tx=0).stop 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 -- 172.21.15.134:0/641194113 shutdown_connections 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 --2- 172.21.15.134:0/641194113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 -- 172.21.15.134:0/641194113 >> 172.21.15.134:0/641194113 conn(0x7fc0d80d11e0 msgr2=0x7fc0d80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 -- 172.21.15.134:0/641194113 shutdown_connections 2024-09-15T22:46:40.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.736+0000 7fc0dc877640 1 -- 172.21.15.134:0/641194113 wait complete. 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.737+0000 7fc0dc877640 1 Processor -- start 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.737+0000 7fc0dc877640 1 -- start start 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 0x7fc0d80cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 0x7fc0d8158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d815edc0 con 0x7fc0d80ce200 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d80d1d00 con 0x7fc0c4004800 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0dc877640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80ccc20 con 0x7fc0d8148100 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51280/0 (socket says 172.21.15.134:51280) 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 -- 172.21.15.134:0/2310923437 learned_addr learned my addr 172.21.15.134:0/2310923437 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0d659c640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 0x7fc0d80cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0d6d9d640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 0x7fc0d8158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 -- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 msgr2=0x7fc0d8158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 0x7fc0d8158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 -- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 msgr2=0x7fc0d80cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 0x7fc0d80cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0cffff640 1 -- 172.21.15.134:0/2310923437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80ccf00 con 0x7fc0d80ce200 2024-09-15T22:46:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0d6d9d640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 0x7fc0d8158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.738+0000 7fc0d659c640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 0x7fc0d80cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0cffff640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009bb0 tx=0x7fc0c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c003f020 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c0037040 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d80cd1e0 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0036070 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.739+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d80cd7a0 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.740+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d8148510 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.740+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fc0c0042020 con 0x7fc0d80ce200 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.741+0000 7fc0ceffd640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 0x7fc0b806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:40.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.741+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5255+0+0 (secure 0 0 0) 0x7fc0c00abac0 con 0x7fc0d80ce200 2024-09-15T22:46:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.741+0000 7fc0d659c640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 0x7fc0b806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.741+0000 7fc0d659c640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 0x7fc0b806eb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80055c0 tx=0x7fc0c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.745+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0d8148510 con 0x7fc0d80ce200 2024-09-15T22:46:40.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:40.910+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc0d80b65c0 con 0x7fc0d80ce200 2024-09-15T22:46:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.614+0000 7fc0ceffd640 1 -- 172.21.15.134:0/2310923437 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) ==== 170+0+0 (secure 0 0 0) 0x7fc0c0049030 con 0x7fc0d80ce200 2024-09-15T22:46:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.616+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 msgr2=0x7fc0b806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.616+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 0x7fc0b806eb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80055c0 tx=0x7fc0c8009040 comp rx=0 tx=0).stop 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.616+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 msgr2=0x7fc0d8147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.616+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009bb0 tx=0x7fc0c0004730 comp rx=0 tx=0).stop 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 shutdown_connections 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0d8148100 0x7fc0d8158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc0b806c6a0 0x7fc0b806eb60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0d80ce200 0x7fc0d8147bc0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 --2- 172.21.15.134:0/2310923437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c4004800 0x7fc0d80cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 >> 172.21.15.134:0/2310923437 conn(0x7fc0d80d11e0 msgr2=0x7fc0d80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:41.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 shutdown_connections 2024-09-15T22:46:41.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.617+0000 7fc0dc877640 1 -- 172.21.15.134:0/2310923437 wait complete. 2024-09-15T22:46:41.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:46:41.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.741+0000 7f4a33fff640 1 Processor -- start 2024-09-15T22:46:41.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.741+0000 7f4a33fff640 1 -- start start 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a33fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a34073cf0 0x7f4a3406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a33fff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a34147c00 con 0x7f4a34147820 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a33fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a340741d0 con 0x7f4a340b63b0 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a33fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4a34162160 con 0x7f4a34073cf0 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a32ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4a34147820 0x7f4a340b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55408/0 (socket says 172.21.15.134:55408) 2024-09-15T22:46:41.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3213576368 learned_addr learned my addr 172.21.15.134:0/3213576368 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a2a7fc640 1 --2- 172.21.15.134:0/3213576368 >> v2:172.21.15.177:3300/0 conn(0x7f4a34073cf0 0x7f4a3406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289345240 0 0) 0x7f4a34147c00 con 0x7f4a34147820 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003520 con 0x7f4a34147820 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4025835137 0 0) 0x7f4a20003520 con 0x7f4a34147820 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 >> v2:172.21.15.177:3300/0 conn(0x7f4a34073cf0 msgr2=0x7f4a3406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 --2- 172.21.15.134:0/3213576368 >> v2:172.21.15.177:3300/0 conn(0x7f4a34073cf0 0x7f4a3406d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 >> v1:172.21.15.177:6789/0 conn(0x7f4a340b63b0 legacy=0x7f4a3406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a34162440 con 0x7f4a34147820 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f4a24001670 con 0x7f4a34147820 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 >> v1:172.21.15.134:6789/0 conn(0x7f4a34147820 legacy=0x7f4a340b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a20004800 0x7f4a20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a200051c0 0x7f4a2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34162160 con 0x7f4a200039b0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000c060 con 0x7f4a20004800 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2000c260 con 0x7f4a200051c0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.742+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a2a7fc640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a20004800 0x7f4a20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a337fe640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a200051c0 0x7f4a2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a200051c0 msgr2=0x7f4a2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a200051c0 0x7f4a2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a20004800 msgr2=0x7f4a20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a20004800 0x7f4a20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3213576368 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a20003520 con 0x7f4a200039b0 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a337fe640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a200051c0 0x7f4a2000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a337fe640 1 -- 172.21.15.134:0/3213576368 reap_dead start 2024-09-15T22:46:41.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a20003dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c240 tx=0x7f4a20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72a43cfb2ee2543 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.743+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007d10 con 0x7f4a200039b0 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a24005ad0 con 0x7f4a200039b0 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a327fc640 1 -- 172.21.15.134:0/3213576368 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007070 con 0x7f4a200039b0 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 -- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 msgr2=0x7f4a20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a20003dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c240 tx=0x7f4a20005830 comp rx=0 tx=0).stop 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 -- 172.21.15.134:0/3213576368 shutdown_connections 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3213576368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a20003dd0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 -- 172.21.15.134:0/3213576368 >> 172.21.15.134:0/3213576368 conn(0x7f4a3406ccb0 msgr2=0x7f4a3406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 -- 172.21.15.134:0/3213576368 shutdown_connections 2024-09-15T22:46:41.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.744+0000 7f4a33fff640 1 -- 172.21.15.134:0/3213576368 wait complete. 2024-09-15T22:46:41.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.745+0000 7f4a33fff640 1 Processor -- start 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.745+0000 7f4a33fff640 1 -- start start 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a34142090 0x7f4a340b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a34142510 0x7f4a340b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34162f20 con 0x7f4a200039b0 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34162a00 con 0x7f4a34142090 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a33fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34148280 con 0x7f4a34142510 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a32ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a32ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51300/0 (socket says 172.21.15.134:51300) 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3450801862 learned_addr learned my addr 172.21.15.134:0/3450801862 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a2a7fc640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a34142090 0x7f4a340b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.746+0000 7f4a337fe640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a34142510 0x7f4a340b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a34142510 msgr2=0x7f4a340b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a34142510 0x7f4a340b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a34142090 msgr2=0x7f4a340b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a34142090 0x7f4a340b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 -- 172.21.15.134:0/3450801862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3415d5f0 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a32ffd640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c240 tx=0x7f4a34162610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24041070 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a24000ed0 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a34140a40 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007d10 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.747+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a34141000 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.748+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a340d2400 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.748+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f4a24044070 con 0x7f4a200039b0 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.749+0000 7f4a2bfff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 0x7f4a1406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:41.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.749+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5637+0+0 (secure 0 0 0) 0x7f4a240abcd0 con 0x7f4a200039b0 2024-09-15T22:46:41.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.749+0000 7f4a2a7fc640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 0x7f4a1406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:41.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.750+0000 7f4a2a7fc640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 0x7f4a1406eb60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4a34161f40 tx=0x7f4a1c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:41.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.753+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a2404b070 con 0x7f4a200039b0 2024-09-15T22:46:41.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:41.951+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4a340cd8d0 con 0x7f4a200039b0 2024-09-15T22:46:42.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.615+0000 7f4a2bfff640 1 -- 172.21.15.134:0/3450801862 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v58) ==== 174+0+0 (secure 0 0 0) 0x7f4a3415d5f0 con 0x7f4a200039b0 2024-09-15T22:46:42.617 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 18 and data pool 19 2024-09-15T22:46:42.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.619+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 msgr2=0x7f4a1406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.619+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 0x7f4a1406eb60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4a34161f40 tx=0x7f4a1c009190 comp rx=0 tx=0).stop 2024-09-15T22:46:42.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.619+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 msgr2=0x7f4a3415d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.619+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c240 tx=0x7f4a34162610 comp rx=0 tx=0).stop 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 shutdown_connections 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a34142510 0x7f4a340b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a34142090 0x7f4a340b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4a1406c6a0 0x7f4a1406eb60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 --2- 172.21.15.134:0/3450801862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a200039b0 0x7f4a3415d0b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.621+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 >> 172.21.15.134:0/3450801862 conn(0x7f4a3406ccb0 msgr2=0x7f4a340b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.622+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 shutdown_connections 2024-09-15T22:46:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.622+0000 7f4a33fff640 1 -- 172.21.15.134:0/3450801862 wait complete. 2024-09-15T22:46:42.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.744+0000 7f1bcf7fd640 1 Processor -- start 2024-09-15T22:46:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.745+0000 7f1bcf7fd640 1 -- start start 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.745+0000 7f1bcf7fd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bc806c1f0 0x7f1bc80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcf7fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc80cd5f0 con 0x7f1bc8151c50 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcf7fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc80cd8d0 con 0x7f1bc806be10 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcf7fd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc80cdbb0 con 0x7f1bc806c1f0 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bccd98640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1bc8151c50 0x7f1bc8162740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55420/0 (socket says 172.21.15.134:55420) 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bccd98640 1 -- 172.21.15.134:0/3569794567 learned_addr learned my addr 172.21.15.134:0/3569794567 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:42.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcdd9a640 1 --2- 172.21.15.134:0/3569794567 >> v2:172.21.15.177:3300/0 conn(0x7f1bc806c1f0 0x7f1bc80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:42.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3569794567 >> v1:172.21.15.177:6789/0 conn(0x7f1bc806be10 legacy=0x7f1bc8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3569794567 >> v1:172.21.15.134:6789/0 conn(0x7f1bc8151c50 legacy=0x7f1bc8162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.746+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3569794567 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc80cde90 con 0x7f1bc806c1f0 2024-09-15T22:46:42.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.747+0000 7f1bcdd9a640 1 --2- 172.21.15.134:0/3569794567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc80cd010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009d90 tx=0x7f1bc002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949c681f7e809b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:42.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.748+0000 7f1bbffff640 1 -- 172.21.15.134:0/3569794567 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0007740 con 0x7f1bc806c1f0 2024-09-15T22:46:42.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.748+0000 7f1bbffff640 1 -- 172.21.15.134:0/3569794567 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc00078e0 con 0x7f1bc806c1f0 2024-09-15T22:46:42.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.748+0000 7f1bbffff640 1 -- 172.21.15.134:0/3569794567 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0007cb0 con 0x7f1bc806c1f0 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.748+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3569794567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 msgr2=0x7f1bc80cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.748+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3569794567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc80cd010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009d90 tx=0x7f1bc002a6f0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.749+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3569794567 shutdown_connections 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.749+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3569794567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc80cd010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.749+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3569794567 >> 172.21.15.134:0/3569794567 conn(0x7f1bc8062cc0 msgr2=0x7f1bc806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.749+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3569794567 shutdown_connections 2024-09-15T22:46:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.749+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3569794567 wait complete. 2024-09-15T22:46:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 Processor -- start 2024-09-15T22:46:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 -- start start 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc806be10 0x7f1bc8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc8144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc815baa0 con 0x7f1bc8151c50 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80ce690 con 0x7f1bc806c1f0 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.750+0000 7f1bcf7fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc815bc20 con 0x7f1bc806be10 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51310/0 (socket says 172.21.15.134:51310) 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3132087451 learned_addr learned my addr 172.21.15.134:0/3132087451 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcd599640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc806be10 0x7f1bc8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bccd98640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc8144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc806be10 msgr2=0x7f1bc8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc806be10 0x7f1bc8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 msgr2=0x7f1bc8144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc8144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 -- 172.21.15.134:0/3132087451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc81562b0 con 0x7f1bc8151c50 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcdd9a640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1bc002ace0 tx=0x7f1bc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0040070 con 0x7f1bc8151c50 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc0031c90 con 0x7f1bc8151c50 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc8156590 con 0x7f1bc8151c50 2024-09-15T22:46:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.751+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0045680 con 0x7f1bc8151c50 2024-09-15T22:46:42.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.752+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc8156b50 con 0x7f1bc8151c50 2024-09-15T22:46:42.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.752+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc8156d50 con 0x7f1bc8151c50 2024-09-15T22:46:42.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.753+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f1bc0039040 con 0x7f1bc8151c50 2024-09-15T22:46:42.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.753+0000 7f1bbdffb640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 0x7f1bac06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:42.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.753+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5737+0+0 (secure 0 0 0) 0x7f1bc00ad560 con 0x7f1bc8151c50 2024-09-15T22:46:42.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.754+0000 7f1bcd599640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 0x7f1bac06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:42.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.754+0000 7f1bcd599640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 0x7f1bac06eb60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1bc81554c0 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.758+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bc8156d50 con 0x7f1bc8151c50 2024-09-15T22:46:42.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.926+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bc80cd010 con 0x7f1bc8151c50 2024-09-15T22:46:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.927+0000 7f1bbdffb640 1 -- 172.21.15.134:0/3132087451 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+16780 (secure 0 0 0) 0x7f1bc007b030 con 0x7f1bc8151c50 2024-09-15T22:46:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:42.929 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":121,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:41.952332+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:46:40.298166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T22:46:40.929558+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 msgr2=0x7f1bac06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 0x7f1bac06eb60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1bc81554c0 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 msgr2=0x7f1bc8144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1bc002ace0 tx=0x7f1bc0004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 shutdown_connections 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1bac06c6a0 0x7f1bac06eb60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bc8151c50 0x7f1bc8144fb0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc806c1f0 0x7f1bc8144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 --2- 172.21.15.134:0/3132087451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc806be10 0x7f1bc8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:42.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 >> 172.21.15.134:0/3132087451 conn(0x7f1bc8062cc0 msgr2=0x7f1bc80b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:42.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.929+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 shutdown_connections 2024-09-15T22:46:42.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:42.930+0000 7f1bcf7fd640 1 -- 172.21.15.134:0/3132087451 wait complete. 2024-09-15T22:46:42.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:43.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.039+0000 7fc9e97bd640 1 Processor -- start 2024-09-15T22:46:43.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.039+0000 7fc9e97bd640 1 -- start start 2024-09-15T22:46:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e97bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9e415c690 0x7fc9e40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e97bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9e40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e97bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4073da0 con 0x7fc9e40b1980 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e97bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e40b4c40 con 0x7fc9e415c690 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e97bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e4074060 con 0x7fc9e40b4290 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e27fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc9e40b1980 0x7fc9e40d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55428/0 (socket says 172.21.15.134:55428) 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.040+0000 7fc9e27fc640 1 -- 172.21.15.134:0/1949381904 learned_addr learned my addr 172.21.15.134:0/1949381904 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e2ffd640 1 --2- 172.21.15.134:0/1949381904 >> v2:172.21.15.177:3300/0 conn(0x7fc9e415c690 0x7fc9e40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e37fe640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9e40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742936018 0 0) 0x7fc9e4073da0 con 0x7fc9e40b1980 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9cc003520 con 0x7fc9e40b1980 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 519955552 0 0) 0x7fc9cc003520 con 0x7fc9e40b1980 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 msgr2=0x7fc9e40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9e40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 >> v2:172.21.15.177:3300/0 conn(0x7fc9e415c690 msgr2=0x7fc9e40b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 --2- 172.21.15.134:0/1949381904 >> v2:172.21.15.177:3300/0 conn(0x7fc9e415c690 0x7fc9e40b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40b6aa0 con 0x7fc9e40b1980 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc9d8001670 con 0x7fc9e40b1980 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 >> v1:172.21.15.134:6789/0 conn(0x7fc9e40b1980 legacy=0x7fc9e40d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9cc003f30 0x7fc9cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9cc004d40 0x7fc9cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40b4c40 con 0x7fc9cc003f30 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4074060 con 0x7fc9cc004d40 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc00b9c0 con 0x7fc9e40b4290 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9cc003f30 0x7fc9cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e2ffd640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e37fe640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9cc004d40 0x7fc9cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 -- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 msgr2=0x7fc9cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9e40b4290 0x7fc9cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 -- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9cc004d40 msgr2=0x7fc9cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9cc004d40 0x7fc9cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e27fc640 1 -- 172.21.15.134:0/1949381904 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc003520 con 0x7fc9cc003f30 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.041+0000 7fc9e37fe640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9cc004d40 0x7fc9cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.042+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9cc003f30 0x7fc9cc004800 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8001050 tx=0x7fc9cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e49114fe5161e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.042+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8007d70 con 0x7fc9cc003f30 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.042+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d8005af0 con 0x7fc9cc003f30 2024-09-15T22:46:43.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.042+0000 7fc9e1ffb640 1 -- 172.21.15.134:0/1949381904 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8007070 con 0x7fc9cc003f30 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 -- 172.21.15.134:0/1949381904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9cc003f30 msgr2=0x7fc9cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/1949381904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9cc003f30 0x7fc9cc004800 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8001050 tx=0x7fc9cc005830 comp rx=0 tx=0).stop 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e37fe640 1 -- 172.21.15.134:0/1949381904 reap_dead start 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 -- 172.21.15.134:0/1949381904 shutdown_connections 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 -- 172.21.15.134:0/1949381904 >> 172.21.15.134:0/1949381904 conn(0x7fc9e4062630 msgr2=0x7fc9e4062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 -- 172.21.15.134:0/1949381904 shutdown_connections 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.043+0000 7fc9e97bd640 1 -- 172.21.15.134:0/1949381904 wait complete. 2024-09-15T22:46:43.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.044+0000 7fc9e97bd640 1 Processor -- start 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.044+0000 7fc9e97bd640 1 -- start start 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9cc003f30 0x7fc9e40af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 0x7fc9e4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e415cbf0 con 0x7fc9e406e9b0 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e415ca70 con 0x7fc9e415e980 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e97bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e40d0c50 con 0x7fc9cc003f30 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51324/0 (socket says 172.21.15.134:51324) 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 -- 172.21.15.134:0/3978512896 learned_addr learned my addr 172.21.15.134:0/3978512896 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e2ffd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9cc003f30 0x7fc9e40af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e37fe640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 0x7fc9e4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 -- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9cc003f30 msgr2=0x7fc9e40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9cc003f30 0x7fc9e40af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 -- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 msgr2=0x7fc9e4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 0x7fc9e4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 -- 172.21.15.134:0/3978512896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40b0f70 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e37fe640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 0x7fc9e4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.045+0000 7fc9e27fc640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc9d802ae20 tx=0x7fc9d8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.046+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8042070 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.046+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d8007480 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.046+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e40b1250 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.046+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8007d50 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.046+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e415e180 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.047+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e40b6010 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.047+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fc9d803b050 con 0x7fc9e406e9b0 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.048+0000 7fc9cb7fe640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 0x7fc9d006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.048+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5737+0+0 (secure 0 0 0) 0x7fc9d80ac3d0 con 0x7fc9e406e9b0 2024-09-15T22:46:43.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.048+0000 7fc9e2ffd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 0x7fc9d006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.048+0000 7fc9e2ffd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 0x7fc9d006eb90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009c40 tx=0x7fc9d4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.052+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9d8005ac0 con 0x7fc9e406e9b0 2024-09-15T22:46:43.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.219+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9e4158ff0 con 0x7fc9e406e9b0 2024-09-15T22:46:43.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.220+0000 7fc9cb7fe640 1 -- 172.21.15.134:0/3978512896 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+16780 (secure 0 0 0) 0x7fc9d807a660 con 0x7fc9e406e9b0 2024-09-15T22:46:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:43.221 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":121,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:41.952332+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:46:40.298166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T22:46:40.929558+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:43.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 msgr2=0x7fc9d006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 0x7fc9d006eb90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009c40 tx=0x7fc9d4009190 comp rx=0 tx=0).stop 2024-09-15T22:46:43.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 msgr2=0x7fc9e414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc9d802ae20 tx=0x7fc9d8000fe0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 shutdown_connections 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9e415e980 0x7fc9e4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc9d006c6d0 0x7fc9d006eb90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e406e9b0 0x7fc9e414f300 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 --2- 172.21.15.134:0/3978512896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9cc003f30 0x7fc9e40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 >> 172.21.15.134:0/3978512896 conn(0x7fc9e4062630 msgr2=0x7fc9e40b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 shutdown_connections 2024-09-15T22:46:43.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.222+0000 7fc9e97bd640 1 -- 172.21.15.134:0/3978512896 wait complete. 2024-09-15T22:46:43.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:46:43.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 Processor -- start 2024-09-15T22:46:43.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 -- start start 2024-09-15T22:46:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd280b3d50 0x7fbd2806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd280b3290 0x7fbd2806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280cf9a0 con 0x7fbd28161e30 2024-09-15T22:46:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280cfcf0 con 0x7fbd280b3d50 2024-09-15T22:46:43.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.335+0000 7fbd2d923640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbd28162210 con 0x7fbd280b3290 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd280b3d50 0x7fbd2806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd280b3d50 0x7fbd2806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51334/0 (socket says 172.21.15.134:51334) 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd26ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbd28161e30 0x7fbd280d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55438/0 (socket says 172.21.15.134:55438) 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 -- 172.21.15.134:0/3749434395 learned_addr learned my addr 172.21.15.134:0/3749434395 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 -- 172.21.15.134:0/3749434395 >> v2:172.21.15.177:3300/0 conn(0x7fbd280b3290 msgr2=0x7fbd2806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 --2- 172.21.15.134:0/3749434395 >> v2:172.21.15.177:3300/0 conn(0x7fbd280b3290 0x7fbd2806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 -- 172.21.15.134:0/3749434395 >> v1:172.21.15.134:6789/0 conn(0x7fbd28161e30 legacy=0x7fbd280d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd267fc640 1 -- 172.21.15.134:0/3749434395 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280d5210 con 0x7fbd280b3d50 2024-09-15T22:46:43.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.336+0000 7fbd25ffb640 1 -- 172.21.15.134:0/3749434395 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514720522 0 0) 0x7fbd280cf9a0 con 0x7fbd28161e30 2024-09-15T22:46:43.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd267fc640 1 --2- 172.21.15.134:0/3749434395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3d50 0x7fbd2806d8c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b3ce0 tx=0x7fbd1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecebb19a1806e9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd25ffb640 1 -- 172.21.15.134:0/3749434395 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c037070 con 0x7fbd280b3d50 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd25ffb640 1 -- 172.21.15.134:0/3749434395 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c032440 con 0x7fbd280b3d50 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd25ffb640 1 -- 172.21.15.134:0/3749434395 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c032810 con 0x7fbd280b3d50 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 -- 172.21.15.134:0/3749434395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3d50 msgr2=0x7fbd2806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3749434395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3d50 0x7fbd2806d8c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b3ce0 tx=0x7fbd1c02a270 comp rx=0 tx=0).stop 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 -- 172.21.15.134:0/3749434395 shutdown_connections 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3749434395 >> v2:172.21.15.177:3300/0 conn(0x7fbd280b3290 0x7fbd2806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3749434395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3d50 0x7fbd2806d8c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 -- 172.21.15.134:0/3749434395 >> 172.21.15.134:0/3749434395 conn(0x7fbd280d1870 msgr2=0x7fbd280d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 -- 172.21.15.134:0/3749434395 shutdown_connections 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.337+0000 7fbd2d923640 1 -- 172.21.15.134:0/3749434395 wait complete. 2024-09-15T22:46:43.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.338+0000 7fbd2d923640 1 Processor -- start 2024-09-15T22:46:43.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 -- start start 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd280b3d50 0x7fbd280ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 0x7fbd281f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b78b0 con 0x7fbd280b3290 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b3950 con 0x7fbd28161e30 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd2d923640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280b7a30 con 0x7fbd280b3d50 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.339+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51338/0 (socket says 172.21.15.134:51338) 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 -- 172.21.15.134:0/3852322013 learned_addr learned my addr 172.21.15.134:0/3852322013 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd267fc640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd280b3d50 0x7fbd280ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 -- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd280b3d50 msgr2=0x7fbd280ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd280b3d50 0x7fbd280ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 -- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 msgr2=0x7fbd281f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd277fe640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 0x7fbd281f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 0x7fbd281f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 -- 172.21.15.134:0/3852322013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28156240 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd277fe640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 0x7fbd281f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd26ffd640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c430 tx=0x7fbd1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180074e0 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180047e0 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd28156520 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18004bd0 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.340+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd28156ae0 con 0x7fbd280b3290 2024-09-15T22:46:43.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.341+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd28068e90 con 0x7fbd280b3290 2024-09-15T22:46:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.342+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fbd18011070 con 0x7fbd280b3290 2024-09-15T22:46:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.342+0000 7fbd0ffff640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 0x7fbd1406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.342+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5737+0+0 (secure 0 0 0) 0x7fbd1808b620 con 0x7fbd280b3290 2024-09-15T22:46:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.343+0000 7fbd267fc640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 0x7fbd1406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.343+0000 7fbd267fc640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 0x7fbd1406eb60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.347+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd28068e90 con 0x7fbd280b3290 2024-09-15T22:46:43.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.546+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbd280b70a0 con 0x7fbd280b3290 2024-09-15T22:46:43.613 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:46:43.612+0000 7f0efa103640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:46:43.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.753+0000 7fbd0ffff640 1 -- 172.21.15.134:0/3852322013 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) ==== 118+0+0 (secure 0 0 0) 0x7fbd180599a0 con 0x7fbd280b3290 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 msgr2=0x7fbd1406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 0x7fbd1406eb60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c02e000 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 msgr2=0x7fbd28155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c430 tx=0x7fbd1800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 shutdown_connections 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28161e30 0x7fbd281f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd280b3d50 0x7fbd280ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1406c6a0 0x7fbd1406eb60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 --2- 172.21.15.134:0/3852322013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd280b3290 0x7fbd28155b60 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 >> 172.21.15.134:0/3852322013 conn(0x7fbd280d1870 msgr2=0x7fbd280b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 shutdown_connections 2024-09-15T22:46:43.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.755+0000 7fbd2d923640 1 -- 172.21.15.134:0/3852322013 wait complete. 2024-09-15T22:46:43.767 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:46:43.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:46:43.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.867+0000 7ff479ed9640 1 Processor -- start 2024-09-15T22:46:43.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.867+0000 7ff479ed9640 1 -- start start 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 0x7ff4740aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4740b57d0 0x7ff4740b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 0x7ff474072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff474072c40 con 0x7ff4740b57d0 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff47406e570 con 0x7ff474161cc0 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff479ed9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff47406dc40 con 0x7ff474072290 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4740b57d0 0x7ff4740b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4740b57d0 0x7ff4740b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51350/0 (socket says 172.21.15.134:51350) 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 -- 172.21.15.134:0/237131857 learned_addr learned my addr 172.21.15.134:0/237131857 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:43.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff473fff640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 0x7ff474072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 -- 172.21.15.134:0/237131857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 msgr2=0x7ff474072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff4737fe640 1 --2- 172.21.15.134:0/237131857 >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 0x7ff4740aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 0x7ff474072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 -- 172.21.15.134:0/237131857 >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 msgr2=0x7ff4740aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 --2- 172.21.15.134:0/237131857 >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 0x7ff4740aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff472ffd640 1 -- 172.21.15.134:0/237131857 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47406df20 con 0x7ff4740b57d0 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff473fff640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 0x7ff474072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.868+0000 7ff4737fe640 1 --2- 172.21.15.134:0/237131857 >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 0x7ff4740aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:43.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.869+0000 7ff472ffd640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4740b57d0 0x7ff4740b5c40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff474062a30 tx=0x7ff46802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549b54a9f1440fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.869+0000 7ff4727fc640 1 -- 172.21.15.134:0/237131857 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468037070 con 0x7ff4740b57d0 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.869+0000 7ff4727fc640 1 -- 172.21.15.134:0/237131857 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff468032440 con 0x7ff4740b57d0 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.869+0000 7ff4727fc640 1 -- 172.21.15.134:0/237131857 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468032810 con 0x7ff4740b57d0 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 -- 172.21.15.134:0/237131857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4740b57d0 msgr2=0x7ff4740b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4740b57d0 0x7ff4740b5c40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff474062a30 tx=0x7ff46802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 -- 172.21.15.134:0/237131857 shutdown_connections 2024-09-15T22:46:43.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff474072290 0x7ff474072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 --2- 172.21.15.134:0/237131857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4740b57d0 0x7ff4740b5c40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 --2- 172.21.15.134:0/237131857 >> v2:172.21.15.177:3300/0 conn(0x7ff474161cc0 0x7ff4740aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 -- 172.21.15.134:0/237131857 >> 172.21.15.134:0/237131857 conn(0x7ff47406bba0 msgr2=0x7ff47406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 -- 172.21.15.134:0/237131857 shutdown_connections 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.870+0000 7ff479ed9640 1 -- 172.21.15.134:0/237131857 wait complete. 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.871+0000 7ff479ed9640 1 Processor -- start 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.871+0000 7ff479ed9640 1 -- start start 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4740b57d0 0x7ff4741598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 0x7ff4741482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4740af2b0 con 0x7ff474072290 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4740af130 con 0x7ff474161cc0 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff4740b4a60 con 0x7ff4740b57d0 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51364/0 (socket says 172.21.15.134:51364) 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 -- 172.21.15.134:0/1358749499 learned_addr learned my addr 172.21.15.134:0/1358749499 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff472ffd640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4740b57d0 0x7ff4741598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff473fff640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 0x7ff4741482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 -- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4740b57d0 msgr2=0x7ff4741598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4740b57d0 0x7ff4741598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 -- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 msgr2=0x7ff4741482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 0x7ff4741482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 -- 172.21.15.134:0/1358749499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4741557b0 con 0x7ff474072290 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff473fff640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 0x7ff4741482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff4737fe640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c820 tx=0x7ff46400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464015070 con 0x7ff474072290 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff464007a30 con 0x7ff474072290 2024-09-15T22:46:43.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.872+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff474155a90 con 0x7ff474072290 2024-09-15T22:46:43.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.873+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464007de0 con 0x7ff474072290 2024-09-15T22:46:43.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.873+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff474156050 con 0x7ff474072290 2024-09-15T22:46:43.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.873+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4740b5c40 con 0x7ff474072290 2024-09-15T22:46:43.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.874+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7ff464018070 con 0x7ff474072290 2024-09-15T22:46:43.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.874+0000 7ff45bfff640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 0x7ff46006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:43.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.875+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7ff46408ba20 con 0x7ff474072290 2024-09-15T22:46:43.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.875+0000 7ff472ffd640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 0x7ff46006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:43.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.875+0000 7ff472ffd640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 0x7ff46006eb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff468034000 tx=0x7ff46802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:43.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:43.879+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4640594c0 con 0x7ff474072290 2024-09-15T22:46:44.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.079+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff47415d820 con 0x7ff474072290 2024-09-15T22:46:44.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.756+0000 7ff45bfff640 1 -- 172.21.15.134:0/1358749499 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) ==== 122+0+0 (secure 0 0 0) 0x7ff46405d7c0 con 0x7ff474072290 2024-09-15T22:46:44.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 msgr2=0x7ff46006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:44.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 0x7ff46006eb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff468034000 tx=0x7ff46802e000 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 msgr2=0x7ff474155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c820 tx=0x7ff46400cce0 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 shutdown_connections 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff474161cc0 0x7ff4741482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4740b57d0 0x7ff4741598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff46006c6d0 0x7ff46006eb90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 --2- 172.21.15.134:0/1358749499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff474072290 0x7ff474155160 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.758+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 >> 172.21.15.134:0/1358749499 conn(0x7ff47406bba0 msgr2=0x7ff47415ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.759+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 shutdown_connections 2024-09-15T22:46:44.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:44.759+0000 7ff479ed9640 1 -- 172.21.15.134:0/1358749499 wait complete. 2024-09-15T22:46:44.988 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:46:44.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.090+0000 7f46ca01e640 1 Processor -- start 2024-09-15T22:46:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.090+0000 7f46ca01e640 1 -- start start 2024-09-15T22:46:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46ca01e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c415ca40 0x7f46c415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46ca01e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46c415ceb0 0x7f46c41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46ca01e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c415d390 con 0x7f46c40d02a0 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46ca01e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f46c415d670 con 0x7f46c415ceb0 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46ca01e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f46c415d950 con 0x7f46c415ca40 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46c415ceb0 0x7f46c41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f46c40d02a0 0x7f46c40d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55452/0 (socket says 172.21.15.134:55452) 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c37fe640 1 -- 172.21.15.134:0/3682539136 learned_addr learned my addr 172.21.15.134:0/3682539136 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c2ffd640 1 --2- 172.21.15.134:0/3682539136 >> v2:172.21.15.177:3300/0 conn(0x7f46c415ca40 0x7f46c415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c3fff640 1 -- 172.21.15.134:0/3682539136 >> v2:172.21.15.177:3300/0 conn(0x7f46c415ca40 msgr2=0x7f46c415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c3fff640 1 --2- 172.21.15.134:0/3682539136 >> v2:172.21.15.177:3300/0 conn(0x7f46c415ca40 0x7f46c415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c3fff640 1 -- 172.21.15.134:0/3682539136 >> v1:172.21.15.134:6789/0 conn(0x7f46c40d02a0 legacy=0x7f46c40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c3fff640 1 -- 172.21.15.134:0/3682539136 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c415dc30 con 0x7f46c415ceb0 2024-09-15T22:46:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.091+0000 7f46c27fc640 1 -- 172.21.15.134:0/3682539136 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183402789 0 0) 0x7f46c415d390 con 0x7f46c40d02a0 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46c3fff640 1 --2- 172.21.15.134:0/3682539136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c41594c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f46c40cf320 tx=0x7f46bc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d8ef78b541e207 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46c27fc640 1 -- 172.21.15.134:0/3682539136 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc007740 con 0x7f46c415ceb0 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46c27fc640 1 -- 172.21.15.134:0/3682539136 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc0078e0 con 0x7f46c415ceb0 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46c27fc640 1 -- 172.21.15.134:0/3682539136 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc007cb0 con 0x7f46c415ceb0 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46ca01e640 1 -- 172.21.15.134:0/3682539136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 msgr2=0x7f46c41594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.092+0000 7f46ca01e640 1 --2- 172.21.15.134:0/3682539136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c41594c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f46c40cf320 tx=0x7f46bc02a5f0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 -- 172.21.15.134:0/3682539136 shutdown_connections 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 --2- 172.21.15.134:0/3682539136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c41594c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 --2- 172.21.15.134:0/3682539136 >> v2:172.21.15.177:3300/0 conn(0x7f46c415ca40 0x7f46c415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 -- 172.21.15.134:0/3682539136 >> 172.21.15.134:0/3682539136 conn(0x7f46c4062cc0 msgr2=0x7f46c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 -- 172.21.15.134:0/3682539136 shutdown_connections 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.093+0000 7f46ca01e640 1 -- 172.21.15.134:0/3682539136 wait complete. 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.094+0000 7f46ca01e640 1 Processor -- start 2024-09-15T22:46:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.094+0000 7f46ca01e640 1 -- start start 2024-09-15T22:46:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40d02a0 0x7f46c4144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 0x7f46c4158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46c4155d10 con 0x7f46c415ceb0 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46c4155b90 con 0x7f46c415ca40 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f46c40b4790 con 0x7f46c40d02a0 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51382/0 (socket says 172.21.15.134:51382) 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 -- 172.21.15.134:0/2236476973 learned_addr learned my addr 172.21.15.134:0/2236476973 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c37fe640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40d02a0 0x7f46c4144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c2ffd640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 0x7f46c4158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 -- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40d02a0 msgr2=0x7f46c4144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40d02a0 0x7f46c4144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 -- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 msgr2=0x7f46c4158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 0x7f46c4158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 -- 172.21.15.134:0/2236476973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c41453c0 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c2ffd640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 0x7f46c4158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46c3fff640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f46bc02a630 tx=0x7f46bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc03f070 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc031bc0 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc009450 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.095+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c4159000 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.096+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c4072940 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.096+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c40d0680 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.097+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f46bc003990 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.097+0000 7f46abfff640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 0x7f46b006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.097+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f46bc0ac9d0 con 0x7f46c415ceb0 2024-09-15T22:46:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.098+0000 7f46c37fe640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 0x7f46b006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.098+0000 7f46c37fe640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 0x7f46b006eb90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000f60 tx=0x7f46b8007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.102+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46c41453c0 con 0x7f46c415ceb0 2024-09-15T22:46:45.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.300+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46c40cc6b0 con 0x7f46c415ceb0 2024-09-15T22:46:45.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.300+0000 7f46abfff640 1 -- 172.21.15.134:0/2236476973 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5228 (secure 0 0 0) 0x7f46bc07a470 con 0x7f46c415ceb0 2024-09-15T22:46:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:45.302 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":61,"btime":"2024-09-15T22:46:44:753926+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:46:45.302 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 61 2024-09-15T22:46:45.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.302+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 msgr2=0x7f46b006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 0x7f46b006eb90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000f60 tx=0x7f46b8007d50 comp rx=0 tx=0).stop 2024-09-15T22:46:45.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 msgr2=0x7f46c40ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f46bc02a630 tx=0x7f46bc004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:45.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 shutdown_connections 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46b006c6d0 0x7f46b006eb90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c415ceb0 0x7f46c40ac340 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c415ca40 0x7f46c4158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 --2- 172.21.15.134:0/2236476973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40d02a0 0x7f46c4144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 >> 172.21.15.134:0/2236476973 conn(0x7f46c4062cc0 msgr2=0x7f46c414cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 shutdown_connections 2024-09-15T22:46:45.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.303+0000 7f46ca01e640 1 -- 172.21.15.134:0/2236476973 wait complete. 2024-09-15T22:46:45.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:46:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.412+0000 7f451fe5e640 1 Processor -- start 2024-09-15T22:46:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.412+0000 7f451fe5e640 1 -- start start 2024-09-15T22:46:45.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451fe5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f451815c180 0x7f45180cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451fe5e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45180ce230 0x7f45180cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451fe5e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45180ce740 con 0x7f45180cf5b0 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451fe5e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4518072640 con 0x7f451815c180 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451fe5e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4518072920 con 0x7f45180ce230 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451dbfa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f451815c180 0x7f45180cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451dbfa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f451815c180 0x7f45180cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51386/0 (socket says 172.21.15.134:51386) 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.413+0000 7f451dbfa640 1 -- 172.21.15.134:0/2881207423 learned_addr learned my addr 172.21.15.134:0/2881207423 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451d3f9640 1 --2- 172.21.15.134:0/2881207423 >> v2:172.21.15.177:3300/0 conn(0x7f45180ce230 0x7f45180cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451dbfa640 1 -- 172.21.15.134:0/2881207423 >> v2:172.21.15.177:3300/0 conn(0x7f45180ce230 msgr2=0x7f45180cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451dbfa640 1 --2- 172.21.15.134:0/2881207423 >> v2:172.21.15.177:3300/0 conn(0x7f45180ce230 0x7f45180cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451dbfa640 1 -- 172.21.15.134:0/2881207423 >> v1:172.21.15.177:6789/0 conn(0x7f45180cf5b0 legacy=0x7f4518073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451dbfa640 1 -- 172.21.15.134:0/2881207423 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4518072c00 con 0x7f451815c180 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.414+0000 7f451dbfa640 1 --2- 172.21.15.134:0/2881207423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f45180cdcf0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4518071d60 tx=0x7f450802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b525e6a6c1fee847 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451cbf8640 1 -- 172.21.15.134:0/2881207423 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508036070 con 0x7f451815c180 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451cbf8640 1 -- 172.21.15.134:0/2881207423 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4508031600 con 0x7f451815c180 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451cbf8640 1 -- 172.21.15.134:0/2881207423 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45080319d0 con 0x7f451815c180 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 -- 172.21.15.134:0/2881207423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 msgr2=0x7f45180cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 --2- 172.21.15.134:0/2881207423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f45180cdcf0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4518071d60 tx=0x7f450802a660 comp rx=0 tx=0).stop 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 -- 172.21.15.134:0/2881207423 shutdown_connections 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 --2- 172.21.15.134:0/2881207423 >> v2:172.21.15.177:3300/0 conn(0x7f45180ce230 0x7f45180cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 --2- 172.21.15.134:0/2881207423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f45180cdcf0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 -- 172.21.15.134:0/2881207423 >> 172.21.15.134:0/2881207423 conn(0x7f4518062cc0 msgr2=0x7f451806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 -- 172.21.15.134:0/2881207423 shutdown_connections 2024-09-15T22:46:45.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.415+0000 7f451fe5e640 1 -- 172.21.15.134:0/2881207423 wait complete. 2024-09-15T22:46:45.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.416+0000 7f451fe5e640 1 Processor -- start 2024-09-15T22:46:45.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.416+0000 7f451fe5e640 1 -- start start 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45180ce230 0x7f4518160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45180cf5b0 0x7f4518152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f451815c560 con 0x7f451815c180 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45180722f0 con 0x7f45180ce230 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451fe5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f451815c6e0 con 0x7f45180cf5b0 2024-09-15T22:46:45.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451e3fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451e3fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51392/0 (socket says 172.21.15.134:51392) 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451e3fb640 1 -- 172.21.15.134:0/3554999721 learned_addr learned my addr 172.21.15.134:0/3554999721 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451dbfa640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45180ce230 0x7f4518160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451d3f9640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45180cf5b0 0x7f4518152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451e3fb640 1 -- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45180cf5b0 msgr2=0x7f4518152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.417+0000 7f451e3fb640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45180cf5b0 0x7f4518152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451e3fb640 1 -- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45180ce230 msgr2=0x7f4518160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451e3fb640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45180ce230 0x7f4518160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451e3fb640 1 -- 172.21.15.134:0/3554999721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45181e7340 con 0x7f451815c180 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451e3fb640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f451000c440 tx=0x7f451000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510011790 con 0x7f451815c180 2024-09-15T22:46:45.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4510017070 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45181e7620 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510011b70 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.418+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451815d2f0 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.419+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45180cf070 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.419+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f4510011d10 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.420+0000 7f45167fc640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 0x7f450406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.420+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f451008b740 con 0x7f451815c180 2024-09-15T22:46:45.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.420+0000 7f451dbfa640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 0x7f450406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.420+0000 7f451dbfa640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 0x7f450406eb60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4508033000 tx=0x7f4508009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.424+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4510059370 con 0x7f451815c180 2024-09-15T22:46:45.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.588+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45180cdc80 con 0x7f451815c180 2024-09-15T22:46:45.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.589+0000 7f45167fc640 1 -- 172.21.15.134:0/3554999721 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16767 (secure 0 0 0) 0x7f451005d670 con 0x7f451815c180 2024-09-15T22:46:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:45.592 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":122,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:43.624806+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:46:40.298166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T22:46:40.929558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:46:45.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 msgr2=0x7f450406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 0x7f450406eb60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4508033000 tx=0x7f4508009000 comp rx=0 tx=0).stop 2024-09-15T22:46:45.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 msgr2=0x7f4518153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f451000c440 tx=0x7f451000c900 comp rx=0 tx=0).stop 2024-09-15T22:46:45.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 shutdown_connections 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f450406c6a0 0x7f450406eb60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f451815c180 0x7f4518153310 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45180cf5b0 0x7f4518152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 --2- 172.21.15.134:0/3554999721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45180ce230 0x7f4518160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 >> 172.21.15.134:0/3554999721 conn(0x7f4518062cc0 msgr2=0x7f45180cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 shutdown_connections 2024-09-15T22:46:45.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.591+0000 7f451fe5e640 1 -- 172.21.15.134:0/3554999721 wait complete. 2024-09-15T22:46:45.605 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:46:45.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:46:45.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 Processor -- start 2024-09-15T22:46:45.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 -- start start 2024-09-15T22:46:45.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75ec15ed20 0x7f75ec0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec0cef90 0x7f75ec0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec0b7170 con 0x7f75ec15e940 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec0b7aa0 con 0x7f75ec15ed20 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.701+0000 7f75f31f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0d3660 con 0x7f75ec0cef90 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75ec15ed20 0x7f75ec0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75ec15ed20 0x7f75ec0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51398/0 (socket says 172.21.15.134:51398) 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 -- 172.21.15.134:0/4176526016 learned_addr learned my addr 172.21.15.134:0/4176526016 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75f0f8d640 1 --1- 172.21.15.134:0/4176526016 >> v1:172.21.15.134:6789/0 conn(0x7f75ec15e940 0x7f75ec0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55456/0 (socket says 172.21.15.134:55456) 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75f178e640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec0cef90 0x7f75ec0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 -- 172.21.15.134:0/4176526016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec0cef90 msgr2=0x7f75ec0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec0cef90 0x7f75ec0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 -- 172.21.15.134:0/4176526016 >> v1:172.21.15.134:6789/0 conn(0x7f75ec15e940 legacy=0x7f75ec0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.702+0000 7f75ebfff640 1 -- 172.21.15.134:0/4176526016 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0d3940 con 0x7f75ec15ed20 2024-09-15T22:46:45.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75ebfff640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15ed20 0x7f75ec0b3220 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009e50 tx=0x7f75dc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2c34c121c6a610 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75eb7fe640 1 -- 172.21.15.134:0/4176526016 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc036070 con 0x7f75ec15ed20 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75eb7fe640 1 -- 172.21.15.134:0/4176526016 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc031600 con 0x7f75ec15ed20 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75eb7fe640 1 -- 172.21.15.134:0/4176526016 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0319d0 con 0x7f75ec15ed20 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 -- 172.21.15.134:0/4176526016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15ed20 msgr2=0x7f75ec0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15ed20 0x7f75ec0b3220 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009e50 tx=0x7f75dc02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 -- 172.21.15.134:0/4176526016 shutdown_connections 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec0cef90 0x7f75ec0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 --2- 172.21.15.134:0/4176526016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15ed20 0x7f75ec0b3220 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 -- 172.21.15.134:0/4176526016 >> 172.21.15.134:0/4176526016 conn(0x7f75ec0b6240 msgr2=0x7f75ec0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 -- 172.21.15.134:0/4176526016 shutdown_connections 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.703+0000 7f75f31f1640 1 -- 172.21.15.134:0/4176526016 wait complete. 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.704+0000 7f75f31f1640 1 Processor -- start 2024-09-15T22:46:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.704+0000 7f75f31f1640 1 -- start start 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 0x7f75ec0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 0x7f75ec0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0d3310 con 0x7f75ec15e940 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0d3f00 con 0x7f75ec0cef90 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75f31f1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0d1ef0 con 0x7f75ec15ed20 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51414/0 (socket says 172.21.15.134:51414) 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.705+0000 7f75ebfff640 1 -- 172.21.15.134:0/1998826078 learned_addr learned my addr 172.21.15.134:0/1998826078 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f178e640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 0x7f75ec0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 -- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 msgr2=0x7f75ec0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 0x7f75ec0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f0f8d640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 0x7f75ec0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 -- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 msgr2=0x7f75ec0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 0x7f75ec0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 -- 172.21.15.134:0/1998826078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0ab660 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f178e640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 0x7f75ec0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f0f8d640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 0x7f75ec0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75ebfff640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009f70 tx=0x7f75dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc036050 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc042070 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec158ac0 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc009510 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.706+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec159080 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.707+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec0d1060 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.708+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f75dc007bb0 con 0x7f75ec15e940 2024-09-15T22:46:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.708+0000 7f75e97fa640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 0x7f75cc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.708+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f75dc0acbb0 con 0x7f75ec15e940 2024-09-15T22:46:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.708+0000 7f75f0f8d640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 0x7f75cc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.709+0000 7f75f0f8d640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 0x7f75cc06eb60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000f60 tx=0x7f75e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.712+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75dc045360 con 0x7f75ec15e940 2024-09-15T22:46:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.875+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75ec161f60 con 0x7f75cc06c6a0 2024-09-15T22:46:45.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.882+0000 7f75e97fa640 1 -- 172.21.15.134:0/1998826078 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247086 (secure 0 0 0) 0x7f75ec161f60 con 0x7f75cc06c6a0 2024-09-15T22:46:45.887 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:45.888 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 msgr2=0x7f75cc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 0x7f75cc06eb60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000f60 tx=0x7f75e4009040 comp rx=0 tx=0).stop 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 msgr2=0x7f75ec0cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009f70 tx=0x7f75dc004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 shutdown_connections 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75ec15ed20 0x7f75ec0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75cc06c6a0 0x7f75cc06eb60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ec15e940 0x7f75ec0cc850 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 --2- 172.21.15.134:0/1998826078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75ec0cef90 0x7f75ec0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 >> 172.21.15.134:0/1998826078 conn(0x7f75ec0b6240 msgr2=0x7f75ec0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 shutdown_connections 2024-09-15T22:46:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:45.885+0000 7f75f31f1640 1 -- 172.21.15.134:0/1998826078 wait complete. 2024-09-15T22:46:45.901 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-15T22:46:45.201610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262288,"kb_used_data":12760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712432,"statfs":{"total":773094113280,"available":772825530368,"internally_reserved":0,"allocated":13066240,"data_stored":6378436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589562"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623630+0000","last_change":"2024-09-15T22:46:41.623630+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623630+0000","last_undegraded":"2024-09-15T22:46:41.623630+0000","last_fullsized":"2024-09-15T22:46:41.623630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624933+0000","last_change":"2024-09-15T22:46:41.624933+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624933+0000","last_undegraded":"2024-09-15T22:46:41.624933+0000","last_fullsized":"2024-09-15T22:46:41.624933+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627512+0000","last_change":"2024-09-15T22:46:41.627512+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627512+0000","last_undegraded":"2024-09-15T22:46:41.627512+0000","last_fullsized":"2024-09-15T22:46:41.627512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623031+0000","last_change":"2024-09-15T22:46:41.623031+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623031+0000","last_undegraded":"2024-09-15T22:46:41.623031+0000","last_fullsized":"2024-09-15T22:46:41.623031+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625199+0000","last_change":"2024-09-15T22:46:41.625199+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625199+0000","last_undegraded":"2024-09-15T22:46:41.625199+0000","last_fullsized":"2024-09-15T22:46:41.625199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632064+0000","last_change":"2024-09-15T22:46:41.632064+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632064+0000","last_undegraded":"2024-09-15T22:46:41.632064+0000","last_fullsized":"2024-09-15T22:46:41.632064+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624746+0000","last_change":"2024-09-15T22:46:41.624746+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624746+0000","last_undegraded":"2024-09-15T22:46:41.624746+0000","last_fullsized":"2024-09-15T22:46:41.624746+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624619+0000","last_change":"2024-09-15T22:46:41.624619+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624619+0000","last_undegraded":"2024-09-15T22:46:41.624619+0000","last_fullsized":"2024-09-15T22:46:41.624619+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627104+0000","last_change":"2024-09-15T22:46:41.627104+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627104+0000","last_undegraded":"2024-09-15T22:46:41.627104+0000","last_fullsized":"2024-09-15T22:46:41.627104+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624494+0000","last_change":"2024-09-15T22:46:41.624494+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624494+0000","last_undegraded":"2024-09-15T22:46:41.624494+0000","last_fullsized":"2024-09-15T22:46:41.624494+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623333+0000","last_change":"2024-09-15T22:46:41.623333+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623333+0000","last_undegraded":"2024-09-15T22:46:41.623333+0000","last_fullsized":"2024-09-15T22:46:41.623333+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631652+0000","last_change":"2024-09-15T22:46:41.631652+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631652+0000","last_undegraded":"2024-09-15T22:46:41.631652+0000","last_fullsized":"2024-09-15T22:46:41.631652+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.622355+0000","last_change":"2024-09-15T22:46:41.622355+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.622355+0000","last_undegraded":"2024-09-15T22:46:41.622355+0000","last_fullsized":"2024-09-15T22:46:41.622355+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620816+0000","last_change":"2024-09-15T22:46:41.620816+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620816+0000","last_undegraded":"2024-09-15T22:46:41.620816+0000","last_fullsized":"2024-09-15T22:46:41.620816+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621924+0000","last_change":"2024-09-15T22:46:41.621924+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621924+0000","last_undegraded":"2024-09-15T22:46:41.621924+0000","last_fullsized":"2024-09-15T22:46:41.621924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619522+0000","last_change":"2024-09-15T22:46:41.619522+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619522+0000","last_undegraded":"2024-09-15T22:46:41.619522+0000","last_fullsized":"2024-09-15T22:46:41.619522+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.626218+0000","last_change":"2024-09-15T22:46:41.626218+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.626218+0000","last_undegraded":"2024-09-15T22:46:41.626218+0000","last_fullsized":"2024-09-15T22:46:41.626218+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624272+0000","last_change":"2024-09-15T22:46:41.624272+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624272+0000","last_undegraded":"2024-09-15T22:46:41.624272+0000","last_fullsized":"2024-09-15T22:46:41.624272+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621009+0000","last_change":"2024-09-15T22:46:41.621009+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621009+0000","last_undegraded":"2024-09-15T22:46:41.621009+0000","last_fullsized":"2024-09-15T22:46:41.621009+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627283+0000","last_change":"2024-09-15T22:46:41.627283+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627283+0000","last_undegraded":"2024-09-15T22:46:41.627283+0000","last_fullsized":"2024-09-15T22:46:41.627283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.633814+0000","last_change":"2024-09-15T22:46:41.633814+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.633814+0000","last_undegraded":"2024-09-15T22:46:41.633814+0000","last_fullsized":"2024-09-15T22:46:41.633814+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619661+0000","last_change":"2024-09-15T22:46:41.619661+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619661+0000","last_undegraded":"2024-09-15T22:46:41.619661+0000","last_fullsized":"2024-09-15T22:46:41.619661+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625865+0000","last_change":"2024-09-15T22:46:41.625865+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625865+0000","last_undegraded":"2024-09-15T22:46:41.625865+0000","last_fullsized":"2024-09-15T22:46:41.625865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623783+0000","last_change":"2024-09-15T22:46:41.623783+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623783+0000","last_undegraded":"2024-09-15T22:46:41.623783+0000","last_fullsized":"2024-09-15T22:46:41.623783+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623730+0000","last_change":"2024-09-15T22:46:41.623730+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623730+0000","last_undegraded":"2024-09-15T22:46:41.623730+0000","last_fullsized":"2024-09-15T22:46:41.623730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621527+0000","last_change":"2024-09-15T22:46:41.621527+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621527+0000","last_undegraded":"2024-09-15T22:46:41.621527+0000","last_fullsized":"2024-09-15T22:46:41.621527+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618559+0000","last_change":"2024-09-15T22:46:41.618559+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618559+0000","last_undegraded":"2024-09-15T22:46:41.618559+0000","last_fullsized":"2024-09-15T22:46:41.618559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625532+0000","last_change":"2024-09-15T22:46:41.625532+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625532+0000","last_undegraded":"2024-09-15T22:46:41.625532+0000","last_fullsized":"2024-09-15T22:46:41.625532+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621351+0000","last_change":"2024-09-15T22:46:41.621351+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621351+0000","last_undegraded":"2024-09-15T22:46:41.621351+0000","last_fullsized":"2024-09-15T22:46:41.621351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619245+0000","last_change":"2024-09-15T22:46:41.619245+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619245+0000","last_undegraded":"2024-09-15T22:46:41.619245+0000","last_fullsized":"2024-09-15T22:46:41.619245+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625026+0000","last_change":"2024-09-15T22:46:41.625026+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625026+0000","last_undegraded":"2024-09-15T22:46:41.625026+0000","last_fullsized":"2024-09-15T22:46:41.625026+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625531+0000","last_change":"2024-09-15T22:46:41.625531+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625531+0000","last_undegraded":"2024-09-15T22:46:41.625531+0000","last_fullsized":"2024-09-15T22:46:41.625531+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619576+0000","last_change":"2024-09-15T22:46:41.619576+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619576+0000","last_undegraded":"2024-09-15T22:46:41.619576+0000","last_fullsized":"2024-09-15T22:46:41.619576+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634548+0000","last_change":"2024-09-15T22:46:41.633396+0000","last_active":"2024-09-15T22:46:41.634548+0000","last_peered":"2024-09-15T22:46:41.634548+0000","last_clean":"2024-09-15T22:46:41.634548+0000","last_became_active":"2024-09-15T22:46:41.632887+0000","last_became_peered":"2024-09-15T22:46:41.632887+0000","last_unstale":"2024-09-15T22:46:41.634548+0000","last_undegraded":"2024-09-15T22:46:41.634548+0000","last_fullsized":"2024-09-15T22:46:41.634548+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:27.587484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625449+0000","last_change":"2024-09-15T22:46:41.625449+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625449+0000","last_undegraded":"2024-09-15T22:46:41.625449+0000","last_fullsized":"2024-09-15T22:46:41.625449+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638511+0000","last_change":"2024-09-15T22:46:41.637052+0000","last_active":"2024-09-15T22:46:41.638511+0000","last_peered":"2024-09-15T22:46:41.638511+0000","last_clean":"2024-09-15T22:46:41.638511+0000","last_became_active":"2024-09-15T22:46:41.636779+0000","last_became_peered":"2024-09-15T22:46:41.636779+0000","last_unstale":"2024-09-15T22:46:41.638511+0000","last_undegraded":"2024-09-15T22:46:41.638511+0000","last_fullsized":"2024-09-15T22:46:41.638511+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:30.820869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625005+0000","last_change":"2024-09-15T22:46:41.625005+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625005+0000","last_undegraded":"2024-09-15T22:46:41.625005+0000","last_fullsized":"2024-09-15T22:46:41.625005+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634913+0000","last_change":"2024-09-15T22:46:41.630313+0000","last_active":"2024-09-15T22:46:41.634913+0000","last_peered":"2024-09-15T22:46:41.634913+0000","last_clean":"2024-09-15T22:46:41.634913+0000","last_became_active":"2024-09-15T22:46:41.629752+0000","last_became_peered":"2024-09-15T22:46:41.629752+0000","last_unstale":"2024-09-15T22:46:41.634913+0000","last_undegraded":"2024-09-15T22:46:41.634913+0000","last_fullsized":"2024-09-15T22:46:41.634913+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:12.837921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631279+0000","last_change":"2024-09-15T22:46:41.631279+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631279+0000","last_undegraded":"2024-09-15T22:46:41.631279+0000","last_fullsized":"2024-09-15T22:46:41.631279+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637753+0000","last_change":"2024-09-15T22:46:41.633208+0000","last_active":"2024-09-15T22:46:41.637753+0000","last_peered":"2024-09-15T22:46:41.637753+0000","last_clean":"2024-09-15T22:46:41.637753+0000","last_became_active":"2024-09-15T22:46:41.632913+0000","last_became_peered":"2024-09-15T22:46:41.632913+0000","last_unstale":"2024-09-15T22:46:41.637753+0000","last_undegraded":"2024-09-15T22:46:41.637753+0000","last_fullsized":"2024-09-15T22:46:41.637753+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:56.346187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623188+0000","last_change":"2024-09-15T22:46:41.623188+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623188+0000","last_undegraded":"2024-09-15T22:46:41.623188+0000","last_fullsized":"2024-09-15T22:46:41.623188+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632618+0000","last_change":"2024-09-15T22:46:41.625300+0000","last_active":"2024-09-15T22:46:41.632618+0000","last_peered":"2024-09-15T22:46:41.632618+0000","last_clean":"2024-09-15T22:46:41.632618+0000","last_became_active":"2024-09-15T22:46:41.624984+0000","last_became_peered":"2024-09-15T22:46:41.624984+0000","last_unstale":"2024-09-15T22:46:41.632618+0000","last_undegraded":"2024-09-15T22:46:41.632618+0000","last_fullsized":"2024-09-15T22:46:41.632618+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.020034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632655+0000","last_change":"2024-09-15T22:46:41.632655+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632655+0000","last_undegraded":"2024-09-15T22:46:41.632655+0000","last_fullsized":"2024-09-15T22:46:41.632655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637735+0000","last_change":"2024-09-15T22:46:41.632960+0000","last_active":"2024-09-15T22:46:41.637735+0000","last_peered":"2024-09-15T22:46:41.637735+0000","last_clean":"2024-09-15T22:46:41.637735+0000","last_became_active":"2024-09-15T22:46:41.632657+0000","last_became_peered":"2024-09-15T22:46:41.632657+0000","last_unstale":"2024-09-15T22:46:41.637735+0000","last_undegraded":"2024-09-15T22:46:41.637735+0000","last_fullsized":"2024-09-15T22:46:41.637735+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.686133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631250+0000","last_change":"2024-09-15T22:46:41.631250+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631250+0000","last_undegraded":"2024-09-15T22:46:41.631250+0000","last_fullsized":"2024-09-15T22:46:41.631250+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.631923+0000","last_change":"2024-09-15T22:46:41.629042+0000","last_active":"2024-09-15T22:46:41.631923+0000","last_peered":"2024-09-15T22:46:41.631923+0000","last_clean":"2024-09-15T22:46:41.631923+0000","last_became_active":"2024-09-15T22:46:41.628771+0000","last_became_peered":"2024-09-15T22:46:41.628771+0000","last_unstale":"2024-09-15T22:46:41.631923+0000","last_undegraded":"2024-09-15T22:46:41.631923+0000","last_fullsized":"2024-09-15T22:46:41.631923+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:16.367659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620302+0000","last_change":"2024-09-15T22:46:41.620302+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620302+0000","last_undegraded":"2024-09-15T22:46:41.620302+0000","last_fullsized":"2024-09-15T22:46:41.620302+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632468+0000","last_change":"2024-09-15T22:46:41.629205+0000","last_active":"2024-09-15T22:46:41.632468+0000","last_peered":"2024-09-15T22:46:41.632468+0000","last_clean":"2024-09-15T22:46:41.632468+0000","last_became_active":"2024-09-15T22:46:41.628999+0000","last_became_peered":"2024-09-15T22:46:41.628999+0000","last_unstale":"2024-09-15T22:46:41.632468+0000","last_undegraded":"2024-09-15T22:46:41.632468+0000","last_fullsized":"2024-09-15T22:46:41.632468+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:19.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620632+0000","last_change":"2024-09-15T22:46:41.620632+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620632+0000","last_undegraded":"2024-09-15T22:46:41.620632+0000","last_fullsized":"2024-09-15T22:46:41.620632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642260+0000","last_change":"2024-09-15T22:46:41.641108+0000","last_active":"2024-09-15T22:46:41.642260+0000","last_peered":"2024-09-15T22:46:41.642260+0000","last_clean":"2024-09-15T22:46:41.642260+0000","last_became_active":"2024-09-15T22:46:41.640839+0000","last_became_peered":"2024-09-15T22:46:41.640839+0000","last_unstale":"2024-09-15T22:46:41.642260+0000","last_undegraded":"2024-09-15T22:46:41.642260+0000","last_fullsized":"2024-09-15T22:46:41.642260+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:47.007958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625071+0000","last_change":"2024-09-15T22:46:41.625071+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625071+0000","last_undegraded":"2024-09-15T22:46:41.625071+0000","last_fullsized":"2024-09-15T22:46:41.625071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632205+0000","last_change":"2024-09-15T22:46:41.628614+0000","last_active":"2024-09-15T22:46:41.632205+0000","last_peered":"2024-09-15T22:46:41.632205+0000","last_clean":"2024-09-15T22:46:41.632205+0000","last_became_active":"2024-09-15T22:46:41.628338+0000","last_became_peered":"2024-09-15T22:46:41.628338+0000","last_unstale":"2024-09-15T22:46:41.632205+0000","last_undegraded":"2024-09-15T22:46:41.632205+0000","last_fullsized":"2024-09-15T22:46:41.632205+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:42.231798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627788+0000","last_change":"2024-09-15T22:46:41.627788+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627788+0000","last_undegraded":"2024-09-15T22:46:41.627788+0000","last_fullsized":"2024-09-15T22:46:41.627788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634796+0000","last_change":"2024-09-15T22:46:41.633198+0000","last_active":"2024-09-15T22:46:41.634796+0000","last_peered":"2024-09-15T22:46:41.634796+0000","last_clean":"2024-09-15T22:46:41.634796+0000","last_became_active":"2024-09-15T22:46:41.632937+0000","last_became_peered":"2024-09-15T22:46:41.632937+0000","last_unstale":"2024-09-15T22:46:41.634796+0000","last_undegraded":"2024-09-15T22:46:41.634796+0000","last_fullsized":"2024-09-15T22:46:41.634796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:30.520261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624570+0000","last_change":"2024-09-15T22:46:41.624570+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624570+0000","last_undegraded":"2024-09-15T22:46:41.624570+0000","last_fullsized":"2024-09-15T22:46:41.624570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636612+0000","last_change":"2024-09-15T22:46:41.634748+0000","last_active":"2024-09-15T22:46:41.636612+0000","last_peered":"2024-09-15T22:46:41.636612+0000","last_clean":"2024-09-15T22:46:41.636612+0000","last_became_active":"2024-09-15T22:46:41.634461+0000","last_became_peered":"2024-09-15T22:46:41.634461+0000","last_unstale":"2024-09-15T22:46:41.636612+0000","last_undegraded":"2024-09-15T22:46:41.636612+0000","last_fullsized":"2024-09-15T22:46:41.636612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.418086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619123+0000","last_change":"2024-09-15T22:46:41.619123+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619123+0000","last_undegraded":"2024-09-15T22:46:41.619123+0000","last_fullsized":"2024-09-15T22:46:41.619123+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632076+0000","last_change":"2024-09-15T22:46:41.626980+0000","last_active":"2024-09-15T22:46:41.632076+0000","last_peered":"2024-09-15T22:46:41.632076+0000","last_clean":"2024-09-15T22:46:41.632076+0000","last_became_active":"2024-09-15T22:46:41.626709+0000","last_became_peered":"2024-09-15T22:46:41.626709+0000","last_unstale":"2024-09-15T22:46:41.632076+0000","last_undegraded":"2024-09-15T22:46:41.632076+0000","last_fullsized":"2024-09-15T22:46:41.632076+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:01.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619131+0000","last_change":"2024-09-15T22:46:41.619131+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619131+0000","last_undegraded":"2024-09-15T22:46:41.619131+0000","last_fullsized":"2024-09-15T22:46:41.619131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640491+0000","last_change":"2024-09-15T22:46:41.635999+0000","last_active":"2024-09-15T22:46:41.640491+0000","last_peered":"2024-09-15T22:46:41.640491+0000","last_clean":"2024-09-15T22:46:41.640491+0000","last_became_active":"2024-09-15T22:46:41.635675+0000","last_became_peered":"2024-09-15T22:46:41.635675+0000","last_unstale":"2024-09-15T22:46:41.640491+0000","last_undegraded":"2024-09-15T22:46:41.640491+0000","last_fullsized":"2024-09-15T22:46:41.640491+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:34.594050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.630349+0000","last_change":"2024-09-15T22:46:41.630349+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.630349+0000","last_undegraded":"2024-09-15T22:46:41.630349+0000","last_fullsized":"2024-09-15T22:46:41.630349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636347+0000","last_change":"2024-09-15T22:46:41.634008+0000","last_active":"2024-09-15T22:46:41.636347+0000","last_peered":"2024-09-15T22:46:41.636347+0000","last_clean":"2024-09-15T22:46:41.636347+0000","last_became_active":"2024-09-15T22:46:41.633721+0000","last_became_peered":"2024-09-15T22:46:41.633721+0000","last_unstale":"2024-09-15T22:46:41.636347+0000","last_undegraded":"2024-09-15T22:46:41.636347+0000","last_fullsized":"2024-09-15T22:46:41.636347+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:16.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624299+0000","last_change":"2024-09-15T22:46:41.624299+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624299+0000","last_undegraded":"2024-09-15T22:46:41.624299+0000","last_fullsized":"2024-09-15T22:46:41.624299+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.641269+0000","last_change":"2024-09-15T22:46:41.637476+0000","last_active":"2024-09-15T22:46:41.641269+0000","last_peered":"2024-09-15T22:46:41.641269+0000","last_clean":"2024-09-15T22:46:41.641269+0000","last_became_active":"2024-09-15T22:46:41.636964+0000","last_became_peered":"2024-09-15T22:46:41.636964+0000","last_unstale":"2024-09-15T22:46:41.641269+0000","last_undegraded":"2024-09-15T22:46:41.641269+0000","last_fullsized":"2024-09-15T22:46:41.641269+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:25.506971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624020+0000","last_change":"2024-09-15T22:46:41.624020+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624020+0000","last_undegraded":"2024-09-15T22:46:41.624020+0000","last_fullsized":"2024-09-15T22:46:41.624020+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634984+0000","last_change":"2024-09-15T22:46:41.630408+0000","last_active":"2024-09-15T22:46:41.634984+0000","last_peered":"2024-09-15T22:46:41.634984+0000","last_clean":"2024-09-15T22:46:41.634984+0000","last_became_active":"2024-09-15T22:46:41.630125+0000","last_became_peered":"2024-09-15T22:46:41.630125+0000","last_unstale":"2024-09-15T22:46:41.634984+0000","last_undegraded":"2024-09-15T22:46:41.634984+0000","last_fullsized":"2024-09-15T22:46:41.634984+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:06.035082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621170+0000","last_change":"2024-09-15T22:46:41.621170+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621170+0000","last_undegraded":"2024-09-15T22:46:41.621170+0000","last_fullsized":"2024-09-15T22:46:41.621170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636158+0000","last_change":"2024-09-15T22:46:41.635450+0000","last_active":"2024-09-15T22:46:41.636158+0000","last_peered":"2024-09-15T22:46:41.636158+0000","last_clean":"2024-09-15T22:46:41.636158+0000","last_became_active":"2024-09-15T22:46:41.635105+0000","last_became_peered":"2024-09-15T22:46:41.635105+0000","last_unstale":"2024-09-15T22:46:41.636158+0000","last_undegraded":"2024-09-15T22:46:41.636158+0000","last_fullsized":"2024-09-15T22:46:41.636158+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:06.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620613+0000","last_change":"2024-09-15T22:46:41.620613+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620613+0000","last_undegraded":"2024-09-15T22:46:41.620613+0000","last_fullsized":"2024-09-15T22:46:41.620613+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634315+0000","last_change":"2024-09-15T22:46:41.632765+0000","last_active":"2024-09-15T22:46:41.634315+0000","last_peered":"2024-09-15T22:46:41.634315+0000","last_clean":"2024-09-15T22:46:41.634315+0000","last_became_active":"2024-09-15T22:46:41.632486+0000","last_became_peered":"2024-09-15T22:46:41.632486+0000","last_unstale":"2024-09-15T22:46:41.634315+0000","last_undegraded":"2024-09-15T22:46:41.634315+0000","last_fullsized":"2024-09-15T22:46:41.634315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:00.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618774+0000","last_change":"2024-09-15T22:46:41.618774+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618774+0000","last_undegraded":"2024-09-15T22:46:41.618774+0000","last_fullsized":"2024-09-15T22:46:41.618774+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636178+0000","last_change":"2024-09-15T22:46:41.635456+0000","last_active":"2024-09-15T22:46:41.636178+0000","last_peered":"2024-09-15T22:46:41.636178+0000","last_clean":"2024-09-15T22:46:41.636178+0000","last_became_active":"2024-09-15T22:46:41.635135+0000","last_became_peered":"2024-09-15T22:46:41.635135+0000","last_unstale":"2024-09-15T22:46:41.636178+0000","last_undegraded":"2024-09-15T22:46:41.636178+0000","last_fullsized":"2024-09-15T22:46:41.636178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:23.028152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624040+0000","last_change":"2024-09-15T22:46:41.624040+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624040+0000","last_undegraded":"2024-09-15T22:46:41.624040+0000","last_fullsized":"2024-09-15T22:46:41.624040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634912+0000","last_change":"2024-09-15T22:46:41.631832+0000","last_active":"2024-09-15T22:46:41.634912+0000","last_peered":"2024-09-15T22:46:41.634912+0000","last_clean":"2024-09-15T22:46:41.634912+0000","last_became_active":"2024-09-15T22:46:41.631510+0000","last_became_peered":"2024-09-15T22:46:41.631510+0000","last_unstale":"2024-09-15T22:46:41.634912+0000","last_undegraded":"2024-09-15T22:46:41.634912+0000","last_fullsized":"2024-09-15T22:46:41.634912+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:05.137822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618710+0000","last_change":"2024-09-15T22:46:41.618710+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618710+0000","last_undegraded":"2024-09-15T22:46:41.618710+0000","last_fullsized":"2024-09-15T22:46:41.618710+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640377+0000","last_change":"2024-09-15T22:46:41.635616+0000","last_active":"2024-09-15T22:46:41.640377+0000","last_peered":"2024-09-15T22:46:41.640377+0000","last_clean":"2024-09-15T22:46:41.640377+0000","last_became_active":"2024-09-15T22:46:41.635280+0000","last_became_peered":"2024-09-15T22:46:41.635280+0000","last_unstale":"2024-09-15T22:46:41.640377+0000","last_undegraded":"2024-09-15T22:46:41.640377+0000","last_fullsized":"2024-09-15T22:46:41.640377+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:59.003178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.629896+0000","last_change":"2024-09-15T22:46:41.629896+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.629896+0000","last_undegraded":"2024-09-15T22:46:41.629896+0000","last_fullsized":"2024-09-15T22:46:41.629896+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634864+0000","last_change":"2024-09-15T22:46:41.629982+0000","last_active":"2024-09-15T22:46:41.634864+0000","last_peered":"2024-09-15T22:46:41.634864+0000","last_clean":"2024-09-15T22:46:41.634864+0000","last_became_active":"2024-09-15T22:46:41.629685+0000","last_became_peered":"2024-09-15T22:46:41.629685+0000","last_unstale":"2024-09-15T22:46:41.634864+0000","last_undegraded":"2024-09-15T22:46:41.634864+0000","last_fullsized":"2024-09-15T22:46:41.634864+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:58.816529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623916+0000","last_change":"2024-09-15T22:46:41.623916+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623916+0000","last_undegraded":"2024-09-15T22:46:41.623916+0000","last_fullsized":"2024-09-15T22:46:41.623916+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637755+0000","last_change":"2024-09-15T22:46:41.633318+0000","last_active":"2024-09-15T22:46:41.637755+0000","last_peered":"2024-09-15T22:46:41.637755+0000","last_clean":"2024-09-15T22:46:41.637755+0000","last_became_active":"2024-09-15T22:46:41.633029+0000","last_became_peered":"2024-09-15T22:46:41.633029+0000","last_unstale":"2024-09-15T22:46:41.637755+0000","last_undegraded":"2024-09-15T22:46:41.637755+0000","last_fullsized":"2024-09-15T22:46:41.637755+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:59.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621291+0000","last_change":"2024-09-15T22:46:41.621291+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621291+0000","last_undegraded":"2024-09-15T22:46:41.621291+0000","last_fullsized":"2024-09-15T22:46:41.621291+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640527+0000","last_change":"2024-09-15T22:46:41.637794+0000","last_active":"2024-09-15T22:46:41.640527+0000","last_peered":"2024-09-15T22:46:41.640527+0000","last_clean":"2024-09-15T22:46:41.640527+0000","last_became_active":"2024-09-15T22:46:41.637474+0000","last_became_peered":"2024-09-15T22:46:41.637474+0000","last_unstale":"2024-09-15T22:46:41.640527+0000","last_undegraded":"2024-09-15T22:46:41.640527+0000","last_fullsized":"2024-09-15T22:46:41.640527+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:45.038132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618785+0000","last_change":"2024-09-15T22:46:41.618785+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618785+0000","last_undegraded":"2024-09-15T22:46:41.618785+0000","last_fullsized":"2024-09-15T22:46:41.618785+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640452+0000","last_change":"2024-09-15T22:46:41.637018+0000","last_active":"2024-09-15T22:46:41.640452+0000","last_peered":"2024-09-15T22:46:41.640452+0000","last_clean":"2024-09-15T22:46:41.640452+0000","last_became_active":"2024-09-15T22:46:41.636696+0000","last_became_peered":"2024-09-15T22:46:41.636696+0000","last_unstale":"2024-09-15T22:46:41.640452+0000","last_undegraded":"2024-09-15T22:46:41.640452+0000","last_fullsized":"2024-09-15T22:46:41.640452+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:14.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624482+0000","last_change":"2024-09-15T22:46:41.624482+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624482+0000","last_undegraded":"2024-09-15T22:46:41.624482+0000","last_fullsized":"2024-09-15T22:46:41.624482+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.626926+0000","last_change":"2024-09-15T22:46:41.626298+0000","last_active":"2024-09-15T22:46:41.626926+0000","last_peered":"2024-09-15T22:46:41.626926+0000","last_clean":"2024-09-15T22:46:41.626926+0000","last_became_active":"2024-09-15T22:46:41.625885+0000","last_became_peered":"2024-09-15T22:46:41.625885+0000","last_unstale":"2024-09-15T22:46:41.626926+0000","last_undegraded":"2024-09-15T22:46:41.626926+0000","last_fullsized":"2024-09-15T22:46:41.626926+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:30.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631676+0000","last_change":"2024-09-15T22:46:41.631676+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631676+0000","last_undegraded":"2024-09-15T22:46:41.631676+0000","last_fullsized":"2024-09-15T22:46:41.631676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632643+0000","last_change":"2024-09-15T22:46:41.628608+0000","last_active":"2024-09-15T22:46:41.632643+0000","last_peered":"2024-09-15T22:46:41.632643+0000","last_clean":"2024-09-15T22:46:41.632643+0000","last_became_active":"2024-09-15T22:46:41.628339+0000","last_became_peered":"2024-09-15T22:46:41.628339+0000","last_unstale":"2024-09-15T22:46:41.632643+0000","last_undegraded":"2024-09-15T22:46:41.632643+0000","last_fullsized":"2024-09-15T22:46:41.632643+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:06.797079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632297+0000","last_change":"2024-09-15T22:46:41.632297+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632297+0000","last_undegraded":"2024-09-15T22:46:41.632297+0000","last_fullsized":"2024-09-15T22:46:41.632297+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638304+0000","last_change":"2024-09-15T22:46:41.635924+0000","last_active":"2024-09-15T22:46:41.638304+0000","last_peered":"2024-09-15T22:46:41.638304+0000","last_clean":"2024-09-15T22:46:41.638304+0000","last_became_active":"2024-09-15T22:46:41.635467+0000","last_became_peered":"2024-09-15T22:46:41.635467+0000","last_unstale":"2024-09-15T22:46:41.638304+0000","last_undegraded":"2024-09-15T22:46:41.638304+0000","last_fullsized":"2024-09-15T22:46:41.638304+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:36.930156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621917+0000","last_change":"2024-09-15T22:46:41.621917+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621917+0000","last_undegraded":"2024-09-15T22:46:41.621917+0000","last_fullsized":"2024-09-15T22:46:41.621917+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640507+0000","last_change":"2024-09-15T22:46:41.636005+0000","last_active":"2024-09-15T22:46:41.640507+0000","last_peered":"2024-09-15T22:46:41.640507+0000","last_clean":"2024-09-15T22:46:41.640507+0000","last_became_active":"2024-09-15T22:46:41.635611+0000","last_became_peered":"2024-09-15T22:46:41.635611+0000","last_unstale":"2024-09-15T22:46:41.640507+0000","last_undegraded":"2024-09-15T22:46:41.640507+0000","last_fullsized":"2024-09-15T22:46:41.640507+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:09.159745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619319+0000","last_change":"2024-09-15T22:46:41.619319+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619319+0000","last_undegraded":"2024-09-15T22:46:41.619319+0000","last_fullsized":"2024-09-15T22:46:41.619319+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.629613+0000","last_change":"2024-09-15T22:46:41.626572+0000","last_active":"2024-09-15T22:46:41.629613+0000","last_peered":"2024-09-15T22:46:41.629613+0000","last_clean":"2024-09-15T22:46:41.629613+0000","last_became_active":"2024-09-15T22:46:41.626269+0000","last_became_peered":"2024-09-15T22:46:41.626269+0000","last_unstale":"2024-09-15T22:46:41.629613+0000","last_undegraded":"2024-09-15T22:46:41.629613+0000","last_fullsized":"2024-09-15T22:46:41.629613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:17.611238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624540+0000","last_change":"2024-09-15T22:46:41.624540+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624540+0000","last_undegraded":"2024-09-15T22:46:41.624540+0000","last_fullsized":"2024-09-15T22:46:41.624540+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642265+0000","last_change":"2024-09-15T22:46:41.641080+0000","last_active":"2024-09-15T22:46:41.642265+0000","last_peered":"2024-09-15T22:46:41.642265+0000","last_clean":"2024-09-15T22:46:41.642265+0000","last_became_active":"2024-09-15T22:46:41.640738+0000","last_became_peered":"2024-09-15T22:46:41.640738+0000","last_unstale":"2024-09-15T22:46:41.642265+0000","last_undegraded":"2024-09-15T22:46:41.642265+0000","last_fullsized":"2024-09-15T22:46:41.642265+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:40.915323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":389,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.618371+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:46:41.618371+0000","last_peered":"2024-09-15T22:46:41.618371+0000","last_clean":"2024-09-15T22:46:41.618371+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:46:41.618371+0000","last_undegraded":"2024-09-15T22:46:41.618371+0000","last_fullsized":"2024-09-15T22:46:41.618371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33216,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338624,"statfs":{"total":96636764160,"available":96602750976,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:46:45.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:46:46.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.038+0000 7fcf6a7b7640 1 Processor -- start 2024-09-15T22:46:46.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.038+0000 7fcf6a7b7640 1 -- start start 2024-09-15T22:46:46.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf6a7b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf640cd300 0x7fcf6406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf6a7b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf6406f010 0x7fcf640ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf6a7b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6415ecf0 con 0x7fcf6415c300 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf6a7b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6406f480 con 0x7fcf640cd300 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf6a7b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6415c6e0 con 0x7fcf6406f010 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf640cd300 0x7fcf6406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf640cd300 0x7fcf6406ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51422/0 (socket says 172.21.15.134:51422) 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.039+0000 7fcf637fe640 1 -- 172.21.15.134:0/237034374 learned_addr learned my addr 172.21.15.134:0/237034374 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf68d54640 1 --2- 172.21.15.134:0/237034374 >> v2:172.21.15.177:3300/0 conn(0x7fcf6406f010 0x7fcf640ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf637fe640 1 -- 172.21.15.134:0/237034374 >> v2:172.21.15.177:3300/0 conn(0x7fcf6406f010 msgr2=0x7fcf640ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf637fe640 1 --2- 172.21.15.134:0/237034374 >> v2:172.21.15.177:3300/0 conn(0x7fcf6406f010 0x7fcf640ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf637fe640 1 -- 172.21.15.134:0/237034374 >> v1:172.21.15.177:6789/0 conn(0x7fcf6415c300 legacy=0x7fcf640affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf637fe640 1 -- 172.21.15.134:0/237034374 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6415efb0 con 0x7fcf640cd300 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf637fe640 1 --2- 172.21.15.134:0/237034374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf6406ead0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cd030 tx=0x7fcf5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52eb39345672a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf62ffd640 1 -- 172.21.15.134:0/237034374 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037070 con 0x7fcf640cd300 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf62ffd640 1 -- 172.21.15.134:0/237034374 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58032440 con 0x7fcf640cd300 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.040+0000 7fcf62ffd640 1 -- 172.21.15.134:0/237034374 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58032810 con 0x7fcf640cd300 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/237034374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 msgr2=0x7fcf6406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/237034374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf6406ead0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cd030 tx=0x7fcf5802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/237034374 shutdown_connections 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/237034374 >> v2:172.21.15.177:3300/0 conn(0x7fcf6406f010 0x7fcf640ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/237034374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf6406ead0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/237034374 >> 172.21.15.134:0/237034374 conn(0x7fcf6406cae0 msgr2=0x7fcf6406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/237034374 shutdown_connections 2024-09-15T22:46:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.041+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/237034374 wait complete. 2024-09-15T22:46:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.042+0000 7fcf6a7b7640 1 Processor -- start 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.042+0000 7fcf6a7b7640 1 -- start start 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf6406f010 0x7fcf64154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf6415c300 0x7fcf6415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6415f850 con 0x7fcf640cd300 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6415f570 con 0x7fcf6406f010 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf6a7b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcf64071880 con 0x7fcf6415c300 2024-09-15T22:46:46.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51428/0 (socket says 172.21.15.134:51428) 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 -- 172.21.15.134:0/1582953383 learned_addr learned my addr 172.21.15.134:0/1582953383 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf63fff640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf6406f010 0x7fcf64154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 -- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf6415c300 msgr2=0x7fcf6415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf6415c300 0x7fcf6415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 -- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf6406f010 msgr2=0x7fcf64154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf6406f010 0x7fcf64154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.043+0000 7fcf637fe640 1 -- 172.21.15.134:0/1582953383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6415a390 con 0x7fcf640cd300 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf637fe640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037040 con 0x7fcf640cd300 2024-09-15T22:46:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58042070 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58030bb0 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6415a670 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.044+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6415ac30 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.045+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64076120 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.045+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fcf58047460 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.046+0000 7fcf60ff9640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 0x7fcf5006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.046+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fcf580ac5d0 con 0x7fcf640cd300 2024-09-15T22:46:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.046+0000 7fcf63fff640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 0x7fcf5006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.046+0000 7fcf63fff640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 0x7fcf5006eb90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf540015d0 tx=0x7fcf54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.050+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf58045360 con 0x7fcf640cd300 2024-09-15T22:46:46.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.210+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf640b64a0 con 0x7fcf5006c6d0 2024-09-15T22:46:46.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.217+0000 7fcf60ff9640 1 -- 172.21.15.134:0/1582953383 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247086 (secure 0 0 0) 0x7fcf640b64a0 con 0x7fcf5006c6d0 2024-09-15T22:46:46.223 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:46.225 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 msgr2=0x7fcf5006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 0x7fcf5006eb90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf540015d0 tx=0x7fcf54009040 comp rx=0 tx=0).stop 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 msgr2=0x7fcf64159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf580046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 shutdown_connections 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf6415c300 0x7fcf6415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcf5006c6d0 0x7fcf5006eb90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf640cd300 0x7fcf64159c20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 --2- 172.21.15.134:0/1582953383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf6406f010 0x7fcf64154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 >> 172.21.15.134:0/1582953383 conn(0x7fcf6406cae0 msgr2=0x7fcf640b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 shutdown_connections 2024-09-15T22:46:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.220+0000 7fcf6a7b7640 1 -- 172.21.15.134:0/1582953383 wait complete. 2024-09-15T22:46:46.233 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-15T22:46:45.201610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262288,"kb_used_data":12760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712432,"statfs":{"total":773094113280,"available":772825530368,"internally_reserved":0,"allocated":13066240,"data_stored":6378436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589562"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623630+0000","last_change":"2024-09-15T22:46:41.623630+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623630+0000","last_undegraded":"2024-09-15T22:46:41.623630+0000","last_fullsized":"2024-09-15T22:46:41.623630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624933+0000","last_change":"2024-09-15T22:46:41.624933+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624933+0000","last_undegraded":"2024-09-15T22:46:41.624933+0000","last_fullsized":"2024-09-15T22:46:41.624933+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627512+0000","last_change":"2024-09-15T22:46:41.627512+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627512+0000","last_undegraded":"2024-09-15T22:46:41.627512+0000","last_fullsized":"2024-09-15T22:46:41.627512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623031+0000","last_change":"2024-09-15T22:46:41.623031+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623031+0000","last_undegraded":"2024-09-15T22:46:41.623031+0000","last_fullsized":"2024-09-15T22:46:41.623031+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625199+0000","last_change":"2024-09-15T22:46:41.625199+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625199+0000","last_undegraded":"2024-09-15T22:46:41.625199+0000","last_fullsized":"2024-09-15T22:46:41.625199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632064+0000","last_change":"2024-09-15T22:46:41.632064+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632064+0000","last_undegraded":"2024-09-15T22:46:41.632064+0000","last_fullsized":"2024-09-15T22:46:41.632064+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624746+0000","last_change":"2024-09-15T22:46:41.624746+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624746+0000","last_undegraded":"2024-09-15T22:46:41.624746+0000","last_fullsized":"2024-09-15T22:46:41.624746+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624619+0000","last_change":"2024-09-15T22:46:41.624619+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624619+0000","last_undegraded":"2024-09-15T22:46:41.624619+0000","last_fullsized":"2024-09-15T22:46:41.624619+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627104+0000","last_change":"2024-09-15T22:46:41.627104+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627104+0000","last_undegraded":"2024-09-15T22:46:41.627104+0000","last_fullsized":"2024-09-15T22:46:41.627104+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624494+0000","last_change":"2024-09-15T22:46:41.624494+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624494+0000","last_undegraded":"2024-09-15T22:46:41.624494+0000","last_fullsized":"2024-09-15T22:46:41.624494+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623333+0000","last_change":"2024-09-15T22:46:41.623333+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623333+0000","last_undegraded":"2024-09-15T22:46:41.623333+0000","last_fullsized":"2024-09-15T22:46:41.623333+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631652+0000","last_change":"2024-09-15T22:46:41.631652+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631652+0000","last_undegraded":"2024-09-15T22:46:41.631652+0000","last_fullsized":"2024-09-15T22:46:41.631652+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.622355+0000","last_change":"2024-09-15T22:46:41.622355+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.622355+0000","last_undegraded":"2024-09-15T22:46:41.622355+0000","last_fullsized":"2024-09-15T22:46:41.622355+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620816+0000","last_change":"2024-09-15T22:46:41.620816+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620816+0000","last_undegraded":"2024-09-15T22:46:41.620816+0000","last_fullsized":"2024-09-15T22:46:41.620816+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621924+0000","last_change":"2024-09-15T22:46:41.621924+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621924+0000","last_undegraded":"2024-09-15T22:46:41.621924+0000","last_fullsized":"2024-09-15T22:46:41.621924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619522+0000","last_change":"2024-09-15T22:46:41.619522+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619522+0000","last_undegraded":"2024-09-15T22:46:41.619522+0000","last_fullsized":"2024-09-15T22:46:41.619522+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.626218+0000","last_change":"2024-09-15T22:46:41.626218+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.626218+0000","last_undegraded":"2024-09-15T22:46:41.626218+0000","last_fullsized":"2024-09-15T22:46:41.626218+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624272+0000","last_change":"2024-09-15T22:46:41.624272+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624272+0000","last_undegraded":"2024-09-15T22:46:41.624272+0000","last_fullsized":"2024-09-15T22:46:41.624272+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621009+0000","last_change":"2024-09-15T22:46:41.621009+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621009+0000","last_undegraded":"2024-09-15T22:46:41.621009+0000","last_fullsized":"2024-09-15T22:46:41.621009+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627283+0000","last_change":"2024-09-15T22:46:41.627283+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627283+0000","last_undegraded":"2024-09-15T22:46:41.627283+0000","last_fullsized":"2024-09-15T22:46:41.627283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.633814+0000","last_change":"2024-09-15T22:46:41.633814+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.633814+0000","last_undegraded":"2024-09-15T22:46:41.633814+0000","last_fullsized":"2024-09-15T22:46:41.633814+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619661+0000","last_change":"2024-09-15T22:46:41.619661+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619661+0000","last_undegraded":"2024-09-15T22:46:41.619661+0000","last_fullsized":"2024-09-15T22:46:41.619661+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625865+0000","last_change":"2024-09-15T22:46:41.625865+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625865+0000","last_undegraded":"2024-09-15T22:46:41.625865+0000","last_fullsized":"2024-09-15T22:46:41.625865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623783+0000","last_change":"2024-09-15T22:46:41.623783+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623783+0000","last_undegraded":"2024-09-15T22:46:41.623783+0000","last_fullsized":"2024-09-15T22:46:41.623783+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623730+0000","last_change":"2024-09-15T22:46:41.623730+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623730+0000","last_undegraded":"2024-09-15T22:46:41.623730+0000","last_fullsized":"2024-09-15T22:46:41.623730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621527+0000","last_change":"2024-09-15T22:46:41.621527+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621527+0000","last_undegraded":"2024-09-15T22:46:41.621527+0000","last_fullsized":"2024-09-15T22:46:41.621527+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618559+0000","last_change":"2024-09-15T22:46:41.618559+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618559+0000","last_undegraded":"2024-09-15T22:46:41.618559+0000","last_fullsized":"2024-09-15T22:46:41.618559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625532+0000","last_change":"2024-09-15T22:46:41.625532+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625532+0000","last_undegraded":"2024-09-15T22:46:41.625532+0000","last_fullsized":"2024-09-15T22:46:41.625532+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621351+0000","last_change":"2024-09-15T22:46:41.621351+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621351+0000","last_undegraded":"2024-09-15T22:46:41.621351+0000","last_fullsized":"2024-09-15T22:46:41.621351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619245+0000","last_change":"2024-09-15T22:46:41.619245+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619245+0000","last_undegraded":"2024-09-15T22:46:41.619245+0000","last_fullsized":"2024-09-15T22:46:41.619245+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625026+0000","last_change":"2024-09-15T22:46:41.625026+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625026+0000","last_undegraded":"2024-09-15T22:46:41.625026+0000","last_fullsized":"2024-09-15T22:46:41.625026+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625531+0000","last_change":"2024-09-15T22:46:41.625531+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625531+0000","last_undegraded":"2024-09-15T22:46:41.625531+0000","last_fullsized":"2024-09-15T22:46:41.625531+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619576+0000","last_change":"2024-09-15T22:46:41.619576+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619576+0000","last_undegraded":"2024-09-15T22:46:41.619576+0000","last_fullsized":"2024-09-15T22:46:41.619576+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634548+0000","last_change":"2024-09-15T22:46:41.633396+0000","last_active":"2024-09-15T22:46:41.634548+0000","last_peered":"2024-09-15T22:46:41.634548+0000","last_clean":"2024-09-15T22:46:41.634548+0000","last_became_active":"2024-09-15T22:46:41.632887+0000","last_became_peered":"2024-09-15T22:46:41.632887+0000","last_unstale":"2024-09-15T22:46:41.634548+0000","last_undegraded":"2024-09-15T22:46:41.634548+0000","last_fullsized":"2024-09-15T22:46:41.634548+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:27.587484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625449+0000","last_change":"2024-09-15T22:46:41.625449+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625449+0000","last_undegraded":"2024-09-15T22:46:41.625449+0000","last_fullsized":"2024-09-15T22:46:41.625449+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638511+0000","last_change":"2024-09-15T22:46:41.637052+0000","last_active":"2024-09-15T22:46:41.638511+0000","last_peered":"2024-09-15T22:46:41.638511+0000","last_clean":"2024-09-15T22:46:41.638511+0000","last_became_active":"2024-09-15T22:46:41.636779+0000","last_became_peered":"2024-09-15T22:46:41.636779+0000","last_unstale":"2024-09-15T22:46:41.638511+0000","last_undegraded":"2024-09-15T22:46:41.638511+0000","last_fullsized":"2024-09-15T22:46:41.638511+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:30.820869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625005+0000","last_change":"2024-09-15T22:46:41.625005+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625005+0000","last_undegraded":"2024-09-15T22:46:41.625005+0000","last_fullsized":"2024-09-15T22:46:41.625005+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634913+0000","last_change":"2024-09-15T22:46:41.630313+0000","last_active":"2024-09-15T22:46:41.634913+0000","last_peered":"2024-09-15T22:46:41.634913+0000","last_clean":"2024-09-15T22:46:41.634913+0000","last_became_active":"2024-09-15T22:46:41.629752+0000","last_became_peered":"2024-09-15T22:46:41.629752+0000","last_unstale":"2024-09-15T22:46:41.634913+0000","last_undegraded":"2024-09-15T22:46:41.634913+0000","last_fullsized":"2024-09-15T22:46:41.634913+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:12.837921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631279+0000","last_change":"2024-09-15T22:46:41.631279+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631279+0000","last_undegraded":"2024-09-15T22:46:41.631279+0000","last_fullsized":"2024-09-15T22:46:41.631279+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637753+0000","last_change":"2024-09-15T22:46:41.633208+0000","last_active":"2024-09-15T22:46:41.637753+0000","last_peered":"2024-09-15T22:46:41.637753+0000","last_clean":"2024-09-15T22:46:41.637753+0000","last_became_active":"2024-09-15T22:46:41.632913+0000","last_became_peered":"2024-09-15T22:46:41.632913+0000","last_unstale":"2024-09-15T22:46:41.637753+0000","last_undegraded":"2024-09-15T22:46:41.637753+0000","last_fullsized":"2024-09-15T22:46:41.637753+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:56.346187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623188+0000","last_change":"2024-09-15T22:46:41.623188+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623188+0000","last_undegraded":"2024-09-15T22:46:41.623188+0000","last_fullsized":"2024-09-15T22:46:41.623188+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632618+0000","last_change":"2024-09-15T22:46:41.625300+0000","last_active":"2024-09-15T22:46:41.632618+0000","last_peered":"2024-09-15T22:46:41.632618+0000","last_clean":"2024-09-15T22:46:41.632618+0000","last_became_active":"2024-09-15T22:46:41.624984+0000","last_became_peered":"2024-09-15T22:46:41.624984+0000","last_unstale":"2024-09-15T22:46:41.632618+0000","last_undegraded":"2024-09-15T22:46:41.632618+0000","last_fullsized":"2024-09-15T22:46:41.632618+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.020034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632655+0000","last_change":"2024-09-15T22:46:41.632655+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632655+0000","last_undegraded":"2024-09-15T22:46:41.632655+0000","last_fullsized":"2024-09-15T22:46:41.632655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637735+0000","last_change":"2024-09-15T22:46:41.632960+0000","last_active":"2024-09-15T22:46:41.637735+0000","last_peered":"2024-09-15T22:46:41.637735+0000","last_clean":"2024-09-15T22:46:41.637735+0000","last_became_active":"2024-09-15T22:46:41.632657+0000","last_became_peered":"2024-09-15T22:46:41.632657+0000","last_unstale":"2024-09-15T22:46:41.637735+0000","last_undegraded":"2024-09-15T22:46:41.637735+0000","last_fullsized":"2024-09-15T22:46:41.637735+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.686133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631250+0000","last_change":"2024-09-15T22:46:41.631250+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631250+0000","last_undegraded":"2024-09-15T22:46:41.631250+0000","last_fullsized":"2024-09-15T22:46:41.631250+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.631923+0000","last_change":"2024-09-15T22:46:41.629042+0000","last_active":"2024-09-15T22:46:41.631923+0000","last_peered":"2024-09-15T22:46:41.631923+0000","last_clean":"2024-09-15T22:46:41.631923+0000","last_became_active":"2024-09-15T22:46:41.628771+0000","last_became_peered":"2024-09-15T22:46:41.628771+0000","last_unstale":"2024-09-15T22:46:41.631923+0000","last_undegraded":"2024-09-15T22:46:41.631923+0000","last_fullsized":"2024-09-15T22:46:41.631923+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:16.367659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620302+0000","last_change":"2024-09-15T22:46:41.620302+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620302+0000","last_undegraded":"2024-09-15T22:46:41.620302+0000","last_fullsized":"2024-09-15T22:46:41.620302+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632468+0000","last_change":"2024-09-15T22:46:41.629205+0000","last_active":"2024-09-15T22:46:41.632468+0000","last_peered":"2024-09-15T22:46:41.632468+0000","last_clean":"2024-09-15T22:46:41.632468+0000","last_became_active":"2024-09-15T22:46:41.628999+0000","last_became_peered":"2024-09-15T22:46:41.628999+0000","last_unstale":"2024-09-15T22:46:41.632468+0000","last_undegraded":"2024-09-15T22:46:41.632468+0000","last_fullsized":"2024-09-15T22:46:41.632468+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:19.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620632+0000","last_change":"2024-09-15T22:46:41.620632+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620632+0000","last_undegraded":"2024-09-15T22:46:41.620632+0000","last_fullsized":"2024-09-15T22:46:41.620632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642260+0000","last_change":"2024-09-15T22:46:41.641108+0000","last_active":"2024-09-15T22:46:41.642260+0000","last_peered":"2024-09-15T22:46:41.642260+0000","last_clean":"2024-09-15T22:46:41.642260+0000","last_became_active":"2024-09-15T22:46:41.640839+0000","last_became_peered":"2024-09-15T22:46:41.640839+0000","last_unstale":"2024-09-15T22:46:41.642260+0000","last_undegraded":"2024-09-15T22:46:41.642260+0000","last_fullsized":"2024-09-15T22:46:41.642260+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:47.007958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625071+0000","last_change":"2024-09-15T22:46:41.625071+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625071+0000","last_undegraded":"2024-09-15T22:46:41.625071+0000","last_fullsized":"2024-09-15T22:46:41.625071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632205+0000","last_change":"2024-09-15T22:46:41.628614+0000","last_active":"2024-09-15T22:46:41.632205+0000","last_peered":"2024-09-15T22:46:41.632205+0000","last_clean":"2024-09-15T22:46:41.632205+0000","last_became_active":"2024-09-15T22:46:41.628338+0000","last_became_peered":"2024-09-15T22:46:41.628338+0000","last_unstale":"2024-09-15T22:46:41.632205+0000","last_undegraded":"2024-09-15T22:46:41.632205+0000","last_fullsized":"2024-09-15T22:46:41.632205+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:42.231798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627788+0000","last_change":"2024-09-15T22:46:41.627788+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627788+0000","last_undegraded":"2024-09-15T22:46:41.627788+0000","last_fullsized":"2024-09-15T22:46:41.627788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634796+0000","last_change":"2024-09-15T22:46:41.633198+0000","last_active":"2024-09-15T22:46:41.634796+0000","last_peered":"2024-09-15T22:46:41.634796+0000","last_clean":"2024-09-15T22:46:41.634796+0000","last_became_active":"2024-09-15T22:46:41.632937+0000","last_became_peered":"2024-09-15T22:46:41.632937+0000","last_unstale":"2024-09-15T22:46:41.634796+0000","last_undegraded":"2024-09-15T22:46:41.634796+0000","last_fullsized":"2024-09-15T22:46:41.634796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:30.520261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624570+0000","last_change":"2024-09-15T22:46:41.624570+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624570+0000","last_undegraded":"2024-09-15T22:46:41.624570+0000","last_fullsized":"2024-09-15T22:46:41.624570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636612+0000","last_change":"2024-09-15T22:46:41.634748+0000","last_active":"2024-09-15T22:46:41.636612+0000","last_peered":"2024-09-15T22:46:41.636612+0000","last_clean":"2024-09-15T22:46:41.636612+0000","last_became_active":"2024-09-15T22:46:41.634461+0000","last_became_peered":"2024-09-15T22:46:41.634461+0000","last_unstale":"2024-09-15T22:46:41.636612+0000","last_undegraded":"2024-09-15T22:46:41.636612+0000","last_fullsized":"2024-09-15T22:46:41.636612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.418086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619123+0000","last_change":"2024-09-15T22:46:41.619123+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619123+0000","last_undegraded":"2024-09-15T22:46:41.619123+0000","last_fullsized":"2024-09-15T22:46:41.619123+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632076+0000","last_change":"2024-09-15T22:46:41.626980+0000","last_active":"2024-09-15T22:46:41.632076+0000","last_peered":"2024-09-15T22:46:41.632076+0000","last_clean":"2024-09-15T22:46:41.632076+0000","last_became_active":"2024-09-15T22:46:41.626709+0000","last_became_peered":"2024-09-15T22:46:41.626709+0000","last_unstale":"2024-09-15T22:46:41.632076+0000","last_undegraded":"2024-09-15T22:46:41.632076+0000","last_fullsized":"2024-09-15T22:46:41.632076+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:01.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619131+0000","last_change":"2024-09-15T22:46:41.619131+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619131+0000","last_undegraded":"2024-09-15T22:46:41.619131+0000","last_fullsized":"2024-09-15T22:46:41.619131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640491+0000","last_change":"2024-09-15T22:46:41.635999+0000","last_active":"2024-09-15T22:46:41.640491+0000","last_peered":"2024-09-15T22:46:41.640491+0000","last_clean":"2024-09-15T22:46:41.640491+0000","last_became_active":"2024-09-15T22:46:41.635675+0000","last_became_peered":"2024-09-15T22:46:41.635675+0000","last_unstale":"2024-09-15T22:46:41.640491+0000","last_undegraded":"2024-09-15T22:46:41.640491+0000","last_fullsized":"2024-09-15T22:46:41.640491+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:34.594050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.630349+0000","last_change":"2024-09-15T22:46:41.630349+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.630349+0000","last_undegraded":"2024-09-15T22:46:41.630349+0000","last_fullsized":"2024-09-15T22:46:41.630349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636347+0000","last_change":"2024-09-15T22:46:41.634008+0000","last_active":"2024-09-15T22:46:41.636347+0000","last_peered":"2024-09-15T22:46:41.636347+0000","last_clean":"2024-09-15T22:46:41.636347+0000","last_became_active":"2024-09-15T22:46:41.633721+0000","last_became_peered":"2024-09-15T22:46:41.633721+0000","last_unstale":"2024-09-15T22:46:41.636347+0000","last_undegraded":"2024-09-15T22:46:41.636347+0000","last_fullsized":"2024-09-15T22:46:41.636347+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:16.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624299+0000","last_change":"2024-09-15T22:46:41.624299+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624299+0000","last_undegraded":"2024-09-15T22:46:41.624299+0000","last_fullsized":"2024-09-15T22:46:41.624299+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.641269+0000","last_change":"2024-09-15T22:46:41.637476+0000","last_active":"2024-09-15T22:46:41.641269+0000","last_peered":"2024-09-15T22:46:41.641269+0000","last_clean":"2024-09-15T22:46:41.641269+0000","last_became_active":"2024-09-15T22:46:41.636964+0000","last_became_peered":"2024-09-15T22:46:41.636964+0000","last_unstale":"2024-09-15T22:46:41.641269+0000","last_undegraded":"2024-09-15T22:46:41.641269+0000","last_fullsized":"2024-09-15T22:46:41.641269+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:25.506971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624020+0000","last_change":"2024-09-15T22:46:41.624020+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624020+0000","last_undegraded":"2024-09-15T22:46:41.624020+0000","last_fullsized":"2024-09-15T22:46:41.624020+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634984+0000","last_change":"2024-09-15T22:46:41.630408+0000","last_active":"2024-09-15T22:46:41.634984+0000","last_peered":"2024-09-15T22:46:41.634984+0000","last_clean":"2024-09-15T22:46:41.634984+0000","last_became_active":"2024-09-15T22:46:41.630125+0000","last_became_peered":"2024-09-15T22:46:41.630125+0000","last_unstale":"2024-09-15T22:46:41.634984+0000","last_undegraded":"2024-09-15T22:46:41.634984+0000","last_fullsized":"2024-09-15T22:46:41.634984+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:06.035082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621170+0000","last_change":"2024-09-15T22:46:41.621170+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621170+0000","last_undegraded":"2024-09-15T22:46:41.621170+0000","last_fullsized":"2024-09-15T22:46:41.621170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636158+0000","last_change":"2024-09-15T22:46:41.635450+0000","last_active":"2024-09-15T22:46:41.636158+0000","last_peered":"2024-09-15T22:46:41.636158+0000","last_clean":"2024-09-15T22:46:41.636158+0000","last_became_active":"2024-09-15T22:46:41.635105+0000","last_became_peered":"2024-09-15T22:46:41.635105+0000","last_unstale":"2024-09-15T22:46:41.636158+0000","last_undegraded":"2024-09-15T22:46:41.636158+0000","last_fullsized":"2024-09-15T22:46:41.636158+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:06.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620613+0000","last_change":"2024-09-15T22:46:41.620613+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620613+0000","last_undegraded":"2024-09-15T22:46:41.620613+0000","last_fullsized":"2024-09-15T22:46:41.620613+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634315+0000","last_change":"2024-09-15T22:46:41.632765+0000","last_active":"2024-09-15T22:46:41.634315+0000","last_peered":"2024-09-15T22:46:41.634315+0000","last_clean":"2024-09-15T22:46:41.634315+0000","last_became_active":"2024-09-15T22:46:41.632486+0000","last_became_peered":"2024-09-15T22:46:41.632486+0000","last_unstale":"2024-09-15T22:46:41.634315+0000","last_undegraded":"2024-09-15T22:46:41.634315+0000","last_fullsized":"2024-09-15T22:46:41.634315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:00.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618774+0000","last_change":"2024-09-15T22:46:41.618774+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618774+0000","last_undegraded":"2024-09-15T22:46:41.618774+0000","last_fullsized":"2024-09-15T22:46:41.618774+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636178+0000","last_change":"2024-09-15T22:46:41.635456+0000","last_active":"2024-09-15T22:46:41.636178+0000","last_peered":"2024-09-15T22:46:41.636178+0000","last_clean":"2024-09-15T22:46:41.636178+0000","last_became_active":"2024-09-15T22:46:41.635135+0000","last_became_peered":"2024-09-15T22:46:41.635135+0000","last_unstale":"2024-09-15T22:46:41.636178+0000","last_undegraded":"2024-09-15T22:46:41.636178+0000","last_fullsized":"2024-09-15T22:46:41.636178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:23.028152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624040+0000","last_change":"2024-09-15T22:46:41.624040+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624040+0000","last_undegraded":"2024-09-15T22:46:41.624040+0000","last_fullsized":"2024-09-15T22:46:41.624040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634912+0000","last_change":"2024-09-15T22:46:41.631832+0000","last_active":"2024-09-15T22:46:41.634912+0000","last_peered":"2024-09-15T22:46:41.634912+0000","last_clean":"2024-09-15T22:46:41.634912+0000","last_became_active":"2024-09-15T22:46:41.631510+0000","last_became_peered":"2024-09-15T22:46:41.631510+0000","last_unstale":"2024-09-15T22:46:41.634912+0000","last_undegraded":"2024-09-15T22:46:41.634912+0000","last_fullsized":"2024-09-15T22:46:41.634912+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:05.137822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618710+0000","last_change":"2024-09-15T22:46:41.618710+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618710+0000","last_undegraded":"2024-09-15T22:46:41.618710+0000","last_fullsized":"2024-09-15T22:46:41.618710+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640377+0000","last_change":"2024-09-15T22:46:41.635616+0000","last_active":"2024-09-15T22:46:41.640377+0000","last_peered":"2024-09-15T22:46:41.640377+0000","last_clean":"2024-09-15T22:46:41.640377+0000","last_became_active":"2024-09-15T22:46:41.635280+0000","last_became_peered":"2024-09-15T22:46:41.635280+0000","last_unstale":"2024-09-15T22:46:41.640377+0000","last_undegraded":"2024-09-15T22:46:41.640377+0000","last_fullsized":"2024-09-15T22:46:41.640377+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:59.003178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.629896+0000","last_change":"2024-09-15T22:46:41.629896+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.629896+0000","last_undegraded":"2024-09-15T22:46:41.629896+0000","last_fullsized":"2024-09-15T22:46:41.629896+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634864+0000","last_change":"2024-09-15T22:46:41.629982+0000","last_active":"2024-09-15T22:46:41.634864+0000","last_peered":"2024-09-15T22:46:41.634864+0000","last_clean":"2024-09-15T22:46:41.634864+0000","last_became_active":"2024-09-15T22:46:41.629685+0000","last_became_peered":"2024-09-15T22:46:41.629685+0000","last_unstale":"2024-09-15T22:46:41.634864+0000","last_undegraded":"2024-09-15T22:46:41.634864+0000","last_fullsized":"2024-09-15T22:46:41.634864+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:58.816529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623916+0000","last_change":"2024-09-15T22:46:41.623916+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623916+0000","last_undegraded":"2024-09-15T22:46:41.623916+0000","last_fullsized":"2024-09-15T22:46:41.623916+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637755+0000","last_change":"2024-09-15T22:46:41.633318+0000","last_active":"2024-09-15T22:46:41.637755+0000","last_peered":"2024-09-15T22:46:41.637755+0000","last_clean":"2024-09-15T22:46:41.637755+0000","last_became_active":"2024-09-15T22:46:41.633029+0000","last_became_peered":"2024-09-15T22:46:41.633029+0000","last_unstale":"2024-09-15T22:46:41.637755+0000","last_undegraded":"2024-09-15T22:46:41.637755+0000","last_fullsized":"2024-09-15T22:46:41.637755+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:59.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621291+0000","last_change":"2024-09-15T22:46:41.621291+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621291+0000","last_undegraded":"2024-09-15T22:46:41.621291+0000","last_fullsized":"2024-09-15T22:46:41.621291+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640527+0000","last_change":"2024-09-15T22:46:41.637794+0000","last_active":"2024-09-15T22:46:41.640527+0000","last_peered":"2024-09-15T22:46:41.640527+0000","last_clean":"2024-09-15T22:46:41.640527+0000","last_became_active":"2024-09-15T22:46:41.637474+0000","last_became_peered":"2024-09-15T22:46:41.637474+0000","last_unstale":"2024-09-15T22:46:41.640527+0000","last_undegraded":"2024-09-15T22:46:41.640527+0000","last_fullsized":"2024-09-15T22:46:41.640527+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:45.038132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618785+0000","last_change":"2024-09-15T22:46:41.618785+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618785+0000","last_undegraded":"2024-09-15T22:46:41.618785+0000","last_fullsized":"2024-09-15T22:46:41.618785+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640452+0000","last_change":"2024-09-15T22:46:41.637018+0000","last_active":"2024-09-15T22:46:41.640452+0000","last_peered":"2024-09-15T22:46:41.640452+0000","last_clean":"2024-09-15T22:46:41.640452+0000","last_became_active":"2024-09-15T22:46:41.636696+0000","last_became_peered":"2024-09-15T22:46:41.636696+0000","last_unstale":"2024-09-15T22:46:41.640452+0000","last_undegraded":"2024-09-15T22:46:41.640452+0000","last_fullsized":"2024-09-15T22:46:41.640452+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:14.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624482+0000","last_change":"2024-09-15T22:46:41.624482+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624482+0000","last_undegraded":"2024-09-15T22:46:41.624482+0000","last_fullsized":"2024-09-15T22:46:41.624482+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.626926+0000","last_change":"2024-09-15T22:46:41.626298+0000","last_active":"2024-09-15T22:46:41.626926+0000","last_peered":"2024-09-15T22:46:41.626926+0000","last_clean":"2024-09-15T22:46:41.626926+0000","last_became_active":"2024-09-15T22:46:41.625885+0000","last_became_peered":"2024-09-15T22:46:41.625885+0000","last_unstale":"2024-09-15T22:46:41.626926+0000","last_undegraded":"2024-09-15T22:46:41.626926+0000","last_fullsized":"2024-09-15T22:46:41.626926+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:30.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631676+0000","last_change":"2024-09-15T22:46:41.631676+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631676+0000","last_undegraded":"2024-09-15T22:46:41.631676+0000","last_fullsized":"2024-09-15T22:46:41.631676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632643+0000","last_change":"2024-09-15T22:46:41.628608+0000","last_active":"2024-09-15T22:46:41.632643+0000","last_peered":"2024-09-15T22:46:41.632643+0000","last_clean":"2024-09-15T22:46:41.632643+0000","last_became_active":"2024-09-15T22:46:41.628339+0000","last_became_peered":"2024-09-15T22:46:41.628339+0000","last_unstale":"2024-09-15T22:46:41.632643+0000","last_undegraded":"2024-09-15T22:46:41.632643+0000","last_fullsized":"2024-09-15T22:46:41.632643+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:06.797079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632297+0000","last_change":"2024-09-15T22:46:41.632297+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632297+0000","last_undegraded":"2024-09-15T22:46:41.632297+0000","last_fullsized":"2024-09-15T22:46:41.632297+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638304+0000","last_change":"2024-09-15T22:46:41.635924+0000","last_active":"2024-09-15T22:46:41.638304+0000","last_peered":"2024-09-15T22:46:41.638304+0000","last_clean":"2024-09-15T22:46:41.638304+0000","last_became_active":"2024-09-15T22:46:41.635467+0000","last_became_peered":"2024-09-15T22:46:41.635467+0000","last_unstale":"2024-09-15T22:46:41.638304+0000","last_undegraded":"2024-09-15T22:46:41.638304+0000","last_fullsized":"2024-09-15T22:46:41.638304+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:36.930156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621917+0000","last_change":"2024-09-15T22:46:41.621917+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621917+0000","last_undegraded":"2024-09-15T22:46:41.621917+0000","last_fullsized":"2024-09-15T22:46:41.621917+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640507+0000","last_change":"2024-09-15T22:46:41.636005+0000","last_active":"2024-09-15T22:46:41.640507+0000","last_peered":"2024-09-15T22:46:41.640507+0000","last_clean":"2024-09-15T22:46:41.640507+0000","last_became_active":"2024-09-15T22:46:41.635611+0000","last_became_peered":"2024-09-15T22:46:41.635611+0000","last_unstale":"2024-09-15T22:46:41.640507+0000","last_undegraded":"2024-09-15T22:46:41.640507+0000","last_fullsized":"2024-09-15T22:46:41.640507+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:09.159745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619319+0000","last_change":"2024-09-15T22:46:41.619319+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619319+0000","last_undegraded":"2024-09-15T22:46:41.619319+0000","last_fullsized":"2024-09-15T22:46:41.619319+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.629613+0000","last_change":"2024-09-15T22:46:41.626572+0000","last_active":"2024-09-15T22:46:41.629613+0000","last_peered":"2024-09-15T22:46:41.629613+0000","last_clean":"2024-09-15T22:46:41.629613+0000","last_became_active":"2024-09-15T22:46:41.626269+0000","last_became_peered":"2024-09-15T22:46:41.626269+0000","last_unstale":"2024-09-15T22:46:41.629613+0000","last_undegraded":"2024-09-15T22:46:41.629613+0000","last_fullsized":"2024-09-15T22:46:41.629613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:17.611238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624540+0000","last_change":"2024-09-15T22:46:41.624540+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624540+0000","last_undegraded":"2024-09-15T22:46:41.624540+0000","last_fullsized":"2024-09-15T22:46:41.624540+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642265+0000","last_change":"2024-09-15T22:46:41.641080+0000","last_active":"2024-09-15T22:46:41.642265+0000","last_peered":"2024-09-15T22:46:41.642265+0000","last_clean":"2024-09-15T22:46:41.642265+0000","last_became_active":"2024-09-15T22:46:41.640738+0000","last_became_peered":"2024-09-15T22:46:41.640738+0000","last_unstale":"2024-09-15T22:46:41.642265+0000","last_undegraded":"2024-09-15T22:46:41.642265+0000","last_fullsized":"2024-09-15T22:46:41.642265+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:40.915323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":389,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.618371+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:46:41.618371+0000","last_peered":"2024-09-15T22:46:41.618371+0000","last_clean":"2024-09-15T22:46:41.618371+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:46:41.618371+0000","last_undegraded":"2024-09-15T22:46:41.618371+0000","last_fullsized":"2024-09-15T22:46:41.618371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33216,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338624,"statfs":{"total":96636764160,"available":96602750976,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:46:46.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:46:46.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.369+0000 7f5c2f98d640 1 Processor -- start 2024-09-15T22:46:46.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.369+0000 7f5c2f98d640 1 -- start start 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2f98d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c2815f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2f98d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c28162660 con 0x7f5c2815e3f0 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2f98d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c28162940 con 0x7f5c2806c2b0 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2f98d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c280b30d0 con 0x7f5c28162110 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2d729640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5c2815e3f0 0x7f5c2806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:39156/0 (socket says 172.21.15.134:39156) 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2d729640 1 -- 172.21.15.134:0/1820335536 learned_addr learned my addr 172.21.15.134:0/1820335536 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.370+0000 7f5c2df2a640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c2815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984901121 0 0) 0x7f5c28162660 con 0x7f5c2815e3f0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c10003520 con 0x7f5c2815e3f0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1160191647 0 0) 0x7f5c10003520 con 0x7f5c2815e3f0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 msgr2=0x7f5c2815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c2815f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 >> v1:172.21.15.177:6789/0 conn(0x7f5c2806c2b0 legacy=0x7f5c280b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c28162c20 con 0x7f5c2815e3f0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5c18001670 con 0x7f5c2815e3f0 2024-09-15T22:46:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 >> v1:172.21.15.134:6789/0 conn(0x7f5c2815e3f0 legacy=0x7f5c2806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c100039e0 0x7f5c10003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000ba70 con 0x7f5c100039e0 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000bc20 con 0x7f5c10004d40 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1000be20 con 0x7f5c28162110 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c100039e0 0x7f5c10003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2cf28640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2df2a640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 -- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 msgr2=0x7f5c10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28162110 0x7f5c10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 -- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c10004d40 msgr2=0x7f5c100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.371+0000 7f5c2d729640 1 -- 172.21.15.134:0/1820335536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10003520 con 0x7f5c100039e0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.372+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c100039e0 0x7f5c10003e00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c210 tx=0x7f5c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2258ca225d1a7a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.372+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18007cf0 con 0x7f5c100039e0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.372+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c18005af0 con 0x7f5c100039e0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.372+0000 7f5c27fff640 1 -- 172.21.15.134:0/1820335536 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18007070 con 0x7f5c100039e0 2024-09-15T22:46:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1820335536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c100039e0 msgr2=0x7f5c10003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1820335536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c100039e0 0x7f5c10003e00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c210 tx=0x7f5c10005830 comp rx=0 tx=0).stop 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2df2a640 1 -- 172.21.15.134:0/1820335536 reap_dead start 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1820335536 shutdown_connections 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1820335536 >> 172.21.15.134:0/1820335536 conn(0x7f5c2806ce90 msgr2=0x7f5c2806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1820335536 shutdown_connections 2024-09-15T22:46:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.373+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1820335536 wait complete. 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.374+0000 7f5c2f98d640 1 Processor -- start 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.374+0000 7f5c2f98d640 1 -- start start 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 0x7f5c28153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28155630 0x7f5c28155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2815e7d0 con 0x7f5c28152b60 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c280b0380 con 0x7f5c100039e0 2024-09-15T22:46:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2815e950 con 0x7f5c28155630 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38368/0 (socket says 172.21.15.134:38368) 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 -- 172.21.15.134:0/1441257596 learned_addr learned my addr 172.21.15.134:0/1441257596 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2cf28640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28155630 0x7f5c28155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 0x7f5c28153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 -- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28155630 msgr2=0x7f5c28155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28155630 0x7f5c28155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 -- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 msgr2=0x7f5c28153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 0x7f5c28153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 -- 172.21.15.134:0/1441257596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c280d0ba0 con 0x7f5c28152b60 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 0x7f5c28153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2df2a640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5c280b3e80 tx=0x7f5c2000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000fde0 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c20015430 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c28153520 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.375+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20015820 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.376+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c281564e0 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.377+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2815f5e0 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.377+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f5c200159c0 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.378+0000 7f5c25ffb640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 0x7f5c1406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.378+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f5c2008c910 con 0x7f5c28152b60 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.378+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 0x7f5c1406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.378+0000 7f5c2d729640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 0x7f5c1406eb60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c18032000 tx=0x7f5c18009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.382+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c20019030 con 0x7f5c28152b60 2024-09-15T22:46:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.542+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c280af8b0 con 0x7f5c1406c6a0 2024-09-15T22:46:46.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.548+0000 7f5c25ffb640 1 -- 172.21.15.134:0/1441257596 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247086 (secure 0 0 0) 0x7f5c280af8b0 con 0x7f5c1406c6a0 2024-09-15T22:46:46.553 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:46.554 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:46:46.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 msgr2=0x7f5c1406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 0x7f5c1406eb60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c18032000 tx=0x7f5c18009030 comp rx=0 tx=0).stop 2024-09-15T22:46:46.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 msgr2=0x7f5c28152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5c280b3e80 tx=0x7f5c2000f580 comp rx=0 tx=0).stop 2024-09-15T22:46:46.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 shutdown_connections 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5c1406c6a0 0x7f5c1406eb60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c28152b60 0x7f5c28152fe0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c28155630 0x7f5c28155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 --2- 172.21.15.134:0/1441257596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c100039e0 0x7f5c28153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 >> 172.21.15.134:0/1441257596 conn(0x7f5c2806ce90 msgr2=0x7f5c2806efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 shutdown_connections 2024-09-15T22:46:46.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.551+0000 7f5c2f98d640 1 -- 172.21.15.134:0/1441257596 wait complete. 2024-09-15T22:46:46.564 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-15T22:46:45.201610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262288,"kb_used_data":12760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712432,"statfs":{"total":773094113280,"available":772825530368,"internally_reserved":0,"allocated":13066240,"data_stored":6378436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589562"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623630+0000","last_change":"2024-09-15T22:46:41.623630+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623630+0000","last_undegraded":"2024-09-15T22:46:41.623630+0000","last_fullsized":"2024-09-15T22:46:41.623630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624933+0000","last_change":"2024-09-15T22:46:41.624933+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624933+0000","last_undegraded":"2024-09-15T22:46:41.624933+0000","last_fullsized":"2024-09-15T22:46:41.624933+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627512+0000","last_change":"2024-09-15T22:46:41.627512+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627512+0000","last_undegraded":"2024-09-15T22:46:41.627512+0000","last_fullsized":"2024-09-15T22:46:41.627512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623031+0000","last_change":"2024-09-15T22:46:41.623031+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623031+0000","last_undegraded":"2024-09-15T22:46:41.623031+0000","last_fullsized":"2024-09-15T22:46:41.623031+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625199+0000","last_change":"2024-09-15T22:46:41.625199+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625199+0000","last_undegraded":"2024-09-15T22:46:41.625199+0000","last_fullsized":"2024-09-15T22:46:41.625199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632064+0000","last_change":"2024-09-15T22:46:41.632064+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632064+0000","last_undegraded":"2024-09-15T22:46:41.632064+0000","last_fullsized":"2024-09-15T22:46:41.632064+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624746+0000","last_change":"2024-09-15T22:46:41.624746+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624746+0000","last_undegraded":"2024-09-15T22:46:41.624746+0000","last_fullsized":"2024-09-15T22:46:41.624746+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624619+0000","last_change":"2024-09-15T22:46:41.624619+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624619+0000","last_undegraded":"2024-09-15T22:46:41.624619+0000","last_fullsized":"2024-09-15T22:46:41.624619+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627104+0000","last_change":"2024-09-15T22:46:41.627104+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627104+0000","last_undegraded":"2024-09-15T22:46:41.627104+0000","last_fullsized":"2024-09-15T22:46:41.627104+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624494+0000","last_change":"2024-09-15T22:46:41.624494+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624494+0000","last_undegraded":"2024-09-15T22:46:41.624494+0000","last_fullsized":"2024-09-15T22:46:41.624494+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623333+0000","last_change":"2024-09-15T22:46:41.623333+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623333+0000","last_undegraded":"2024-09-15T22:46:41.623333+0000","last_fullsized":"2024-09-15T22:46:41.623333+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631652+0000","last_change":"2024-09-15T22:46:41.631652+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631652+0000","last_undegraded":"2024-09-15T22:46:41.631652+0000","last_fullsized":"2024-09-15T22:46:41.631652+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.622355+0000","last_change":"2024-09-15T22:46:41.622355+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.622355+0000","last_undegraded":"2024-09-15T22:46:41.622355+0000","last_fullsized":"2024-09-15T22:46:41.622355+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620816+0000","last_change":"2024-09-15T22:46:41.620816+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620816+0000","last_undegraded":"2024-09-15T22:46:41.620816+0000","last_fullsized":"2024-09-15T22:46:41.620816+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621924+0000","last_change":"2024-09-15T22:46:41.621924+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621924+0000","last_undegraded":"2024-09-15T22:46:41.621924+0000","last_fullsized":"2024-09-15T22:46:41.621924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619522+0000","last_change":"2024-09-15T22:46:41.619522+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619522+0000","last_undegraded":"2024-09-15T22:46:41.619522+0000","last_fullsized":"2024-09-15T22:46:41.619522+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.626218+0000","last_change":"2024-09-15T22:46:41.626218+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.626218+0000","last_undegraded":"2024-09-15T22:46:41.626218+0000","last_fullsized":"2024-09-15T22:46:41.626218+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624272+0000","last_change":"2024-09-15T22:46:41.624272+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624272+0000","last_undegraded":"2024-09-15T22:46:41.624272+0000","last_fullsized":"2024-09-15T22:46:41.624272+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621009+0000","last_change":"2024-09-15T22:46:41.621009+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621009+0000","last_undegraded":"2024-09-15T22:46:41.621009+0000","last_fullsized":"2024-09-15T22:46:41.621009+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627283+0000","last_change":"2024-09-15T22:46:41.627283+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627283+0000","last_undegraded":"2024-09-15T22:46:41.627283+0000","last_fullsized":"2024-09-15T22:46:41.627283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.633814+0000","last_change":"2024-09-15T22:46:41.633814+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.633814+0000","last_undegraded":"2024-09-15T22:46:41.633814+0000","last_fullsized":"2024-09-15T22:46:41.633814+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619661+0000","last_change":"2024-09-15T22:46:41.619661+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619661+0000","last_undegraded":"2024-09-15T22:46:41.619661+0000","last_fullsized":"2024-09-15T22:46:41.619661+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625865+0000","last_change":"2024-09-15T22:46:41.625865+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625865+0000","last_undegraded":"2024-09-15T22:46:41.625865+0000","last_fullsized":"2024-09-15T22:46:41.625865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623783+0000","last_change":"2024-09-15T22:46:41.623783+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623783+0000","last_undegraded":"2024-09-15T22:46:41.623783+0000","last_fullsized":"2024-09-15T22:46:41.623783+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623730+0000","last_change":"2024-09-15T22:46:41.623730+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623730+0000","last_undegraded":"2024-09-15T22:46:41.623730+0000","last_fullsized":"2024-09-15T22:46:41.623730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621527+0000","last_change":"2024-09-15T22:46:41.621527+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621527+0000","last_undegraded":"2024-09-15T22:46:41.621527+0000","last_fullsized":"2024-09-15T22:46:41.621527+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618559+0000","last_change":"2024-09-15T22:46:41.618559+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618559+0000","last_undegraded":"2024-09-15T22:46:41.618559+0000","last_fullsized":"2024-09-15T22:46:41.618559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625532+0000","last_change":"2024-09-15T22:46:41.625532+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625532+0000","last_undegraded":"2024-09-15T22:46:41.625532+0000","last_fullsized":"2024-09-15T22:46:41.625532+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621351+0000","last_change":"2024-09-15T22:46:41.621351+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621351+0000","last_undegraded":"2024-09-15T22:46:41.621351+0000","last_fullsized":"2024-09-15T22:46:41.621351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619245+0000","last_change":"2024-09-15T22:46:41.619245+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619245+0000","last_undegraded":"2024-09-15T22:46:41.619245+0000","last_fullsized":"2024-09-15T22:46:41.619245+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625026+0000","last_change":"2024-09-15T22:46:41.625026+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625026+0000","last_undegraded":"2024-09-15T22:46:41.625026+0000","last_fullsized":"2024-09-15T22:46:41.625026+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625531+0000","last_change":"2024-09-15T22:46:41.625531+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625531+0000","last_undegraded":"2024-09-15T22:46:41.625531+0000","last_fullsized":"2024-09-15T22:46:41.625531+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619576+0000","last_change":"2024-09-15T22:46:41.619576+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619576+0000","last_undegraded":"2024-09-15T22:46:41.619576+0000","last_fullsized":"2024-09-15T22:46:41.619576+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634548+0000","last_change":"2024-09-15T22:46:41.633396+0000","last_active":"2024-09-15T22:46:41.634548+0000","last_peered":"2024-09-15T22:46:41.634548+0000","last_clean":"2024-09-15T22:46:41.634548+0000","last_became_active":"2024-09-15T22:46:41.632887+0000","last_became_peered":"2024-09-15T22:46:41.632887+0000","last_unstale":"2024-09-15T22:46:41.634548+0000","last_undegraded":"2024-09-15T22:46:41.634548+0000","last_fullsized":"2024-09-15T22:46:41.634548+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:27.587484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625449+0000","last_change":"2024-09-15T22:46:41.625449+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625449+0000","last_undegraded":"2024-09-15T22:46:41.625449+0000","last_fullsized":"2024-09-15T22:46:41.625449+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638511+0000","last_change":"2024-09-15T22:46:41.637052+0000","last_active":"2024-09-15T22:46:41.638511+0000","last_peered":"2024-09-15T22:46:41.638511+0000","last_clean":"2024-09-15T22:46:41.638511+0000","last_became_active":"2024-09-15T22:46:41.636779+0000","last_became_peered":"2024-09-15T22:46:41.636779+0000","last_unstale":"2024-09-15T22:46:41.638511+0000","last_undegraded":"2024-09-15T22:46:41.638511+0000","last_fullsized":"2024-09-15T22:46:41.638511+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:30.820869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625005+0000","last_change":"2024-09-15T22:46:41.625005+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625005+0000","last_undegraded":"2024-09-15T22:46:41.625005+0000","last_fullsized":"2024-09-15T22:46:41.625005+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634913+0000","last_change":"2024-09-15T22:46:41.630313+0000","last_active":"2024-09-15T22:46:41.634913+0000","last_peered":"2024-09-15T22:46:41.634913+0000","last_clean":"2024-09-15T22:46:41.634913+0000","last_became_active":"2024-09-15T22:46:41.629752+0000","last_became_peered":"2024-09-15T22:46:41.629752+0000","last_unstale":"2024-09-15T22:46:41.634913+0000","last_undegraded":"2024-09-15T22:46:41.634913+0000","last_fullsized":"2024-09-15T22:46:41.634913+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:12.837921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631279+0000","last_change":"2024-09-15T22:46:41.631279+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631279+0000","last_undegraded":"2024-09-15T22:46:41.631279+0000","last_fullsized":"2024-09-15T22:46:41.631279+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637753+0000","last_change":"2024-09-15T22:46:41.633208+0000","last_active":"2024-09-15T22:46:41.637753+0000","last_peered":"2024-09-15T22:46:41.637753+0000","last_clean":"2024-09-15T22:46:41.637753+0000","last_became_active":"2024-09-15T22:46:41.632913+0000","last_became_peered":"2024-09-15T22:46:41.632913+0000","last_unstale":"2024-09-15T22:46:41.637753+0000","last_undegraded":"2024-09-15T22:46:41.637753+0000","last_fullsized":"2024-09-15T22:46:41.637753+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:56.346187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623188+0000","last_change":"2024-09-15T22:46:41.623188+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623188+0000","last_undegraded":"2024-09-15T22:46:41.623188+0000","last_fullsized":"2024-09-15T22:46:41.623188+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632618+0000","last_change":"2024-09-15T22:46:41.625300+0000","last_active":"2024-09-15T22:46:41.632618+0000","last_peered":"2024-09-15T22:46:41.632618+0000","last_clean":"2024-09-15T22:46:41.632618+0000","last_became_active":"2024-09-15T22:46:41.624984+0000","last_became_peered":"2024-09-15T22:46:41.624984+0000","last_unstale":"2024-09-15T22:46:41.632618+0000","last_undegraded":"2024-09-15T22:46:41.632618+0000","last_fullsized":"2024-09-15T22:46:41.632618+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.020034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632655+0000","last_change":"2024-09-15T22:46:41.632655+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632655+0000","last_undegraded":"2024-09-15T22:46:41.632655+0000","last_fullsized":"2024-09-15T22:46:41.632655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637735+0000","last_change":"2024-09-15T22:46:41.632960+0000","last_active":"2024-09-15T22:46:41.637735+0000","last_peered":"2024-09-15T22:46:41.637735+0000","last_clean":"2024-09-15T22:46:41.637735+0000","last_became_active":"2024-09-15T22:46:41.632657+0000","last_became_peered":"2024-09-15T22:46:41.632657+0000","last_unstale":"2024-09-15T22:46:41.637735+0000","last_undegraded":"2024-09-15T22:46:41.637735+0000","last_fullsized":"2024-09-15T22:46:41.637735+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.686133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631250+0000","last_change":"2024-09-15T22:46:41.631250+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631250+0000","last_undegraded":"2024-09-15T22:46:41.631250+0000","last_fullsized":"2024-09-15T22:46:41.631250+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.631923+0000","last_change":"2024-09-15T22:46:41.629042+0000","last_active":"2024-09-15T22:46:41.631923+0000","last_peered":"2024-09-15T22:46:41.631923+0000","last_clean":"2024-09-15T22:46:41.631923+0000","last_became_active":"2024-09-15T22:46:41.628771+0000","last_became_peered":"2024-09-15T22:46:41.628771+0000","last_unstale":"2024-09-15T22:46:41.631923+0000","last_undegraded":"2024-09-15T22:46:41.631923+0000","last_fullsized":"2024-09-15T22:46:41.631923+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:16.367659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620302+0000","last_change":"2024-09-15T22:46:41.620302+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620302+0000","last_undegraded":"2024-09-15T22:46:41.620302+0000","last_fullsized":"2024-09-15T22:46:41.620302+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632468+0000","last_change":"2024-09-15T22:46:41.629205+0000","last_active":"2024-09-15T22:46:41.632468+0000","last_peered":"2024-09-15T22:46:41.632468+0000","last_clean":"2024-09-15T22:46:41.632468+0000","last_became_active":"2024-09-15T22:46:41.628999+0000","last_became_peered":"2024-09-15T22:46:41.628999+0000","last_unstale":"2024-09-15T22:46:41.632468+0000","last_undegraded":"2024-09-15T22:46:41.632468+0000","last_fullsized":"2024-09-15T22:46:41.632468+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:19.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620632+0000","last_change":"2024-09-15T22:46:41.620632+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620632+0000","last_undegraded":"2024-09-15T22:46:41.620632+0000","last_fullsized":"2024-09-15T22:46:41.620632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642260+0000","last_change":"2024-09-15T22:46:41.641108+0000","last_active":"2024-09-15T22:46:41.642260+0000","last_peered":"2024-09-15T22:46:41.642260+0000","last_clean":"2024-09-15T22:46:41.642260+0000","last_became_active":"2024-09-15T22:46:41.640839+0000","last_became_peered":"2024-09-15T22:46:41.640839+0000","last_unstale":"2024-09-15T22:46:41.642260+0000","last_undegraded":"2024-09-15T22:46:41.642260+0000","last_fullsized":"2024-09-15T22:46:41.642260+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:47.007958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.625071+0000","last_change":"2024-09-15T22:46:41.625071+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.625071+0000","last_undegraded":"2024-09-15T22:46:41.625071+0000","last_fullsized":"2024-09-15T22:46:41.625071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632205+0000","last_change":"2024-09-15T22:46:41.628614+0000","last_active":"2024-09-15T22:46:41.632205+0000","last_peered":"2024-09-15T22:46:41.632205+0000","last_clean":"2024-09-15T22:46:41.632205+0000","last_became_active":"2024-09-15T22:46:41.628338+0000","last_became_peered":"2024-09-15T22:46:41.628338+0000","last_unstale":"2024-09-15T22:46:41.632205+0000","last_undegraded":"2024-09-15T22:46:41.632205+0000","last_fullsized":"2024-09-15T22:46:41.632205+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:42.231798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.627788+0000","last_change":"2024-09-15T22:46:41.627788+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.627788+0000","last_undegraded":"2024-09-15T22:46:41.627788+0000","last_fullsized":"2024-09-15T22:46:41.627788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634796+0000","last_change":"2024-09-15T22:46:41.633198+0000","last_active":"2024-09-15T22:46:41.634796+0000","last_peered":"2024-09-15T22:46:41.634796+0000","last_clean":"2024-09-15T22:46:41.634796+0000","last_became_active":"2024-09-15T22:46:41.632937+0000","last_became_peered":"2024-09-15T22:46:41.632937+0000","last_unstale":"2024-09-15T22:46:41.634796+0000","last_undegraded":"2024-09-15T22:46:41.634796+0000","last_fullsized":"2024-09-15T22:46:41.634796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:30.520261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624570+0000","last_change":"2024-09-15T22:46:41.624570+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624570+0000","last_undegraded":"2024-09-15T22:46:41.624570+0000","last_fullsized":"2024-09-15T22:46:41.624570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636612+0000","last_change":"2024-09-15T22:46:41.634748+0000","last_active":"2024-09-15T22:46:41.636612+0000","last_peered":"2024-09-15T22:46:41.636612+0000","last_clean":"2024-09-15T22:46:41.636612+0000","last_became_active":"2024-09-15T22:46:41.634461+0000","last_became_peered":"2024-09-15T22:46:41.634461+0000","last_unstale":"2024-09-15T22:46:41.636612+0000","last_undegraded":"2024-09-15T22:46:41.636612+0000","last_fullsized":"2024-09-15T22:46:41.636612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.418086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619123+0000","last_change":"2024-09-15T22:46:41.619123+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619123+0000","last_undegraded":"2024-09-15T22:46:41.619123+0000","last_fullsized":"2024-09-15T22:46:41.619123+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632076+0000","last_change":"2024-09-15T22:46:41.626980+0000","last_active":"2024-09-15T22:46:41.632076+0000","last_peered":"2024-09-15T22:46:41.632076+0000","last_clean":"2024-09-15T22:46:41.632076+0000","last_became_active":"2024-09-15T22:46:41.626709+0000","last_became_peered":"2024-09-15T22:46:41.626709+0000","last_unstale":"2024-09-15T22:46:41.632076+0000","last_undegraded":"2024-09-15T22:46:41.632076+0000","last_fullsized":"2024-09-15T22:46:41.632076+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:01.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619131+0000","last_change":"2024-09-15T22:46:41.619131+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619131+0000","last_undegraded":"2024-09-15T22:46:41.619131+0000","last_fullsized":"2024-09-15T22:46:41.619131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640491+0000","last_change":"2024-09-15T22:46:41.635999+0000","last_active":"2024-09-15T22:46:41.640491+0000","last_peered":"2024-09-15T22:46:41.640491+0000","last_clean":"2024-09-15T22:46:41.640491+0000","last_became_active":"2024-09-15T22:46:41.635675+0000","last_became_peered":"2024-09-15T22:46:41.635675+0000","last_unstale":"2024-09-15T22:46:41.640491+0000","last_undegraded":"2024-09-15T22:46:41.640491+0000","last_fullsized":"2024-09-15T22:46:41.640491+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:34.594050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.630349+0000","last_change":"2024-09-15T22:46:41.630349+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.630349+0000","last_undegraded":"2024-09-15T22:46:41.630349+0000","last_fullsized":"2024-09-15T22:46:41.630349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636347+0000","last_change":"2024-09-15T22:46:41.634008+0000","last_active":"2024-09-15T22:46:41.636347+0000","last_peered":"2024-09-15T22:46:41.636347+0000","last_clean":"2024-09-15T22:46:41.636347+0000","last_became_active":"2024-09-15T22:46:41.633721+0000","last_became_peered":"2024-09-15T22:46:41.633721+0000","last_unstale":"2024-09-15T22:46:41.636347+0000","last_undegraded":"2024-09-15T22:46:41.636347+0000","last_fullsized":"2024-09-15T22:46:41.636347+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:16.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624299+0000","last_change":"2024-09-15T22:46:41.624299+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624299+0000","last_undegraded":"2024-09-15T22:46:41.624299+0000","last_fullsized":"2024-09-15T22:46:41.624299+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.641269+0000","last_change":"2024-09-15T22:46:41.637476+0000","last_active":"2024-09-15T22:46:41.641269+0000","last_peered":"2024-09-15T22:46:41.641269+0000","last_clean":"2024-09-15T22:46:41.641269+0000","last_became_active":"2024-09-15T22:46:41.636964+0000","last_became_peered":"2024-09-15T22:46:41.636964+0000","last_unstale":"2024-09-15T22:46:41.641269+0000","last_undegraded":"2024-09-15T22:46:41.641269+0000","last_fullsized":"2024-09-15T22:46:41.641269+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:25.506971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624020+0000","last_change":"2024-09-15T22:46:41.624020+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624020+0000","last_undegraded":"2024-09-15T22:46:41.624020+0000","last_fullsized":"2024-09-15T22:46:41.624020+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634984+0000","last_change":"2024-09-15T22:46:41.630408+0000","last_active":"2024-09-15T22:46:41.634984+0000","last_peered":"2024-09-15T22:46:41.634984+0000","last_clean":"2024-09-15T22:46:41.634984+0000","last_became_active":"2024-09-15T22:46:41.630125+0000","last_became_peered":"2024-09-15T22:46:41.630125+0000","last_unstale":"2024-09-15T22:46:41.634984+0000","last_undegraded":"2024-09-15T22:46:41.634984+0000","last_fullsized":"2024-09-15T22:46:41.634984+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:06.035082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621170+0000","last_change":"2024-09-15T22:46:41.621170+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621170+0000","last_undegraded":"2024-09-15T22:46:41.621170+0000","last_fullsized":"2024-09-15T22:46:41.621170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636158+0000","last_change":"2024-09-15T22:46:41.635450+0000","last_active":"2024-09-15T22:46:41.636158+0000","last_peered":"2024-09-15T22:46:41.636158+0000","last_clean":"2024-09-15T22:46:41.636158+0000","last_became_active":"2024-09-15T22:46:41.635105+0000","last_became_peered":"2024-09-15T22:46:41.635105+0000","last_unstale":"2024-09-15T22:46:41.636158+0000","last_undegraded":"2024-09-15T22:46:41.636158+0000","last_fullsized":"2024-09-15T22:46:41.636158+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:06.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.620613+0000","last_change":"2024-09-15T22:46:41.620613+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.620613+0000","last_undegraded":"2024-09-15T22:46:41.620613+0000","last_fullsized":"2024-09-15T22:46:41.620613+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634315+0000","last_change":"2024-09-15T22:46:41.632765+0000","last_active":"2024-09-15T22:46:41.634315+0000","last_peered":"2024-09-15T22:46:41.634315+0000","last_clean":"2024-09-15T22:46:41.634315+0000","last_became_active":"2024-09-15T22:46:41.632486+0000","last_became_peered":"2024-09-15T22:46:41.632486+0000","last_unstale":"2024-09-15T22:46:41.634315+0000","last_undegraded":"2024-09-15T22:46:41.634315+0000","last_fullsized":"2024-09-15T22:46:41.634315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:00.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618774+0000","last_change":"2024-09-15T22:46:41.618774+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618774+0000","last_undegraded":"2024-09-15T22:46:41.618774+0000","last_fullsized":"2024-09-15T22:46:41.618774+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.636178+0000","last_change":"2024-09-15T22:46:41.635456+0000","last_active":"2024-09-15T22:46:41.636178+0000","last_peered":"2024-09-15T22:46:41.636178+0000","last_clean":"2024-09-15T22:46:41.636178+0000","last_became_active":"2024-09-15T22:46:41.635135+0000","last_became_peered":"2024-09-15T22:46:41.635135+0000","last_unstale":"2024-09-15T22:46:41.636178+0000","last_undegraded":"2024-09-15T22:46:41.636178+0000","last_fullsized":"2024-09-15T22:46:41.636178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:23.028152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624040+0000","last_change":"2024-09-15T22:46:41.624040+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624040+0000","last_undegraded":"2024-09-15T22:46:41.624040+0000","last_fullsized":"2024-09-15T22:46:41.624040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634912+0000","last_change":"2024-09-15T22:46:41.631832+0000","last_active":"2024-09-15T22:46:41.634912+0000","last_peered":"2024-09-15T22:46:41.634912+0000","last_clean":"2024-09-15T22:46:41.634912+0000","last_became_active":"2024-09-15T22:46:41.631510+0000","last_became_peered":"2024-09-15T22:46:41.631510+0000","last_unstale":"2024-09-15T22:46:41.634912+0000","last_undegraded":"2024-09-15T22:46:41.634912+0000","last_fullsized":"2024-09-15T22:46:41.634912+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:05.137822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618710+0000","last_change":"2024-09-15T22:46:41.618710+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618710+0000","last_undegraded":"2024-09-15T22:46:41.618710+0000","last_fullsized":"2024-09-15T22:46:41.618710+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640377+0000","last_change":"2024-09-15T22:46:41.635616+0000","last_active":"2024-09-15T22:46:41.640377+0000","last_peered":"2024-09-15T22:46:41.640377+0000","last_clean":"2024-09-15T22:46:41.640377+0000","last_became_active":"2024-09-15T22:46:41.635280+0000","last_became_peered":"2024-09-15T22:46:41.635280+0000","last_unstale":"2024-09-15T22:46:41.640377+0000","last_undegraded":"2024-09-15T22:46:41.640377+0000","last_fullsized":"2024-09-15T22:46:41.640377+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:59.003178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.629896+0000","last_change":"2024-09-15T22:46:41.629896+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.629896+0000","last_undegraded":"2024-09-15T22:46:41.629896+0000","last_fullsized":"2024-09-15T22:46:41.629896+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.634864+0000","last_change":"2024-09-15T22:46:41.629982+0000","last_active":"2024-09-15T22:46:41.634864+0000","last_peered":"2024-09-15T22:46:41.634864+0000","last_clean":"2024-09-15T22:46:41.634864+0000","last_became_active":"2024-09-15T22:46:41.629685+0000","last_became_peered":"2024-09-15T22:46:41.629685+0000","last_unstale":"2024-09-15T22:46:41.634864+0000","last_undegraded":"2024-09-15T22:46:41.634864+0000","last_fullsized":"2024-09-15T22:46:41.634864+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:58.816529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.623916+0000","last_change":"2024-09-15T22:46:41.623916+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.623916+0000","last_undegraded":"2024-09-15T22:46:41.623916+0000","last_fullsized":"2024-09-15T22:46:41.623916+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.637755+0000","last_change":"2024-09-15T22:46:41.633318+0000","last_active":"2024-09-15T22:46:41.637755+0000","last_peered":"2024-09-15T22:46:41.637755+0000","last_clean":"2024-09-15T22:46:41.637755+0000","last_became_active":"2024-09-15T22:46:41.633029+0000","last_became_peered":"2024-09-15T22:46:41.633029+0000","last_unstale":"2024-09-15T22:46:41.637755+0000","last_undegraded":"2024-09-15T22:46:41.637755+0000","last_fullsized":"2024-09-15T22:46:41.637755+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:59.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621291+0000","last_change":"2024-09-15T22:46:41.621291+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621291+0000","last_undegraded":"2024-09-15T22:46:41.621291+0000","last_fullsized":"2024-09-15T22:46:41.621291+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640527+0000","last_change":"2024-09-15T22:46:41.637794+0000","last_active":"2024-09-15T22:46:41.640527+0000","last_peered":"2024-09-15T22:46:41.640527+0000","last_clean":"2024-09-15T22:46:41.640527+0000","last_became_active":"2024-09-15T22:46:41.637474+0000","last_became_peered":"2024-09-15T22:46:41.637474+0000","last_unstale":"2024-09-15T22:46:41.640527+0000","last_undegraded":"2024-09-15T22:46:41.640527+0000","last_fullsized":"2024-09-15T22:46:41.640527+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:45.038132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.618785+0000","last_change":"2024-09-15T22:46:41.618785+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.618785+0000","last_undegraded":"2024-09-15T22:46:41.618785+0000","last_fullsized":"2024-09-15T22:46:41.618785+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640452+0000","last_change":"2024-09-15T22:46:41.637018+0000","last_active":"2024-09-15T22:46:41.640452+0000","last_peered":"2024-09-15T22:46:41.640452+0000","last_clean":"2024-09-15T22:46:41.640452+0000","last_became_active":"2024-09-15T22:46:41.636696+0000","last_became_peered":"2024-09-15T22:46:41.636696+0000","last_unstale":"2024-09-15T22:46:41.640452+0000","last_undegraded":"2024-09-15T22:46:41.640452+0000","last_fullsized":"2024-09-15T22:46:41.640452+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:14.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624482+0000","last_change":"2024-09-15T22:46:41.624482+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624482+0000","last_undegraded":"2024-09-15T22:46:41.624482+0000","last_fullsized":"2024-09-15T22:46:41.624482+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.626926+0000","last_change":"2024-09-15T22:46:41.626298+0000","last_active":"2024-09-15T22:46:41.626926+0000","last_peered":"2024-09-15T22:46:41.626926+0000","last_clean":"2024-09-15T22:46:41.626926+0000","last_became_active":"2024-09-15T22:46:41.625885+0000","last_became_peered":"2024-09-15T22:46:41.625885+0000","last_unstale":"2024-09-15T22:46:41.626926+0000","last_undegraded":"2024-09-15T22:46:41.626926+0000","last_fullsized":"2024-09-15T22:46:41.626926+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:30.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.631676+0000","last_change":"2024-09-15T22:46:41.631676+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.631676+0000","last_undegraded":"2024-09-15T22:46:41.631676+0000","last_fullsized":"2024-09-15T22:46:41.631676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.632643+0000","last_change":"2024-09-15T22:46:41.628608+0000","last_active":"2024-09-15T22:46:41.632643+0000","last_peered":"2024-09-15T22:46:41.632643+0000","last_clean":"2024-09-15T22:46:41.632643+0000","last_became_active":"2024-09-15T22:46:41.628339+0000","last_became_peered":"2024-09-15T22:46:41.628339+0000","last_unstale":"2024-09-15T22:46:41.632643+0000","last_undegraded":"2024-09-15T22:46:41.632643+0000","last_fullsized":"2024-09-15T22:46:41.632643+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:06.797079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.632297+0000","last_change":"2024-09-15T22:46:41.632297+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.632297+0000","last_undegraded":"2024-09-15T22:46:41.632297+0000","last_fullsized":"2024-09-15T22:46:41.632297+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.638304+0000","last_change":"2024-09-15T22:46:41.635924+0000","last_active":"2024-09-15T22:46:41.638304+0000","last_peered":"2024-09-15T22:46:41.638304+0000","last_clean":"2024-09-15T22:46:41.638304+0000","last_became_active":"2024-09-15T22:46:41.635467+0000","last_became_peered":"2024-09-15T22:46:41.635467+0000","last_unstale":"2024-09-15T22:46:41.638304+0000","last_undegraded":"2024-09-15T22:46:41.638304+0000","last_fullsized":"2024-09-15T22:46:41.638304+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:36.930156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.621917+0000","last_change":"2024-09-15T22:46:41.621917+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.621917+0000","last_undegraded":"2024-09-15T22:46:41.621917+0000","last_fullsized":"2024-09-15T22:46:41.621917+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.640507+0000","last_change":"2024-09-15T22:46:41.636005+0000","last_active":"2024-09-15T22:46:41.640507+0000","last_peered":"2024-09-15T22:46:41.640507+0000","last_clean":"2024-09-15T22:46:41.640507+0000","last_became_active":"2024-09-15T22:46:41.635611+0000","last_became_peered":"2024-09-15T22:46:41.635611+0000","last_unstale":"2024-09-15T22:46:41.640507+0000","last_undegraded":"2024-09-15T22:46:41.640507+0000","last_fullsized":"2024-09-15T22:46:41.640507+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:09.159745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.619319+0000","last_change":"2024-09-15T22:46:41.619319+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.619319+0000","last_undegraded":"2024-09-15T22:46:41.619319+0000","last_fullsized":"2024-09-15T22:46:41.619319+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.629613+0000","last_change":"2024-09-15T22:46:41.626572+0000","last_active":"2024-09-15T22:46:41.629613+0000","last_peered":"2024-09-15T22:46:41.629613+0000","last_clean":"2024-09-15T22:46:41.629613+0000","last_became_active":"2024-09-15T22:46:41.626269+0000","last_became_peered":"2024-09-15T22:46:41.626269+0000","last_unstale":"2024-09-15T22:46:41.629613+0000","last_undegraded":"2024-09-15T22:46:41.629613+0000","last_fullsized":"2024-09-15T22:46:41.629613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:17.611238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2024-09-15T22:46:41.624540+0000","last_change":"2024-09-15T22:46:41.624540+0000","last_active":"2024-09-15T22:46:41.610520+0000","last_peered":"2024-09-15T22:46:41.610520+0000","last_clean":"2024-09-15T22:46:41.610520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:46:41.624540+0000","last_undegraded":"2024-09-15T22:46:41.624540+0000","last_fullsized":"2024-09-15T22:46:41.624540+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.642265+0000","last_change":"2024-09-15T22:46:41.641080+0000","last_active":"2024-09-15T22:46:41.642265+0000","last_peered":"2024-09-15T22:46:41.642265+0000","last_clean":"2024-09-15T22:46:41.642265+0000","last_became_active":"2024-09-15T22:46:41.640738+0000","last_became_peered":"2024-09-15T22:46:41.640738+0000","last_unstale":"2024-09-15T22:46:41.642265+0000","last_undegraded":"2024-09-15T22:46:41.642265+0000","last_fullsized":"2024-09-15T22:46:41.642265+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:40.915323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":389,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-15T22:46:41.618371+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:46:41.618371+0000","last_peered":"2024-09-15T22:46:41.618371+0000","last_clean":"2024-09-15T22:46:41.618371+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:46:41.618371+0000","last_undegraded":"2024-09-15T22:46:41.618371+0000","last_fullsized":"2024-09-15T22:46:41.618371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1490944,"data_stored":652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33216,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338624,"statfs":{"total":96636764160,"available":96602750976,"internally_reserved":0,"allocated":2072576,"data_stored":1236929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1478656,"data_stored":646561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:46:46.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-15T22:46:46.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623630+0000', 'last_change': '2024-09-15T22:46:41.623630+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623630+0000', 'last_undegraded': '2024-09-15T22:46:41.623630+0000', 'last_fullsized': '2024-09-15T22:46:41.623630+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624933+0000', 'last_change': '2024-09-15T22:46:41.624933+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624933+0000', 'last_undegraded': '2024-09-15T22:46:41.624933+0000', 'last_fullsized': '2024-09-15T22:46:41.624933+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.627512+0000', 'last_change': '2024-09-15T22:46:41.627512+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.627512+0000', 'last_undegraded': '2024-09-15T22:46:41.627512+0000', 'last_fullsized': '2024-09-15T22:46:41.627512+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623031+0000', 'last_change': '2024-09-15T22:46:41.623031+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623031+0000', 'last_undegraded': '2024-09-15T22:46:41.623031+0000', 'last_fullsized': '2024-09-15T22:46:41.623031+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:46:46.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625199+0000', 'last_change': '2024-09-15T22:46:41.625199+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625199+0000', 'last_undegraded': '2024-09-15T22:46:41.625199+0000', 'last_fullsized': '2024-09-15T22:46:41.625199+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.632064+0000', 'last_change': '2024-09-15T22:46:41.632064+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.632064+0000', 'last_undegraded': '2024-09-15T22:46:41.632064+0000', 'last_fullsized': '2024-09-15T22:46:41.632064+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624746+0000', 'last_change': '2024-09-15T22:46:41.624746+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624746+0000', 'last_undegraded': '2024-09-15T22:46:41.624746+0000', 'last_fullsized': '2024-09-15T22:46:41.624746+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624619+0000', 'last_change': '2024-09-15T22:46:41.624619+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624619+0000', 'last_undegraded': '2024-09-15T22:46:41.624619+0000', 'last_fullsized': '2024-09-15T22:46:41.624619+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.627104+0000', 'last_change': '2024-09-15T22:46:41.627104+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.627104+0000', 'last_undegraded': '2024-09-15T22:46:41.627104+0000', 'last_fullsized': '2024-09-15T22:46:41.627104+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624494+0000', 'last_change': '2024-09-15T22:46:41.624494+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624494+0000', 'last_undegraded': '2024-09-15T22:46:41.624494+0000', 'last_fullsized': '2024-09-15T22:46:41.624494+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623333+0000', 'last_change': '2024-09-15T22:46:41.623333+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623333+0000', 'last_undegraded': '2024-09-15T22:46:41.623333+0000', 'last_fullsized': '2024-09-15T22:46:41.623333+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.631652+0000', 'last_change': '2024-09-15T22:46:41.631652+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.631652+0000', 'last_undegraded': '2024-09-15T22:46:41.631652+0000', 'last_fullsized': '2024-09-15T22:46:41.631652+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.622355+0000', 'last_change': '2024-09-15T22:46:41.622355+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.622355+0000', 'last_undegraded': '2024-09-15T22:46:41.622355+0000', 'last_fullsized': '2024-09-15T22:46:41.622355+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-15T22:46:46.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.620816+0000', 'last_change': '2024-09-15T22:46:41.620816+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.620816+0000', 'last_undegraded': '2024-09-15T22:46:41.620816+0000', 'last_fullsized': '2024-09-15T22:46:41.620816+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621924+0000', 'last_change': '2024-09-15T22:46:41.621924+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621924+0000', 'last_undegraded': '2024-09-15T22:46:41.621924+0000', 'last_fullsized': '2024-09-15T22:46:41.621924+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619522+0000', 'last_change': '2024-09-15T22:46:41.619522+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619522+0000', 'last_undegraded': '2024-09-15T22:46:41.619522+0000', 'last_fullsized': '2024-09-15T22:46:41.619522+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.626218+0000', 'last_change': '2024-09-15T22:46:41.626218+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.626218+0000', 'last_undegraded': '2024-09-15T22:46:41.626218+0000', 'last_fullsized': '2024-09-15T22:46:41.626218+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-15T22:46:46.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624272+0000', 'last_change': '2024-09-15T22:46:41.624272+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624272+0000', 'last_undegraded': '2024-09-15T22:46:41.624272+0000', 'last_fullsized': '2024-09-15T22:46:41.624272+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-15T22:46:46.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621009+0000', 'last_change': '2024-09-15T22:46:41.621009+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621009+0000', 'last_undegraded': '2024-09-15T22:46:41.621009+0000', 'last_fullsized': '2024-09-15T22:46:41.621009+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-15T22:46:46.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.627283+0000', 'last_change': '2024-09-15T22:46:41.627283+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.627283+0000', 'last_undegraded': '2024-09-15T22:46:41.627283+0000', 'last_fullsized': '2024-09-15T22:46:41.627283+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.633814+0000', 'last_change': '2024-09-15T22:46:41.633814+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.633814+0000', 'last_undegraded': '2024-09-15T22:46:41.633814+0000', 'last_fullsized': '2024-09-15T22:46:41.633814+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619661+0000', 'last_change': '2024-09-15T22:46:41.619661+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619661+0000', 'last_undegraded': '2024-09-15T22:46:41.619661+0000', 'last_fullsized': '2024-09-15T22:46:41.619661+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625865+0000', 'last_change': '2024-09-15T22:46:41.625865+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625865+0000', 'last_undegraded': '2024-09-15T22:46:41.625865+0000', 'last_fullsized': '2024-09-15T22:46:41.625865+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623783+0000', 'last_change': '2024-09-15T22:46:41.623783+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623783+0000', 'last_undegraded': '2024-09-15T22:46:41.623783+0000', 'last_fullsized': '2024-09-15T22:46:41.623783+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623730+0000', 'last_change': '2024-09-15T22:46:41.623730+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623730+0000', 'last_undegraded': '2024-09-15T22:46:41.623730+0000', 'last_fullsized': '2024-09-15T22:46:41.623730+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621527+0000', 'last_change': '2024-09-15T22:46:41.621527+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621527+0000', 'last_undegraded': '2024-09-15T22:46:41.621527+0000', 'last_fullsized': '2024-09-15T22:46:41.621527+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.618559+0000', 'last_change': '2024-09-15T22:46:41.618559+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.618559+0000', 'last_undegraded': '2024-09-15T22:46:41.618559+0000', 'last_fullsized': '2024-09-15T22:46:41.618559+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-15T22:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625532+0000', 'last_change': '2024-09-15T22:46:41.625532+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625532+0000', 'last_undegraded': '2024-09-15T22:46:41.625532+0000', 'last_fullsized': '2024-09-15T22:46:41.625532+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621351+0000', 'last_change': '2024-09-15T22:46:41.621351+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621351+0000', 'last_undegraded': '2024-09-15T22:46:41.621351+0000', 'last_fullsized': '2024-09-15T22:46:41.621351+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619245+0000', 'last_change': '2024-09-15T22:46:41.619245+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619245+0000', 'last_undegraded': '2024-09-15T22:46:41.619245+0000', 'last_fullsized': '2024-09-15T22:46:41.619245+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625026+0000', 'last_change': '2024-09-15T22:46:41.625026+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625026+0000', 'last_undegraded': '2024-09-15T22:46:41.625026+0000', 'last_fullsized': '2024-09-15T22:46:41.625026+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625531+0000', 'last_change': '2024-09-15T22:46:41.625531+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625531+0000', 'last_undegraded': '2024-09-15T22:46:41.625531+0000', 'last_fullsized': '2024-09-15T22:46:41.625531+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-15T22:46:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619576+0000', 'last_change': '2024-09-15T22:46:41.619576+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619576+0000', 'last_undegraded': '2024-09-15T22:46:41.619576+0000', 'last_fullsized': '2024-09-15T22:46:41.619576+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625449+0000', 'last_change': '2024-09-15T22:46:41.625449+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625449+0000', 'last_undegraded': '2024-09-15T22:46:41.625449+0000', 'last_fullsized': '2024-09-15T22:46:41.625449+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625005+0000', 'last_change': '2024-09-15T22:46:41.625005+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625005+0000', 'last_undegraded': '2024-09-15T22:46:41.625005+0000', 'last_fullsized': '2024-09-15T22:46:41.625005+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.631279+0000', 'last_change': '2024-09-15T22:46:41.631279+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.631279+0000', 'last_undegraded': '2024-09-15T22:46:41.631279+0000', 'last_fullsized': '2024-09-15T22:46:41.631279+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623188+0000', 'last_change': '2024-09-15T22:46:41.623188+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623188+0000', 'last_undegraded': '2024-09-15T22:46:41.623188+0000', 'last_fullsized': '2024-09-15T22:46:41.623188+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-15T22:46:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.632655+0000', 'last_change': '2024-09-15T22:46:41.632655+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.632655+0000', 'last_undegraded': '2024-09-15T22:46:41.632655+0000', 'last_fullsized': '2024-09-15T22:46:41.632655+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-15T22:46:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.631250+0000', 'last_change': '2024-09-15T22:46:41.631250+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.631250+0000', 'last_undegraded': '2024-09-15T22:46:41.631250+0000', 'last_fullsized': '2024-09-15T22:46:41.631250+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-15T22:46:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.620302+0000', 'last_change': '2024-09-15T22:46:41.620302+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.620302+0000', 'last_undegraded': '2024-09-15T22:46:41.620302+0000', 'last_fullsized': '2024-09-15T22:46:41.620302+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.620632+0000', 'last_change': '2024-09-15T22:46:41.620632+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.620632+0000', 'last_undegraded': '2024-09-15T22:46:41.620632+0000', 'last_fullsized': '2024-09-15T22:46:41.620632+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.625071+0000', 'last_change': '2024-09-15T22:46:41.625071+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.625071+0000', 'last_undegraded': '2024-09-15T22:46:41.625071+0000', 'last_fullsized': '2024-09-15T22:46:41.625071+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-15T22:46:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.627788+0000', 'last_change': '2024-09-15T22:46:41.627788+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.627788+0000', 'last_undegraded': '2024-09-15T22:46:41.627788+0000', 'last_fullsized': '2024-09-15T22:46:41.627788+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624570+0000', 'last_change': '2024-09-15T22:46:41.624570+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624570+0000', 'last_undegraded': '2024-09-15T22:46:41.624570+0000', 'last_fullsized': '2024-09-15T22:46:41.624570+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619123+0000', 'last_change': '2024-09-15T22:46:41.619123+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619123+0000', 'last_undegraded': '2024-09-15T22:46:41.619123+0000', 'last_fullsized': '2024-09-15T22:46:41.619123+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619131+0000', 'last_change': '2024-09-15T22:46:41.619131+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619131+0000', 'last_undegraded': '2024-09-15T22:46:41.619131+0000', 'last_fullsized': '2024-09-15T22:46:41.619131+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.630349+0000', 'last_change': '2024-09-15T22:46:41.630349+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.630349+0000', 'last_undegraded': '2024-09-15T22:46:41.630349+0000', 'last_fullsized': '2024-09-15T22:46:41.630349+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624299+0000', 'last_change': '2024-09-15T22:46:41.624299+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624299+0000', 'last_undegraded': '2024-09-15T22:46:41.624299+0000', 'last_fullsized': '2024-09-15T22:46:41.624299+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624020+0000', 'last_change': '2024-09-15T22:46:41.624020+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624020+0000', 'last_undegraded': '2024-09-15T22:46:41.624020+0000', 'last_fullsized': '2024-09-15T22:46:41.624020+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621170+0000', 'last_change': '2024-09-15T22:46:41.621170+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621170+0000', 'last_undegraded': '2024-09-15T22:46:41.621170+0000', 'last_fullsized': '2024-09-15T22:46:41.621170+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.620613+0000', 'last_change': '2024-09-15T22:46:41.620613+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.620613+0000', 'last_undegraded': '2024-09-15T22:46:41.620613+0000', 'last_fullsized': '2024-09-15T22:46:41.620613+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-15T22:46:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.618774+0000', 'last_change': '2024-09-15T22:46:41.618774+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.618774+0000', 'last_undegraded': '2024-09-15T22:46:41.618774+0000', 'last_fullsized': '2024-09-15T22:46:41.618774+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624040+0000', 'last_change': '2024-09-15T22:46:41.624040+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624040+0000', 'last_undegraded': '2024-09-15T22:46:41.624040+0000', 'last_fullsized': '2024-09-15T22:46:41.624040+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.618710+0000', 'last_change': '2024-09-15T22:46:41.618710+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.618710+0000', 'last_undegraded': '2024-09-15T22:46:41.618710+0000', 'last_fullsized': '2024-09-15T22:46:41.618710+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.629896+0000', 'last_change': '2024-09-15T22:46:41.629896+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.629896+0000', 'last_undegraded': '2024-09-15T22:46:41.629896+0000', 'last_fullsized': '2024-09-15T22:46:41.629896+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.623916+0000', 'last_change': '2024-09-15T22:46:41.623916+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.623916+0000', 'last_undegraded': '2024-09-15T22:46:41.623916+0000', 'last_fullsized': '2024-09-15T22:46:41.623916+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-15T22:46:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621291+0000', 'last_change': '2024-09-15T22:46:41.621291+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621291+0000', 'last_undegraded': '2024-09-15T22:46:41.621291+0000', 'last_fullsized': '2024-09-15T22:46:41.621291+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.618785+0000', 'last_change': '2024-09-15T22:46:41.618785+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.618785+0000', 'last_undegraded': '2024-09-15T22:46:41.618785+0000', 'last_fullsized': '2024-09-15T22:46:41.618785+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624482+0000', 'last_change': '2024-09-15T22:46:41.624482+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624482+0000', 'last_undegraded': '2024-09-15T22:46:41.624482+0000', 'last_fullsized': '2024-09-15T22:46:41.624482+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-15T22:46:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.631676+0000', 'last_change': '2024-09-15T22:46:41.631676+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.631676+0000', 'last_undegraded': '2024-09-15T22:46:41.631676+0000', 'last_fullsized': '2024-09-15T22:46:41.631676+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.632297+0000', 'last_change': '2024-09-15T22:46:41.632297+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.632297+0000', 'last_undegraded': '2024-09-15T22:46:41.632297+0000', 'last_fullsized': '2024-09-15T22:46:41.632297+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.621917+0000', 'last_change': '2024-09-15T22:46:41.621917+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.621917+0000', 'last_undegraded': '2024-09-15T22:46:41.621917+0000', 'last_fullsized': '2024-09-15T22:46:41.621917+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.619319+0000', 'last_change': '2024-09-15T22:46:41.619319+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.619319+0000', 'last_undegraded': '2024-09-15T22:46:41.619319+0000', 'last_fullsized': '2024-09-15T22:46:41.619319+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-15T22:46:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 120, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:46:41.624540+0000', 'last_change': '2024-09-15T22:46:41.624540+0000', 'last_active': '2024-09-15T22:46:41.610520+0000', 'last_peered': '2024-09-15T22:46:41.610520+0000', 'last_clean': '2024-09-15T22:46:41.610520+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:46:41.624540+0000', 'last_undegraded': '2024-09-15T22:46:41.624540+0000', 'last_fullsized': '2024-09-15T22:46:41.624540+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'last_clean_scrub_stamp': '2024-09-15T22:46:41.610520+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:46:46.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:46:46.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.704+0000 7f4001c27640 1 Processor -- start 2024-09-15T22:46:46.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.704+0000 7f4001c27640 1 -- start start 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ca40 0x7f3ffc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ffc15ce80 0x7f3ffc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3ffc0d0bc0 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3ffc15d390 con 0x7f3ffc15ce80 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f4001c27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc15d670 con 0x7f3ffc15ca40 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f3ffb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f3ffb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38380/0 (socket says 172.21.15.134:38380) 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.705+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/1767320666 learned_addr learned my addr 172.21.15.134:0/1767320666 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/1767320666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ca40 msgr2=0x7f3ffc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffaffd640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ca40 0x7f3ffc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffbfff640 1 --2- 172.21.15.134:0/1767320666 >> v2:172.21.15.177:3300/0 conn(0x7f3ffc15ce80 0x7f3ffc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ca40 0x7f3ffc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/1767320666 >> v2:172.21.15.177:3300/0 conn(0x7f3ffc15ce80 msgr2=0x7f3ffc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/1767320666 >> v2:172.21.15.177:3300/0 conn(0x7f3ffc15ce80 0x7f3ffc1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/1767320666 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc15d950 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc06cd20 tx=0x7f3fec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7627173a2915a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffa7fc640 1 -- 172.21.15.134:0/1767320666 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec037070 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffa7fc640 1 -- 172.21.15.134:0/1767320666 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fec032440 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.706+0000 7f3ffa7fc640 1 -- 172.21.15.134:0/1767320666 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec032810 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 -- 172.21.15.134:0/1767320666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 msgr2=0x7f3ffc0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc06cd20 tx=0x7f3fec02a140 comp rx=0 tx=0).stop 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 -- 172.21.15.134:0/1767320666 shutdown_connections 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 --2- 172.21.15.134:0/1767320666 >> v2:172.21.15.177:3300/0 conn(0x7f3ffc15ce80 0x7f3ffc1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ca40 0x7f3ffc15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 --2- 172.21.15.134:0/1767320666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0d0680 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 -- 172.21.15.134:0/1767320666 >> 172.21.15.134:0/1767320666 conn(0x7f3ffc062cc0 msgr2=0x7f3ffc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 -- 172.21.15.134:0/1767320666 shutdown_connections 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.707+0000 7f4001c27640 1 -- 172.21.15.134:0/1767320666 wait complete. 2024-09-15T22:46:46.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.708+0000 7f4001c27640 1 Processor -- start 2024-09-15T22:46:46.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.708+0000 7f4001c27640 1 -- start start 2024-09-15T22:46:46.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ffc15ca40 0x7f3ffc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ce80 0x7f3ffc06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc155b90 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc15df10 con 0x7f3ffc15ca40 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f4001c27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc155d10 con 0x7f3ffc15ce80 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38386/0 (socket says 172.21.15.134:38386) 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/2025532701 learned_addr learned my addr 172.21.15.134:0/2025532701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ce80 msgr2=0x7f3ffc06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ce80 0x7f3ffc06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ffc15ca40 msgr2=0x7f3ffc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ffc15ca40 0x7f3ffc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.709+0000 7f3ffb7fe640 1 -- 172.21.15.134:0/2025532701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc158070 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f3ffb7fe640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3fec02a180 tx=0x7f3fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec037040 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fec042070 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc158350 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec030bd0 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.710+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc158910 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.711+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc0b4790 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.711+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f3fec047460 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.712+0000 7f3fe3fff640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 0x7f3fe806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.712+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f3fec0ac670 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.712+0000 7f3ffaffd640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 0x7f3fe806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.712+0000 7f3ffaffd640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 0x7f3fe806eb60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc15c460 tx=0x7f3ff0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.716+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fec045360 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.946+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3ffc0cc6b0 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.946+0000 7f3fe3fff640 1 -- 172.21.15.134:0/2025532701 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1625 (secure 0 0 0) 0x7f3fec07a8f0 con 0x7f3ffc0d02a0 2024-09-15T22:46:46.949 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:46.949 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":344,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":268582912,"bytes_avail":772825530368,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":61,"btime":"2024-09-15T22:46:44:753926+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7368}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-15T22:46:17.194552+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 msgr2=0x7f3fe806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 0x7f3fe806eb60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc15c460 tx=0x7f3ff0008040 comp rx=0 tx=0).stop 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 msgr2=0x7f3ffc0aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3fec02a180 tx=0x7f3fec0046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 shutdown_connections 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ffc15ce80 0x7f3ffc06c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ffc15ca40 0x7f3ffc06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3fe806c6a0 0x7f3fe806eb60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 --2- 172.21.15.134:0/2025532701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ffc0d02a0 0x7f3ffc0aaec0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 >> 172.21.15.134:0/2025532701 conn(0x7f3ffc062cc0 msgr2=0x7f3ffc15b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 shutdown_connections 2024-09-15T22:46:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:46.948+0000 7f4001c27640 1 -- 172.21.15.134:0/2025532701 wait complete. 2024-09-15T22:46:46.962 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:46:46.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:46:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.057+0000 7fdeb3db7640 1 Processor -- start 2024-09-15T22:46:47.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 -- start start 2024-09-15T22:46:47.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 0x7fdeac0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac15ca40 0x7fdeac15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdeac15ce80 0x7fdeac1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdeac0d0bc0 con 0x7fdeac15ce80 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdeac15d390 con 0x7fdeac0d02a0 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.058+0000 7fdeb3db7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac15d670 con 0x7fdeac15ca40 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdeac15ce80 0x7fdeac1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdeac15ce80 0x7fdeac1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38398/0 (socket says 172.21.15.134:38398) 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 -- 172.21.15.134:0/1560665653 learned_addr learned my addr 172.21.15.134:0/1560665653 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/1560665653 >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 0x7fdeac0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb1352640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac15ca40 0x7fdeac15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 -- 172.21.15.134:0/1560665653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac15ca40 msgr2=0x7fdeac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac15ca40 0x7fdeac15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 -- 172.21.15.134:0/1560665653 >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 msgr2=0x7fdeac0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 --2- 172.21.15.134:0/1560665653 >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 0x7fdeac0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb2354640 1 -- 172.21.15.134:0/1560665653 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac15d950 con 0x7fdeac15ce80 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.059+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/1560665653 >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 0x7fdeac0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb2354640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac1594c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fdeac06f030 tx=0x7fdea402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f9951e5d76ce2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb0b51640 1 -- 172.21.15.134:0/1560665653 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4036070 con 0x7fdeac15ce80 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb0b51640 1 -- 172.21.15.134:0/1560665653 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea4031600 con 0x7fdeac15ce80 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb0b51640 1 -- 172.21.15.134:0/1560665653 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40319d0 con 0x7fdeac15ce80 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 -- 172.21.15.134:0/1560665653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 msgr2=0x7fdeac1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac1594c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fdeac06f030 tx=0x7fdea402a610 comp rx=0 tx=0).stop 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 -- 172.21.15.134:0/1560665653 shutdown_connections 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac1594c0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/1560665653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac15ca40 0x7fdeac15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/1560665653 >> v2:172.21.15.177:3300/0 conn(0x7fdeac0d02a0 0x7fdeac0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 -- 172.21.15.134:0/1560665653 >> 172.21.15.134:0/1560665653 conn(0x7fdeac062cc0 msgr2=0x7fdeac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 -- 172.21.15.134:0/1560665653 shutdown_connections 2024-09-15T22:46:47.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.060+0000 7fdeb3db7640 1 -- 172.21.15.134:0/1560665653 wait complete. 2024-09-15T22:46:47.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 Processor -- start 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 -- start start 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 0x7fdeac1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 0x7fdeac156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac155b90 con 0x7fdeac15ce80 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac15df10 con 0x7fdeac15ca40 2024-09-15T22:46:47.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb3db7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac155d10 con 0x7fdeac0d02a0 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb2354640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb2354640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38402/0 (socket says 172.21.15.134:38402) 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.062+0000 7fdeb2354640 1 -- 172.21.15.134:0/2281865193 learned_addr learned my addr 172.21.15.134:0/2281865193 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb1352640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 0x7fdeac156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 0x7fdeac1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 -- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 msgr2=0x7fdeac1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 0x7fdeac1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 -- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 msgr2=0x7fdeac156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 0x7fdeac156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 -- 172.21.15.134:0/2281865193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac14c540 con 0x7fdeac15ce80 2024-09-15T22:46:47.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb1352640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 0x7fdeac156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 0x7fdeac1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb2354640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdea402ac00 tx=0x7fdea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea403f020 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea4037040 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac14c130 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4036070 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.063+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac1578e0 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.064+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac0b4790 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.065+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fdea4042020 con 0x7fdeac15ce80 2024-09-15T22:46:47.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.065+0000 7fde9e7fc640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 0x7fde9006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:47.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.065+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fdea40ac460 con 0x7fdeac15ce80 2024-09-15T22:46:47.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.065+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 0x7fde9006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:47.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.066+0000 7fdeb1b53640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 0x7fde9006eb60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdea0006fd0 tx=0x7fdea0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:47.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.069+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdea4049020 con 0x7fdeac15ce80 2024-09-15T22:46:47.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.232+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdeac0b3b30 con 0x7fde9006c6a0 2024-09-15T22:46:47.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.238+0000 7fde9e7fc640 1 -- 172.21.15.134:0/2281865193 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7fdeac0b3b30 con 0x7fde9006c6a0 2024-09-15T22:46:47.243 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:47.245 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 msgr2=0x7fde9006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 0x7fde9006eb60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdea0006fd0 tx=0x7fdea0008040 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 msgr2=0x7fdeac14bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdea402ac00 tx=0x7fdea4004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 shutdown_connections 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fde9006c6a0 0x7fde9006eb60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac15ce80 0x7fdeac14bbf0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeac15ca40 0x7fdeac156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 --2- 172.21.15.134:0/2281865193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeac0d02a0 0x7fdeac1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 >> 172.21.15.134:0/2281865193 conn(0x7fdeac062cc0 msgr2=0x7fdeac0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:47.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 shutdown_connections 2024-09-15T22:46:47.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:47.241+0000 7fdeb3db7640 1 -- 172.21.15.134:0/2281865193 wait complete. 2024-09-15T22:46:47.254 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-15T22:46:47.202088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262600,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712120,"statfs":{"total":773094113280,"available":772825210880,"internally_reserved":0,"allocated":13377536,"data_stored":6513516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632407+0000","last_change":"2024-09-15T22:46:42.634623+0000","last_active":"2024-09-15T22:46:43.632407+0000","last_peered":"2024-09-15T22:46:43.632407+0000","last_clean":"2024-09-15T22:46:43.632407+0000","last_became_active":"2024-09-15T22:46:42.634296+0000","last_became_peered":"2024-09-15T22:46:42.634296+0000","last_unstale":"2024-09-15T22:46:43.632407+0000","last_undegraded":"2024-09-15T22:46:43.632407+0000","last_fullsized":"2024-09-15T22:46:43.632407+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:35.596238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633207+0000","last_change":"2024-09-15T22:46:42.638516+0000","last_active":"2024-09-15T22:46:43.633207+0000","last_peered":"2024-09-15T22:46:43.633207+0000","last_clean":"2024-09-15T22:46:43.633207+0000","last_became_active":"2024-09-15T22:46:42.637582+0000","last_became_peered":"2024-09-15T22:46:42.637582+0000","last_unstale":"2024-09-15T22:46:43.633207+0000","last_undegraded":"2024-09-15T22:46:43.633207+0000","last_fullsized":"2024-09-15T22:46:43.633207+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:16.561559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731805+0000","last_change":"2024-09-15T22:46:42.634428+0000","last_active":"2024-09-15T22:46:43.731805+0000","last_peered":"2024-09-15T22:46:43.731805+0000","last_clean":"2024-09-15T22:46:43.731805+0000","last_became_active":"2024-09-15T22:46:42.634197+0000","last_became_peered":"2024-09-15T22:46:42.634197+0000","last_unstale":"2024-09-15T22:46:43.731805+0000","last_undegraded":"2024-09-15T22:46:43.731805+0000","last_fullsized":"2024-09-15T22:46:43.731805+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:25.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732792+0000","last_change":"2024-09-15T22:46:42.647609+0000","last_active":"2024-09-15T22:46:43.732792+0000","last_peered":"2024-09-15T22:46:43.732792+0000","last_clean":"2024-09-15T22:46:43.732792+0000","last_became_active":"2024-09-15T22:46:42.647329+0000","last_became_peered":"2024-09-15T22:46:42.647329+0000","last_unstale":"2024-09-15T22:46:43.732792+0000","last_undegraded":"2024-09-15T22:46:43.732792+0000","last_fullsized":"2024-09-15T22:46:43.732792+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:58.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731567+0000","last_change":"2024-09-15T22:46:42.647678+0000","last_active":"2024-09-15T22:46:43.731567+0000","last_peered":"2024-09-15T22:46:43.731567+0000","last_clean":"2024-09-15T22:46:43.731567+0000","last_became_active":"2024-09-15T22:46:42.647338+0000","last_became_peered":"2024-09-15T22:46:42.647338+0000","last_unstale":"2024-09-15T22:46:43.731567+0000","last_undegraded":"2024-09-15T22:46:43.731567+0000","last_fullsized":"2024-09-15T22:46:43.731567+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:15.504000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631549+0000","last_change":"2024-09-15T22:46:42.639540+0000","last_active":"2024-09-15T22:46:43.631549+0000","last_peered":"2024-09-15T22:46:43.631549+0000","last_clean":"2024-09-15T22:46:43.631549+0000","last_became_active":"2024-09-15T22:46:42.639302+0000","last_became_peered":"2024-09-15T22:46:42.639302+0000","last_unstale":"2024-09-15T22:46:43.631549+0000","last_undegraded":"2024-09-15T22:46:43.631549+0000","last_fullsized":"2024-09-15T22:46:43.631549+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:24.882815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731878+0000","last_change":"2024-09-15T22:46:42.640949+0000","last_active":"2024-09-15T22:46:43.731878+0000","last_peered":"2024-09-15T22:46:43.731878+0000","last_clean":"2024-09-15T22:46:43.731878+0000","last_became_active":"2024-09-15T22:46:42.640683+0000","last_became_peered":"2024-09-15T22:46:42.640683+0000","last_unstale":"2024-09-15T22:46:43.731878+0000","last_undegraded":"2024-09-15T22:46:43.731878+0000","last_fullsized":"2024-09-15T22:46:43.731878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:58.022222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731365+0000","last_change":"2024-09-15T22:46:42.638327+0000","last_active":"2024-09-15T22:46:43.731365+0000","last_peered":"2024-09-15T22:46:43.731365+0000","last_clean":"2024-09-15T22:46:43.731365+0000","last_became_active":"2024-09-15T22:46:42.638069+0000","last_became_peered":"2024-09-15T22:46:42.638069+0000","last_unstale":"2024-09-15T22:46:43.731365+0000","last_undegraded":"2024-09-15T22:46:43.731365+0000","last_fullsized":"2024-09-15T22:46:43.731365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.234466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732511+0000","last_change":"2024-09-15T22:46:42.635529+0000","last_active":"2024-09-15T22:46:43.732511+0000","last_peered":"2024-09-15T22:46:43.732511+0000","last_clean":"2024-09-15T22:46:43.732511+0000","last_became_active":"2024-09-15T22:46:42.635293+0000","last_became_peered":"2024-09-15T22:46:42.635293+0000","last_unstale":"2024-09-15T22:46:43.732511+0000","last_undegraded":"2024-09-15T22:46:43.732511+0000","last_fullsized":"2024-09-15T22:46:43.732511+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:33.240060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633346+0000","last_change":"2024-09-15T22:46:42.638192+0000","last_active":"2024-09-15T22:46:43.633346+0000","last_peered":"2024-09-15T22:46:43.633346+0000","last_clean":"2024-09-15T22:46:43.633346+0000","last_became_active":"2024-09-15T22:46:42.637906+0000","last_became_peered":"2024-09-15T22:46:42.637906+0000","last_unstale":"2024-09-15T22:46:43.633346+0000","last_undegraded":"2024-09-15T22:46:43.633346+0000","last_fullsized":"2024-09-15T22:46:43.633346+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:32.973241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732346+0000","last_change":"2024-09-15T22:46:42.639131+0000","last_active":"2024-09-15T22:46:43.732346+0000","last_peered":"2024-09-15T22:46:43.732346+0000","last_clean":"2024-09-15T22:46:43.732346+0000","last_became_active":"2024-09-15T22:46:42.638603+0000","last_became_peered":"2024-09-15T22:46:42.638603+0000","last_unstale":"2024-09-15T22:46:43.732346+0000","last_undegraded":"2024-09-15T22:46:43.732346+0000","last_fullsized":"2024-09-15T22:46:43.732346+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:57:26.779461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631813+0000","last_change":"2024-09-15T22:46:42.640367+0000","last_active":"2024-09-15T22:46:43.631813+0000","last_peered":"2024-09-15T22:46:43.631813+0000","last_clean":"2024-09-15T22:46:43.631813+0000","last_became_active":"2024-09-15T22:46:42.639818+0000","last_became_peered":"2024-09-15T22:46:42.639818+0000","last_unstale":"2024-09-15T22:46:43.631813+0000","last_undegraded":"2024-09-15T22:46:43.631813+0000","last_fullsized":"2024-09-15T22:46:43.631813+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:13.840109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732095+0000","last_change":"2024-09-15T22:46:42.636662+0000","last_active":"2024-09-15T22:46:43.732095+0000","last_peered":"2024-09-15T22:46:43.732095+0000","last_clean":"2024-09-15T22:46:43.732095+0000","last_became_active":"2024-09-15T22:46:42.635916+0000","last_became_peered":"2024-09-15T22:46:42.635916+0000","last_unstale":"2024-09-15T22:46:43.732095+0000","last_undegraded":"2024-09-15T22:46:43.732095+0000","last_fullsized":"2024-09-15T22:46:43.732095+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:36.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632475+0000","last_change":"2024-09-15T22:46:42.634480+0000","last_active":"2024-09-15T22:46:43.632475+0000","last_peered":"2024-09-15T22:46:43.632475+0000","last_clean":"2024-09-15T22:46:43.632475+0000","last_became_active":"2024-09-15T22:46:42.634194+0000","last_became_peered":"2024-09-15T22:46:42.634194+0000","last_unstale":"2024-09-15T22:46:43.632475+0000","last_undegraded":"2024-09-15T22:46:43.632475+0000","last_fullsized":"2024-09-15T22:46:43.632475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:00.806908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732296+0000","last_change":"2024-09-15T22:46:42.638763+0000","last_active":"2024-09-15T22:46:43.732296+0000","last_peered":"2024-09-15T22:46:43.732296+0000","last_clean":"2024-09-15T22:46:43.732296+0000","last_became_active":"2024-09-15T22:46:42.638490+0000","last_became_peered":"2024-09-15T22:46:42.638490+0000","last_unstale":"2024-09-15T22:46:43.732296+0000","last_undegraded":"2024-09-15T22:46:43.732296+0000","last_fullsized":"2024-09-15T22:46:43.732296+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:01.335663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632188+0000","last_change":"2024-09-15T22:46:42.630705+0000","last_active":"2024-09-15T22:46:43.632188+0000","last_peered":"2024-09-15T22:46:43.632188+0000","last_clean":"2024-09-15T22:46:43.632188+0000","last_became_active":"2024-09-15T22:46:42.630124+0000","last_became_peered":"2024-09-15T22:46:42.630124+0000","last_unstale":"2024-09-15T22:46:43.632188+0000","last_undegraded":"2024-09-15T22:46:43.632188+0000","last_fullsized":"2024-09-15T22:46:43.632188+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:24.288263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732601+0000","last_change":"2024-09-15T22:46:42.643055+0000","last_active":"2024-09-15T22:46:43.732601+0000","last_peered":"2024-09-15T22:46:43.732601+0000","last_clean":"2024-09-15T22:46:43.732601+0000","last_became_active":"2024-09-15T22:46:42.642794+0000","last_became_peered":"2024-09-15T22:46:42.642794+0000","last_unstale":"2024-09-15T22:46:43.732601+0000","last_undegraded":"2024-09-15T22:46:43.732601+0000","last_fullsized":"2024-09-15T22:46:43.732601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:55.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732516+0000","last_change":"2024-09-15T22:46:42.641584+0000","last_active":"2024-09-15T22:46:43.732516+0000","last_peered":"2024-09-15T22:46:43.732516+0000","last_clean":"2024-09-15T22:46:43.732516+0000","last_became_active":"2024-09-15T22:46:42.641324+0000","last_became_peered":"2024-09-15T22:46:42.641324+0000","last_unstale":"2024-09-15T22:46:43.732516+0000","last_undegraded":"2024-09-15T22:46:43.732516+0000","last_fullsized":"2024-09-15T22:46:43.732516+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:28.589672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632898+0000","last_change":"2024-09-15T22:46:42.631179+0000","last_active":"2024-09-15T22:46:43.632898+0000","last_peered":"2024-09-15T22:46:43.632898+0000","last_clean":"2024-09-15T22:46:43.632898+0000","last_became_active":"2024-09-15T22:46:42.630919+0000","last_became_peered":"2024-09-15T22:46:42.630919+0000","last_unstale":"2024-09-15T22:46:43.632898+0000","last_undegraded":"2024-09-15T22:46:43.632898+0000","last_fullsized":"2024-09-15T22:46:43.632898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:10.161933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732371+0000","last_change":"2024-09-15T22:46:42.641703+0000","last_active":"2024-09-15T22:46:43.732371+0000","last_peered":"2024-09-15T22:46:43.732371+0000","last_clean":"2024-09-15T22:46:43.732371+0000","last_became_active":"2024-09-15T22:46:42.641450+0000","last_became_peered":"2024-09-15T22:46:42.641450+0000","last_unstale":"2024-09-15T22:46:43.732371+0000","last_undegraded":"2024-09-15T22:46:43.732371+0000","last_fullsized":"2024-09-15T22:46:43.732371+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:31.522449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631577+0000","last_change":"2024-09-15T22:46:42.634642+0000","last_active":"2024-09-15T22:46:43.631577+0000","last_peered":"2024-09-15T22:46:43.631577+0000","last_clean":"2024-09-15T22:46:43.631577+0000","last_became_active":"2024-09-15T22:46:42.634219+0000","last_became_peered":"2024-09-15T22:46:42.634219+0000","last_unstale":"2024-09-15T22:46:43.631577+0000","last_undegraded":"2024-09-15T22:46:43.631577+0000","last_fullsized":"2024-09-15T22:46:43.631577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633567+0000","last_change":"2024-09-15T22:46:42.637103+0000","last_active":"2024-09-15T22:46:43.633567+0000","last_peered":"2024-09-15T22:46:43.633567+0000","last_clean":"2024-09-15T22:46:43.633567+0000","last_became_active":"2024-09-15T22:46:42.633667+0000","last_became_peered":"2024-09-15T22:46:42.633667+0000","last_unstale":"2024-09-15T22:46:43.633567+0000","last_undegraded":"2024-09-15T22:46:43.633567+0000","last_fullsized":"2024-09-15T22:46:43.633567+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:36.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731314+0000","last_change":"2024-09-15T22:46:42.636654+0000","last_active":"2024-09-15T22:46:43.731314+0000","last_peered":"2024-09-15T22:46:43.731314+0000","last_clean":"2024-09-15T22:46:43.731314+0000","last_became_active":"2024-09-15T22:46:42.636157+0000","last_became_peered":"2024-09-15T22:46:42.636157+0000","last_unstale":"2024-09-15T22:46:43.731314+0000","last_undegraded":"2024-09-15T22:46:43.731314+0000","last_fullsized":"2024-09-15T22:46:43.731314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:28.589672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731899+0000","last_change":"2024-09-15T22:46:42.645451+0000","last_active":"2024-09-15T22:46:43.731899+0000","last_peered":"2024-09-15T22:46:43.731899+0000","last_clean":"2024-09-15T22:46:43.731899+0000","last_became_active":"2024-09-15T22:46:42.645097+0000","last_became_peered":"2024-09-15T22:46:42.645097+0000","last_unstale":"2024-09-15T22:46:43.731899+0000","last_undegraded":"2024-09-15T22:46:43.731899+0000","last_fullsized":"2024-09-15T22:46:43.731899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.436898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732848+0000","last_change":"2024-09-15T22:46:42.640880+0000","last_active":"2024-09-15T22:46:43.732848+0000","last_peered":"2024-09-15T22:46:43.732848+0000","last_clean":"2024-09-15T22:46:43.732848+0000","last_became_active":"2024-09-15T22:46:42.640449+0000","last_became_peered":"2024-09-15T22:46:42.640449+0000","last_unstale":"2024-09-15T22:46:43.732848+0000","last_undegraded":"2024-09-15T22:46:43.732848+0000","last_fullsized":"2024-09-15T22:46:43.732848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:55.646363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633389+0000","last_change":"2024-09-15T22:46:42.634765+0000","last_active":"2024-09-15T22:46:43.633389+0000","last_peered":"2024-09-15T22:46:43.633389+0000","last_clean":"2024-09-15T22:46:43.633389+0000","last_became_active":"2024-09-15T22:46:42.634467+0000","last_became_peered":"2024-09-15T22:46:42.634467+0000","last_unstale":"2024-09-15T22:46:43.633389+0000","last_undegraded":"2024-09-15T22:46:43.633389+0000","last_fullsized":"2024-09-15T22:46:43.633389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:21.748623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632583+0000","last_change":"2024-09-15T22:46:42.629508+0000","last_active":"2024-09-15T22:46:43.632583+0000","last_peered":"2024-09-15T22:46:43.632583+0000","last_clean":"2024-09-15T22:46:43.632583+0000","last_became_active":"2024-09-15T22:46:42.629240+0000","last_became_peered":"2024-09-15T22:46:42.629240+0000","last_unstale":"2024-09-15T22:46:43.632583+0000","last_undegraded":"2024-09-15T22:46:43.632583+0000","last_fullsized":"2024-09-15T22:46:43.632583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:34.619116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732077+0000","last_change":"2024-09-15T22:46:42.634189+0000","last_active":"2024-09-15T22:46:43.732077+0000","last_peered":"2024-09-15T22:46:43.732077+0000","last_clean":"2024-09-15T22:46:43.732077+0000","last_became_active":"2024-09-15T22:46:42.633852+0000","last_became_peered":"2024-09-15T22:46:42.633852+0000","last_unstale":"2024-09-15T22:46:43.732077+0000","last_undegraded":"2024-09-15T22:46:43.732077+0000","last_fullsized":"2024-09-15T22:46:43.732077+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:40.489821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633254+0000","last_change":"2024-09-15T22:46:42.636587+0000","last_active":"2024-09-15T22:46:43.633254+0000","last_peered":"2024-09-15T22:46:43.633254+0000","last_clean":"2024-09-15T22:46:43.633254+0000","last_became_active":"2024-09-15T22:46:42.635352+0000","last_became_peered":"2024-09-15T22:46:42.635352+0000","last_unstale":"2024-09-15T22:46:43.633254+0000","last_undegraded":"2024-09-15T22:46:43.633254+0000","last_fullsized":"2024-09-15T22:46:43.633254+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:09.796690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633547+0000","last_change":"2024-09-15T22:46:42.632484+0000","last_active":"2024-09-15T22:46:43.633547+0000","last_peered":"2024-09-15T22:46:43.633547+0000","last_clean":"2024-09-15T22:46:43.633547+0000","last_became_active":"2024-09-15T22:46:42.631779+0000","last_became_peered":"2024-09-15T22:46:42.631779+0000","last_unstale":"2024-09-15T22:46:43.633547+0000","last_undegraded":"2024-09-15T22:46:43.633547+0000","last_fullsized":"2024-09-15T22:46:43.633547+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:48.711096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731456+0000","last_change":"2024-09-15T22:46:42.636432+0000","last_active":"2024-09-15T22:46:43.731456+0000","last_peered":"2024-09-15T22:46:43.731456+0000","last_clean":"2024-09-15T22:46:43.731456+0000","last_became_active":"2024-09-15T22:46:42.635870+0000","last_became_peered":"2024-09-15T22:46:42.635870+0000","last_unstale":"2024-09-15T22:46:43.731456+0000","last_undegraded":"2024-09-15T22:46:43.731456+0000","last_fullsized":"2024-09-15T22:46:43.731456+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.040320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731781+0000","last_change":"2024-09-15T22:46:42.637956+0000","last_active":"2024-09-15T22:46:43.731781+0000","last_peered":"2024-09-15T22:46:43.731781+0000","last_clean":"2024-09-15T22:46:43.731781+0000","last_became_active":"2024-09-15T22:46:42.637673+0000","last_became_peered":"2024-09-15T22:46:42.637673+0000","last_unstale":"2024-09-15T22:46:43.731781+0000","last_undegraded":"2024-09-15T22:46:43.731781+0000","last_fullsized":"2024-09-15T22:46:43.731781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:39.155708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632971+0000","last_change":"2024-09-15T22:46:42.625795+0000","last_active":"2024-09-15T22:46:43.632971+0000","last_peered":"2024-09-15T22:46:43.632971+0000","last_clean":"2024-09-15T22:46:43.632971+0000","last_became_active":"2024-09-15T22:46:42.625495+0000","last_became_peered":"2024-09-15T22:46:42.625495+0000","last_unstale":"2024-09-15T22:46:43.632971+0000","last_undegraded":"2024-09-15T22:46:43.632971+0000","last_fullsized":"2024-09-15T22:46:43.632971+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:45.910950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732307+0000","last_change":"2024-09-15T22:46:41.633396+0000","last_active":"2024-09-15T22:46:43.732307+0000","last_peered":"2024-09-15T22:46:43.732307+0000","last_clean":"2024-09-15T22:46:43.732307+0000","last_became_active":"2024-09-15T22:46:41.632887+0000","last_became_peered":"2024-09-15T22:46:41.632887+0000","last_unstale":"2024-09-15T22:46:43.732307+0000","last_undegraded":"2024-09-15T22:46:43.732307+0000","last_fullsized":"2024-09-15T22:46:43.732307+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:39.487633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732647+0000","last_change":"2024-09-15T22:46:42.642421+0000","last_active":"2024-09-15T22:46:43.732647+0000","last_peered":"2024-09-15T22:46:43.732647+0000","last_clean":"2024-09-15T22:46:43.732647+0000","last_became_active":"2024-09-15T22:46:42.642166+0000","last_became_peered":"2024-09-15T22:46:42.642166+0000","last_unstale":"2024-09-15T22:46:43.732647+0000","last_undegraded":"2024-09-15T22:46:43.732647+0000","last_fullsized":"2024-09-15T22:46:43.732647+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:13.975878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732356+0000","last_change":"2024-09-15T22:46:41.637052+0000","last_active":"2024-09-15T22:46:43.732356+0000","last_peered":"2024-09-15T22:46:43.732356+0000","last_clean":"2024-09-15T22:46:43.732356+0000","last_became_active":"2024-09-15T22:46:41.636779+0000","last_became_peered":"2024-09-15T22:46:41.636779+0000","last_unstale":"2024-09-15T22:46:43.732356+0000","last_undegraded":"2024-09-15T22:46:43.732356+0000","last_fullsized":"2024-09-15T22:46:43.732356+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:06.300428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731659+0000","last_change":"2024-09-15T22:46:42.638022+0000","last_active":"2024-09-15T22:46:43.731659+0000","last_peered":"2024-09-15T22:46:43.731659+0000","last_clean":"2024-09-15T22:46:43.731659+0000","last_became_active":"2024-09-15T22:46:42.637720+0000","last_became_peered":"2024-09-15T22:46:42.637720+0000","last_unstale":"2024-09-15T22:46:43.731659+0000","last_undegraded":"2024-09-15T22:46:43.731659+0000","last_fullsized":"2024-09-15T22:46:43.731659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:57.232269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732441+0000","last_change":"2024-09-15T22:46:41.630313+0000","last_active":"2024-09-15T22:46:43.732441+0000","last_peered":"2024-09-15T22:46:43.732441+0000","last_clean":"2024-09-15T22:46:43.732441+0000","last_became_active":"2024-09-15T22:46:41.629752+0000","last_became_peered":"2024-09-15T22:46:41.629752+0000","last_unstale":"2024-09-15T22:46:43.732441+0000","last_undegraded":"2024-09-15T22:46:43.732441+0000","last_fullsized":"2024-09-15T22:46:43.732441+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:54.557667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631962+0000","last_change":"2024-09-15T22:46:42.631811+0000","last_active":"2024-09-15T22:46:43.631962+0000","last_peered":"2024-09-15T22:46:43.631962+0000","last_clean":"2024-09-15T22:46:43.631962+0000","last_became_active":"2024-09-15T22:46:42.631554+0000","last_became_peered":"2024-09-15T22:46:42.631554+0000","last_unstale":"2024-09-15T22:46:43.631962+0000","last_undegraded":"2024-09-15T22:46:43.631962+0000","last_fullsized":"2024-09-15T22:46:43.631962+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:35.596238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633322+0000","last_change":"2024-09-15T22:46:41.633208+0000","last_active":"2024-09-15T22:46:43.633322+0000","last_peered":"2024-09-15T22:46:43.633322+0000","last_clean":"2024-09-15T22:46:43.633322+0000","last_became_active":"2024-09-15T22:46:41.632913+0000","last_became_peered":"2024-09-15T22:46:41.632913+0000","last_unstale":"2024-09-15T22:46:43.633322+0000","last_undegraded":"2024-09-15T22:46:43.633322+0000","last_fullsized":"2024-09-15T22:46:43.633322+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:18.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731989+0000","last_change":"2024-09-15T22:46:42.643116+0000","last_active":"2024-09-15T22:46:43.731989+0000","last_peered":"2024-09-15T22:46:43.731989+0000","last_clean":"2024-09-15T22:46:43.731989+0000","last_became_active":"2024-09-15T22:46:42.642850+0000","last_became_peered":"2024-09-15T22:46:42.642850+0000","last_unstale":"2024-09-15T22:46:43.731989+0000","last_undegraded":"2024-09-15T22:46:43.731989+0000","last_fullsized":"2024-09-15T22:46:43.731989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:40.859787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633275+0000","last_change":"2024-09-15T22:46:41.625300+0000","last_active":"2024-09-15T22:46:43.633275+0000","last_peered":"2024-09-15T22:46:43.633275+0000","last_clean":"2024-09-15T22:46:43.633275+0000","last_became_active":"2024-09-15T22:46:41.624984+0000","last_became_peered":"2024-09-15T22:46:41.624984+0000","last_unstale":"2024-09-15T22:46:43.633275+0000","last_undegraded":"2024-09-15T22:46:43.633275+0000","last_fullsized":"2024-09-15T22:46:43.633275+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:50.636464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631765+0000","last_change":"2024-09-15T22:46:42.635292+0000","last_active":"2024-09-15T22:46:43.631765+0000","last_peered":"2024-09-15T22:46:43.631765+0000","last_clean":"2024-09-15T22:46:43.631765+0000","last_became_active":"2024-09-15T22:46:42.635038+0000","last_became_peered":"2024-09-15T22:46:42.635038+0000","last_unstale":"2024-09-15T22:46:43.631765+0000","last_undegraded":"2024-09-15T22:46:43.631765+0000","last_fullsized":"2024-09-15T22:46:43.631765+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:23.762096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732092+0000","last_change":"2024-09-15T22:46:41.632960+0000","last_active":"2024-09-15T22:46:43.732092+0000","last_peered":"2024-09-15T22:46:43.732092+0000","last_clean":"2024-09-15T22:46:43.732092+0000","last_became_active":"2024-09-15T22:46:41.632657+0000","last_became_peered":"2024-09-15T22:46:41.632657+0000","last_unstale":"2024-09-15T22:46:43.732092+0000","last_undegraded":"2024-09-15T22:46:43.732092+0000","last_fullsized":"2024-09-15T22:46:43.732092+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:03.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631555+0000","last_change":"2024-09-15T22:46:42.644549+0000","last_active":"2024-09-15T22:46:43.631555+0000","last_peered":"2024-09-15T22:46:43.631555+0000","last_clean":"2024-09-15T22:46:43.631555+0000","last_became_active":"2024-09-15T22:46:42.644129+0000","last_became_peered":"2024-09-15T22:46:42.644129+0000","last_unstale":"2024-09-15T22:46:43.631555+0000","last_undegraded":"2024-09-15T22:46:43.631555+0000","last_fullsized":"2024-09-15T22:46:43.631555+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:34.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732111+0000","last_change":"2024-09-15T22:46:41.629042+0000","last_active":"2024-09-15T22:46:43.732111+0000","last_peered":"2024-09-15T22:46:43.732111+0000","last_clean":"2024-09-15T22:46:43.732111+0000","last_became_active":"2024-09-15T22:46:41.628771+0000","last_became_peered":"2024-09-15T22:46:41.628771+0000","last_unstale":"2024-09-15T22:46:43.732111+0000","last_undegraded":"2024-09-15T22:46:43.732111+0000","last_fullsized":"2024-09-15T22:46:43.732111+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:59.398012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632262+0000","last_change":"2024-09-15T22:46:42.633303+0000","last_active":"2024-09-15T22:46:43.632262+0000","last_peered":"2024-09-15T22:46:43.632262+0000","last_clean":"2024-09-15T22:46:43.632262+0000","last_became_active":"2024-09-15T22:46:42.633040+0000","last_became_peered":"2024-09-15T22:46:42.633040+0000","last_unstale":"2024-09-15T22:46:43.632262+0000","last_undegraded":"2024-09-15T22:46:43.632262+0000","last_fullsized":"2024-09-15T22:46:43.632262+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:07.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632811+0000","last_change":"2024-09-15T22:46:41.629205+0000","last_active":"2024-09-15T22:46:43.632811+0000","last_peered":"2024-09-15T22:46:43.632811+0000","last_clean":"2024-09-15T22:46:43.632811+0000","last_became_active":"2024-09-15T22:46:41.628999+0000","last_became_peered":"2024-09-15T22:46:41.628999+0000","last_unstale":"2024-09-15T22:46:43.632811+0000","last_undegraded":"2024-09-15T22:46:43.632811+0000","last_fullsized":"2024-09-15T22:46:43.632811+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:55.152314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633451+0000","last_change":"2024-09-15T22:46:42.642652+0000","last_active":"2024-09-15T22:46:43.633451+0000","last_peered":"2024-09-15T22:46:43.633451+0000","last_clean":"2024-09-15T22:46:43.633451+0000","last_became_active":"2024-09-15T22:46:42.642389+0000","last_became_peered":"2024-09-15T22:46:42.642389+0000","last_unstale":"2024-09-15T22:46:43.633451+0000","last_undegraded":"2024-09-15T22:46:43.633451+0000","last_fullsized":"2024-09-15T22:46:43.633451+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:49.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631976+0000","last_change":"2024-09-15T22:46:41.641108+0000","last_active":"2024-09-15T22:46:43.631976+0000","last_peered":"2024-09-15T22:46:43.631976+0000","last_clean":"2024-09-15T22:46:43.631976+0000","last_became_active":"2024-09-15T22:46:41.640839+0000","last_became_peered":"2024-09-15T22:46:41.640839+0000","last_unstale":"2024-09-15T22:46:43.631976+0000","last_undegraded":"2024-09-15T22:46:43.631976+0000","last_fullsized":"2024-09-15T22:46:43.631976+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:14.501812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732035+0000","last_change":"2024-09-15T22:46:42.638848+0000","last_active":"2024-09-15T22:46:43.732035+0000","last_peered":"2024-09-15T22:46:43.732035+0000","last_clean":"2024-09-15T22:46:43.732035+0000","last_became_active":"2024-09-15T22:46:42.638581+0000","last_became_peered":"2024-09-15T22:46:42.638581+0000","last_unstale":"2024-09-15T22:46:43.732035+0000","last_undegraded":"2024-09-15T22:46:43.732035+0000","last_fullsized":"2024-09-15T22:46:43.732035+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:07.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732612+0000","last_change":"2024-09-15T22:46:41.628614+0000","last_active":"2024-09-15T22:46:43.732612+0000","last_peered":"2024-09-15T22:46:43.732612+0000","last_clean":"2024-09-15T22:46:43.732612+0000","last_became_active":"2024-09-15T22:46:41.628338+0000","last_became_peered":"2024-09-15T22:46:41.628338+0000","last_unstale":"2024-09-15T22:46:43.732612+0000","last_undegraded":"2024-09-15T22:46:43.732612+0000","last_fullsized":"2024-09-15T22:46:43.732612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:28.963567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631868+0000","last_change":"2024-09-15T22:46:42.640567+0000","last_active":"2024-09-15T22:46:43.631868+0000","last_peered":"2024-09-15T22:46:43.631868+0000","last_clean":"2024-09-15T22:46:43.631868+0000","last_became_active":"2024-09-15T22:46:42.640137+0000","last_became_peered":"2024-09-15T22:46:42.640137+0000","last_unstale":"2024-09-15T22:46:43.631868+0000","last_undegraded":"2024-09-15T22:46:43.631868+0000","last_fullsized":"2024-09-15T22:46:43.631868+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:07.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732292+0000","last_change":"2024-09-15T22:46:41.633198+0000","last_active":"2024-09-15T22:46:43.732292+0000","last_peered":"2024-09-15T22:46:43.732292+0000","last_clean":"2024-09-15T22:46:43.732292+0000","last_became_active":"2024-09-15T22:46:41.632937+0000","last_became_peered":"2024-09-15T22:46:41.632937+0000","last_unstale":"2024-09-15T22:46:43.732292+0000","last_undegraded":"2024-09-15T22:46:43.732292+0000","last_fullsized":"2024-09-15T22:46:43.732292+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:09.054602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732214+0000","last_change":"2024-09-15T22:46:42.647578+0000","last_active":"2024-09-15T22:46:43.732214+0000","last_peered":"2024-09-15T22:46:43.732214+0000","last_clean":"2024-09-15T22:46:43.732214+0000","last_became_active":"2024-09-15T22:46:42.647317+0000","last_became_peered":"2024-09-15T22:46:42.647317+0000","last_unstale":"2024-09-15T22:46:43.732214+0000","last_undegraded":"2024-09-15T22:46:43.732214+0000","last_fullsized":"2024-09-15T22:46:43.732214+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:40.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"121'6","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732123+0000","last_change":"2024-09-15T22:46:41.634748+0000","last_active":"2024-09-15T22:46:43.732123+0000","last_peered":"2024-09-15T22:46:43.732123+0000","last_clean":"2024-09-15T22:46:43.732123+0000","last_became_active":"2024-09-15T22:46:41.634461+0000","last_became_peered":"2024-09-15T22:46:41.634461+0000","last_unstale":"2024-09-15T22:46:43.732123+0000","last_undegraded":"2024-09-15T22:46:43.732123+0000","last_fullsized":"2024-09-15T22:46:43.732123+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.669538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633065+0000","last_change":"2024-09-15T22:46:42.640573+0000","last_active":"2024-09-15T22:46:43.633065+0000","last_peered":"2024-09-15T22:46:43.633065+0000","last_clean":"2024-09-15T22:46:43.633065+0000","last_became_active":"2024-09-15T22:46:42.640296+0000","last_became_peered":"2024-09-15T22:46:42.640296+0000","last_unstale":"2024-09-15T22:46:43.633065+0000","last_undegraded":"2024-09-15T22:46:43.633065+0000","last_fullsized":"2024-09-15T22:46:43.633065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:02.335173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632236+0000","last_change":"2024-09-15T22:46:41.626980+0000","last_active":"2024-09-15T22:46:43.632236+0000","last_peered":"2024-09-15T22:46:43.632236+0000","last_clean":"2024-09-15T22:46:43.632236+0000","last_became_active":"2024-09-15T22:46:41.626709+0000","last_became_peered":"2024-09-15T22:46:41.626709+0000","last_unstale":"2024-09-15T22:46:43.632236+0000","last_undegraded":"2024-09-15T22:46:43.632236+0000","last_fullsized":"2024-09-15T22:46:43.632236+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:40.526854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632988+0000","last_change":"2024-09-15T22:46:42.627156+0000","last_active":"2024-09-15T22:46:43.632988+0000","last_peered":"2024-09-15T22:46:43.632988+0000","last_clean":"2024-09-15T22:46:43.632988+0000","last_became_active":"2024-09-15T22:46:42.625608+0000","last_became_peered":"2024-09-15T22:46:42.625608+0000","last_unstale":"2024-09-15T22:46:43.632988+0000","last_undegraded":"2024-09-15T22:46:43.632988+0000","last_fullsized":"2024-09-15T22:46:43.632988+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:53.981855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732203+0000","last_change":"2024-09-15T22:46:41.635999+0000","last_active":"2024-09-15T22:46:43.732203+0000","last_peered":"2024-09-15T22:46:43.732203+0000","last_clean":"2024-09-15T22:46:43.732203+0000","last_became_active":"2024-09-15T22:46:41.635675+0000","last_became_peered":"2024-09-15T22:46:41.635675+0000","last_unstale":"2024-09-15T22:46:43.732203+0000","last_undegraded":"2024-09-15T22:46:43.732203+0000","last_fullsized":"2024-09-15T22:46:43.732203+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:15.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631540+0000","last_change":"2024-09-15T22:46:42.646071+0000","last_active":"2024-09-15T22:46:43.631540+0000","last_peered":"2024-09-15T22:46:43.631540+0000","last_clean":"2024-09-15T22:46:43.631540+0000","last_became_active":"2024-09-15T22:46:42.645836+0000","last_became_peered":"2024-09-15T22:46:42.645836+0000","last_unstale":"2024-09-15T22:46:43.631540+0000","last_undegraded":"2024-09-15T22:46:43.631540+0000","last_fullsized":"2024-09-15T22:46:43.631540+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:56.063750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"121'8","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631513+0000","last_change":"2024-09-15T22:46:41.634008+0000","last_active":"2024-09-15T22:46:43.631513+0000","last_peered":"2024-09-15T22:46:43.631513+0000","last_clean":"2024-09-15T22:46:43.631513+0000","last_became_active":"2024-09-15T22:46:41.633721+0000","last_became_peered":"2024-09-15T22:46:41.633721+0000","last_unstale":"2024-09-15T22:46:43.631513+0000","last_undegraded":"2024-09-15T22:46:43.631513+0000","last_fullsized":"2024-09-15T22:46:43.631513+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:44.232277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732101+0000","last_change":"2024-09-15T22:46:42.634165+0000","last_active":"2024-09-15T22:46:43.732101+0000","last_peered":"2024-09-15T22:46:43.732101+0000","last_clean":"2024-09-15T22:46:43.732101+0000","last_became_active":"2024-09-15T22:46:42.633901+0000","last_became_peered":"2024-09-15T22:46:42.633901+0000","last_unstale":"2024-09-15T22:46:43.732101+0000","last_undegraded":"2024-09-15T22:46:43.732101+0000","last_fullsized":"2024-09-15T22:46:43.732101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.836981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632026+0000","last_change":"2024-09-15T22:46:41.637476+0000","last_active":"2024-09-15T22:46:43.632026+0000","last_peered":"2024-09-15T22:46:43.632026+0000","last_clean":"2024-09-15T22:46:43.632026+0000","last_became_active":"2024-09-15T22:46:41.636964+0000","last_became_peered":"2024-09-15T22:46:41.636964+0000","last_unstale":"2024-09-15T22:46:43.632026+0000","last_undegraded":"2024-09-15T22:46:43.632026+0000","last_fullsized":"2024-09-15T22:46:43.632026+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.020034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732165+0000","last_change":"2024-09-15T22:46:42.643797+0000","last_active":"2024-09-15T22:46:43.732165+0000","last_peered":"2024-09-15T22:46:43.732165+0000","last_clean":"2024-09-15T22:46:43.732165+0000","last_became_active":"2024-09-15T22:46:42.643516+0000","last_became_peered":"2024-09-15T22:46:42.643516+0000","last_unstale":"2024-09-15T22:46:43.732165+0000","last_undegraded":"2024-09-15T22:46:43.732165+0000","last_fullsized":"2024-09-15T22:46:43.732165+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:57.348375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732818+0000","last_change":"2024-09-15T22:46:41.630408+0000","last_active":"2024-09-15T22:46:43.732818+0000","last_peered":"2024-09-15T22:46:43.732818+0000","last_clean":"2024-09-15T22:46:43.732818+0000","last_became_active":"2024-09-15T22:46:41.630125+0000","last_became_peered":"2024-09-15T22:46:41.630125+0000","last_unstale":"2024-09-15T22:46:43.732818+0000","last_undegraded":"2024-09-15T22:46:43.732818+0000","last_fullsized":"2024-09-15T22:46:43.732818+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:08.794502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633236+0000","last_change":"2024-09-15T22:46:42.637892+0000","last_active":"2024-09-15T22:46:43.633236+0000","last_peered":"2024-09-15T22:46:43.633236+0000","last_clean":"2024-09-15T22:46:43.633236+0000","last_became_active":"2024-09-15T22:46:42.637268+0000","last_became_peered":"2024-09-15T22:46:42.637268+0000","last_unstale":"2024-09-15T22:46:43.633236+0000","last_undegraded":"2024-09-15T22:46:43.633236+0000","last_fullsized":"2024-09-15T22:46:43.633236+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:55.559856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732017+0000","last_change":"2024-09-15T22:46:41.635450+0000","last_active":"2024-09-15T22:46:43.732017+0000","last_peered":"2024-09-15T22:46:43.732017+0000","last_clean":"2024-09-15T22:46:43.732017+0000","last_became_active":"2024-09-15T22:46:41.635105+0000","last_became_peered":"2024-09-15T22:46:41.635105+0000","last_unstale":"2024-09-15T22:46:43.732017+0000","last_undegraded":"2024-09-15T22:46:43.732017+0000","last_fullsized":"2024-09-15T22:46:43.732017+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:20.498079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633039+0000","last_change":"2024-09-15T22:46:42.642809+0000","last_active":"2024-09-15T22:46:43.633039+0000","last_peered":"2024-09-15T22:46:43.633039+0000","last_clean":"2024-09-15T22:46:43.633039+0000","last_became_active":"2024-09-15T22:46:42.642210+0000","last_became_peered":"2024-09-15T22:46:42.642210+0000","last_unstale":"2024-09-15T22:46:43.633039+0000","last_undegraded":"2024-09-15T22:46:43.633039+0000","last_fullsized":"2024-09-15T22:46:43.633039+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.935930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731891+0000","last_change":"2024-09-15T22:46:41.632765+0000","last_active":"2024-09-15T22:46:43.731891+0000","last_peered":"2024-09-15T22:46:43.731891+0000","last_clean":"2024-09-15T22:46:43.731891+0000","last_became_active":"2024-09-15T22:46:41.632486+0000","last_became_peered":"2024-09-15T22:46:41.632486+0000","last_unstale":"2024-09-15T22:46:43.731891+0000","last_undegraded":"2024-09-15T22:46:43.731891+0000","last_fullsized":"2024-09-15T22:46:43.731891+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:45.486697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633633+0000","last_change":"2024-09-15T22:46:42.632201+0000","last_active":"2024-09-15T22:46:43.633633+0000","last_peered":"2024-09-15T22:46:43.633633+0000","last_clean":"2024-09-15T22:46:43.633633+0000","last_became_active":"2024-09-15T22:46:42.631475+0000","last_became_peered":"2024-09-15T22:46:42.631475+0000","last_unstale":"2024-09-15T22:46:43.633633+0000","last_undegraded":"2024-09-15T22:46:43.633633+0000","last_fullsized":"2024-09-15T22:46:43.633633+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:57:26.779461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731683+0000","last_change":"2024-09-15T22:46:41.635456+0000","last_active":"2024-09-15T22:46:43.731683+0000","last_peered":"2024-09-15T22:46:43.731683+0000","last_clean":"2024-09-15T22:46:43.731683+0000","last_became_active":"2024-09-15T22:46:41.635135+0000","last_became_peered":"2024-09-15T22:46:41.635135+0000","last_unstale":"2024-09-15T22:46:43.731683+0000","last_undegraded":"2024-09-15T22:46:43.731683+0000","last_fullsized":"2024-09-15T22:46:43.731683+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.152465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731605+0000","last_change":"2024-09-15T22:46:42.633650+0000","last_active":"2024-09-15T22:46:43.731605+0000","last_peered":"2024-09-15T22:46:43.731605+0000","last_clean":"2024-09-15T22:46:43.731605+0000","last_became_active":"2024-09-15T22:46:42.633362+0000","last_became_peered":"2024-09-15T22:46:42.633362+0000","last_unstale":"2024-09-15T22:46:43.731605+0000","last_undegraded":"2024-09-15T22:46:43.731605+0000","last_fullsized":"2024-09-15T22:46:43.731605+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:46.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732156+0000","last_change":"2024-09-15T22:46:41.631832+0000","last_active":"2024-09-15T22:46:43.732156+0000","last_peered":"2024-09-15T22:46:43.732156+0000","last_clean":"2024-09-15T22:46:43.732156+0000","last_became_active":"2024-09-15T22:46:41.631510+0000","last_became_peered":"2024-09-15T22:46:41.631510+0000","last_unstale":"2024-09-15T22:46:43.732156+0000","last_undegraded":"2024-09-15T22:46:43.732156+0000","last_fullsized":"2024-09-15T22:46:43.732156+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:50.620428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632354+0000","last_change":"2024-09-15T22:46:42.634028+0000","last_active":"2024-09-15T22:46:43.632354+0000","last_peered":"2024-09-15T22:46:43.632354+0000","last_clean":"2024-09-15T22:46:43.632354+0000","last_became_active":"2024-09-15T22:46:42.633690+0000","last_became_peered":"2024-09-15T22:46:42.633690+0000","last_unstale":"2024-09-15T22:46:43.632354+0000","last_undegraded":"2024-09-15T22:46:43.632354+0000","last_fullsized":"2024-09-15T22:46:43.632354+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:30.088796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632341+0000","last_change":"2024-09-15T22:46:41.635616+0000","last_active":"2024-09-15T22:46:43.632341+0000","last_peered":"2024-09-15T22:46:43.632341+0000","last_clean":"2024-09-15T22:46:43.632341+0000","last_became_active":"2024-09-15T22:46:41.635280+0000","last_became_peered":"2024-09-15T22:46:41.635280+0000","last_unstale":"2024-09-15T22:46:43.632341+0000","last_undegraded":"2024-09-15T22:46:43.632341+0000","last_fullsized":"2024-09-15T22:46:43.632341+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:59.514386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631541+0000","last_change":"2024-09-15T22:46:42.645057+0000","last_active":"2024-09-15T22:46:43.631541+0000","last_peered":"2024-09-15T22:46:43.631541+0000","last_clean":"2024-09-15T22:46:43.631541+0000","last_became_active":"2024-09-15T22:46:42.644799+0000","last_became_peered":"2024-09-15T22:46:42.644799+0000","last_unstale":"2024-09-15T22:46:43.631541+0000","last_undegraded":"2024-09-15T22:46:43.631541+0000","last_fullsized":"2024-09-15T22:46:43.631541+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:20.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731809+0000","last_change":"2024-09-15T22:46:41.629982+0000","last_active":"2024-09-15T22:46:43.731809+0000","last_peered":"2024-09-15T22:46:43.731809+0000","last_clean":"2024-09-15T22:46:43.731809+0000","last_became_active":"2024-09-15T22:46:41.629685+0000","last_became_peered":"2024-09-15T22:46:41.629685+0000","last_unstale":"2024-09-15T22:46:43.731809+0000","last_undegraded":"2024-09-15T22:46:43.731809+0000","last_fullsized":"2024-09-15T22:46:43.731809+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:50.933742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731801+0000","last_change":"2024-09-15T22:46:42.648436+0000","last_active":"2024-09-15T22:46:43.731801+0000","last_peered":"2024-09-15T22:46:43.731801+0000","last_clean":"2024-09-15T22:46:43.731801+0000","last_became_active":"2024-09-15T22:46:42.648001+0000","last_became_peered":"2024-09-15T22:46:42.648001+0000","last_unstale":"2024-09-15T22:46:43.731801+0000","last_undegraded":"2024-09-15T22:46:43.731801+0000","last_fullsized":"2024-09-15T22:46:43.731801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:10.056791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732433+0000","last_change":"2024-09-15T22:46:41.633318+0000","last_active":"2024-09-15T22:46:43.732433+0000","last_peered":"2024-09-15T22:46:43.732433+0000","last_clean":"2024-09-15T22:46:43.732433+0000","last_became_active":"2024-09-15T22:46:41.633029+0000","last_became_peered":"2024-09-15T22:46:41.633029+0000","last_unstale":"2024-09-15T22:46:43.732433+0000","last_undegraded":"2024-09-15T22:46:43.732433+0000","last_fullsized":"2024-09-15T22:46:43.732433+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:39.934465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632686+0000","last_change":"2024-09-15T22:46:42.635224+0000","last_active":"2024-09-15T22:46:43.632686+0000","last_peered":"2024-09-15T22:46:43.632686+0000","last_clean":"2024-09-15T22:46:43.632686+0000","last_became_active":"2024-09-15T22:46:42.634987+0000","last_became_peered":"2024-09-15T22:46:42.634987+0000","last_unstale":"2024-09-15T22:46:43.632686+0000","last_undegraded":"2024-09-15T22:46:43.632686+0000","last_fullsized":"2024-09-15T22:46:43.632686+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:35.903209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732185+0000","last_change":"2024-09-15T22:46:41.637794+0000","last_active":"2024-09-15T22:46:43.732185+0000","last_peered":"2024-09-15T22:46:43.732185+0000","last_clean":"2024-09-15T22:46:43.732185+0000","last_became_active":"2024-09-15T22:46:41.637474+0000","last_became_peered":"2024-09-15T22:46:41.637474+0000","last_unstale":"2024-09-15T22:46:43.732185+0000","last_undegraded":"2024-09-15T22:46:43.732185+0000","last_fullsized":"2024-09-15T22:46:43.732185+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.484934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632711+0000","last_change":"2024-09-15T22:46:42.641734+0000","last_active":"2024-09-15T22:46:43.632711+0000","last_peered":"2024-09-15T22:46:43.632711+0000","last_clean":"2024-09-15T22:46:43.632711+0000","last_became_active":"2024-09-15T22:46:42.641448+0000","last_became_peered":"2024-09-15T22:46:42.641448+0000","last_unstale":"2024-09-15T22:46:43.632711+0000","last_undegraded":"2024-09-15T22:46:43.632711+0000","last_fullsized":"2024-09-15T22:46:43.632711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:13.864589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732334+0000","last_change":"2024-09-15T22:46:41.637018+0000","last_active":"2024-09-15T22:46:43.732334+0000","last_peered":"2024-09-15T22:46:43.732334+0000","last_clean":"2024-09-15T22:46:43.732334+0000","last_became_active":"2024-09-15T22:46:41.636696+0000","last_became_peered":"2024-09-15T22:46:41.636696+0000","last_unstale":"2024-09-15T22:46:43.732334+0000","last_undegraded":"2024-09-15T22:46:43.732334+0000","last_fullsized":"2024-09-15T22:46:43.732334+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:45.941332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731930+0000","last_change":"2024-09-15T22:46:42.633824+0000","last_active":"2024-09-15T22:46:43.731930+0000","last_peered":"2024-09-15T22:46:43.731930+0000","last_clean":"2024-09-15T22:46:43.731930+0000","last_became_active":"2024-09-15T22:46:42.633569+0000","last_became_peered":"2024-09-15T22:46:42.633569+0000","last_unstale":"2024-09-15T22:46:43.731930+0000","last_undegraded":"2024-09-15T22:46:43.731930+0000","last_fullsized":"2024-09-15T22:46:43.731930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:48.594990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632808+0000","last_change":"2024-09-15T22:46:41.626298+0000","last_active":"2024-09-15T22:46:43.632808+0000","last_peered":"2024-09-15T22:46:43.632808+0000","last_clean":"2024-09-15T22:46:43.632808+0000","last_became_active":"2024-09-15T22:46:41.625885+0000","last_became_peered":"2024-09-15T22:46:41.625885+0000","last_unstale":"2024-09-15T22:46:43.632808+0000","last_undegraded":"2024-09-15T22:46:43.632808+0000","last_fullsized":"2024-09-15T22:46:43.632808+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:26.849151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631592+0000","last_change":"2024-09-15T22:46:42.629690+0000","last_active":"2024-09-15T22:46:43.631592+0000","last_peered":"2024-09-15T22:46:43.631592+0000","last_clean":"2024-09-15T22:46:43.631592+0000","last_became_active":"2024-09-15T22:46:42.629362+0000","last_became_peered":"2024-09-15T22:46:42.629362+0000","last_unstale":"2024-09-15T22:46:43.631592+0000","last_undegraded":"2024-09-15T22:46:43.631592+0000","last_fullsized":"2024-09-15T22:46:43.631592+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:02.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633351+0000","last_change":"2024-09-15T22:46:41.628608+0000","last_active":"2024-09-15T22:46:43.633351+0000","last_peered":"2024-09-15T22:46:43.633351+0000","last_clean":"2024-09-15T22:46:43.633351+0000","last_became_active":"2024-09-15T22:46:41.628339+0000","last_became_peered":"2024-09-15T22:46:41.628339+0000","last_unstale":"2024-09-15T22:46:43.633351+0000","last_undegraded":"2024-09-15T22:46:43.633351+0000","last_fullsized":"2024-09-15T22:46:43.633351+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:59.962089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631767+0000","last_change":"2024-09-15T22:46:42.646094+0000","last_active":"2024-09-15T22:46:43.631767+0000","last_peered":"2024-09-15T22:46:43.631767+0000","last_clean":"2024-09-15T22:46:43.631767+0000","last_became_active":"2024-09-15T22:46:42.645870+0000","last_became_peered":"2024-09-15T22:46:42.645870+0000","last_unstale":"2024-09-15T22:46:43.631767+0000","last_undegraded":"2024-09-15T22:46:43.631767+0000","last_fullsized":"2024-09-15T22:46:43.631767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:59.818718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631652+0000","last_change":"2024-09-15T22:46:41.635924+0000","last_active":"2024-09-15T22:46:43.631652+0000","last_peered":"2024-09-15T22:46:43.631652+0000","last_clean":"2024-09-15T22:46:43.631652+0000","last_became_active":"2024-09-15T22:46:41.635467+0000","last_became_peered":"2024-09-15T22:46:41.635467+0000","last_unstale":"2024-09-15T22:46:43.631652+0000","last_undegraded":"2024-09-15T22:46:43.631652+0000","last_fullsized":"2024-09-15T22:46:43.631652+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:06.797079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731901+0000","last_change":"2024-09-15T22:46:42.646916+0000","last_active":"2024-09-15T22:46:43.731901+0000","last_peered":"2024-09-15T22:46:43.731901+0000","last_clean":"2024-09-15T22:46:43.731901+0000","last_became_active":"2024-09-15T22:46:42.646598+0000","last_became_peered":"2024-09-15T22:46:42.646598+0000","last_unstale":"2024-09-15T22:46:43.731901+0000","last_undegraded":"2024-09-15T22:46:43.731901+0000","last_fullsized":"2024-09-15T22:46:43.731901+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:12.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732308+0000","last_change":"2024-09-15T22:46:41.636005+0000","last_active":"2024-09-15T22:46:43.732308+0000","last_peered":"2024-09-15T22:46:43.732308+0000","last_clean":"2024-09-15T22:46:43.732308+0000","last_became_active":"2024-09-15T22:46:41.635611+0000","last_became_peered":"2024-09-15T22:46:41.635611+0000","last_unstale":"2024-09-15T22:46:43.732308+0000","last_undegraded":"2024-09-15T22:46:43.732308+0000","last_fullsized":"2024-09-15T22:46:43.732308+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:34.901021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632232+0000","last_change":"2024-09-15T22:46:42.638426+0000","last_active":"2024-09-15T22:46:43.632232+0000","last_peered":"2024-09-15T22:46:43.632232+0000","last_clean":"2024-09-15T22:46:43.632232+0000","last_became_active":"2024-09-15T22:46:42.638123+0000","last_became_peered":"2024-09-15T22:46:42.638123+0000","last_unstale":"2024-09-15T22:46:43.632232+0000","last_undegraded":"2024-09-15T22:46:43.632232+0000","last_fullsized":"2024-09-15T22:46:43.632232+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:43.545449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632450+0000","last_change":"2024-09-15T22:46:41.626572+0000","last_active":"2024-09-15T22:46:43.632450+0000","last_peered":"2024-09-15T22:46:43.632450+0000","last_clean":"2024-09-15T22:46:43.632450+0000","last_became_active":"2024-09-15T22:46:41.626269+0000","last_became_peered":"2024-09-15T22:46:41.626269+0000","last_unstale":"2024-09-15T22:46:43.632450+0000","last_undegraded":"2024-09-15T22:46:43.632450+0000","last_fullsized":"2024-09-15T22:46:43.632450+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:17.793711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732445+0000","last_change":"2024-09-15T22:46:42.641316+0000","last_active":"2024-09-15T22:46:43.732445+0000","last_peered":"2024-09-15T22:46:43.732445+0000","last_clean":"2024-09-15T22:46:43.732445+0000","last_became_active":"2024-09-15T22:46:42.641069+0000","last_became_peered":"2024-09-15T22:46:42.641069+0000","last_unstale":"2024-09-15T22:46:43.732445+0000","last_undegraded":"2024-09-15T22:46:43.732445+0000","last_fullsized":"2024-09-15T22:46:43.732445+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:19.293812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631964+0000","last_change":"2024-09-15T22:46:41.641080+0000","last_active":"2024-09-15T22:46:43.631964+0000","last_peered":"2024-09-15T22:46:43.631964+0000","last_clean":"2024-09-15T22:46:43.631964+0000","last_became_active":"2024-09-15T22:46:41.640738+0000","last_became_peered":"2024-09-15T22:46:41.640738+0000","last_unstale":"2024-09-15T22:46:43.631964+0000","last_undegraded":"2024-09-15T22:46:43.631964+0000","last_fullsized":"2024-09-15T22:46:43.631964+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:19.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":393,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731224+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:46:43.731224+0000","last_peered":"2024-09-15T22:46:43.731224+0000","last_clean":"2024-09-15T22:46:43.731224+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:46:43.731224+0000","last_undegraded":"2024-09-15T22:46:43.731224+0000","last_fullsized":"2024-09-15T22:46:43.731224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1519616,"data_stored":666029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1515520,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509510,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":1257105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1515520,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1519616,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1523712,"data_stored":666667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2125824,"data_stored":1257997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509511,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1536000,"data_stored":667663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:46:50.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:46:50.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 Processor -- start 2024-09-15T22:46:50.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 -- start start 2024-09-15T22:46:50.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffabc15ed20 0x7ffabc0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffabc0b7170 con 0x7ffabc0cef90 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ffabc0d1ae0 con 0x7ffabc15ed20 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.370+0000 7ffac179f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffabc0b7aa0 con 0x7ffabc15e940 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffabaffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffaba7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffabc15ed20 0x7ffabc0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffabb7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffabc0cef90 0x7ffabc0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:47230/0 (socket says 172.21.15.134:47230) 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffabaffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:34884/0 (socket says 172.21.15.134:34884) 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffabb7fe640 1 -- 172.21.15.134:0/4088526844 learned_addr learned my addr 172.21.15.134:0/4088526844 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffaba7fc640 1 -- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 msgr2=0x7ffabc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffaba7fc640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffaba7fc640 1 -- 172.21.15.134:0/4088526844 >> v1:172.21.15.177:6789/0 conn(0x7ffabc0cef90 legacy=0x7ffabc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffaba7fc640 1 -- 172.21.15.134:0/4088526844 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc0d3660 con 0x7ffabc15ed20 2024-09-15T22:46:50.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.371+0000 7ffabaffd640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.372+0000 7ffaba7fc640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15ed20 0x7ffabc0d15a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40097a0 tx=0x7ffaa402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496f4f002f9b27ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.372+0000 7ffab9ffb640 1 -- 172.21.15.134:0/4088526844 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4037070 con 0x7ffabc15ed20 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.372+0000 7ffab9ffb640 1 -- 172.21.15.134:0/4088526844 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa4032440 con 0x7ffabc15ed20 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.372+0000 7ffab9ffb640 1 -- 172.21.15.134:0/4088526844 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4032810 con 0x7ffabc15ed20 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 -- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15ed20 msgr2=0x7ffabc0d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15ed20 0x7ffabc0d15a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40097a0 tx=0x7ffaa402a210 comp rx=0 tx=0).stop 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 -- 172.21.15.134:0/4088526844 shutdown_connections 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15ed20 0x7ffabc0d15a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 --2- 172.21.15.134:0/4088526844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15e940 0x7ffabc0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 -- 172.21.15.134:0/4088526844 >> 172.21.15.134:0/4088526844 conn(0x7ffabc0b6240 msgr2=0x7ffabc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 -- 172.21.15.134:0/4088526844 shutdown_connections 2024-09-15T22:46:50.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.373+0000 7ffac179f640 1 -- 172.21.15.134:0/4088526844 wait complete. 2024-09-15T22:46:50.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.374+0000 7ffac179f640 1 Processor -- start 2024-09-15T22:46:50.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.374+0000 7ffac179f640 1 -- start start 2024-09-15T22:46:50.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15e940 0x7ffabc1e7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15ed20 0x7ffabc158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc0d3f00 con 0x7ffabc0cef90 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc0d3c20 con 0x7ffabc15e940 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffac179f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffabc0d3310 con 0x7ffabc15ed20 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38406/0 (socket says 172.21.15.134:38406) 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 -- 172.21.15.134:0/1996263261 learned_addr learned my addr 172.21.15.134:0/1996263261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffaba7fc640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15e940 0x7ffabc1e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabb7fe640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15ed20 0x7ffabc158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 -- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15ed20 msgr2=0x7ffabc158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15ed20 0x7ffabc158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 -- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15e940 msgr2=0x7ffabc1e7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15e940 0x7ffabc1e7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.375+0000 7ffabaffd640 1 -- 172.21.15.134:0/1996263261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc145e00 con 0x7ffabc0cef90 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffabaffd640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ffab400efc0 tx=0x7ffab400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4018020 con 0x7ffabc0cef90 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4014680 con 0x7ffabc0cef90 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc1460e0 con 0x7ffabc0cef90 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4014a50 con 0x7ffabc0cef90 2024-09-15T22:46:50.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.376+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc146980 con 0x7ffabc0cef90 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.377+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffabc0d1ef0 con 0x7ffabc0cef90 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.377+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7ffab4005d10 con 0x7ffabc0cef90 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.378+0000 7ffab37fe640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 0x7ffa9c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.378+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7ffab408ca60 con 0x7ffabc0cef90 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.378+0000 7ffaba7fc640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 0x7ffa9c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.378+0000 7ffaba7fc640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 0x7ffa9c06eb60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4034000 tx=0x7ffaa402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.382+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffab4022030 con 0x7ffabc0cef90 2024-09-15T22:46:50.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.544+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffabc0ba6b0 con 0x7ffa9c06c6a0 2024-09-15T22:46:50.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.550+0000 7ffab37fe640 1 -- 172.21.15.134:0/1996263261 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7ffabc0ba6b0 con 0x7ffa9c06c6a0 2024-09-15T22:46:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:50.556 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 msgr2=0x7ffa9c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 0x7ffa9c06eb60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4034000 tx=0x7ffaa402e000 comp rx=0 tx=0).stop 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 msgr2=0x7ffabc147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ffab400efc0 tx=0x7ffab400c490 comp rx=0 tx=0).stop 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 shutdown_connections 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc15ed20 0x7ffabc158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc15e940 0x7ffabc1e7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa9c06c6a0 0x7ffa9c06eb60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 --2- 172.21.15.134:0/1996263261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffabc0cef90 0x7ffabc147c90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 >> 172.21.15.134:0/1996263261 conn(0x7ffabc0b6240 msgr2=0x7ffabc15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:50.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 shutdown_connections 2024-09-15T22:46:50.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.554+0000 7ffac179f640 1 -- 172.21.15.134:0/1996263261 wait complete. 2024-09-15T22:46:50.566 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-15T22:46:49.202631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262600,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712120,"statfs":{"total":773094113280,"available":772825210880,"internally_reserved":0,"allocated":13377536,"data_stored":6513516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.586444"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632407+0000","last_change":"2024-09-15T22:46:42.634623+0000","last_active":"2024-09-15T22:46:43.632407+0000","last_peered":"2024-09-15T22:46:43.632407+0000","last_clean":"2024-09-15T22:46:43.632407+0000","last_became_active":"2024-09-15T22:46:42.634296+0000","last_became_peered":"2024-09-15T22:46:42.634296+0000","last_unstale":"2024-09-15T22:46:43.632407+0000","last_undegraded":"2024-09-15T22:46:43.632407+0000","last_fullsized":"2024-09-15T22:46:43.632407+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:35.596238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633207+0000","last_change":"2024-09-15T22:46:42.638516+0000","last_active":"2024-09-15T22:46:43.633207+0000","last_peered":"2024-09-15T22:46:43.633207+0000","last_clean":"2024-09-15T22:46:43.633207+0000","last_became_active":"2024-09-15T22:46:42.637582+0000","last_became_peered":"2024-09-15T22:46:42.637582+0000","last_unstale":"2024-09-15T22:46:43.633207+0000","last_undegraded":"2024-09-15T22:46:43.633207+0000","last_fullsized":"2024-09-15T22:46:43.633207+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:16.561559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731805+0000","last_change":"2024-09-15T22:46:42.634428+0000","last_active":"2024-09-15T22:46:43.731805+0000","last_peered":"2024-09-15T22:46:43.731805+0000","last_clean":"2024-09-15T22:46:43.731805+0000","last_became_active":"2024-09-15T22:46:42.634197+0000","last_became_peered":"2024-09-15T22:46:42.634197+0000","last_unstale":"2024-09-15T22:46:43.731805+0000","last_undegraded":"2024-09-15T22:46:43.731805+0000","last_fullsized":"2024-09-15T22:46:43.731805+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:25.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732792+0000","last_change":"2024-09-15T22:46:42.647609+0000","last_active":"2024-09-15T22:46:43.732792+0000","last_peered":"2024-09-15T22:46:43.732792+0000","last_clean":"2024-09-15T22:46:43.732792+0000","last_became_active":"2024-09-15T22:46:42.647329+0000","last_became_peered":"2024-09-15T22:46:42.647329+0000","last_unstale":"2024-09-15T22:46:43.732792+0000","last_undegraded":"2024-09-15T22:46:43.732792+0000","last_fullsized":"2024-09-15T22:46:43.732792+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:58.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731567+0000","last_change":"2024-09-15T22:46:42.647678+0000","last_active":"2024-09-15T22:46:43.731567+0000","last_peered":"2024-09-15T22:46:43.731567+0000","last_clean":"2024-09-15T22:46:43.731567+0000","last_became_active":"2024-09-15T22:46:42.647338+0000","last_became_peered":"2024-09-15T22:46:42.647338+0000","last_unstale":"2024-09-15T22:46:43.731567+0000","last_undegraded":"2024-09-15T22:46:43.731567+0000","last_fullsized":"2024-09-15T22:46:43.731567+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:15.504000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631549+0000","last_change":"2024-09-15T22:46:42.639540+0000","last_active":"2024-09-15T22:46:43.631549+0000","last_peered":"2024-09-15T22:46:43.631549+0000","last_clean":"2024-09-15T22:46:43.631549+0000","last_became_active":"2024-09-15T22:46:42.639302+0000","last_became_peered":"2024-09-15T22:46:42.639302+0000","last_unstale":"2024-09-15T22:46:43.631549+0000","last_undegraded":"2024-09-15T22:46:43.631549+0000","last_fullsized":"2024-09-15T22:46:43.631549+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:24.882815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731878+0000","last_change":"2024-09-15T22:46:42.640949+0000","last_active":"2024-09-15T22:46:43.731878+0000","last_peered":"2024-09-15T22:46:43.731878+0000","last_clean":"2024-09-15T22:46:43.731878+0000","last_became_active":"2024-09-15T22:46:42.640683+0000","last_became_peered":"2024-09-15T22:46:42.640683+0000","last_unstale":"2024-09-15T22:46:43.731878+0000","last_undegraded":"2024-09-15T22:46:43.731878+0000","last_fullsized":"2024-09-15T22:46:43.731878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:58.022222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731365+0000","last_change":"2024-09-15T22:46:42.638327+0000","last_active":"2024-09-15T22:46:43.731365+0000","last_peered":"2024-09-15T22:46:43.731365+0000","last_clean":"2024-09-15T22:46:43.731365+0000","last_became_active":"2024-09-15T22:46:42.638069+0000","last_became_peered":"2024-09-15T22:46:42.638069+0000","last_unstale":"2024-09-15T22:46:43.731365+0000","last_undegraded":"2024-09-15T22:46:43.731365+0000","last_fullsized":"2024-09-15T22:46:43.731365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.234466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732511+0000","last_change":"2024-09-15T22:46:42.635529+0000","last_active":"2024-09-15T22:46:43.732511+0000","last_peered":"2024-09-15T22:46:43.732511+0000","last_clean":"2024-09-15T22:46:43.732511+0000","last_became_active":"2024-09-15T22:46:42.635293+0000","last_became_peered":"2024-09-15T22:46:42.635293+0000","last_unstale":"2024-09-15T22:46:43.732511+0000","last_undegraded":"2024-09-15T22:46:43.732511+0000","last_fullsized":"2024-09-15T22:46:43.732511+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:33.240060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633346+0000","last_change":"2024-09-15T22:46:42.638192+0000","last_active":"2024-09-15T22:46:43.633346+0000","last_peered":"2024-09-15T22:46:43.633346+0000","last_clean":"2024-09-15T22:46:43.633346+0000","last_became_active":"2024-09-15T22:46:42.637906+0000","last_became_peered":"2024-09-15T22:46:42.637906+0000","last_unstale":"2024-09-15T22:46:43.633346+0000","last_undegraded":"2024-09-15T22:46:43.633346+0000","last_fullsized":"2024-09-15T22:46:43.633346+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:32.973241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732346+0000","last_change":"2024-09-15T22:46:42.639131+0000","last_active":"2024-09-15T22:46:43.732346+0000","last_peered":"2024-09-15T22:46:43.732346+0000","last_clean":"2024-09-15T22:46:43.732346+0000","last_became_active":"2024-09-15T22:46:42.638603+0000","last_became_peered":"2024-09-15T22:46:42.638603+0000","last_unstale":"2024-09-15T22:46:43.732346+0000","last_undegraded":"2024-09-15T22:46:43.732346+0000","last_fullsized":"2024-09-15T22:46:43.732346+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:57:26.779461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631813+0000","last_change":"2024-09-15T22:46:42.640367+0000","last_active":"2024-09-15T22:46:43.631813+0000","last_peered":"2024-09-15T22:46:43.631813+0000","last_clean":"2024-09-15T22:46:43.631813+0000","last_became_active":"2024-09-15T22:46:42.639818+0000","last_became_peered":"2024-09-15T22:46:42.639818+0000","last_unstale":"2024-09-15T22:46:43.631813+0000","last_undegraded":"2024-09-15T22:46:43.631813+0000","last_fullsized":"2024-09-15T22:46:43.631813+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:13.840109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732095+0000","last_change":"2024-09-15T22:46:42.636662+0000","last_active":"2024-09-15T22:46:43.732095+0000","last_peered":"2024-09-15T22:46:43.732095+0000","last_clean":"2024-09-15T22:46:43.732095+0000","last_became_active":"2024-09-15T22:46:42.635916+0000","last_became_peered":"2024-09-15T22:46:42.635916+0000","last_unstale":"2024-09-15T22:46:43.732095+0000","last_undegraded":"2024-09-15T22:46:43.732095+0000","last_fullsized":"2024-09-15T22:46:43.732095+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:36.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632475+0000","last_change":"2024-09-15T22:46:42.634480+0000","last_active":"2024-09-15T22:46:43.632475+0000","last_peered":"2024-09-15T22:46:43.632475+0000","last_clean":"2024-09-15T22:46:43.632475+0000","last_became_active":"2024-09-15T22:46:42.634194+0000","last_became_peered":"2024-09-15T22:46:42.634194+0000","last_unstale":"2024-09-15T22:46:43.632475+0000","last_undegraded":"2024-09-15T22:46:43.632475+0000","last_fullsized":"2024-09-15T22:46:43.632475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:00.806908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732296+0000","last_change":"2024-09-15T22:46:42.638763+0000","last_active":"2024-09-15T22:46:43.732296+0000","last_peered":"2024-09-15T22:46:43.732296+0000","last_clean":"2024-09-15T22:46:43.732296+0000","last_became_active":"2024-09-15T22:46:42.638490+0000","last_became_peered":"2024-09-15T22:46:42.638490+0000","last_unstale":"2024-09-15T22:46:43.732296+0000","last_undegraded":"2024-09-15T22:46:43.732296+0000","last_fullsized":"2024-09-15T22:46:43.732296+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:01.335663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632188+0000","last_change":"2024-09-15T22:46:42.630705+0000","last_active":"2024-09-15T22:46:43.632188+0000","last_peered":"2024-09-15T22:46:43.632188+0000","last_clean":"2024-09-15T22:46:43.632188+0000","last_became_active":"2024-09-15T22:46:42.630124+0000","last_became_peered":"2024-09-15T22:46:42.630124+0000","last_unstale":"2024-09-15T22:46:43.632188+0000","last_undegraded":"2024-09-15T22:46:43.632188+0000","last_fullsized":"2024-09-15T22:46:43.632188+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:24.288263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732601+0000","last_change":"2024-09-15T22:46:42.643055+0000","last_active":"2024-09-15T22:46:43.732601+0000","last_peered":"2024-09-15T22:46:43.732601+0000","last_clean":"2024-09-15T22:46:43.732601+0000","last_became_active":"2024-09-15T22:46:42.642794+0000","last_became_peered":"2024-09-15T22:46:42.642794+0000","last_unstale":"2024-09-15T22:46:43.732601+0000","last_undegraded":"2024-09-15T22:46:43.732601+0000","last_fullsized":"2024-09-15T22:46:43.732601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:55.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732516+0000","last_change":"2024-09-15T22:46:42.641584+0000","last_active":"2024-09-15T22:46:43.732516+0000","last_peered":"2024-09-15T22:46:43.732516+0000","last_clean":"2024-09-15T22:46:43.732516+0000","last_became_active":"2024-09-15T22:46:42.641324+0000","last_became_peered":"2024-09-15T22:46:42.641324+0000","last_unstale":"2024-09-15T22:46:43.732516+0000","last_undegraded":"2024-09-15T22:46:43.732516+0000","last_fullsized":"2024-09-15T22:46:43.732516+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:28.589672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632898+0000","last_change":"2024-09-15T22:46:42.631179+0000","last_active":"2024-09-15T22:46:43.632898+0000","last_peered":"2024-09-15T22:46:43.632898+0000","last_clean":"2024-09-15T22:46:43.632898+0000","last_became_active":"2024-09-15T22:46:42.630919+0000","last_became_peered":"2024-09-15T22:46:42.630919+0000","last_unstale":"2024-09-15T22:46:43.632898+0000","last_undegraded":"2024-09-15T22:46:43.632898+0000","last_fullsized":"2024-09-15T22:46:43.632898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:10.161933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732371+0000","last_change":"2024-09-15T22:46:42.641703+0000","last_active":"2024-09-15T22:46:43.732371+0000","last_peered":"2024-09-15T22:46:43.732371+0000","last_clean":"2024-09-15T22:46:43.732371+0000","last_became_active":"2024-09-15T22:46:42.641450+0000","last_became_peered":"2024-09-15T22:46:42.641450+0000","last_unstale":"2024-09-15T22:46:43.732371+0000","last_undegraded":"2024-09-15T22:46:43.732371+0000","last_fullsized":"2024-09-15T22:46:43.732371+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:31.522449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631577+0000","last_change":"2024-09-15T22:46:42.634642+0000","last_active":"2024-09-15T22:46:43.631577+0000","last_peered":"2024-09-15T22:46:43.631577+0000","last_clean":"2024-09-15T22:46:43.631577+0000","last_became_active":"2024-09-15T22:46:42.634219+0000","last_became_peered":"2024-09-15T22:46:42.634219+0000","last_unstale":"2024-09-15T22:46:43.631577+0000","last_undegraded":"2024-09-15T22:46:43.631577+0000","last_fullsized":"2024-09-15T22:46:43.631577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633567+0000","last_change":"2024-09-15T22:46:42.637103+0000","last_active":"2024-09-15T22:46:43.633567+0000","last_peered":"2024-09-15T22:46:43.633567+0000","last_clean":"2024-09-15T22:46:43.633567+0000","last_became_active":"2024-09-15T22:46:42.633667+0000","last_became_peered":"2024-09-15T22:46:42.633667+0000","last_unstale":"2024-09-15T22:46:43.633567+0000","last_undegraded":"2024-09-15T22:46:43.633567+0000","last_fullsized":"2024-09-15T22:46:43.633567+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:36.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731314+0000","last_change":"2024-09-15T22:46:42.636654+0000","last_active":"2024-09-15T22:46:43.731314+0000","last_peered":"2024-09-15T22:46:43.731314+0000","last_clean":"2024-09-15T22:46:43.731314+0000","last_became_active":"2024-09-15T22:46:42.636157+0000","last_became_peered":"2024-09-15T22:46:42.636157+0000","last_unstale":"2024-09-15T22:46:43.731314+0000","last_undegraded":"2024-09-15T22:46:43.731314+0000","last_fullsized":"2024-09-15T22:46:43.731314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:28.589672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731899+0000","last_change":"2024-09-15T22:46:42.645451+0000","last_active":"2024-09-15T22:46:43.731899+0000","last_peered":"2024-09-15T22:46:43.731899+0000","last_clean":"2024-09-15T22:46:43.731899+0000","last_became_active":"2024-09-15T22:46:42.645097+0000","last_became_peered":"2024-09-15T22:46:42.645097+0000","last_unstale":"2024-09-15T22:46:43.731899+0000","last_undegraded":"2024-09-15T22:46:43.731899+0000","last_fullsized":"2024-09-15T22:46:43.731899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.436898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732848+0000","last_change":"2024-09-15T22:46:42.640880+0000","last_active":"2024-09-15T22:46:43.732848+0000","last_peered":"2024-09-15T22:46:43.732848+0000","last_clean":"2024-09-15T22:46:43.732848+0000","last_became_active":"2024-09-15T22:46:42.640449+0000","last_became_peered":"2024-09-15T22:46:42.640449+0000","last_unstale":"2024-09-15T22:46:43.732848+0000","last_undegraded":"2024-09-15T22:46:43.732848+0000","last_fullsized":"2024-09-15T22:46:43.732848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:55.646363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633389+0000","last_change":"2024-09-15T22:46:42.634765+0000","last_active":"2024-09-15T22:46:43.633389+0000","last_peered":"2024-09-15T22:46:43.633389+0000","last_clean":"2024-09-15T22:46:43.633389+0000","last_became_active":"2024-09-15T22:46:42.634467+0000","last_became_peered":"2024-09-15T22:46:42.634467+0000","last_unstale":"2024-09-15T22:46:43.633389+0000","last_undegraded":"2024-09-15T22:46:43.633389+0000","last_fullsized":"2024-09-15T22:46:43.633389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:21.748623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632583+0000","last_change":"2024-09-15T22:46:42.629508+0000","last_active":"2024-09-15T22:46:43.632583+0000","last_peered":"2024-09-15T22:46:43.632583+0000","last_clean":"2024-09-15T22:46:43.632583+0000","last_became_active":"2024-09-15T22:46:42.629240+0000","last_became_peered":"2024-09-15T22:46:42.629240+0000","last_unstale":"2024-09-15T22:46:43.632583+0000","last_undegraded":"2024-09-15T22:46:43.632583+0000","last_fullsized":"2024-09-15T22:46:43.632583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:34.619116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732077+0000","last_change":"2024-09-15T22:46:42.634189+0000","last_active":"2024-09-15T22:46:43.732077+0000","last_peered":"2024-09-15T22:46:43.732077+0000","last_clean":"2024-09-15T22:46:43.732077+0000","last_became_active":"2024-09-15T22:46:42.633852+0000","last_became_peered":"2024-09-15T22:46:42.633852+0000","last_unstale":"2024-09-15T22:46:43.732077+0000","last_undegraded":"2024-09-15T22:46:43.732077+0000","last_fullsized":"2024-09-15T22:46:43.732077+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:40.489821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633254+0000","last_change":"2024-09-15T22:46:42.636587+0000","last_active":"2024-09-15T22:46:43.633254+0000","last_peered":"2024-09-15T22:46:43.633254+0000","last_clean":"2024-09-15T22:46:43.633254+0000","last_became_active":"2024-09-15T22:46:42.635352+0000","last_became_peered":"2024-09-15T22:46:42.635352+0000","last_unstale":"2024-09-15T22:46:43.633254+0000","last_undegraded":"2024-09-15T22:46:43.633254+0000","last_fullsized":"2024-09-15T22:46:43.633254+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:09.796690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633547+0000","last_change":"2024-09-15T22:46:42.632484+0000","last_active":"2024-09-15T22:46:43.633547+0000","last_peered":"2024-09-15T22:46:43.633547+0000","last_clean":"2024-09-15T22:46:43.633547+0000","last_became_active":"2024-09-15T22:46:42.631779+0000","last_became_peered":"2024-09-15T22:46:42.631779+0000","last_unstale":"2024-09-15T22:46:43.633547+0000","last_undegraded":"2024-09-15T22:46:43.633547+0000","last_fullsized":"2024-09-15T22:46:43.633547+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:48.711096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731456+0000","last_change":"2024-09-15T22:46:42.636432+0000","last_active":"2024-09-15T22:46:43.731456+0000","last_peered":"2024-09-15T22:46:43.731456+0000","last_clean":"2024-09-15T22:46:43.731456+0000","last_became_active":"2024-09-15T22:46:42.635870+0000","last_became_peered":"2024-09-15T22:46:42.635870+0000","last_unstale":"2024-09-15T22:46:43.731456+0000","last_undegraded":"2024-09-15T22:46:43.731456+0000","last_fullsized":"2024-09-15T22:46:43.731456+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.040320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731781+0000","last_change":"2024-09-15T22:46:42.637956+0000","last_active":"2024-09-15T22:46:43.731781+0000","last_peered":"2024-09-15T22:46:43.731781+0000","last_clean":"2024-09-15T22:46:43.731781+0000","last_became_active":"2024-09-15T22:46:42.637673+0000","last_became_peered":"2024-09-15T22:46:42.637673+0000","last_unstale":"2024-09-15T22:46:43.731781+0000","last_undegraded":"2024-09-15T22:46:43.731781+0000","last_fullsized":"2024-09-15T22:46:43.731781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:39.155708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632971+0000","last_change":"2024-09-15T22:46:42.625795+0000","last_active":"2024-09-15T22:46:43.632971+0000","last_peered":"2024-09-15T22:46:43.632971+0000","last_clean":"2024-09-15T22:46:43.632971+0000","last_became_active":"2024-09-15T22:46:42.625495+0000","last_became_peered":"2024-09-15T22:46:42.625495+0000","last_unstale":"2024-09-15T22:46:43.632971+0000","last_undegraded":"2024-09-15T22:46:43.632971+0000","last_fullsized":"2024-09-15T22:46:43.632971+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:45.910950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732307+0000","last_change":"2024-09-15T22:46:41.633396+0000","last_active":"2024-09-15T22:46:43.732307+0000","last_peered":"2024-09-15T22:46:43.732307+0000","last_clean":"2024-09-15T22:46:43.732307+0000","last_became_active":"2024-09-15T22:46:41.632887+0000","last_became_peered":"2024-09-15T22:46:41.632887+0000","last_unstale":"2024-09-15T22:46:43.732307+0000","last_undegraded":"2024-09-15T22:46:43.732307+0000","last_fullsized":"2024-09-15T22:46:43.732307+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:39.487633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732647+0000","last_change":"2024-09-15T22:46:42.642421+0000","last_active":"2024-09-15T22:46:43.732647+0000","last_peered":"2024-09-15T22:46:43.732647+0000","last_clean":"2024-09-15T22:46:43.732647+0000","last_became_active":"2024-09-15T22:46:42.642166+0000","last_became_peered":"2024-09-15T22:46:42.642166+0000","last_unstale":"2024-09-15T22:46:43.732647+0000","last_undegraded":"2024-09-15T22:46:43.732647+0000","last_fullsized":"2024-09-15T22:46:43.732647+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:13.975878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732356+0000","last_change":"2024-09-15T22:46:41.637052+0000","last_active":"2024-09-15T22:46:43.732356+0000","last_peered":"2024-09-15T22:46:43.732356+0000","last_clean":"2024-09-15T22:46:43.732356+0000","last_became_active":"2024-09-15T22:46:41.636779+0000","last_became_peered":"2024-09-15T22:46:41.636779+0000","last_unstale":"2024-09-15T22:46:43.732356+0000","last_undegraded":"2024-09-15T22:46:43.732356+0000","last_fullsized":"2024-09-15T22:46:43.732356+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:06.300428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731659+0000","last_change":"2024-09-15T22:46:42.638022+0000","last_active":"2024-09-15T22:46:43.731659+0000","last_peered":"2024-09-15T22:46:43.731659+0000","last_clean":"2024-09-15T22:46:43.731659+0000","last_became_active":"2024-09-15T22:46:42.637720+0000","last_became_peered":"2024-09-15T22:46:42.637720+0000","last_unstale":"2024-09-15T22:46:43.731659+0000","last_undegraded":"2024-09-15T22:46:43.731659+0000","last_fullsized":"2024-09-15T22:46:43.731659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:57.232269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732441+0000","last_change":"2024-09-15T22:46:41.630313+0000","last_active":"2024-09-15T22:46:43.732441+0000","last_peered":"2024-09-15T22:46:43.732441+0000","last_clean":"2024-09-15T22:46:43.732441+0000","last_became_active":"2024-09-15T22:46:41.629752+0000","last_became_peered":"2024-09-15T22:46:41.629752+0000","last_unstale":"2024-09-15T22:46:43.732441+0000","last_undegraded":"2024-09-15T22:46:43.732441+0000","last_fullsized":"2024-09-15T22:46:43.732441+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:54.557667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631962+0000","last_change":"2024-09-15T22:46:42.631811+0000","last_active":"2024-09-15T22:46:43.631962+0000","last_peered":"2024-09-15T22:46:43.631962+0000","last_clean":"2024-09-15T22:46:43.631962+0000","last_became_active":"2024-09-15T22:46:42.631554+0000","last_became_peered":"2024-09-15T22:46:42.631554+0000","last_unstale":"2024-09-15T22:46:43.631962+0000","last_undegraded":"2024-09-15T22:46:43.631962+0000","last_fullsized":"2024-09-15T22:46:43.631962+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:35.596238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633322+0000","last_change":"2024-09-15T22:46:41.633208+0000","last_active":"2024-09-15T22:46:43.633322+0000","last_peered":"2024-09-15T22:46:43.633322+0000","last_clean":"2024-09-15T22:46:43.633322+0000","last_became_active":"2024-09-15T22:46:41.632913+0000","last_became_peered":"2024-09-15T22:46:41.632913+0000","last_unstale":"2024-09-15T22:46:43.633322+0000","last_undegraded":"2024-09-15T22:46:43.633322+0000","last_fullsized":"2024-09-15T22:46:43.633322+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:18.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731989+0000","last_change":"2024-09-15T22:46:42.643116+0000","last_active":"2024-09-15T22:46:43.731989+0000","last_peered":"2024-09-15T22:46:43.731989+0000","last_clean":"2024-09-15T22:46:43.731989+0000","last_became_active":"2024-09-15T22:46:42.642850+0000","last_became_peered":"2024-09-15T22:46:42.642850+0000","last_unstale":"2024-09-15T22:46:43.731989+0000","last_undegraded":"2024-09-15T22:46:43.731989+0000","last_fullsized":"2024-09-15T22:46:43.731989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:40.859787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633275+0000","last_change":"2024-09-15T22:46:41.625300+0000","last_active":"2024-09-15T22:46:43.633275+0000","last_peered":"2024-09-15T22:46:43.633275+0000","last_clean":"2024-09-15T22:46:43.633275+0000","last_became_active":"2024-09-15T22:46:41.624984+0000","last_became_peered":"2024-09-15T22:46:41.624984+0000","last_unstale":"2024-09-15T22:46:43.633275+0000","last_undegraded":"2024-09-15T22:46:43.633275+0000","last_fullsized":"2024-09-15T22:46:43.633275+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:50.636464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631765+0000","last_change":"2024-09-15T22:46:42.635292+0000","last_active":"2024-09-15T22:46:43.631765+0000","last_peered":"2024-09-15T22:46:43.631765+0000","last_clean":"2024-09-15T22:46:43.631765+0000","last_became_active":"2024-09-15T22:46:42.635038+0000","last_became_peered":"2024-09-15T22:46:42.635038+0000","last_unstale":"2024-09-15T22:46:43.631765+0000","last_undegraded":"2024-09-15T22:46:43.631765+0000","last_fullsized":"2024-09-15T22:46:43.631765+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:23.762096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732092+0000","last_change":"2024-09-15T22:46:41.632960+0000","last_active":"2024-09-15T22:46:43.732092+0000","last_peered":"2024-09-15T22:46:43.732092+0000","last_clean":"2024-09-15T22:46:43.732092+0000","last_became_active":"2024-09-15T22:46:41.632657+0000","last_became_peered":"2024-09-15T22:46:41.632657+0000","last_unstale":"2024-09-15T22:46:43.732092+0000","last_undegraded":"2024-09-15T22:46:43.732092+0000","last_fullsized":"2024-09-15T22:46:43.732092+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:03.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631555+0000","last_change":"2024-09-15T22:46:42.644549+0000","last_active":"2024-09-15T22:46:43.631555+0000","last_peered":"2024-09-15T22:46:43.631555+0000","last_clean":"2024-09-15T22:46:43.631555+0000","last_became_active":"2024-09-15T22:46:42.644129+0000","last_became_peered":"2024-09-15T22:46:42.644129+0000","last_unstale":"2024-09-15T22:46:43.631555+0000","last_undegraded":"2024-09-15T22:46:43.631555+0000","last_fullsized":"2024-09-15T22:46:43.631555+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:34.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732111+0000","last_change":"2024-09-15T22:46:41.629042+0000","last_active":"2024-09-15T22:46:43.732111+0000","last_peered":"2024-09-15T22:46:43.732111+0000","last_clean":"2024-09-15T22:46:43.732111+0000","last_became_active":"2024-09-15T22:46:41.628771+0000","last_became_peered":"2024-09-15T22:46:41.628771+0000","last_unstale":"2024-09-15T22:46:43.732111+0000","last_undegraded":"2024-09-15T22:46:43.732111+0000","last_fullsized":"2024-09-15T22:46:43.732111+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:59.398012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632262+0000","last_change":"2024-09-15T22:46:42.633303+0000","last_active":"2024-09-15T22:46:43.632262+0000","last_peered":"2024-09-15T22:46:43.632262+0000","last_clean":"2024-09-15T22:46:43.632262+0000","last_became_active":"2024-09-15T22:46:42.633040+0000","last_became_peered":"2024-09-15T22:46:42.633040+0000","last_unstale":"2024-09-15T22:46:43.632262+0000","last_undegraded":"2024-09-15T22:46:43.632262+0000","last_fullsized":"2024-09-15T22:46:43.632262+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:07.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632811+0000","last_change":"2024-09-15T22:46:41.629205+0000","last_active":"2024-09-15T22:46:43.632811+0000","last_peered":"2024-09-15T22:46:43.632811+0000","last_clean":"2024-09-15T22:46:43.632811+0000","last_became_active":"2024-09-15T22:46:41.628999+0000","last_became_peered":"2024-09-15T22:46:41.628999+0000","last_unstale":"2024-09-15T22:46:43.632811+0000","last_undegraded":"2024-09-15T22:46:43.632811+0000","last_fullsized":"2024-09-15T22:46:43.632811+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:55.152314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633451+0000","last_change":"2024-09-15T22:46:42.642652+0000","last_active":"2024-09-15T22:46:43.633451+0000","last_peered":"2024-09-15T22:46:43.633451+0000","last_clean":"2024-09-15T22:46:43.633451+0000","last_became_active":"2024-09-15T22:46:42.642389+0000","last_became_peered":"2024-09-15T22:46:42.642389+0000","last_unstale":"2024-09-15T22:46:43.633451+0000","last_undegraded":"2024-09-15T22:46:43.633451+0000","last_fullsized":"2024-09-15T22:46:43.633451+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:49.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631976+0000","last_change":"2024-09-15T22:46:41.641108+0000","last_active":"2024-09-15T22:46:43.631976+0000","last_peered":"2024-09-15T22:46:43.631976+0000","last_clean":"2024-09-15T22:46:43.631976+0000","last_became_active":"2024-09-15T22:46:41.640839+0000","last_became_peered":"2024-09-15T22:46:41.640839+0000","last_unstale":"2024-09-15T22:46:43.631976+0000","last_undegraded":"2024-09-15T22:46:43.631976+0000","last_fullsized":"2024-09-15T22:46:43.631976+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:14.501812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732035+0000","last_change":"2024-09-15T22:46:42.638848+0000","last_active":"2024-09-15T22:46:43.732035+0000","last_peered":"2024-09-15T22:46:43.732035+0000","last_clean":"2024-09-15T22:46:43.732035+0000","last_became_active":"2024-09-15T22:46:42.638581+0000","last_became_peered":"2024-09-15T22:46:42.638581+0000","last_unstale":"2024-09-15T22:46:43.732035+0000","last_undegraded":"2024-09-15T22:46:43.732035+0000","last_fullsized":"2024-09-15T22:46:43.732035+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:07.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732612+0000","last_change":"2024-09-15T22:46:41.628614+0000","last_active":"2024-09-15T22:46:43.732612+0000","last_peered":"2024-09-15T22:46:43.732612+0000","last_clean":"2024-09-15T22:46:43.732612+0000","last_became_active":"2024-09-15T22:46:41.628338+0000","last_became_peered":"2024-09-15T22:46:41.628338+0000","last_unstale":"2024-09-15T22:46:43.732612+0000","last_undegraded":"2024-09-15T22:46:43.732612+0000","last_fullsized":"2024-09-15T22:46:43.732612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:28.963567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631868+0000","last_change":"2024-09-15T22:46:42.640567+0000","last_active":"2024-09-15T22:46:43.631868+0000","last_peered":"2024-09-15T22:46:43.631868+0000","last_clean":"2024-09-15T22:46:43.631868+0000","last_became_active":"2024-09-15T22:46:42.640137+0000","last_became_peered":"2024-09-15T22:46:42.640137+0000","last_unstale":"2024-09-15T22:46:43.631868+0000","last_undegraded":"2024-09-15T22:46:43.631868+0000","last_fullsized":"2024-09-15T22:46:43.631868+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:07.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732292+0000","last_change":"2024-09-15T22:46:41.633198+0000","last_active":"2024-09-15T22:46:43.732292+0000","last_peered":"2024-09-15T22:46:43.732292+0000","last_clean":"2024-09-15T22:46:43.732292+0000","last_became_active":"2024-09-15T22:46:41.632937+0000","last_became_peered":"2024-09-15T22:46:41.632937+0000","last_unstale":"2024-09-15T22:46:43.732292+0000","last_undegraded":"2024-09-15T22:46:43.732292+0000","last_fullsized":"2024-09-15T22:46:43.732292+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:09.054602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732214+0000","last_change":"2024-09-15T22:46:42.647578+0000","last_active":"2024-09-15T22:46:43.732214+0000","last_peered":"2024-09-15T22:46:43.732214+0000","last_clean":"2024-09-15T22:46:43.732214+0000","last_became_active":"2024-09-15T22:46:42.647317+0000","last_became_peered":"2024-09-15T22:46:42.647317+0000","last_unstale":"2024-09-15T22:46:43.732214+0000","last_undegraded":"2024-09-15T22:46:43.732214+0000","last_fullsized":"2024-09-15T22:46:43.732214+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:40.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"121'6","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732123+0000","last_change":"2024-09-15T22:46:41.634748+0000","last_active":"2024-09-15T22:46:43.732123+0000","last_peered":"2024-09-15T22:46:43.732123+0000","last_clean":"2024-09-15T22:46:43.732123+0000","last_became_active":"2024-09-15T22:46:41.634461+0000","last_became_peered":"2024-09-15T22:46:41.634461+0000","last_unstale":"2024-09-15T22:46:43.732123+0000","last_undegraded":"2024-09-15T22:46:43.732123+0000","last_fullsized":"2024-09-15T22:46:43.732123+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.669538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633065+0000","last_change":"2024-09-15T22:46:42.640573+0000","last_active":"2024-09-15T22:46:43.633065+0000","last_peered":"2024-09-15T22:46:43.633065+0000","last_clean":"2024-09-15T22:46:43.633065+0000","last_became_active":"2024-09-15T22:46:42.640296+0000","last_became_peered":"2024-09-15T22:46:42.640296+0000","last_unstale":"2024-09-15T22:46:43.633065+0000","last_undegraded":"2024-09-15T22:46:43.633065+0000","last_fullsized":"2024-09-15T22:46:43.633065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:02.335173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632236+0000","last_change":"2024-09-15T22:46:41.626980+0000","last_active":"2024-09-15T22:46:43.632236+0000","last_peered":"2024-09-15T22:46:43.632236+0000","last_clean":"2024-09-15T22:46:43.632236+0000","last_became_active":"2024-09-15T22:46:41.626709+0000","last_became_peered":"2024-09-15T22:46:41.626709+0000","last_unstale":"2024-09-15T22:46:43.632236+0000","last_undegraded":"2024-09-15T22:46:43.632236+0000","last_fullsized":"2024-09-15T22:46:43.632236+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:40.526854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632988+0000","last_change":"2024-09-15T22:46:42.627156+0000","last_active":"2024-09-15T22:46:43.632988+0000","last_peered":"2024-09-15T22:46:43.632988+0000","last_clean":"2024-09-15T22:46:43.632988+0000","last_became_active":"2024-09-15T22:46:42.625608+0000","last_became_peered":"2024-09-15T22:46:42.625608+0000","last_unstale":"2024-09-15T22:46:43.632988+0000","last_undegraded":"2024-09-15T22:46:43.632988+0000","last_fullsized":"2024-09-15T22:46:43.632988+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:53.981855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732203+0000","last_change":"2024-09-15T22:46:41.635999+0000","last_active":"2024-09-15T22:46:43.732203+0000","last_peered":"2024-09-15T22:46:43.732203+0000","last_clean":"2024-09-15T22:46:43.732203+0000","last_became_active":"2024-09-15T22:46:41.635675+0000","last_became_peered":"2024-09-15T22:46:41.635675+0000","last_unstale":"2024-09-15T22:46:43.732203+0000","last_undegraded":"2024-09-15T22:46:43.732203+0000","last_fullsized":"2024-09-15T22:46:43.732203+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:15.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631540+0000","last_change":"2024-09-15T22:46:42.646071+0000","last_active":"2024-09-15T22:46:43.631540+0000","last_peered":"2024-09-15T22:46:43.631540+0000","last_clean":"2024-09-15T22:46:43.631540+0000","last_became_active":"2024-09-15T22:46:42.645836+0000","last_became_peered":"2024-09-15T22:46:42.645836+0000","last_unstale":"2024-09-15T22:46:43.631540+0000","last_undegraded":"2024-09-15T22:46:43.631540+0000","last_fullsized":"2024-09-15T22:46:43.631540+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:56.063750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"121'8","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631513+0000","last_change":"2024-09-15T22:46:41.634008+0000","last_active":"2024-09-15T22:46:43.631513+0000","last_peered":"2024-09-15T22:46:43.631513+0000","last_clean":"2024-09-15T22:46:43.631513+0000","last_became_active":"2024-09-15T22:46:41.633721+0000","last_became_peered":"2024-09-15T22:46:41.633721+0000","last_unstale":"2024-09-15T22:46:43.631513+0000","last_undegraded":"2024-09-15T22:46:43.631513+0000","last_fullsized":"2024-09-15T22:46:43.631513+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:44.232277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732101+0000","last_change":"2024-09-15T22:46:42.634165+0000","last_active":"2024-09-15T22:46:43.732101+0000","last_peered":"2024-09-15T22:46:43.732101+0000","last_clean":"2024-09-15T22:46:43.732101+0000","last_became_active":"2024-09-15T22:46:42.633901+0000","last_became_peered":"2024-09-15T22:46:42.633901+0000","last_unstale":"2024-09-15T22:46:43.732101+0000","last_undegraded":"2024-09-15T22:46:43.732101+0000","last_fullsized":"2024-09-15T22:46:43.732101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.836981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632026+0000","last_change":"2024-09-15T22:46:41.637476+0000","last_active":"2024-09-15T22:46:43.632026+0000","last_peered":"2024-09-15T22:46:43.632026+0000","last_clean":"2024-09-15T22:46:43.632026+0000","last_became_active":"2024-09-15T22:46:41.636964+0000","last_became_peered":"2024-09-15T22:46:41.636964+0000","last_unstale":"2024-09-15T22:46:43.632026+0000","last_undegraded":"2024-09-15T22:46:43.632026+0000","last_fullsized":"2024-09-15T22:46:43.632026+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.020034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732165+0000","last_change":"2024-09-15T22:46:42.643797+0000","last_active":"2024-09-15T22:46:43.732165+0000","last_peered":"2024-09-15T22:46:43.732165+0000","last_clean":"2024-09-15T22:46:43.732165+0000","last_became_active":"2024-09-15T22:46:42.643516+0000","last_became_peered":"2024-09-15T22:46:42.643516+0000","last_unstale":"2024-09-15T22:46:43.732165+0000","last_undegraded":"2024-09-15T22:46:43.732165+0000","last_fullsized":"2024-09-15T22:46:43.732165+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:57.348375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732818+0000","last_change":"2024-09-15T22:46:41.630408+0000","last_active":"2024-09-15T22:46:43.732818+0000","last_peered":"2024-09-15T22:46:43.732818+0000","last_clean":"2024-09-15T22:46:43.732818+0000","last_became_active":"2024-09-15T22:46:41.630125+0000","last_became_peered":"2024-09-15T22:46:41.630125+0000","last_unstale":"2024-09-15T22:46:43.732818+0000","last_undegraded":"2024-09-15T22:46:43.732818+0000","last_fullsized":"2024-09-15T22:46:43.732818+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:08.794502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633236+0000","last_change":"2024-09-15T22:46:42.637892+0000","last_active":"2024-09-15T22:46:43.633236+0000","last_peered":"2024-09-15T22:46:43.633236+0000","last_clean":"2024-09-15T22:46:43.633236+0000","last_became_active":"2024-09-15T22:46:42.637268+0000","last_became_peered":"2024-09-15T22:46:42.637268+0000","last_unstale":"2024-09-15T22:46:43.633236+0000","last_undegraded":"2024-09-15T22:46:43.633236+0000","last_fullsized":"2024-09-15T22:46:43.633236+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:55.559856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732017+0000","last_change":"2024-09-15T22:46:41.635450+0000","last_active":"2024-09-15T22:46:43.732017+0000","last_peered":"2024-09-15T22:46:43.732017+0000","last_clean":"2024-09-15T22:46:43.732017+0000","last_became_active":"2024-09-15T22:46:41.635105+0000","last_became_peered":"2024-09-15T22:46:41.635105+0000","last_unstale":"2024-09-15T22:46:43.732017+0000","last_undegraded":"2024-09-15T22:46:43.732017+0000","last_fullsized":"2024-09-15T22:46:43.732017+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:20.498079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633039+0000","last_change":"2024-09-15T22:46:42.642809+0000","last_active":"2024-09-15T22:46:43.633039+0000","last_peered":"2024-09-15T22:46:43.633039+0000","last_clean":"2024-09-15T22:46:43.633039+0000","last_became_active":"2024-09-15T22:46:42.642210+0000","last_became_peered":"2024-09-15T22:46:42.642210+0000","last_unstale":"2024-09-15T22:46:43.633039+0000","last_undegraded":"2024-09-15T22:46:43.633039+0000","last_fullsized":"2024-09-15T22:46:43.633039+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.935930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731891+0000","last_change":"2024-09-15T22:46:41.632765+0000","last_active":"2024-09-15T22:46:43.731891+0000","last_peered":"2024-09-15T22:46:43.731891+0000","last_clean":"2024-09-15T22:46:43.731891+0000","last_became_active":"2024-09-15T22:46:41.632486+0000","last_became_peered":"2024-09-15T22:46:41.632486+0000","last_unstale":"2024-09-15T22:46:43.731891+0000","last_undegraded":"2024-09-15T22:46:43.731891+0000","last_fullsized":"2024-09-15T22:46:43.731891+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:45.486697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633633+0000","last_change":"2024-09-15T22:46:42.632201+0000","last_active":"2024-09-15T22:46:43.633633+0000","last_peered":"2024-09-15T22:46:43.633633+0000","last_clean":"2024-09-15T22:46:43.633633+0000","last_became_active":"2024-09-15T22:46:42.631475+0000","last_became_peered":"2024-09-15T22:46:42.631475+0000","last_unstale":"2024-09-15T22:46:43.633633+0000","last_undegraded":"2024-09-15T22:46:43.633633+0000","last_fullsized":"2024-09-15T22:46:43.633633+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:57:26.779461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731683+0000","last_change":"2024-09-15T22:46:41.635456+0000","last_active":"2024-09-15T22:46:43.731683+0000","last_peered":"2024-09-15T22:46:43.731683+0000","last_clean":"2024-09-15T22:46:43.731683+0000","last_became_active":"2024-09-15T22:46:41.635135+0000","last_became_peered":"2024-09-15T22:46:41.635135+0000","last_unstale":"2024-09-15T22:46:43.731683+0000","last_undegraded":"2024-09-15T22:46:43.731683+0000","last_fullsized":"2024-09-15T22:46:43.731683+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.152465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731605+0000","last_change":"2024-09-15T22:46:42.633650+0000","last_active":"2024-09-15T22:46:43.731605+0000","last_peered":"2024-09-15T22:46:43.731605+0000","last_clean":"2024-09-15T22:46:43.731605+0000","last_became_active":"2024-09-15T22:46:42.633362+0000","last_became_peered":"2024-09-15T22:46:42.633362+0000","last_unstale":"2024-09-15T22:46:43.731605+0000","last_undegraded":"2024-09-15T22:46:43.731605+0000","last_fullsized":"2024-09-15T22:46:43.731605+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:58:46.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732156+0000","last_change":"2024-09-15T22:46:41.631832+0000","last_active":"2024-09-15T22:46:43.732156+0000","last_peered":"2024-09-15T22:46:43.732156+0000","last_clean":"2024-09-15T22:46:43.732156+0000","last_became_active":"2024-09-15T22:46:41.631510+0000","last_became_peered":"2024-09-15T22:46:41.631510+0000","last_unstale":"2024-09-15T22:46:43.732156+0000","last_undegraded":"2024-09-15T22:46:43.732156+0000","last_fullsized":"2024-09-15T22:46:43.732156+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:50.620428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632354+0000","last_change":"2024-09-15T22:46:42.634028+0000","last_active":"2024-09-15T22:46:43.632354+0000","last_peered":"2024-09-15T22:46:43.632354+0000","last_clean":"2024-09-15T22:46:43.632354+0000","last_became_active":"2024-09-15T22:46:42.633690+0000","last_became_peered":"2024-09-15T22:46:42.633690+0000","last_unstale":"2024-09-15T22:46:43.632354+0000","last_undegraded":"2024-09-15T22:46:43.632354+0000","last_fullsized":"2024-09-15T22:46:43.632354+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:30.088796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632341+0000","last_change":"2024-09-15T22:46:41.635616+0000","last_active":"2024-09-15T22:46:43.632341+0000","last_peered":"2024-09-15T22:46:43.632341+0000","last_clean":"2024-09-15T22:46:43.632341+0000","last_became_active":"2024-09-15T22:46:41.635280+0000","last_became_peered":"2024-09-15T22:46:41.635280+0000","last_unstale":"2024-09-15T22:46:43.632341+0000","last_undegraded":"2024-09-15T22:46:43.632341+0000","last_fullsized":"2024-09-15T22:46:43.632341+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:59.514386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631541+0000","last_change":"2024-09-15T22:46:42.645057+0000","last_active":"2024-09-15T22:46:43.631541+0000","last_peered":"2024-09-15T22:46:43.631541+0000","last_clean":"2024-09-15T22:46:43.631541+0000","last_became_active":"2024-09-15T22:46:42.644799+0000","last_became_peered":"2024-09-15T22:46:42.644799+0000","last_unstale":"2024-09-15T22:46:43.631541+0000","last_undegraded":"2024-09-15T22:46:43.631541+0000","last_fullsized":"2024-09-15T22:46:43.631541+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:20.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731809+0000","last_change":"2024-09-15T22:46:41.629982+0000","last_active":"2024-09-15T22:46:43.731809+0000","last_peered":"2024-09-15T22:46:43.731809+0000","last_clean":"2024-09-15T22:46:43.731809+0000","last_became_active":"2024-09-15T22:46:41.629685+0000","last_became_peered":"2024-09-15T22:46:41.629685+0000","last_unstale":"2024-09-15T22:46:43.731809+0000","last_undegraded":"2024-09-15T22:46:43.731809+0000","last_fullsized":"2024-09-15T22:46:43.731809+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:50.933742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731801+0000","last_change":"2024-09-15T22:46:42.648436+0000","last_active":"2024-09-15T22:46:43.731801+0000","last_peered":"2024-09-15T22:46:43.731801+0000","last_clean":"2024-09-15T22:46:43.731801+0000","last_became_active":"2024-09-15T22:46:42.648001+0000","last_became_peered":"2024-09-15T22:46:42.648001+0000","last_unstale":"2024-09-15T22:46:43.731801+0000","last_undegraded":"2024-09-15T22:46:43.731801+0000","last_fullsized":"2024-09-15T22:46:43.731801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:10.056791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732433+0000","last_change":"2024-09-15T22:46:41.633318+0000","last_active":"2024-09-15T22:46:43.732433+0000","last_peered":"2024-09-15T22:46:43.732433+0000","last_clean":"2024-09-15T22:46:43.732433+0000","last_became_active":"2024-09-15T22:46:41.633029+0000","last_became_peered":"2024-09-15T22:46:41.633029+0000","last_unstale":"2024-09-15T22:46:43.732433+0000","last_undegraded":"2024-09-15T22:46:43.732433+0000","last_fullsized":"2024-09-15T22:46:43.732433+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:39.934465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632686+0000","last_change":"2024-09-15T22:46:42.635224+0000","last_active":"2024-09-15T22:46:43.632686+0000","last_peered":"2024-09-15T22:46:43.632686+0000","last_clean":"2024-09-15T22:46:43.632686+0000","last_became_active":"2024-09-15T22:46:42.634987+0000","last_became_peered":"2024-09-15T22:46:42.634987+0000","last_unstale":"2024-09-15T22:46:43.632686+0000","last_undegraded":"2024-09-15T22:46:43.632686+0000","last_fullsized":"2024-09-15T22:46:43.632686+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:35.903209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732185+0000","last_change":"2024-09-15T22:46:41.637794+0000","last_active":"2024-09-15T22:46:43.732185+0000","last_peered":"2024-09-15T22:46:43.732185+0000","last_clean":"2024-09-15T22:46:43.732185+0000","last_became_active":"2024-09-15T22:46:41.637474+0000","last_became_peered":"2024-09-15T22:46:41.637474+0000","last_unstale":"2024-09-15T22:46:43.732185+0000","last_undegraded":"2024-09-15T22:46:43.732185+0000","last_fullsized":"2024-09-15T22:46:43.732185+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.484934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632711+0000","last_change":"2024-09-15T22:46:42.641734+0000","last_active":"2024-09-15T22:46:43.632711+0000","last_peered":"2024-09-15T22:46:43.632711+0000","last_clean":"2024-09-15T22:46:43.632711+0000","last_became_active":"2024-09-15T22:46:42.641448+0000","last_became_peered":"2024-09-15T22:46:42.641448+0000","last_unstale":"2024-09-15T22:46:43.632711+0000","last_undegraded":"2024-09-15T22:46:43.632711+0000","last_fullsized":"2024-09-15T22:46:43.632711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:13.864589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732334+0000","last_change":"2024-09-15T22:46:41.637018+0000","last_active":"2024-09-15T22:46:43.732334+0000","last_peered":"2024-09-15T22:46:43.732334+0000","last_clean":"2024-09-15T22:46:43.732334+0000","last_became_active":"2024-09-15T22:46:41.636696+0000","last_became_peered":"2024-09-15T22:46:41.636696+0000","last_unstale":"2024-09-15T22:46:43.732334+0000","last_undegraded":"2024-09-15T22:46:43.732334+0000","last_fullsized":"2024-09-15T22:46:43.732334+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:45.941332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731930+0000","last_change":"2024-09-15T22:46:42.633824+0000","last_active":"2024-09-15T22:46:43.731930+0000","last_peered":"2024-09-15T22:46:43.731930+0000","last_clean":"2024-09-15T22:46:43.731930+0000","last_became_active":"2024-09-15T22:46:42.633569+0000","last_became_peered":"2024-09-15T22:46:42.633569+0000","last_unstale":"2024-09-15T22:46:43.731930+0000","last_undegraded":"2024-09-15T22:46:43.731930+0000","last_fullsized":"2024-09-15T22:46:43.731930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:48.594990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632808+0000","last_change":"2024-09-15T22:46:41.626298+0000","last_active":"2024-09-15T22:46:43.632808+0000","last_peered":"2024-09-15T22:46:43.632808+0000","last_clean":"2024-09-15T22:46:43.632808+0000","last_became_active":"2024-09-15T22:46:41.625885+0000","last_became_peered":"2024-09-15T22:46:41.625885+0000","last_unstale":"2024-09-15T22:46:43.632808+0000","last_undegraded":"2024-09-15T22:46:43.632808+0000","last_fullsized":"2024-09-15T22:46:43.632808+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:26.849151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631592+0000","last_change":"2024-09-15T22:46:42.629690+0000","last_active":"2024-09-15T22:46:43.631592+0000","last_peered":"2024-09-15T22:46:43.631592+0000","last_clean":"2024-09-15T22:46:43.631592+0000","last_became_active":"2024-09-15T22:46:42.629362+0000","last_became_peered":"2024-09-15T22:46:42.629362+0000","last_unstale":"2024-09-15T22:46:43.631592+0000","last_undegraded":"2024-09-15T22:46:43.631592+0000","last_fullsized":"2024-09-15T22:46:43.631592+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:02.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.633351+0000","last_change":"2024-09-15T22:46:41.628608+0000","last_active":"2024-09-15T22:46:43.633351+0000","last_peered":"2024-09-15T22:46:43.633351+0000","last_clean":"2024-09-15T22:46:43.633351+0000","last_became_active":"2024-09-15T22:46:41.628339+0000","last_became_peered":"2024-09-15T22:46:41.628339+0000","last_unstale":"2024-09-15T22:46:43.633351+0000","last_undegraded":"2024-09-15T22:46:43.633351+0000","last_fullsized":"2024-09-15T22:46:43.633351+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:59.962089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631767+0000","last_change":"2024-09-15T22:46:42.646094+0000","last_active":"2024-09-15T22:46:43.631767+0000","last_peered":"2024-09-15T22:46:43.631767+0000","last_clean":"2024-09-15T22:46:43.631767+0000","last_became_active":"2024-09-15T22:46:42.645870+0000","last_became_peered":"2024-09-15T22:46:42.645870+0000","last_unstale":"2024-09-15T22:46:43.631767+0000","last_undegraded":"2024-09-15T22:46:43.631767+0000","last_fullsized":"2024-09-15T22:46:43.631767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:59.818718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631652+0000","last_change":"2024-09-15T22:46:41.635924+0000","last_active":"2024-09-15T22:46:43.631652+0000","last_peered":"2024-09-15T22:46:43.631652+0000","last_clean":"2024-09-15T22:46:43.631652+0000","last_became_active":"2024-09-15T22:46:41.635467+0000","last_became_peered":"2024-09-15T22:46:41.635467+0000","last_unstale":"2024-09-15T22:46:43.631652+0000","last_undegraded":"2024-09-15T22:46:43.631652+0000","last_fullsized":"2024-09-15T22:46:43.631652+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:17:06.797079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731901+0000","last_change":"2024-09-15T22:46:42.646916+0000","last_active":"2024-09-15T22:46:43.731901+0000","last_peered":"2024-09-15T22:46:43.731901+0000","last_clean":"2024-09-15T22:46:43.731901+0000","last_became_active":"2024-09-15T22:46:42.646598+0000","last_became_peered":"2024-09-15T22:46:42.646598+0000","last_unstale":"2024-09-15T22:46:43.731901+0000","last_undegraded":"2024-09-15T22:46:43.731901+0000","last_fullsized":"2024-09-15T22:46:43.731901+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:12.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732308+0000","last_change":"2024-09-15T22:46:41.636005+0000","last_active":"2024-09-15T22:46:43.732308+0000","last_peered":"2024-09-15T22:46:43.732308+0000","last_clean":"2024-09-15T22:46:43.732308+0000","last_became_active":"2024-09-15T22:46:41.635611+0000","last_became_peered":"2024-09-15T22:46:41.635611+0000","last_unstale":"2024-09-15T22:46:43.732308+0000","last_undegraded":"2024-09-15T22:46:43.732308+0000","last_fullsized":"2024-09-15T22:46:43.732308+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:34.901021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632232+0000","last_change":"2024-09-15T22:46:42.638426+0000","last_active":"2024-09-15T22:46:43.632232+0000","last_peered":"2024-09-15T22:46:43.632232+0000","last_clean":"2024-09-15T22:46:43.632232+0000","last_became_active":"2024-09-15T22:46:42.638123+0000","last_became_peered":"2024-09-15T22:46:42.638123+0000","last_unstale":"2024-09-15T22:46:43.632232+0000","last_undegraded":"2024-09-15T22:46:43.632232+0000","last_fullsized":"2024-09-15T22:46:43.632232+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:43.545449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.632450+0000","last_change":"2024-09-15T22:46:41.626572+0000","last_active":"2024-09-15T22:46:43.632450+0000","last_peered":"2024-09-15T22:46:43.632450+0000","last_clean":"2024-09-15T22:46:43.632450+0000","last_became_active":"2024-09-15T22:46:41.626269+0000","last_became_peered":"2024-09-15T22:46:41.626269+0000","last_unstale":"2024-09-15T22:46:43.632450+0000","last_undegraded":"2024-09-15T22:46:43.632450+0000","last_fullsized":"2024-09-15T22:46:43.632450+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:17.793711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.732445+0000","last_change":"2024-09-15T22:46:42.641316+0000","last_active":"2024-09-15T22:46:43.732445+0000","last_peered":"2024-09-15T22:46:43.732445+0000","last_clean":"2024-09-15T22:46:43.732445+0000","last_became_active":"2024-09-15T22:46:42.641069+0000","last_became_peered":"2024-09-15T22:46:42.641069+0000","last_unstale":"2024-09-15T22:46:43.732445+0000","last_undegraded":"2024-09-15T22:46:43.732445+0000","last_fullsized":"2024-09-15T22:46:43.732445+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:41.610520+0000","last_clean_scrub_stamp":"2024-09-15T22:46:41.610520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:19.293812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.631964+0000","last_change":"2024-09-15T22:46:41.641080+0000","last_active":"2024-09-15T22:46:43.631964+0000","last_peered":"2024-09-15T22:46:43.631964+0000","last_clean":"2024-09-15T22:46:43.631964+0000","last_became_active":"2024-09-15T22:46:41.640738+0000","last_became_peered":"2024-09-15T22:46:41.640738+0000","last_unstale":"2024-09-15T22:46:43.631964+0000","last_undegraded":"2024-09-15T22:46:43.631964+0000","last_fullsized":"2024-09-15T22:46:43.631964+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:46:40.608332+0000","last_clean_scrub_stamp":"2024-09-15T22:46:40.608332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:19.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":393,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-15T22:46:43.731224+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:46:43.731224+0000","last_peered":"2024-09-15T22:46:43.731224+0000","last_clean":"2024-09-15T22:46:43.731224+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:46:43.731224+0000","last_undegraded":"2024-09-15T22:46:43.731224+0000","last_fullsized":"2024-09-15T22:46:43.731224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1519616,"data_stored":666029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1515520,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509510,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":1257105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1515520,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1519616,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1523712,"data_stored":666667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2125824,"data_stored":1257997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509511,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1536000,"data_stored":667663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:46:50.571 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:46:50.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:46:50.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.715+0000 7f160834b640 1 Processor -- start 2024-09-15T22:46:50.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.715+0000 7f160834b640 1 -- start start 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f160834b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 0x7f16000d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f160834b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16000b3540 0x7f16000d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f160834b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16000d20e0 con 0x7f16000b61e0 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f160834b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f16000d24f0 con 0x7f16000b3540 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f160834b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f16000cfa70 con 0x7f16000b3b00 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.716+0000 7f16068e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16000b3540 0x7f16000d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16000b3540 0x7f16000d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38420/0 (socket says 172.21.15.134:38420) 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 -- 172.21.15.134:0/1227244592 learned_addr learned my addr 172.21.15.134:0/1227244592 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16058e6640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 0x7f16000d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 -- 172.21.15.134:0/1227244592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 msgr2=0x7f16000d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 0x7f16000d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 -- 172.21.15.134:0/1227244592 >> v1:172.21.15.177:6789/0 conn(0x7f16000b61e0 legacy=0x7f16000b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 -- 172.21.15.134:0/1227244592 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16000cfd50 con 0x7f16000b3540 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16058e6640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 0x7f16000d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.717+0000 7f16068e8640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f16000d2ec0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009870 tx=0x7f15f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eda511be2d0505 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f16050e5640 1 -- 172.21.15.134:0/1227244592 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8037070 con 0x7f16000b3540 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f16050e5640 1 -- 172.21.15.134:0/1227244592 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f802ae10 con 0x7f16000b3540 2024-09-15T22:46:50.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f16050e5640 1 -- 172.21.15.134:0/1227244592 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8032660 con 0x7f16000b3540 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 -- 172.21.15.134:0/1227244592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 msgr2=0x7f16000d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f16000d2ec0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009870 tx=0x7f15f802a100 comp rx=0 tx=0).stop 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 -- 172.21.15.134:0/1227244592 shutdown_connections 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f16000d2ec0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 --2- 172.21.15.134:0/1227244592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b3b00 0x7f16000d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 -- 172.21.15.134:0/1227244592 >> 172.21.15.134:0/1227244592 conn(0x7f16000d11e0 msgr2=0x7f16000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 -- 172.21.15.134:0/1227244592 shutdown_connections 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.718+0000 7f160834b640 1 -- 172.21.15.134:0/1227244592 wait complete. 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.719+0000 7f160834b640 1 Processor -- start 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.719+0000 7f160834b640 1 -- start start 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 0x7f16000cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 0x7f16000d3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f160015edc0 con 0x7f16000b3540 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f16000d1d00 con 0x7f16000b3b00 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f160834b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1600161ef0 con 0x7f16000b61e0 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38424/0 (socket says 172.21.15.134:38424) 2024-09-15T22:46:50.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 -- 172.21.15.134:0/1228887827 learned_addr learned my addr 172.21.15.134:0/1228887827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16058e6640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 0x7f16000cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16068e8640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 0x7f16000d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 -- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 msgr2=0x7f16000d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 0x7f16000d3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 -- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 msgr2=0x7f16000cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.720+0000 7f16060e7640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 0x7f16000cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f16060e7640 1 -- 172.21.15.134:0/1228887827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1600155220 con 0x7f16000b3540 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f16058e6640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 0x7f16000cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f16068e8640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 0x7f16000d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f16060e7640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c7c0 tx=0x7f15f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0016020 con 0x7f16000b3540 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f000aa50 con 0x7f16000b3540 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16000cd830 con 0x7f16000b3540 2024-09-15T22:46:50.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f000ae40 con 0x7f16000b3540 2024-09-15T22:46:50.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.721+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16000cddf0 con 0x7f16000b3540 2024-09-15T22:46:50.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.722+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16000b65c0 con 0x7f16000b3540 2024-09-15T22:46:50.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.722+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f15f0019020 con 0x7f16000b3540 2024-09-15T22:46:50.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.723+0000 7f15feffd640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 0x7f15ec06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:50.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.723+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f15f008be40 con 0x7f16000b3540 2024-09-15T22:46:50.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.723+0000 7f16058e6640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 0x7f15ec06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:50.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.724+0000 7f16058e6640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 0x7f15ec06eb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15f4006fd0 tx=0x7f15f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:50.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.727+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15f0020020 con 0x7f16000b3540 2024-09-15T22:46:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.955+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f16000b6d80 con 0x7f16000b3540 2024-09-15T22:46:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.957+0000 7f15feffd640 1 -- 172.21.15.134:0/1228887827 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f1600155220 con 0x7f16000b3540 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:46:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:46:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 msgr2=0x7f15ec06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 0x7f15ec06eb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15f4006fd0 tx=0x7f15f4008040 comp rx=0 tx=0).stop 2024-09-15T22:46:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 msgr2=0x7f1600154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c7c0 tx=0x7f15f000cc80 comp rx=0 tx=0).stop 2024-09-15T22:46:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 shutdown_connections 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16000b61e0 0x7f16000d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16000b3b00 0x7f16000cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f15ec06c6a0 0x7f15ec06eb60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 --2- 172.21.15.134:0/1228887827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16000b3540 0x7f1600154ce0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 >> 172.21.15.134:0/1228887827 conn(0x7f16000d11e0 msgr2=0x7f160015d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 shutdown_connections 2024-09-15T22:46:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:50.960+0000 7f160834b640 1 -- 172.21.15.134:0/1228887827 wait complete. 2024-09-15T22:46:50.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:46:51.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.069+0000 7f8be730a640 1 Processor -- start 2024-09-15T22:46:51.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.069+0000 7f8be730a640 1 -- start start 2024-09-15T22:46:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be730a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8be00d02a0 0x7f8be00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be730a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8be015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be730a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be00d0bc0 con 0x7f8be015ce80 2024-09-15T22:46:51.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be730a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8be015d390 con 0x7f8be00d02a0 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be730a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8be015d670 con 0x7f8be015ca40 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be58a7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8be015ce80 0x7f8be01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:39164/0 (socket says 172.21.15.134:39164) 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be58a7640 1 -- 172.21.15.134:0/3007903914 learned_addr learned my addr 172.21.15.134:0/3007903914 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be48a5640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8be015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be50a6640 1 --2- 172.21.15.134:0/3007903914 >> v2:172.21.15.177:3300/0 conn(0x7f8be00d02a0 0x7f8be00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772784586 0 0) 0x7f8be00d0bc0 con 0x7f8be015ce80 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bcc003520 con 0x7f8be015ce80 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2326051228 0 0) 0x7f8bcc003520 con 0x7f8be015ce80 2024-09-15T22:46:51.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 msgr2=0x7f8be015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8be015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 >> v2:172.21.15.177:3300/0 conn(0x7f8be00d02a0 msgr2=0x7f8be00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/3007903914 >> v2:172.21.15.177:3300/0 conn(0x7f8be00d02a0 0x7f8be00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be015d950 con 0x7f8be015ce80 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f8bd80019f0 con 0x7f8be015ce80 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 >> v1:172.21.15.134:6789/0 conn(0x7f8be015ce80 legacy=0x7f8be01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8bcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bcc004800 0x7f8bcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8bcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8be015d390 con 0x7f8bcc0039b0 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8be015d670 con 0x7f8bcc004800 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc00b9c0 con 0x7f8be015ca40 2024-09-15T22:46:51.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.070+0000 7f8be50a6640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8bcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be48a5640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bcc004800 0x7f8bcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be58a7640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8bcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 -- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 msgr2=0x7f8bcc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be015ca40 0x7f8bcc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 -- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bcc004800 msgr2=0x7f8bcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bcc004800 0x7f8bcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 -- 172.21.15.134:0/3007903914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc003520 con 0x7f8bcc0039b0 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be48a5640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bcc004800 0x7f8bcc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.071+0000 7f8be50a6640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8bcc003dd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009af0 tx=0x7f8bcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482814bb5e32ffaa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc036070 con 0x7f8bcc0039b0 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc031400 con 0x7f8bcc0039b0 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8bd7fff640 1 -- 172.21.15.134:0/3007903914 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc009690 con 0x7f8bcc0039b0 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 -- 172.21.15.134:0/3007903914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 msgr2=0x7f8bcc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 --2- 172.21.15.134:0/3007903914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8bcc003dd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009af0 tx=0x7f8bcc005830 comp rx=0 tx=0).stop 2024-09-15T22:46:51.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be58a7640 1 -- 172.21.15.134:0/3007903914 reap_dead start 2024-09-15T22:46:51.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 -- 172.21.15.134:0/3007903914 shutdown_connections 2024-09-15T22:46:51.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 -- 172.21.15.134:0/3007903914 >> 172.21.15.134:0/3007903914 conn(0x7f8be0062cc0 msgr2=0x7f8be006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 -- 172.21.15.134:0/3007903914 shutdown_connections 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.072+0000 7f8be730a640 1 -- 172.21.15.134:0/3007903914 wait complete. 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.073+0000 7f8be730a640 1 Processor -- start 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.073+0000 7f8be730a640 1 -- start start 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8be0156ef0 0x7f8be01f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be0154920 0x7f8be0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0155b90 con 0x7f8bcc0039b0 2024-09-15T22:46:51.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8be015df10 con 0x7f8be0156ef0 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be730a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8be0155d10 con 0x7f8be0154920 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38440/0 (socket says 172.21.15.134:38440) 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 -- 172.21.15.134:0/1627820474 learned_addr learned my addr 172.21.15.134:0/1627820474 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be58a7640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be0154920 0x7f8be0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be48a5640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8be0156ef0 0x7f8be01f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 -- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be0154920 msgr2=0x7f8be0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be0154920 0x7f8be0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 -- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8be0156ef0 msgr2=0x7f8be01f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8be0156ef0 0x7f8be01f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.074+0000 7f8be50a6640 1 -- 172.21.15.134:0/1627820474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be0072130 con 0x7f8bcc0039b0 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8be50a6640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc034040 tx=0x7f8bdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc031cf0 con 0x7f8bcc0039b0 2024-09-15T22:46:51.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0433f0 con 0x7f8bcc0039b0 2024-09-15T22:46:51.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be01f1840 con 0x7f8bcc0039b0 2024-09-15T22:46:51.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0437e0 con 0x7f8bcc0039b0 2024-09-15T22:46:51.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.075+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01f1e00 con 0x7f8bcc0039b0 2024-09-15T22:46:51.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.076+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be0063160 con 0x7f8bcc0039b0 2024-09-15T22:46:51.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.077+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f8bdc04a060 con 0x7f8bcc0039b0 2024-09-15T22:46:51.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.077+0000 7f8bd5ffb640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 0x7f8bc406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.077+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f8bdc0ad7d0 con 0x7f8bcc0039b0 2024-09-15T22:46:51.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.077+0000 7f8be48a5640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 0x7f8bc406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.078+0000 7f8be48a5640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 0x7f8bc406eb60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8be00b3e40 tx=0x7f8bd0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.081+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bdc03e070 con 0x7f8bcc0039b0 2024-09-15T22:46:51.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.281+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8be0151c60 con 0x7f8bcc0039b0 2024-09-15T22:46:51.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.282+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1627820474 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5228 (secure 0 0 0) 0x7f8bdc07b2f0 con 0x7f8bcc0039b0 2024-09-15T22:46:51.283 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:51.283 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":61,"btime":"2024-09-15T22:46:44:753926+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:46:51.283 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 61 2024-09-15T22:46:51.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 msgr2=0x7f8bc406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 0x7f8bc406eb60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8be00b3e40 tx=0x7f8bd0008040 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 msgr2=0x7f8be01588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc034040 tx=0x7f8bdc004730 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 shutdown_connections 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8be0154920 0x7f8be0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8be0156ef0 0x7f8be01f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406c6a0 0x7f8bc406eb60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 --2- 172.21.15.134:0/1627820474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bcc0039b0 0x7f8be01588d0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 >> 172.21.15.134:0/1627820474 conn(0x7f8be0062cc0 msgr2=0x7f8be00cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 shutdown_connections 2024-09-15T22:46:51.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.284+0000 7f8be730a640 1 -- 172.21.15.134:0/1627820474 wait complete. 2024-09-15T22:46:51.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:46:41.952655+0000', 'modified': '2024-09-15T22:46:44.081148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7368}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7368': {'gid': 7368, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/1968724028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1968724028}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1968724028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7368, 'qdb_cluster': [7368]} 2024-09-15T22:46:51.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:46:51.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:46:51.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.801+0000 7fc94fe7b640 1 Processor -- start 2024-09-15T22:46:51.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.802+0000 7fc94fe7b640 1 -- start start 2024-09-15T22:46:51.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.802+0000 7fc94fe7b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9480d02a0 0x7fc9480d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.802+0000 7fc94fe7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc94815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94fe7b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9480d0bc0 con 0x7fc94815ce80 2024-09-15T22:46:51.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94fe7b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc94815d390 con 0x7fc9480d02a0 2024-09-15T22:46:51.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94fe7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc94815d670 con 0x7fc94815ca40 2024-09-15T22:46:51.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9480d02a0 0x7fc9480d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9480d02a0 0x7fc9480d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38456/0 (socket says 172.21.15.134:38456) 2024-09-15T22:46:51.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 -- 172.21.15.134:0/1133270258 learned_addr learned my addr 172.21.15.134:0/1133270258 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94d416640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc94815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 -- 172.21.15.134:0/1133270258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 msgr2=0x7fc94815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc94815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 -- 172.21.15.134:0/1133270258 >> v1:172.21.15.177:6789/0 conn(0x7fc94815ce80 legacy=0x7fc9481594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.803+0000 7fc94dc17640 1 -- 172.21.15.134:0/1133270258 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94815d950 con 0x7fc9480d02a0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94dc17640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc9480d0680 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4338f55f1407d603 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94cc15640 1 -- 172.21.15.134:0/1133270258 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c037070 con 0x7fc9480d02a0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94cc15640 1 -- 172.21.15.134:0/1133270258 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c032440 con 0x7fc9480d02a0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94cc15640 1 -- 172.21.15.134:0/1133270258 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c032810 con 0x7fc9480d02a0 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 -- 172.21.15.134:0/1133270258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 msgr2=0x7fc9480d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc9480d0680 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c02a180 comp rx=0 tx=0).stop 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 -- 172.21.15.134:0/1133270258 shutdown_connections 2024-09-15T22:46:51.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc94815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/1133270258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc9480d0680 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.804+0000 7fc94fe7b640 1 -- 172.21.15.134:0/1133270258 >> 172.21.15.134:0/1133270258 conn(0x7fc948062cc0 msgr2=0x7fc94806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.805+0000 7fc94fe7b640 1 -- 172.21.15.134:0/1133270258 shutdown_connections 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.805+0000 7fc94fe7b640 1 -- 172.21.15.134:0/1133270258 wait complete. 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 Processor -- start 2024-09-15T22:46:51.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 -- start start 2024-09-15T22:46:51.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc948154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94815ce80 0x7fc9481575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc948155b90 con 0x7fc9480d02a0 2024-09-15T22:46:51.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc94815df10 con 0x7fc94815ce80 2024-09-15T22:46:51.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94fe7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc948155d10 con 0x7fc94815ca40 2024-09-15T22:46:51.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.806+0000 7fc94dc17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38472/0 (socket says 172.21.15.134:38472) 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 -- 172.21.15.134:0/905451653 learned_addr learned my addr 172.21.15.134:0/905451653 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94d416640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc948154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94e418640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94815ce80 0x7fc9481575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 -- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 msgr2=0x7fc948154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc948154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 -- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94815ce80 msgr2=0x7fc9481575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94815ce80 0x7fc9481575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 -- 172.21.15.134:0/905451653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc948149b10 con 0x7fc9480d02a0 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94dc17640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc93a7fc640 1 -- 172.21.15.134:0/905451653 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c037040 con 0x7fc9480d02a0 2024-09-15T22:46:51.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc93a7fc640 1 -- 172.21.15.134:0/905451653 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c042070 con 0x7fc9480d02a0 2024-09-15T22:46:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc948156ac0 con 0x7fc9480d02a0 2024-09-15T22:46:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc93a7fc640 1 -- 172.21.15.134:0/905451653 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c030bd0 con 0x7fc9480d02a0 2024-09-15T22:46:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.807+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc948157080 con 0x7fc9480d02a0 2024-09-15T22:46:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.809+0000 7fc93a7fc640 1 -- 172.21.15.134:0/905451653 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fc93c047460 con 0x7fc9480d02a0 2024-09-15T22:46:51.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.809+0000 7fc93a7fc640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 0x7fc92c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.810+0000 7fc93a7fc640 1 -- 172.21.15.134:0/905451653 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fc93c0ac550 con 0x7fc9480d02a0 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.810+0000 7fc94d416640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 0x7fc92c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.810+0000 7fc94d416640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 0x7fc92c06eb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc948158540 tx=0x7fc944008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.810+0000 7fc952c1b740 1 Processor -- start 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.810+0000 7fc952c1b740 1 -- start start 2024-09-15T22:46:51.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f2022ac500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022c6ae0 0x55f2022c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f2021e4520 con 0x55f20227fa80 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f20218c3e0 con 0x55f2022ac120 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f2021e04e0 con 0x55f2022c6ae0 2024-09-15T22:46:51.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38484/0 (socket says 172.21.15.134:38484) 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc94e418640 1 -- 172.21.15.134:0/3907823323 learned_addr learned my addr 172.21.15.134:0/3907823323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc94dc17640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f2022ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.811+0000 7fc94d416640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022c6ae0 0x55f2022c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 -- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022c6ae0 msgr2=0x55f2022c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022c6ae0 0x55f2022c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 -- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 msgr2=0x55f2022ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f2022ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 -- 172.21.15.134:0/3907823323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2021a72f0 con 0x55f20227fa80 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94dc17640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f2022ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc94e418640 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc9400056e0 tx=0x7fc94000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199fbae5a4d0146c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc92b7fe640 1 -- 172.21.15.134:0/3907823323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940018020 con 0x55f20227fa80 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc92b7fe640 1 -- 172.21.15.134:0/3907823323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc940014470 con 0x55f20227fa80 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.812+0000 7fc92b7fe640 1 -- 172.21.15.134:0/3907823323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940014840 con 0x55f20227fa80 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- 172.21.15.134:0/3907823323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 msgr2=0x55f2022c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc9400056e0 tx=0x7fc94000f5a0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- 172.21.15.134:0/3907823323 shutdown_connections 2024-09-15T22:46:51.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227fa80 0x55f2022c87d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022c6ae0 0x55f2022c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3907823323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f2022ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- 172.21.15.134:0/3907823323 >> 172.21.15.134:0/3907823323 conn(0x55f20227ea80 msgr2=0x55f2022c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- 172.21.15.134:0/3907823323 shutdown_connections 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- 172.21.15.134:0/3907823323 wait complete. 2024-09-15T22:46:51.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 -- start start 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.813+0000 7fc952c1b740 1 Processor -- start 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022ac120 0x55f20227d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f202298760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f2022acee0 con 0x55f20227d830 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f20216d450 con 0x55f2022c6ae0 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f2022c7770 con 0x55f2022ac120 2024-09-15T22:46:51.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc952c1b740 10 client.0 _ll_register_callbacks cb 0x55f201ef6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38496/0 (socket says 172.21.15.134:38496) 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 -- 172.21.15.134:0/1551772916 learned_addr learned my addr 172.21.15.134:0/1551772916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 -- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022ac120 msgr2=0x55f20227d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022ac120 0x55f20227d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 -- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 msgr2=0x55f202298760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f202298760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.814+0000 7fc94e418640 1 -- 172.21.15.134:0/1551772916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f201ef72d0 con 0x55f20227d830 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc94e418640 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc940017040 tx=0x7fc940003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa33688f8169e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940014a30 con 0x55f20227d830 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc940014470 con 0x55f20227d830 2024-09-15T22:46:51.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fc940014bd0 con 0x55f20227d830 2024-09-15T22:46:51.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc94002e050 con 0x55f20227d830 2024-09-15T22:46:51.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 10 client.7521 fetch_fsmap learned FSMap version 61 2024-09-15T22:46:51.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55f201fc16b0 con 0x55f20227d830 2024-09-15T22:46:51.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc940014470 con 0x55f20227d830 2024-09-15T22:46:51.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fc940026470 con 0x55f20227d830 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 10 client.7521 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 10 client.7521 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 20 client.7521 populate_metadata read hostname 'smithi134' 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f20227ff20 0x55f2022c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 4 client.7521 mds_command: new command op to 7368 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 --> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2021f1c50 con 0x55f20227ff20 2024-09-15T22:46:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.815+0000 7fc94dc17640 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f20227ff20 0x55f2022c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc928ff9640 10 client.7521 ms_handle_connect on v2:172.21.15.134:6834/1968724028 2024-09-15T22:46:51.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc94dc17640 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f20227ff20 0x55f2022c21b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca0f56f6421cf68 server_cookie=a872a0fdd986fbc0 in_seq=0 out_seq=0 2024-09-15T22:46:51.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc928ff9640 1 -- 172.21.15.134:0/1551772916 <== mds.0 v2:172.21.15.134:6834/1968724028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2021f1c50 con 0x55f20227ff20 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc928ff9640 10 client.7521 handle_command_reply: tid=0 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 client.7521 shutdown 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 msgr2=0x55f202298ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc940017040 tx=0x7fc940003a70 comp rx=0 tx=0).stop 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 shutdown_connections 2024-09-15T22:46:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f20227ff20 0x55f2022c21b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f20227d830 0x55f202298ca0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f202298760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 --2- 172.21.15.134:0/1551772916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f2022ac120 0x55f20227d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc928ff9640 0 client.7521 ms_handle_reset on v2:172.21.15.134:6834/1968724028 2024-09-15T22:46:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.816+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 >> 172.21.15.134:0/1551772916 conn(0x55f20227fa80 msgr2=0x55f2022ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.817+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 shutdown_connections 2024-09-15T22:46:51.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.817+0000 7fc952c1b740 1 -- 172.21.15.134:0/1551772916 wait complete. 2024-09-15T22:46:51.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.817+0000 7fc952c1b740 20 client.7521 trim_cache size 0 max 16384 2024-09-15T22:46:51.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.834+0000 7fc952c1b740 1 Processor -- start 2024-09-15T22:46:51.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.834+0000 7fc952c1b740 1 -- start start 2024-09-15T22:46:51.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f2022af160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f2022ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc948168720 con 0x55f2022ac120 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9481f69c0 con 0x55f2022c6ae0 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc9481680d0 con 0x55f20227d830 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38498/0 (socket says 172.21.15.134:38498) 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 -- 172.21.15.134:0/3937682714 learned_addr learned my addr 172.21.15.134:0/3937682714 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 -- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 msgr2=0x55f2022af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f2022af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 -- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 msgr2=0x55f2022ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f2022ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 -- 172.21.15.134:0/3937682714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2022ef910 con 0x55f2022ac120 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.835+0000 7fc94d416640 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc944004390 tx=0x7fc944004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6233de196da6ab33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc92affd640 1 -- 172.21.15.134:0/3937682714 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944025070 con 0x55f2022ac120 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc92affd640 1 -- 172.21.15.134:0/3937682714 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944019030 con 0x55f2022ac120 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc92affd640 1 -- 172.21.15.134:0/3937682714 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944021480 con 0x55f2022ac120 2024-09-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 -- 172.21.15.134:0/3937682714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 msgr2=0x55f2022ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc944004390 tx=0x7fc944004730 comp rx=0 tx=0).stop 2024-09-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 -- 172.21.15.134:0/3937682714 shutdown_connections 2024-09-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022c6ae0 0x55f2022ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022ac120 0x55f2022ca440 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3937682714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f2022af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 -- 172.21.15.134:0/3937682714 >> 172.21.15.134:0/3937682714 conn(0x55f20227fa80 msgr2=0x55f202282220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 -- 172.21.15.134:0/3937682714 shutdown_connections 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.836+0000 7fc952c1b740 1 -- 172.21.15.134:0/3937682714 wait complete. 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.837+0000 7fc952c1b740 1 -- start start 2024-09-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.837+0000 7fc952c1b740 1 Processor -- start 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f20227c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f202281190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f2022afa10 con 0x55f2022c6ae0 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f2022c30a0 con 0x55f2022ac120 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55f202280370 con 0x55f20227d830 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 10 client.0 _ll_register_callbacks cb 0x7fc93c0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38502/0 (socket says 172.21.15.134:38502) 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 -- 172.21.15.134:0/3798770378 learned_addr learned my addr 172.21.15.134:0/3798770378 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94dc17640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f20227c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94d416640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f202281190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 -- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 msgr2=0x55f20227c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f20227c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 -- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 msgr2=0x55f202281190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:51.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f202281190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 -- 172.21.15.134:0/3798770378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2022984c0 con 0x55f2022c6ae0 2024-09-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94d416640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f202281190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc94e418640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc940002230 tx=0x7fc940003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f806f796c2b9a733 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc928ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940036070 con 0x55f2022c6ae0 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fc940014830 con 0x55f2022c6ae0 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.838+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc944019030 con 0x55f2022c6ae0 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc940018020 con 0x55f2022c6ae0 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 10 client.7527 fetch_fsmap learned FSMap version 61 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55f20227b8d0 con 0x55f2022c6ae0 2024-09-15T22:46:51.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944019030 con 0x55f2022c6ae0 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fc940039020 con 0x55f2022c6ae0 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 10 client.7527 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 10 client.7527 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 20 client.7527 populate_metadata read hostname 'smithi134' 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f202349630 0x55f2022d9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 4 client.7527 mds_command: new command op to 7368 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 --> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] -- command(tid 0: {"prefix": "status"}) -- 0x55f2021ebfa0 con 0x55f202349630 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc94dc17640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f202349630 0x55f2022d9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 10 client.7527 ms_handle_connect on v2:172.21.15.134:6834/1968724028 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc94dc17640 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f202349630 0x55f2022d9d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d718dd51e67a012 server_cookie=74b1ac5e2691ad1d in_seq=0 out_seq=0 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 1 -- 172.21.15.134:0/3798770378 <== mds.0 v2:172.21.15.134:6834/1968724028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55f2021ebfa0 con 0x55f202349630 2024-09-15T22:46:51.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc928ff9640 10 client.7527 handle_command_reply: tid=0 2024-09-15T22:46:51.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.839+0000 7fc952c1b740 1 client.7527 shutdown 2024-09-15T22:46:51.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 msgr2=0x55f2022816d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc940002230 tx=0x7fc940003ae0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 shutdown_connections 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:6834/1968724028,v1:172.21.15.134:6835/1968724028] conn(0x55f202349630 0x55f2022d9d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2022c6ae0 0x55f2022816d0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2022ac120 0x55f202281190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc928ff9640 0 client.7527 ms_handle_reset on v2:172.21.15.134:6834/1968724028 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 --2- 172.21.15.134:0/3798770378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f20227d830 0x55f20227c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 >> 172.21.15.134:0/3798770378 conn(0x55f20227fa80 msgr2=0x55f2022aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 shutdown_connections 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 1 -- 172.21.15.134:0/3798770378 wait complete. 2024-09-15T22:46:51.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc952c1b740 20 client.7527 trim_cache size 0 max 16384 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 7368, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 9.2234010610000006, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 61, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 122, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 122, 2024-09-15T22:46:51.869 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 13.574926552999999 2024-09-15T22:46:51.870 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 msgr2=0x7fc92c06eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 0x7fc92c06eb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc948158540 tx=0x7fc944008040 comp rx=0 tx=0).stop 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 msgr2=0x7fc948071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 shutdown_connections 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94815ce80 0x7fc9481575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc94815ca40 0x7fc948154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc92c06c6d0 0x7fc92c06eb90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 --2- 172.21.15.134:0/905451653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9480d02a0 0x7fc948071580 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 >> 172.21.15.134:0/905451653 conn(0x7fc948062cc0 msgr2=0x7fc94815b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 shutdown_connections 2024-09-15T22:46:51.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.840+0000 7fc94fe7b640 1 -- 172.21.15.134:0/905451653 wait complete. 2024-09-15T22:46:51.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:46:51.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:46:51.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:46:51.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.971+0000 7fb643df1640 1 Processor -- start 2024-09-15T22:46:51.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.972+0000 7fb643df1640 1 -- start start 2024-09-15T22:46:51.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.972+0000 7fb643df1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb63c151c50 0x7fb63c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.972+0000 7fb643df1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63c0cd5f0 con 0x7fb63c06c1f0 2024-09-15T22:46:51.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.972+0000 7fb643df1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63c0cd8d0 con 0x7fb63c06be10 2024-09-15T22:46:51.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.972+0000 7fb643df1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb63c0cdbb0 con 0x7fb63c151c50 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64238e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb63c06c1f0 0x7fb63c164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:39168/0 (socket says 172.21.15.134:39168) 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64238e640 1 -- 172.21.15.134:0/4207608087 learned_addr learned my addr 172.21.15.134:0/4207608087 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64138c640 1 --2- 172.21.15.134:0/4207608087 >> v2:172.21.15.177:3300/0 conn(0x7fb63c151c50 0x7fb63c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670845415 0 0) 0x7fb63c0cd5f0 con 0x7fb63c06c1f0 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624003520 con 0x7fb63c06c1f0 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64138c640 1 -- 172.21.15.134:0/4207608087 >> v1:172.21.15.177:6789/0 conn(0x7fb63c06be10 legacy=0x7fb63c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4013907779 0 0) 0x7fb624003520 con 0x7fb63c06c1f0 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64138c640 1 -- 172.21.15.134:0/4207608087 >> v1:172.21.15.134:6789/0 conn(0x7fb63c06c1f0 legacy=0x7fb63c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.973+0000 7fb64138c640 1 -- 172.21.15.134:0/4207608087 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63c0cde90 con 0x7fb63c151c50 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.974+0000 7fb64138c640 1 --2- 172.21.15.134:0/4207608087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c151c50 0x7fb63c0cd010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb630009720 tx=0x7fb63002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237e550ae8099c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.974+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630037070 con 0x7fb63c151c50 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.974+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63002aaf0 con 0x7fb63c151c50 2024-09-15T22:46:51.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.974+0000 7fb640b8b640 1 -- 172.21.15.134:0/4207608087 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0019f0 con 0x7fb63c151c50 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 -- 172.21.15.134:0/4207608087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c151c50 msgr2=0x7fb63c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 --2- 172.21.15.134:0/4207608087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c151c50 0x7fb63c0cd010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb630009720 tx=0x7fb63002a060 comp rx=0 tx=0).stop 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 -- 172.21.15.134:0/4207608087 shutdown_connections 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 --2- 172.21.15.134:0/4207608087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c151c50 0x7fb63c0cd010 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 -- 172.21.15.134:0/4207608087 >> 172.21.15.134:0/4207608087 conn(0x7fb63c062cc0 msgr2=0x7fb63c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 -- 172.21.15.134:0/4207608087 shutdown_connections 2024-09-15T22:46:51.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.975+0000 7fb643df1640 1 -- 172.21.15.134:0/4207608087 wait complete. 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.976+0000 7fb643df1640 1 Processor -- start 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.976+0000 7fb643df1640 1 -- start start 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06be10 0x7fb63c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63c06c1f0 0x7fb63c14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c15baa0 con 0x7fb63c151c50 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c0ce690 con 0x7fb63c06be10 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb63c15bc20 con 0x7fb63c06c1f0 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38516/0 (socket says 172.21.15.134:38516) 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 -- 172.21.15.134:0/214354016 learned_addr learned my addr 172.21.15.134:0/214354016 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64138c640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63c06c1f0 0x7fb63c14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb641b8d640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06be10 0x7fb63c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 -- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63c06c1f0 msgr2=0x7fb63c14af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63c06c1f0 0x7fb63c14af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 -- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06be10 msgr2=0x7fb63c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06be10 0x7fb63c0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 -- 172.21.15.134:0/214354016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63c14ab00 con 0x7fb63c151c50 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb64238e640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c890 tx=0x7fb62c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c018070 con 0x7fb63c151c50 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c00a640 con 0x7fb63c151c50 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00aa10 con 0x7fb63c151c50 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63c149d40 con 0x7fb63c151c50 2024-09-15T22:46:51.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.977+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63c14a300 con 0x7fb63c151c50 2024-09-15T22:46:51.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.978+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63c14baa0 con 0x7fb63c151c50 2024-09-15T22:46:51.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.979+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fb62c01b070 con 0x7fb63c151c50 2024-09-15T22:46:51.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.979+0000 7fb63a7fc640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 0x7fb62806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:51.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.979+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fb62c08b1b0 con 0x7fb63c151c50 2024-09-15T22:46:51.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.980+0000 7fb641b8d640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 0x7fb62806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:51.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.980+0000 7fb641b8d640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 0x7fb62806eb60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb63c14dbc0 tx=0x7fb634009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:51.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:51.984+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb62c058d60 con 0x7fb63c151c50 2024-09-15T22:46:52.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.184+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb63c0761a0 con 0x7fb63c151c50 2024-09-15T22:46:52.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.184+0000 7fb63a7fc640 1 -- 172.21.15.134:0/214354016 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7fb62c05d060 con 0x7fb63c151c50 2024-09-15T22:46:52.186 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 msgr2=0x7fb62806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 0x7fb62806eb60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb63c14dbc0 tx=0x7fb634009040 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 msgr2=0x7fb63c14b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c890 tx=0x7fb62c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 shutdown_connections 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb62806c6a0 0x7fb62806eb60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c151c50 0x7fb63c14b440 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63c06c1f0 0x7fb63c14af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 --2- 172.21.15.134:0/214354016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06be10 0x7fb63c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 >> 172.21.15.134:0/214354016 conn(0x7fb63c062cc0 msgr2=0x7fb63c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:52.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 shutdown_connections 2024-09-15T22:46:52.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52.186+0000 7fb643df1640 1 -- 172.21.15.134:0/214354016 wait complete. 2024-09-15T22:46:52.198 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:46:52.198 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:46:52.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:46:52.199 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:46:52.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.199 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:46:52.215 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42481sec preferred_lft 42481sec 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:52.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.218 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:46:52.280 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:46:52.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.281 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:46:52.337 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:46:52.338 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:46:52.338 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:46:52.338 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:46:52.338 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:46:52.338 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:46:52.338 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:46:52.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:46:52.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:46:52.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:46:52.339 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:46:52.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:46:52.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.463 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:46:52.478 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:46:52.479 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:46:52.479 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:46:52.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:46:52.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:52.544 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:52.600 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:46:52.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:52.600 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:52.658 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:46:52.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:52.741 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:52.741 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:52.741 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:52.750 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:52.750 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:52.750 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:52.750 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:52.750 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:52.754 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:46:52.755 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:46:52.756 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:46:52.756 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:46:52.756 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:46:52.756 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:46:52.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:46:52.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:52.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:46:52.822 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:46:52.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:46:52.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:52.923 INFO:teuthology.orchestra.run.smithi134.stdout:client6140 2024-09-15T22:46:52.924 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:52.924 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:52.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:46:53.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.078+0000 7f10a6786640 1 Processor -- start 2024-09-15T22:46:53.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.078+0000 7f10a6786640 1 -- start start 2024-09-15T22:46:53.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a6786640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 0x7f10a00cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a6786640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10a006c1f0 0x7f10a015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a6786640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a00cd5f0 con 0x7f10a006be10 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a6786640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00cd8d0 con 0x7f10a006c1f0 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a6786640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f10a00cdbb0 con 0x7f10a0151c50 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10a006c1f0 0x7f10a015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10a006c1f0 0x7f10a015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38526/0 (socket says 172.21.15.134:38526) 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 -- 172.21.15.134:0/264038492 learned_addr learned my addr 172.21.15.134:0/264038492 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 -- 172.21.15.134:0/264038492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 msgr2=0x7f10a00cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f109f7fe640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 0x7f10a00cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 0x7f10a00cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 -- 172.21.15.134:0/264038492 >> v1:172.21.15.177:6789/0 conn(0x7f10a006be10 legacy=0x7f10a0151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f10a4d23640 1 -- 172.21.15.134:0/264038492 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a00cde90 con 0x7f10a006c1f0 2024-09-15T22:46:53.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.079+0000 7f109f7fe640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 0x7f10a00cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.080+0000 7f10a4d23640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a006c1f0 0x7f10a015baa0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f109802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b56919693b3052 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.080+0000 7f109effd640 1 -- 172.21.15.134:0/264038492 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098036070 con 0x7f10a006c1f0 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.080+0000 7f109effd640 1 -- 172.21.15.134:0/264038492 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098031600 con 0x7f10a006c1f0 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.080+0000 7f109effd640 1 -- 172.21.15.134:0/264038492 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980319d0 con 0x7f10a006c1f0 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 -- 172.21.15.134:0/264038492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a006c1f0 msgr2=0x7f10a015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a006c1f0 0x7f10a015baa0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f109802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 -- 172.21.15.134:0/264038492 shutdown_connections 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a006c1f0 0x7f10a015baa0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 --2- 172.21.15.134:0/264038492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a0151c50 0x7f10a00cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 -- 172.21.15.134:0/264038492 >> 172.21.15.134:0/264038492 conn(0x7f10a0062cc0 msgr2=0x7f10a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:53.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 -- 172.21.15.134:0/264038492 shutdown_connections 2024-09-15T22:46:53.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.081+0000 7f10a6786640 1 -- 172.21.15.134:0/264038492 wait complete. 2024-09-15T22:46:53.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.082+0000 7f10a6786640 1 Processor -- start 2024-09-15T22:46:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.082+0000 7f10a6786640 1 -- start start 2024-09-15T22:46:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 0x7f10a0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 0x7f10a0149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10a00d0310 con 0x7f10a0151c50 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f10a00ce690 con 0x7f10a006c1f0 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a6786640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f10a00d0490 con 0x7f10a006be10 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38540/0 (socket says 172.21.15.134:38540) 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 -- 172.21.15.134:0/41022972 learned_addr learned my addr 172.21.15.134:0/41022972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f109f7fe640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 0x7f10a0149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f109ffff640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 0x7f10a0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 -- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 msgr2=0x7f10a0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 0x7f10a0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 -- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 msgr2=0x7f10a0149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 0x7f10a0149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 -- 172.21.15.134:0/41022972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a014a020 con 0x7f10a0151c50 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f109f7fe640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 0x7f10a0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f109ffff640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 0x7f10a0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.083+0000 7f10a4d23640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f1098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.084+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098036050 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.084+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098042070 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.084+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098009510 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.084+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a00722d0 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.084+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a0149000 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.085+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a00d0fb0 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.085+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f1098007b90 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.086+0000 7f109cff9640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 0x7f108c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.086+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f10980acba0 con 0x7f10a0151c50 2024-09-15T22:46:53.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.086+0000 7f109ffff640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 0x7f108c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:53.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.086+0000 7f109ffff640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 0x7f108c06eb60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1090003eb0 tx=0x7f1090009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:53.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.090+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a00d0fb0 con 0x7f10a0151c50 2024-09-15T22:46:53.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.293+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10a00d08f0 con 0x7f10a0151c50 2024-09-15T22:46:53.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.293+0000 7f109cff9640 1 -- 172.21.15.134:0/41022972 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7f109807ac90 con 0x7f10a0151c50 2024-09-15T22:46:53.295 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:46:53.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 msgr2=0x7f108c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:53.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 0x7f108c06eb60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1090003eb0 tx=0x7f1090009040 comp rx=0 tx=0).stop 2024-09-15T22:46:53.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 msgr2=0x7f10a01484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:53.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f1098004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:53.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 shutdown_connections 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f108c06c6a0 0x7f108c06eb60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a0151c50 0x7f10a01484b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10a006c1f0 0x7f10a0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 --2- 172.21.15.134:0/41022972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10a006be10 0x7f10a0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 >> 172.21.15.134:0/41022972 conn(0x7f10a0062cc0 msgr2=0x7f10a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 shutdown_connections 2024-09-15T22:46:53.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:53.296+0000 7f10a6786640 1 -- 172.21.15.134:0/41022972 wait complete. 2024-09-15T22:46:53.308 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:46:53.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:46:53.309 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:53.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.309 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:46:53.329 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:46:53.330 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42470sec preferred_lft 42470sec 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.331 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:46:53.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.332 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:46:53.398 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:46:53.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.399 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:46:53.460 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:46:53.460 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:46:53.460 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:46:53.460 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:46:53.460 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:46:53.461 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:46:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:46:53.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:53.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.592 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:46:53.608 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:46:53.609 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:46:53.609 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:53.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:46:53.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:53.674 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:53.730 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:46:53.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:46:53.731 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:53.786 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:46:53.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:53.870 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:53.870 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:53.871 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:53.883 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:46:53.883 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:46:53.883 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:46:53.884 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:46:53.885 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:46:53.886 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:46:53.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:53.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:46:53.951 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:46:54.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:46:54.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:46:54.046 INFO:teuthology.orchestra.run.smithi177.stdout:client6143 2024-09-15T22:46:54.046 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:46:54.046 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:46:54.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:46:54.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.171+0000 7f9486ee4640 1 Processor -- start 2024-09-15T22:46:54.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.171+0000 7f9486ee4640 1 -- start start 2024-09-15T22:46:54.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9486ee4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f948006c2b0 0x7f9480148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9486ee4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948006e660 con 0x7f9480147970 2024-09-15T22:46:54.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9486ee4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94800b5ee0 con 0x7f948006d980 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9486ee4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f948006dd90 con 0x7f948006c2b0 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9484c80640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9480147970 0x7f948006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:39174/0 (socket says 172.21.15.134:39174) 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.172+0000 7f9484c80640 1 -- 172.21.15.134:0/1414471591 learned_addr learned my addr 172.21.15.134:0/1414471591 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947ffff640 1 --2- 172.21.15.134:0/1414471591 >> v2:172.21.15.177:3300/0 conn(0x7f948006c2b0 0x7f9480148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732109980 0 0) 0x7f9470001110 con 0x7f9480147970 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9468003520 con 0x7f9480147970 2024-09-15T22:46:54.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947ffff640 1 -- 172.21.15.134:0/1414471591 >> v1:172.21.15.177:6789/0 conn(0x7f948006d980 legacy=0x7f94800b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816543405 0 0) 0x7f94800b5ee0 con 0x7f948006d980 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947ffff640 1 -- 172.21.15.134:0/1414471591 >> v1:172.21.15.134:6789/0 conn(0x7f9480147970 legacy=0x7f948006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.173+0000 7f947ffff640 1 -- 172.21.15.134:0/1414471591 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800b61c0 con 0x7f948006c2b0 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f947ffff640 1 --2- 172.21.15.134:0/1414471591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948006c2b0 0x7f9480148040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f94740097a0 tx=0x7f947402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b72d1a5f878b4730 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474037070 con 0x7f948006c2b0 2024-09-15T22:46:54.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474032440 con 0x7f948006c2b0 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f947f7fe640 1 -- 172.21.15.134:0/1414471591 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474032810 con 0x7f948006c2b0 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f9486ee4640 1 -- 172.21.15.134:0/1414471591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948006c2b0 msgr2=0x7f9480148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f9486ee4640 1 --2- 172.21.15.134:0/1414471591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948006c2b0 0x7f9480148040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f94740097a0 tx=0x7f947402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f9486ee4640 1 -- 172.21.15.134:0/1414471591 shutdown_connections 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f9486ee4640 1 --2- 172.21.15.134:0/1414471591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948006c2b0 0x7f9480148040 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.174+0000 7f9486ee4640 1 -- 172.21.15.134:0/1414471591 >> 172.21.15.134:0/1414471591 conn(0x7f948006ccb0 msgr2=0x7f948006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:54.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.175+0000 7f9486ee4640 1 -- 172.21.15.134:0/1414471591 shutdown_connections 2024-09-15T22:46:54.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.175+0000 7f9486ee4640 1 -- 172.21.15.134:0/1414471591 wait complete. 2024-09-15T22:46:54.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.176+0000 7f9486ee4640 1 Processor -- start 2024-09-15T22:46:54.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.176+0000 7f9486ee4640 1 -- start start 2024-09-15T22:46:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948006d980 0x7f94800cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9480147970 0x7f948013fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94800b6780 con 0x7f948006c2b0 2024-09-15T22:46:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94800b5c90 con 0x7f9480147970 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9480147d50 con 0x7f948006d980 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38546/0 (socket says 172.21.15.134:38546) 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 -- 172.21.15.134:0/2022108656 learned_addr learned my addr 172.21.15.134:0/2022108656 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 -- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948006d980 msgr2=0x7f94800cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948006d980 0x7f94800cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9485481640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9480147970 0x7f948013fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 -- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9480147970 msgr2=0x7f948013fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9480147970 0x7f948013fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 -- 172.21.15.134:0/2022108656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948015e1b0 con 0x7f948006c2b0 2024-09-15T22:46:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9484c80640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f947000c3d0 tx=0x7f947000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470017070 con 0x7f948006c2b0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9470005ce0 con 0x7f948006c2b0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800d0630 con 0x7f948006c2b0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470007310 con 0x7f948006c2b0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.177+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9480141fa0 con 0x7f948006c2b0 2024-09-15T22:46:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.178+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480148040 con 0x7f948006c2b0 2024-09-15T22:46:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.179+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f947001a070 con 0x7f948006c2b0 2024-09-15T22:46:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.179+0000 7f947d7fa640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 0x7f946c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.179+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f947008aff0 con 0x7f948006c2b0 2024-09-15T22:46:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.180+0000 7f947ffff640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 0x7f946c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.180+0000 7f947ffff640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 0x7f946c06eb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9474034000 tx=0x7f947402c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.184+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94800d0630 con 0x7f948006c2b0 2024-09-15T22:46:54.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.386+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9480141590 con 0x7f948006c2b0 2024-09-15T22:46:54.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.968+0000 7f947d7fa640 1 -- 172.21.15.134:0/2022108656 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v62) ==== 136+0+0 (secure 0 0 0) 0x7f948015e1b0 con 0x7f948006c2b0 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 msgr2=0x7f946c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 0x7f946c06eb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9474034000 tx=0x7f947402c000 comp rx=0 tx=0).stop 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 msgr2=0x7f948015dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f947000c3d0 tx=0x7f947000c890 comp rx=0 tx=0).stop 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 shutdown_connections 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9480147970 0x7f948013fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948006d980 0x7f94800cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f946c06c6a0 0x7f946c06eb60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 --2- 172.21.15.134:0/2022108656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f948006c2b0 0x7f948015dc70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 >> 172.21.15.134:0/2022108656 conn(0x7f948006ccb0 msgr2=0x7f948006fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 shutdown_connections 2024-09-15T22:46:54.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:54.970+0000 7f9486ee4640 1 -- 172.21.15.134:0/2022108656 wait complete. 2024-09-15T22:46:54.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:46:55.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.085+0000 7f250f14b640 1 Processor -- start 2024-09-15T22:46:55.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.085+0000 7f250f14b640 1 -- start start 2024-09-15T22:46:55.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250f14b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f2508162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250f14b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f250815ebb0 0x7f25080b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250f14b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250815f520 con 0x7f25080b3840 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250f14b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f250815fae0 con 0x7f250815ebb0 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250f14b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f250815f800 con 0x7f2508162860 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f250815ebb0 0x7f25080b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250cee7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f2508162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f250815ebb0 0x7f25080b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:41628/0 (socket says 172.21.15.134:41628) 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 -- 172.21.15.134:0/524878884 learned_addr learned my addr 172.21.15.134:0/524878884 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250d6e8640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f25080b3840 0x7f250806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:47284/0 (socket says 172.21.15.134:47284) 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 -- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 msgr2=0x7f2508162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f2508162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 -- 172.21.15.134:0/524878884 >> v1:172.21.15.177:6789/0 conn(0x7f25080b3840 legacy=0x7f250806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f2507fff640 1 -- 172.21.15.134:0/524878884 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25080b2b00 con 0x7f250815ebb0 2024-09-15T22:46:55.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f25077fe640 1 -- 172.21.15.134:0/524878884 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309716659 0 0) 0x7f250815f520 con 0x7f25080b3840 2024-09-15T22:46:55.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.086+0000 7f250cee7640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f2508162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.087+0000 7f2507fff640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f25080b3300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009870 tx=0x7f24f402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb07fdf7a7492552 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.087+0000 7f25077fe640 1 -- 172.21.15.134:0/524878884 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4037070 con 0x7f250815ebb0 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.087+0000 7f25077fe640 1 -- 172.21.15.134:0/524878884 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4032440 con 0x7f250815ebb0 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.087+0000 7f25077fe640 1 -- 172.21.15.134:0/524878884 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4032810 con 0x7f250815ebb0 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 -- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 msgr2=0x7f25080b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f25080b3300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009870 tx=0x7f24f402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 -- 172.21.15.134:0/524878884 shutdown_connections 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f25080b3300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 --2- 172.21.15.134:0/524878884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f2508162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 -- 172.21.15.134:0/524878884 >> 172.21.15.134:0/524878884 conn(0x7f250806ce90 msgr2=0x7f250806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 -- 172.21.15.134:0/524878884 shutdown_connections 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.088+0000 7f250f14b640 1 -- 172.21.15.134:0/524878884 wait complete. 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.089+0000 7f250f14b640 1 Processor -- start 2024-09-15T22:46:55.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.089+0000 7f250f14b640 1 -- start start 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f2508157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f25080b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f250806c430 con 0x7f25080b3840 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f250806c2b0 con 0x7f250815ebb0 2024-09-15T22:46:55.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250f14b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f250815eff0 con 0x7f2508162860 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38558/0 (socket says 172.21.15.134:38558) 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 -- 172.21.15.134:0/1079291255 learned_addr learned my addr 172.21.15.134:0/1079291255 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f2507fff640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f2508157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250d6e8640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f25080b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 -- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 msgr2=0x7f25080b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f25080b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 -- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 msgr2=0x7f2508157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f2508157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.090+0000 7f250cee7640 1 -- 172.21.15.134:0/1079291255 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250815d260 con 0x7f25080b3840 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f250cee7640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00e960 tx=0x7f24fc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc017070 con 0x7f25080b3840 2024-09-15T22:46:55.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc00ca00 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250815e670 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00cdd0 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.091+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2508155710 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.092+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25080b3300 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.092+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f24fc01a070 con 0x7f25080b3840 2024-09-15T22:46:55.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.093+0000 7f25057fa640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 0x7f24ec06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.093+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f24fc08b940 con 0x7f25080b3840 2024-09-15T22:46:55.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.093+0000 7f2507fff640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 0x7f24ec06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.093+0000 7f2507fff640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 0x7f24ec06eb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.097+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24fc0594f0 con 0x7f25080b3840 2024-09-15T22:46:55.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.283+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f2508162c40 con 0x7f24ec06c6a0 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.285+0000 7f25057fa640 1 -- 172.21.15.134:0/1079291255 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f2508162c40 con 0x7f24ec06c6a0 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:55.286 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:46:55.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 msgr2=0x7f24ec06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 0x7f24ec06eb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 msgr2=0x7f25081551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00e960 tx=0x7f24fc00ee20 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 shutdown_connections 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2508162860 0x7f25080b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f250815ebb0 0x7f2508157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f24ec06c6a0 0x7f24ec06eb60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 --2- 172.21.15.134:0/1079291255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25080b3840 0x7f25081551d0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 >> 172.21.15.134:0/1079291255 conn(0x7f250806ce90 msgr2=0x7f250806f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 shutdown_connections 2024-09-15T22:46:55.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.287+0000 7f250f14b640 1 -- 172.21.15.134:0/1079291255 wait complete. 2024-09-15T22:46:55.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:46:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.401+0000 7fe8fab59640 1 Processor -- start 2024-09-15T22:46:55.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.401+0000 7fe8fab59640 1 -- start start 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8fab59640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8f415d790 0x7fe8f40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8fab59640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 0x7fe8f40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8fab59640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f406d700 con 0x7fe8f415d3b0 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8fab59640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f406da30 con 0x7fe8f415d790 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8fab59640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f40cde80 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8ebfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8f415d790 0x7fe8f40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8f88f5640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe8f415d3b0 0x7fe8f4071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:39182/0 (socket says 172.21.15.134:39182) 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8f88f5640 1 -- 172.21.15.134:0/1916354432 learned_addr learned my addr 172.21.15.134:0/1916354432 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8f90f6640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 0x7fe8f40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8ebfff640 1 -- 172.21.15.134:0/1916354432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 msgr2=0x7fe8f40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8ebfff640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 0x7fe8f40cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8ebfff640 1 -- 172.21.15.134:0/1916354432 >> v1:172.21.15.134:6789/0 conn(0x7fe8f415d3b0 legacy=0x7fe8f4071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8ebfff640 1 -- 172.21.15.134:0/1916354432 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f40cd8c0 con 0x7fe8f415d790 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8eb7fe640 1 -- 172.21.15.134:0/1916354432 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594486198 0 0) 0x7fe8f406d700 con 0x7fe8f415d3b0 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.402+0000 7fe8f90f6640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 0x7fe8f40cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:55.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.403+0000 7fe8ebfff640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f415d790 0x7fe8f40cce70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe8f406dbb0 tx=0x7fe8e402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e67406f9ff6fd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.403+0000 7fe8eb7fe640 1 -- 172.21.15.134:0/1916354432 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4037070 con 0x7fe8f415d790 2024-09-15T22:46:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.403+0000 7fe8eb7fe640 1 -- 172.21.15.134:0/1916354432 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e4032440 con 0x7fe8f415d790 2024-09-15T22:46:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.403+0000 7fe8eb7fe640 1 -- 172.21.15.134:0/1916354432 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4032810 con 0x7fe8f415d790 2024-09-15T22:46:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 -- 172.21.15.134:0/1916354432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f415d790 msgr2=0x7fe8f40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f415d790 0x7fe8f40cce70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe8f406dbb0 tx=0x7fe8e402a160 comp rx=0 tx=0).stop 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 -- 172.21.15.134:0/1916354432 shutdown_connections 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f40cd3b0 0x7fe8f40cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 --2- 172.21.15.134:0/1916354432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f415d790 0x7fe8f40cce70 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 -- 172.21.15.134:0/1916354432 >> 172.21.15.134:0/1916354432 conn(0x7fe8f406bba0 msgr2=0x7fe8f406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 -- 172.21.15.134:0/1916354432 shutdown_connections 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.404+0000 7fe8fab59640 1 -- 172.21.15.134:0/1916354432 wait complete. 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.405+0000 7fe8fab59640 1 Processor -- start 2024-09-15T22:46:55.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.405+0000 7fe8fab59640 1 -- start start 2024-09-15T22:46:55.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f415d3b0 0x7fe8f40aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f40aa4d0 0x7fe8f4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f415cd70 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f415cbf0 con 0x7fe8f40aa4d0 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f40cf860 con 0x7fe8f415d3b0 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38576/0 (socket says 172.21.15.134:38576) 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 -- 172.21.15.134:0/3789071537 learned_addr learned my addr 172.21.15.134:0/3789071537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 -- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f415d3b0 msgr2=0x7fe8f40aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f415d3b0 0x7fe8f40aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 -- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f40aa4d0 msgr2=0x7fe8f4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f40aa4d0 0x7fe8f4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 -- 172.21.15.134:0/3789071537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f40aa9d0 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8f88f5640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c4d0 tx=0x7fe8f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0018070 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f0007500 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f40aacb0 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0004a20 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.406+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f40ab550 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.408+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f40aae80 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.408+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7fe8f001b070 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.408+0000 7fe8e97fa640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 0x7fe8e006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.408+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fe8f008af20 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.408+0000 7fe8ebfff640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 0x7fe8e006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.409+0000 7fe8ebfff640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 0x7fe8e006eb60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4034000 tx=0x7fe8e402c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.412+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8f0059090 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.578+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe8f40cfc90 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.579+0000 7fe8e97fa640 1 -- 172.21.15.134:0/3789071537 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fe8f0058990 con 0x7fe8f40cd3b0 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 msgr2=0x7fe8e006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 0x7fe8e006eb60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4034000 tx=0x7fe8e402c000 comp rx=0 tx=0).stop 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 msgr2=0x7fe8f40b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c4d0 tx=0x7fe8f000c990 comp rx=0 tx=0).stop 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 shutdown_connections 2024-09-15T22:46:55.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f40aa4d0 0x7fe8f4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8f415d3b0 0x7fe8f40aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe8e006c6a0 0x7fe8e006eb60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 --2- 172.21.15.134:0/3789071537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8f40cd3b0 0x7fe8f40b4010 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 >> 172.21.15.134:0/3789071537 conn(0x7fe8f406bba0 msgr2=0x7fe8f415e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 shutdown_connections 2024-09-15T22:46:55.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:55.581+0000 7fe8fab59640 1 -- 172.21.15.134:0/3789071537 wait complete. 2024-09-15T22:46:55.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.594 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol91280/dca33315-5300-4c88-bfae-7fc8eb81e421) 2024-09-15T22:46:55.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.624 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol91280/dca33315-5300-4c88-bfae-7fc8eb81e421/.snap/fake) 2024-09-15T22:46:55.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.696 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:46:55.750 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:46:55.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.750 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol91280/dca33315-5300-4c88-bfae-7fc8eb81e421) 2024-09-15T22:46:55.818 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:55.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol91280/.meta 2024-09-15T22:46:55.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.887 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp58660/subvol44061/fe080379-ac82-4419-a16e-20fd209951cf) 2024-09-15T22:46:55.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:55.954 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp58660/subvol44061/fe080379-ac82-4419-a16e-20fd209951cf/.snap/fake) 2024-09-15T22:46:56.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:56.025 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:46:56.081 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:46:56.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:56.081 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp58660/subvol44061/fe080379-ac82-4419-a16e-20fd209951cf) 2024-09-15T22:46:56.153 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:56.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp58660/subvol44061/.meta 2024-09-15T22:46:56.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:56.219 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol3802/6f3e8fc2-70f0-4657-9321-856a4bd30d2b) 2024-09-15T22:46:56.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:56.287 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:46:56.343 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:46:56.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:56.343 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol3802/6f3e8fc2-70f0-4657-9321-856a4bd30d2b) 2024-09-15T22:46:56.412 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:46:56.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol3802/.meta 2024-09-15T22:46:56.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol91280 2024-09-15T22:46:56.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.618+0000 7f14d4f26640 1 Processor -- start 2024-09-15T22:46:56.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.618+0000 7f14d4f26640 1 -- start start 2024-09-15T22:46:56.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.619+0000 7f14d4f26640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14d0161e30 0x7f14d00d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.619+0000 7f14d4f26640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d00cf9a0 con 0x7f14d006dfd0 2024-09-15T22:46:56.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.619+0000 7f14d4f26640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d0162210 con 0x7f14d00b3d50 2024-09-15T22:46:56.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.619+0000 7f14d4f26640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f14d00cfcf0 con 0x7f14d0161e30 2024-09-15T22:46:56.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14ced9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f14d006dfd0 0x7f14d00b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45904/0 (socket says 172.21.15.134:45904) 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14ced9d640 1 -- 172.21.15.134:0/2377609993 learned_addr learned my addr 172.21.15.134:0/2377609993 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14ce59c640 1 --2- 172.21.15.134:0/2377609993 >> v2:172.21.15.177:3300/0 conn(0x7f14d0161e30 0x7f14d00d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102095854 0 0) 0x7f14d00cf9a0 con 0x7f14d006dfd0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b8003520 con 0x7f14d006dfd0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3530933441 0 0) 0x7f14b8003520 con 0x7f14d006dfd0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 >> v2:172.21.15.177:3300/0 conn(0x7f14d0161e30 msgr2=0x7f14d00d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 --2- 172.21.15.134:0/2377609993 >> v2:172.21.15.177:3300/0 conn(0x7f14d0161e30 0x7f14d00d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 >> v1:172.21.15.177:6789/0 conn(0x7f14d00b3d50 legacy=0x7f14d006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d00d5210 con 0x7f14d006dfd0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f14c80019f0 con 0x7f14d006dfd0 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 >> v1:172.21.15.134:6789/0 conn(0x7f14d006dfd0 legacy=0x7f14d00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b80039b0 0x7f14b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 0x7f14b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14b80051c0 0x7f14b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00cfcf0 con 0x7f14b8004800 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f14b800c060 con 0x7f14b80039b0 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14b800c260 con 0x7f14b80051c0 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 0x7f14b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14ce59c640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b80039b0 0x7f14b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14ced9d640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14b80051c0 0x7f14b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cdd9b640 1 -- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14b80051c0 msgr2=0x7f14b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14b80051c0 0x7f14b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.620+0000 7f14cdd9b640 1 -- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b80039b0 msgr2=0x7f14b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b80039b0 0x7f14b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cdd9b640 1 -- 172.21.15.134:0/2377609993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b8003520 con 0x7f14b8004800 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14ced9d640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14b80051c0 0x7f14b800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14ced9d640 1 -- 172.21.15.134:0/2377609993 reap_dead start 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 0x7f14b8004c80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f14c4001720 tx=0x7f14b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451d0b91d7521a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4001370 con 0x7f14b8004800 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c40052d0 con 0x7f14b8004800 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.621+0000 7f14cd59a640 1 -- 172.21.15.134:0/2377609993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c402ab90 con 0x7f14b8004800 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 -- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 msgr2=0x7f14b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 0x7f14b8004c80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f14c4001720 tx=0x7f14b8005830 comp rx=0 tx=0).stop 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 -- 172.21.15.134:0/2377609993 shutdown_connections 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 --2- 172.21.15.134:0/2377609993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8004800 0x7f14b8004c80 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 -- 172.21.15.134:0/2377609993 >> 172.21.15.134:0/2377609993 conn(0x7f14d00d1870 msgr2=0x7f14d00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 -- 172.21.15.134:0/2377609993 shutdown_connections 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.622+0000 7f14d4f26640 1 -- 172.21.15.134:0/2377609993 wait complete. 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.623+0000 7f14d4f26640 1 Processor -- start 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 -- start start 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b8004800 0x7f14d00cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14d0160910 0x7f14d0160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00b3290 con 0x7f14d00cc3c0 2024-09-15T22:46:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00b3950 con 0x7f14b8004800 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14d4f26640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14d00b3410 con 0x7f14d0160910 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14cdd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14cdd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43522/0 (socket says 172.21.15.134:43522) 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.624+0000 7f14cdd9b640 1 -- 172.21.15.134:0/1176992270 learned_addr learned my addr 172.21.15.134:0/1176992270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14ce59c640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b8004800 0x7f14d00cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14ced9d640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14d0160910 0x7f14d0160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 -- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14d0160910 msgr2=0x7f14d0160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14d0160910 0x7f14d0160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 -- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b8004800 msgr2=0x7f14d00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b8004800 0x7f14d00cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 -- 172.21.15.134:0/1176992270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d00cc840 con 0x7f14d00cc3c0 2024-09-15T22:46:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14cdd9b640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000c00 tx=0x7f14c4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4040030 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c4005480 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d00cd830 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4001370 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.625+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d01592a0 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.626+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d01612d0 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.626+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f14c4043070 con 0x7f14d00cc3c0 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.627+0000 7f14beffd640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 0x7f14b006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.627+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f14c40ab2f0 con 0x7f14d00cc3c0 2024-09-15T22:46:56.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.627+0000 7f14ce59c640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 0x7f14b006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.628+0000 7f14ce59c640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 0x7f14b006eb60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009b80 tx=0x7f14c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.631+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14c404b020 con 0x7f14d00cc3c0 2024-09-15T22:46:56.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.821+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol91280", "target": ["mon-mgr", ""]}) -- 0x7f14d00cdd50 con 0x7f14b006c6a0 2024-09-15T22:46:56.828 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:56.827+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:56.829 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:56.827+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:56.829 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:56.827+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:56.829 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:56.827+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:56.829 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:56.827+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.859+0000 7f14beffd640 1 -- 172.21.15.134:0/1176992270 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f14d00cdd50 con 0x7f14b006c6a0 2024-09-15T22:46:56.861 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol91280/dca33315-5300-4c88-bfae-7fc8eb81e421 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 msgr2=0x7f14b006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 0x7f14b006eb60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009b80 tx=0x7f14c0008040 comp rx=0 tx=0).stop 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 msgr2=0x7f14d01546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000c00 tx=0x7f14c4001120 comp rx=0 tx=0).stop 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 shutdown_connections 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14d0160910 0x7f14d0160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b006c6a0 0x7f14b006eb60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d00cc3c0 0x7f14d01546f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 --2- 172.21.15.134:0/1176992270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14b8004800 0x7f14d00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 >> 172.21.15.134:0/1176992270 conn(0x7f14d00d1870 msgr2=0x7f14d00ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 shutdown_connections 2024-09-15T22:46:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.861+0000 7f14d4f26640 1 -- 172.21.15.134:0/1176992270 wait complete. 2024-09-15T22:46:56.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol44061 subvol_grp58660 2024-09-15T22:46:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.975+0000 7f2243c53640 1 Processor -- start 2024-09-15T22:46:56.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.975+0000 7f2243c53640 1 -- start start 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c0b4f70 0x7f223c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c06fa40 0x7f223c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 0x7f223c160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f223c15fcd0 con 0x7f223c0b4f70 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f223c0b5890 con 0x7f223c15fed0 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f2243c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f223c06e9a0 con 0x7f223c06fa40 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c0b4f70 0x7f223c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f223c0b4f70 0x7f223c15f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43534/0 (socket says 172.21.15.134:43534) 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 -- 172.21.15.134:0/3946432225 learned_addr learned my addr 172.21.15.134:0/3946432225 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:56.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22411ee640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c06fa40 0x7f223c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22421f0640 1 --2- 172.21.15.134:0/3946432225 >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 0x7f223c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 -- 172.21.15.134:0/3946432225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c06fa40 msgr2=0x7f223c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c06fa40 0x7f223c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 -- 172.21.15.134:0/3946432225 >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 msgr2=0x7f223c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 --2- 172.21.15.134:0/3946432225 >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 0x7f223c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22419ef640 1 -- 172.21.15.134:0/3946432225 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c06ec80 con 0x7f223c0b4f70 2024-09-15T22:46:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.976+0000 7f22421f0640 1 --2- 172.21.15.134:0/3946432225 >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 0x7f223c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:56.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.977+0000 7f22419ef640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c0b4f70 0x7f223c15f790 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f223c073290 tx=0x7f223802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef651151eb3efba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.977+0000 7f22409ed640 1 -- 172.21.15.134:0/3946432225 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238037070 con 0x7f223c0b4f70 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.977+0000 7f22409ed640 1 -- 172.21.15.134:0/3946432225 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238032440 con 0x7f223c0b4f70 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.977+0000 7f22409ed640 1 -- 172.21.15.134:0/3946432225 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238032810 con 0x7f223c0b4f70 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 -- 172.21.15.134:0/3946432225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c0b4f70 msgr2=0x7f223c15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c0b4f70 0x7f223c15f790 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f223c073290 tx=0x7f223802a270 comp rx=0 tx=0).stop 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 -- 172.21.15.134:0/3946432225 shutdown_connections 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 --2- 172.21.15.134:0/3946432225 >> v2:172.21.15.177:3300/0 conn(0x7f223c15fed0 0x7f223c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c06fa40 0x7f223c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 --2- 172.21.15.134:0/3946432225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c0b4f70 0x7f223c15f790 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 -- 172.21.15.134:0/3946432225 >> 172.21.15.134:0/3946432225 conn(0x7f223c062810 msgr2=0x7f223c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 -- 172.21.15.134:0/3946432225 shutdown_connections 2024-09-15T22:46:56.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.978+0000 7f2243c53640 1 -- 172.21.15.134:0/3946432225 wait complete. 2024-09-15T22:46:56.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.979+0000 7f2243c53640 1 Processor -- start 2024-09-15T22:46:56.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.979+0000 7f2243c53640 1 -- start start 2024-09-15T22:46:56.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 0x7f223c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 0x7f223c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f223c06f520 con 0x7f223c06fa40 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f223c06f240 con 0x7f223c0b4f70 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f2243c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f223c06e620 con 0x7f223c15fed0 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f22419ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f22419ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43548/0 (socket says 172.21.15.134:43548) 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f22419ef640 1 -- 172.21.15.134:0/3345579872 learned_addr learned my addr 172.21.15.134:0/3345579872 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f22411ee640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 0x7f223c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.980+0000 7f22421f0640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 0x7f223c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 -- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 msgr2=0x7f223c1424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 0x7f223c1424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 -- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 msgr2=0x7f223c0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 0x7f223c0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 -- 172.21.15.134:0/3345579872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c13f700 con 0x7f223c06fa40 2024-09-15T22:46:56.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22411ee640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 0x7f223c0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22421f0640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 0x7f223c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22419ef640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f223802a2b0 tx=0x7f22380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238041020 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22380306c0 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c150ee0 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238037040 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.981+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c1514a0 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.982+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c06bd50 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.983+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f2238044020 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.983+0000 7f22327fc640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 0x7f222006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.983+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f22380ac290 con 0x7f223c06fa40 2024-09-15T22:46:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.983+0000 7f22411ee640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 0x7f222006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.984+0000 7f22411ee640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 0x7f222006eb60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f223c1403c0 tx=0x7f222c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:56.987+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f223804b030 con 0x7f223c06fa40 2024-09-15T22:46:57.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.179+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol44061", "group_name": "subvol_grp58660", "target": ["mon-mgr", ""]}) -- 0x7f223c0b4b90 con 0x7f222006c6a0 2024-09-15T22:46:57.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.209+0000 7f22327fc640 1 -- 172.21.15.134:0/3345579872 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7f223c0b4b90 con 0x7f222006c6a0 2024-09-15T22:46:57.211 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp58660/subvol44061/fe080379-ac82-4419-a16e-20fd209951cf 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 msgr2=0x7f222006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 0x7f222006eb60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f223c1403c0 tx=0x7f222c008040 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 msgr2=0x7f223c1f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f223802a2b0 tx=0x7f22380046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 shutdown_connections 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f223c15fed0 0x7f223c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f223c0b4f70 0x7f223c0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f222006c6a0 0x7f222006eb60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 --2- 172.21.15.134:0/3345579872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f223c06fa40 0x7f223c1f4c30 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 >> 172.21.15.134:0/3345579872 conn(0x7f223c062810 msgr2=0x7f223c161510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 shutdown_connections 2024-09-15T22:46:57.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.211+0000 7f2243c53640 1 -- 172.21.15.134:0/3345579872 wait complete. 2024-09-15T22:46:57.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol3802 2024-09-15T22:46:57.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.324+0000 7f04b5df6640 1 Processor -- start 2024-09-15T22:46:57.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.324+0000 7f04b5df6640 1 -- start start 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b0161cc0 0x7f04b00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04b00b57d0 0x7f04b00b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04b0072290 0x7f04b0072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f04b006e570 con 0x7f04b00b57d0 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f04b006dc40 con 0x7f04b0072290 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04b5df6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f04b006df20 con 0x7f04b0161cc0 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04b00b57d0 0x7f04b00b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04b00b57d0 0x7f04b00b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43564/0 (socket says 172.21.15.134:43564) 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 -- 172.21.15.134:0/4047498539 learned_addr learned my addr 172.21.15.134:0/4047498539 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04affff640 1 --2- 172.21.15.134:0/4047498539 >> v2:172.21.15.177:3300/0 conn(0x7f04b0072290 0x7f04b0072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 -- 172.21.15.134:0/4047498539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b0161cc0 msgr2=0x7f04b00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 --2- 172.21.15.134:0/4047498539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b0161cc0 0x7f04b00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 -- 172.21.15.134:0/4047498539 >> v2:172.21.15.177:3300/0 conn(0x7f04b0072290 msgr2=0x7f04b0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 --2- 172.21.15.134:0/4047498539 >> v2:172.21.15.177:3300/0 conn(0x7f04b0072290 0x7f04b0072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.325+0000 7f04aeffd640 1 -- 172.21.15.134:0/4047498539 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b006e200 con 0x7f04b00b57d0 2024-09-15T22:46:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.326+0000 7f04aeffd640 1 --2- 172.21.15.134:0/4047498539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b00b57d0 0x7f04b00b5c10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f04b01632d0 tx=0x7f049802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efc988e7715c899 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.326+0000 7f04ae7fc640 1 -- 172.21.15.134:0/4047498539 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498037070 con 0x7f04b00b57d0 2024-09-15T22:46:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.326+0000 7f04ae7fc640 1 -- 172.21.15.134:0/4047498539 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498032440 con 0x7f04b00b57d0 2024-09-15T22:46:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.326+0000 7f04ae7fc640 1 -- 172.21.15.134:0/4047498539 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498032810 con 0x7f04b00b57d0 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 -- 172.21.15.134:0/4047498539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b00b57d0 msgr2=0x7f04b00b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 --2- 172.21.15.134:0/4047498539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b00b57d0 0x7f04b00b5c10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f04b01632d0 tx=0x7f049802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 -- 172.21.15.134:0/4047498539 shutdown_connections 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 --2- 172.21.15.134:0/4047498539 >> v2:172.21.15.177:3300/0 conn(0x7f04b0072290 0x7f04b0072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 --2- 172.21.15.134:0/4047498539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b00b57d0 0x7f04b00b5c10 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 --2- 172.21.15.134:0/4047498539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b0161cc0 0x7f04b00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 -- 172.21.15.134:0/4047498539 >> 172.21.15.134:0/4047498539 conn(0x7f04b006bba0 msgr2=0x7f04b006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 -- 172.21.15.134:0/4047498539 shutdown_connections 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.327+0000 7f04b5df6640 1 -- 172.21.15.134:0/4047498539 wait complete. 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.328+0000 7f04b5df6640 1 Processor -- start 2024-09-15T22:46:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.328+0000 7f04b5df6640 1 -- start start 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04b0072290 0x7f04b01f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b00b57d0 0x7f04b01496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04b00b4be0 con 0x7f04b0161cc0 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04b00b4a60 con 0x7f04b0072290 2024-09-15T22:46:57.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04b5df6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f04b006ea00 con 0x7f04b00b57d0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43578/0 (socket says 172.21.15.134:43578) 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 -- 172.21.15.134:0/1240724566 learned_addr learned my addr 172.21.15.134:0/1240724566 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04af7fe640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04b0072290 0x7f04b01f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04aeffd640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b00b57d0 0x7f04b01496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 -- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b00b57d0 msgr2=0x7f04b01496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b00b57d0 0x7f04b01496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 -- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04b0072290 msgr2=0x7f04b01f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04b0072290 0x7f04b01f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.329+0000 7f04affff640 1 -- 172.21.15.134:0/1240724566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b01f5b90 con 0x7f04b0161cc0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04affff640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f04a800cd70 tx=0x7f04a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8003b90 con 0x7f04b0161cc0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a8003d30 con 0x7f04b0161cc0 2024-09-15T22:46:57.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004240 con 0x7f04b0161cc0 2024-09-15T22:46:57.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b01595b0 con 0x7f04b0161cc0 2024-09-15T22:46:57.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.330+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b0159b70 con 0x7f04b0161cc0 2024-09-15T22:46:57.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.331+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b00b5c10 con 0x7f04b0161cc0 2024-09-15T22:46:57.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.332+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f04a80043e0 con 0x7f04b0161cc0 2024-09-15T22:46:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.332+0000 7f04a7fff640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 0x7f049006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.332+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f04a808c6a0 con 0x7f04b0161cc0 2024-09-15T22:46:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.332+0000 7f04af7fe640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 0x7f049006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.333+0000 7f04af7fe640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 0x7f049006eb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04b0156f50 tx=0x7f04a0009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.336+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04a805a0b0 con 0x7f04b0161cc0 2024-09-15T22:46:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.534+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol3802", "target": ["mon-mgr", ""]}) -- 0x7f04b006cde0 con 0x7f049006c6a0 2024-09-15T22:46:57.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.563+0000 7f04a7fff640 1 -- 172.21.15.134:0/1240724566 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+144 (secure 0 0 0) 0x7f04b006cde0 con 0x7f049006c6a0 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "status": { 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "pending", 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "source": { 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "volume": "fake", 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "subvolume": "fake", 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "snapshot": "fake" 2024-09-15T22:46:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:46:57.566 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:46:57.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.565+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 msgr2=0x7f049006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.565+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 0x7f049006eb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04b0156f50 tx=0x7f04a0009060 comp rx=0 tx=0).stop 2024-09-15T22:46:57.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 msgr2=0x7f04b015f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f04a800cd70 tx=0x7f04a800a660 comp rx=0 tx=0).stop 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 shutdown_connections 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f049006c6a0 0x7f049006eb60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0161cc0 0x7f04b015f980 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04b00b57d0 0x7f04b01496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 --2- 172.21.15.134:0/1240724566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04b0072290 0x7f04b01f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 >> 172.21.15.134:0/1240724566 conn(0x7f04b006bba0 msgr2=0x7f04b00d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:57.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 shutdown_connections 2024-09-15T22:46:57.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.566+0000 7f04b5df6640 1 -- 172.21.15.134:0/1240724566 wait complete. 2024-09-15T22:46:57.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol91280 fake 2024-09-15T22:46:57.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.682+0000 7f828e942640 1 Processor -- start 2024-09-15T22:46:57.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.682+0000 7f828e942640 1 -- start start 2024-09-15T22:46:57.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828e942640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f82880b3540 0x7f82880d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828e942640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82880d20e0 con 0x7f82880b3b00 2024-09-15T22:46:57.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828e942640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82880cfa70 con 0x7f82880b61e0 2024-09-15T22:46:57.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828e942640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f82880d24f0 con 0x7f82880b3540 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f82877fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f82880b3b00 0x7f82880d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45908/0 (socket says 172.21.15.134:45908) 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f82877fe640 1 -- 172.21.15.134:0/2460007106 learned_addr learned my addr 172.21.15.134:0/2460007106 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828cedf640 1 --2- 172.21.15.134:0/2460007106 >> v2:172.21.15.177:3300/0 conn(0x7f82880b3540 0x7f82880d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322651108 0 0) 0x7f82880d20e0 con 0x7f82880b3b00 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8270003520 con 0x7f82880b3b00 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828cedf640 1 -- 172.21.15.134:0/2460007106 >> v1:172.21.15.177:6789/0 conn(0x7f82880b61e0 legacy=0x7f82880b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828cedf640 1 -- 172.21.15.134:0/2460007106 >> v1:172.21.15.134:6789/0 conn(0x7f82880b3b00 legacy=0x7f82880d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3764465164 0 0) 0x7f8270003520 con 0x7f82880b3b00 2024-09-15T22:46:57.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.683+0000 7f828cedf640 1 -- 172.21.15.134:0/2460007106 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82880cfd50 con 0x7f82880b3540 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.684+0000 7f828cedf640 1 --2- 172.21.15.134:0/2460007106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3540 0x7f82880d3090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b67e0156bb1eb088 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.684+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c001670 con 0x7f82880b3540 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.684+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8280007540 con 0x7f82880b3540 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.684+0000 7f8286ffd640 1 -- 172.21.15.134:0/2460007106 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82800078f0 con 0x7f82880b3540 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 -- 172.21.15.134:0/2460007106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3540 msgr2=0x7f82880d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 --2- 172.21.15.134:0/2460007106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3540 0x7f82880d3090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828002a560 comp rx=0 tx=0).stop 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 -- 172.21.15.134:0/2460007106 shutdown_connections 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 --2- 172.21.15.134:0/2460007106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3540 0x7f82880d3090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 -- 172.21.15.134:0/2460007106 >> 172.21.15.134:0/2460007106 conn(0x7f82880d11e0 msgr2=0x7f82880d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 -- 172.21.15.134:0/2460007106 shutdown_connections 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.685+0000 7f828e942640 1 -- 172.21.15.134:0/2460007106 wait complete. 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.686+0000 7f828e942640 1 Processor -- start 2024-09-15T22:46:57.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.686+0000 7f828e942640 1 -- start start 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 0x7f82880cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82880b61e0 0x7f82880cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f828815edc0 con 0x7f82880b3540 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82880d1d00 con 0x7f82880b3b00 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828e942640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f828815fce0 con 0x7f82880b61e0 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43594/0 (socket says 172.21.15.134:43594) 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 -- 172.21.15.134:0/3574240208 learned_addr learned my addr 172.21.15.134:0/3574240208 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f82877fe640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 0x7f82880cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 -- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82880b61e0 msgr2=0x7f82880cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f828cedf640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82880b61e0 0x7f82880cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82880b61e0 0x7f82880cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 -- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 msgr2=0x7f82880cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 0x7f82880cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 -- 172.21.15.134:0/3574240208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828815ffc0 con 0x7f82880b3540 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f82877fe640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 0x7f82880cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8287fff640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f827800c400 tx=0x7f827800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278017070 con 0x7f82880b3540 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.687+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82780052d0 con 0x7f82880b3540 2024-09-15T22:46:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.688+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278003830 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.688+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82881602a0 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.688+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82881f4b40 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.689+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82880b65c0 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.689+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 91203+0+0 (secure 0 0 0) 0x7f827801a070 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.690+0000 7f8284ff9640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 0x7f827406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.690+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f827808af00 con 0x7f82880b3540 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.690+0000 7f82877fe640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 0x7f827406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.690+0000 7f82877fe640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 0x7f827406eb60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f827c001eb0 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.694+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8278059070 con 0x7f82880b3540 2024-09-15T22:46:57.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.887+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol91280", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f82880ba6e0 con 0x7f827406c6a0 2024-09-15T22:46:57.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.925+0000 7f8284ff9640 1 -- 172.21.15.134:0/3574240208 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f82880ba6e0 con 0x7f827406c6a0 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 msgr2=0x7f827406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 0x7f827406eb60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f827c001eb0 tx=0x7f827c009040 comp rx=0 tx=0).stop 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 msgr2=0x7f8288150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f827800c400 tx=0x7f827800c8c0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 shutdown_connections 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82880b61e0 0x7f82880cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82880b3b00 0x7f82880cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f827406c6a0 0x7f827406eb60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 --2- 172.21.15.134:0/3574240208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82880b3540 0x7f8288150990 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:57.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 >> 172.21.15.134:0/3574240208 conn(0x7f82880d11e0 msgr2=0x7f82880b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:57.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 shutdown_connections 2024-09-15T22:46:57.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:57.927+0000 7f828e942640 1 -- 172.21.15.134:0/3574240208 wait complete. 2024-09-15T22:46:57.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol44061 fake subvol_grp58660 2024-09-15T22:46:58.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.045+0000 7f4b21280640 1 Processor -- start 2024-09-15T22:46:58.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.045+0000 7f4b21280640 1 -- start start 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b21280640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b21280640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4b1c1621d0 0x7f4b1c0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b21280640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1c0d3460 con 0x7f4b1c0b7aa0 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b21280640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1c0d4630 con 0x7f4b1c1621d0 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b21280640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c0d3180 con 0x7f4b1c06db30 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43104/0 (socket says 172.21.15.134:43104) 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b1affd640 1 -- 172.21.15.134:0/1298378291 learned_addr learned my addr 172.21.15.134:0/1298378291 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.046+0000 7f4b1b7fe640 1 --2- 172.21.15.134:0/1298378291 >> v2:172.21.15.177:3300/0 conn(0x7f4b1c1621d0 0x7f4b1c0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.047+0000 7f4b1affd640 1 -- 172.21.15.134:0/1298378291 >> v2:172.21.15.177:3300/0 conn(0x7f4b1c1621d0 msgr2=0x7f4b1c0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.047+0000 7f4b1affd640 1 --2- 172.21.15.134:0/1298378291 >> v2:172.21.15.177:3300/0 conn(0x7f4b1c1621d0 0x7f4b1c0cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.047+0000 7f4b1affd640 1 -- 172.21.15.134:0/1298378291 >> v1:172.21.15.177:6789/0 conn(0x7f4b1c0b7aa0 legacy=0x7f4b1c161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.047+0000 7f4b1affd640 1 -- 172.21.15.134:0/1298378291 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c0d3760 con 0x7f4b1c06db30 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.047+0000 7f4b1affd640 1 --2- 172.21.15.134:0/1298378291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506218cdef0dee99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b19ffb640 1 -- 172.21.15.134:0/1298378291 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c036070 con 0x7f4b1c06db30 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b19ffb640 1 -- 172.21.15.134:0/1298378291 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c031600 con 0x7f4b1c06db30 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b19ffb640 1 -- 172.21.15.134:0/1298378291 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0319d0 con 0x7f4b1c06db30 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 -- 172.21.15.134:0/1298378291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 msgr2=0x7f4b1c0d40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 --2- 172.21.15.134:0/1298378291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c02a680 comp rx=0 tx=0).stop 2024-09-15T22:46:58.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 -- 172.21.15.134:0/1298378291 shutdown_connections 2024-09-15T22:46:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 --2- 172.21.15.134:0/1298378291 >> v2:172.21.15.177:3300/0 conn(0x7f4b1c1621d0 0x7f4b1c0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 --2- 172.21.15.134:0/1298378291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c06db30 0x7f4b1c0d40f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 -- 172.21.15.134:0/1298378291 >> 172.21.15.134:0/1298378291 conn(0x7f4b1c0d1870 msgr2=0x7f4b1c0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 -- 172.21.15.134:0/1298378291 shutdown_connections 2024-09-15T22:46:58.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.048+0000 7f4b21280640 1 -- 172.21.15.134:0/1298378291 wait complete. 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.049+0000 7f4b21280640 1 Processor -- start 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 -- start start 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 0x7f4b1c0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 0x7f4b1c0b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c0d5560 con 0x7f4b1c06db30 2024-09-15T22:46:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c0d3d20 con 0x7f4b1c1621d0 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b21280640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c0d56e0 con 0x7f4b1c0b7aa0 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43606/0 (socket says 172.21.15.134:43606) 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.050+0000 7f4b1affd640 1 -- 172.21.15.134:0/3415429011 learned_addr learned my addr 172.21.15.134:0/3415429011 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1b7fe640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 0x7f4b1c0b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 -- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 msgr2=0x7f4b1c0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1a7fc640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 0x7f4b1c0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 0x7f4b1c0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 -- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 msgr2=0x7f4b1c0b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 0x7f4b1c0b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 -- 172.21.15.134:0/3415429011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c0c9a60 con 0x7f4b1c06db30 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1b7fe640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 0x7f4b1c0b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1a7fc640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 0x7f4b1c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b1affd640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009f70 tx=0x7f4b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c03f020 con 0x7f4b1c06db30 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c037040 con 0x7f4b1c06db30 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c0c9d40 con 0x7f4b1c06db30 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c036070 con 0x7f4b1c06db30 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.051+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c0cad60 con 0x7f4b1c06db30 2024-09-15T22:46:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.052+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1c0d2de0 con 0x7f4b1c06db30 2024-09-15T22:46:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.053+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 91254+0+0 (secure 0 0 0) 0x7f4b0c042020 con 0x7f4b1c06db30 2024-09-15T22:46:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.053+0000 7f4b037fe640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 0x7f4b0806ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.053+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f4b0c0ac320 con 0x7f4b1c06db30 2024-09-15T22:46:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.053+0000 7f4b1a7fc640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 0x7f4b0806ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.054+0000 7f4b1a7fc640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 0x7f4b0806ec20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0b9b80 tx=0x7f4b10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.057+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b0c049030 con 0x7f4b1c06db30 2024-09-15T22:46:58.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.255+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol44061", "snap_name": "fake", "group_name": "subvol_grp58660", "target": ["mon-mgr", ""]}) -- 0x7f4b1c0cbbb0 con 0x7f4b0806c760 2024-09-15T22:46:58.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.292+0000 7f4b037fe640 1 -- 172.21.15.134:0/3415429011 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4b100013e0 con 0x7f4b0806c760 2024-09-15T22:46:58.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 msgr2=0x7f4b0806ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 0x7f4b0806ec20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0b9b80 tx=0x7f4b10009040 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 msgr2=0x7f4b1c151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009f70 tx=0x7f4b0c004a40 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 shutdown_connections 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b1c1621d0 0x7f4b1c0b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b1c0b7aa0 0x7f4b1c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4b0806c760 0x7f4b0806ec20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 --2- 172.21.15.134:0/3415429011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b1c06db30 0x7f4b1c151ca0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 >> 172.21.15.134:0/3415429011 conn(0x7f4b1c0d1870 msgr2=0x7f4b1c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 shutdown_connections 2024-09-15T22:46:58.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.294+0000 7f4b21280640 1 -- 172.21.15.134:0/3415429011 wait complete. 2024-09-15T22:46:58.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:58.307 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol91280/.meta) 2024-09-15T22:46:58.332 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:58.333 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:46:58.333 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:46:58.333 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol91280/dca33315-5300-4c88-bfae-7fc8eb81e421 2024-09-15T22:46:58.333 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:46:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:58.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:58.334 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp58660/subvol44061/.meta) 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/subvol_grp58660/subvol44061/fe080379-ac82-4419-a16e-20fd209951cf 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:46:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:46:58.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol91280 2024-09-15T22:46:58.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.542+0000 7f6d5970a640 1 Processor -- start 2024-09-15T22:46:58.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.542+0000 7f6d5970a640 1 -- start start 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d5970a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d5970a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d540d2d10 0x7f6d540d31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d5970a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d540cfb90 con 0x7f6d540b3430 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d5970a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6d540d22c0 con 0x7f6d540d2d10 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d5970a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5406c810 con 0x7f6d540cf750 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d527fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d537fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d540d2d10 0x7f6d540d31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d527fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43116/0 (socket says 172.21.15.134:43116) 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.543+0000 7f6d527fc640 1 -- 172.21.15.134:0/1990819468 learned_addr learned my addr 172.21.15.134:0/1990819468 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.544+0000 7f6d527fc640 1 -- 172.21.15.134:0/1990819468 >> v2:172.21.15.177:3300/0 conn(0x7f6d540d2d10 msgr2=0x7f6d540d31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.544+0000 7f6d527fc640 1 --2- 172.21.15.134:0/1990819468 >> v2:172.21.15.177:3300/0 conn(0x7f6d540d2d10 0x7f6d540d31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.544+0000 7f6d527fc640 1 -- 172.21.15.134:0/1990819468 >> v1:172.21.15.177:6789/0 conn(0x7f6d540b3430 legacy=0x7f6d540b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.544+0000 7f6d527fc640 1 -- 172.21.15.134:0/1990819468 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5415e9d0 con 0x7f6d540cf750 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d527fc640 1 --2- 172.21.15.134:0/1990819468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009870 tx=0x7f6d4802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15ac2fb9606c87e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d51ffb640 1 -- 172.21.15.134:0/1990819468 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48037070 con 0x7f6d540cf750 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d51ffb640 1 -- 172.21.15.134:0/1990819468 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d48032440 con 0x7f6d540cf750 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d51ffb640 1 -- 172.21.15.134:0/1990819468 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48032810 con 0x7f6d540cf750 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 -- 172.21.15.134:0/1990819468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 msgr2=0x7f6d5406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 --2- 172.21.15.134:0/1990819468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009870 tx=0x7f6d4802a1c0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 -- 172.21.15.134:0/1990819468 shutdown_connections 2024-09-15T22:46:58.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 --2- 172.21.15.134:0/1990819468 >> v2:172.21.15.177:3300/0 conn(0x7f6d540d2d10 0x7f6d540d31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 --2- 172.21.15.134:0/1990819468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540cf750 0x7f6d5406c2d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 -- 172.21.15.134:0/1990819468 >> 172.21.15.134:0/1990819468 conn(0x7f6d540d4b10 msgr2=0x7f6d540d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 -- 172.21.15.134:0/1990819468 shutdown_connections 2024-09-15T22:46:58.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.545+0000 7f6d5970a640 1 -- 172.21.15.134:0/1990819468 wait complete. 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 Processor -- start 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 -- start start 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d540b3430 0x7f6d54150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540d2d10 0x7f6d540d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d540d2510 con 0x7f6d540cf750 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5406cd50 con 0x7f6d540b3430 2024-09-15T22:46:58.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.547+0000 7f6d5970a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d540d27f0 con 0x7f6d540d2d10 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43620/0 (socket says 172.21.15.134:43620) 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 -- 172.21.15.134:0/2135095717 learned_addr learned my addr 172.21.15.134:0/2135095717 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d537fe640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540d2d10 0x7f6d540d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d52ffd640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d540b3430 0x7f6d54150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 -- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540d2d10 msgr2=0x7f6d540d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540d2d10 0x7f6d540d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 -- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d540b3430 msgr2=0x7f6d54150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d540b3430 0x7f6d54150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 -- 172.21.15.134:0/2135095717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d540b6bc0 con 0x7f6d540cf750 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d527fc640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6d480097c0 tx=0x7f6d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48041070 con 0x7f6d540cf750 2024-09-15T22:46:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4803c870 con 0x7f6d540cf750 2024-09-15T22:46:58.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48037040 con 0x7f6d540cf750 2024-09-15T22:46:58.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.548+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d541509b0 con 0x7f6d540cf750 2024-09-15T22:46:58.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.549+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d540b4ff0 con 0x7f6d540cf750 2024-09-15T22:46:58.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.549+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5406c2d0 con 0x7f6d540cf750 2024-09-15T22:46:58.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.550+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 91254+0+0 (secure 0 0 0) 0x7f6d48044070 con 0x7f6d540cf750 2024-09-15T22:46:58.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.550+0000 7f6d3b7fe640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 0x7f6d4006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.551+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f6d480ac900 con 0x7f6d540cf750 2024-09-15T22:46:58.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.551+0000 7f6d52ffd640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 0x7f6d4006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.551+0000 7f6d52ffd640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 0x7f6d4006ec20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d44001f10 tx=0x7f6d44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.555+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d4807a5b0 con 0x7f6d540cf750 2024-09-15T22:46:58.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.749+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol91280", "target": ["mon-mgr", ""]}) -- 0x7f6d5415c880 con 0x7f6d4006c760 2024-09-15T22:46:58.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.782+0000 7f6d3b7fe640 1 -- 172.21.15.134:0/2135095717 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d5415c880 con 0x7f6d4006c760 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 msgr2=0x7f6d4006ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 0x7f6d4006ec20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d44001f10 tx=0x7f6d44009040 comp rx=0 tx=0).stop 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 msgr2=0x7f6d540d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6d480097c0 tx=0x7f6d480046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 shutdown_connections 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d540d2d10 0x7f6d540d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d4006c760 0x7f6d4006ec20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d540cf750 0x7f6d540d33a0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 --2- 172.21.15.134:0/2135095717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d540b3430 0x7f6d54150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.784+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 >> 172.21.15.134:0/2135095717 conn(0x7f6d540d4b10 msgr2=0x7f6d540b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.785+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 shutdown_connections 2024-09-15T22:46:58.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.785+0000 7f6d5970a640 1 -- 172.21.15.134:0/2135095717 wait complete. 2024-09-15T22:46:58.789 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.788+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.789 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.788+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.789 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.788+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.789 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.788+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.789 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.788+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol44061 subvol_grp58660 2024-09-15T22:46:58.801 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.801+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.802 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.801+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.802 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.801+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.802 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.801+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.802 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:58.801+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:58.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.900+0000 7f09adfc4640 1 Processor -- start 2024-09-15T22:46:58.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.900+0000 7f09adfc4640 1 -- start start 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09adfc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f09a806f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09adfc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a806f930 con 0x7f09a806c2b0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09adfc4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a806fc10 con 0x7f09a80b55a0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09adfc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f09a806fef0 con 0x7f09a81481b0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09a7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f09a806c2b0 0x7f09a80af330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45916/0 (socket says 172.21.15.134:45916) 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.901+0000 7f09a7fff640 1 -- 172.21.15.134:0/3871525835 learned_addr learned my addr 172.21.15.134:0/3871525835 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a77fe640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f09a806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346558086 0 0) 0x7f09a806f930 con 0x7f09a806c2b0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0990003520 con 0x7f09a806c2b0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 608293598 0 0) 0x7f0990003520 con 0x7f09a806c2b0 2024-09-15T22:46:58.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 msgr2=0x7f09a806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f09a806f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 >> v1:172.21.15.177:6789/0 conn(0x7f09a80b55a0 legacy=0x7f09a806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80aeb30 con 0x7f09a806c2b0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f09a00019f0 con 0x7f09a806c2b0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 >> v1:172.21.15.134:6789/0 conn(0x7f09a806c2b0 legacy=0x7f09a80af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09900039e0 0x7f0990003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f0990004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0990004d40 0x7f09900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09a806fef0 con 0x7f0990004d40 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f099000b9c0 con 0x7f09900039e0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f099000bbc0 con 0x7f09a81481b0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a77fe640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09900039e0 0x7f0990003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0990004d40 0x7f09900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a6ffd640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f0990004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 -- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 msgr2=0x7f0990004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a81481b0 0x7f0990004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 -- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09900039e0 msgr2=0x7f0990003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09900039e0 0x7f0990003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.902+0000 7f09a7fff640 1 -- 172.21.15.134:0/3871525835 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0990003520 con 0x7f0990004d40 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.903+0000 7f09a7fff640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0990004d40 0x7f09900051c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b4ab0 tx=0x7f0990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a8bb6308ab1c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.903+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a000a410 con 0x7f0990004d40 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.903+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a002f070 con 0x7f0990004d40 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.903+0000 7f09a67fc640 1 -- 172.21.15.134:0/3871525835 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a002bba0 con 0x7f0990004d40 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 -- 172.21.15.134:0/3871525835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0990004d40 msgr2=0x7f09900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3871525835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0990004d40 0x7f09900051c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b4ab0 tx=0x7f0990005830 comp rx=0 tx=0).stop 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09a7fff640 1 -- 172.21.15.134:0/3871525835 reap_dead start 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 -- 172.21.15.134:0/3871525835 shutdown_connections 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 -- 172.21.15.134:0/3871525835 >> 172.21.15.134:0/3871525835 conn(0x7f09a8062810 msgr2=0x7f09a806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 -- 172.21.15.134:0/3871525835 shutdown_connections 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.904+0000 7f09adfc4640 1 -- 172.21.15.134:0/3871525835 wait complete. 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.905+0000 7f09adfc4640 1 Processor -- start 2024-09-15T22:46:58.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.905+0000 7f09adfc4640 1 -- start start 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09a80b22c0 0x7f09a813ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a813ee90 0x7f09a813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09a806f1b0 con 0x7f09a815e380 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09a806f030 con 0x7f09a80b22c0 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09adfc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f09a806f330 con 0x7f09a813ee90 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43642/0 (socket says 172.21.15.134:43642) 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 -- 172.21.15.134:0/3452058959 learned_addr learned my addr 172.21.15.134:0/3452058959 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 -- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a813ee90 msgr2=0x7f09a813f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a813ee90 0x7f09a813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 -- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09a80b22c0 msgr2=0x7f09a813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09a80b22c0 0x7f09a813ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 -- 172.21.15.134:0/3452058959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80b29b0 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f09a77fe640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f0998011950 tx=0x7f0998011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.906+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099800faf0 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.907+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099800fc90 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.907+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a813d630 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.907+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998014440 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.907+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a80b2f30 con 0x7f09a815e380 2024-09-15T22:46:58.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.908+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a806bba0 con 0x7f09a815e380 2024-09-15T22:46:58.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.908+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 91254+0+0 (secure 0 0 0) 0x7f0998012040 con 0x7f09a815e380 2024-09-15T22:46:58.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.909+0000 7f098ffff640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 0x7f099406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.909+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f099808c270 con 0x7f09a815e380 2024-09-15T22:46:58.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.909+0000 7f09a6ffd640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 0x7f099406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.910+0000 7f09a6ffd640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 0x7f099406ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b1dc0 tx=0x7f099c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:58.913+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0998019030 con 0x7f09a815e380 2024-09-15T22:46:59.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.103+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol44061", "group_name": "subvol_grp58660", "target": ["mon-mgr", ""]}) -- 0x7f09a80cdcb0 con 0x7f099406c730 2024-09-15T22:46:59.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.141+0000 7f098ffff640 1 -- 172.21.15.134:0/3452058959 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f09a80cdcb0 con 0x7f099406c730 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 msgr2=0x7f099406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 0x7f099406ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b1dc0 tx=0x7f099c009040 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 msgr2=0x7f09a8160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f0998011950 tx=0x7f0998011e10 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 shutdown_connections 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09a813ee90 0x7f09a813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09a80b22c0 0x7f09a813ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f099406c730 0x7f099406ebf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 --2- 172.21.15.134:0/3452058959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a815e380 0x7f09a8160070 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 >> 172.21.15.134:0/3452058959 conn(0x7f09a8062810 msgr2=0x7f09a80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.143+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 shutdown_connections 2024-09-15T22:46:59.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.144+0000 7f09adfc4640 1 -- 172.21.15.134:0/3452058959 wait complete. 2024-09-15T22:46:59.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol3802 2024-09-15T22:46:59.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.259+0000 7f6d7a682640 1 Processor -- start 2024-09-15T22:46:59.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.259+0000 7f6d7a682640 1 -- start start 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d7a682640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6d74158e50 0x7f6d740b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d7a682640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d7415c800 con 0x7f6d7406f130 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d7a682640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d740b43f0 con 0x7f6d7415c370 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d7a682640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6d740b3630 con 0x7f6d74158e50 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d73fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6d74158e50 0x7f6d740b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d78c1f640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6d7406f130 0x7f6d740ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45922/0 (socket says 172.21.15.134:45922) 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d73fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6d74158e50 0x7f6d740b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43654/0 (socket says 172.21.15.134:43654) 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d78c1f640 1 -- 172.21.15.134:0/4082775762 learned_addr learned my addr 172.21.15.134:0/4082775762 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d73fff640 1 -- 172.21.15.134:0/4082775762 >> v1:172.21.15.177:6789/0 conn(0x7f6d7415c370 legacy=0x7f6d7406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d72ffd640 1 -- 172.21.15.134:0/4082775762 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270303401 0 0) 0x7f6d7415c800 con 0x7f6d7406f130 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d73fff640 1 -- 172.21.15.134:0/4082775762 >> v1:172.21.15.134:6789/0 conn(0x7f6d7406f130 legacy=0x7f6d740ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.260+0000 7f6d73fff640 1 -- 172.21.15.134:0/4082775762 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740b3910 con 0x7f6d74158e50 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.261+0000 7f6d73fff640 1 --2- 172.21.15.134:0/4082775762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d74158e50 0x7f6d740b5050 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6d640097a0 tx=0x7f6d6402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc11d788be76dad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.261+0000 7f6d72ffd640 1 -- 172.21.15.134:0/4082775762 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64037070 con 0x7f6d74158e50 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.261+0000 7f6d72ffd640 1 -- 172.21.15.134:0/4082775762 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6402ae50 con 0x7f6d74158e50 2024-09-15T22:46:59.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.261+0000 7f6d72ffd640 1 -- 172.21.15.134:0/4082775762 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64032660 con 0x7f6d74158e50 2024-09-15T22:46:59.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 -- 172.21.15.134:0/4082775762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d74158e50 msgr2=0x7f6d740b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 --2- 172.21.15.134:0/4082775762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d74158e50 0x7f6d740b5050 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6d640097a0 tx=0x7f6d6402a140 comp rx=0 tx=0).stop 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 -- 172.21.15.134:0/4082775762 shutdown_connections 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 --2- 172.21.15.134:0/4082775762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d74158e50 0x7f6d740b5050 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 -- 172.21.15.134:0/4082775762 >> 172.21.15.134:0/4082775762 conn(0x7f6d7406bba0 msgr2=0x7f6d7406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 -- 172.21.15.134:0/4082775762 shutdown_connections 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.262+0000 7f6d7a682640 1 -- 172.21.15.134:0/4082775762 wait complete. 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.263+0000 7f6d7a682640 1 Processor -- start 2024-09-15T22:46:59.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.263+0000 7f6d7a682640 1 -- start start 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d7406f130 0x7f6d74153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d74158e50 0x7f6d7414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d7415c370 0x7f6d740ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74159230 con 0x7f6d7406f130 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b3ed0 con 0x7f6d7415c370 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740ce910 con 0x7f6d74158e50 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d7406f130 0x7f6d74153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d7406f130 0x7f6d74153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43662/0 (socket says 172.21.15.134:43662) 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 -- 172.21.15.134:0/3783871485 learned_addr learned my addr 172.21.15.134:0/3783871485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:59.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 -- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d74158e50 msgr2=0x7f6d7414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d78c1f640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d7415c370 0x7f6d740ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d74158e50 0x7f6d7414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 -- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d7415c370 msgr2=0x7f6d740ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d7415c370 0x7f6d740ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 -- 172.21.15.134:0/3783871485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d74152420 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d73fff640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d7406f130 0x7f6d74153830 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f6d640097a0 tx=0x7f6d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64037040 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64004030 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.264+0000 7f6d7a682640 1 -- 172.21.15.134:0/3783871485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d74152d60 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.265+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64006e10 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.265+0000 7f6d7a682640 1 -- 172.21.15.134:0/3783871485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d7414e470 con 0x7f6d7406f130 2024-09-15T22:46:59.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.265+0000 7f6d7a682640 1 -- 172.21.15.134:0/3783871485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d740b0920 con 0x7f6d7406f130 2024-09-15T22:46:59.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.266+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 91254+0+0 (secure 0 0 0) 0x7f6d6403d650 con 0x7f6d7406f130 2024-09-15T22:46:59.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.266+0000 7f6d70ff9640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6006c730 0x7f6d6006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.267+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f6d640ac450 con 0x7f6d7406f130 2024-09-15T22:46:59.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.267+0000 7f6d737fe640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6006c730 0x7f6d6006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.267+0000 7f6d737fe640 1 --2- 172.21.15.134:0/3783871485 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6006c730 0x7f6d6006ebf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b08f0 tx=0x7f6d68006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.271+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d64042020 con 0x7f6d7406f130 2024-09-15T22:46:59.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.461+0000 7f6d7a682640 1 -- 172.21.15.134:0/3783871485 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol3802", "target": ["mon-mgr", ""]}) -- 0x7f6d740b0640 con 0x7f6d6006c730 2024-09-15T22:46:59.481 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:46:59.480+0000 7f4588482640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol3802' is not ready for operation rm (use --force to override) 2024-09-15T22:46:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.480+0000 7f6d70ff9640 1 -- 172.21.15.134:0/3783871485 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol3802' is not ready for operation rm (use --force to override)) ==== 86+0+0 (secure 0 0 0) 0x7f6d740b0640 con 0x7f6d6006c730 2024-09-15T22:46:59.482 INFO:teuthology.orchestra.run.smithi134.stderr:Error EAGAIN: subvolume 'subvol3802' is not ready for operation rm (use --force to override) 2024-09-15T22:46:59.487 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-15T22:46:59.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:46:59.487 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol3802/.meta) 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:type = clone 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol3802/6f3e8fc2-70f0-4657-9321-856a4bd30d2b 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:state = pending 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:[source] 2024-09-15T22:46:59.513 INFO:teuthology.orchestra.run.smithi134.stdout:volume = fake 2024-09-15T22:46:59.514 INFO:teuthology.orchestra.run.smithi134.stdout:subvolume = fake 2024-09-15T22:46:59.514 INFO:teuthology.orchestra.run.smithi134.stdout:snapshot = fake 2024-09-15T22:46:59.515 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol3802 --force 2024-09-15T22:46:59.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.657+0000 7f733d477640 1 Processor -- start 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.657+0000 7f733d477640 1 -- start start 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f733d477640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f733d477640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73380d1fd0 0x7f73380b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f733d477640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733806ec90 con 0x7f73380d1860 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f733d477640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f73380d1dd0 con 0x7f73380d1fd0 2024-09-15T22:46:59.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f733d477640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f73380b7800 con 0x7f733815e5c0 2024-09-15T22:46:59.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f73377fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73380d1fd0 0x7f73380b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f7336ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f73367fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f73380d1860 0x7f73381622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:53674/0 (socket says 172.21.15.134:53674) 2024-09-15T22:46:59.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f7336ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43178/0 (socket says 172.21.15.134:43178) 2024-09-15T22:46:59.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f73377fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73380d1fd0 0x7f73380b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39786/0 (socket says 172.21.15.134:39786) 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.658+0000 7f73367fc640 1 -- 172.21.15.134:0/2188504635 learned_addr learned my addr 172.21.15.134:0/2188504635 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.659+0000 7f73377fe640 1 -- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 msgr2=0x7f73380b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.659+0000 7f73377fe640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.659+0000 7f73377fe640 1 -- 172.21.15.134:0/2188504635 >> v1:172.21.15.177:6789/0 conn(0x7f73380d1860 legacy=0x7f73381622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.659+0000 7f73377fe640 1 -- 172.21.15.134:0/2188504635 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7338073d20 con 0x7f73380d1fd0 2024-09-15T22:46:59.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.659+0000 7f7336ffd640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f73377fe640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f73380b72c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f73300097a0 tx=0x7f733002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=149c3894661caf38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f7335ffb640 1 -- 172.21.15.134:0/2188504635 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330037070 con 0x7f73380d1fd0 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f7335ffb640 1 -- 172.21.15.134:0/2188504635 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733002adb0 con 0x7f73380d1fd0 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f7335ffb640 1 -- 172.21.15.134:0/2188504635 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330032660 con 0x7f73380d1fd0 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 -- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 msgr2=0x7f73380b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f73380b72c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f73300097a0 tx=0x7f733002a060 comp rx=0 tx=0).stop 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 -- 172.21.15.134:0/2188504635 shutdown_connections 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f73380b72c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 --2- 172.21.15.134:0/2188504635 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f733815e5c0 0x7f73380b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 -- 172.21.15.134:0/2188504635 >> 172.21.15.134:0/2188504635 conn(0x7f73380d25b0 msgr2=0x7f73380d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 -- 172.21.15.134:0/2188504635 shutdown_connections 2024-09-15T22:46:59.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.660+0000 7f733d477640 1 -- 172.21.15.134:0/2188504635 wait complete. 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 Processor -- start 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 -- start start 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73380d1860 0x7f733814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f7338154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73380719e0 con 0x7f733815e5c0 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f733806e770 con 0x7f73380d1fd0 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.662+0000 7f733d477640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f73380b5710 con 0x7f73380d1860 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43664/0 (socket says 172.21.15.134:43664) 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 -- 172.21.15.134:0/1213889482 learned_addr learned my addr 172.21.15.134:0/1213889482 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f7336ffd640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73380d1860 0x7f733814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73367fc640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f7338154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 -- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73380d1860 msgr2=0x7f733814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73380d1860 0x7f733814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 -- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 msgr2=0x7f7338154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f7338154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 -- 172.21.15.134:0/1213889482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733814c0f0 con 0x7f733815e5c0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f73377fe640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f7330035040 tx=0x7f73300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330041070 con 0x7f733815e5c0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733003c670 con 0x7f733815e5c0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73380cbae0 con 0x7f733815e5c0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330037040 con 0x7f733815e5c0 2024-09-15T22:46:59.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.663+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73380cc0a0 con 0x7f733815e5c0 2024-09-15T22:46:59.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.664+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733815e9a0 con 0x7f733815e5c0 2024-09-15T22:46:59.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.665+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 91254+0+0 (secure 0 0 0) 0x7f733003a070 con 0x7f733815e5c0 2024-09-15T22:46:59.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.665+0000 7f731f7fe640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 0x7f732406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.665+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f73300abeb0 con 0x7f733815e5c0 2024-09-15T22:46:59.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.666+0000 7f7336ffd640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 0x7f732406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.666+0000 7f7336ffd640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 0x7f732406ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f73381f7b40 tx=0x7f732800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.670+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f733814c0f0 con 0x7f733815e5c0 2024-09-15T22:46:59.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.858+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol3802", "force": true, "target": ["mon-mgr", ""]}) -- 0x7f733815bf60 con 0x7f732406c730 2024-09-15T22:46:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.882+0000 7f731f7fe640 1 -- 172.21.15.134:0/1213889482 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f733815bf60 con 0x7f732406c730 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 msgr2=0x7f732406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 0x7f732406ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f73381f7b40 tx=0x7f732800b040 comp rx=0 tx=0).stop 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 msgr2=0x7f73381553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f7330035040 tx=0x7f73300046c0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 shutdown_connections 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f732406c730 0x7f732406ebf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f733815e5c0 0x7f73381553b0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380d1fd0 0x7f7338154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 --2- 172.21.15.134:0/1213889482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73380d1860 0x7f733814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 >> 172.21.15.134:0/1213889482 conn(0x7f73380d25b0 msgr2=0x7f73380b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 shutdown_connections 2024-09-15T22:46:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:46:59.884+0000 7f733d477640 1 -- 172.21.15.134:0/1213889482 wait complete. 2024-09-15T22:46:59.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-15T22:47:00.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.000+0000 7fbca0445640 1 Processor -- start 2024-09-15T22:47:00.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.000+0000 7fbca0445640 1 -- start start 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.001+0000 7fbca0445640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbc9806bba0 0x7fbc9806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.001+0000 7fbca0445640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc980d1400 con 0x7fbc980d0610 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.001+0000 7fbca0445640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc980d1160 con 0x7fbc9806f060 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.001+0000 7fbca0445640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbc9806c4c0 con 0x7fbc9806bba0 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9d9e0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbc980d0610 0x7fbc980d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45932/0 (socket says 172.21.15.134:45932) 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9d9e0640 1 -- 172.21.15.134:0/1830898485 learned_addr learned my addr 172.21.15.134:0/1830898485 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9e1e1640 1 --2- 172.21.15.134:0/1830898485 >> v2:172.21.15.177:3300/0 conn(0x7fbc9806bba0 0x7fbc9806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537668885 0 0) 0x7fbc980d1400 con 0x7fbc980d0610 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc84003520 con 0x7fbc980d0610 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9e1e1640 1 -- 172.21.15.134:0/1830898485 >> v1:172.21.15.177:6789/0 conn(0x7fbc9806f060 legacy=0x7fbc9806f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406623279 0 0) 0x7fbc980d1160 con 0x7fbc9806f060 2024-09-15T22:47:00.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9e1e1640 1 -- 172.21.15.134:0/1830898485 >> v1:172.21.15.134:6789/0 conn(0x7fbc980d0610 legacy=0x7fbc980d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.002+0000 7fbc9e1e1640 1 -- 172.21.15.134:0/1830898485 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9806e2a0 con 0x7fbc9806bba0 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbc9e1e1640 1 --2- 172.21.15.134:0/1830898485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9806bf80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009d90 tx=0x7fbc9402ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cb58c6b53575154 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032830 con 0x7fbc9806bba0 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc940329d0 con 0x7fbc9806bba0 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbc9d1df640 1 -- 172.21.15.134:0/1830898485 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032d80 con 0x7fbc9806bba0 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbca0445640 1 -- 172.21.15.134:0/1830898485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 msgr2=0x7fbc9806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.003+0000 7fbca0445640 1 --2- 172.21.15.134:0/1830898485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9806bf80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009d90 tx=0x7fbc9402ea70 comp rx=0 tx=0).stop 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.004+0000 7fbca0445640 1 -- 172.21.15.134:0/1830898485 shutdown_connections 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.004+0000 7fbca0445640 1 --2- 172.21.15.134:0/1830898485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9806bf80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.004+0000 7fbca0445640 1 -- 172.21.15.134:0/1830898485 >> 172.21.15.134:0/1830898485 conn(0x7fbc980b3380 msgr2=0x7fbc980b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.004+0000 7fbca0445640 1 -- 172.21.15.134:0/1830898485 shutdown_connections 2024-09-15T22:47:00.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.004+0000 7fbca0445640 1 -- 172.21.15.134:0/1830898485 wait complete. 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.005+0000 7fbca0445640 1 Processor -- start 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.005+0000 7fbca0445640 1 -- start start 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.005+0000 7fbca0445640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9815f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980d0610 0x7fbc9815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98146290 con 0x7fbc9806f060 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9806e860 con 0x7fbc9806bba0 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98146410 con 0x7fbc980d0610 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43670/0 (socket says 172.21.15.134:43670) 2024-09-15T22:47:00.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 -- 172.21.15.134:0/806564705 learned_addr learned my addr 172.21.15.134:0/806564705 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9e1e1640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9e9e2640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980d0610 0x7fbc9815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 -- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980d0610 msgr2=0x7fbc9815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980d0610 0x7fbc9815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 -- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 msgr2=0x7fbc9815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9815f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 -- 172.21.15.134:0/806564705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9813f610 con 0x7fbc9806f060 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc9d9e0640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c390 tx=0x7fbc8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88017070 con 0x7fbc9806f060 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88005ce0 con 0x7fbc9806f060 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9813f8f0 con 0x7fbc9806f060 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880072f0 con 0x7fbc9806f060 2024-09-15T22:47:00.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.006+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc98143700 con 0x7fbc9806f060 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.007+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc98143900 con 0x7fbc9806f060 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.008+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fbc8801a070 con 0x7fbc9806f060 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.008+0000 7fbc8effd640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 0x7fbc7c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.008+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fbc8808b1c0 con 0x7fbc9806f060 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.008+0000 7fbc9e1e1640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 0x7fbc7c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.009+0000 7fbc9e1e1640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 0x7fbc7c06ed10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc94039000 tx=0x7fbc94034000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.013+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc98143900 con 0x7fbc9806f060 2024-09-15T22:47:00.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.203+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7fbc9806bf80 con 0x7fbc7c06c850 2024-09-15T22:47:00.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.206+0000 7fbc8effd640 1 -- 172.21.15.134:0/806564705 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fbc9806bf80 con 0x7fbc7c06c850 2024-09-15T22:47:00.208 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-09-15T22:47:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 msgr2=0x7fbc7c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 0x7fbc7c06ed10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc94039000 tx=0x7fbc94034000 comp rx=0 tx=0).stop 2024-09-15T22:47:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 msgr2=0x7fbc9815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c390 tx=0x7fbc8800c850 comp rx=0 tx=0).stop 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 shutdown_connections 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980d0610 0x7fbc9815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbc7c06c850 0x7fbc7c06ed10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9806f060 0x7fbc9815bb50 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.208+0000 7fbca0445640 1 --2- 172.21.15.134:0/806564705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806bba0 0x7fbc9815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.209+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 >> 172.21.15.134:0/806564705 conn(0x7fbc980b3380 msgr2=0x7fbc980b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.209+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 shutdown_connections 2024-09-15T22:47:00.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.209+0000 7fbca0445640 1 -- 172.21.15.134:0/806564705 wait complete. 2024-09-15T22:47:00.220 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:47:00.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:47:00.272 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:47:00.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:00.277 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:47:00.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:00.312 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:00.352 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:47:00.468 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:00.469 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:00.469 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:00.486 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:00.486 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:00.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:47:00.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.686+0000 7faafe986640 1 Processor -- start 2024-09-15T22:47:00.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 -- start start 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faaf815e940 0x7faaf80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf815ed20 0x7faaf80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf80b7170 con 0x7faaf80cef90 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faaf80d1ae0 con 0x7faaf815e940 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafe986640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faaf80b7aa0 con 0x7faaf815ed20 2024-09-15T22:47:00.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faaf7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faaf815e940 0x7faaf80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafcf23640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faaf80cef90 0x7faaf80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45940/0 (socket says 172.21.15.134:45940) 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.687+0000 7faafcf23640 1 -- 172.21.15.134:0/1998858846 learned_addr learned my addr 172.21.15.134:0/1998858846 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf77fe640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf815ed20 0x7faaf80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf7fff640 1 -- 172.21.15.134:0/1998858846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf815ed20 msgr2=0x7faaf80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf7fff640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf815ed20 0x7faaf80d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf7fff640 1 -- 172.21.15.134:0/1998858846 >> v1:172.21.15.134:6789/0 conn(0x7faaf80cef90 legacy=0x7faaf80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf7fff640 1 -- 172.21.15.134:0/1998858846 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf80d3660 con 0x7faaf815e940 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf6ffd640 1 -- 172.21.15.134:0/1998858846 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793515249 0 0) 0x7faaf0001490 con 0x7faaf80cef90 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.688+0000 7faaf7fff640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80d1060 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7faae80097a0 tx=0x7faae802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd5555a7e58b006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faaf6ffd640 1 -- 172.21.15.134:0/1998858846 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8037070 con 0x7faaf815e940 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faaf6ffd640 1 -- 172.21.15.134:0/1998858846 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8032440 con 0x7faaf815e940 2024-09-15T22:47:00.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faaf6ffd640 1 -- 172.21.15.134:0/1998858846 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8032810 con 0x7faaf815e940 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 -- 172.21.15.134:0/1998858846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 msgr2=0x7faaf80d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80d1060 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7faae80097a0 tx=0x7faae802a210 comp rx=0 tx=0).stop 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 -- 172.21.15.134:0/1998858846 shutdown_connections 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf815ed20 0x7faaf80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 --2- 172.21.15.134:0/1998858846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80d1060 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 -- 172.21.15.134:0/1998858846 >> 172.21.15.134:0/1998858846 conn(0x7faaf80b6240 msgr2=0x7faaf80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 -- 172.21.15.134:0/1998858846 shutdown_connections 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.689+0000 7faafe986640 1 -- 172.21.15.134:0/1998858846 wait complete. 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.690+0000 7faafe986640 1 Processor -- start 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 -- start start 2024-09-15T22:47:00.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf80cef90 0x7faaf81f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf815ed20 0x7faaf815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faaf80d3f00 con 0x7faaf815e940 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faaf80d3c20 con 0x7faaf815ed20 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faafe986640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faaf80d3310 con 0x7faaf80cef90 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43692/0 (socket says 172.21.15.134:43692) 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.691+0000 7faaf77fe640 1 -- 172.21.15.134:0/1810353763 learned_addr learned my addr 172.21.15.134:0/1810353763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf7fff640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf80cef90 0x7faaf81f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faafcf23640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf815ed20 0x7faaf815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 -- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf80cef90 msgr2=0x7faaf81f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf80cef90 0x7faaf81f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 -- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf815ed20 msgr2=0x7faaf815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf815ed20 0x7faaf815ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 -- 172.21.15.134:0/1810353763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf815b150 con 0x7faaf815e940 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf77fe640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7faaec00d800 tx=0x7faaec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec00b6c0 con 0x7faaf815e940 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec019070 con 0x7faaf815e940 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf80b8a50 con 0x7faaf815e940 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec00bac0 con 0x7faaf815e940 2024-09-15T22:47:00.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.692+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf80b9010 con 0x7faaf815e940 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.693+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf80b9210 con 0x7faaf815e940 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.694+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7faaec00bc60 con 0x7faaf815e940 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.694+0000 7faaf4ff9640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 0x7faae406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.694+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7faaec08c250 con 0x7faaf815e940 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.694+0000 7faaf7fff640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 0x7faae406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:00.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.695+0000 7faaf7fff640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 0x7faae406ed10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faae8034000 tx=0x7faae802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:00.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.698+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaf80b9210 con 0x7faaf815e940 2024-09-15T22:47:00.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.879+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faaf80d1f80 con 0x7faaf815e940 2024-09-15T22:47:00.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.879+0000 7faaf4ff9640 1 -- 172.21.15.134:0/1810353763 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) ==== 80+0+0 (secure 0 0 0) 0x7faaec05a1c0 con 0x7faaf815e940 2024-09-15T22:47:00.880 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:47:00.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 msgr2=0x7faae406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 0x7faae406ed10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faae8034000 tx=0x7faae802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:00.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 msgr2=0x7faaf80ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:00.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7faaec00d800 tx=0x7faaec00dcc0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 shutdown_connections 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf815ed20 0x7faaf815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faae406c850 0x7faae406ed10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf815e940 0x7faaf80ab1a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 --2- 172.21.15.134:0/1810353763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faaf80cef90 0x7faaf81f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 >> 172.21.15.134:0/1810353763 conn(0x7faaf80b6240 msgr2=0x7faaf80b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 shutdown_connections 2024-09-15T22:47:00.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:00.881+0000 7faafe986640 1 -- 172.21.15.134:0/1810353763 wait complete. 2024-09-15T22:47:00.894 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:47:00.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:00.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:00.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:47:00.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:00.934 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:47:00.991 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:00.991 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:00.991 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:01.009 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:01.009 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:01.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.165+0000 7ff9ab647640 1 Processor -- start 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.165+0000 7ff9ab647640 1 -- start start 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9ab647640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff9a40b0640 0x7ff9a40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9ab647640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a40ce150 con 0x7ff9a40cdae0 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9ab647640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a40ce430 con 0x7ff9a4156880 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9ab647640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a40b6b00 con 0x7ff9a40b0640 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9a9be4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff9a40b0640 0x7ff9a40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9a9be4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff9a40b0640 0x7ff9a40b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43698/0 (socket says 172.21.15.134:43698) 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.166+0000 7ff9a9be4640 1 -- 172.21.15.134:0/3810738026 learned_addr learned my addr 172.21.15.134:0/3810738026 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff9a9be4640 1 -- 172.21.15.134:0/3810738026 >> v1:172.21.15.177:6789/0 conn(0x7ff9a4156880 legacy=0x7ff9a4160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff9a9be4640 1 -- 172.21.15.134:0/3810738026 >> v1:172.21.15.134:6789/0 conn(0x7ff9a40cdae0 legacy=0x7ff9a40aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff9a9be4640 1 -- 172.21.15.134:0/3810738026 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a415ff30 con 0x7ff9a40b0640 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff9a9be4640 1 --2- 172.21.15.134:0/3810738026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40b0640 0x7ff9a40b65c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009e50 tx=0x7ff99c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f114cec555da362 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff99bfff640 1 -- 172.21.15.134:0/3810738026 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c036070 con 0x7ff9a40b0640 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff99bfff640 1 -- 172.21.15.134:0/3810738026 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c031600 con 0x7ff9a40b0640 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.167+0000 7ff99bfff640 1 -- 172.21.15.134:0/3810738026 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0319f0 con 0x7ff9a40b0640 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 -- 172.21.15.134:0/3810738026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40b0640 msgr2=0x7ff9a40b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3810738026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40b0640 0x7ff9a40b65c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009e50 tx=0x7ff99c02a7c0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 -- 172.21.15.134:0/3810738026 shutdown_connections 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3810738026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40b0640 0x7ff9a40b65c0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 -- 172.21.15.134:0/3810738026 >> 172.21.15.134:0/3810738026 conn(0x7ff9a406cae0 msgr2=0x7ff9a406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 -- 172.21.15.134:0/3810738026 shutdown_connections 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.168+0000 7ff9ab647640 1 -- 172.21.15.134:0/3810738026 wait complete. 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.169+0000 7ff9ab647640 1 Processor -- start 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.169+0000 7ff9ab647640 1 -- start start 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a40b0640 0x7ff9a41539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4156880 0x7ff9a40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40ce710 con 0x7ff9a40cdae0 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4156c60 con 0x7ff9a4156880 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9ab647640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a415c8a0 con 0x7ff9a40b0640 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43700/0 (socket says 172.21.15.134:43700) 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 -- 172.21.15.134:0/3537673621 learned_addr learned my addr 172.21.15.134:0/3537673621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 -- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a40b0640 msgr2=0x7ff9a41539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a9be4640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4156880 0x7ff9a40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a93e3640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a40b0640 0x7ff9a41539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a40b0640 0x7ff9a41539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 -- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4156880 msgr2=0x7ff9a40b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4156880 0x7ff9a40b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.170+0000 7ff9a8be2640 1 -- 172.21.15.134:0/3537673621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a40b4650 con 0x7ff9a40cdae0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff9a8be2640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c450 tx=0x7ff99400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940052d0 con 0x7ff9a40cdae0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff994005470 con 0x7ff9a40cdae0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a40b48f0 con 0x7ff9a40cdae0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994012870 con 0x7ff9a40cdae0 2024-09-15T22:47:01.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.171+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a40b4eb0 con 0x7ff9a40cdae0 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.172+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a414ae50 con 0x7ff9a40cdae0 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.172+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7ff994012a10 con 0x7ff9a40cdae0 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.173+0000 7ff999ffb640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 0x7ff98806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.173+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7ff99408bab0 con 0x7ff9a40cdae0 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.173+0000 7ff9a93e3640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 0x7ff98806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.174+0000 7ff9a93e3640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 0x7ff98806ed10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40763d0 tx=0x7ff9a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.177+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff994059990 con 0x7ff9a40cdae0 2024-09-15T22:47:01.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.354+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff9a406e690 con 0x7ff9a40cdae0 2024-09-15T22:47:01.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.355+0000 7ff999ffb640 1 -- 172.21.15.134:0/3537673621 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) ==== 80+0+0 (secure 0 0 0) 0x7ff994059290 con 0x7ff9a40cdae0 2024-09-15T22:47:01.356 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.356+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 msgr2=0x7ff98806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.356+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 0x7ff98806ed10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40763d0 tx=0x7ff9a0009040 comp rx=0 tx=0).stop 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 msgr2=0x7ff9a40b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c450 tx=0x7ff99400c910 comp rx=0 tx=0).stop 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 shutdown_connections 2024-09-15T22:47:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9a4156880 0x7ff9a40b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff98806c850 0x7ff98806ed10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a40cdae0 0x7ff9a40b4110 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 --2- 172.21.15.134:0/3537673621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9a40b0640 0x7ff9a41539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 >> 172.21.15.134:0/3537673621 conn(0x7ff9a406cae0 msgr2=0x7ff9a4155540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 shutdown_connections 2024-09-15T22:47:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.357+0000 7ff9ab647640 1 -- 172.21.15.134:0/3537673621 wait complete. 2024-09-15T22:47:01.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:47:01.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:01.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:01.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:47:01.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:01.403 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:47:01.462 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:01.463 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:01.463 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:01.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:01.479 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:01.479 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:01.479 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:01.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:01.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:01.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.618+0000 7efd61c3c640 1 Processor -- start 2024-09-15T22:47:01.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.618+0000 7efd61c3c640 1 -- start start 2024-09-15T22:47:01.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd61c3c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd5c0d02a0 0x7efd5c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd61c3c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c0d0bc0 con 0x7efd5c15ca40 2024-09-15T22:47:01.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd61c3c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c15d390 con 0x7efd5c15ceb0 2024-09-15T22:47:01.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd61c3c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c15d670 con 0x7efd5c0d02a0 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7efd5c15ca40 0x7efd5c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45966/0 (socket says 172.21.15.134:45966) 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5affd640 1 -- 172.21.15.134:0/4042060818 learned_addr learned my addr 172.21.15.134:0/4042060818 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540591956 0 0) 0x7efd5c0d0bc0 con 0x7efd5c15ca40 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd44003520 con 0x7efd5c15ca40 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5b7fe640 1 --2- 172.21.15.134:0/4042060818 >> v2:172.21.15.177:3300/0 conn(0x7efd5c0d02a0 0x7efd5c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3055932601 0 0) 0x7efd44003520 con 0x7efd5c15ca40 2024-09-15T22:47:01.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 >> v2:172.21.15.177:3300/0 conn(0x7efd5c0d02a0 msgr2=0x7efd5c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 --2- 172.21.15.134:0/4042060818 >> v2:172.21.15.177:3300/0 conn(0x7efd5c0d02a0 0x7efd5c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 >> v1:172.21.15.177:6789/0 conn(0x7efd5c15ceb0 legacy=0x7efd5c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15d950 con 0x7efd5c15ca40 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7efd50001670 con 0x7efd5c15ca40 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 >> v1:172.21.15.134:6789/0 conn(0x7efd5c15ca40 legacy=0x7efd5c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440039b0 0x7efd44003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 0x7efd4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15d670 con 0x7efd440052e0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.619+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400c190 con 0x7efd440039b0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd4400c390 con 0x7efd44004800 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 0x7efd4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5b7fe640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440039b0 0x7efd44003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5affd640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 -- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd44004800 msgr2=0x7efd44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 -- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440039b0 msgr2=0x7efd44003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440039b0 0x7efd44003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 -- 172.21.15.134:0/4042060818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd44003520 con 0x7efd440052e0 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.620+0000 7efd5bfff640 1 -- 172.21.15.134:0/4042060818 reap_dead start 2024-09-15T22:47:01.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd5bfff640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 0x7efd4400b9c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7efd5c15d2c0 tx=0x7efd44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85155b93e60b4730 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54037070 con 0x7efd440052e0 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5402ad30 con 0x7efd440052e0 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd5a7fc640 1 -- 172.21.15.134:0/4042060818 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54004080 con 0x7efd440052e0 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 -- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 msgr2=0x7efd4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 0x7efd4400b9c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7efd5c15d2c0 tx=0x7efd44005830 comp rx=0 tx=0).stop 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 -- 172.21.15.134:0/4042060818 shutdown_connections 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 --2- 172.21.15.134:0/4042060818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd440052e0 0x7efd4400b9c0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 -- 172.21.15.134:0/4042060818 >> 172.21.15.134:0/4042060818 conn(0x7efd5c062cc0 msgr2=0x7efd5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 -- 172.21.15.134:0/4042060818 shutdown_connections 2024-09-15T22:47:01.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.621+0000 7efd61c3c640 1 -- 172.21.15.134:0/4042060818 wait complete. 2024-09-15T22:47:01.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.622+0000 7efd61c3c640 1 Processor -- start 2024-09-15T22:47:01.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 -- start start 2024-09-15T22:47:01.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440052e0 0x7efd5c072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd5c1460d0 0x7efd5c0732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c155b90 con 0x7efd5c145c70 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15df10 con 0x7efd440052e0 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.623+0000 7efd61c3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c155d10 con 0x7efd5c1460d0 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43722/0 (socket says 172.21.15.134:43722) 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 -- 172.21.15.134:0/297072274 learned_addr learned my addr 172.21.15.134:0/297072274 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5bfff640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd5c1460d0 0x7efd5c0732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5b7fe640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440052e0 0x7efd5c072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 -- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd5c1460d0 msgr2=0x7efd5c0732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd5c1460d0 0x7efd5c0732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 -- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440052e0 msgr2=0x7efd5c072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440052e0 0x7efd5c072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 -- 172.21.15.134:0/297072274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c071b10 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd5affd640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7efd50007310 tx=0x7efd500077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5001a070 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5000f940 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c071df0 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000fd10 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.624+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c0723b0 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.625+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c0b4790 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.626+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7efd5001d070 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.626+0000 7efd43fff640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 0x7efd4806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.626+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7efd5008b8a0 con 0x7efd5c145c70 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.627+0000 7efd5b7fe640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 0x7efd4806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.627+0000 7efd5b7fe640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 0x7efd4806ed10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.631+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd500590a0 con 0x7efd5c145c70 2024-09-15T22:47:01.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.827+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd5c0b0af0 con 0x7efd5c145c70 2024-09-15T22:47:01.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.828+0000 7efd43fff640 1 -- 172.21.15.134:0/297072274 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7efd5005d3a0 con 0x7efd5c145c70 2024-09-15T22:47:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:01.830 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":62,"btime":"2024-09-15T22:46:54:967979+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:47:01.830 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 62 2024-09-15T22:47:01.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 msgr2=0x7efd4806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 0x7efd4806ed10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 msgr2=0x7efd5c071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7efd50007310 tx=0x7efd500077d0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 shutdown_connections 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd5c1460d0 0x7efd5c0732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd4806c850 0x7efd4806ed10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd5c145c70 0x7efd5c071070 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 --2- 172.21.15.134:0/297072274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd440052e0 0x7efd5c072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 >> 172.21.15.134:0/297072274 conn(0x7efd5c062cc0 msgr2=0x7efd5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 shutdown_connections 2024-09-15T22:47:01.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.830+0000 7efd61c3c640 1 -- 172.21.15.134:0/297072274 wait complete. 2024-09-15T22:47:01.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:01.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.939+0000 7f57f2e74640 1 Processor -- start 2024-09-15T22:47:01.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.939+0000 7f57f2e74640 1 -- start start 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f2e74640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f57ec0d02a0 0x7f57ec0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f2e74640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57ec15ceb0 0x7f57ec1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f2e74640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57ec0d0bc0 con 0x7f57ec15ca40 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f2e74640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f57ec15d390 con 0x7f57ec15ceb0 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f2e74640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f57ec15d670 con 0x7f57ec0d02a0 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57ec15ceb0 0x7f57ec1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57ec15ceb0 0x7f57ec1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43726/0 (socket says 172.21.15.134:43726) 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 -- 172.21.15.134:0/3316287986 learned_addr learned my addr 172.21.15.134:0/3316287986 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f0c10640 1 --2- 172.21.15.134:0/3316287986 >> v2:172.21.15.177:3300/0 conn(0x7f57ec0d02a0 0x7f57ec0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 -- 172.21.15.134:0/3316287986 >> v2:172.21.15.177:3300/0 conn(0x7f57ec0d02a0 msgr2=0x7f57ec0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 --2- 172.21.15.134:0/3316287986 >> v2:172.21.15.177:3300/0 conn(0x7f57ec0d02a0 0x7f57ec0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 -- 172.21.15.134:0/3316287986 >> v1:172.21.15.177:6789/0 conn(0x7f57ec15ca40 legacy=0x7f57ec15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.940+0000 7f57f1411640 1 -- 172.21.15.134:0/3316287986 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec15d950 con 0x7f57ec15ceb0 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f1411640 1 --2- 172.21.15.134:0/3316287986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1594c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f57ec06f030 tx=0x7f57e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d458ca1ed13e948 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57eb7fe640 1 -- 172.21.15.134:0/3316287986 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4036070 con 0x7f57ec15ceb0 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57eb7fe640 1 -- 172.21.15.134:0/3316287986 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e4031600 con 0x7f57ec15ceb0 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57eb7fe640 1 -- 172.21.15.134:0/3316287986 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e40319d0 con 0x7f57ec15ceb0 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 -- 172.21.15.134:0/3316287986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 msgr2=0x7f57ec1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 --2- 172.21.15.134:0/3316287986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1594c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f57ec06f030 tx=0x7f57e402a660 comp rx=0 tx=0).stop 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 -- 172.21.15.134:0/3316287986 shutdown_connections 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 --2- 172.21.15.134:0/3316287986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1594c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 --2- 172.21.15.134:0/3316287986 >> v2:172.21.15.177:3300/0 conn(0x7f57ec0d02a0 0x7f57ec0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.941+0000 7f57f2e74640 1 -- 172.21.15.134:0/3316287986 >> 172.21.15.134:0/3316287986 conn(0x7f57ec062cc0 msgr2=0x7f57ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.942+0000 7f57f2e74640 1 -- 172.21.15.134:0/3316287986 shutdown_connections 2024-09-15T22:47:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.942+0000 7f57f2e74640 1 -- 172.21.15.134:0/3316287986 wait complete. 2024-09-15T22:47:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.943+0000 7f57f2e74640 1 Processor -- start 2024-09-15T22:47:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.943+0000 7f57f2e74640 1 -- start start 2024-09-15T22:47:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec0d02a0 0x7f57ec1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57ec15ca40 0x7f57ec0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec15eb40 con 0x7f57ec15ceb0 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec15df10 con 0x7f57ec0d02a0 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f57ec155b90 con 0x7f57ec15ca40 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43730/0 (socket says 172.21.15.134:43730) 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 -- 172.21.15.134:0/1806869760 learned_addr learned my addr 172.21.15.134:0/1806869760 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f0c10640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec0d02a0 0x7f57ec1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57ebfff640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57ec15ca40 0x7f57ec0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 -- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57ec15ca40 msgr2=0x7f57ec0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57ec15ca40 0x7f57ec0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 -- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec0d02a0 msgr2=0x7f57ec1f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec0d02a0 0x7f57ec1f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 -- 172.21.15.134:0/1806869760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec1f5160 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f1411640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009f40 tx=0x7f57e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4036050 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e4042070 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec1f48c0 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4009510 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.944+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec1f4e80 con 0x7f57ec15ceb0 2024-09-15T22:47:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.945+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec0b4790 con 0x7f57ec15ceb0 2024-09-15T22:47:01.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.946+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f57e4007bf0 con 0x7f57ec15ceb0 2024-09-15T22:47:01.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.946+0000 7f57e97fa640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 0x7f57d006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.946+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f57e40acd40 con 0x7f57ec15ceb0 2024-09-15T22:47:01.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.947+0000 7f57f0c10640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 0x7f57d006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.947+0000 7f57f0c10640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 0x7f57d006ed10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57ec15b5b0 tx=0x7f57e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:01.950+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57e407a670 con 0x7f57ec15ceb0 2024-09-15T22:47:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.152+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57ec0af030 con 0x7f57ec15ceb0 2024-09-15T22:47:02.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.152+0000 7f57e97fa640 1 -- 172.21.15.134:0/1806869760 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f57e407e970 con 0x7f57ec15ceb0 2024-09-15T22:47:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:02.154 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":62,"btime":"2024-09-15T22:46:54:967979+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:47:02.154 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 62 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 msgr2=0x7f57d006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 0x7f57d006ed10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57ec15b5b0 tx=0x7f57e0008040 comp rx=0 tx=0).stop 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 msgr2=0x7f57ec1f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009f40 tx=0x7f57e4004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 shutdown_connections 2024-09-15T22:47:02.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f57d006c850 0x7f57d006ed10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57ec15ceb0 0x7f57ec1f53a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57ec15ca40 0x7f57ec0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 --2- 172.21.15.134:0/1806869760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec0d02a0 0x7f57ec1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 >> 172.21.15.134:0/1806869760 conn(0x7f57ec062cc0 msgr2=0x7f57ec1539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 shutdown_connections 2024-09-15T22:47:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.155+0000 7f57f2e74640 1 -- 172.21.15.134:0/1806869760 wait complete. 2024-09-15T22:47:02.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:02.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.264+0000 7fb5372f8640 1 Processor -- start 2024-09-15T22:47:02.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.264+0000 7fb5372f8640 1 -- start start 2024-09-15T22:47:02.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb5372f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb53015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb5372f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb53015ce80 0x7fb5301594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb5372f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb53015d390 con 0x7fb5300d02a0 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb5372f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb53015d670 con 0x7fb53015ce80 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb5372f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb53015d950 con 0x7fb53015ca40 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb53015ce80 0x7fb5301594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb53015ce80 0x7fb5301594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43746/0 (socket says 172.21.15.134:43746) 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 -- 172.21.15.134:0/1485191124 learned_addr learned my addr 172.21.15.134:0/1485191124 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb534893640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb53015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 -- 172.21.15.134:0/1485191124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 msgr2=0x7fb53015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb53015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 -- 172.21.15.134:0/1485191124 >> v1:172.21.15.177:6789/0 conn(0x7fb5300d02a0 legacy=0x7fb5300d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:02.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.265+0000 7fb535895640 1 -- 172.21.15.134:0/1485191124 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53015dc30 con 0x7fb53015ce80 2024-09-15T22:47:02.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb535895640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb53015ce80 0x7fb5301594c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb52800d150 tx=0x7fb52802c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a699aafae4b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb527fff640 1 -- 172.21.15.134:0/1485191124 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528039070 con 0x7fb53015ce80 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb527fff640 1 -- 172.21.15.134:0/1485191124 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb528009600 con 0x7fb53015ce80 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb527fff640 1 -- 172.21.15.134:0/1485191124 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280099d0 con 0x7fb53015ce80 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb5372f8640 1 -- 172.21.15.134:0/1485191124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb53015ce80 msgr2=0x7fb5301594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb5372f8640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb53015ce80 0x7fb5301594c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb52800d150 tx=0x7fb52802c840 comp rx=0 tx=0).stop 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.266+0000 7fb5372f8640 1 -- 172.21.15.134:0/1485191124 shutdown_connections 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.267+0000 7fb5372f8640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb53015ce80 0x7fb5301594c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.267+0000 7fb5372f8640 1 --2- 172.21.15.134:0/1485191124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb53015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.267+0000 7fb5372f8640 1 -- 172.21.15.134:0/1485191124 >> 172.21.15.134:0/1485191124 conn(0x7fb530062cc0 msgr2=0x7fb53006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.267+0000 7fb5372f8640 1 -- 172.21.15.134:0/1485191124 shutdown_connections 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.267+0000 7fb5372f8640 1 -- 172.21.15.134:0/1485191124 wait complete. 2024-09-15T22:47:02.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.268+0000 7fb5372f8640 1 Processor -- start 2024-09-15T22:47:02.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.268+0000 7fb5372f8640 1 -- start start 2024-09-15T22:47:02.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.268+0000 7fb5372f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.268+0000 7fb5372f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb5300b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.268+0000 7fb5372f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb53015ce80 0x7fb53014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb5372f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb530155d10 con 0x7fb5300d02a0 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb5372f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb530155b90 con 0x7fb53015ce80 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb5372f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb5300b4790 con 0x7fb53015ca40 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43758/0 (socket says 172.21.15.134:43758) 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 -- 172.21.15.134:0/986908327 learned_addr learned my addr 172.21.15.134:0/986908327 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb534893640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb5300b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535895640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb53015ce80 0x7fb53014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 -- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 msgr2=0x7fb5300b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb5300b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 -- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb53015ce80 msgr2=0x7fb53014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb53015ce80 0x7fb53014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 -- 172.21.15.134:0/986908327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53014dc70 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb535094640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b3f0 tx=0x7fb52c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c015020 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52c011830 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53014df50 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c011c20 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.269+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53014e510 con 0x7fb5300d02a0 2024-09-15T22:47:02.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.270+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5300b41e0 con 0x7fb5300d02a0 2024-09-15T22:47:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.271+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fb52c018020 con 0x7fb5300d02a0 2024-09-15T22:47:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.271+0000 7fb525ffb640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 0x7fb51406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.271+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fb52c08b9b0 con 0x7fb5300d02a0 2024-09-15T22:47:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.271+0000 7fb534893640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 0x7fb51406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.272+0000 7fb534893640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 0x7fb51406ed10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb5300d0b80 tx=0x7fb520008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.275+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb52c01f030 con 0x7fb5300d02a0 2024-09-15T22:47:02.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.439+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb53006d440 con 0x7fb5300d02a0 2024-09-15T22:47:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.441+0000 7fb525ffb640 1 -- 172.21.15.134:0/986908327 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16767 (secure 0 0 0) 0x7fb52c0592d0 con 0x7fb5300d02a0 2024-09-15T22:47:02.442 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:02.442 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":122,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:43.624806+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:46:40.298166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T22:46:40.929558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 msgr2=0x7fb51406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 0x7fb51406ed10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb5300d0b80 tx=0x7fb520008040 comp rx=0 tx=0).stop 2024-09-15T22:47:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 msgr2=0x7fb53014d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b3f0 tx=0x7fb52c00b8b0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 shutdown_connections 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb53015ce80 0x7fb53014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb53015ca40 0x7fb5300b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb51406c850 0x7fb51406ed10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 --2- 172.21.15.134:0/986908327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5300d02a0 0x7fb53014d690 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 >> 172.21.15.134:0/986908327 conn(0x7fb530062cc0 msgr2=0x7fb5300b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 shutdown_connections 2024-09-15T22:47:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.443+0000 7fb5372f8640 1 -- 172.21.15.134:0/986908327 wait complete. 2024-09-15T22:47:02.457 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:47:02.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:02.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.554+0000 7f77102d2640 1 Processor -- start 2024-09-15T22:47:02.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.554+0000 7f77102d2640 1 -- start start 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f77102d2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f77080b8f90 0x7f77080b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f77102d2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77080b7170 con 0x7f770815ed20 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f77102d2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77080b7aa0 con 0x7f770815e940 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f77102d2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f77080d3660 con 0x7f77080b8f90 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f770d86d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f770815ed20 0x7f77080b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45972/0 (socket says 172.21.15.134:45972) 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f770d86d640 1 -- 172.21.15.134:0/1692508485 learned_addr learned my addr 172.21.15.134:0/1692508485 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.555+0000 7f770e86f640 1 --2- 172.21.15.134:0/1692508485 >> v2:172.21.15.134:3300/0 conn(0x7f77080b8f90 0x7f77080b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770e86f640 1 -- 172.21.15.134:0/1692508485 >> v1:172.21.15.177:6789/0 conn(0x7f770815e940 legacy=0x7f77080d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:02.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770e86f640 1 -- 172.21.15.134:0/1692508485 >> v1:172.21.15.134:6789/0 conn(0x7f770815ed20 legacy=0x7f77080b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770d06c640 1 -- 172.21.15.134:0/1692508485 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958999763 0 0) 0x7f76f8001110 con 0x7f770815ed20 2024-09-15T22:47:02.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770e86f640 1 -- 172.21.15.134:0/1692508485 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77080d3940 con 0x7f77080b8f90 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770e86f640 1 --2- 172.21.15.134:0/1692508485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77080b8f90 0x7f77080b3930 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7700009d90 tx=0x7f770002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c21a0aeb6f312a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770d06c640 1 -- 172.21.15.134:0/1692508485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700007740 con 0x7f77080b8f90 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.556+0000 7f770d06c640 1 -- 172.21.15.134:0/1692508485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77000078e0 con 0x7f77080b8f90 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f770d06c640 1 -- 172.21.15.134:0/1692508485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700007cb0 con 0x7f77080b8f90 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 -- 172.21.15.134:0/1692508485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77080b8f90 msgr2=0x7f77080b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 --2- 172.21.15.134:0/1692508485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77080b8f90 0x7f77080b3930 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7700009d90 tx=0x7f770002a730 comp rx=0 tx=0).stop 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 -- 172.21.15.134:0/1692508485 shutdown_connections 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 --2- 172.21.15.134:0/1692508485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77080b8f90 0x7f77080b3930 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 -- 172.21.15.134:0/1692508485 >> 172.21.15.134:0/1692508485 conn(0x7f77080b6240 msgr2=0x7f77080b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 -- 172.21.15.134:0/1692508485 shutdown_connections 2024-09-15T22:47:02.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.557+0000 7f77102d2640 1 -- 172.21.15.134:0/1692508485 wait complete. 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.558+0000 7f77102d2640 1 Processor -- start 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.558+0000 7f77102d2640 1 -- start start 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77080b8f90 0x7f7708158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f770815ed20 0x7f770814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77080d3310 con 0x7f770815e940 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f77080d3f00 con 0x7f770815ed20 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f77102d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f77080d1ef0 con 0x7f77080b8f90 2024-09-15T22:47:02.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43778/0 (socket says 172.21.15.134:43778) 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 -- 172.21.15.134:0/1797476686 learned_addr learned my addr 172.21.15.134:0/1797476686 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770e06e640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77080b8f90 0x7f7708158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 -- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77080b8f90 msgr2=0x7f7708158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77080b8f90 0x7f7708158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 -- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f770815ed20 msgr2=0x7f770814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770e86f640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f770815ed20 0x7f770814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f770815ed20 0x7f770814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.559+0000 7f770d86d640 1 -- 172.21.15.134:0/1797476686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770814b4a0 con 0x7f770815e940 2024-09-15T22:47:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f770d86d640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f76f800c410 tx=0x7f76f800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80074e0 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f80047e0 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770814b780 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8004bd0 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.560+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77081f8a10 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.561+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77080cef90 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.561+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f76f8011070 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.562+0000 7f76feffd640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 0x7f76ec06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.562+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f76f808bab0 con 0x7f770815e940 2024-09-15T22:47:02.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.562+0000 7f770e06e640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 0x7f76ec06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.562+0000 7f770e06e640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 0x7f76ec06ed10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7704003d90 tx=0x7f7704009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.566+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77080b7170 con 0x7f770815e940 2024-09-15T22:47:02.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.766+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77080ba6b0 con 0x7f770815e940 2024-09-15T22:47:02.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.767+0000 7f76feffd640 1 -- 172.21.15.134:0/1797476686 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f76f800e280 con 0x7f770815e940 2024-09-15T22:47:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:02.769 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":62,"btime":"2024-09-15T22:46:54:967979+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:47:02.769 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 62 2024-09-15T22:47:02.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 msgr2=0x7f76ec06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 0x7f76ec06ed10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7704003d90 tx=0x7f7704009040 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 msgr2=0x7f77081f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f76f800c410 tx=0x7f76f800c8d0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 shutdown_connections 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f770815ed20 0x7f770814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f76ec06c850 0x7f76ec06ed10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770815e940 0x7f77081f84d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 --2- 172.21.15.134:0/1797476686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77080b8f90 0x7f7708158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 >> 172.21.15.134:0/1797476686 conn(0x7f77080b6240 msgr2=0x7f7708160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 shutdown_connections 2024-09-15T22:47:02.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.769+0000 7f77102d2640 1 -- 172.21.15.134:0/1797476686 wait complete. 2024-09-15T22:47:02.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.878+0000 7fd1adadd640 1 Processor -- start 2024-09-15T22:47:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.878+0000 7fd1adadd640 1 -- start start 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1adadd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1adadd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a8073120 0x7fd1a80735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1adadd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a80ce740 con 0x7fd1a80ce230 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1adadd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a8072640 con 0x7fd1a8073120 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1adadd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a8072920 con 0x7fd1a815c180 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a77fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a8073120 0x7fd1a80735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a8073120 0x7fd1a80735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:39900/0 (socket says 172.21.15.134:39900) 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a7fff640 1 -- 172.21.15.134:0/2930315534 learned_addr learned my addr 172.21.15.134:0/2930315534 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a77fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43290/0 (socket says 172.21.15.134:43290) 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.879+0000 7fd1a6ffd640 1 --1- 172.21.15.134:0/2930315534 >> v1:172.21.15.177:6789/0 conn(0x7fd1a80ce230 0x7fd1a80cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:53738/0 (socket says 172.21.15.134:53738) 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a7fff640 1 -- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 msgr2=0x7fd1a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a7fff640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a7fff640 1 -- 172.21.15.134:0/2930315534 >> v1:172.21.15.177:6789/0 conn(0x7fd1a80ce230 legacy=0x7fd1a80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a7fff640 1 -- 172.21.15.134:0/2930315534 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a8072c00 con 0x7fd1a8073120 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a67fc640 1 -- 172.21.15.134:0/2930315534 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793749950 0 0) 0x7fd1a80ce740 con 0x7fd1a80ce230 2024-09-15T22:47:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a77fe640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:02.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.880+0000 7fd1a7fff640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a80735d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009870 tx=0x7fd1a002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea57e2b9b67038a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1a67fc640 1 -- 172.21.15.134:0/2930315534 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0037070 con 0x7fd1a8073120 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1a67fc640 1 -- 172.21.15.134:0/2930315534 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a0032440 con 0x7fd1a8073120 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1a67fc640 1 -- 172.21.15.134:0/2930315534 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0032810 con 0x7fd1a8073120 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 -- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 msgr2=0x7fd1a80735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a80735d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009870 tx=0x7fd1a002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 -- 172.21.15.134:0/2930315534 shutdown_connections 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a80735d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 --2- 172.21.15.134:0/2930315534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 -- 172.21.15.134:0/2930315534 >> 172.21.15.134:0/2930315534 conn(0x7fd1a8062cc0 msgr2=0x7fd1a806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 -- 172.21.15.134:0/2930315534 shutdown_connections 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.881+0000 7fd1adadd640 1 -- 172.21.15.134:0/2930315534 wait complete. 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.882+0000 7fd1adadd640 1 Processor -- start 2024-09-15T22:47:02.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 -- start start 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a8144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80cf780 con 0x7fd1a80ce230 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80722f0 con 0x7fd1a8073120 2024-09-15T22:47:02.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1adadd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a815c560 con 0x7fd1a815c180 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43780/0 (socket says 172.21.15.134:43780) 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1003890748 learned_addr learned my addr 172.21.15.134:0/1003890748 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1a77fe640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a8144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.883+0000 7fd1a7fff640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 msgr2=0x7fd1a80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 msgr2=0x7fd1a8144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a8144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1003890748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a80b1af0 con 0x7fd1a80ce230 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1a6ffd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c4e0 tx=0x7fd19c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c018070 con 0x7fd1a80ce230 2024-09-15T22:47:02.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c007500 con 0x7fd1a80ce230 2024-09-15T22:47:02.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a80b1dd0 con 0x7fd1a80ce230 2024-09-15T22:47:02.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c004a20 con 0x7fd1a80ce230 2024-09-15T22:47:02.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.884+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a8150110 con 0x7fd1a80ce230 2024-09-15T22:47:02.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.885+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a80cdcf0 con 0x7fd1a80ce230 2024-09-15T22:47:02.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.886+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fd19c01b070 con 0x7fd1a80ce230 2024-09-15T22:47:02.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.886+0000 7fd18ffff640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 0x7fd19406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:02.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.886+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7fd19c08b0f0 con 0x7fd1a80ce230 2024-09-15T22:47:02.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.886+0000 7fd1a77fe640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 0x7fd19406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:02.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.887+0000 7fd1a77fe640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 0x7fd19406ed10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd198009bd0 tx=0x7fd19800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:02.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:02.891+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd19c058ad0 con 0x7fd1a80ce230 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.090+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1a80d0560 con 0x7fd1a80ce230 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.091+0000 7fd18ffff640 1 -- 172.21.15.134:0/1003890748 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7fd19c05cdd0 con 0x7fd1a80ce230 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":62,"btime":"2024-09-15T22:46:54:967979+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:46:41.952655+0000","modified":"2024-09-15T22:46:44.081148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7368":{"gid":7368,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1968724028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1968724028},{"type":"v1","addr":"172.21.15.134:6835","nonce":1968724028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7368,"qdb_cluster":[7368]},"id":9}]} 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 62 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.092+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 msgr2=0x7fd19406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.092+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 0x7fd19406ed10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd198009bd0 tx=0x7fd19800b040 comp rx=0 tx=0).stop 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.092+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 msgr2=0x7fd1a8150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c4e0 tx=0x7fd19c00c9a0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 shutdown_connections 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1a815c180 0x7fd1a80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd19406c850 0x7fd19406ed10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1a80ce230 0x7fd1a8150910 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 --2- 172.21.15.134:0/1003890748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a8073120 0x7fd1a8144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 >> 172.21.15.134:0/1003890748 conn(0x7fd1a8062cc0 msgr2=0x7fd1a815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 shutdown_connections 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.093+0000 7fd1adadd640 1 -- 172.21.15.134:0/1003890748 wait complete. 2024-09-15T22:47:03.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.203+0000 7f33b813b640 1 Processor -- start 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.203+0000 7f33b813b640 1 -- start start 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b813b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f33b015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b813b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f33b015ce80 0x7f33b01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b813b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b015d390 con 0x7f33b00d02a0 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b813b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f33b015d670 con 0x7f33b015ce80 2024-09-15T22:47:03.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b813b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f33b015d950 con 0x7f33b015ca40 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b5ed7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f33b00d02a0 0x7f33b00d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45976/0 (socket says 172.21.15.134:45976) 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b5ed7640 1 -- 172.21.15.134:0/3821701917 learned_addr learned my addr 172.21.15.134:0/3821701917 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f33b015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b66d8640 1 --2- 172.21.15.134:0/3821701917 >> v2:172.21.15.177:3300/0 conn(0x7f33b015ce80 0x7f33b01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693261016 0 0) 0x7f33b015d390 con 0x7f33b00d02a0 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f339c003520 con 0x7f33b00d02a0 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3893053254 0 0) 0x7f339c003520 con 0x7f33b00d02a0 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 msgr2=0x7f33b015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f33b015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 >> v2:172.21.15.177:3300/0 conn(0x7f33b015ce80 msgr2=0x7f33b01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 --2- 172.21.15.134:0/3821701917 >> v2:172.21.15.177:3300/0 conn(0x7f33b015ce80 0x7f33b01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b015dc30 con 0x7f33b00d02a0 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f33ac001670 con 0x7f33b00d02a0 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 >> v1:172.21.15.134:6789/0 conn(0x7f33b00d02a0 legacy=0x7f33b00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f339c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f339c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c004d40 0x7f339c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33b015d670 con 0x7f339c003f30 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33b015d950 con 0x7f339c004d40 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.204+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f339c00ba10 con 0x7f33b015ca40 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f339c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b5ed7640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f339c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b66d8640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c004d40 0x7f339c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 -- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 msgr2=0x7f339c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b015ca40 0x7f339c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 -- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c004d40 msgr2=0x7f339c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c004d40 0x7f339c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.205+0000 7f33b56d6640 1 -- 172.21.15.134:0/3821701917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c003520 con 0x7f339c003f30 2024-09-15T22:47:03.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f339c004800 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009af0 tx=0x7f339c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638b74efa3280a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0036070 con 0x7f339c003f30 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a0031400 con 0x7f339c003f30 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b4ed5640 1 -- 172.21.15.134:0/3821701917 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0009690 con 0x7f339c003f30 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 -- 172.21.15.134:0/3821701917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 msgr2=0x7f339c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 --2- 172.21.15.134:0/3821701917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f339c004800 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009af0 tx=0x7f339c005830 comp rx=0 tx=0).stop 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b66d8640 1 -- 172.21.15.134:0/3821701917 reap_dead start 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 -- 172.21.15.134:0/3821701917 shutdown_connections 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 -- 172.21.15.134:0/3821701917 >> 172.21.15.134:0/3821701917 conn(0x7f33b0062cc0 msgr2=0x7f33b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 -- 172.21.15.134:0/3821701917 shutdown_connections 2024-09-15T22:47:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.206+0000 7f33b813b640 1 -- 172.21.15.134:0/3821701917 wait complete. 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.207+0000 7f33b813b640 1 Processor -- start 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 -- start start 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b014c330 0x7f33b0146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006bba0 0x7f33b006c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0155d10 con 0x7f339c003f30 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0155b90 con 0x7f33b006bba0 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b813b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00b4790 con 0x7f33b014c330 2024-09-15T22:47:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b5ed7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b5ed7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43792/0 (socket says 172.21.15.134:43792) 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b5ed7640 1 -- 172.21.15.134:0/3805572772 learned_addr learned my addr 172.21.15.134:0/3805572772 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.208+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b014c330 0x7f33b0146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b66d8640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006bba0 0x7f33b006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 -- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b014c330 msgr2=0x7f33b0146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b014c330 0x7f33b0146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 -- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006bba0 msgr2=0x7f33b006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006bba0 0x7f33b006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 -- 172.21.15.134:0/3805572772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b00b0150 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b5ed7640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007310 tx=0x7f33ac0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00f960 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac018070 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b00b0430 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00fd60 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.209+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b0147170 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.210+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b00d0680 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.211+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f33ac01c410 con 0x7f339c003f30 2024-09-15T22:47:03.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.211+0000 7f33a67fc640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 0x7f339406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.211+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f33ac08bb70 con 0x7f339c003f30 2024-09-15T22:47:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.211+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 0x7f339406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.212+0000 7f33b56d6640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 0x7f339406ed40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33a0033000 tx=0x7f33a0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.215+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33ac059400 con 0x7f339c003f30 2024-09-15T22:47:03.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.385+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33b0154ee0 con 0x7f339c003f30 2024-09-15T22:47:03.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.386+0000 7f33a67fc640 1 -- 172.21.15.134:0/3805572772 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16767 (secure 0 0 0) 0x7f33ac05d700 con 0x7f339c003f30 2024-09-15T22:47:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:03.389 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":122,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:46:43.624806+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:46:40.298166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T22:46:40.929558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:03.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 msgr2=0x7f339406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 0x7f339406ed40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33a0033000 tx=0x7f33a0008030 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 msgr2=0x7f33b014bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007310 tx=0x7f33ac0077d0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 shutdown_connections 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006bba0 0x7f33b006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33b014c330 0x7f33b0146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f339406c880 0x7f339406ed40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.388+0000 7f33b813b640 1 --2- 172.21.15.134:0/3805572772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c003f30 0x7f33b014bd70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.389+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 >> 172.21.15.134:0/3805572772 conn(0x7f33b0062cc0 msgr2=0x7f33b015b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.389+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 shutdown_connections 2024-09-15T22:47:03.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.389+0000 7f33b813b640 1 -- 172.21.15.134:0/3805572772 wait complete. 2024-09-15T22:47:03.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:47:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.508+0000 7f13c8b8d640 1 Processor -- start 2024-09-15T22:47:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.508+0000 7f13c8b8d640 1 -- start start 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c8b8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f13c406c1f0 0x7f13c40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c8b8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c40cd5f0 con 0x7f13c4151c50 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c8b8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c40cd8d0 con 0x7f13c406be10 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c8b8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f13c40cdbb0 con 0x7f13c406c1f0 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c1d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f13c4151c50 0x7f13c4162740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45978/0 (socket says 172.21.15.134:45978) 2024-09-15T22:47:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.509+0000 7f13c1d9b640 1 -- 172.21.15.134:0/2368362852 learned_addr learned my addr 172.21.15.134:0/2368362852 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c2d9d640 1 --2- 172.21.15.134:0/2368362852 >> v2:172.21.15.177:3300/0 conn(0x7f13c406c1f0 0x7f13c40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683718163 0 0) 0x7f13c40cd5f0 con 0x7f13c4151c50 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13ac003440 con 0x7f13c4151c50 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834796823 0 0) 0x7f13c40cd8d0 con 0x7f13c406be10 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c40cd5f0 con 0x7f13c406be10 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c2d9d640 1 -- 172.21.15.134:0/2368362852 >> v1:172.21.15.177:6789/0 conn(0x7f13c406be10 legacy=0x7f13c4151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2992101546 0 0) 0x7f13ac003440 con 0x7f13c4151c50 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c2d9d640 1 -- 172.21.15.134:0/2368362852 >> v1:172.21.15.134:6789/0 conn(0x7f13c4151c50 legacy=0x7f13c4162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.510+0000 7f13c2d9d640 1 -- 172.21.15.134:0/2368362852 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c40cde90 con 0x7f13c406c1f0 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c2d9d640 1 --2- 172.21.15.134:0/2368362852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c406c1f0 0x7f13c40cd010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097a0 tx=0x7f13bc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681399bd1d57daa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc037070 con 0x7f13c406c1f0 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc02ac50 con 0x7f13c406c1f0 2024-09-15T22:47:03.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c159a640 1 -- 172.21.15.134:0/2368362852 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8001670 con 0x7f13c406c1f0 2024-09-15T22:47:03.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 -- 172.21.15.134:0/2368362852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c406c1f0 msgr2=0x7f13c40cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/2368362852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c406c1f0 0x7f13c40cd010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097a0 tx=0x7f13bc02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 -- 172.21.15.134:0/2368362852 shutdown_connections 2024-09-15T22:47:03.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/2368362852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c406c1f0 0x7f13c40cd010 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 -- 172.21.15.134:0/2368362852 >> 172.21.15.134:0/2368362852 conn(0x7f13c4062cc0 msgr2=0x7f13c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 -- 172.21.15.134:0/2368362852 shutdown_connections 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.511+0000 7f13c8b8d640 1 -- 172.21.15.134:0/2368362852 wait complete. 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.513+0000 7f13c8b8d640 1 Processor -- start 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.513+0000 7f13c8b8d640 1 -- start start 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.513+0000 7f13c8b8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.513+0000 7f13c8b8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f13c406c1f0 0x7f13c4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c4151c50 0x7f13c4153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13c415baa0 con 0x7f13c406be10 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f13c40ce690 con 0x7f13c4151c50 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f13c415bc20 con 0x7f13c406c1f0 2024-09-15T22:47:03.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43806/0 (socket says 172.21.15.134:43806) 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 -- 172.21.15.134:0/1178000555 learned_addr learned my addr 172.21.15.134:0/1178000555 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c1d9b640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f13c406c1f0 0x7f13c4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c2d9d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c4151c50 0x7f13c4153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 -- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f13c406c1f0 msgr2=0x7f13c4152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f13c406c1f0 0x7f13c4152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 -- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c4151c50 msgr2=0x7f13c4153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c4151c50 0x7f13c4153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 -- 172.21.15.134:0/1178000555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c4146110 con 0x7f13c406be10 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c259c640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f13b400c800 tx=0x7f13b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4003b70 con 0x7f13c406be10 2024-09-15T22:47:03.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4003d10 con 0x7f13c406be10 2024-09-15T22:47:03.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c4153630 con 0x7f13c406be10 2024-09-15T22:47:03.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b400aa90 con 0x7f13c406be10 2024-09-15T22:47:03.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.514+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c4153ed0 con 0x7f13c406be10 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.515+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c40b5870 con 0x7f13c406be10 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.516+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f13b400ac30 con 0x7f13c406be10 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.516+0000 7f13b2ffd640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 0x7f13a406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.516+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5737+0+0 (secure 0 0 0) 0x7f13b408bf80 con 0x7f13c406be10 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.516+0000 7f13c1d9b640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 0x7f13a406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.517+0000 7f13c1d9b640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 0x7f13a406ed10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13c40b3e70 tx=0x7f13b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.520+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13b4059de0 con 0x7f13c406be10 2024-09-15T22:47:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.723+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f13c40cd010 con 0x7f13c406be10 2024-09-15T22:47:03.724 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:47:03.723+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:47:03.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.725+0000 7f13b2ffd640 1 -- 172.21.15.134:0/1178000555 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f13b40596e0 con 0x7f13c406be10 2024-09-15T22:47:03.726 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 msgr2=0x7f13a406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 0x7f13a406ed10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13c40b3e70 tx=0x7f13b8009040 comp rx=0 tx=0).stop 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 msgr2=0x7f13c4145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f13b400c800 tx=0x7f13b400ccc0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 shutdown_connections 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13c4151c50 0x7f13c4153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f13c406c1f0 0x7f13c4152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f13a406c850 0x7f13a406ed10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 --2- 172.21.15.134:0/1178000555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c406be10 0x7f13c4145bd0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 >> 172.21.15.134:0/1178000555 conn(0x7f13c4062cc0 msgr2=0x7f13c40b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 shutdown_connections 2024-09-15T22:47:03.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.727+0000 7f13c8b8d640 1 -- 172.21.15.134:0/1178000555 wait complete. 2024-09-15T22:47:03.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:47:03.770 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:47:03.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.844+0000 7f5a9552a640 1 Processor -- start 2024-09-15T22:47:03.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.844+0000 7f5a9552a640 1 -- start start 2024-09-15T22:47:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a9552a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a9006f130 0x7f5a900b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a9552a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9015c370 0x7f5a900ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a9552a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a9015c820 con 0x7f5a90158e50 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a9552a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5a900b43f0 con 0x7f5a9006f130 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a9552a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900b3630 con 0x7f5a9015c370 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a9006f130 0x7f5a900b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a9006f130 0x7f5a900b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43820/0 (socket says 172.21.15.134:43820) 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 -- 172.21.15.134:0/3554289900 learned_addr learned my addr 172.21.15.134:0/3554289900 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a8f7fe640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9015c370 0x7f5a900ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 -- 172.21.15.134:0/3554289900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9015c370 msgr2=0x7f5a900ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9015c370 0x7f5a900ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 -- 172.21.15.134:0/3554289900 >> v1:172.21.15.177:6789/0 conn(0x7f5a90158e50 legacy=0x7f5a9006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.845+0000 7f5a867fc640 1 -- 172.21.15.134:0/3554289900 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a900b3910 con 0x7f5a9006f130 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.846+0000 7f5a867fc640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9006f130 0x7f5a900b5050 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009850 tx=0x7f5a7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d0668400b58e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.846+0000 7f5a8e7fc640 1 -- 172.21.15.134:0/3554289900 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78004030 con 0x7f5a9006f130 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.846+0000 7f5a8e7fc640 1 -- 172.21.15.134:0/3554289900 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a780041d0 con 0x7f5a9006f130 2024-09-15T22:47:03.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.846+0000 7f5a8e7fc640 1 -- 172.21.15.134:0/3554289900 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78003610 con 0x7f5a9006f130 2024-09-15T22:47:03.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 -- 172.21.15.134:0/3554289900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9006f130 msgr2=0x7f5a900b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9006f130 0x7f5a900b5050 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009850 tx=0x7f5a7802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 -- 172.21.15.134:0/3554289900 shutdown_connections 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9015c370 0x7f5a900ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 --2- 172.21.15.134:0/3554289900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a9006f130 0x7f5a900b5050 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 -- 172.21.15.134:0/3554289900 >> 172.21.15.134:0/3554289900 conn(0x7f5a9006bba0 msgr2=0x7f5a9006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 -- 172.21.15.134:0/3554289900 shutdown_connections 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.847+0000 7f5a9552a640 1 -- 172.21.15.134:0/3554289900 wait complete. 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.848+0000 7f5a9552a640 1 Processor -- start 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.848+0000 7f5a9552a640 1 -- start start 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9006f130 0x7f5a9014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9015c370 0x7f5a900ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90159230 con 0x7f5a90158e50 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900b3ed0 con 0x7f5a9015c370 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a9552a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900ce740 con 0x7f5a9006f130 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43826/0 (socket says 172.21.15.134:43826) 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 -- 172.21.15.134:0/2188736501 learned_addr learned my addr 172.21.15.134:0/2188736501 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a8f7fe640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9015c370 0x7f5a900ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a8effd640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9006f130 0x7f5a9014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 -- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9006f130 msgr2=0x7f5a9014bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9006f130 0x7f5a9014bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 -- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9015c370 msgr2=0x7f5a900ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9015c370 0x7f5a900ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.849+0000 7f5a867fc640 1 -- 172.21.15.134:0/2188736501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9015d540 con 0x7f5a90158e50 2024-09-15T22:47:03.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a867fc640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5a78034040 tx=0x7f5a780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78004030 con 0x7f5a90158e50 2024-09-15T22:47:03.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78003e50 con 0x7f5a90158e50 2024-09-15T22:47:03.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9015d820 con 0x7f5a90158e50 2024-09-15T22:47:03.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78006240 con 0x7f5a90158e50 2024-09-15T22:47:03.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.850+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9015dde0 con 0x7f5a90158e50 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.851+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a900ce200 con 0x7f5a90158e50 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.851+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5a780063e0 con 0x7f5a90158e50 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.852+0000 7f5a87fff640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 0x7f5a7006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.852+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5879+0+0 (secure 0 0 0) 0x7f5a780ae710 con 0x7f5a90158e50 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.852+0000 7f5a8effd640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 0x7f5a7006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.852+0000 7f5a8effd640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 0x7f5a7006ed10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5a80004f60 tx=0x7f5a80007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:03.856+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a9015c820 con 0x7f5a90158e50 2024-09-15T22:47:04.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.063+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5a900b0880 con 0x7f5a90158e50 2024-09-15T22:47:04.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.726+0000 7f5a87fff640 1 -- 172.21.15.134:0/2188736501 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7f5a7807c0a0 con 0x7f5a90158e50 2024-09-15T22:47:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.728+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 msgr2=0x7f5a7006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.728+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 0x7f5a7006ed10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5a80004f60 tx=0x7f5a80007e30 comp rx=0 tx=0).stop 2024-09-15T22:47:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.728+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 msgr2=0x7f5a900af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5a78034040 tx=0x7f5a780046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 shutdown_connections 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a9015c370 0x7f5a900ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a7006c850 0x7f5a7006ed10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a90158e50 0x7f5a900af540 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 --2- 172.21.15.134:0/2188736501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a9006f130 0x7f5a9014bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 >> 172.21.15.134:0/2188736501 conn(0x7f5a9006bba0 msgr2=0x7f5a900ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 shutdown_connections 2024-09-15T22:47:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.729+0000 7f5a9552a640 1 -- 172.21.15.134:0/2188736501 wait complete. 2024-09-15T22:47:04.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:47:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.889+0000 7f7fc06fa640 1 Processor -- start 2024-09-15T22:47:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.889+0000 7f7fc06fa640 1 -- start start 2024-09-15T22:47:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fc06fa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb80cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fc06fa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7fb806d4f0 0x7f7fb806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fc06fa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb80b4240 con 0x7f7fb8145d90 2024-09-15T22:47:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fc06fa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb806d080 con 0x7f7fb806d4f0 2024-09-15T22:47:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fc06fa640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb80b4520 con 0x7f7fb80cf5d0 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7fb806d4f0 0x7f7fb806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7fb806d4f0 0x7f7fb806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43828/0 (socket says 172.21.15.134:43828) 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 -- 172.21.15.134:0/2056937783 learned_addr learned my addr 172.21.15.134:0/2056937783 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbdc95640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb80cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 -- 172.21.15.134:0/2056937783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 msgr2=0x7f7fb80cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb80cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 -- 172.21.15.134:0/2056937783 >> v1:172.21.15.177:6789/0 conn(0x7f7fb8145d90 legacy=0x7f7fb80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.890+0000 7f7fbec97640 1 -- 172.21.15.134:0/2056937783 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb80b4800 con 0x7f7fb806d4f0 2024-09-15T22:47:04.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.891+0000 7f7fbec97640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb806d4f0 0x7f7fb806d980 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009e50 tx=0x7f7fb002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9249b95483283186 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.891+0000 7f7fbd494640 1 -- 172.21.15.134:0/2056937783 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0036070 con 0x7f7fb806d4f0 2024-09-15T22:47:04.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.891+0000 7f7fbd494640 1 -- 172.21.15.134:0/2056937783 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0031600 con 0x7f7fb806d4f0 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.891+0000 7f7fbd494640 1 -- 172.21.15.134:0/2056937783 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00319d0 con 0x7f7fb806d4f0 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 -- 172.21.15.134:0/2056937783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb806d4f0 msgr2=0x7f7fb806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb806d4f0 0x7f7fb806d980 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009e50 tx=0x7f7fb002a710 comp rx=0 tx=0).stop 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 -- 172.21.15.134:0/2056937783 shutdown_connections 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb806d4f0 0x7f7fb806d980 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/2056937783 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb80cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 -- 172.21.15.134:0/2056937783 >> 172.21.15.134:0/2056937783 conn(0x7f7fb806bba0 msgr2=0x7f7fb806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 -- 172.21.15.134:0/2056937783 shutdown_connections 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.892+0000 7f7fc06fa640 1 -- 172.21.15.134:0/2056937783 wait complete. 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.893+0000 7f7fc06fa640 1 Processor -- start 2024-09-15T22:47:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.893+0000 7f7fc06fa640 1 -- start start 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 0x7f7fb81f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb81f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb80cd660 con 0x7f7fb8145d90 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb80cff50 con 0x7f7fb806d4f0 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fc06fa640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb80b5610 con 0x7f7fb80cf5d0 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43842/0 (socket says 172.21.15.134:43842) 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 -- 172.21.15.134:0/3656733262 learned_addr learned my addr 172.21.15.134:0/3656733262 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbdc95640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb81f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbe496640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 0x7f7fb81f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 -- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 msgr2=0x7f7fb81f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb81f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 -- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 msgr2=0x7f7fb81f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 0x7f7fb81f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 -- 172.21.15.134:0/3656733262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb81f31e0 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbe496640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 0x7f7fb81f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.894+0000 7f7fbec97640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034040 tx=0x7f7fb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.895+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0036050 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.895+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0042070 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.895+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb81f3520 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.895+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0009510 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.895+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb81f3d60 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.896+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb8146170 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.896+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f7fb0007bf0 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.896+0000 7f7faeffd640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 0x7f7f9c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.897+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5879+0+0 (secure 0 0 0) 0x7f7fb00acdb0 con 0x7f7fb8145d90 2024-09-15T22:47:04.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.897+0000 7f7fbe496640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 0x7f7f9c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.897+0000 7f7fbe496640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 0x7f7f9c06ed10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001660 tx=0x7f7fb4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:04.901+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fb81f3520 con 0x7f7fb8145d90 2024-09-15T22:47:05.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:05.067+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7fb81f3f30 con 0x7f7fb8145d90 2024-09-15T22:47:06.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.016+0000 7f7faeffd640 1 -- 172.21.15.134:0/3656733262 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) ==== 181+0+0 (secure 0 0 0) 0x7f7fb007aaf0 con 0x7f7fb8145d90 2024-09-15T22:47:06.019 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 msgr2=0x7f7f9c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 0x7f7f9c06ed10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001660 tx=0x7f7fb4009040 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 msgr2=0x7f7fb80ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034040 tx=0x7f7fb0004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 shutdown_connections 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f9c06c850 0x7f7f9c06ed10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fb8145d90 0x7f7fb80ae400 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fb80cf5d0 0x7f7fb81f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 --2- 172.21.15.134:0/3656733262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb806d4f0 0x7f7fb81f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 >> 172.21.15.134:0/3656733262 conn(0x7f7fb806bba0 msgr2=0x7f7fb8160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:06.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 shutdown_connections 2024-09-15T22:47:06.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.020+0000 7f7fc06fa640 1 -- 172.21.15.134:0/3656733262 wait complete. 2024-09-15T22:47:06.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:47:06.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.143+0000 7f998fd11640 1 Processor -- start 2024-09-15T22:47:06.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 -- start start 2024-09-15T22:47:06.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f99880d3990 0x7f9988162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880b6b00 con 0x7f99880b3b00 2024-09-15T22:47:06.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f99880d24f0 con 0x7f99880d3990 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.144+0000 7f998fd11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99880d20e0 con 0x7f99880b61e0 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43376/0 (socket says 172.21.15.134:43376) 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 -- 172.21.15.134:0/1204549318 learned_addr learned my addr 172.21.15.134:0/1204549318 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998e2ae640 1 --2- 172.21.15.134:0/1204549318 >> v2:172.21.15.177:3300/0 conn(0x7f99880d3990 0x7f9988162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 -- 172.21.15.134:0/1204549318 >> v2:172.21.15.177:3300/0 conn(0x7f99880d3990 msgr2=0x7f9988162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 --2- 172.21.15.134:0/1204549318 >> v2:172.21.15.177:3300/0 conn(0x7f99880d3990 0x7f9988162ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 -- 172.21.15.134:0/1204549318 >> v1:172.21.15.177:6789/0 conn(0x7f99880b3b00 legacy=0x7f99881625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.145+0000 7f998daad640 1 -- 172.21.15.134:0/1204549318 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99880cfa70 con 0x7f99880b61e0 2024-09-15T22:47:06.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.146+0000 7f998daad640 1 --2- 172.21.15.134:0/1204549318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9984009870 tx=0x7f998402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf2f99fe3f92e26e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:06.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.146+0000 7f998caab640 1 -- 172.21.15.134:0/1204549318 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984037070 con 0x7f99880b61e0 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.146+0000 7f998caab640 1 -- 172.21.15.134:0/1204549318 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9984032440 con 0x7f99880b61e0 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.146+0000 7f998caab640 1 -- 172.21.15.134:0/1204549318 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984032810 con 0x7f99880b61e0 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 -- 172.21.15.134:0/1204549318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 msgr2=0x7f99880b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 --2- 172.21.15.134:0/1204549318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9984009870 tx=0x7f998402a130 comp rx=0 tx=0).stop 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 -- 172.21.15.134:0/1204549318 shutdown_connections 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 --2- 172.21.15.134:0/1204549318 >> v2:172.21.15.177:3300/0 conn(0x7f99880d3990 0x7f9988162ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 --2- 172.21.15.134:0/1204549318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f99880b65c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 -- 172.21.15.134:0/1204549318 >> 172.21.15.134:0/1204549318 conn(0x7f99880d11e0 msgr2=0x7f99880d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:06.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 -- 172.21.15.134:0/1204549318 shutdown_connections 2024-09-15T22:47:06.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.147+0000 7f998fd11640 1 -- 172.21.15.134:0/1204549318 wait complete. 2024-09-15T22:47:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.148+0000 7f998fd11640 1 Processor -- start 2024-09-15T22:47:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.148+0000 7f998fd11640 1 -- start start 2024-09-15T22:47:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f998814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99880d3990 0x7f99880ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f998815edc0 con 0x7f99880b3b00 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99880d0030 con 0x7f99880d3990 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9988151c20 con 0x7f99880b61e0 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43854/0 (socket says 172.21.15.134:43854) 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 -- 172.21.15.134:0/2562200770 learned_addr learned my addr 172.21.15.134:0/2562200770 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998d2ac640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f998814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998e2ae640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99880d3990 0x7f99880ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 -- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 msgr2=0x7f998814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f998814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 -- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99880d3990 msgr2=0x7f99880ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:06.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99880d3990 0x7f99880ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 -- 172.21.15.134:0/2562200770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9988151010 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998daad640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9984000c00 tx=0x7f99840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984041020 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998403d620 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984037040 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.149+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99881512f0 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.150+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99881518b0 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.150+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99880d1d00 con 0x7f99880b3b00 2024-09-15T22:47:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.151+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f9984044020 con 0x7f99880b3b00 2024-09-15T22:47:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.151+0000 7f997e7fc640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 0x7f996c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.152+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5413+0+0 (secure 0 0 0) 0x7f99840ac370 con 0x7f99880b3b00 2024-09-15T22:47:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.152+0000 7f998d2ac640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 0x7f996c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.152+0000 7f998d2ac640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 0x7f996c06ed10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f99880b4300 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.156+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f998404b030 con 0x7f99880b3b00 2024-09-15T22:47:06.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:06.325+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99880d5550 con 0x7f99880b3b00 2024-09-15T22:47:07.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.018+0000 7f997e7fc640 1 -- 172.21.15.134:0/2562200770 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v125) ==== 169+0+0 (secure 0 0 0) 0x7f9984079d50 con 0x7f99880b3b00 2024-09-15T22:47:07.020 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 msgr2=0x7f996c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 0x7f996c06ed10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f99880b4300 tx=0x7f9978009040 comp rx=0 tx=0).stop 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 msgr2=0x7f99881520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9984000c00 tx=0x7f99840046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 shutdown_connections 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99880d3990 0x7f99880ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99880b61e0 0x7f998814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f996c06c850 0x7f996c06ed10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 --2- 172.21.15.134:0/2562200770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99880b3b00 0x7f99881520b0 secure :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9984000c00 tx=0x7f99840046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.022+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 >> 172.21.15.134:0/2562200770 conn(0x7f99880d11e0 msgr2=0x7f99880d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:07.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.023+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 shutdown_connections 2024-09-15T22:47:07.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.023+0000 7f998fd11640 1 -- 172.21.15.134:0/2562200770 wait complete. 2024-09-15T22:47:07.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:47:07.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.142+0000 7f347ca37640 1 Processor -- start 2024-09-15T22:47:07.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.142+0000 7f347ca37640 1 -- start start 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347ca37640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f347815b090 0x7f34780b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347ca37640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 0x7f347815b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347ca37640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3478071de0 con 0x7f347815b9b0 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347ca37640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f34780720c0 con 0x7f347815b090 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347ca37640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f34780723a0 con 0x7f34780715b0 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f347815b090 0x7f34780b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f3476d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f347815b9b0 0x7f347806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33700/0 (socket says 172.21.15.134:33700) 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f347659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f347815b090 0x7f34780b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33244/0 (socket says 172.21.15.134:33244) 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.143+0000 7f3476d9d640 1 -- 172.21.15.134:0/1994321286 learned_addr learned my addr 172.21.15.134:0/1994321286 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f346dd9b640 1 --2- 172.21.15.134:0/1994321286 >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 0x7f347815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f347659c640 1 -- 172.21.15.134:0/1994321286 >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 msgr2=0x7f347815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f3475d9b640 1 -- 172.21.15.134:0/1994321286 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373975624 0 0) 0x7f3478071de0 con 0x7f347815b9b0 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f347659c640 1 --2- 172.21.15.134:0/1994321286 >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 0x7f347815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f347659c640 1 -- 172.21.15.134:0/1994321286 >> v1:172.21.15.134:6789/0 conn(0x7f347815b9b0 legacy=0x7f347806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f347659c640 1 -- 172.21.15.134:0/1994321286 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3478072680 con 0x7f347815b090 2024-09-15T22:47:07.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f346dd9b640 1 --2- 172.21.15.134:0/1994321286 >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 0x7f347815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.144+0000 7f347659c640 1 --2- 172.21.15.134:0/1994321286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b090 0x7f34780b5420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f34780696b0 tx=0x7f346802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3015607ed9f468 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f3475d9b640 1 -- 172.21.15.134:0/1994321286 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468037070 con 0x7f347815b090 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f3475d9b640 1 -- 172.21.15.134:0/1994321286 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3468032440 con 0x7f347815b090 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f3475d9b640 1 -- 172.21.15.134:0/1994321286 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468032810 con 0x7f347815b090 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 -- 172.21.15.134:0/1994321286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b090 msgr2=0x7f34780b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 --2- 172.21.15.134:0/1994321286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b090 0x7f34780b5420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f34780696b0 tx=0x7f346802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 -- 172.21.15.134:0/1994321286 shutdown_connections 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 --2- 172.21.15.134:0/1994321286 >> v2:172.21.15.177:3300/0 conn(0x7f34780715b0 0x7f347815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 --2- 172.21.15.134:0/1994321286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b090 0x7f34780b5420 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 -- 172.21.15.134:0/1994321286 >> 172.21.15.134:0/1994321286 conn(0x7f347806bba0 msgr2=0x7f347806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 -- 172.21.15.134:0/1994321286 shutdown_connections 2024-09-15T22:47:07.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.145+0000 7f347ca37640 1 -- 172.21.15.134:0/1994321286 wait complete. 2024-09-15T22:47:07.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 Processor -- start 2024-09-15T22:47:07.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 -- start start 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34780715b0 0x7f3478158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347815b090 0x7f34781483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34780719c0 con 0x7f347815b9b0 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f347815bdc0 con 0x7f347815b090 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f347ca37640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3478071b40 con 0x7f34780715b0 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.147+0000 7f3476d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33252/0 (socket says 172.21.15.134:33252) 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 -- 172.21.15.134:0/2866484971 learned_addr learned my addr 172.21.15.134:0/2866484971 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f346dd9b640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347815b090 0x7f34781483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f347659c640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34780715b0 0x7f3478158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 -- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34780715b0 msgr2=0x7f3478158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34780715b0 0x7f3478158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 -- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347815b090 msgr2=0x7f34781483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347815b090 0x7f34781483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 -- 172.21.15.134:0/2866484971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3478148d90 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f3476d9d640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f347000c7a0 tx=0x7f347000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470018070 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347000a640 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3478149070 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347000aab0 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.148+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3478149630 con 0x7f347815b9b0 2024-09-15T22:47:07.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.149+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3478069b00 con 0x7f347815b9b0 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.150+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f347001b070 con 0x7f347815b9b0 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.150+0000 7f346f7fe640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 0x7f345806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.150+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7f347008b2a0 con 0x7f347815b9b0 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.150+0000 7f347659c640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 0x7f345806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.151+0000 7f347659c640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 0x7f345806ed10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3468034000 tx=0x7f346802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.154+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3478069b00 con 0x7f347815b9b0 2024-09-15T22:47:07.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.328+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f34780ac690 con 0x7f347815b9b0 2024-09-15T22:47:07.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.331+0000 7f346f7fe640 1 -- 172.21.15.134:0/2866484971 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f34700593d0 con 0x7f347815b9b0 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 msgr2=0x7f345806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 0x7f345806ed10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3468034000 tx=0x7f346802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 msgr2=0x7f34780aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f347000c7a0 tx=0x7f347000cc60 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 shutdown_connections 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f345806c850 0x7f345806ed10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347815b9b0 0x7f34780aa4d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347815b090 0x7f34781483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 --2- 172.21.15.134:0/2866484971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34780715b0 0x7f3478158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 >> 172.21.15.134:0/2866484971 conn(0x7f347806bba0 msgr2=0x7f347806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 shutdown_connections 2024-09-15T22:47:07.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.333+0000 7f347ca37640 1 -- 172.21.15.134:0/2866484971 wait complete. 2024-09-15T22:47:07.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-15T22:47:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.443+0000 7fb24845e640 1 Processor -- start 2024-09-15T22:47:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.443+0000 7fb24845e640 1 -- start start 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb24845e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 0x7fb2400cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb24845e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb240151c50 0x7fb24015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb24845e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2400cd5f0 con 0x7fb24006c1f0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb24845e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb2400cd8d0 con 0x7fb240151c50 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb24845e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2400cdbb0 con 0x7fb24006be10 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2459f9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb24006c1f0 0x7fb240151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33702/0 (socket says 172.21.15.134:33702) 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2459f9640 1 -- 172.21.15.134:0/1674697599 learned_addr learned my addr 172.21.15.134:0/1674697599 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2461fa640 1 --2- 172.21.15.134:0/1674697599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 0x7fb2400cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2469fb640 1 --2- 172.21.15.134:0/1674697599 >> v2:172.21.15.177:3300/0 conn(0x7fb240151c50 0x7fb24015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080625104 0 0) 0x7fb2400cd5f0 con 0x7fb24006c1f0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c003520 con 0x7fb24006c1f0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229689340 0 0) 0x7fb22c003520 con 0x7fb24006c1f0 2024-09-15T22:47:07.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2461fa640 1 -- 172.21.15.134:0/1674697599 >> v2:172.21.15.177:3300/0 conn(0x7fb240151c50 msgr2=0x7fb24015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:07.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2461fa640 1 --2- 172.21.15.134:0/1674697599 >> v2:172.21.15.177:3300/0 conn(0x7fb240151c50 0x7fb24015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.444+0000 7fb2461fa640 1 -- 172.21.15.134:0/1674697599 >> v1:172.21.15.134:6789/0 conn(0x7fb24006c1f0 legacy=0x7fb240151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.445+0000 7fb2461fa640 1 -- 172.21.15.134:0/1674697599 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400cde90 con 0x7fb24006be10 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.445+0000 7fb2461fa640 1 --2- 172.21.15.134:0/1674697599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 0x7fb2400cd010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a940 tx=0x7fb23c02b4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeefbcef3f003b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.445+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230001670 con 0x7fb24006be10 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.445+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c030510 con 0x7fb24006be10 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.445+0000 7fb2451f8640 1 -- 172.21.15.134:0/1674697599 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00b040 con 0x7fb24006be10 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 -- 172.21.15.134:0/1674697599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 msgr2=0x7fb2400cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 --2- 172.21.15.134:0/1674697599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 0x7fb2400cd010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a940 tx=0x7fb23c02b4d0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 -- 172.21.15.134:0/1674697599 shutdown_connections 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 --2- 172.21.15.134:0/1674697599 >> v2:172.21.15.177:3300/0 conn(0x7fb240151c50 0x7fb24015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 --2- 172.21.15.134:0/1674697599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006be10 0x7fb2400cd010 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 -- 172.21.15.134:0/1674697599 >> 172.21.15.134:0/1674697599 conn(0x7fb240062cc0 msgr2=0x7fb24006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:07.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 -- 172.21.15.134:0/1674697599 shutdown_connections 2024-09-15T22:47:07.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.446+0000 7fb24845e640 1 -- 172.21.15.134:0/1674697599 wait complete. 2024-09-15T22:47:07.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.447+0000 7fb24845e640 1 Processor -- start 2024-09-15T22:47:07.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.447+0000 7fb24845e640 1 -- start start 2024-09-15T22:47:07.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 0x7fb2400b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb240151c50 0x7fb2400b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400d0310 con 0x7fb24006be10 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400ce690 con 0x7fb240151c50 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb24845e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2400d0490 con 0x7fb24006c1f0 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33256/0 (socket says 172.21.15.134:33256) 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 -- 172.21.15.134:0/2873358093 learned_addr learned my addr 172.21.15.134:0/2873358093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2459f9640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 0x7fb2400b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2469fb640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb240151c50 0x7fb2400b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 -- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 msgr2=0x7fb2400b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 0x7fb2400b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 -- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb240151c50 msgr2=0x7fb2400b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:07.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb240151c50 0x7fb2400b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2461fa640 1 -- 172.21.15.134:0/2873358093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb240072cc0 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.448+0000 7fb2459f9640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 0x7fb2400b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb2461fa640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a940 tx=0x7fb23c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c048070 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c03bc90 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24013e6d0 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c006e10 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.449+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24013ec90 con 0x7fb24006be10 2024-09-15T22:47:07.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.450+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24013e4e0 con 0x7fb24006be10 2024-09-15T22:47:07.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.450+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fb23c04b070 con 0x7fb24006be10 2024-09-15T22:47:07.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.451+0000 7fb236ffd640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 0x7fb22406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:07.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.451+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7fb23c0ae050 con 0x7fb24006be10 2024-09-15T22:47:07.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.451+0000 7fb2459f9640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 0x7fb22406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:07.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.452+0000 7fb2459f9640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 0x7fb22406ed10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb24014fab0 tx=0x7fb230009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:07.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.455+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb23c040070 con 0x7fb24006be10 2024-09-15T22:47:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:07.683+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fb2400d0840 con 0x7fb24006be10 2024-09-15T22:47:08.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.031+0000 7fb236ffd640 1 -- 172.21.15.134:0/2873358093 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v318) ==== 148+0+0 (secure 0 0 0) 0x7fb23c07c100 con 0x7fb24006be10 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 msgr2=0x7fb22406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 0x7fb22406ed10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb24014fab0 tx=0x7fb230009040 comp rx=0 tx=0).stop 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 msgr2=0x7fb2401ef980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a940 tx=0x7fb23c004730 comp rx=0 tx=0).stop 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 shutdown_connections 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb240151c50 0x7fb2400b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24006c1f0 0x7fb2400b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22406c850 0x7fb22406ed10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 --2- 172.21.15.134:0/2873358093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24006be10 0x7fb2401ef980 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 >> 172.21.15.134:0/2873358093 conn(0x7fb240062cc0 msgr2=0x7fb2400b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 shutdown_connections 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.034+0000 7fb24845e640 1 -- 172.21.15.134:0/2873358093 wait complete. 2024-09-15T22:47:08.046 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-15T22:47:08.047 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:47:08.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:08.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.144+0000 7fc14bf98640 1 Processor -- start 2024-09-15T22:47:08.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.144+0000 7fc14bf98640 1 -- start start 2024-09-15T22:47:08.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14bf98640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc1441606b0 0x7fc1440cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14bf98640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 0x7fc1440b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14bf98640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc144160bb0 con 0x7fc14415f8e0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14bf98640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc144160e90 con 0x7fc1441606b0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14bf98640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc1440b3f20 con 0x7fc1440b3550 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149d34640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc14415f8e0 0x7fc14415ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33710/0 (socket says 172.21.15.134:33710) 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149d34640 1 -- 172.21.15.134:0/4067121246 learned_addr learned my addr 172.21.15.134:0/4067121246 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149533640 1 --2- 172.21.15.134:0/4067121246 >> v2:172.21.15.134:3300/0 conn(0x7fc1441606b0 0x7fc1440cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc148d32640 1 -- 172.21.15.134:0/4067121246 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970844320 0 0) 0x7fc144160bb0 con 0x7fc14415f8e0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc148d32640 1 -- 172.21.15.134:0/4067121246 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc130003520 con 0x7fc14415f8e0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14a535640 1 --2- 172.21.15.134:0/4067121246 >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 0x7fc1440b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149533640 1 -- 172.21.15.134:0/4067121246 >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 msgr2=0x7fc1440b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149533640 1 --2- 172.21.15.134:0/4067121246 >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 0x7fc1440b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149533640 1 -- 172.21.15.134:0/4067121246 >> v1:172.21.15.134:6789/0 conn(0x7fc14415f8e0 legacy=0x7fc14415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc149533640 1 -- 172.21.15.134:0/4067121246 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1440ce170 con 0x7fc1441606b0 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.145+0000 7fc14a535640 1 --2- 172.21.15.134:0/4067121246 >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 0x7fc1440b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.146+0000 7fc149533640 1 --2- 172.21.15.134:0/4067121246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1441606b0 0x7fc1440cec50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc1440d1550 tx=0x7fc13402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a793d3b9168e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.146+0000 7fc148d32640 1 -- 172.21.15.134:0/4067121246 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134037070 con 0x7fc1441606b0 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.146+0000 7fc148d32640 1 -- 172.21.15.134:0/4067121246 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc134032440 con 0x7fc1441606b0 2024-09-15T22:47:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.146+0000 7fc148d32640 1 -- 172.21.15.134:0/4067121246 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13402ae60 con 0x7fc1441606b0 2024-09-15T22:47:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 -- 172.21.15.134:0/4067121246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1441606b0 msgr2=0x7fc1440cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 --2- 172.21.15.134:0/4067121246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1441606b0 0x7fc1440cec50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc1440d1550 tx=0x7fc13402a110 comp rx=0 tx=0).stop 2024-09-15T22:47:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 -- 172.21.15.134:0/4067121246 shutdown_connections 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 --2- 172.21.15.134:0/4067121246 >> v2:172.21.15.177:3300/0 conn(0x7fc1440b3550 0x7fc1440b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 --2- 172.21.15.134:0/4067121246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1441606b0 0x7fc1440cec50 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 -- 172.21.15.134:0/4067121246 >> 172.21.15.134:0/4067121246 conn(0x7fc14406ce90 msgr2=0x7fc14406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 -- 172.21.15.134:0/4067121246 shutdown_connections 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.147+0000 7fc14bf98640 1 -- 172.21.15.134:0/4067121246 wait complete. 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.148+0000 7fc14bf98640 1 Processor -- start 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.148+0000 7fc14bf98640 1 -- start start 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 0x7fc1441f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1441606b0 0x7fc14415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc14415fcc0 con 0x7fc14415f8e0 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1440ce730 con 0x7fc1441606b0 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14bf98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc1440b59e0 con 0x7fc1440b3550 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33282/0 (socket says 172.21.15.134:33282) 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 -- 172.21.15.134:0/2482523656 learned_addr learned my addr 172.21.15.134:0/2482523656 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149d34640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 0x7fc1441f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc14a535640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1441606b0 0x7fc14415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 -- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 msgr2=0x7fc1441f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 0x7fc1441f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 -- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1441606b0 msgr2=0x7fc14415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1441606b0 0x7fc14415bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 -- 172.21.15.134:0/2482523656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1441f4580 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149d34640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 0x7fc1441f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.149+0000 7fc149533640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fc134000c00 tx=0x7fc1340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.150+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134037040 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.150+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc134042070 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.150+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1441f48c0 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.150+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134030960 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.150+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1440ae980 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.151+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1440b39e0 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.151+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fc134030b00 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.152+0000 7fc13a7fc640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 0x7fc12806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.152+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7fc1340ac530 con 0x7fc14415f8e0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.152+0000 7fc149d34640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 0x7fc12806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.152+0000 7fc149d34640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 0x7fc12806ed10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc140005c00 tx=0x7fc140009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.156+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1441f48c0 con 0x7fc14415f8e0 2024-09-15T22:47:08.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.319+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc144160490 con 0x7fc14415f8e0 2024-09-15T22:47:08.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.320+0000 7fc13a7fc640 1 -- 172.21.15.134:0/2482523656 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+13169 (secure 0 0 0) 0x7fc13407a810 con 0x7fc14415f8e0 2024-09-15T22:47:08.321 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:08.321 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":125,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:07.017762+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1968724028":"2024-09-16T22:47:03.724513+0000","172.21.15.134:6834/1968724028":"2024-09-16T22:47:03.724513+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:08.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 msgr2=0x7fc12806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 0x7fc12806ed10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc140005c00 tx=0x7fc140009040 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 msgr2=0x7fc144154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fc134000c00 tx=0x7fc1340046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 shutdown_connections 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1441606b0 0x7fc14415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc12806c850 0x7fc12806ed10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc14415f8e0 0x7fc144154e10 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 --2- 172.21.15.134:0/2482523656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1440b3550 0x7fc1441f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 >> 172.21.15.134:0/2482523656 conn(0x7fc14406ce90 msgr2=0x7fc1440b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 shutdown_connections 2024-09-15T22:47:08.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.322+0000 7fc14bf98640 1 -- 172.21.15.134:0/2482523656 wait complete. 2024-09-15T22:47:08.334 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:47:08.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:47:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.435+0000 7f32ab30a640 1 Processor -- start 2024-09-15T22:47:08.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.435+0000 7f32ab30a640 1 -- start start 2024-09-15T22:47:08.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32ab30a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 0x7f32a40ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32ab30a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32a406dda0 0x7f32a406e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32ab30a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a415ccb0 con 0x7f32a40cfd90 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32ab30a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f32a415cf90 con 0x7f32a406dda0 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32ab30a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f32a415d270 con 0x7f32a40b5f50 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32a406dda0 0x7f32a406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32a406dda0 0x7f32a406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33292/0 (socket says 172.21.15.134:33292) 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 -- 172.21.15.134:0/3635359674 learned_addr learned my addr 172.21.15.134:0/3635359674 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a88a5640 1 --1- 172.21.15.134:0/3635359674 >> v1:172.21.15.134:6789/0 conn(0x7f32a40cfd90 0x7f32a40d0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33718/0 (socket says 172.21.15.134:33718) 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a90a6640 1 --2- 172.21.15.134:0/3635359674 >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 0x7f32a40ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 -- 172.21.15.134:0/3635359674 >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 msgr2=0x7f32a40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 --2- 172.21.15.134:0/3635359674 >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 0x7f32a40ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 -- 172.21.15.134:0/3635359674 >> v1:172.21.15.134:6789/0 conn(0x7f32a40cfd90 legacy=0x7f32a40d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f329bfff640 1 -- 172.21.15.134:0/3635359674 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551844051 0 0) 0x7f32a415ccb0 con 0x7f32a40cfd90 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a98a7640 1 -- 172.21.15.134:0/3635359674 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a415d550 con 0x7f32a406dda0 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.436+0000 7f32a90a6640 1 --2- 172.21.15.134:0/3635359674 >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 0x7f32a40ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f32a98a7640 1 --2- 172.21.15.134:0/3635359674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a406dda0 0x7f32a406e210 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f32a4075b90 tx=0x7f329c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540de80ce9c51793 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f329bfff640 1 -- 172.21.15.134:0/3635359674 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c036070 con 0x7f32a406dda0 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f329bfff640 1 -- 172.21.15.134:0/3635359674 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c031600 con 0x7f32a406dda0 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f329bfff640 1 -- 172.21.15.134:0/3635359674 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c0319d0 con 0x7f32a406dda0 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f32ab30a640 1 -- 172.21.15.134:0/3635359674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a406dda0 msgr2=0x7f32a406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.437+0000 7f32ab30a640 1 --2- 172.21.15.134:0/3635359674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a406dda0 0x7f32a406e210 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f32a4075b90 tx=0x7f329c02a610 comp rx=0 tx=0).stop 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 -- 172.21.15.134:0/3635359674 shutdown_connections 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 --2- 172.21.15.134:0/3635359674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a406dda0 0x7f32a406e210 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 --2- 172.21.15.134:0/3635359674 >> v2:172.21.15.177:3300/0 conn(0x7f32a40b5f50 0x7f32a40ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 -- 172.21.15.134:0/3635359674 >> 172.21.15.134:0/3635359674 conn(0x7f32a406bba0 msgr2=0x7f32a406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 -- 172.21.15.134:0/3635359674 shutdown_connections 2024-09-15T22:47:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.438+0000 7f32ab30a640 1 -- 172.21.15.134:0/3635359674 wait complete. 2024-09-15T22:47:08.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.439+0000 7f32ab30a640 1 Processor -- start 2024-09-15T22:47:08.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.439+0000 7f32ab30a640 1 -- start start 2024-09-15T22:47:08.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.439+0000 7f32ab30a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a406dda0 0x7f32a4149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a40b5f50 0x7f32a4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40ce820 con 0x7f32a40cfd90 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32a415c970 con 0x7f32a406dda0 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40cd970 con 0x7f32a40b5f50 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33302/0 (socket says 172.21.15.134:33302) 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 -- 172.21.15.134:0/930979538 learned_addr learned my addr 172.21.15.134:0/930979538 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a90a6640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a406dda0 0x7f32a4149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a88a5640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a40b5f50 0x7f32a4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 -- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a40b5f50 msgr2=0x7f32a4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a40b5f50 0x7f32a4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 -- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a406dda0 msgr2=0x7f32a4149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a406dda0 0x7f32a4149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 -- 172.21.15.134:0/930979538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a4071fe0 con 0x7f32a40cfd90 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32a98a7640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f329c009f40 tx=0x7f329c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c036050 con 0x7f32a40cfd90 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c042070 con 0x7f32a40cfd90 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a4072850 con 0x7f32a40cfd90 2024-09-15T22:47:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.440+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c007bd0 con 0x7f32a40cfd90 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.441+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a4072e10 con 0x7f32a40cfd90 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.441+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a40ce2e0 con 0x7f32a40cfd90 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.442+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f329c047460 con 0x7f32a40cfd90 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.442+0000 7f3299ffb640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 0x7f328806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.443+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7f329c0aca40 con 0x7f32a40cfd90 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.443+0000 7f32a90a6640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 0x7f328806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.443+0000 7f32a90a6640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 0x7f328806ed10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32a0006fd0 tx=0x7f32a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.447+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f329c07a530 con 0x7f32a40cfd90 2024-09-15T22:47:08.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.610+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32a4072500 con 0x7f32a40cfd90 2024-09-15T22:47:08.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.610+0000 7f3299ffb640 1 -- 172.21.15.134:0/930979538 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) ==== 93+0+10 (secure 0 0 0) 0x7f329c07e830 con 0x7f32a40cfd90 2024-09-15T22:47:08.612 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:47:08.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 msgr2=0x7f328806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 0x7f328806ed10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32a0006fd0 tx=0x7f32a0008040 comp rx=0 tx=0).stop 2024-09-15T22:47:08.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 msgr2=0x7f32a4159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f329c009f40 tx=0x7f329c004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:08.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 shutdown_connections 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f328806c850 0x7f328806ed10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a40cfd90 0x7f32a4159c40 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a40b5f50 0x7f32a4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 --2- 172.21.15.134:0/930979538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a406dda0 0x7f32a4149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 >> 172.21.15.134:0/930979538 conn(0x7f32a406bba0 msgr2=0x7f32a415f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 shutdown_connections 2024-09-15T22:47:08.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.613+0000 7f32ab30a640 1 -- 172.21.15.134:0/930979538 wait complete. 2024-09-15T22:47:08.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-15T22:47:08.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.722+0000 7f5adf8d2640 1 Processor -- start 2024-09-15T22:47:08.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 -- start start 2024-09-15T22:47:08.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ad80aff30 0x7f5ad80b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad80ce150 con 0x7f5ad80b65c0 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad80b08a0 con 0x7f5ad80aff30 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.723+0000 7f5adf8d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80ce430 con 0x7f5ad8156880 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ad80aff30 0x7f5ad80b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ad80aff30 0x7f5ad80b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33308/0 (socket says 172.21.15.134:33308) 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 -- 172.21.15.134:0/2010684519 learned_addr learned my addr 172.21.15.134:0/2010684519 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5add66e640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 -- 172.21.15.134:0/2010684519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 msgr2=0x7f5ad80cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad80cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 -- 172.21.15.134:0/2010684519 >> v1:172.21.15.177:6789/0 conn(0x7f5ad80b65c0 legacy=0x7f5ad8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.724+0000 7f5adde6f640 1 -- 172.21.15.134:0/2010684519 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad815ff30 con 0x7f5ad80aff30 2024-09-15T22:47:08.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adde6f640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad80b0360 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e50 tx=0x7f5ac802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7beb23ef27d17d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5ad7fff640 1 -- 172.21.15.134:0/2010684519 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8036070 con 0x7f5ad80aff30 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5ad7fff640 1 -- 172.21.15.134:0/2010684519 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8031600 con 0x7f5ad80aff30 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5ad7fff640 1 -- 172.21.15.134:0/2010684519 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80319d0 con 0x7f5ad80aff30 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 -- 172.21.15.134:0/2010684519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 msgr2=0x7f5ad80b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad80b0360 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e50 tx=0x7f5ac802a630 comp rx=0 tx=0).stop 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 -- 172.21.15.134:0/2010684519 shutdown_connections 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad80b0360 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/2010684519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad80cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 -- 172.21.15.134:0/2010684519 >> 172.21.15.134:0/2010684519 conn(0x7f5ad806cae0 msgr2=0x7f5ad806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 -- 172.21.15.134:0/2010684519 shutdown_connections 2024-09-15T22:47:08.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.725+0000 7f5adf8d2640 1 -- 172.21.15.134:0/2010684519 wait complete. 2024-09-15T22:47:08.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.726+0000 7f5adf8d2640 1 Processor -- start 2024-09-15T22:47:08.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.726+0000 7f5adf8d2640 1 -- start start 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad80b65c0 0x7f5ad8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad81e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b6a00 con 0x7f5ad80aff30 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8156c60 con 0x7f5ad80b65c0 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adf8d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80ce710 con 0x7f5ad8156880 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5add66e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5add66e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33324/0 (socket says 172.21.15.134:33324) 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5add66e640 1 -- 172.21.15.134:0/548697511 learned_addr learned my addr 172.21.15.134:0/548697511 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adde6f640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad81e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.727+0000 7f5adce6d640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad80b65c0 0x7f5ad8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 -- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 msgr2=0x7f5ad81e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad81e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 -- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad80b65c0 msgr2=0x7f5ad8154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad80b65c0 0x7f5ad8154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 -- 172.21.15.134:0/548697511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad8151950 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5add66e640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000d5f0 tx=0x7f5ad000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00125f0 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad0019070 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad8151c30 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00129d0 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.728+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad81f2100 con 0x7f5ad80aff30 2024-09-15T22:47:08.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.729+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad80b0360 con 0x7f5ad80aff30 2024-09-15T22:47:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.730+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5ad0012b70 con 0x7f5ad80aff30 2024-09-15T22:47:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.730+0000 7f5ad5ffb640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 0x7f5ac406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.730+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7f5ad008be20 con 0x7f5ad80aff30 2024-09-15T22:47:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.730+0000 7f5adce6d640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 0x7f5ac406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.731+0000 7f5adce6d640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 0x7f5ac406ed40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8155730 tx=0x7f5acc007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.735+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ad0059990 con 0x7f5ad80aff30 2024-09-15T22:47:08.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:08.963+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f5ad80cd1d0 con 0x7f5ad80aff30 2024-09-15T22:47:09.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.032+0000 7f5ad5ffb640 1 -- 172.21.15.134:0/548697511 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v319) ==== 154+0+0 (secure 0 0 0) 0x7f5ad005ee20 con 0x7f5ad80aff30 2024-09-15T22:47:09.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 msgr2=0x7f5ac406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 0x7f5ac406ed40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8155730 tx=0x7f5acc007e30 comp rx=0 tx=0).stop 2024-09-15T22:47:09.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 msgr2=0x7f5ad8151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000d5f0 tx=0x7f5ad000dab0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 shutdown_connections 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ad8156880 0x7f5ad81e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad80b65c0 0x7f5ad8154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ac406c880 0x7f5ac406ed40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 --2- 172.21.15.134:0/548697511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80aff30 0x7f5ad8151100 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 >> 172.21.15.134:0/548697511 conn(0x7f5ad806cae0 msgr2=0x7f5ad80b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 shutdown_connections 2024-09-15T22:47:09.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.034+0000 7f5adf8d2640 1 -- 172.21.15.134:0/548697511 wait complete. 2024-09-15T22:47:09.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:47:09.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.147+0000 7f56e36b7640 1 Processor -- start 2024-09-15T22:47:09.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.147+0000 7f56e36b7640 1 -- start start 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e36b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56dc15d790 0x7f56dc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e36b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56dc06d700 con 0x7f56dc15d3b0 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e36b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56dc0cde80 con 0x7f56dc0cd3b0 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e36b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc06da30 con 0x7f56dc15d790 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e1453640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f56dc15d3b0 0x7f56dc071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33728/0 (socket says 172.21.15.134:33728) 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e1453640 1 -- 172.21.15.134:0/683238572 learned_addr learned my addr 172.21.15.134:0/683238572 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473399553 0 0) 0x7f56dc06d700 con 0x7f56dc15d3b0 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c8003520 con 0x7f56dc15d3b0 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56e0c52640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56dc15d790 0x7f56dc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2493768478 0 0) 0x7f56c8003520 con 0x7f56dc15d3b0 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56dc15d790 msgr2=0x7f56dc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56dc15d790 0x7f56dc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 >> v1:172.21.15.177:6789/0 conn(0x7f56dc0cd3b0 legacy=0x7f56dc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc0cd8c0 con 0x7f56dc15d3b0 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f56d8001690 con 0x7f56dc15d3b0 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 >> v1:172.21.15.134:6789/0 conn(0x7f56dc15d3b0 legacy=0x7f56dc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56c80039e0 0x7f56c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56c8004800 0x7f56c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c80051c0 0x7f56c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc06da30 con 0x7f56c8004800 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56c800bf00 con 0x7f56c80039e0 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.148+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f56c800c0d0 con 0x7f56c80051c0 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56c8004800 0x7f56c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e1453640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56c80039e0 0x7f56c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e1c54640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c80051c0 0x7f56c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 -- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c80051c0 msgr2=0x7f56c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c80051c0 0x7f56c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 -- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56c80039e0 msgr2=0x7f56c8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56c80039e0 0x7f56c8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 -- 172.21.15.134:0/683238572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c8003520 con 0x7f56c8004800 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e1c54640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c80051c0 0x7f56c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e1453640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56c80039e0 0x7f56c8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:09.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.149+0000 7f56e0c52640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56c8004800 0x7f56c8004c80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00ba10 tx=0x7f56c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0204a996f916f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00b5e0 con 0x7f56c8004800 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc02adb0 con 0x7f56c8004800 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56d3fff640 1 -- 172.21.15.134:0/683238572 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc005bb0 con 0x7f56c8004800 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 -- 172.21.15.134:0/683238572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56c8004800 msgr2=0x7f56c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 --2- 172.21.15.134:0/683238572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56c8004800 0x7f56c8004c80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00ba10 tx=0x7f56c8005830 comp rx=0 tx=0).stop 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e1c54640 1 -- 172.21.15.134:0/683238572 reap_dead start 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 -- 172.21.15.134:0/683238572 shutdown_connections 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 -- 172.21.15.134:0/683238572 >> 172.21.15.134:0/683238572 conn(0x7f56dc06bba0 msgr2=0x7f56dc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 -- 172.21.15.134:0/683238572 shutdown_connections 2024-09-15T22:47:09.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.150+0000 7f56e36b7640 1 -- 172.21.15.134:0/683238572 wait complete. 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.151+0000 7f56e36b7640 1 Processor -- start 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.151+0000 7f56e36b7640 1 -- start start 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 0x7f56dc152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56dc0ab5b0 0x7f56dc159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc15cd70 con 0x7f56dc0ac410 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc15cbf0 con 0x7f56dc0ab5b0 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e36b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc0cfa30 con 0x7f56c8004800 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e1c54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e1c54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33350/0 (socket says 172.21.15.134:33350) 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e1c54640 1 -- 172.21.15.134:0/1762920362 learned_addr learned my addr 172.21.15.134:0/1762920362 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e1453640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 0x7f56dc152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.152+0000 7f56e0c52640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56dc0ab5b0 0x7f56dc159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 -- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 msgr2=0x7f56dc152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 0x7f56dc152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 -- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56dc0ab5b0 msgr2=0x7f56dc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56dc0ab5b0 0x7f56dc159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 -- 172.21.15.134:0/1762920362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc0addd0 con 0x7f56dc0ac410 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1453640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 0x7f56dc152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e1c54640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000f80 tx=0x7f56d400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4006b50 con 0x7f56dc0ac410 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d4006d10 con 0x7f56dc0ac410 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc0ae040 con 0x7f56dc0ac410 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4003970 con 0x7f56dc0ac410 2024-09-15T22:47:09.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.153+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc0ae600 con 0x7f56dc0ac410 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.154+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc15d790 con 0x7f56dc0ac410 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.154+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f56d401a020 con 0x7f56dc0ac410 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.155+0000 7f56d1ffb640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 0x7f56c006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.155+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7f56d408b070 con 0x7f56dc0ac410 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.155+0000 7f56e1453640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 0x7f56c006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.156+0000 7f56e1453640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 0x7f56c006ed10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56d8001050 tx=0x7f56d8001150 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.159+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56d4059420 con 0x7f56dc0ac410 2024-09-15T22:47:09.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.326+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f56dc0b2090 con 0x7f56dc0ac410 2024-09-15T22:47:09.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.329+0000 7f56d1ffb640 1 -- 172.21.15.134:0/1762920362 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f56d4058d20 con 0x7f56dc0ac410 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 msgr2=0x7f56c006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 0x7f56c006ed10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56d8001050 tx=0x7f56d8001150 comp rx=0 tx=0).stop 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 msgr2=0x7f56dc157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000f80 tx=0x7f56d400eb90 comp rx=0 tx=0).stop 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 shutdown_connections 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f56c006c850 0x7f56c006ed10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56dc0ac410 0x7f56dc157cd0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56dc0ab5b0 0x7f56dc159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 --2- 172.21.15.134:0/1762920362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56c8004800 0x7f56dc152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 >> 172.21.15.134:0/1762920362 conn(0x7f56dc06bba0 msgr2=0x7f56dc0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 shutdown_connections 2024-09-15T22:47:09.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.331+0000 7f56e36b7640 1 -- 172.21.15.134:0/1762920362 wait complete. 2024-09-15T22:47:09.344 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:47:09.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:09.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:09.437 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:47:09.438 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:09.438 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:09.454 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:09.455 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:09.455 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:09.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:09.474 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:09.474 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:09.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:09.511 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:09.511 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:09.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:09.531 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:47:09.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.647+0000 7fe5f008d640 1 Processor -- start 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.648+0000 7fe5f008d640 1 -- start start 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.648+0000 7fe5f008d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe5e80b0640 0x7fe5e80b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.648+0000 7fe5f008d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80ce150 con 0x7fe5e80cdae0 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.648+0000 7fe5f008d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80ce430 con 0x7fe5e8156880 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.648+0000 7fe5f008d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e80b6b00 con 0x7fe5e80b0640 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ed628640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe5e80cdae0 0x7fe5e80aff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33744/0 (socket says 172.21.15.134:33744) 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ed628640 1 -- 172.21.15.134:0/2539883506 learned_addr learned my addr 172.21.15.134:0/2539883506 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ee62a640 1 --2- 172.21.15.134:0/2539883506 >> v2:172.21.15.177:3300/0 conn(0x7fe5e80b0640 0x7fe5e80b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067357027 0 0) 0x7fe5e80ce150 con 0x7fe5e80cdae0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5d4003520 con 0x7fe5e80cdae0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229082943 0 0) 0x7fe5d4003520 con 0x7fe5e80cdae0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 >> v2:172.21.15.177:3300/0 conn(0x7fe5e80b0640 msgr2=0x7fe5e80b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 --2- 172.21.15.134:0/2539883506 >> v2:172.21.15.177:3300/0 conn(0x7fe5e80b0640 0x7fe5e80b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 >> v1:172.21.15.177:6789/0 conn(0x7fe5e8156880 legacy=0x7fe5e8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e815ff30 con 0x7fe5e80cdae0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fe5dc001670 con 0x7fe5e80cdae0 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 >> v1:172.21.15.134:6789/0 conn(0x7fe5e80cdae0 legacy=0x7fe5e80aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 0x7fe5d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d4004800 0x7fe5d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5d40051c0 0x7fe5d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80b6b00 con 0x7fe5d40039b0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400c060 con 0x7fe5d40051c0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d400c260 con 0x7fe5d4004800 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ede29640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 0x7fe5d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ee62a640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5d40051c0 0x7fe5d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.649+0000 7fe5ed628640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d4004800 0x7fe5d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 -- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d4004800 msgr2=0x7fe5d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d4004800 0x7fe5d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 -- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5d40051c0 msgr2=0x7fe5d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5d40051c0 0x7fe5d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 -- 172.21.15.134:0/2539883506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d4003520 con 0x7fe5d40039b0 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ee62a640 1 -- 172.21.15.134:0/2539883506 reap_dead start 2024-09-15T22:47:09.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ede29640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 0x7fe5d4003dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001750 tx=0x7fe5d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4503dfc8eea3d87e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4001370 con 0x7fe5d40039b0 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e40052d0 con 0x7fe5d40039b0 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.650+0000 7fe5ece27640 1 -- 172.21.15.134:0/2539883506 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e402abc0 con 0x7fe5d40039b0 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 -- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 msgr2=0x7fe5d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 0x7fe5d4003dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001750 tx=0x7fe5d4005830 comp rx=0 tx=0).stop 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 -- 172.21.15.134:0/2539883506 shutdown_connections 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 --2- 172.21.15.134:0/2539883506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d40039b0 0x7fe5d4003dd0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 -- 172.21.15.134:0/2539883506 >> 172.21.15.134:0/2539883506 conn(0x7fe5e806cae0 msgr2=0x7fe5e806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 -- 172.21.15.134:0/2539883506 shutdown_connections 2024-09-15T22:47:09.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.651+0000 7fe5f008d640 1 -- 172.21.15.134:0/2539883506 wait complete. 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.652+0000 7fe5f008d640 1 Processor -- start 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.652+0000 7fe5f008d640 1 -- start start 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d40039b0 0x7fe5e8152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e8157960 0x7fe5e814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80ce710 con 0x7fe5e81528d0 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e8156c60 con 0x7fe5e8157960 2024-09-15T22:47:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5f008d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e80b65c0 con 0x7fe5d40039b0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33372/0 (socket says 172.21.15.134:33372) 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 -- 172.21.15.134:0/4251835341 learned_addr learned my addr 172.21.15.134:0/4251835341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ede29640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d40039b0 0x7fe5e8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ed628640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e8157960 0x7fe5e814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 -- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d40039b0 msgr2=0x7fe5e8152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d40039b0 0x7fe5e8152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 -- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e8157960 msgr2=0x7fe5e814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e8157960 0x7fe5e814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.653+0000 7fe5ee62a640 1 -- 172.21.15.134:0/4251835341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e81530b0 con 0x7fe5e81528d0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5ee62a640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cee40 tx=0x7fe5e000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000fce0 con 0x7fe5e81528d0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e000fe80 con 0x7fe5e81528d0 2024-09-15T22:47:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e8153390 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0015670 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.654+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e8157160 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.655+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e80aff30 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.655+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fe5e0015810 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.656+0000 7fe5da7fc640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 0x7fe5cc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.656+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4999+0+0 (secure 0 0 0) 0x7fe5e008c810 con 0x7fe5e81528d0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.656+0000 7fe5ede29640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 0x7fe5cc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.656+0000 7fe5ede29640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 0x7fe5cc06ed10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4032000 tx=0x7fe5e402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.660+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5e0019030 con 0x7fe5e81528d0 2024-09-15T22:47:09.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.857+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5e80b0cb0 con 0x7fe5e81528d0 2024-09-15T22:47:09.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.857+0000 7fe5da7fc640 1 -- 172.21.15.134:0/4251835341 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3914 (secure 0 0 0) 0x7fe5e0010040 con 0x7fe5e81528d0 2024-09-15T22:47:09.859 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:09.859 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":64,"btime":"2024-09-15T22:47:04:726092+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/420540297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":420540297},{"type":"v1","addr":"172.21.15.177:6835","nonce":420540297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/33514333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":33514333},{"type":"v1","addr":"172.21.15.177:6834","nonce":33514333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2204715333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2204715333},{"type":"v1","addr":"172.21.15.134:6825","nonce":2204715333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4261504921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4261504921},{"type":"v1","addr":"172.21.15.134:6835","nonce":4261504921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-09-15T22:47:09.859 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 64 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 msgr2=0x7fe5cc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 0x7fe5cc06ed10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4032000 tx=0x7fe5e402e000 comp rx=0 tx=0).stop 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 msgr2=0x7fe5e81548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cee40 tx=0x7fe5e000f1b0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 shutdown_connections 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5cc06c850 0x7fe5cc06ed10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5e81528d0 0x7fe5e81548c0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e8157960 0x7fe5e814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 --2- 172.21.15.134:0/4251835341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5d40039b0 0x7fe5e8152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.859+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 >> 172.21.15.134:0/4251835341 conn(0x7fe5e806cae0 msgr2=0x7fe5e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.860+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 shutdown_connections 2024-09-15T22:47:09.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:09.860+0000 7fe5f008d640 1 -- 172.21.15.134:0/4251835341 wait complete. 2024-09-15T22:47:09.872 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:47:09.873 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:47:09.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:47:09.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:09.873 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:47:09.873 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:47:09.873 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:47:09.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:09.874 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:47:09.874 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:47:09.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:47:09.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:09.874 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:47:09.874 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:47:09.874 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:47:09.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:09.882 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:47:09.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:47:09.883 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:47:09.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:47:09.885 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:47:09.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:47:09.886 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:47:09.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:47:09.926 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:47:09.927 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:09.928 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:47:09.928 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:09.929 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:47:09.929 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:09.930 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:47:09.931 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:09.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:47:10.001 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:47:10.001 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:47:10.010 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:47:10.011 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:47:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.035+0000 7f0f7add6640 1 Processor -- start 2024-09-15T22:47:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.035+0000 7f0f7add6640 1 -- start start 2024-09-15T22:47:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f7add6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 0x7f0f740d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f7add6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f740b7170 con 0x7f0f740cef90 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f7add6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f740b7aa0 con 0x7f0f7415ed20 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f7add6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f740d3660 con 0x7f0f7415e940 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f79373640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0f740cef90 0x7f0f740b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33752/0 (socket says 172.21.15.134:33752) 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f73fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0f7415ed20 0x7f0f740b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:35934/0 (socket says 172.21.15.134:35934) 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f79373640 1 -- 172.21.15.134:0/3564341490 learned_addr learned my addr 172.21.15.134:0/3564341490 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f78b72640 1 --2- 172.21.15.134:0/3564341490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 0x7f0f740d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f737fe640 1 -- 172.21.15.134:0/3564341490 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805488800 0 0) 0x7f0f6c001490 con 0x7f0f740cef90 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f737fe640 1 -- 172.21.15.134:0/3564341490 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f64003520 con 0x7f0f740cef90 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f78b72640 1 -- 172.21.15.134:0/3564341490 >> v1:172.21.15.177:6789/0 conn(0x7f0f7415ed20 legacy=0x7f0f740b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f78b72640 1 -- 172.21.15.134:0/3564341490 >> v1:172.21.15.134:6789/0 conn(0x7f0f740cef90 legacy=0x7f0f740b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.036+0000 7f0f78b72640 1 -- 172.21.15.134:0/3564341490 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f740d3940 con 0x7f0f7415e940 2024-09-15T22:47:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.037+0000 7f0f78b72640 1 --2- 172.21.15.134:0/3564341490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 0x7f0f740d1060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a919adf30578003 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.040+0000 7f0f737fe640 1 -- 172.21.15.134:0/3564341490 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037070 con 0x7f0f7415e940 2024-09-15T22:47:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.040+0000 7f0f737fe640 1 -- 172.21.15.134:0/3564341490 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f68032440 con 0x7f0f7415e940 2024-09-15T22:47:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.040+0000 7f0f737fe640 1 -- 172.21.15.134:0/3564341490 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680327f0 con 0x7f0f7415e940 2024-09-15T22:47:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 -- 172.21.15.134:0/3564341490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 msgr2=0x7f0f740d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 --2- 172.21.15.134:0/3564341490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 0x7f0f740d1060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a290 comp rx=0 tx=0).stop 2024-09-15T22:47:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 -- 172.21.15.134:0/3564341490 shutdown_connections 2024-09-15T22:47:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 --2- 172.21.15.134:0/3564341490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f7415e940 0x7f0f740d1060 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 -- 172.21.15.134:0/3564341490 >> 172.21.15.134:0/3564341490 conn(0x7f0f740b6240 msgr2=0x7f0f740b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 -- 172.21.15.134:0/3564341490 shutdown_connections 2024-09-15T22:47:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.041+0000 7f0f7add6640 1 -- 172.21.15.134:0/3564341490 wait complete. 2024-09-15T22:47:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.042+0000 7f0f7add6640 1 Processor -- start 2024-09-15T22:47:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.042+0000 7f0f7add6640 1 -- start start 2024-09-15T22:47:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f740cef90 0x7f0f740cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f7415ed20 0x7f0f740b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740d3310 con 0x7f0f7415e940 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740d3f00 con 0x7f0f7415ed20 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f7add6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f740d1ef0 con 0x7f0f740cef90 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33404/0 (socket says 172.21.15.134:33404) 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f73fff640 1 -- 172.21.15.134:0/4122593576 learned_addr learned my addr 172.21.15.134:0/4122593576 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.043+0000 7f0f79373640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f7415ed20 0x7f0f740b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f78b72640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f740cef90 0x7f0f740cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 -- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f740cef90 msgr2=0x7f0f740cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f740cef90 0x7f0f740cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 -- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f7415ed20 msgr2=0x7f0f740b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f7415ed20 0x7f0f740b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 -- 172.21.15.134:0/4122593576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f740b45c0 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f73fff640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c3c0 tx=0x7f0f6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600074e0 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60007680 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f740b48a0 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004a00 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.044+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f740c9760 con 0x7f0f7415e940 2024-09-15T22:47:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.045+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f740d1060 con 0x7f0f7415e940 2024-09-15T22:47:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.046+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f0f6001a020 con 0x7f0f7415e940 2024-09-15T22:47:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.046+0000 7f0f717fa640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 0x7f0f5806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.046+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4999+0+0 (secure 0 0 0) 0x7f0f6008b280 con 0x7f0f7415e940 2024-09-15T22:47:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.046+0000 7f0f78b72640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 0x7f0f5806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.047+0000 7f0f78b72640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 0x7f0f5806ed10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.052+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f60058df0 con 0x7f0f7415e940 2024-09-15T22:47:10.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:10.227+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0f740ba6b0 con 0x7f0f7415e940 2024-09-15T22:47:11.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.047+0000 7f0f717fa640 1 -- 172.21.15.134:0/4122593576 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v130) ==== 97+0+0 (secure 0 0 0) 0x7f0f6005d0f0 con 0x7f0f7415e940 2024-09-15T22:47:11.048 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 msgr2=0x7f0f5806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 0x7f0f5806ed10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 msgr2=0x7f0f740b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c3c0 tx=0x7f0f6000c880 comp rx=0 tx=0).stop 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 shutdown_connections 2024-09-15T22:47:11.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f7415ed20 0x7f0f740b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f5806c850 0x7f0f5806ed10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f7415e940 0x7f0f740b5340 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 --2- 172.21.15.134:0/4122593576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f740cef90 0x7f0f740cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.049+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 >> 172.21.15.134:0/4122593576 conn(0x7f0f740b6240 msgr2=0x7f0f740d4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.050+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 shutdown_connections 2024-09-15T22:47:11.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.050+0000 7f0f7add6640 1 -- 172.21.15.134:0/4122593576 wait complete. 2024-09-15T22:47:11.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:47:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.163+0000 7f957e877640 1 Processor -- start 2024-09-15T22:47:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.163+0000 7f957e877640 1 -- start start 2024-09-15T22:47:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957e877640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f957806c1f0 0x7f95780cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957e877640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95780cd5f0 con 0x7f957806be10 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957e877640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95780cd8d0 con 0x7f9578151c50 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957e877640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f95780cdbb0 con 0x7f957806c1f0 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f957806c1f0 0x7f95780cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f957806c1f0 0x7f95780cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33420/0 (socket says 172.21.15.134:33420) 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f9577fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f957806be10 0x7f9578151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33762/0 (socket says 172.21.15.134:33762) 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 -- 172.21.15.134:0/346699946 learned_addr learned my addr 172.21.15.134:0/346699946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 -- 172.21.15.134:0/346699946 >> v1:172.21.15.177:6789/0 conn(0x7f9578151c50 legacy=0x7f9578162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 -- 172.21.15.134:0/346699946 >> v1:172.21.15.134:6789/0 conn(0x7f957806be10 legacy=0x7f9578151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f9576ffd640 1 -- 172.21.15.134:0/346699946 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818151016 0 0) 0x7f95780cd5f0 con 0x7f957806be10 2024-09-15T22:47:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.164+0000 7f957ce14640 1 -- 172.21.15.134:0/346699946 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95780cde90 con 0x7f957806c1f0 2024-09-15T22:47:11.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f957ce14640 1 --2- 172.21.15.134:0/346699946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f95780cd010 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9570009e50 tx=0x7f957002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2db4f1a4ce2e659 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f9576ffd640 1 -- 172.21.15.134:0/346699946 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570036070 con 0x7f957806c1f0 2024-09-15T22:47:11.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f9576ffd640 1 -- 172.21.15.134:0/346699946 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570031600 con 0x7f957806c1f0 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f9576ffd640 1 -- 172.21.15.134:0/346699946 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95700319d0 con 0x7f957806c1f0 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f957e877640 1 -- 172.21.15.134:0/346699946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 msgr2=0x7f95780cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.165+0000 7f957e877640 1 --2- 172.21.15.134:0/346699946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f95780cd010 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9570009e50 tx=0x7f957002a760 comp rx=0 tx=0).stop 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.166+0000 7f957e877640 1 -- 172.21.15.134:0/346699946 shutdown_connections 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.166+0000 7f957e877640 1 --2- 172.21.15.134:0/346699946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f95780cd010 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.166+0000 7f957e877640 1 -- 172.21.15.134:0/346699946 >> 172.21.15.134:0/346699946 conn(0x7f9578062cc0 msgr2=0x7f957806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.166+0000 7f957e877640 1 -- 172.21.15.134:0/346699946 shutdown_connections 2024-09-15T22:47:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.166+0000 7f957e877640 1 -- 172.21.15.134:0/346699946 wait complete. 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.167+0000 7f957e877640 1 Processor -- start 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.167+0000 7f957e877640 1 -- start start 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 0x7f9578140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9578151c50 0x7f957814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f957815baa0 con 0x7f957806c1f0 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95780ce690 con 0x7f9578151c50 2024-09-15T22:47:11.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f957815bc20 con 0x7f957806be10 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33432/0 (socket says 172.21.15.134:33432) 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 -- 172.21.15.134:0/1771814669 learned_addr learned my addr 172.21.15.134:0/1771814669 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957ce14640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9578151c50 0x7f957814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f9577fff640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 0x7f9578140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 -- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 msgr2=0x7f9578140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 0x7f9578140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 -- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9578151c50 msgr2=0x7f957814c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9578151c50 0x7f957814c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 -- 172.21.15.134:0/1771814669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95781438f0 con 0x7f957806c1f0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f9577fff640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 0x7f9578140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f95777fe640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b3c0 tx=0x7f956c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c011830 con 0x7f957806c1f0 2024-09-15T22:47:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956c016070 con 0x7f957806c1f0 2024-09-15T22:47:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9578140a50 con 0x7f957806c1f0 2024-09-15T22:47:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c011c10 con 0x7f957806c1f0 2024-09-15T22:47:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.168+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957814eea0 con 0x7f957806c1f0 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.169+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95780cd010 con 0x7f957806c1f0 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.170+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f956c01b460 con 0x7f957806c1f0 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.170+0000 7f9574ff9640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 0x7f956406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.170+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 4913+0+0 (secure 0 0 0) 0x7f956c08b7a0 con 0x7f957806c1f0 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.171+0000 7f9577fff640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 0x7f956406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.171+0000 7f9577fff640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 0x7f956406ed10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9568000f60 tx=0x7f9568007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.175+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9578140a50 con 0x7f957806c1f0 2024-09-15T22:47:11.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.401+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f95781585a0 con 0x7f957806c1f0 2024-09-15T22:47:11.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.402+0000 7f9574ff9640 1 -- 172.21.15.134:0/1771814669 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f95781438f0 con 0x7f957806c1f0 2024-09-15T22:47:11.403 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:11.404 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:47:11.406 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.407 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.408 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.412 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:47:11.413 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.415 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:11.416 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:47:11.418 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:47:11.419 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:47:11.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 msgr2=0x7f956406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 0x7f956406ed10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9568000f60 tx=0x7f9568007c10 comp rx=0 tx=0).stop 2024-09-15T22:47:11.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 msgr2=0x7f9578154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b3c0 tx=0x7f956c00b880 comp rx=0 tx=0).stop 2024-09-15T22:47:11.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 shutdown_connections 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9578151c50 0x7f957814c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f956406c850 0x7f956406ed10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957806c1f0 0x7f9578154e40 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 --2- 172.21.15.134:0/1771814669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f957806be10 0x7f9578140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 >> 172.21.15.134:0/1771814669 conn(0x7f9578062cc0 msgr2=0x7f95780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 shutdown_connections 2024-09-15T22:47:11.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.404+0000 7f957e877640 1 -- 172.21.15.134:0/1771814669 wait complete. 2024-09-15T22:47:11.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:47:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.519+0000 7f75902b7640 1 Processor -- start 2024-09-15T22:47:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.519+0000 7f75902b7640 1 -- start start 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.520+0000 7f75902b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f758815e940 0x7f75880d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.520+0000 7f75902b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f75880d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.520+0000 7f75902b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75880b7170 con 0x7f758815ed20 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.520+0000 7f75902b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d1ae0 con 0x7f758815e940 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.520+0000 7f75902b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f75880b7aa0 con 0x7f75880cef90 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d852640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f758815ed20 0x7f75880b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33778/0 (socket says 172.21.15.134:33778) 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d852640 1 -- 172.21.15.134:0/524107731 learned_addr learned my addr 172.21.15.134:0/524107731 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378880607 0 0) 0x7f7584001110 con 0x7f758815ed20 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758e053640 1 --2- 172.21.15.134:0/524107731 >> v2:172.21.15.177:3300/0 conn(0x7f758815e940 0x7f75880d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7574003520 con 0x7f758815ed20 2024-09-15T22:47:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758e854640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f75880d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 235734371 0 0) 0x7f7574003520 con 0x7f758815ed20 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 msgr2=0x7f75880d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f75880d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 >> v2:172.21.15.177:3300/0 conn(0x7f758815e940 msgr2=0x7f75880d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 --2- 172.21.15.134:0/524107731 >> v2:172.21.15.177:3300/0 conn(0x7f758815e940 0x7f75880d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880d3660 con 0x7f758815ed20 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7584001840 con 0x7f758815ed20 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 >> v1:172.21.15.134:6789/0 conn(0x7f758815ed20 legacy=0x7f75880b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75740039b0 0x7f7574003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f7574004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7574004d40 0x7f75740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75880b7aa0 con 0x7f7574004d40 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f757400b9c0 con 0x7f75740039b0 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f757400bb40 con 0x7f75880cef90 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758e854640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7574004d40 0x7f75740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758e053640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75740039b0 0x7f7574003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.521+0000 7f758d852640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f7574004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 -- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 msgr2=0x7f7574004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75880cef90 0x7f7574004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 -- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75740039b0 msgr2=0x7f7574003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75740039b0 0x7f7574003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 -- 172.21.15.134:0/524107731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7574003520 con 0x7f7574004d40 2024-09-15T22:47:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758e854640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7574004d40 0x7f75740051c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f7580009fc0 tx=0x7f7574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc70e72b3ef1ea27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580009c10 con 0x7f7574004d40 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7580036070 con 0x7f7574004d40 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.522+0000 7f758d051640 1 -- 172.21.15.134:0/524107731 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580031880 con 0x7f7574004d40 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 -- 172.21.15.134:0/524107731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7574004d40 msgr2=0x7f75740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 --2- 172.21.15.134:0/524107731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7574004d40 0x7f75740051c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f7580009fc0 tx=0x7f7574005830 comp rx=0 tx=0).stop 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f758e854640 1 -- 172.21.15.134:0/524107731 reap_dead start 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 -- 172.21.15.134:0/524107731 shutdown_connections 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 -- 172.21.15.134:0/524107731 >> 172.21.15.134:0/524107731 conn(0x7f75880b6240 msgr2=0x7f75880b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 -- 172.21.15.134:0/524107731 shutdown_connections 2024-09-15T22:47:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.523+0000 7f75902b7640 1 -- 172.21.15.134:0/524107731 wait complete. 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.524+0000 7f75902b7640 1 Processor -- start 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.524+0000 7f75902b7640 1 -- start start 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7574004d40 0x7f758815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75880cab40 0x7f75880cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75880d3f00 con 0x7f7588158700 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f75880d3c20 con 0x7f75880cab40 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f75902b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f75880d3310 con 0x7f7574004d40 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33454/0 (socket says 172.21.15.134:33454) 2024-09-15T22:47:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 -- 172.21.15.134:0/266918516 learned_addr learned my addr 172.21.15.134:0/266918516 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758e854640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75880cab40 0x7f75880cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758e053640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7574004d40 0x7f758815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 -- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7574004d40 msgr2=0x7f758815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7574004d40 0x7f758815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 -- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75880cab40 msgr2=0x7f75880cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75880cab40 0x7f75880cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.525+0000 7f758d852640 1 -- 172.21.15.134:0/266918516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880b5ed0 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f758d852640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f75840019b0 tx=0x7f75840077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758400f960 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7584018070 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7588158e70 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758400fd00 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.526+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7588159c10 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.527+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7588159260 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.527+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f758401d460 con 0x7f7588158700 2024-09-15T22:47:11.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.528+0000 7f757affd640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 0x7f756c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.528+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 4913+0+0 (secure 0 0 0) 0x7f758408bcf0 con 0x7f7588158700 2024-09-15T22:47:11.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.528+0000 7f758e053640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 0x7f756c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.528+0000 7f758e053640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 0x7f756c06ed10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f757c009a00 tx=0x7f757c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.532+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75880b7170 con 0x7f7588158700 2024-09-15T22:47:11.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.697+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75880d1ef0 con 0x7f7588158700 2024-09-15T22:47:11.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.698+0000 7f757affd640 1 -- 172.21.15.134:0/266918516 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v130) ==== 84+0+65 (secure 0 0 0) 0x7f7584059f00 con 0x7f7588158700 2024-09-15T22:47:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:11.700 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:47:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:47:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:47:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:11.701 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 msgr2=0x7f756c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 0x7f756c06ed10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f757c009a00 tx=0x7f757c008040 comp rx=0 tx=0).stop 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 msgr2=0x7f75880b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f75840019b0 tx=0x7f75840077a0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 shutdown_connections 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75880cab40 0x7f75880cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f756c06c850 0x7f756c06ed10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7588158700 0x7f75880b5990 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 --2- 172.21.15.134:0/266918516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7574004d40 0x7f758815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 >> 172.21.15.134:0/266918516 conn(0x7f75880b6240 msgr2=0x7f758815f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 shutdown_connections 2024-09-15T22:47:11.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.700+0000 7f75902b7640 1 -- 172.21.15.134:0/266918516 wait complete. 2024-09-15T22:47:11.712 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:47:11.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.813+0000 7ff38ae65640 1 Processor -- start 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.813+0000 7ff38ae65640 1 -- start start 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff38415c4b0 0x7ff3840b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3840b5c10 0x7ff3840b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 0x7ff3841600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840b0470 con 0x7ff38415c4b0 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840cdc10 con 0x7ff3840b5c10 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff38ae65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff3840cdef0 con 0x7ff3840d0820 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff388c01640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff38415c4b0 0x7ff3840b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff383fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3840b5c10 0x7ff3840b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff388c01640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff38415c4b0 0x7ff3840b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33468/0 (socket says 172.21.15.134:33468) 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff388c01640 1 -- 172.21.15.134:0/1162564687 learned_addr learned my addr 172.21.15.134:0/1162564687 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.814+0000 7ff389402640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 0x7ff3841600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 -- 172.21.15.134:0/1162564687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 msgr2=0x7ff3841600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 0x7ff3841600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 -- 172.21.15.134:0/1162564687 >> v2:172.21.15.177:3300/0 conn(0x7ff3840b5c10 msgr2=0x7ff3840b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 --2- 172.21.15.134:0/1162564687 >> v2:172.21.15.177:3300/0 conn(0x7ff3840b5c10 0x7ff3840b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 -- 172.21.15.134:0/1162564687 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3840ce1d0 con 0x7ff38415c4b0 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff389402640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 0x7ff3841600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff388c01640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff38415c4b0 0x7ff3840b4f20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff3840cd690 tx=0x7ff37802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9578d0160b1fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.815+0000 7ff3837fe640 1 -- 172.21.15.134:0/1162564687 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378037070 con 0x7ff38415c4b0 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff3837fe640 1 -- 172.21.15.134:0/1162564687 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378032440 con 0x7ff38415c4b0 2024-09-15T22:47:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff3837fe640 1 -- 172.21.15.134:0/1162564687 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378032810 con 0x7ff38415c4b0 2024-09-15T22:47:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 -- 172.21.15.134:0/1162564687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff38415c4b0 msgr2=0x7ff3840b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff38415c4b0 0x7ff3840b4f20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff3840cd690 tx=0x7ff37802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 -- 172.21.15.134:0/1162564687 shutdown_connections 2024-09-15T22:47:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840d0820 0x7ff3841600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1162564687 >> v2:172.21.15.177:3300/0 conn(0x7ff3840b5c10 0x7ff3840b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1162564687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff38415c4b0 0x7ff3840b4f20 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 -- 172.21.15.134:0/1162564687 >> 172.21.15.134:0/1162564687 conn(0x7ff38406c9f0 msgr2=0x7ff38406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 -- 172.21.15.134:0/1162564687 shutdown_connections 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.816+0000 7ff38ae65640 1 -- 172.21.15.134:0/1162564687 wait complete. 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.817+0000 7ff38ae65640 1 Processor -- start 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.817+0000 7ff38ae65640 1 -- start start 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840b5c10 0x7ff38415f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff38415c4b0 0x7ff38415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3840ce790 con 0x7ff3840d0820 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff38415c890 con 0x7ff38415c4b0 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff38ae65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff3840ce910 con 0x7ff3840b5c10 2024-09-15T22:47:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff383fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff383fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33480/0 (socket says 172.21.15.134:33480) 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.818+0000 7ff383fff640 1 -- 172.21.15.134:0/1882403719 learned_addr learned my addr 172.21.15.134:0/1882403719 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff389402640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff38415c4b0 0x7ff38415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff388c01640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840b5c10 0x7ff38415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 -- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840b5c10 msgr2=0x7ff38415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840b5c10 0x7ff38415f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 -- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff38415c4b0 msgr2=0x7ff38415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff38415c4b0 0x7ff38415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 -- 172.21.15.134:0/1882403719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38415d800 con 0x7ff3840d0820 2024-09-15T22:47:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff383fff640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff37000e8a0 tx=0x7ff37000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370017070 con 0x7ff3840d0820 2024-09-15T22:47:11.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37000ee90 con 0x7ff3840d0820 2024-09-15T22:47:11.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37000cb80 con 0x7ff3840d0820 2024-09-15T22:47:11.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38415dae0 con 0x7ff3840d0820 2024-09-15T22:47:11.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.819+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38415e0a0 con 0x7ff3840d0820 2024-09-15T22:47:11.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.820+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3840ced20 con 0x7ff3840d0820 2024-09-15T22:47:11.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.821+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7ff37001a070 con 0x7ff3840d0820 2024-09-15T22:47:11.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.821+0000 7ff3817fa640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 0x7ff36806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:11.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.821+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 4913+0+0 (secure 0 0 0) 0x7ff37008bcb0 con 0x7ff3840d0820 2024-09-15T22:47:11.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.821+0000 7ff388c01640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 0x7ff36806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:11.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.822+0000 7ff388c01640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 0x7ff36806ed10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff378034000 tx=0x7ff37802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:11.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.825+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3840ced20 con 0x7ff3840d0820 2024-09-15T22:47:11.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:11.991+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff3840b4f20 con 0x7ff3840d0820 2024-09-15T22:47:12.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.051+0000 7ff3817fa640 1 -- 172.21.15.134:0/1882403719 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v131) ==== 138+0+0 (secure 0 0 0) 0x7ff370059870 con 0x7ff3840d0820 2024-09-15T22:47:12.053 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 msgr2=0x7ff36806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 0x7ff36806ed10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff378034000 tx=0x7ff37802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 msgr2=0x7ff38415fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff37000e8a0 tx=0x7ff37000ed60 comp rx=0 tx=0).stop 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 shutdown_connections 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff38415c4b0 0x7ff38415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff36806c850 0x7ff36806ed10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3840d0820 0x7ff38415fb60 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 --2- 172.21.15.134:0/1882403719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3840b5c10 0x7ff38415f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 >> 172.21.15.134:0/1882403719 conn(0x7ff38406c9f0 msgr2=0x7ff3840b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 shutdown_connections 2024-09-15T22:47:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.054+0000 7ff38ae65640 1 -- 172.21.15.134:0/1882403719 wait complete. 2024-09-15T22:47:12.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:47:12.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.175+0000 7f7b34c77640 1 Processor -- start 2024-09-15T22:47:12.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.175+0000 7f7b34c77640 1 -- start start 2024-09-15T22:47:12.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7b3015c440 0x7f7b300b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b300d0750 0x7f7b3015d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b3015d670 0x7f7b3006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7b300700c0 con 0x7f7b300d0750 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7b300cdfe0 con 0x7f7b3015c440 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b34c77640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300ce230 con 0x7f7b3015d670 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b300d0750 0x7f7b3015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b300d0750 0x7f7b3015d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33496/0 (socket says 172.21.15.134:33496) 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/2404552062 learned_addr learned my addr 172.21.15.134:0/2404552062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2e59c640 1 --2- 172.21.15.134:0/2404552062 >> v2:172.21.15.177:3300/0 conn(0x7f7b3015c440 0x7f7b300b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2ed9d640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b3015d670 0x7f7b3006dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/2404552062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b3015d670 msgr2=0x7f7b3006dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b3015d670 0x7f7b3006dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/2404552062 >> v2:172.21.15.177:3300/0 conn(0x7f7b3015c440 msgr2=0x7f7b300b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/2404552062 >> v2:172.21.15.177:3300/0 conn(0x7f7b3015c440 0x7f7b300b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.176+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/2404552062 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300ce510 con 0x7f7b300d0750 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.177+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b300d0750 0x7f7b3015d130 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f7b30069910 tx=0x7f7b2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3122b5fef8e3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.177+0000 7f7b2d59a640 1 -- 172.21.15.134:0/2404552062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24037070 con 0x7f7b300d0750 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.177+0000 7f7b2d59a640 1 -- 172.21.15.134:0/2404552062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b24032440 con 0x7f7b300d0750 2024-09-15T22:47:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.177+0000 7f7b2d59a640 1 -- 172.21.15.134:0/2404552062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24032810 con 0x7f7b300d0750 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 -- 172.21.15.134:0/2404552062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b300d0750 msgr2=0x7f7b3015d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b300d0750 0x7f7b3015d130 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f7b30069910 tx=0x7f7b2402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 -- 172.21.15.134:0/2404552062 shutdown_connections 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b3015d670 0x7f7b3006dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 --2- 172.21.15.134:0/2404552062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b300d0750 0x7f7b3015d130 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 --2- 172.21.15.134:0/2404552062 >> v2:172.21.15.177:3300/0 conn(0x7f7b3015c440 0x7f7b300b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 -- 172.21.15.134:0/2404552062 >> 172.21.15.134:0/2404552062 conn(0x7f7b300b0980 msgr2=0x7f7b300b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 -- 172.21.15.134:0/2404552062 shutdown_connections 2024-09-15T22:47:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.178+0000 7f7b34c77640 1 -- 172.21.15.134:0/2404552062 wait complete. 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.179+0000 7f7b34c77640 1 Processor -- start 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.179+0000 7f7b34c77640 1 -- start start 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 0x7f7b30072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 0x7f7b30141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3015c9a0 con 0x7f7b3015c440 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3015c820 con 0x7f7b3015d670 2024-09-15T22:47:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b34c77640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3006e0f0 con 0x7f7b300d0750 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33506/0 (socket says 172.21.15.134:33506) 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/4204349224 learned_addr learned my addr 172.21.15.134:0/4204349224 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2e59c640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 0x7f7b30072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2ed9d640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 0x7f7b30141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 msgr2=0x7f7b30072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 0x7f7b30072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 msgr2=0x7f7b30141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 0x7f7b30141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 -- 172.21.15.134:0/4204349224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3015a130 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2e59c640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 0x7f7b30072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2ed9d640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 0x7f7b30141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b2dd9b640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24041020 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.180+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2403d620 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.181+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24037040 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.181+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3015a410 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.181+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3015a9d0 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.182+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3006e420 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.182+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f7b24044020 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.182+0000 7f7b1effd640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 0x7f7b1006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.183+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5283+0+0 (secure 0 0 0) 0x7f7b240ac3a0 con 0x7f7b3015c440 2024-09-15T22:47:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.183+0000 7f7b2e59c640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 0x7f7b1006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.183+0000 7f7b2e59c640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 0x7f7b1006ed10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009b10 tx=0x7f7b20008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.187+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b2404b030 con 0x7f7b3015c440 2024-09-15T22:47:12.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:12.357+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7b3015d140 con 0x7f7b3015c440 2024-09-15T22:47:13.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.056+0000 7f7b1effd640 1 -- 172.21.15.134:0/4204349224 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v132) ==== 170+0+0 (secure 0 0 0) 0x7f7b2407a440 con 0x7f7b3015c440 2024-09-15T22:47:13.058 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.060+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 msgr2=0x7f7b1006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.060+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 0x7f7b1006ed10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009b10 tx=0x7f7b20008040 comp rx=0 tx=0).stop 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.060+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 msgr2=0x7f7b30159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.060+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b240046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 shutdown_connections 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b3015d670 0x7f7b30141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7b1006c850 0x7f7b1006ed10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b3015c440 0x7f7b30159a30 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 --2- 172.21.15.134:0/4204349224 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b300d0750 0x7f7b30072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.061+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 >> 172.21.15.134:0/4204349224 conn(0x7f7b300b0980 msgr2=0x7f7b3006eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:13.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.062+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 shutdown_connections 2024-09-15T22:47:13.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.062+0000 7f7b34c77640 1 -- 172.21.15.134:0/4204349224 wait complete. 2024-09-15T22:47:13.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:47:13.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.190+0000 7f5cbd8c9640 1 Processor -- start 2024-09-15T22:47:13.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.190+0000 7f5cbd8c9640 1 -- start start 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cbd8c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 0x7f5cb8169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cbd8c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb80cf490 con 0x7f5cb80b3890 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cbd8c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb80cf740 con 0x7f5cb80d3a70 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cbd8c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb80d2e60 con 0x7f5cb80d32f0 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cb67fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5cb80b3890 0x7f5cb80ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33782/0 (socket says 172.21.15.134:33782) 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cb67fc640 1 -- 172.21.15.134:0/3663681316 learned_addr learned my addr 172.21.15.134:0/3663681316 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cb77fe640 1 --2- 172.21.15.134:0/3663681316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 0x7f5cb8169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:13.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141163309 0 0) 0x7f5cb80cf490 con 0x7f5cb80b3890 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.191+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ca0003520 con 0x7f5cb80b3890 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275049401 0 0) 0x7f5cb80cf740 con 0x7f5cb80d3a70 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb80cf490 con 0x7f5cb80d3a70 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb77fe640 1 -- 172.21.15.134:0/3663681316 >> v1:172.21.15.177:6789/0 conn(0x7f5cb80d3a70 legacy=0x7f5cb80d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 865960884 0 0) 0x7f5ca0003520 con 0x7f5cb80b3890 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb77fe640 1 -- 172.21.15.134:0/3663681316 >> v1:172.21.15.134:6789/0 conn(0x7f5cb80b3890 legacy=0x7f5cb80ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb77fe640 1 -- 172.21.15.134:0/3663681316 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb80cfa20 con 0x7f5cb80d32f0 2024-09-15T22:47:13.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.192+0000 7f5cb77fe640 1 --2- 172.21.15.134:0/3663681316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 0x7f5cb8169010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009dc0 tx=0x7f5cb002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15a1e8921b055d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:13.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac001670 con 0x7f5cb80d32f0 2024-09-15T22:47:13.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb0007540 con 0x7f5cb80d32f0 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cb5ffb640 1 -- 172.21.15.134:0/3663681316 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00078f0 con 0x7f5cb80d32f0 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/3663681316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 msgr2=0x7f5cb8169010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/3663681316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 0x7f5cb8169010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009dc0 tx=0x7f5cb002a660 comp rx=0 tx=0).stop 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/3663681316 shutdown_connections 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/3663681316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d32f0 0x7f5cb8169010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/3663681316 >> 172.21.15.134:0/3663681316 conn(0x7f5cb8062c60 msgr2=0x7f5cb80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/3663681316 shutdown_connections 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.193+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/3663681316 wait complete. 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.194+0000 7f5cbd8c9640 1 Processor -- start 2024-09-15T22:47:13.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.194+0000 7f5cbd8c9640 1 -- start start 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb80b3890 0x7f5cb80cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d3a70 0x7f5cb80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb8169550 con 0x7f5cb80d32f0 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80d2af0 con 0x7f5cb80b3890 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cbd8c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb81696d0 con 0x7f5cb80d3a70 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cb67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cb67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33514/0 (socket says 172.21.15.134:33514) 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cb67fc640 1 -- 172.21.15.134:0/2424164322 learned_addr learned my addr 172.21.15.134:0/2424164322 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cb77fe640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d3a70 0x7f5cb80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.195+0000 7f5cb6ffd640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb80b3890 0x7f5cb80cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 -- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d3a70 msgr2=0x7f5cb80c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d3a70 0x7f5cb80c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 -- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb80b3890 msgr2=0x7f5cb80cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb80b3890 0x7f5cb80cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 -- 172.21.15.134:0/2424164322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb80ca070 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cb67fc640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c750 tx=0x7f5cac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac017070 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cac005ad0 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb80ca350 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac007070 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.196+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb80ca910 con 0x7f5cb80d32f0 2024-09-15T22:47:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.197+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb80ced80 con 0x7f5cb80d32f0 2024-09-15T22:47:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.197+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5cac01a070 con 0x7f5cb80d32f0 2024-09-15T22:47:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.198+0000 7f5c9ffff640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 0x7f5ca406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.198+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5665+0+0 (secure 0 0 0) 0x7f5cac08b240 con 0x7f5cb80d32f0 2024-09-15T22:47:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.198+0000 7f5cb6ffd640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 0x7f5ca406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.199+0000 7f5cb6ffd640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 0x7f5ca406ed40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80011e0 tx=0x7f5ca8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:13.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.203+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cac058ba0 con 0x7f5cb80d32f0 2024-09-15T22:47:13.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:13.402+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5cb80d4290 con 0x7f5cb80d32f0 2024-09-15T22:47:14.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.074+0000 7f5c9ffff640 1 -- 172.21.15.134:0/2424164322 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v66) ==== 174+0+0 (secure 0 0 0) 0x7f5cac05cea0 con 0x7f5cb80d32f0 2024-09-15T22:47:14.078 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 20 and data pool 21 2024-09-15T22:47:14.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 msgr2=0x7f5ca406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 0x7f5ca406ed40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80011e0 tx=0x7f5ca8009040 comp rx=0 tx=0).stop 2024-09-15T22:47:14.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 msgr2=0x7f5cb8155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c750 tx=0x7f5cac00cc10 comp rx=0 tx=0).stop 2024-09-15T22:47:14.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 shutdown_connections 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cb80d3a70 0x7f5cb80c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca406c880 0x7f5ca406ed40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cb80d32f0 0x7f5cb8155ad0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 --2- 172.21.15.134:0/2424164322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb80b3890 0x7f5cb80cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 >> 172.21.15.134:0/2424164322 conn(0x7f5cb8062c60 msgr2=0x7f5cb80b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.084+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 shutdown_connections 2024-09-15T22:47:14.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.085+0000 7f5cbd8c9640 1 -- 172.21.15.134:0/2424164322 wait complete. 2024-09-15T22:47:14.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:14.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 Processor -- start 2024-09-15T22:47:14.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 -- start start 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f070415e940 0x7f07040d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07040cef90 0x7f07040d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07040b7170 con 0x7f070415ed20 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f07040d1ae0 con 0x7f070415e940 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.203+0000 7f070ad03640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f07040b7aa0 con 0x7f07040cef90 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f070415e940 0x7f07040d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f070415e940 0x7f07040d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33528/0 (socket says 172.21.15.134:33528) 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 -- 172.21.15.134:0/3839441358 learned_addr learned my addr 172.21.15.134:0/3839441358 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0703fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f070415ed20 0x7f07040b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33792/0 (socket says 172.21.15.134:33792) 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 -- 172.21.15.134:0/3839441358 >> v2:172.21.15.177:3300/0 conn(0x7f07040cef90 msgr2=0x7f07040d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:14.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 --2- 172.21.15.134:0/3839441358 >> v2:172.21.15.177:3300/0 conn(0x7f07040cef90 0x7f07040d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 -- 172.21.15.134:0/3839441358 >> v1:172.21.15.134:6789/0 conn(0x7f070415ed20 legacy=0x7f07040b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f0708a9f640 1 -- 172.21.15.134:0/3839441358 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07040d3660 con 0x7f070415e940 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.204+0000 7f07037fe640 1 -- 172.21.15.134:0/3839441358 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648347198 0 0) 0x7f06ec001490 con 0x7f070415ed20 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f0708a9f640 1 --2- 172.21.15.134:0/3839441358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415e940 0x7f07040d1060 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f070406d070 tx=0x7f06fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc466647b2b5653 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f07037fe640 1 -- 172.21.15.134:0/3839441358 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc037070 con 0x7f070415e940 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f07037fe640 1 -- 172.21.15.134:0/3839441358 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc02ae50 con 0x7f070415e940 2024-09-15T22:47:14.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f07037fe640 1 -- 172.21.15.134:0/3839441358 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc032860 con 0x7f070415e940 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 -- 172.21.15.134:0/3839441358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415e940 msgr2=0x7f07040d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 --2- 172.21.15.134:0/3839441358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415e940 0x7f07040d1060 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f070406d070 tx=0x7f06fc02a300 comp rx=0 tx=0).stop 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 -- 172.21.15.134:0/3839441358 shutdown_connections 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 --2- 172.21.15.134:0/3839441358 >> v2:172.21.15.177:3300/0 conn(0x7f07040cef90 0x7f07040d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 --2- 172.21.15.134:0/3839441358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415e940 0x7f07040d1060 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 -- 172.21.15.134:0/3839441358 >> 172.21.15.134:0/3839441358 conn(0x7f07040b6240 msgr2=0x7f07040b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 -- 172.21.15.134:0/3839441358 shutdown_connections 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.205+0000 7f070ad03640 1 -- 172.21.15.134:0/3839441358 wait complete. 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.206+0000 7f070ad03640 1 Processor -- start 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.206+0000 7f070ad03640 1 -- start start 2024-09-15T22:47:14.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07040cef90 0x7f0704154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f070415e940 0x7f07041592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07040d3f00 con 0x7f070415ed20 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f07040d3c20 con 0x7f07040cef90 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f070ad03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f07040d3310 con 0x7f070415e940 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f07092a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f07092a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33538/0 (socket says 172.21.15.134:33538) 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.207+0000 7f07092a0640 1 -- 172.21.15.134:0/1775741313 learned_addr learned my addr 172.21.15.134:0/1775741313 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f0708a9f640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07040cef90 0x7f0704154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f0703fff640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f070415e940 0x7f07041592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 -- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f070415e940 msgr2=0x7f07041592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f070415e940 0x7f07041592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 -- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07040cef90 msgr2=0x7f0704154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07040cef90 0x7f0704154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 -- 172.21.15.134:0/1775741313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070415a080 con 0x7f070415ed20 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07092a0640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f06f400b410 tx=0x7f06f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4015020 con 0x7f070415ed20 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f4011850 con 0x7f070415ed20 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070415a360 con 0x7f070415ed20 2024-09-15T22:47:14.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4011c40 con 0x7f070415ed20 2024-09-15T22:47:14.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.208+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070415a920 con 0x7f070415ed20 2024-09-15T22:47:14.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.209+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07041621b0 con 0x7f070415ed20 2024-09-15T22:47:14.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.210+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f06f4018020 con 0x7f070415ed20 2024-09-15T22:47:14.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.210+0000 7f07017fa640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 0x7f06e406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.210+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5765+0+0 (secure 0 0 0) 0x7f06f408bd90 con 0x7f070415ed20 2024-09-15T22:47:14.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.210+0000 7f0708a9f640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 0x7f06e406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.211+0000 7f0708a9f640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 0x7f06e406ed10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06fc034000 tx=0x7f06fc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.214+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07041621b0 con 0x7f070415ed20 2024-09-15T22:47:14.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.381+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07040d1ef0 con 0x7f070415ed20 2024-09-15T22:47:14.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.383+0000 7f07017fa640 1 -- 172.21.15.134:0/1775741313 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16877 (secure 0 0 0) 0x7f06f401f020 con 0x7f070415ed20 2024-09-15T22:47:14.384 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:14.385 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":133,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:13.403791+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:12.010666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:12.376443+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 msgr2=0x7f06e406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 0x7f06e406ed10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06fc034000 tx=0x7f06fc02e000 comp rx=0 tx=0).stop 2024-09-15T22:47:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 msgr2=0x7f07041e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f06f400b410 tx=0x7f06f400b8d0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 shutdown_connections 2024-09-15T22:47:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06e406c850 0x7f06e406ed10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f070415ed20 0x7f07041e92a0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f070415e940 0x7f07041592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 --2- 172.21.15.134:0/1775741313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07040cef90 0x7f0704154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 >> 172.21.15.134:0/1775741313 conn(0x7f07040b6240 msgr2=0x7f0704161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 shutdown_connections 2024-09-15T22:47:14.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.385+0000 7f070ad03640 1 -- 172.21.15.134:0/1775741313 wait complete. 2024-09-15T22:47:14.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:14.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.495+0000 7f872796d640 1 Processor -- start 2024-09-15T22:47:14.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.495+0000 7f872796d640 1 -- start start 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f872796d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f872006be10 0x7f87200cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f872796d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f872006c1f0 0x7f872015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f872796d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87200cd5f0 con 0x7f8720151540 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f872796d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f87200cd8d0 con 0x7f872006c1f0 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f872796d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f87200cdbb0 con 0x7f872006be10 2024-09-15T22:47:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f872006c1f0 0x7f872015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f872006c1f0 0x7f872015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33544/0 (socket says 172.21.15.134:33544) 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 -- 172.21.15.134:0/2607418157 learned_addr learned my addr 172.21.15.134:0/2607418157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8725709640 1 --2- 172.21.15.134:0/2607418157 >> v2:172.21.15.177:3300/0 conn(0x7f872006be10 0x7f87200cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 -- 172.21.15.134:0/2607418157 >> v2:172.21.15.177:3300/0 conn(0x7f872006be10 msgr2=0x7f87200cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 --2- 172.21.15.134:0/2607418157 >> v2:172.21.15.177:3300/0 conn(0x7f872006be10 0x7f87200cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 -- 172.21.15.134:0/2607418157 >> v1:172.21.15.177:6789/0 conn(0x7f8720151540 legacy=0x7f8720151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.496+0000 7f8724f08640 1 -- 172.21.15.134:0/2607418157 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87200cde90 con 0x7f872006c1f0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f8724f08640 1 --2- 172.21.15.134:0/2607418157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f872006c1f0 0x7f872015baa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f872006f180 tx=0x7f871402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadf2153f2910f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f871ffff640 1 -- 172.21.15.134:0/2607418157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714036070 con 0x7f872006c1f0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f871ffff640 1 -- 172.21.15.134:0/2607418157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714031600 con 0x7f872006c1f0 2024-09-15T22:47:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f871ffff640 1 -- 172.21.15.134:0/2607418157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87140319d0 con 0x7f872006c1f0 2024-09-15T22:47:14.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 -- 172.21.15.134:0/2607418157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f872006c1f0 msgr2=0x7f872015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 --2- 172.21.15.134:0/2607418157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f872006c1f0 0x7f872015baa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f872006f180 tx=0x7f871402a730 comp rx=0 tx=0).stop 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 -- 172.21.15.134:0/2607418157 shutdown_connections 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 --2- 172.21.15.134:0/2607418157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f872006c1f0 0x7f872015baa0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 --2- 172.21.15.134:0/2607418157 >> v2:172.21.15.177:3300/0 conn(0x7f872006be10 0x7f87200cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.497+0000 7f872796d640 1 -- 172.21.15.134:0/2607418157 >> 172.21.15.134:0/2607418157 conn(0x7f8720062cc0 msgr2=0x7f872006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.498+0000 7f872796d640 1 -- 172.21.15.134:0/2607418157 shutdown_connections 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.498+0000 7f872796d640 1 -- 172.21.15.134:0/2607418157 wait complete. 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 Processor -- start 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 -- start start 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 0x7f8720153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872006c1f0 0x7f87200b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87200d0310 con 0x7f8720151540 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f87200ce690 con 0x7f872006c1f0 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f872796d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f87200d0490 con 0x7f872006be10 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.499+0000 7f8725f0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33548/0 (socket says 172.21.15.134:33548) 2024-09-15T22:47:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 -- 172.21.15.134:0/1619275411 learned_addr learned my addr 172.21.15.134:0/1619275411 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8724f08640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872006c1f0 0x7f87200b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725709640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 0x7f8720153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 -- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 msgr2=0x7f8720153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 0x7f8720153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 -- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872006c1f0 msgr2=0x7f87200b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872006c1f0 0x7f87200b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 -- 172.21.15.134:0/1619275411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87201583a0 con 0x7f8720151540 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725709640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 0x7f8720153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f8725f0a640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f871000c390 tx=0x7f871000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710017070 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100052d0 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710003810 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201f3910 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.500+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201f3ed0 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.501+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87200d07c0 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.502+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f871001a070 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.502+0000 7f871dffb640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 0x7f870c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.502+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5765+0+0 (secure 0 0 0) 0x7f871008b0b0 con 0x7f8720151540 2024-09-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.502+0000 7f8725709640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 0x7f870c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.503+0000 7f8725709640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 0x7f870c06ed10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8718009b90 tx=0x7f8718008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.506+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87100589b0 con 0x7f8720151540 2024-09-15T22:47:14.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.675+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87200b4f00 con 0x7f8720151540 2024-09-15T22:47:14.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.676+0000 7f871dffb640 1 -- 172.21.15.134:0/1619275411 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16877 (secure 0 0 0) 0x7f871005ccb0 con 0x7f8720151540 2024-09-15T22:47:14.678 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:14.678 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":133,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:13.403791+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:12.010666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:12.376443+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 msgr2=0x7f870c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 0x7f870c06ed10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8718009b90 tx=0x7f8718008040 comp rx=0 tx=0).stop 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 msgr2=0x7f87200b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f871000c390 tx=0x7f871000c850 comp rx=0 tx=0).stop 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 shutdown_connections 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06c850 0x7f870c06ed10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8720151540 0x7f87200b1760 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872006c1f0 0x7f87200b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 --2- 172.21.15.134:0/1619275411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f872006be10 0x7f8720153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 >> 172.21.15.134:0/1619275411 conn(0x7f8720062cc0 msgr2=0x7f87200b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 shutdown_connections 2024-09-15T22:47:14.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.678+0000 7f872796d640 1 -- 172.21.15.134:0/1619275411 wait complete. 2024-09-15T22:47:14.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:47:14.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.791+0000 7fafbc3d6640 1 Processor -- start 2024-09-15T22:47:14.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.792+0000 7fafbc3d6640 1 -- start start 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafbc3d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fafb40b57d0 0x7fafb40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafbc3d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb406dc40 con 0x7fafb4072290 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafbc3d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb406df20 con 0x7fafb4161cc0 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafbc3d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fafb40af300 con 0x7fafb40b57d0 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafba973640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fafb4072290 0x7fafb406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33802/0 (socket says 172.21.15.134:33802) 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafba973640 1 -- 172.21.15.134:0/234481311 learned_addr learned my addr 172.21.15.134:0/234481311 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9971640 1 --2- 172.21.15.134:0/234481311 >> v2:172.21.15.177:3300/0 conn(0x7fafb40b57d0 0x7fafb40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266800643 0 0) 0x7fafb406dc40 con 0x7fafb4072290 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003520 con 0x7fafb4072290 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9971640 1 -- 172.21.15.134:0/234481311 >> v1:172.21.15.177:6789/0 conn(0x7fafb4161cc0 legacy=0x7fafb40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952629090 0 0) 0x7fafb406df20 con 0x7fafb4161cc0 2024-09-15T22:47:14.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9971640 1 -- 172.21.15.134:0/234481311 >> v1:172.21.15.134:6789/0 conn(0x7fafb4072290 legacy=0x7fafb406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.793+0000 7fafb9971640 1 -- 172.21.15.134:0/234481311 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb406e200 con 0x7fafb40b57d0 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.794+0000 7fafb9971640 1 --2- 172.21.15.134:0/234481311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb40b57d0 0x7fafb40b5c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fafa80097a0 tx=0x7fafa802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6246b1ea96e8c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.794+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8037070 con 0x7fafb40b57d0 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.794+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa8032440 con 0x7fafb40b57d0 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.794+0000 7fafb9170640 1 -- 172.21.15.134:0/234481311 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa80327f0 con 0x7fafb40b57d0 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 -- 172.21.15.134:0/234481311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb40b57d0 msgr2=0x7fafb40b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/234481311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb40b57d0 0x7fafb40b5c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fafa80097a0 tx=0x7fafa802a230 comp rx=0 tx=0).stop 2024-09-15T22:47:14.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 -- 172.21.15.134:0/234481311 shutdown_connections 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/234481311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb40b57d0 0x7fafb40b5c40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 -- 172.21.15.134:0/234481311 >> 172.21.15.134:0/234481311 conn(0x7fafb406bba0 msgr2=0x7fafb406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 -- 172.21.15.134:0/234481311 shutdown_connections 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.795+0000 7fafbc3d6640 1 -- 172.21.15.134:0/234481311 wait complete. 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.796+0000 7fafbc3d6640 1 Processor -- start 2024-09-15T22:47:14.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.796+0000 7fafbc3d6640 1 -- start start 2024-09-15T22:47:14.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb4072290 0x7fafb4160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb4161cc0 0x7fafb4159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fafb406f110 con 0x7fafb40b57d0 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafb406e570 con 0x7fafb4072290 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fafb406f290 con 0x7fafb4161cc0 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33562/0 (socket says 172.21.15.134:33562) 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 -- 172.21.15.134:0/3798559662 learned_addr learned my addr 172.21.15.134:0/3798559662 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafba172640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb4072290 0x7fafb4160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 -- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb4161cc0 msgr2=0x7fafb4159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb4161cc0 0x7fafb4159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 -- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb4072290 msgr2=0x7fafb4160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:14.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb4072290 0x7fafb4160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 -- 172.21.15.134:0/3798559662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb415a0c0 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafb9971640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fafa802a270 tx=0x7fafa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8037040 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa8042070 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb41f5130 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8030900 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.797+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41f4650 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.798+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb40b5c40 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.799+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fafa8030aa0 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.799+0000 7fafa6ffd640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 0x7faf9806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.799+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5765+0+0 (secure 0 0 0) 0x7fafa80ac820 con 0x7fafb40b57d0 2024-09-15T22:47:14.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.800+0000 7fafba172640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 0x7faf9806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:14.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.800+0000 7fafba172640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 0x7faf9806ed10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000f60 tx=0x7fafb0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:14.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:14.804+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafa807a770 con 0x7fafb40b57d0 2024-09-15T22:47:15.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.003+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fafb4072f90 con 0x7fafb40b57d0 2024-09-15T22:47:15.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.072+0000 7fafa6ffd640 1 -- 172.21.15.134:0/3798559662 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7fafa807a070 con 0x7fafb40b57d0 2024-09-15T22:47:15.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.074+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 msgr2=0x7faf9806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.074+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 0x7faf9806ed10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000f60 tx=0x7fafb0009040 comp rx=0 tx=0).stop 2024-09-15T22:47:15.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.074+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 msgr2=0x7fafb4159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.074+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fafa802a270 tx=0x7fafa80046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 shutdown_connections 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb4161cc0 0x7fafb4159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faf9806c850 0x7faf9806ed10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafb40b57d0 0x7fafb4159640 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 --2- 172.21.15.134:0/3798559662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb4072290 0x7fafb4160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 >> 172.21.15.134:0/3798559662 conn(0x7fafb406bba0 msgr2=0x7fafb406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 shutdown_connections 2024-09-15T22:47:15.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.075+0000 7fafbc3d6640 1 -- 172.21.15.134:0/3798559662 wait complete. 2024-09-15T22:47:15.087 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:47:15.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:47:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.187+0000 7ff3785c4640 1 Processor -- start 2024-09-15T22:47:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.187+0000 7ff3785c4640 1 -- start start 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff3785c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff370071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff3785c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3700715c0 con 0x7ff3700cf320 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff3785c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37006d700 con 0x7ff37015d790 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff3785c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff37006da30 con 0x7ff37015d3b0 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff376b61640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff3700cf320 0x7ff3700cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33812/0 (socket says 172.21.15.134:33812) 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff376b61640 1 -- 172.21.15.134:0/592689893 learned_addr learned my addr 172.21.15.134:0/592689893 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff376360640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff370071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187897366 0 0) 0x7ff3700715c0 con 0x7ff3700cf320 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35c003520 con 0x7ff3700cf320 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063098358 0 0) 0x7ff35c003520 con 0x7ff3700cf320 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 msgr2=0x7ff370071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff370071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 >> v1:172.21.15.177:6789/0 conn(0x7ff37015d790 legacy=0x7ff3700cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3700cde80 con 0x7ff3700cf320 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7ff3680019f0 con 0x7ff3700cf320 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 >> v1:172.21.15.134:6789/0 conn(0x7ff3700cf320 legacy=0x7ff3700cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0039e0 0x7ff35c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff35c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff35c004d40 0x7ff35c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff37006da30 con 0x7ff35c004d40 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c00ba70 con 0x7ff35c0039e0 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c00bc70 con 0x7ff37015d3b0 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.188+0000 7ff376b61640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff35c004d40 0x7ff35c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376360640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0039e0 0x7ff35c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff375b5f640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff35c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 -- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 msgr2=0x7ff35c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015d3b0 0x7ff35c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 -- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0039e0 msgr2=0x7ff35c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0039e0 0x7ff35c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 -- 172.21.15.134:0/592689893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c003520 con 0x7ff35c004d40 2024-09-15T22:47:15.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.189+0000 7ff376b61640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff35c004d40 0x7ff35c0051c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7ff368002230 tx=0x7ff35c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4b823bcf7ad8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:15.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36800a4a0 con 0x7ff35c004d40 2024-09-15T22:47:15.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36802f070 con 0x7ff35c004d40 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff37535e640 1 -- 172.21.15.134:0/592689893 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36802bcb0 con 0x7ff35c004d40 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 -- 172.21.15.134:0/592689893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff35c004d40 msgr2=0x7ff35c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 --2- 172.21.15.134:0/592689893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff35c004d40 0x7ff35c0051c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7ff368002230 tx=0x7ff35c005830 comp rx=0 tx=0).stop 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff376b61640 1 -- 172.21.15.134:0/592689893 reap_dead start 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 -- 172.21.15.134:0/592689893 shutdown_connections 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 -- 172.21.15.134:0/592689893 >> 172.21.15.134:0/592689893 conn(0x7ff37006bba0 msgr2=0x7ff37006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 -- 172.21.15.134:0/592689893 shutdown_connections 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.190+0000 7ff3785c4640 1 -- 172.21.15.134:0/592689893 wait complete. 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.191+0000 7ff3785c4640 1 Processor -- start 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.191+0000 7ff3785c4640 1 -- start start 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c004d40 0x7ff3701553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015e390 0x7ff3700ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700cd580 con 0x7ff370155ca0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700cdba0 con 0x7ff35c004d40 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff3785c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff37015cbf0 con 0x7ff37015e390 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33586/0 (socket says 172.21.15.134:33586) 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 -- 172.21.15.134:0/2160264506 learned_addr learned my addr 172.21.15.134:0/2160264506 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 -- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015e390 msgr2=0x7ff3700ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015e390 0x7ff3700ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 -- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c004d40 msgr2=0x7ff3701553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c004d40 0x7ff3701553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.192+0000 7ff375b5f640 1 -- 172.21.15.134:0/2160264506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37015b330 con 0x7ff370155ca0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff375b5f640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00f7a0 tx=0x7ff36c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0050d0 con 0x7ff370155ca0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c018070 con 0x7ff370155ca0 2024-09-15T22:47:15.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37015b610 con 0x7ff370155ca0 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c005490 con 0x7ff370155ca0 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.193+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37015bbd0 con 0x7ff370155ca0 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.194+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37015e7b0 con 0x7ff370155ca0 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.194+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7ff36c00d730 con 0x7ff370155ca0 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.195+0000 7ff366ffd640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 0x7ff35406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.195+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7ff36c08bd50 con 0x7ff370155ca0 2024-09-15T22:47:15.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.195+0000 7ff376360640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 0x7ff35406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:15.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.196+0000 7ff376360640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 0x7ff35406ed10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff360009ab0 tx=0x7ff3600095d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:15.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.199+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff36c092080 con 0x7ff370155ca0 2024-09-15T22:47:15.337 INFO:tasks.ceph.mds.c.smithi134.stderr:2024-09-15T22:47:15.336+0000 7fcbf8f79640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:47:15.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:15.401+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff3700cf730 con 0x7ff370155ca0 2024-09-15T22:47:16.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.086+0000 7ff366ffd640 1 -- 172.21.15.134:0/2160264506 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7ff36c059c10 con 0x7ff370155ca0 2024-09-15T22:47:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 msgr2=0x7ff35406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 0x7ff35406ed10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff360009ab0 tx=0x7ff3600095d0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 msgr2=0x7ff37015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00f7a0 tx=0x7ff36c00fc60 comp rx=0 tx=0).stop 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 shutdown_connections 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37015e390 0x7ff3700ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff35406c850 0x7ff35406ed10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370155ca0 0x7ff37015de50 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 --2- 172.21.15.134:0/2160264506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c004d40 0x7ff3701553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 >> 172.21.15.134:0/2160264506 conn(0x7ff37006bba0 msgr2=0x7ff3701567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 shutdown_connections 2024-09-15T22:47:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.089+0000 7ff3785c4640 1 -- 172.21.15.134:0/2160264506 wait complete. 2024-09-15T22:47:16.102 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:47:16.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.201+0000 7fbee6cb7640 1 Processor -- start 2024-09-15T22:47:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 -- start start 2024-09-15T22:47:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbee015e940 0x7fbee00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbee015ed20 0x7fbee00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee00b7170 con 0x7fbee00cef90 2024-09-15T22:47:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbee00d1ae0 con 0x7fbee015ed20 2024-09-15T22:47:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee6cb7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbee00b7aa0 con 0x7fbee015e940 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbed7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbee015ed20 0x7fbee00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee5254640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbee00cef90 0x7fbee00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38874/0 (socket says 172.21.15.134:38874) 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.202+0000 7fbee5254640 1 -- 172.21.15.134:0/2908680231 learned_addr learned my addr 172.21.15.134:0/2908680231 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbee4a53640 1 --2- 172.21.15.134:0/2908680231 >> v2:172.21.15.177:3300/0 conn(0x7fbee015e940 0x7fbee00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbed7fff640 1 -- 172.21.15.134:0/2908680231 >> v2:172.21.15.177:3300/0 conn(0x7fbee015e940 msgr2=0x7fbee00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbed7fff640 1 --2- 172.21.15.134:0/2908680231 >> v2:172.21.15.177:3300/0 conn(0x7fbee015e940 0x7fbee00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbed7fff640 1 -- 172.21.15.134:0/2908680231 >> v1:172.21.15.134:6789/0 conn(0x7fbee00cef90 legacy=0x7fbee00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbed7fff640 1 -- 172.21.15.134:0/2908680231 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00d3660 con 0x7fbee015ed20 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.203+0000 7fbed7fff640 1 --2- 172.21.15.134:0/2908680231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015ed20 0x7fbee00d15a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbee00509d0 tx=0x7fbed002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65adc5a2d05ef903 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbed77fe640 1 -- 172.21.15.134:0/2908680231 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0037070 con 0x7fbee015ed20 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbed77fe640 1 -- 172.21.15.134:0/2908680231 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0032440 con 0x7fbee015ed20 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbed77fe640 1 -- 172.21.15.134:0/2908680231 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0032810 con 0x7fbee015ed20 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 -- 172.21.15.134:0/2908680231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015ed20 msgr2=0x7fbee00d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/2908680231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015ed20 0x7fbee00d15a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbee00509d0 tx=0x7fbed002a230 comp rx=0 tx=0).stop 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 -- 172.21.15.134:0/2908680231 shutdown_connections 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/2908680231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015ed20 0x7fbee00d15a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/2908680231 >> v2:172.21.15.177:3300/0 conn(0x7fbee015e940 0x7fbee00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 -- 172.21.15.134:0/2908680231 >> 172.21.15.134:0/2908680231 conn(0x7fbee00b6240 msgr2=0x7fbee00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 -- 172.21.15.134:0/2908680231 shutdown_connections 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.204+0000 7fbee6cb7640 1 -- 172.21.15.134:0/2908680231 wait complete. 2024-09-15T22:47:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.205+0000 7fbee6cb7640 1 Processor -- start 2024-09-15T22:47:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.205+0000 7fbee6cb7640 1 -- start start 2024-09-15T22:47:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 0x7fbee0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 0x7fbee00afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00d3f00 con 0x7fbee015e940 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00d3c20 con 0x7fbee015ed20 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbee6cb7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbee00d3310 con 0x7fbee00cef90 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbed7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbed7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46922/0 (socket says 172.21.15.134:46922) 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.206+0000 7fbed7fff640 1 -- 172.21.15.134:0/85501663 learned_addr learned my addr 172.21.15.134:0/85501663 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee4a53640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 0x7fbee0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee5254640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 0x7fbee00afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 -- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 msgr2=0x7fbee0153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 0x7fbee0153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 -- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 msgr2=0x7fbee00afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 0x7fbee00afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 -- 172.21.15.134:0/85501663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00ae4c0 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee4a53640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 0x7fbee0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee5254640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 0x7fbee00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed7fff640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009890 tx=0x7fbed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0037040 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0042070 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee00ae7a0 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0030bd0 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.207+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee00af040 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.208+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee00aeb90 con 0x7fbee015e940 2024-09-15T22:47:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.209+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fbed0047460 con 0x7fbee015e940 2024-09-15T22:47:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.209+0000 7fbed57fa640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 0x7fbecc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.209+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fbed00aca90 con 0x7fbee015e940 2024-09-15T22:47:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.209+0000 7fbee4a53640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 0x7fbecc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.210+0000 7fbee4a53640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 0x7fbecc06ed10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006fd0 tx=0x7fbedc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.213+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbed0032e20 con 0x7fbee015e940 2024-09-15T22:47:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.410+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbee00d1ef0 con 0x7fbee015e940 2024-09-15T22:47:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.410+0000 7fbed57fa640 1 -- 172.21.15.134:0/85501663 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5239 (secure 0 0 0) 0x7fbed007a9e0 con 0x7fbee015e940 2024-09-15T22:47:16.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:16.412 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":68,"btime":"2024-09-15T22:47:16:079894+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 68 2024-09-15T22:47:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 msgr2=0x7fbecc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 0x7fbecc06ed10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006fd0 tx=0x7fbedc008040 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 msgr2=0x7fbee00ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009890 tx=0x7fbed00046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 shutdown_connections 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbee015ed20 0x7fbee00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbecc06c850 0x7fbecc06ed10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbee015e940 0x7fbee00ac5d0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 --2- 172.21.15.134:0/85501663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbee00cef90 0x7fbee0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 >> 172.21.15.134:0/85501663 conn(0x7fbee00b6240 msgr2=0x7fbee00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 shutdown_connections 2024-09-15T22:47:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.412+0000 7fbee6cb7640 1 -- 172.21.15.134:0/85501663 wait complete. 2024-09-15T22:47:16.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:16.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 Processor -- start 2024-09-15T22:47:16.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 -- start start 2024-09-15T22:47:16.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f675815e940 0x7f67580d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67580cef90 0x7f67580d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67580b7170 con 0x7f675815ed20 2024-09-15T22:47:16.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f67580d1ae0 con 0x7f675815e940 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.522+0000 7f675e3e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f67580b7aa0 con 0x7f67580cef90 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f675815e940 0x7f67580d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f675815e940 0x7f67580d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46926/0 (socket says 172.21.15.134:46926) 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 -- 172.21.15.134:0/879736787 learned_addr learned my addr 172.21.15.134:0/879736787 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f675c981640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67580cef90 0x7f67580d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 -- 172.21.15.134:0/879736787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67580cef90 msgr2=0x7f67580d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67580cef90 0x7f67580d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 -- 172.21.15.134:0/879736787 >> v1:172.21.15.177:6789/0 conn(0x7f675815ed20 legacy=0x7f67580b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.523+0000 7f6757fff640 1 -- 172.21.15.134:0/879736787 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67580d3660 con 0x7f675815e940 2024-09-15T22:47:16.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f6757fff640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580d1060 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6748009870 tx=0x7f674802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65d79902c3d2f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f6756ffd640 1 -- 172.21.15.134:0/879736787 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748037070 con 0x7f675815e940 2024-09-15T22:47:16.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f6756ffd640 1 -- 172.21.15.134:0/879736787 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674802ae50 con 0x7f675815e940 2024-09-15T22:47:16.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f6756ffd640 1 -- 172.21.15.134:0/879736787 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748032860 con 0x7f675815e940 2024-09-15T22:47:16.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 -- 172.21.15.134:0/879736787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 msgr2=0x7f67580d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580d1060 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6748009870 tx=0x7f674802a300 comp rx=0 tx=0).stop 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 -- 172.21.15.134:0/879736787 shutdown_connections 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67580cef90 0x7f67580d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 --2- 172.21.15.134:0/879736787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580d1060 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 -- 172.21.15.134:0/879736787 >> 172.21.15.134:0/879736787 conn(0x7f67580b6240 msgr2=0x7f67580b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 -- 172.21.15.134:0/879736787 shutdown_connections 2024-09-15T22:47:16.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.524+0000 7f675e3e4640 1 -- 172.21.15.134:0/879736787 wait complete. 2024-09-15T22:47:16.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 Processor -- start 2024-09-15T22:47:16.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 -- start start 2024-09-15T22:47:16.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67580cef90 0x7f67581574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f675815ed20 0x7f67580ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67580d3f00 con 0x7f675815e940 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67580d3c20 con 0x7f67580cef90 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.526+0000 7f675e3e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f67580d3310 con 0x7f675815ed20 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46932/0 (socket says 172.21.15.134:46932) 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 -- 172.21.15.134:0/1834651949 learned_addr learned my addr 172.21.15.134:0/1834651949 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f6757fff640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67580cef90 0x7f67581574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f675c981640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f675815ed20 0x7f67580ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 -- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f675815ed20 msgr2=0x7f67580ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f675815ed20 0x7f67580ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 -- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67580cef90 msgr2=0x7f67581574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67580cef90 0x7f67581574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 -- 172.21.15.134:0/1834651949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67580cd1b0 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f67577fe640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c470 tx=0x7f674c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c0052d0 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c005470 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c007260 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67580b5bf0 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.527+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67581e9b70 con 0x7f675815e940 2024-09-15T22:47:16.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.528+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67580d1ef0 con 0x7f675815e940 2024-09-15T22:47:16.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.529+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f674c007400 con 0x7f675815e940 2024-09-15T22:47:16.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.529+0000 7f6754ff9640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 0x7f674406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.529+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f674c08b300 con 0x7f675815e940 2024-09-15T22:47:16.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.530+0000 7f6757fff640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 0x7f674406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.530+0000 7f6757fff640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 0x7f674406ed10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6748034000 tx=0x7f674802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.533+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67580b7170 con 0x7f675815e940 2024-09-15T22:47:16.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.699+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67580b5ef0 con 0x7f675815e940 2024-09-15T22:47:16.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.700+0000 7f6754ff9640 1 -- 172.21.15.134:0/1834651949 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16864 (secure 0 0 0) 0x7f674c058b70 con 0x7f675815e940 2024-09-15T22:47:16.701 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:16.701 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":134,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:15.059547+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:12.010666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:12.376443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 msgr2=0x7f674406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 0x7f674406ed10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6748034000 tx=0x7f674802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 msgr2=0x7f67580b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c470 tx=0x7f674c001e70 comp rx=0 tx=0).stop 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 shutdown_connections 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f675815ed20 0x7f67580ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f674406c850 0x7f674406ed10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675815e940 0x7f67580b5450 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 --2- 172.21.15.134:0/1834651949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67580cef90 0x7f67581574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 >> 172.21.15.134:0/1834651949 conn(0x7f67580b6240 msgr2=0x7f67580b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 shutdown_connections 2024-09-15T22:47:16.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.702+0000 7f675e3e4640 1 -- 172.21.15.134:0/1834651949 wait complete. 2024-09-15T22:47:16.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:47:16.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:16.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.811+0000 7f5a59dc4640 1 Processor -- start 2024-09-15T22:47:16.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.811+0000 7f5a59dc4640 1 -- start start 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a59dc4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a5415c5e0 0x7f5a540712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a59dc4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a540b66e0 0x7f5a540b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a59dc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5415c9c0 con 0x7f5a540b6d50 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a59dc4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5a54074100 con 0x7f5a540b66e0 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a59dc4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5a540b76d0 con 0x7f5a5415c5e0 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a53fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a540b66e0 0x7f5a540b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a4affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5a540b6d50 0x7f5a541600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38890/0 (socket says 172.21.15.134:38890) 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a53fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a540b66e0 0x7f5a540b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46942/0 (socket says 172.21.15.134:46942) 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.812+0000 7f5a4affd640 1 -- 172.21.15.134:0/1944766980 learned_addr learned my addr 172.21.15.134:0/1944766980 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a537fe640 1 --2- 172.21.15.134:0/1944766980 >> v2:172.21.15.177:3300/0 conn(0x7f5a5415c5e0 0x7f5a540712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a53fff640 1 -- 172.21.15.134:0/1944766980 >> v2:172.21.15.177:3300/0 conn(0x7f5a5415c5e0 msgr2=0x7f5a540712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a53fff640 1 --2- 172.21.15.134:0/1944766980 >> v2:172.21.15.177:3300/0 conn(0x7f5a5415c5e0 0x7f5a540712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a53fff640 1 -- 172.21.15.134:0/1944766980 >> v1:172.21.15.134:6789/0 conn(0x7f5a540b6d50 legacy=0x7f5a541600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a52ffd640 1 -- 172.21.15.134:0/1944766980 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696665712 0 0) 0x7f5a5415c9c0 con 0x7f5a540b6d50 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a53fff640 1 -- 172.21.15.134:0/1944766980 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a540b1dd0 con 0x7f5a540b66e0 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.813+0000 7f5a53fff640 1 --2- 172.21.15.134:0/1944766980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a540b66e0 0x7f5a540b7190 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5a540638c0 tx=0x7f5a4c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d16969577987464 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a52ffd640 1 -- 172.21.15.134:0/1944766980 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c007740 con 0x7f5a540b66e0 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a52ffd640 1 -- 172.21.15.134:0/1944766980 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0078e0 con 0x7f5a540b66e0 2024-09-15T22:47:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a52ffd640 1 -- 172.21.15.134:0/1944766980 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c007cb0 con 0x7f5a540b66e0 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 -- 172.21.15.134:0/1944766980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a540b66e0 msgr2=0x7f5a540b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/1944766980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a540b66e0 0x7f5a540b7190 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5a540638c0 tx=0x7f5a4c02a680 comp rx=0 tx=0).stop 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 -- 172.21.15.134:0/1944766980 shutdown_connections 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/1944766980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a540b66e0 0x7f5a540b7190 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/1944766980 >> v2:172.21.15.177:3300/0 conn(0x7f5a5415c5e0 0x7f5a540712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 -- 172.21.15.134:0/1944766980 >> 172.21.15.134:0/1944766980 conn(0x7f5a540b4220 msgr2=0x7f5a540b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 -- 172.21.15.134:0/1944766980 shutdown_connections 2024-09-15T22:47:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.814+0000 7f5a59dc4640 1 -- 172.21.15.134:0/1944766980 wait complete. 2024-09-15T22:47:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.815+0000 7f5a59dc4640 1 Processor -- start 2024-09-15T22:47:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 -- start start 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 0x7f5a541f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a540b6d50 0x7f5a541f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a54073ab0 con 0x7f5a5415c5e0 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a540737d0 con 0x7f5a540b66e0 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a59dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a54073d90 con 0x7f5a540b6d50 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a53fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a53fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46948/0 (socket says 172.21.15.134:46948) 2024-09-15T22:47:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.816+0000 7f5a53fff640 1 -- 172.21.15.134:0/3469553375 learned_addr learned my addr 172.21.15.134:0/3469553375 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a537fe640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 0x7f5a541f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a4affd640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a540b6d50 0x7f5a541f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 -- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a540b6d50 msgr2=0x7f5a541f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a540b6d50 0x7f5a541f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 -- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 msgr2=0x7f5a541f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 0x7f5a541f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 -- 172.21.15.134:0/3469553375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a54152da0 con 0x7f5a5415c5e0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a537fe640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 0x7f5a541f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a53fff640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c02ac70 tx=0x7f5a4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c040070 con 0x7f5a5415c5e0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c031bc0 con 0x7f5a5415c5e0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a54153080 con 0x7f5a5415c5e0 2024-09-15T22:47:16.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c009450 con 0x7f5a5415c5e0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.817+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a54153640 con 0x7f5a5415c5e0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.818+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5415be30 con 0x7f5a5415c5e0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.819+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5a4c039040 con 0x7f5a5415c5e0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.819+0000 7f5a50ff9640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 0x7f5a3406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.819+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5a4c0ad820 con 0x7f5a5415c5e0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.819+0000 7f5a537fe640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 0x7f5a3406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:16.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.820+0000 7f5a537fe640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 0x7f5a3406ed10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009af0 tx=0x7f5a44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:16.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.823+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a4c07b6a0 con 0x7f5a5415c5e0 2024-09-15T22:47:16.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.985+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a541f5d40 con 0x7f5a3406c850 2024-09-15T22:47:16.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.992+0000 7f5a50ff9640 1 -- 172.21.15.134:0/3469553375 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240285 (secure 0 0 0) 0x7f5a440119b0 con 0x7f5a3406c850 2024-09-15T22:47:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:16.996 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:16.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 msgr2=0x7f5a3406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 0x7f5a3406ed10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009af0 tx=0x7f5a44008040 comp rx=0 tx=0).stop 2024-09-15T22:47:16.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 msgr2=0x7f5a541592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:16.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c02ac70 tx=0x7f5a4c004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:16.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 shutdown_connections 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3406c850 0x7f5a3406ed10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5415c5e0 0x7f5a541592d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a540b6d50 0x7f5a541f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 --2- 172.21.15.134:0/3469553375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a540b66e0 0x7f5a541f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 >> 172.21.15.134:0/3469553375 conn(0x7f5a540b4220 msgr2=0x7f5a540d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 shutdown_connections 2024-09-15T22:47:16.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:16.995+0000 7f5a59dc4640 1 -- 172.21.15.134:0/3469553375 wait complete. 2024-09-15T22:47:17.006 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-15T22:47:15.208622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263328,"kb_used_data":13796,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711392,"statfs":{"total":773094113280,"available":772824465408,"internally_reserved":0,"allocated":14127104,"data_stored":6847781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000699"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056955+0000","last_change":"2024-09-15T22:47:12.056955+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056955+0000","last_undegraded":"2024-09-15T22:47:12.056955+0000","last_fullsized":"2024-09-15T22:47:12.056955+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055319+0000","last_change":"2024-09-15T22:47:12.055319+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055319+0000","last_undegraded":"2024-09-15T22:47:12.055319+0000","last_fullsized":"2024-09-15T22:47:12.055319+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056423+0000","last_change":"2024-09-15T22:47:12.056423+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056423+0000","last_undegraded":"2024-09-15T22:47:12.056423+0000","last_fullsized":"2024-09-15T22:47:12.056423+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056412+0000","last_change":"2024-09-15T22:47:12.056412+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056412+0000","last_undegraded":"2024-09-15T22:47:12.056412+0000","last_fullsized":"2024-09-15T22:47:12.056412+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058635+0000","last_change":"2024-09-15T22:47:12.058635+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058635+0000","last_undegraded":"2024-09-15T22:47:12.058635+0000","last_fullsized":"2024-09-15T22:47:12.058635+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.060850+0000","last_change":"2024-09-15T22:47:12.060850+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.060850+0000","last_undegraded":"2024-09-15T22:47:12.060850+0000","last_fullsized":"2024-09-15T22:47:12.060850+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055473+0000","last_change":"2024-09-15T22:47:12.055473+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055473+0000","last_undegraded":"2024-09-15T22:47:12.055473+0000","last_fullsized":"2024-09-15T22:47:12.055473+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056617+0000","last_change":"2024-09-15T22:47:12.056617+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056617+0000","last_undegraded":"2024-09-15T22:47:12.056617+0000","last_fullsized":"2024-09-15T22:47:12.056617+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055398+0000","last_change":"2024-09-15T22:47:12.055398+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055398+0000","last_undegraded":"2024-09-15T22:47:12.055398+0000","last_fullsized":"2024-09-15T22:47:12.055398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.060866+0000","last_change":"2024-09-15T22:47:12.060866+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.060866+0000","last_undegraded":"2024-09-15T22:47:12.060866+0000","last_fullsized":"2024-09-15T22:47:12.060866+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056123+0000","last_change":"2024-09-15T22:47:12.056123+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056123+0000","last_undegraded":"2024-09-15T22:47:12.056123+0000","last_fullsized":"2024-09-15T22:47:12.056123+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056329+0000","last_change":"2024-09-15T22:47:12.056329+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056329+0000","last_undegraded":"2024-09-15T22:47:12.056329+0000","last_fullsized":"2024-09-15T22:47:12.056329+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058413+0000","last_change":"2024-09-15T22:47:12.058413+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058413+0000","last_undegraded":"2024-09-15T22:47:12.058413+0000","last_fullsized":"2024-09-15T22:47:12.058413+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.057762+0000","last_change":"2024-09-15T22:47:12.057762+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.057762+0000","last_undegraded":"2024-09-15T22:47:12.057762+0000","last_fullsized":"2024-09-15T22:47:12.057762+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058490+0000","last_change":"2024-09-15T22:47:12.058490+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058490+0000","last_undegraded":"2024-09-15T22:47:12.058490+0000","last_fullsized":"2024-09-15T22:47:12.058490+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058555+0000","last_change":"2024-09-15T22:47:12.058555+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058555+0000","last_undegraded":"2024-09-15T22:47:12.058555+0000","last_fullsized":"2024-09-15T22:47:12.058555+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.059416+0000","last_change":"2024-09-15T22:47:12.059416+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.059416+0000","last_undegraded":"2024-09-15T22:47:12.059416+0000","last_fullsized":"2024-09-15T22:47:12.059416+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056765+0000","last_change":"2024-09-15T22:47:12.056765+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056765+0000","last_undegraded":"2024-09-15T22:47:12.056765+0000","last_fullsized":"2024-09-15T22:47:12.056765+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058082+0000","last_change":"2024-09-15T22:47:12.058082+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058082+0000","last_undegraded":"2024-09-15T22:47:12.058082+0000","last_fullsized":"2024-09-15T22:47:12.058082+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055329+0000","last_change":"2024-09-15T22:47:12.055329+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055329+0000","last_undegraded":"2024-09-15T22:47:12.055329+0000","last_fullsized":"2024-09-15T22:47:12.055329+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058120+0000","last_change":"2024-09-15T22:47:12.058120+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058120+0000","last_undegraded":"2024-09-15T22:47:12.058120+0000","last_fullsized":"2024-09-15T22:47:12.058120+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058292+0000","last_change":"2024-09-15T22:47:12.058292+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058292+0000","last_undegraded":"2024-09-15T22:47:12.058292+0000","last_fullsized":"2024-09-15T22:47:12.058292+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058459+0000","last_change":"2024-09-15T22:47:12.058459+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058459+0000","last_undegraded":"2024-09-15T22:47:12.058459+0000","last_fullsized":"2024-09-15T22:47:12.058459+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058116+0000","last_change":"2024-09-15T22:47:12.058116+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058116+0000","last_undegraded":"2024-09-15T22:47:12.058116+0000","last_fullsized":"2024-09-15T22:47:12.058116+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.057824+0000","last_change":"2024-09-15T22:47:12.057824+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.057824+0000","last_undegraded":"2024-09-15T22:47:12.057824+0000","last_fullsized":"2024-09-15T22:47:12.057824+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055929+0000","last_change":"2024-09-15T22:47:12.055929+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055929+0000","last_undegraded":"2024-09-15T22:47:12.055929+0000","last_fullsized":"2024-09-15T22:47:12.055929+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055602+0000","last_change":"2024-09-15T22:47:12.055602+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055602+0000","last_undegraded":"2024-09-15T22:47:12.055602+0000","last_fullsized":"2024-09-15T22:47:12.055602+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.057832+0000","last_change":"2024-09-15T22:47:12.057832+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.057832+0000","last_undegraded":"2024-09-15T22:47:12.057832+0000","last_fullsized":"2024-09-15T22:47:12.057832+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.056329+0000","last_change":"2024-09-15T22:47:12.056329+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.056329+0000","last_undegraded":"2024-09-15T22:47:12.056329+0000","last_fullsized":"2024-09-15T22:47:12.056329+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.057840+0000","last_change":"2024-09-15T22:47:12.057840+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.057840+0000","last_undegraded":"2024-09-15T22:47:12.057840+0000","last_fullsized":"2024-09-15T22:47:12.057840+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.055421+0000","last_change":"2024-09-15T22:47:12.055421+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.055421+0000","last_undegraded":"2024-09-15T22:47:12.055421+0000","last_fullsized":"2024-09-15T22:47:12.055421+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:13.053086+0000","last_change":"2024-09-15T22:47:13.053086+0000","last_active":"2024-09-15T22:47:13.053086+0000","last_peered":"2024-09-15T22:47:13.053086+0000","last_clean":"2024-09-15T22:47:13.053086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:13.053086+0000","last_undegraded":"2024-09-15T22:47:13.053086+0000","last_fullsized":"2024-09-15T22:47:13.053086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":131,"state":"creating+peering","last_fresh":"2024-09-15T22:47:12.058420+0000","last_change":"2024-09-15T22:47:12.058420+0000","last_active":"2024-09-15T22:47:12.048468+0000","last_peered":"2024-09-15T22:47:12.048468+0000","last_clean":"2024-09-15T22:47:12.048468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:12.058420+0000","last_undegraded":"2024-09-15T22:47:12.058420+0000","last_fullsized":"2024-09-15T22:47:12.058420+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":409,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-15T22:47:12.061245+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:12.061245+0000","last_peered":"2024-09-15T22:47:12.061245+0000","last_clean":"2024-09-15T22:47:12.061245+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:12.061245+0000","last_undegraded":"2024-09-15T22:47:12.061245+0000","last_fullsized":"2024-09-15T22:47:12.061245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":710238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":716111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33340,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338500,"statfs":{"total":96636764160,"available":96602624000,"internally_reserved":0,"allocated":2203648,"data_stored":1295423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":710238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":705055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":705055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33348,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338492,"statfs":{"total":96636764160,"available":96602615808,"internally_reserved":0,"allocated":2203648,"data_stored":1295423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1622016,"data_stored":710238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:17.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:17.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.145+0000 7fa7a358d640 1 Processor -- start 2024-09-15T22:47:17.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 -- start start 2024-09-15T22:47:17.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa79c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa79c15ed20 0x7fa79c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c0b7170 con 0x7fa79c0cef90 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa79c0d1ae0 con 0x7fa79c15ed20 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.146+0000 7fa7a358d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c0b7aa0 con 0x7fa79c15e940 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a1b2a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa79c0cef90 0x7fa79c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38894/0 (socket says 172.21.15.134:38894) 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a1b2a640 1 -- 172.21.15.134:0/3915833990 learned_addr learned my addr 172.21.15.134:0/3915833990 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a0b28640 1 --2- 172.21.15.134:0/3915833990 >> v2:172.21.15.177:3300/0 conn(0x7fa79c15ed20 0x7fa79c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a1329640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa79c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255254213 0 0) 0x7fa794001490 con 0x7fa79c0cef90 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa788003520 con 0x7fa79c0cef90 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4277389809 0 0) 0x7fa788003520 con 0x7fa79c0cef90 2024-09-15T22:47:17.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 msgr2=0x7fa79c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa79c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 >> v2:172.21.15.177:3300/0 conn(0x7fa79c15ed20 msgr2=0x7fa79c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 --2- 172.21.15.134:0/3915833990 >> v2:172.21.15.177:3300/0 conn(0x7fa79c15ed20 0x7fa79c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c0d3660 con 0x7fa79c0cef90 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa794001bc0 con 0x7fa79c0cef90 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 >> v1:172.21.15.134:6789/0 conn(0x7fa79c0cef90 legacy=0x7fa79c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa7880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa788003f30 0x7fa788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa788004d40 0x7fa7880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0b7aa0 con 0x7fa788004d40 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa78800b9c0 con 0x7fa788003f30 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa78800bb70 con 0x7fa79c15e940 2024-09-15T22:47:17.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a1b2a640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa788004d40 0x7fa7880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a0b28640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa788003f30 0x7fa788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.147+0000 7fa7a1329640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa7880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 -- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 msgr2=0x7fa7880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c15e940 0x7fa7880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 -- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa788003f30 msgr2=0x7fa788004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa788003f30 0x7fa788004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 -- 172.21.15.134:0/3915833990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa788003520 con 0x7fa788004d40 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa7a1b2a640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa788004d40 0x7fa7880051c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa79400aa50 tx=0x7fa788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198197302fd3e156 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79400a670 con 0x7fa788004d40 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79402f070 con 0x7fa788004d40 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.148+0000 7fa78ffff640 1 -- 172.21.15.134:0/3915833990 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794034470 con 0x7fa788004d40 2024-09-15T22:47:17.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 -- 172.21.15.134:0/3915833990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa788004d40 msgr2=0x7fa7880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 --2- 172.21.15.134:0/3915833990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa788004d40 0x7fa7880051c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa79400aa50 tx=0x7fa788005830 comp rx=0 tx=0).stop 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a1b2a640 1 -- 172.21.15.134:0/3915833990 reap_dead start 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 -- 172.21.15.134:0/3915833990 shutdown_connections 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 -- 172.21.15.134:0/3915833990 >> 172.21.15.134:0/3915833990 conn(0x7fa79c0b6240 msgr2=0x7fa79c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 -- 172.21.15.134:0/3915833990 shutdown_connections 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.149+0000 7fa7a358d640 1 -- 172.21.15.134:0/3915833990 wait complete. 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.150+0000 7fa7a358d640 1 Processor -- start 2024-09-15T22:47:17.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.150+0000 7fa7a358d640 1 -- start start 2024-09-15T22:47:17.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa788004d40 0x7fa79c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c9560 0x7fa79c0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0d3f00 con 0x7fa79c155d70 2024-09-15T22:47:17.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0d3c20 con 0x7fa79c0c9560 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a358d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c0d3310 con 0x7fa788004d40 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46958/0 (socket says 172.21.15.134:46958) 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 -- 172.21.15.134:0/734724362 learned_addr learned my addr 172.21.15.134:0/734724362 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 -- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa788004d40 msgr2=0x7fa79c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa788004d40 0x7fa79c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a1b2a640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c9560 0x7fa79c0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 -- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c9560 msgr2=0x7fa79c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c9560 0x7fa79c0d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 -- 172.21.15.134:0/734724362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c158ed0 con 0x7fa79c155d70 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.151+0000 7fa7a0b28640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa798011990 tx=0x7fa798011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.152+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79800fad0 con 0x7fa79c155d70 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.152+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79800fc70 con 0x7fa79c155d70 2024-09-15T22:47:17.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.152+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c154860 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.152+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798014440 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.152+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c158bf0 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.153+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c0d1ef0 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.153+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fa798012040 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.154+0000 7fa78dffb640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 0x7fa78006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.154+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fa79808c540 con 0x7fa79c155d70 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.154+0000 7fa7a1329640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 0x7fa78006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.155+0000 7fa7a1329640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 0x7fa78006ed40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa790009ab0 tx=0x7fa7900095d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.158+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa798019030 con 0x7fa79c155d70 2024-09-15T22:47:17.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.321+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa79c15e260 con 0x7fa78006c880 2024-09-15T22:47:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.327+0000 7fa78dffb640 1 -- 172.21.15.134:0/734724362 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252465 (secure 0 0 0) 0x7fa79c15e260 con 0x7fa78006c880 2024-09-15T22:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:17.333 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 msgr2=0x7fa78006ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 0x7fa78006ed40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa790009ab0 tx=0x7fa7900095d0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 msgr2=0x7fa79c0ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa798011990 tx=0x7fa798011e50 comp rx=0 tx=0).stop 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 shutdown_connections 2024-09-15T22:47:17.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c9560 0x7fa79c0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa78006c880 0x7fa78006ed40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79c155d70 0x7fa79c0ce150 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 --2- 172.21.15.134:0/734724362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa788004d40 0x7fa79c153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 >> 172.21.15.134:0/734724362 conn(0x7fa79c0b6240 msgr2=0x7fa79c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 shutdown_connections 2024-09-15T22:47:17.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.330+0000 7fa7a358d640 1 -- 172.21.15.134:0/734724362 wait complete. 2024-09-15T22:47:17.343 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-15T22:47:17.208965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263772,"kb_used_data":14244,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710948,"statfs":{"total":773094113280,"available":772824010752,"internally_reserved":0,"allocated":14585856,"data_stored":7051520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.155477"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065408+0000","last_change":"2024-09-15T22:47:14.074273+0000","last_active":"2024-09-15T22:47:15.065408+0000","last_peered":"2024-09-15T22:47:15.065408+0000","last_clean":"2024-09-15T22:47:15.065408+0000","last_became_active":"2024-09-15T22:47:14.073931+0000","last_became_peered":"2024-09-15T22:47:14.073931+0000","last_unstale":"2024-09-15T22:47:15.065408+0000","last_undegraded":"2024-09-15T22:47:15.065408+0000","last_fullsized":"2024-09-15T22:47:15.065408+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:53.844417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064698+0000","last_change":"2024-09-15T22:47:14.082703+0000","last_active":"2024-09-15T22:47:15.064698+0000","last_peered":"2024-09-15T22:47:15.064698+0000","last_clean":"2024-09-15T22:47:15.064698+0000","last_became_active":"2024-09-15T22:47:14.082098+0000","last_became_peered":"2024-09-15T22:47:14.082098+0000","last_unstale":"2024-09-15T22:47:15.064698+0000","last_undegraded":"2024-09-15T22:47:15.064698+0000","last_fullsized":"2024-09-15T22:47:15.064698+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:53.191190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065333+0000","last_change":"2024-09-15T22:47:14.084314+0000","last_active":"2024-09-15T22:47:15.065333+0000","last_peered":"2024-09-15T22:47:15.065333+0000","last_clean":"2024-09-15T22:47:15.065333+0000","last_became_active":"2024-09-15T22:47:14.084053+0000","last_became_peered":"2024-09-15T22:47:14.084053+0000","last_unstale":"2024-09-15T22:47:15.065333+0000","last_undegraded":"2024-09-15T22:47:15.065333+0000","last_fullsized":"2024-09-15T22:47:15.065333+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:27.857527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078015+0000","last_change":"2024-09-15T22:47:14.088217+0000","last_active":"2024-09-15T22:47:15.078015+0000","last_peered":"2024-09-15T22:47:15.078015+0000","last_clean":"2024-09-15T22:47:15.078015+0000","last_became_active":"2024-09-15T22:47:14.087906+0000","last_became_peered":"2024-09-15T22:47:14.087906+0000","last_unstale":"2024-09-15T22:47:15.078015+0000","last_undegraded":"2024-09-15T22:47:15.078015+0000","last_fullsized":"2024-09-15T22:47:15.078015+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:38.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.078686+0000","last_change":"2024-09-15T22:47:14.073828+0000","last_active":"2024-09-15T22:47:14.078686+0000","last_peered":"2024-09-15T22:47:14.078686+0000","last_clean":"2024-09-15T22:47:14.078686+0000","last_became_active":"2024-09-15T22:47:14.073335+0000","last_became_peered":"2024-09-15T22:47:14.073335+0000","last_unstale":"2024-09-15T22:47:14.078686+0000","last_undegraded":"2024-09-15T22:47:14.078686+0000","last_fullsized":"2024-09-15T22:47:14.078686+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:05.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.987800+0000","last_change":"2024-09-15T22:47:14.078758+0000","last_active":"2024-09-15T22:47:16.987800+0000","last_peered":"2024-09-15T22:47:16.987800+0000","last_clean":"2024-09-15T22:47:16.987800+0000","last_became_active":"2024-09-15T22:47:14.078423+0000","last_became_peered":"2024-09-15T22:47:14.078423+0000","last_unstale":"2024-09-15T22:47:16.987800+0000","last_undegraded":"2024-09-15T22:47:16.987800+0000","last_fullsized":"2024-09-15T22:47:16.987800+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:25.333266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.076798+0000","last_change":"2024-09-15T22:47:14.073154+0000","last_active":"2024-09-15T22:47:14.076798+0000","last_peered":"2024-09-15T22:47:14.076798+0000","last_clean":"2024-09-15T22:47:14.076798+0000","last_became_active":"2024-09-15T22:47:14.072890+0000","last_became_peered":"2024-09-15T22:47:14.072890+0000","last_unstale":"2024-09-15T22:47:14.076798+0000","last_undegraded":"2024-09-15T22:47:14.076798+0000","last_fullsized":"2024-09-15T22:47:14.076798+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:10.598274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064623+0000","last_change":"2024-09-15T22:47:14.075522+0000","last_active":"2024-09-15T22:47:15.064623+0000","last_peered":"2024-09-15T22:47:15.064623+0000","last_clean":"2024-09-15T22:47:15.064623+0000","last_became_active":"2024-09-15T22:47:14.075231+0000","last_became_peered":"2024-09-15T22:47:14.075231+0000","last_unstale":"2024-09-15T22:47:15.064623+0000","last_undegraded":"2024-09-15T22:47:15.064623+0000","last_fullsized":"2024-09-15T22:47:15.064623+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:31.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.988198+0000","last_change":"2024-09-15T22:47:14.079520+0000","last_active":"2024-09-15T22:47:16.988198+0000","last_peered":"2024-09-15T22:47:16.988198+0000","last_clean":"2024-09-15T22:47:16.988198+0000","last_became_active":"2024-09-15T22:47:14.077689+0000","last_became_peered":"2024-09-15T22:47:14.077689+0000","last_unstale":"2024-09-15T22:47:16.988198+0000","last_undegraded":"2024-09-15T22:47:16.988198+0000","last_fullsized":"2024-09-15T22:47:16.988198+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:16.810198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065407+0000","last_change":"2024-09-15T22:47:14.082104+0000","last_active":"2024-09-15T22:47:15.065407+0000","last_peered":"2024-09-15T22:47:15.065407+0000","last_clean":"2024-09-15T22:47:15.065407+0000","last_became_active":"2024-09-15T22:47:14.081031+0000","last_became_peered":"2024-09-15T22:47:14.081031+0000","last_unstale":"2024-09-15T22:47:15.065407+0000","last_undegraded":"2024-09-15T22:47:15.065407+0000","last_fullsized":"2024-09-15T22:47:15.065407+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:11.568132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.988263+0000","last_change":"2024-09-15T22:47:14.072907+0000","last_active":"2024-09-15T22:47:16.988263+0000","last_peered":"2024-09-15T22:47:16.988263+0000","last_clean":"2024-09-15T22:47:16.988263+0000","last_became_active":"2024-09-15T22:47:14.072613+0000","last_became_peered":"2024-09-15T22:47:14.072613+0000","last_unstale":"2024-09-15T22:47:16.988263+0000","last_undegraded":"2024-09-15T22:47:16.988263+0000","last_fullsized":"2024-09-15T22:47:16.988263+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:46.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835404+0000","last_change":"2024-09-15T22:47:14.076665+0000","last_active":"2024-09-15T22:47:16.835404+0000","last_peered":"2024-09-15T22:47:16.835404+0000","last_clean":"2024-09-15T22:47:16.835404+0000","last_became_active":"2024-09-15T22:47:14.076381+0000","last_became_peered":"2024-09-15T22:47:14.076381+0000","last_unstale":"2024-09-15T22:47:16.835404+0000","last_undegraded":"2024-09-15T22:47:16.835404+0000","last_fullsized":"2024-09-15T22:47:16.835404+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:49.851567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.078662+0000","last_change":"2024-09-15T22:47:14.073633+0000","last_active":"2024-09-15T22:47:14.078662+0000","last_peered":"2024-09-15T22:47:14.078662+0000","last_clean":"2024-09-15T22:47:14.078662+0000","last_became_active":"2024-09-15T22:47:14.073006+0000","last_became_peered":"2024-09-15T22:47:14.073006+0000","last_unstale":"2024-09-15T22:47:14.078662+0000","last_undegraded":"2024-09-15T22:47:14.078662+0000","last_fullsized":"2024-09-15T22:47:14.078662+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:27.506316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835026+0000","last_change":"2024-09-15T22:47:14.079995+0000","last_active":"2024-09-15T22:47:16.835026+0000","last_peered":"2024-09-15T22:47:16.835026+0000","last_clean":"2024-09-15T22:47:16.835026+0000","last_became_active":"2024-09-15T22:47:14.078426+0000","last_became_peered":"2024-09-15T22:47:14.078426+0000","last_unstale":"2024-09-15T22:47:16.835026+0000","last_undegraded":"2024-09-15T22:47:16.835026+0000","last_fullsized":"2024-09-15T22:47:16.835026+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:20.037556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.076965+0000","last_change":"2024-09-15T22:47:14.072729+0000","last_active":"2024-09-15T22:47:14.076965+0000","last_peered":"2024-09-15T22:47:14.076965+0000","last_clean":"2024-09-15T22:47:14.076965+0000","last_became_active":"2024-09-15T22:47:14.072454+0000","last_became_peered":"2024-09-15T22:47:14.072454+0000","last_unstale":"2024-09-15T22:47:14.076965+0000","last_undegraded":"2024-09-15T22:47:14.076965+0000","last_fullsized":"2024-09-15T22:47:14.076965+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:51.895581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.081717+0000","last_change":"2024-09-15T22:47:14.074749+0000","last_active":"2024-09-15T22:47:14.081717+0000","last_peered":"2024-09-15T22:47:14.081717+0000","last_clean":"2024-09-15T22:47:14.081717+0000","last_became_active":"2024-09-15T22:47:14.074482+0000","last_became_peered":"2024-09-15T22:47:14.074482+0000","last_unstale":"2024-09-15T22:47:14.081717+0000","last_undegraded":"2024-09-15T22:47:14.081717+0000","last_fullsized":"2024-09-15T22:47:14.081717+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:57.270015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065451+0000","last_change":"2024-09-15T22:47:14.085872+0000","last_active":"2024-09-15T22:47:15.065451+0000","last_peered":"2024-09-15T22:47:15.065451+0000","last_clean":"2024-09-15T22:47:15.065451+0000","last_became_active":"2024-09-15T22:47:14.085543+0000","last_became_peered":"2024-09-15T22:47:14.085543+0000","last_unstale":"2024-09-15T22:47:15.065451+0000","last_undegraded":"2024-09-15T22:47:15.065451+0000","last_fullsized":"2024-09-15T22:47:15.065451+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:35.261092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.070772+0000","last_change":"2024-09-15T22:47:14.068756+0000","last_active":"2024-09-15T22:47:14.070772+0000","last_peered":"2024-09-15T22:47:14.070772+0000","last_clean":"2024-09-15T22:47:14.070772+0000","last_became_active":"2024-09-15T22:47:14.068477+0000","last_became_peered":"2024-09-15T22:47:14.068477+0000","last_unstale":"2024-09-15T22:47:14.070772+0000","last_undegraded":"2024-09-15T22:47:14.070772+0000","last_fullsized":"2024-09-15T22:47:14.070772+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:37.594407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065337+0000","last_change":"2024-09-15T22:47:14.071209+0000","last_active":"2024-09-15T22:47:15.065337+0000","last_peered":"2024-09-15T22:47:15.065337+0000","last_clean":"2024-09-15T22:47:15.065337+0000","last_became_active":"2024-09-15T22:47:14.070866+0000","last_became_peered":"2024-09-15T22:47:14.070866+0000","last_unstale":"2024-09-15T22:47:15.065337+0000","last_undegraded":"2024-09-15T22:47:15.065337+0000","last_fullsized":"2024-09-15T22:47:15.065337+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:31.000826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065232+0000","last_change":"2024-09-15T22:47:14.077661+0000","last_active":"2024-09-15T22:47:15.065232+0000","last_peered":"2024-09-15T22:47:15.065232+0000","last_clean":"2024-09-15T22:47:15.065232+0000","last_became_active":"2024-09-15T22:47:14.077350+0000","last_became_peered":"2024-09-15T22:47:14.077350+0000","last_unstale":"2024-09-15T22:47:15.065232+0000","last_undegraded":"2024-09-15T22:47:15.065232+0000","last_fullsized":"2024-09-15T22:47:15.065232+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:04.841073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065321+0000","last_change":"2024-09-15T22:47:14.085081+0000","last_active":"2024-09-15T22:47:15.065321+0000","last_peered":"2024-09-15T22:47:15.065321+0000","last_clean":"2024-09-15T22:47:15.065321+0000","last_became_active":"2024-09-15T22:47:14.084781+0000","last_became_peered":"2024-09-15T22:47:14.084781+0000","last_unstale":"2024-09-15T22:47:15.065321+0000","last_undegraded":"2024-09-15T22:47:15.065321+0000","last_fullsized":"2024-09-15T22:47:15.065321+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:10.425350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835063+0000","last_change":"2024-09-15T22:47:14.078692+0000","last_active":"2024-09-15T22:47:16.835063+0000","last_peered":"2024-09-15T22:47:16.835063+0000","last_clean":"2024-09-15T22:47:16.835063+0000","last_became_active":"2024-09-15T22:47:14.077718+0000","last_became_peered":"2024-09-15T22:47:14.077718+0000","last_unstale":"2024-09-15T22:47:16.835063+0000","last_undegraded":"2024-09-15T22:47:16.835063+0000","last_fullsized":"2024-09-15T22:47:16.835063+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:50.736378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077747+0000","last_change":"2024-09-15T22:47:14.083659+0000","last_active":"2024-09-15T22:47:15.077747+0000","last_peered":"2024-09-15T22:47:15.077747+0000","last_clean":"2024-09-15T22:47:15.077747+0000","last_became_active":"2024-09-15T22:47:14.083390+0000","last_became_peered":"2024-09-15T22:47:14.083390+0000","last_unstale":"2024-09-15T22:47:15.077747+0000","last_undegraded":"2024-09-15T22:47:15.077747+0000","last_fullsized":"2024-09-15T22:47:15.077747+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:48.812414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.082962+0000","last_change":"2024-09-15T22:47:14.076564+0000","last_active":"2024-09-15T22:47:14.082962+0000","last_peered":"2024-09-15T22:47:14.082962+0000","last_clean":"2024-09-15T22:47:14.082962+0000","last_became_active":"2024-09-15T22:47:14.076286+0000","last_became_peered":"2024-09-15T22:47:14.076286+0000","last_unstale":"2024-09-15T22:47:14.082962+0000","last_undegraded":"2024-09-15T22:47:14.082962+0000","last_fullsized":"2024-09-15T22:47:14.082962+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:56.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064347+0000","last_change":"2024-09-15T22:47:14.082757+0000","last_active":"2024-09-15T22:47:15.064347+0000","last_peered":"2024-09-15T22:47:15.064347+0000","last_clean":"2024-09-15T22:47:15.064347+0000","last_became_active":"2024-09-15T22:47:14.082166+0000","last_became_peered":"2024-09-15T22:47:14.082166+0000","last_unstale":"2024-09-15T22:47:15.064347+0000","last_undegraded":"2024-09-15T22:47:15.064347+0000","last_fullsized":"2024-09-15T22:47:15.064347+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:27.002422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065328+0000","last_change":"2024-09-15T22:47:14.077511+0000","last_active":"2024-09-15T22:47:15.065328+0000","last_peered":"2024-09-15T22:47:15.065328+0000","last_clean":"2024-09-15T22:47:15.065328+0000","last_became_active":"2024-09-15T22:47:14.077150+0000","last_became_peered":"2024-09-15T22:47:14.077150+0000","last_unstale":"2024-09-15T22:47:15.065328+0000","last_undegraded":"2024-09-15T22:47:15.065328+0000","last_fullsized":"2024-09-15T22:47:15.065328+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:44.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064295+0000","last_change":"2024-09-15T22:47:14.082995+0000","last_active":"2024-09-15T22:47:15.064295+0000","last_peered":"2024-09-15T22:47:15.064295+0000","last_clean":"2024-09-15T22:47:15.064295+0000","last_became_active":"2024-09-15T22:47:14.082728+0000","last_became_peered":"2024-09-15T22:47:14.082728+0000","last_unstale":"2024-09-15T22:47:15.064295+0000","last_undegraded":"2024-09-15T22:47:15.064295+0000","last_fullsized":"2024-09-15T22:47:15.064295+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:48.004125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064556+0000","last_change":"2024-09-15T22:47:14.082313+0000","last_active":"2024-09-15T22:47:15.064556+0000","last_peered":"2024-09-15T22:47:15.064556+0000","last_clean":"2024-09-15T22:47:15.064556+0000","last_became_active":"2024-09-15T22:47:14.082003+0000","last_became_peered":"2024-09-15T22:47:14.082003+0000","last_unstale":"2024-09-15T22:47:15.064556+0000","last_undegraded":"2024-09-15T22:47:15.064556+0000","last_fullsized":"2024-09-15T22:47:15.064556+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:04.415807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065004+0000","last_change":"2024-09-15T22:47:14.077003+0000","last_active":"2024-09-15T22:47:15.065004+0000","last_peered":"2024-09-15T22:47:15.065004+0000","last_clean":"2024-09-15T22:47:15.065004+0000","last_became_active":"2024-09-15T22:47:14.076433+0000","last_became_peered":"2024-09-15T22:47:14.076433+0000","last_unstale":"2024-09-15T22:47:15.065004+0000","last_undegraded":"2024-09-15T22:47:15.065004+0000","last_fullsized":"2024-09-15T22:47:15.065004+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:20.308648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835153+0000","last_change":"2024-09-15T22:47:14.077386+0000","last_active":"2024-09-15T22:47:16.835153+0000","last_peered":"2024-09-15T22:47:16.835153+0000","last_clean":"2024-09-15T22:47:16.835153+0000","last_became_active":"2024-09-15T22:47:14.077119+0000","last_became_peered":"2024-09-15T22:47:14.077119+0000","last_unstale":"2024-09-15T22:47:16.835153+0000","last_undegraded":"2024-09-15T22:47:16.835153+0000","last_fullsized":"2024-09-15T22:47:16.835153+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:04.682626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064244+0000","last_change":"2024-09-15T22:47:14.081045+0000","last_active":"2024-09-15T22:47:15.064244+0000","last_peered":"2024-09-15T22:47:15.064244+0000","last_clean":"2024-09-15T22:47:15.064244+0000","last_became_active":"2024-09-15T22:47:14.080749+0000","last_became_peered":"2024-09-15T22:47:14.080749+0000","last_unstale":"2024-09-15T22:47:15.064244+0000","last_undegraded":"2024-09-15T22:47:15.064244+0000","last_fullsized":"2024-09-15T22:47:15.064244+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:38.479836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.063841+0000","last_change":"2024-09-15T22:47:14.083301+0000","last_active":"2024-09-15T22:47:15.063841+0000","last_peered":"2024-09-15T22:47:15.063841+0000","last_clean":"2024-09-15T22:47:15.063841+0000","last_became_active":"2024-09-15T22:47:14.082976+0000","last_became_peered":"2024-09-15T22:47:14.082976+0000","last_unstale":"2024-09-15T22:47:15.063841+0000","last_undegraded":"2024-09-15T22:47:15.063841+0000","last_fullsized":"2024-09-15T22:47:15.063841+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:45.282675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.075630+0000","last_change":"2024-09-15T22:47:14.072005+0000","last_active":"2024-09-15T22:47:14.075630+0000","last_peered":"2024-09-15T22:47:14.075630+0000","last_clean":"2024-09-15T22:47:14.075630+0000","last_became_active":"2024-09-15T22:47:14.071727+0000","last_became_peered":"2024-09-15T22:47:14.071727+0000","last_unstale":"2024-09-15T22:47:14.075630+0000","last_undegraded":"2024-09-15T22:47:14.075630+0000","last_fullsized":"2024-09-15T22:47:14.075630+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:18.727730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"133'4","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065405+0000","last_change":"2024-09-15T22:47:13.073162+0000","last_active":"2024-09-15T22:47:15.065405+0000","last_peered":"2024-09-15T22:47:15.065405+0000","last_clean":"2024-09-15T22:47:15.065405+0000","last_became_active":"2024-09-15T22:47:13.072867+0000","last_became_peered":"2024-09-15T22:47:13.072867+0000","last_unstale":"2024-09-15T22:47:15.065405+0000","last_undegraded":"2024-09-15T22:47:15.065405+0000","last_fullsized":"2024-09-15T22:47:15.065405+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:44.934493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.083006+0000","last_change":"2024-09-15T22:47:14.079361+0000","last_active":"2024-09-15T22:47:14.083006+0000","last_peered":"2024-09-15T22:47:14.083006+0000","last_clean":"2024-09-15T22:47:14.083006+0000","last_became_active":"2024-09-15T22:47:14.079097+0000","last_became_peered":"2024-09-15T22:47:14.079097+0000","last_unstale":"2024-09-15T22:47:14.083006+0000","last_undegraded":"2024-09-15T22:47:14.083006+0000","last_fullsized":"2024-09-15T22:47:14.083006+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:04.682626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"133'1","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.988099+0000","last_change":"2024-09-15T22:47:13.076223+0000","last_active":"2024-09-15T22:47:16.988099+0000","last_peered":"2024-09-15T22:47:16.988099+0000","last_clean":"2024-09-15T22:47:16.988099+0000","last_became_active":"2024-09-15T22:47:13.075946+0000","last_became_peered":"2024-09-15T22:47:13.075946+0000","last_unstale":"2024-09-15T22:47:16.988099+0000","last_undegraded":"2024-09-15T22:47:16.988099+0000","last_fullsized":"2024-09-15T22:47:16.988099+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:17.789095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.987945+0000","last_change":"2024-09-15T22:47:14.079178+0000","last_active":"2024-09-15T22:47:16.987945+0000","last_peered":"2024-09-15T22:47:16.987945+0000","last_clean":"2024-09-15T22:47:16.987945+0000","last_became_active":"2024-09-15T22:47:14.078860+0000","last_became_peered":"2024-09-15T22:47:14.078860+0000","last_unstale":"2024-09-15T22:47:16.987945+0000","last_undegraded":"2024-09-15T22:47:16.987945+0000","last_fullsized":"2024-09-15T22:47:16.987945+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:43.629363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065257+0000","last_change":"2024-09-15T22:47:13.073697+0000","last_active":"2024-09-15T22:47:15.065257+0000","last_peered":"2024-09-15T22:47:15.065257+0000","last_clean":"2024-09-15T22:47:15.065257+0000","last_became_active":"2024-09-15T22:47:13.073435+0000","last_became_peered":"2024-09-15T22:47:13.073435+0000","last_unstale":"2024-09-15T22:47:15.065257+0000","last_undegraded":"2024-09-15T22:47:15.065257+0000","last_fullsized":"2024-09-15T22:47:15.065257+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:59.122426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078108+0000","last_change":"2024-09-15T22:47:14.088123+0000","last_active":"2024-09-15T22:47:15.078108+0000","last_peered":"2024-09-15T22:47:15.078108+0000","last_clean":"2024-09-15T22:47:15.078108+0000","last_became_active":"2024-09-15T22:47:14.087845+0000","last_became_peered":"2024-09-15T22:47:14.087845+0000","last_unstale":"2024-09-15T22:47:15.078108+0000","last_undegraded":"2024-09-15T22:47:15.078108+0000","last_fullsized":"2024-09-15T22:47:15.078108+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:52.942834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065217+0000","last_change":"2024-09-15T22:47:13.074368+0000","last_active":"2024-09-15T22:47:15.065217+0000","last_peered":"2024-09-15T22:47:15.065217+0000","last_clean":"2024-09-15T22:47:15.065217+0000","last_became_active":"2024-09-15T22:47:13.073977+0000","last_became_peered":"2024-09-15T22:47:13.073977+0000","last_unstale":"2024-09-15T22:47:15.065217+0000","last_undegraded":"2024-09-15T22:47:15.065217+0000","last_fullsized":"2024-09-15T22:47:15.065217+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:35.517366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.063974+0000","last_change":"2024-09-15T22:47:14.084955+0000","last_active":"2024-09-15T22:47:15.063974+0000","last_peered":"2024-09-15T22:47:15.063974+0000","last_clean":"2024-09-15T22:47:15.063974+0000","last_became_active":"2024-09-15T22:47:14.084665+0000","last_became_peered":"2024-09-15T22:47:14.084665+0000","last_unstale":"2024-09-15T22:47:15.063974+0000","last_undegraded":"2024-09-15T22:47:15.063974+0000","last_fullsized":"2024-09-15T22:47:15.063974+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:07.038805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"133'1","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065089+0000","last_change":"2024-09-15T22:47:13.076948+0000","last_active":"2024-09-15T22:47:15.065089+0000","last_peered":"2024-09-15T22:47:15.065089+0000","last_clean":"2024-09-15T22:47:15.065089+0000","last_became_active":"2024-09-15T22:47:13.076665+0000","last_became_peered":"2024-09-15T22:47:13.076665+0000","last_unstale":"2024-09-15T22:47:15.065089+0000","last_undegraded":"2024-09-15T22:47:15.065089+0000","last_fullsized":"2024-09-15T22:47:15.065089+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:19.032938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077994+0000","last_change":"2024-09-15T22:47:14.087756+0000","last_active":"2024-09-15T22:47:15.077994+0000","last_peered":"2024-09-15T22:47:15.077994+0000","last_clean":"2024-09-15T22:47:15.077994+0000","last_became_active":"2024-09-15T22:47:14.086615+0000","last_became_peered":"2024-09-15T22:47:14.086615+0000","last_unstale":"2024-09-15T22:47:15.077994+0000","last_undegraded":"2024-09-15T22:47:15.077994+0000","last_fullsized":"2024-09-15T22:47:15.077994+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:03.265623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"133'1","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.061571+0000","last_change":"2024-09-15T22:47:13.071797+0000","last_active":"2024-09-15T22:47:14.061571+0000","last_peered":"2024-09-15T22:47:14.061571+0000","last_clean":"2024-09-15T22:47:14.061571+0000","last_became_active":"2024-09-15T22:47:13.071505+0000","last_became_peered":"2024-09-15T22:47:13.071505+0000","last_unstale":"2024-09-15T22:47:14.061571+0000","last_undegraded":"2024-09-15T22:47:14.061571+0000","last_fullsized":"2024-09-15T22:47:14.061571+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:18.473865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064062+0000","last_change":"2024-09-15T22:47:14.082706+0000","last_active":"2024-09-15T22:47:15.064062+0000","last_peered":"2024-09-15T22:47:15.064062+0000","last_clean":"2024-09-15T22:47:15.064062+0000","last_became_active":"2024-09-15T22:47:14.082399+0000","last_became_peered":"2024-09-15T22:47:14.082399+0000","last_unstale":"2024-09-15T22:47:15.064062+0000","last_undegraded":"2024-09-15T22:47:15.064062+0000","last_fullsized":"2024-09-15T22:47:15.064062+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:23.378496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.987804+0000","last_change":"2024-09-15T22:47:13.074509+0000","last_active":"2024-09-15T22:47:16.987804+0000","last_peered":"2024-09-15T22:47:16.987804+0000","last_clean":"2024-09-15T22:47:16.987804+0000","last_became_active":"2024-09-15T22:47:13.074181+0000","last_became_peered":"2024-09-15T22:47:13.074181+0000","last_unstale":"2024-09-15T22:47:16.987804+0000","last_undegraded":"2024-09-15T22:47:16.987804+0000","last_fullsized":"2024-09-15T22:47:16.987804+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:56.636324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077794+0000","last_change":"2024-09-15T22:47:14.080068+0000","last_active":"2024-09-15T22:47:15.077794+0000","last_peered":"2024-09-15T22:47:15.077794+0000","last_clean":"2024-09-15T22:47:15.077794+0000","last_became_active":"2024-09-15T22:47:14.079743+0000","last_became_peered":"2024-09-15T22:47:14.079743+0000","last_unstale":"2024-09-15T22:47:15.077794+0000","last_undegraded":"2024-09-15T22:47:15.077794+0000","last_fullsized":"2024-09-15T22:47:15.077794+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:39.188971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064975+0000","last_change":"2024-09-15T22:47:13.071158+0000","last_active":"2024-09-15T22:47:15.064975+0000","last_peered":"2024-09-15T22:47:15.064975+0000","last_clean":"2024-09-15T22:47:15.064975+0000","last_became_active":"2024-09-15T22:47:13.070915+0000","last_became_peered":"2024-09-15T22:47:13.070915+0000","last_unstale":"2024-09-15T22:47:15.064975+0000","last_undegraded":"2024-09-15T22:47:15.064975+0000","last_fullsized":"2024-09-15T22:47:15.064975+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:07.251221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078188+0000","last_change":"2024-09-15T22:47:14.082561+0000","last_active":"2024-09-15T22:47:15.078188+0000","last_peered":"2024-09-15T22:47:15.078188+0000","last_clean":"2024-09-15T22:47:15.078188+0000","last_became_active":"2024-09-15T22:47:14.082269+0000","last_became_peered":"2024-09-15T22:47:14.082269+0000","last_unstale":"2024-09-15T22:47:15.078188+0000","last_undegraded":"2024-09-15T22:47:15.078188+0000","last_fullsized":"2024-09-15T22:47:15.078188+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:40.805437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.988101+0000","last_change":"2024-09-15T22:47:13.074329+0000","last_active":"2024-09-15T22:47:16.988101+0000","last_peered":"2024-09-15T22:47:16.988101+0000","last_clean":"2024-09-15T22:47:16.988101+0000","last_became_active":"2024-09-15T22:47:13.073397+0000","last_became_peered":"2024-09-15T22:47:13.073397+0000","last_unstale":"2024-09-15T22:47:16.988101+0000","last_undegraded":"2024-09-15T22:47:16.988101+0000","last_fullsized":"2024-09-15T22:47:16.988101+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:15.832693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835404+0000","last_change":"2024-09-15T22:47:14.084339+0000","last_active":"2024-09-15T22:47:16.835404+0000","last_peered":"2024-09-15T22:47:16.835404+0000","last_clean":"2024-09-15T22:47:16.835404+0000","last_became_active":"2024-09-15T22:47:14.084014+0000","last_became_peered":"2024-09-15T22:47:14.084014+0000","last_unstale":"2024-09-15T22:47:16.835404+0000","last_undegraded":"2024-09-15T22:47:16.835404+0000","last_fullsized":"2024-09-15T22:47:16.835404+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:45.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.062218+0000","last_change":"2024-09-15T22:47:13.074045+0000","last_active":"2024-09-15T22:47:14.062218+0000","last_peered":"2024-09-15T22:47:14.062218+0000","last_clean":"2024-09-15T22:47:14.062218+0000","last_became_active":"2024-09-15T22:47:13.073840+0000","last_became_peered":"2024-09-15T22:47:13.073840+0000","last_unstale":"2024-09-15T22:47:14.062218+0000","last_undegraded":"2024-09-15T22:47:14.062218+0000","last_fullsized":"2024-09-15T22:47:14.062218+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:31.165839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.083784+0000","last_change":"2024-09-15T22:47:14.077353+0000","last_active":"2024-09-15T22:47:14.083784+0000","last_peered":"2024-09-15T22:47:14.083784+0000","last_clean":"2024-09-15T22:47:14.083784+0000","last_became_active":"2024-09-15T22:47:14.077059+0000","last_became_peered":"2024-09-15T22:47:14.077059+0000","last_unstale":"2024-09-15T22:47:14.083784+0000","last_undegraded":"2024-09-15T22:47:14.083784+0000","last_fullsized":"2024-09-15T22:47:14.083784+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:20.037556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"133'6","reported_seq":18,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.093615+0000","last_change":"2024-09-15T22:47:13.074275+0000","last_active":"2024-09-15T22:47:14.093615+0000","last_peered":"2024-09-15T22:47:14.093615+0000","last_clean":"2024-09-15T22:47:14.093615+0000","last_became_active":"2024-09-15T22:47:13.072956+0000","last_became_peered":"2024-09-15T22:47:13.072956+0000","last_unstale":"2024-09-15T22:47:14.093615+0000","last_undegraded":"2024-09-15T22:47:14.093615+0000","last_fullsized":"2024-09-15T22:47:14.093615+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:52.719197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078013+0000","last_change":"2024-09-15T22:47:14.078861+0000","last_active":"2024-09-15T22:47:15.078013+0000","last_peered":"2024-09-15T22:47:15.078013+0000","last_clean":"2024-09-15T22:47:15.078013+0000","last_became_active":"2024-09-15T22:47:14.078564+0000","last_became_peered":"2024-09-15T22:47:14.078564+0000","last_unstale":"2024-09-15T22:47:15.078013+0000","last_undegraded":"2024-09-15T22:47:15.078013+0000","last_fullsized":"2024-09-15T22:47:15.078013+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:22.597219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065167+0000","last_change":"2024-09-15T22:47:13.074166+0000","last_active":"2024-09-15T22:47:15.065167+0000","last_peered":"2024-09-15T22:47:15.065167+0000","last_clean":"2024-09-15T22:47:15.065167+0000","last_became_active":"2024-09-15T22:47:13.073834+0000","last_became_peered":"2024-09-15T22:47:13.073834+0000","last_unstale":"2024-09-15T22:47:15.065167+0000","last_undegraded":"2024-09-15T22:47:15.065167+0000","last_fullsized":"2024-09-15T22:47:15.065167+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:19.734275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064989+0000","last_change":"2024-09-15T22:47:14.078810+0000","last_active":"2024-09-15T22:47:15.064989+0000","last_peered":"2024-09-15T22:47:15.064989+0000","last_clean":"2024-09-15T22:47:15.064989+0000","last_became_active":"2024-09-15T22:47:14.076361+0000","last_became_peered":"2024-09-15T22:47:14.076361+0000","last_unstale":"2024-09-15T22:47:15.064989+0000","last_undegraded":"2024-09-15T22:47:15.064989+0000","last_fullsized":"2024-09-15T22:47:15.064989+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:46.051412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835205+0000","last_change":"2024-09-15T22:47:13.071442+0000","last_active":"2024-09-15T22:47:16.835205+0000","last_peered":"2024-09-15T22:47:16.835205+0000","last_clean":"2024-09-15T22:47:16.835205+0000","last_became_active":"2024-09-15T22:47:13.071208+0000","last_became_peered":"2024-09-15T22:47:13.071208+0000","last_unstale":"2024-09-15T22:47:16.835205+0000","last_undegraded":"2024-09-15T22:47:16.835205+0000","last_fullsized":"2024-09-15T22:47:16.835205+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:19.892140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077746+0000","last_change":"2024-09-15T22:47:14.086939+0000","last_active":"2024-09-15T22:47:15.077746+0000","last_peered":"2024-09-15T22:47:15.077746+0000","last_clean":"2024-09-15T22:47:15.077746+0000","last_became_active":"2024-09-15T22:47:14.086652+0000","last_became_peered":"2024-09-15T22:47:14.086652+0000","last_unstale":"2024-09-15T22:47:15.077746+0000","last_undegraded":"2024-09-15T22:47:15.077746+0000","last_fullsized":"2024-09-15T22:47:15.077746+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:16.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064164+0000","last_change":"2024-09-15T22:47:13.078189+0000","last_active":"2024-09-15T22:47:15.064164+0000","last_peered":"2024-09-15T22:47:15.064164+0000","last_clean":"2024-09-15T22:47:15.064164+0000","last_became_active":"2024-09-15T22:47:13.077920+0000","last_became_peered":"2024-09-15T22:47:13.077920+0000","last_unstale":"2024-09-15T22:47:15.064164+0000","last_undegraded":"2024-09-15T22:47:15.064164+0000","last_fullsized":"2024-09-15T22:47:15.064164+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:22.076600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078006+0000","last_change":"2024-09-15T22:47:14.073280+0000","last_active":"2024-09-15T22:47:15.078006+0000","last_peered":"2024-09-15T22:47:15.078006+0000","last_clean":"2024-09-15T22:47:15.078006+0000","last_became_active":"2024-09-15T22:47:14.073004+0000","last_became_peered":"2024-09-15T22:47:14.073004+0000","last_unstale":"2024-09-15T22:47:15.078006+0000","last_undegraded":"2024-09-15T22:47:15.078006+0000","last_fullsized":"2024-09-15T22:47:15.078006+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:31.842767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"133'8","reported_seq":22,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064811+0000","last_change":"2024-09-15T22:47:13.071148+0000","last_active":"2024-09-15T22:47:15.064811+0000","last_peered":"2024-09-15T22:47:15.064811+0000","last_clean":"2024-09-15T22:47:15.064811+0000","last_became_active":"2024-09-15T22:47:13.070843+0000","last_became_peered":"2024-09-15T22:47:13.070843+0000","last_unstale":"2024-09-15T22:47:15.064811+0000","last_undegraded":"2024-09-15T22:47:15.064811+0000","last_fullsized":"2024-09-15T22:47:15.064811+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:49.731759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.082999+0000","last_change":"2024-09-15T22:47:14.076586+0000","last_active":"2024-09-15T22:47:14.082999+0000","last_peered":"2024-09-15T22:47:14.082999+0000","last_clean":"2024-09-15T22:47:14.082999+0000","last_became_active":"2024-09-15T22:47:14.076304+0000","last_became_peered":"2024-09-15T22:47:14.076304+0000","last_unstale":"2024-09-15T22:47:14.082999+0000","last_undegraded":"2024-09-15T22:47:14.082999+0000","last_fullsized":"2024-09-15T22:47:14.082999+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:32.384682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"133'1","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078220+0000","last_change":"2024-09-15T22:47:13.073191+0000","last_active":"2024-09-15T22:47:15.078220+0000","last_peered":"2024-09-15T22:47:15.078220+0000","last_clean":"2024-09-15T22:47:15.078220+0000","last_became_active":"2024-09-15T22:47:13.072867+0000","last_became_peered":"2024-09-15T22:47:13.072867+0000","last_unstale":"2024-09-15T22:47:15.078220+0000","last_undegraded":"2024-09-15T22:47:15.078220+0000","last_fullsized":"2024-09-15T22:47:15.078220+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:06.034186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064354+0000","last_change":"2024-09-15T22:47:14.084412+0000","last_active":"2024-09-15T22:47:15.064354+0000","last_peered":"2024-09-15T22:47:15.064354+0000","last_clean":"2024-09-15T22:47:15.064354+0000","last_became_active":"2024-09-15T22:47:14.083817+0000","last_became_peered":"2024-09-15T22:47:14.083817+0000","last_unstale":"2024-09-15T22:47:15.064354+0000","last_undegraded":"2024-09-15T22:47:15.064354+0000","last_fullsized":"2024-09-15T22:47:15.064354+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:41.239256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065236+0000","last_change":"2024-09-15T22:47:13.072194+0000","last_active":"2024-09-15T22:47:15.065236+0000","last_peered":"2024-09-15T22:47:15.065236+0000","last_clean":"2024-09-15T22:47:15.065236+0000","last_became_active":"2024-09-15T22:47:13.071889+0000","last_became_peered":"2024-09-15T22:47:13.071889+0000","last_unstale":"2024-09-15T22:47:15.065236+0000","last_undegraded":"2024-09-15T22:47:15.065236+0000","last_fullsized":"2024-09-15T22:47:15.065236+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:03.678008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.083429+0000","last_change":"2024-09-15T22:47:14.077473+0000","last_active":"2024-09-15T22:47:14.083429+0000","last_peered":"2024-09-15T22:47:14.083429+0000","last_clean":"2024-09-15T22:47:14.083429+0000","last_became_active":"2024-09-15T22:47:14.077214+0000","last_became_peered":"2024-09-15T22:47:14.077214+0000","last_unstale":"2024-09-15T22:47:14.083429+0000","last_undegraded":"2024-09-15T22:47:14.083429+0000","last_fullsized":"2024-09-15T22:47:14.083429+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:34.153153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"133'1","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.070819+0000","last_change":"2024-09-15T22:47:13.070569+0000","last_active":"2024-09-15T22:47:14.070819+0000","last_peered":"2024-09-15T22:47:14.070819+0000","last_clean":"2024-09-15T22:47:14.070819+0000","last_became_active":"2024-09-15T22:47:13.070267+0000","last_became_peered":"2024-09-15T22:47:13.070267+0000","last_unstale":"2024-09-15T22:47:14.070819+0000","last_undegraded":"2024-09-15T22:47:14.070819+0000","last_fullsized":"2024-09-15T22:47:14.070819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:28.079227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.988035+0000","last_change":"2024-09-15T22:47:14.078282+0000","last_active":"2024-09-15T22:47:16.988035+0000","last_peered":"2024-09-15T22:47:16.988035+0000","last_clean":"2024-09-15T22:47:16.988035+0000","last_became_active":"2024-09-15T22:47:14.078011+0000","last_became_peered":"2024-09-15T22:47:14.078011+0000","last_unstale":"2024-09-15T22:47:16.988035+0000","last_undegraded":"2024-09-15T22:47:16.988035+0000","last_fullsized":"2024-09-15T22:47:16.988035+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:26.317712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064577+0000","last_change":"2024-09-15T22:47:13.078143+0000","last_active":"2024-09-15T22:47:15.064577+0000","last_peered":"2024-09-15T22:47:15.064577+0000","last_clean":"2024-09-15T22:47:15.064577+0000","last_became_active":"2024-09-15T22:47:13.077823+0000","last_became_peered":"2024-09-15T22:47:13.077823+0000","last_unstale":"2024-09-15T22:47:15.064577+0000","last_undegraded":"2024-09-15T22:47:15.064577+0000","last_fullsized":"2024-09-15T22:47:15.064577+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.137786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835187+0000","last_change":"2024-09-15T22:47:14.079325+0000","last_active":"2024-09-15T22:47:16.835187+0000","last_peered":"2024-09-15T22:47:16.835187+0000","last_clean":"2024-09-15T22:47:16.835187+0000","last_became_active":"2024-09-15T22:47:14.079053+0000","last_became_peered":"2024-09-15T22:47:14.079053+0000","last_unstale":"2024-09-15T22:47:16.835187+0000","last_undegraded":"2024-09-15T22:47:16.835187+0000","last_fullsized":"2024-09-15T22:47:16.835187+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:27.138132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.987672+0000","last_change":"2024-09-15T22:47:13.073584+0000","last_active":"2024-09-15T22:47:16.987672+0000","last_peered":"2024-09-15T22:47:16.987672+0000","last_clean":"2024-09-15T22:47:16.987672+0000","last_became_active":"2024-09-15T22:47:13.073321+0000","last_became_peered":"2024-09-15T22:47:13.073321+0000","last_unstale":"2024-09-15T22:47:16.987672+0000","last_undegraded":"2024-09-15T22:47:16.987672+0000","last_fullsized":"2024-09-15T22:47:16.987672+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:57.952813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.063964+0000","last_change":"2024-09-15T22:47:14.084298+0000","last_active":"2024-09-15T22:47:15.063964+0000","last_peered":"2024-09-15T22:47:15.063964+0000","last_clean":"2024-09-15T22:47:15.063964+0000","last_became_active":"2024-09-15T22:47:14.083693+0000","last_became_peered":"2024-09-15T22:47:14.083693+0000","last_unstale":"2024-09-15T22:47:15.063964+0000","last_undegraded":"2024-09-15T22:47:15.063964+0000","last_fullsized":"2024-09-15T22:47:15.063964+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:41.604499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077795+0000","last_change":"2024-09-15T22:47:13.073797+0000","last_active":"2024-09-15T22:47:15.077795+0000","last_peered":"2024-09-15T22:47:15.077795+0000","last_clean":"2024-09-15T22:47:15.077795+0000","last_became_active":"2024-09-15T22:47:13.073527+0000","last_became_peered":"2024-09-15T22:47:13.073527+0000","last_unstale":"2024-09-15T22:47:15.077795+0000","last_undegraded":"2024-09-15T22:47:15.077795+0000","last_fullsized":"2024-09-15T22:47:15.077795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:37.475218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835014+0000","last_change":"2024-09-15T22:47:14.074618+0000","last_active":"2024-09-15T22:47:16.835014+0000","last_peered":"2024-09-15T22:47:16.835014+0000","last_clean":"2024-09-15T22:47:16.835014+0000","last_became_active":"2024-09-15T22:47:14.074262+0000","last_became_peered":"2024-09-15T22:47:14.074262+0000","last_unstale":"2024-09-15T22:47:16.835014+0000","last_undegraded":"2024-09-15T22:47:16.835014+0000","last_fullsized":"2024-09-15T22:47:16.835014+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:57.270015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077850+0000","last_change":"2024-09-15T22:47:13.076375+0000","last_active":"2024-09-15T22:47:15.077850+0000","last_peered":"2024-09-15T22:47:15.077850+0000","last_clean":"2024-09-15T22:47:15.077850+0000","last_became_active":"2024-09-15T22:47:13.076031+0000","last_became_peered":"2024-09-15T22:47:13.076031+0000","last_unstale":"2024-09-15T22:47:15.077850+0000","last_undegraded":"2024-09-15T22:47:15.077850+0000","last_fullsized":"2024-09-15T22:47:15.077850+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:40.599881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064107+0000","last_change":"2024-09-15T22:47:14.082859+0000","last_active":"2024-09-15T22:47:15.064107+0000","last_peered":"2024-09-15T22:47:15.064107+0000","last_clean":"2024-09-15T22:47:15.064107+0000","last_became_active":"2024-09-15T22:47:14.082221+0000","last_became_peered":"2024-09-15T22:47:14.082221+0000","last_unstale":"2024-09-15T22:47:15.064107+0000","last_undegraded":"2024-09-15T22:47:15.064107+0000","last_fullsized":"2024-09-15T22:47:15.064107+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:07.345776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077810+0000","last_change":"2024-09-15T22:47:13.073760+0000","last_active":"2024-09-15T22:47:15.077810+0000","last_peered":"2024-09-15T22:47:15.077810+0000","last_clean":"2024-09-15T22:47:15.077810+0000","last_became_active":"2024-09-15T22:47:13.073512+0000","last_became_peered":"2024-09-15T22:47:13.073512+0000","last_unstale":"2024-09-15T22:47:15.077810+0000","last_undegraded":"2024-09-15T22:47:15.077810+0000","last_fullsized":"2024-09-15T22:47:15.077810+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:06.341157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078208+0000","last_change":"2024-09-15T22:47:14.080648+0000","last_active":"2024-09-15T22:47:15.078208+0000","last_peered":"2024-09-15T22:47:15.078208+0000","last_clean":"2024-09-15T22:47:15.078208+0000","last_became_active":"2024-09-15T22:47:14.080310+0000","last_became_peered":"2024-09-15T22:47:14.080310+0000","last_unstale":"2024-09-15T22:47:15.078208+0000","last_undegraded":"2024-09-15T22:47:15.078208+0000","last_fullsized":"2024-09-15T22:47:15.078208+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:25.172403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"133'2","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078332+0000","last_change":"2024-09-15T22:47:13.076263+0000","last_active":"2024-09-15T22:47:15.078332+0000","last_peered":"2024-09-15T22:47:15.078332+0000","last_clean":"2024-09-15T22:47:15.078332+0000","last_became_active":"2024-09-15T22:47:13.075980+0000","last_became_peered":"2024-09-15T22:47:13.075980+0000","last_unstale":"2024-09-15T22:47:15.078332+0000","last_undegraded":"2024-09-15T22:47:15.078332+0000","last_fullsized":"2024-09-15T22:47:15.078332+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:22.373878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078273+0000","last_change":"2024-09-15T22:47:14.088601+0000","last_active":"2024-09-15T22:47:15.078273+0000","last_peered":"2024-09-15T22:47:15.078273+0000","last_clean":"2024-09-15T22:47:15.078273+0000","last_became_active":"2024-09-15T22:47:14.088329+0000","last_became_peered":"2024-09-15T22:47:14.088329+0000","last_unstale":"2024-09-15T22:47:15.078273+0000","last_undegraded":"2024-09-15T22:47:15.078273+0000","last_fullsized":"2024-09-15T22:47:15.078273+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:46.323509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"134'1","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.064579+0000","last_change":"2024-09-15T22:47:13.078975+0000","last_active":"2024-09-15T22:47:15.064579+0000","last_peered":"2024-09-15T22:47:15.064579+0000","last_clean":"2024-09-15T22:47:15.064579+0000","last_became_active":"2024-09-15T22:47:13.078719+0000","last_became_peered":"2024-09-15T22:47:13.078719+0000","last_unstale":"2024-09-15T22:47:15.064579+0000","last_undegraded":"2024-09-15T22:47:15.064579+0000","last_fullsized":"2024-09-15T22:47:15.064579+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:11.339461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065317+0000","last_change":"2024-09-15T22:47:14.075511+0000","last_active":"2024-09-15T22:47:15.065317+0000","last_peered":"2024-09-15T22:47:15.065317+0000","last_clean":"2024-09-15T22:47:15.065317+0000","last_became_active":"2024-09-15T22:47:14.075221+0000","last_became_peered":"2024-09-15T22:47:14.075221+0000","last_unstale":"2024-09-15T22:47:15.065317+0000","last_undegraded":"2024-09-15T22:47:15.065317+0000","last_fullsized":"2024-09-15T22:47:15.065317+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:46.000744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.070937+0000","last_change":"2024-09-15T22:47:13.073377+0000","last_active":"2024-09-15T22:47:14.070937+0000","last_peered":"2024-09-15T22:47:14.070937+0000","last_clean":"2024-09-15T22:47:14.070937+0000","last_became_active":"2024-09-15T22:47:13.072860+0000","last_became_peered":"2024-09-15T22:47:13.072860+0000","last_unstale":"2024-09-15T22:47:14.070937+0000","last_undegraded":"2024-09-15T22:47:14.070937+0000","last_fullsized":"2024-09-15T22:47:14.070937+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:27.670216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065113+0000","last_change":"2024-09-15T22:47:14.076493+0000","last_active":"2024-09-15T22:47:15.065113+0000","last_peered":"2024-09-15T22:47:15.065113+0000","last_clean":"2024-09-15T22:47:15.065113+0000","last_became_active":"2024-09-15T22:47:14.076204+0000","last_became_peered":"2024-09-15T22:47:14.076204+0000","last_unstale":"2024-09-15T22:47:15.065113+0000","last_undegraded":"2024-09-15T22:47:15.065113+0000","last_fullsized":"2024-09-15T22:47:15.065113+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:21.456693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.070310+0000","last_change":"2024-09-15T22:47:13.077187+0000","last_active":"2024-09-15T22:47:14.070310+0000","last_peered":"2024-09-15T22:47:14.070310+0000","last_clean":"2024-09-15T22:47:14.070310+0000","last_became_active":"2024-09-15T22:47:13.076927+0000","last_became_peered":"2024-09-15T22:47:13.076927+0000","last_unstale":"2024-09-15T22:47:14.070310+0000","last_undegraded":"2024-09-15T22:47:14.070310+0000","last_fullsized":"2024-09-15T22:47:14.070310+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:55.644300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.082696+0000","last_change":"2024-09-15T22:47:14.078431+0000","last_active":"2024-09-15T22:47:14.082696+0000","last_peered":"2024-09-15T22:47:14.082696+0000","last_clean":"2024-09-15T22:47:14.082696+0000","last_became_active":"2024-09-15T22:47:14.077968+0000","last_became_peered":"2024-09-15T22:47:14.077968+0000","last_unstale":"2024-09-15T22:47:14.082696+0000","last_undegraded":"2024-09-15T22:47:14.082696+0000","last_fullsized":"2024-09-15T22:47:14.082696+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:50.736378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.063967+0000","last_change":"2024-09-15T22:47:13.081583+0000","last_active":"2024-09-15T22:47:15.063967+0000","last_peered":"2024-09-15T22:47:15.063967+0000","last_clean":"2024-09-15T22:47:15.063967+0000","last_became_active":"2024-09-15T22:47:13.081296+0000","last_became_peered":"2024-09-15T22:47:13.081296+0000","last_unstale":"2024-09-15T22:47:15.063967+0000","last_undegraded":"2024-09-15T22:47:15.063967+0000","last_fullsized":"2024-09-15T22:47:15.063967+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:31.402225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.078124+0000","last_change":"2024-09-15T22:47:14.079910+0000","last_active":"2024-09-15T22:47:15.078124+0000","last_peered":"2024-09-15T22:47:15.078124+0000","last_clean":"2024-09-15T22:47:15.078124+0000","last_became_active":"2024-09-15T22:47:14.078715+0000","last_became_peered":"2024-09-15T22:47:14.078715+0000","last_unstale":"2024-09-15T22:47:15.078124+0000","last_undegraded":"2024-09-15T22:47:15.078124+0000","last_fullsized":"2024-09-15T22:47:15.078124+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:20.896759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065053+0000","last_change":"2024-09-15T22:47:13.076360+0000","last_active":"2024-09-15T22:47:15.065053+0000","last_peered":"2024-09-15T22:47:15.065053+0000","last_clean":"2024-09-15T22:47:15.065053+0000","last_became_active":"2024-09-15T22:47:13.076098+0000","last_became_peered":"2024-09-15T22:47:13.076098+0000","last_unstale":"2024-09-15T22:47:15.065053+0000","last_undegraded":"2024-09-15T22:47:15.065053+0000","last_fullsized":"2024-09-15T22:47:15.065053+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:52.137956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.077863+0000","last_change":"2024-09-15T22:47:14.079132+0000","last_active":"2024-09-15T22:47:15.077863+0000","last_peered":"2024-09-15T22:47:15.077863+0000","last_clean":"2024-09-15T22:47:15.077863+0000","last_became_active":"2024-09-15T22:47:14.078816+0000","last_became_peered":"2024-09-15T22:47:14.078816+0000","last_unstale":"2024-09-15T22:47:15.077863+0000","last_undegraded":"2024-09-15T22:47:15.077863+0000","last_fullsized":"2024-09-15T22:47:15.077863+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:55.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.834913+0000","last_change":"2024-09-15T22:47:13.074931+0000","last_active":"2024-09-15T22:47:16.834913+0000","last_peered":"2024-09-15T22:47:16.834913+0000","last_clean":"2024-09-15T22:47:16.834913+0000","last_became_active":"2024-09-15T22:47:13.074739+0000","last_became_peered":"2024-09-15T22:47:13.074739+0000","last_unstale":"2024-09-15T22:47:16.834913+0000","last_undegraded":"2024-09-15T22:47:16.834913+0000","last_fullsized":"2024-09-15T22:47:16.834913+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:51.938215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:15.065054+0000","last_change":"2024-09-15T22:47:14.081760+0000","last_active":"2024-09-15T22:47:15.065054+0000","last_peered":"2024-09-15T22:47:15.065054+0000","last_clean":"2024-09-15T22:47:15.065054+0000","last_became_active":"2024-09-15T22:47:14.081490+0000","last_became_peered":"2024-09-15T22:47:14.081490+0000","last_unstale":"2024-09-15T22:47:15.065054+0000","last_undegraded":"2024-09-15T22:47:15.065054+0000","last_fullsized":"2024-09-15T22:47:15.065054+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:04.705690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.987564+0000","last_change":"2024-09-15T22:47:13.072787+0000","last_active":"2024-09-15T22:47:16.987564+0000","last_peered":"2024-09-15T22:47:16.987564+0000","last_clean":"2024-09-15T22:47:16.987564+0000","last_became_active":"2024-09-15T22:47:13.071336+0000","last_became_peered":"2024-09-15T22:47:13.071336+0000","last_unstale":"2024-09-15T22:47:16.987564+0000","last_undegraded":"2024-09-15T22:47:16.987564+0000","last_fullsized":"2024-09-15T22:47:16.987564+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:50.961409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.082898+0000","last_change":"2024-09-15T22:47:14.081311+0000","last_active":"2024-09-15T22:47:14.082898+0000","last_peered":"2024-09-15T22:47:14.082898+0000","last_clean":"2024-09-15T22:47:14.082898+0000","last_became_active":"2024-09-15T22:47:14.081000+0000","last_became_peered":"2024-09-15T22:47:14.081000+0000","last_unstale":"2024-09-15T22:47:14.082898+0000","last_undegraded":"2024-09-15T22:47:14.082898+0000","last_fullsized":"2024-09-15T22:47:14.082898+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:13.053086+0000","last_clean_scrub_stamp":"2024-09-15T22:47:13.053086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:27.138132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"133'3","reported_seq":17,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-15T22:47:16.835339+0000","last_change":"2024-09-15T22:47:13.072141+0000","last_active":"2024-09-15T22:47:16.835339+0000","last_peered":"2024-09-15T22:47:16.835339+0000","last_clean":"2024-09-15T22:47:16.835339+0000","last_became_active":"2024-09-15T22:47:13.071864+0000","last_became_peered":"2024-09-15T22:47:13.071864+0000","last_unstale":"2024-09-15T22:47:16.835339+0000","last_undegraded":"2024-09-15T22:47:16.835339+0000","last_fullsized":"2024-09-15T22:47:16.835339+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:12.048468+0000","last_clean_scrub_stamp":"2024-09-15T22:47:12.048468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:39.800819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":413,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-15T22:47:14.061403+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:14.061403+0000","last_peered":"2024-09-15T22:47:14.061403+0000","last_clean":"2024-09-15T22:47:14.061403+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:14.061403+0000","last_undegraded":"2024-09-15T22:47:14.061403+0000","last_fullsized":"2024-09-15T22:47:14.061403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1671168,"data_stored":735629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":735629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33416,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338424,"statfs":{"total":96636764160,"available":96602546176,"internally_reserved":0,"allocated":2277376,"data_stored":1321447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1691648,"data_stored":737845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1679360,"data_stored":736245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1675264,"data_stored":735651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33396,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338444,"statfs":{"total":96636764160,"available":96602566656,"internally_reserved":0,"allocated":2256896,"data_stored":1319711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1662976,"data_stored":729363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:17.347 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:47:17.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:47:17.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.488+0000 7fa4a09d6640 1 Processor -- start 2024-09-15T22:47:17.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.488+0000 7fa4a09d6640 1 -- start start 2024-09-15T22:47:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.489+0000 7fa4a09d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 0x7fa49c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.489+0000 7fa4a09d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.489+0000 7fa4a09d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c15c970 con 0x7fa49c15b370 2024-09-15T22:47:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.489+0000 7fa4a09d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c15fef0 con 0x7fa49c06f130 2024-09-15T22:47:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.489+0000 7fa4a09d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c15bbb0 con 0x7fa49c15f9f0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa499d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 0x7fa49c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:51938/0 (socket says 172.21.15.134:51938) 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 -- 172.21.15.134:0/4256767818 learned_addr learned my addr 172.21.15.134:0/4256767818 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 -- 172.21.15.134:0/4256767818 >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 msgr2=0x7fa49c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 --2- 172.21.15.134:0/4256767818 >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 0x7fa49c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 -- 172.21.15.134:0/4256767818 >> v1:172.21.15.177:6789/0 conn(0x7fa49c15b370 legacy=0x7fa49c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa49ad9d640 1 -- 172.21.15.134:0/4256767818 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c15be90 con 0x7fa49c15f9f0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.490+0000 7fa499d9b640 1 --2- 172.21.15.134:0/4256767818 >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 0x7fa49c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa49ad9d640 1 --2- 172.21.15.134:0/4256767818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa494009870 tx=0x7fa49402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6722ee90b0688de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa49959a640 1 -- 172.21.15.134:0/4256767818 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494037070 con 0x7fa49c15f9f0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa49959a640 1 -- 172.21.15.134:0/4256767818 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa494032440 con 0x7fa49c15f9f0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa49959a640 1 -- 172.21.15.134:0/4256767818 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494032810 con 0x7fa49c15f9f0 2024-09-15T22:47:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa4a09d6640 1 -- 172.21.15.134:0/4256767818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 msgr2=0x7fa49c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.491+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/4256767818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa494009870 tx=0x7fa49402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 -- 172.21.15.134:0/4256767818 shutdown_connections 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/4256767818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15f9f0 0x7fa49c0ce490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/4256767818 >> v2:172.21.15.177:3300/0 conn(0x7fa49c06f130 0x7fa49c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 -- 172.21.15.134:0/4256767818 >> 172.21.15.134:0/4256767818 conn(0x7fa49c06bba0 msgr2=0x7fa49c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 -- 172.21.15.134:0/4256767818 shutdown_connections 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.492+0000 7fa4a09d6640 1 -- 172.21.15.134:0/4256767818 wait complete. 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.493+0000 7fa4a09d6640 1 Processor -- start 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.493+0000 7fa4a09d6640 1 -- start start 2024-09-15T22:47:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15b370 0x7fa49c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49c15f9f0 0x7fa49c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0731b0 con 0x7fa49c06f130 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c15c450 con 0x7fa49c15f9f0 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c15b750 con 0x7fa49c15b370 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46960/0 (socket says 172.21.15.134:46960) 2024-09-15T22:47:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 -- 172.21.15.134:0/2877845642 learned_addr learned my addr 172.21.15.134:0/2877845642 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:17.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa499d9b640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15b370 0x7fa49c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49ad9d640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49c15f9f0 0x7fa49c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 -- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15b370 msgr2=0x7fa49c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15b370 0x7fa49c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 -- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49c15f9f0 msgr2=0x7fa49c0aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49c15f9f0 0x7fa49c0aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 -- 172.21.15.134:0/2877845642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c158dd0 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa49a59c640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00ea60 tx=0x7fa48c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c002010 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c006b50 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.494+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c1590b0 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.495+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c003970 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.495+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c159950 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.496+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c072560 con 0x7fa49c06f130 2024-09-15T22:47:17.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.496+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fa48c003b10 con 0x7fa49c06f130 2024-09-15T22:47:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.496+0000 7fa492ffd640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 0x7fa47c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.497+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fa48c08e580 con 0x7fa49c06f130 2024-09-15T22:47:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.497+0000 7fa499d9b640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 0x7fa47c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.497+0000 7fa499d9b640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 0x7fa47c06ed10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa484009560 tx=0x7fa484009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.501+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa48c01f030 con 0x7fa49c06f130 2024-09-15T22:47:17.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.726+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa49c06c090 con 0x7fa49c06f130 2024-09-15T22:47:17.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.728+0000 7fa492ffd640 1 -- 172.21.15.134:0/2877845642 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fa48c016030 con 0x7fa49c06f130 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:47:17.730 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:47:17.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 msgr2=0x7fa47c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 0x7fa47c06ed10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa484009560 tx=0x7fa484009190 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 msgr2=0x7fa49c1f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00ea60 tx=0x7fa48c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 shutdown_connections 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49c15f9f0 0x7fa49c0aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa49c15b370 0x7fa49c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa47c06c850 0x7fa47c06ed10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 --2- 172.21.15.134:0/2877845642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa49c06f130 0x7fa49c1f1e30 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 >> 172.21.15.134:0/2877845642 conn(0x7fa49c06bba0 msgr2=0x7fa49c15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:17.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 shutdown_connections 2024-09-15T22:47:17.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.730+0000 7fa4a09d6640 1 -- 172.21.15.134:0/2877845642 wait complete. 2024-09-15T22:47:17.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.844+0000 7ff1b65a6640 1 Processor -- start 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.844+0000 7ff1b65a6640 1 -- start start 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b65a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff1b015ca40 0x7ff1b015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b65a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1b015ceb0 0x7ff1b01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b65a6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b015d390 con 0x7ff1b00d02a0 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b65a6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b015d670 con 0x7ff1b015ceb0 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b65a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b015d950 con 0x7ff1b015ca40 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1b015ceb0 0x7ff1b01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1b015ceb0 0x7ff1b01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46964/0 (socket says 172.21.15.134:46964) 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 -- 172.21.15.134:0/4037921282 learned_addr learned my addr 172.21.15.134:0/4037921282 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1af7fe640 1 --2- 172.21.15.134:0/4037921282 >> v2:172.21.15.177:3300/0 conn(0x7ff1b015ca40 0x7ff1b015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 -- 172.21.15.134:0/4037921282 >> v2:172.21.15.177:3300/0 conn(0x7ff1b015ca40 msgr2=0x7ff1b015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 --2- 172.21.15.134:0/4037921282 >> v2:172.21.15.177:3300/0 conn(0x7ff1b015ca40 0x7ff1b015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 -- 172.21.15.134:0/4037921282 >> v1:172.21.15.177:6789/0 conn(0x7ff1b00d02a0 legacy=0x7ff1b00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.845+0000 7ff1b4b43640 1 -- 172.21.15.134:0/4037921282 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b015dc30 con 0x7ff1b015ceb0 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b4b43640 1 --2- 172.21.15.134:0/4037921282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ceb0 0x7ff1b01594c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00cf320 tx=0x7ff1a802c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adefb423f07b3e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1aeffd640 1 -- 172.21.15.134:0/4037921282 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8039070 con 0x7ff1b015ceb0 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1aeffd640 1 -- 172.21.15.134:0/4037921282 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a800b2e0 con 0x7ff1b015ceb0 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1aeffd640 1 -- 172.21.15.134:0/4037921282 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8009820 con 0x7ff1b015ceb0 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 -- 172.21.15.134:0/4037921282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ceb0 msgr2=0x7ff1b01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/4037921282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ceb0 0x7ff1b01594c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00cf320 tx=0x7ff1a802c860 comp rx=0 tx=0).stop 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 -- 172.21.15.134:0/4037921282 shutdown_connections 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/4037921282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ceb0 0x7ff1b01594c0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/4037921282 >> v2:172.21.15.177:3300/0 conn(0x7ff1b015ca40 0x7ff1b015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 -- 172.21.15.134:0/4037921282 >> 172.21.15.134:0/4037921282 conn(0x7ff1b0062cc0 msgr2=0x7ff1b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 -- 172.21.15.134:0/4037921282 shutdown_connections 2024-09-15T22:47:17.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.846+0000 7ff1b65a6640 1 -- 172.21.15.134:0/4037921282 wait complete. 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 Processor -- start 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 -- start start 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1b00d02a0 0x7ff1b014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1b015ceb0 0x7ff1b015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0155d10 con 0x7ff1b015ca40 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0155b90 con 0x7ff1b015ceb0 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.848+0000 7ff1b65a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00b4790 con 0x7ff1b00d02a0 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46970/0 (socket says 172.21.15.134:46970) 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 -- 172.21.15.134:0/2226525660 learned_addr learned my addr 172.21.15.134:0/2226525660 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1b4b43640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1b015ceb0 0x7ff1b015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1affff640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1b00d02a0 0x7ff1b014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 -- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1b00d02a0 msgr2=0x7ff1b014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1b00d02a0 0x7ff1b014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 -- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1b015ceb0 msgr2=0x7ff1b015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1b015ceb0 0x7ff1b015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 -- 172.21.15.134:0/2226525660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b01519f0 con 0x7ff1b015ca40 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1af7fe640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7f0 tx=0x7ff1a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4015070 con 0x7ff1b015ca40 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4004240 con 0x7ff1b015ca40 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b0157490 con 0x7ff1b015ca40 2024-09-15T22:47:17.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4007620 con 0x7ff1b015ca40 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.849+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b0157a50 con 0x7ff1b015ca40 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.850+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b00d0680 con 0x7ff1b015ca40 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.851+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7ff1a40079d0 con 0x7ff1b015ca40 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.851+0000 7ff1acff9640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 0x7ff19c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.851+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7ff1a408c3e0 con 0x7ff1b015ca40 2024-09-15T22:47:17.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.851+0000 7ff1affff640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 0x7ff19c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:17.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.852+0000 7ff1affff640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 0x7ff19c06ed10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0004f60 tx=0x7ff1a0007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:17.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:17.855+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1a4059b40 con 0x7ff1b015ca40 2024-09-15T22:47:18.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.054+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1b00b5780 con 0x7ff1b015ca40 2024-09-15T22:47:18.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.054+0000 7ff1acff9640 1 -- 172.21.15.134:0/2226525660 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5239 (secure 0 0 0) 0x7ff1a405de40 con 0x7ff1b015ca40 2024-09-15T22:47:18.056 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:18.056 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":68,"btime":"2024-09-15T22:47:16:079894+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:18.056 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 68 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.056+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 msgr2=0x7ff19c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.056+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 0x7ff19c06ed10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0004f60 tx=0x7ff1a0007e30 comp rx=0 tx=0).stop 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.056+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 msgr2=0x7ff1b015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.056+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7f0 tx=0x7ff1a400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 shutdown_connections 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1b015ceb0 0x7ff1b015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff19c06c850 0x7ff19c06ed10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b015ca40 0x7ff1b015a4f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 --2- 172.21.15.134:0/2226525660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1b00d02a0 0x7ff1b014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 >> 172.21.15.134:0/2226525660 conn(0x7ff1b0062cc0 msgr2=0x7ff1b00b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 shutdown_connections 2024-09-15T22:47:18.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.057+0000 7ff1b65a6640 1 -- 172.21.15.134:0/2226525660 wait complete. 2024-09-15T22:47:18.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:47:13.404117+0000', 'modified': '2024-09-15T22:47:15.403079+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7776': {'gid': 7776, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/4139080869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6825', 'nonce': 4139080869}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4139080869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7776, 'qdb_cluster': [7776]} 2024-09-15T22:47:18.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:47:18.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:47:18.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.577+0000 7f5a5fc3c640 1 Processor -- start 2024-09-15T22:47:18.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 -- start start 2024-09-15T22:47:18.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a5815e940 0x7f5a580d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a580d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580b7170 con 0x7f5a580cef90 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5a580d1ae0 con 0x7f5a5815e940 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.578+0000 7f5a5fc3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580b7aa0 con 0x7f5a5815ed20 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5e1d9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5a580cef90 0x7f5a580b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38900/0 (socket says 172.21.15.134:38900) 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/2542351204 learned_addr learned my addr 172.21.15.134:0/2542351204 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2542351204 >> v2:172.21.15.177:3300/0 conn(0x7f5a5815e940 0x7f5a580d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a580d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226633821 0 0) 0x7f5a50001490 con 0x7f5a580cef90 2024-09-15T22:47:18.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a44003520 con 0x7f5a580cef90 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798862088 0 0) 0x7f5a44003520 con 0x7f5a580cef90 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 msgr2=0x7f5a580d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a580d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 >> v2:172.21.15.177:3300/0 conn(0x7f5a5815e940 msgr2=0x7f5a580d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 --2- 172.21.15.134:0/2542351204 >> v2:172.21.15.177:3300/0 conn(0x7f5a5815e940 0x7f5a580d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580d3660 con 0x7f5a580cef90 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f5a50001bc0 con 0x7f5a580cef90 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 >> v1:172.21.15.134:6789/0 conn(0x7f5a580cef90 legacy=0x7f5a580b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a440039b0 0x7f5a44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a44004d40 0x7f5a440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580b7aa0 con 0x7f5a440039b0 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4400b9c0 con 0x7f5a44004d40 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4400bb40 con 0x7f5a5815ed20 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a440039b0 0x7f5a44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.579+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a44004d40 0x7f5a440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 msgr2=0x7f5a44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a44004d40 msgr2=0x7f5a440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a44004d40 0x7f5a440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/2542351204 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44003520 con 0x7f5a440039b0 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5815ed20 0x7f5a44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:18.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a44004d40 0x7f5a440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:18.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a440039b0 0x7f5a44003dd0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009ac0 tx=0x7f5a44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb9e810257ff18d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48036070 con 0x7f5a440039b0 2024-09-15T22:47:18.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48031400 con 0x7f5a440039b0 2024-09-15T22:47:18.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.580+0000 7f5a5c9d6640 1 -- 172.21.15.134:0/2542351204 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48009690 con 0x7f5a440039b0 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/2542351204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a440039b0 msgr2=0x7f5a44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/2542351204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a440039b0 0x7f5a44003dd0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009ac0 tx=0x7f5a44005830 comp rx=0 tx=0).stop 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/2542351204 reap_dead start 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/2542351204 shutdown_connections 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/2542351204 >> 172.21.15.134:0/2542351204 conn(0x7f5a580b6240 msgr2=0x7f5a580b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/2542351204 shutdown_connections 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.581+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/2542351204 wait complete. 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.582+0000 7f5a5fc3c640 1 Processor -- start 2024-09-15T22:47:18.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.582+0000 7f5a5fc3c640 1 -- start start 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a440039b0 0x7f5a580ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a580c8cb0 0x7f5a580c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d3f00 con 0x7f5a580b4f10 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d3c20 con 0x7f5a580c8cb0 2024-09-15T22:47:18.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5fc3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580d3310 con 0x7f5a440039b0 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5e1d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5e1d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46994/0 (socket says 172.21.15.134:46994) 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/686533568 learned_addr learned my addr 172.21.15.134:0/686533568 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a580c8cb0 0x7f5a580c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.583+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a440039b0 0x7f5a580ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a440039b0 msgr2=0x7f5a580ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a440039b0 0x7f5a580ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a580c8cb0 msgr2=0x7f5a580c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a580c8cb0 0x7f5a580c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/686533568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580c9770 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5a580d04f0 tx=0x7f5a5000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a4e7fc640 1 -- 172.21.15.134:0/686533568 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000eb90 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a4e7fc640 1 -- 172.21.15.134:0/686533568 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50019070 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a580c9a50 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a4e7fc640 1 -- 172.21.15.134:0/686533568 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50013420 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.584+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a580ca010 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.586+0000 7f5a4e7fc640 1 -- 172.21.15.134:0/686533568 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5a500135c0 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.586+0000 7f5a4e7fc640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 0x7f5a3c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.586+0000 7f5a4e7fc640 1 -- 172.21.15.134:0/686533568 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5a5008c070 con 0x7f5a580b4f10 2024-09-15T22:47:18.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.586+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 0x7f5a3c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.587+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 0x7f5a3c06ed10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a48033000 tx=0x7f5a48008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.587+0000 7f5a629d6740 1 Processor -- start 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.587+0000 7f5a629d6740 1 -- start start 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac75c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559fac6c4520 con 0x559fac75fa80 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559fac66c3e0 con 0x559fac7622c0 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x559fac6c04e0 con 0x559fac763a50 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47002/0 (socket says 172.21.15.134:47002) 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 -- 172.21.15.134:0/2498847902 learned_addr learned my addr 172.21.15.134:0/2498847902 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac75c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 -- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 msgr2=0x559fac75c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac75c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 -- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 msgr2=0x559fac7a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 -- 172.21.15.134:0/2498847902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac6872f0 con 0x559fac75fa80 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009cb0 tx=0x7f5a54009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb556372d8966c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a3b7fe640 1 -- 172.21.15.134:0/2498847902 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5401f480 con 0x559fac75fa80 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a3b7fe640 1 -- 172.21.15.134:0/2498847902 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5401f620 con 0x559fac75fa80 2024-09-15T22:47:18.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.588+0000 7f5a3b7fe640 1 -- 172.21.15.134:0/2498847902 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5401fa10 con 0x559fac75fa80 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 -- 172.21.15.134:0/2498847902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 msgr2=0x559fac7626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009cb0 tx=0x7f5a54009190 comp rx=0 tx=0).stop 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 -- 172.21.15.134:0/2498847902 shutdown_connections 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac75c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac75fa80 0x559fac7626a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 --2- 172.21.15.134:0/2498847902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 -- 172.21.15.134:0/2498847902 >> 172.21.15.134:0/2498847902 conn(0x559fac75ea80 msgr2=0x559fac7a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 -- 172.21.15.134:0/2498847902 shutdown_connections 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.589+0000 7f5a629d6740 1 -- 172.21.15.134:0/2498847902 wait complete. 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.590+0000 7f5a629d6740 1 -- start start 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.590+0000 7f5a629d6740 1 Processor -- start 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac7a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559fac75df20 con 0x559fac78aa40 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559fac64d450 con 0x559fac7622c0 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x559fac7a8290 con 0x559fac763a50 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 10 client.0 _ll_register_callbacks cb 0x559fac3d6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47016/0 (socket says 172.21.15.134:47016) 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/1804480801 learned_addr learned my addr 172.21.15.134:0/1804480801 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac7a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 msgr2=0x559fac7a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac7a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 msgr2=0x559fac7a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 -- 172.21.15.134:0/1804480801 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fac3d72d0 con 0x559fac78aa40 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5a50001670 tx=0x7f5a5005dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634191dd3ec64c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50058ff0 con 0x559fac78aa40 2024-09-15T22:47:18.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5a500556f0 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.591+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a5401f620 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f5a50076050 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 10 client.7905 fetch_fsmap learned FSMap version 68 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559fac4a16b0 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5401f620 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f5a50078bd0 con 0x559fac78aa40 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 10 client.7905 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 10 client.7905 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 20 client.7905 populate_metadata read hostname 'smithi134' 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac78b970 0x559fac78bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 4 client.7905 mds_command: new command op to 7776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:18.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 --> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fac6d1c50 con 0x559fac78b970 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac78b970 0x559fac78bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac78b970 0x559fac78bd50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10082d97d1b24809 server_cookie=d8073f4ea78127eb in_seq=0 out_seq=0 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.592+0000 7f5a38ff9640 10 client.7905 ms_handle_connect on v2:172.21.15.134:6825/4139080869 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1804480801 <== mds.0 v2:172.21.15.134:6825/4139080869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fac6d1c50 con 0x559fac78b970 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a38ff9640 10 client.7905 handle_command_reply: tid=0 2024-09-15T22:47:18.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 client.7905 shutdown 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 msgr2=0x559fac75b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5a50001670 tx=0x7f5a5005dd60 comp rx=0 tx=0).stop 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 shutdown_connections 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac78b970 0x559fac78bd50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac78aa40 0x559fac75b860 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac7a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a38ff9640 0 client.7905 ms_handle_reset on v2:172.21.15.134:6825/4139080869 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1804480801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac7622c0 0x559fac7a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 >> 172.21.15.134:0/1804480801 conn(0x559fac75fa80 msgr2=0x559fac7a6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 shutdown_connections 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 1 -- 172.21.15.134:0/1804480801 wait complete. 2024-09-15T22:47:18.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.593+0000 7f5a629d6740 20 client.7905 trim_cache size 0 max 16384 2024-09-15T22:47:18.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.611+0000 7f5a629d6740 1 Processor -- start 2024-09-15T22:47:18.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.611+0000 7f5a629d6740 1 -- start start 2024-09-15T22:47:18.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.611+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac788c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac78aa40 0x559fac7a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a629d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58200310 con 0x559fac7622c0 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581f8510 con 0x559fac78aa40 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5a581ffcf0 con 0x559fac763a50 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47028/0 (socket says 172.21.15.134:47028) 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1551982336 learned_addr learned my addr 172.21.15.134:0/1551982336 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac78aa40 0x559fac7a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac788c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 msgr2=0x559fac788c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac788c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac78aa40 msgr2=0x559fac7a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac78aa40 0x559fac7a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1551982336 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac761ab0 con 0x559fac7622c0 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac788c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009be0 tx=0x7f5a4802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d21e60ea4c072 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a3affd640 1 -- 172.21.15.134:0/1551982336 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48058070 con 0x559fac7622c0 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a3affd640 1 -- 172.21.15.134:0/1551982336 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48003a60 con 0x559fac7622c0 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.612+0000 7f5a3affd640 1 -- 172.21.15.134:0/1551982336 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48036040 con 0x559fac7622c0 2024-09-15T22:47:18.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- 172.21.15.134:0/1551982336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 msgr2=0x559fac7cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009be0 tx=0x7f5a4802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- 172.21.15.134:0/1551982336 shutdown_connections 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac78aa40 0x559fac7a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac763a50 0x559fac788c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1551982336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac7cb750 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- 172.21.15.134:0/1551982336 >> 172.21.15.134:0/1551982336 conn(0x559fac75fa80 msgr2=0x559fac7a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- 172.21.15.134:0/1551982336 shutdown_connections 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- 172.21.15.134:0/1551982336 wait complete. 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 -- start start 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.613+0000 7f5a629d6740 1 Processor -- start 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac763a50 0x559fac7a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac78aa40 0x559fac7a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559fac7a2a20 con 0x559fac7622c0 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559fac78a290 con 0x559fac763a50 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x559fac75c160 con 0x559fac78aa40 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a629d6740 10 client.0 _ll_register_callbacks cb 0x7f5a50059570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a5d9d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a5d9d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47036/0 (socket says 172.21.15.134:47036) 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1123283575 learned_addr learned my addr 172.21.15.134:0/1123283575 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac763a50 0x559fac7a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.614+0000 7f5a5e1d9640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac78aa40 0x559fac7a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac78aa40 msgr2=0x559fac7a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac78aa40 0x559fac7a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac763a50 msgr2=0x559fac7a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac763a50 0x559fac7a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 -- 172.21.15.134:0/1123283575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fac7a67c0 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a5d9d8640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5a48000c00 tx=0x7f5a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c98a89e826a8a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48058070 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5a48003c10 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a48003a60 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f5a48036040 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 10 client.7911 fetch_fsmap learned FSMap version 68 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559fac825bb0 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48003a60 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f5a48066480 con 0x559fac7622c0 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 10 client.7911 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T22:47:18.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 10 client.7911 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 20 client.7911 populate_metadata read hostname 'smithi134' 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac7aa7b0 0x559fac7aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 4 client.7911 mds_command: new command op to 7776 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.615+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 --> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] -- command(tid 0: {"prefix": "status"}) -- 0x559fac6cbfa0 con 0x559fac7aa7b0 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac7aa7b0 0x559fac7aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a38ff9640 10 client.7911 ms_handle_connect on v2:172.21.15.134:6825/4139080869 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a5d1d7640 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac7aa7b0 0x559fac7aab90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33427937d53f6a11 server_cookie=64f88bc5df602767 in_seq=0 out_seq=0 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a38ff9640 1 -- 172.21.15.134:0/1123283575 <== mds.0 v2:172.21.15.134:6825/4139080869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x559fac6cbfa0 con 0x559fac7aa7b0 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a38ff9640 10 client.7911 handle_command_reply: tid=0 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 client.7911 shutdown 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 msgr2=0x559fac79fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5a48000c00 tx=0x7f5a480046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 shutdown_connections 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:6825/4139080869,v1:172.21.15.134:6835/4139080869] conn(0x559fac7aa7b0 0x559fac7aab90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559fac78aa40 0x559fac7a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559fac763a50 0x559fac7a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a38ff9640 0 client.7911 ms_handle_reset on v2:172.21.15.134:6825/4139080869 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 --2- 172.21.15.134:0/1123283575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559fac7622c0 0x559fac79fef0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 >> 172.21.15.134:0/1123283575 conn(0x559fac75fa80 msgr2=0x559fac788620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 shutdown_connections 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 1 -- 172.21.15.134:0/1123283575 wait complete. 2024-09-15T22:47:18.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.616+0000 7f5a629d6740 20 client.7911 trim_cache size 0 max 16384 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 7776, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 4.5459673059999997, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 68, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 134, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 134, 2024-09-15T22:47:18.630 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 8.6150186160000004 2024-09-15T22:47:18.631 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:47:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 msgr2=0x7f5a3c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 0x7f5a3c06ed10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a48033000 tx=0x7f5a48008030 comp rx=0 tx=0).stop 2024-09-15T22:47:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 msgr2=0x7f5a580b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5a580d04f0 tx=0x7f5a5000e530 comp rx=0 tx=0).stop 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 shutdown_connections 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a3c06c850 0x7f5a3c06ed10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a580b4f10 0x7f5a580b53a0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a580c8cb0 0x7f5a580c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 --2- 172.21.15.134:0/686533568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a440039b0 0x7f5a580ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 >> 172.21.15.134:0/686533568 conn(0x7f5a580b6240 msgr2=0x7f5a58161a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 shutdown_connections 2024-09-15T22:47:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.617+0000 7f5a5fc3c640 1 -- 172.21.15.134:0/686533568 wait complete. 2024-09-15T22:47:18.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:47:18.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.730+0000 7fa7c4fb9640 1 Processor -- start 2024-09-15T22:47:18.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.730+0000 7fa7c4fb9640 1 -- start start 2024-09-15T22:47:18.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7c4fb9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c015c180 0x7fa7c00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7c4fb9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 0x7fa7c00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7c4fb9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c00ce740 con 0x7fa7c00cf5b0 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7c4fb9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c0072640 con 0x7fa7c015c180 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7c4fb9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c0072920 con 0x7fa7c00ce230 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c015c180 0x7fa7c00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c015c180 0x7fa7c00cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47042/0 (socket says 172.21.15.134:47042) 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 -- 172.21.15.134:0/1752587870 learned_addr learned my addr 172.21.15.134:0/1752587870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7bdd9b640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 0x7fa7c00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 -- 172.21.15.134:0/1752587870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 msgr2=0x7fa7c00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 0x7fa7c00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7bd59a640 1 -- 172.21.15.134:0/1752587870 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953133813 0 0) 0x7fa7c00ce740 con 0x7fa7c00cf5b0 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 -- 172.21.15.134:0/1752587870 >> v1:172.21.15.134:6789/0 conn(0x7fa7c00cf5b0 legacy=0x7fa7c0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7be59c640 1 -- 172.21.15.134:0/1752587870 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c0072c00 con 0x7fa7c015c180 2024-09-15T22:47:18.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.731+0000 7fa7bdd9b640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 0x7fa7c00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:18.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.732+0000 7fa7be59c640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c015c180 0x7fa7c00cdcf0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009870 tx=0x7fa7b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424d6ea0c9ff6680 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.732+0000 7fa7bd59a640 1 -- 172.21.15.134:0/1752587870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0037070 con 0x7fa7c015c180 2024-09-15T22:47:18.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.732+0000 7fa7bd59a640 1 -- 172.21.15.134:0/1752587870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b0032440 con 0x7fa7c015c180 2024-09-15T22:47:18.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.732+0000 7fa7bd59a640 1 -- 172.21.15.134:0/1752587870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0032810 con 0x7fa7c015c180 2024-09-15T22:47:18.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1752587870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c015c180 msgr2=0x7fa7c00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c015c180 0x7fa7c00cdcf0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009870 tx=0x7fa7b002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1752587870 shutdown_connections 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00ce230 0x7fa7c00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1752587870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c015c180 0x7fa7c00cdcf0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1752587870 >> 172.21.15.134:0/1752587870 conn(0x7fa7c0062cc0 msgr2=0x7fa7c006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1752587870 shutdown_connections 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.733+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1752587870 wait complete. 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.734+0000 7fa7c4fb9640 1 Processor -- start 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.734+0000 7fa7c4fb9640 1 -- start start 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00cf5b0 0x7fa7c0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015c180 0x7fa7c0156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c015c560 con 0x7fa7c00ce230 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c00722f0 con 0x7fa7c015c180 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7c4fb9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c015c6e0 con 0x7fa7c00cf5b0 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47054/0 (socket says 172.21.15.134:47054) 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 -- 172.21.15.134:0/1342981609 learned_addr learned my addr 172.21.15.134:0/1342981609 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 -- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00cf5b0 msgr2=0x7fa7c0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00cf5b0 0x7fa7c0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 -- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015c180 msgr2=0x7fa7c0156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015c180 0x7fa7c0156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 -- 172.21.15.134:0/1342981609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c01607f0 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.735+0000 7fa7be59c640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009870 tx=0x7fa7b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.736+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0041020 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.736+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b0030970 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.736+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c0160ad0 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.736+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0037040 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.736+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c01530c0 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.737+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c00d0f90 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.737+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fa7b0044020 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.738+0000 7fa7aeffd640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 0x7fa7a006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.738+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fa7b00ac8e0 con 0x7fa7c00ce230 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.738+0000 7fa7bdd9b640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 0x7fa7a006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:18.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.738+0000 7fa7bdd9b640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 0x7fa7a006ed10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006fd0 tx=0x7fa7b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:18.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.742+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7b004b030 con 0x7fa7c00ce230 2024-09-15T22:47:18.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.941+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa7c0151180 con 0x7fa7c00ce230 2024-09-15T22:47:18.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.942+0000 7fa7aeffd640 1 -- 172.21.15.134:0/1342981609 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7fa7b007a7a0 con 0x7fa7c00ce230 2024-09-15T22:47:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 msgr2=0x7fa7a006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 0x7fa7a006ed10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006fd0 tx=0x7fa7b4008040 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 msgr2=0x7fa7c0150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009870 tx=0x7fa7b00046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 shutdown_connections 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015c180 0x7fa7c0156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7c00cf5b0 0x7fa7c0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa7a006c850 0x7fa7a006ed10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 --2- 172.21.15.134:0/1342981609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c00ce230 0x7fa7c0150c40 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 >> 172.21.15.134:0/1342981609 conn(0x7fa7c0062cc0 msgr2=0x7fa7c00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 shutdown_connections 2024-09-15T22:47:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:18.944+0000 7fa7c4fb9640 1 -- 172.21.15.134:0/1342981609 wait complete. 2024-09-15T22:47:18.956 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:47:18.957 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:18.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:18.958 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:47:18.973 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:47:18.973 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:47:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:47:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:18.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:18.977 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:47:19.038 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:47:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:19.039 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:47:19.094 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:47:19.095 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:47:19.095 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:47:19.095 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:47:19.095 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:47:19.095 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:47:19.095 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:47:19.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:47:19.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:47:19.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:47:19.096 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:47:19.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:47:19.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:19.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:19.221 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:47:19.236 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:47:19.236 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:47:19.237 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:19.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:19.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:47:19.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:19.302 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:19.357 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:19.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:19.357 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:19.412 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:47:19.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:19.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:19.495 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:19.495 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:19.495 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:19.504 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:19.504 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:19.504 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:19.504 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:19.504 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:47:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:47:19.512 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:47:19.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:19.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:19.577 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:47:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:47:19.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:19.677 INFO:teuthology.orchestra.run.smithi134.stdout:client6365 2024-09-15T22:47:19.678 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:19.678 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:19.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:47:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.830+0000 7fd98002e640 1 Processor -- start 2024-09-15T22:47:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.831+0000 7fd98002e640 1 -- start start 2024-09-15T22:47:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.831+0000 7fd98002e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9781594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.831+0000 7fd98002e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97815d390 con 0x7fd9780d02a0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.831+0000 7fd98002e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97815d670 con 0x7fd97815ca40 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.831+0000 7fd98002e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd97815d950 con 0x7fd97815ceb0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97ddca640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd9780d02a0 0x7fd9780d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38932/0 (socket says 172.21.15.134:38932) 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97ddca640 1 -- 172.21.15.134:0/2849922514 learned_addr learned my addr 172.21.15.134:0/2849922514 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230969349 0 0) 0x7fd97815d390 con 0x7fd9780d02a0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9781594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd964003520 con 0x7fd9780d02a0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1604289642 0 0) 0x7fd964003520 con 0x7fd9780d02a0 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 msgr2=0x7fd9781594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:19.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9781594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 >> v1:172.21.15.177:6789/0 conn(0x7fd97815ca40 legacy=0x7fd97815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97815dc30 con 0x7fd9780d02a0 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd9700019f0 con 0x7fd9780d02a0 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 >> v1:172.21.15.134:6789/0 conn(0x7fd9780d02a0 legacy=0x7fd9780d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964003f20 0x7fd964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd97815d950 con 0x7fd964004d40 2024-09-15T22:47:19.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd96400bad0 con 0x7fd964003f20 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd96400bcd0 con 0x7fd97815ceb0 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97ddca640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.832+0000 7fd97d5c9640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964003f20 0x7fd964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 -- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 msgr2=0x7fd9640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd97815ceb0 0x7fd9640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 -- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964003f20 msgr2=0x7fd964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964003f20 0x7fd964004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 -- 172.21.15.134:0/2849922514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd964003520 con 0x7fd964004d40 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd97815d2c0 tx=0x7fd964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cfb424d53b17ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974036070 con 0x7fd964004d40 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd974031400 con 0x7fd964004d40 2024-09-15T22:47:19.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.833+0000 7fd97cdc8640 1 -- 172.21.15.134:0/2849922514 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974009690 con 0x7fd964004d40 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 -- 172.21.15.134:0/2849922514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd964004d40 msgr2=0x7fd9640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 --2- 172.21.15.134:0/2849922514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd97815d2c0 tx=0x7fd964005830 comp rx=0 tx=0).stop 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd97e5cb640 1 -- 172.21.15.134:0/2849922514 reap_dead start 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 -- 172.21.15.134:0/2849922514 shutdown_connections 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 -- 172.21.15.134:0/2849922514 >> 172.21.15.134:0/2849922514 conn(0x7fd978062cc0 msgr2=0x7fd97806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 -- 172.21.15.134:0/2849922514 shutdown_connections 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.834+0000 7fd98002e640 1 -- 172.21.15.134:0/2849922514 wait complete. 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.835+0000 7fd98002e640 1 Processor -- start 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.835+0000 7fd98002e640 1 -- start start 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964004d40 0x7fd97814c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9780b21c0 0x7fd9780b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd978155b90 con 0x7fd9781f2a90 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd97815eb40 con 0x7fd964004d40 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd98002e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd978155d10 con 0x7fd9780b21c0 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd97d5c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd97d5c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47076/0 (socket says 172.21.15.134:47076) 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd97d5c9640 1 -- 172.21.15.134:0/188483062 learned_addr learned my addr 172.21.15.134:0/188483062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd97ddca640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964004d40 0x7fd97814c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.836+0000 7fd97e5cb640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9780b21c0 0x7fd9780b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 -- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9780b21c0 msgr2=0x7fd9780b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9780b21c0 0x7fd9780b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 -- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964004d40 msgr2=0x7fd97814c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964004d40 0x7fd97814c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 -- 172.21.15.134:0/188483062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97814c630 con 0x7fd9781f2a90 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd97d5c9640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd96800f7c0 tx=0x7fd96800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680052e0 con 0x7fd9781f2a90 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968018070 con 0x7fd9781f2a90 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9781efbd0 con 0x7fd9781f2a90 2024-09-15T22:47:19.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800d910 con 0x7fd9781f2a90 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.837+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781f0190 con 0x7fd9781f2a90 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.838+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9780b4790 con 0x7fd9781f2a90 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.839+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fd96800dab0 con 0x7fd9781f2a90 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.839+0000 7fd96e7fc640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 0x7fd95c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.839+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fd96808bcc0 con 0x7fd9781f2a90 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.839+0000 7fd97ddca640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 0x7fd95c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.840+0000 7fd97ddca640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 0x7fd95c06ed40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd970001460 tx=0x7fd970006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:19.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:19.844+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd968059530 con 0x7fd9781f2a90 2024-09-15T22:47:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.045+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9780b5740 con 0x7fd9781f2a90 2024-09-15T22:47:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.045+0000 7fd96e7fc640 1 -- 172.21.15.134:0/188483062 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7fd96805d830 con 0x7fd9781f2a90 2024-09-15T22:47:20.046 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:47:20.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 msgr2=0x7fd95c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 0x7fd95c06ed40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd970001460 tx=0x7fd970006040 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 msgr2=0x7fd9780aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd96800f7c0 tx=0x7fd96800fc80 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 shutdown_connections 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9780b21c0 0x7fd9780b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd95c06c880 0x7fd95c06ed40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9781f2a90 0x7fd9780aadf0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 --2- 172.21.15.134:0/188483062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd964004d40 0x7fd97814c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 >> 172.21.15.134:0/188483062 conn(0x7fd978062cc0 msgr2=0x7fd978154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 shutdown_connections 2024-09-15T22:47:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:20.047+0000 7fd98002e640 1 -- 172.21.15.134:0/188483062 wait complete. 2024-09-15T22:47:20.059 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:47:20.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:47:20.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:47:20.059 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:47:20.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:20.060 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:47:20.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:47:20.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:47:20.060 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:20.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.060 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:20.080 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.081 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:47:20.082 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:20.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.083 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:47:20.151 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:47:20.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.154 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:47:20.228 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:47:20.228 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:47:20.228 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:47:20.228 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:47:20.228 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:47:20.229 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:47:20.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:47:20.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:20.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.390 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:47:20.428 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:47:20.429 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:47:20.429 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:20.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:47:20.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:20.715 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:20.782 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:20.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:20.782 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:20.845 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:47:20.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.846 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:20.933 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:20.933 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:20.933 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:20.942 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:20.942 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:20.942 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:20.942 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:20.942 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:47:20.947 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:47:20.948 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:47:20.948 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:47:20.948 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:47:20.948 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:47:20.948 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:47:20.949 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:47:20.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:20.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:20.974 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:47:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:47:21.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:21.070 INFO:teuthology.orchestra.run.smithi177.stdout:client6374 2024-09-15T22:47:21.070 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:21.070 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:21.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:47:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.199+0000 7f0f5470c640 1 Processor -- start 2024-09-15T22:47:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.199+0000 7f0f5470c640 1 -- start start 2024-09-15T22:47:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f5470c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f5470c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c0720f0 con 0x7f0f4c0b4060 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f5470c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c1421e0 con 0x7f0f4c141c40 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f5470c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c06d870 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f524a8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f524a8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47088/0 (socket says 172.21.15.134:47088) 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f51ca7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0f4c0b4060 0x7f0f4c13fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38940/0 (socket says 172.21.15.134:38940) 2024-09-15T22:47:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.200+0000 7f0f524a8640 1 -- 172.21.15.134:0/2314992903 learned_addr learned my addr 172.21.15.134:0/2314992903 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.201+0000 7f0f524a8640 1 -- 172.21.15.134:0/2314992903 >> v1:172.21.15.177:6789/0 conn(0x7f0f4c141c40 legacy=0x7f0f4c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.201+0000 7f0f524a8640 1 -- 172.21.15.134:0/2314992903 >> v1:172.21.15.134:6789/0 conn(0x7f0f4c0b4060 legacy=0x7f0f4c13fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.201+0000 7f0f524a8640 1 -- 172.21.15.134:0/2314992903 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c1424c0 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.201+0000 7f0f514a6640 1 -- 172.21.15.134:0/2314992903 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859336737 0 0) 0x7f0f4c0720f0 con 0x7f0f4c0b4060 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.201+0000 7f0f524a8640 1 --2- 172.21.15.134:0/2314992903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f4802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5ef3ba002e1346 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f514a6640 1 -- 172.21.15.134:0/2314992903 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48037070 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f514a6640 1 -- 172.21.15.134:0/2314992903 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4802ae50 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f514a6640 1 -- 172.21.15.134:0/2314992903 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48032860 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 -- 172.21.15.134:0/2314992903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c0b3c80 msgr2=0x7f0f4c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2314992903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f4802a300 comp rx=0 tx=0).stop 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 -- 172.21.15.134:0/2314992903 shutdown_connections 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2314992903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c15d4f0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 -- 172.21.15.134:0/2314992903 >> 172.21.15.134:0/2314992903 conn(0x7f0f4c062810 msgr2=0x7f0f4c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 -- 172.21.15.134:0/2314992903 shutdown_connections 2024-09-15T22:47:21.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.202+0000 7f0f5470c640 1 -- 172.21.15.134:0/2314992903 wait complete. 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.203+0000 7f0f5470c640 1 Processor -- start 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 -- start start 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c0b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c15d910 0x7f0f4c13d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c06c2b0 con 0x7f0f4c141c40 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c142a80 con 0x7f0f4c0b3c80 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f5470c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c06c430 con 0x7f0f4c15d910 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f51ca7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f51ca7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47098/0 (socket says 172.21.15.134:47098) 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f51ca7640 1 -- 172.21.15.134:0/2230960127 learned_addr learned my addr 172.21.15.134:0/2230960127 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f524a8640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c0b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.204+0000 7f0f52ca9640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c15d910 0x7f0f4c13d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 -- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c15d910 msgr2=0x7f0f4c13d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c15d910 0x7f0f4c13d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 -- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3c80 msgr2=0x7f0f4c0b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c0b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 -- 172.21.15.134:0/2230960127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0b4ca0 con 0x7f0f4c141c40 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f51ca7640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00c430 tx=0x7f0f3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0074e0 con 0x7f0f4c141c40 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c0047e0 con 0x7f0f4c141c40 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c0b4f80 con 0x7f0f4c141c40 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c004c10 con 0x7f0f4c141c40 2024-09-15T22:47:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.205+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c0b5540 con 0x7f0f4c141c40 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.206+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c15d4f0 con 0x7f0f4c141c40 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.206+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f0f3c011070 con 0x7f0f4c141c40 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.207+0000 7f0f42ffd640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 0x7f0f3006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.207+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f0f3c08b930 con 0x7f0f4c141c40 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.207+0000 7f0f524a8640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 0x7f0f3006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.208+0000 7f0f524a8640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 0x7f0f3006ed40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f4802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.212+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f3c059230 con 0x7f0f4c141c40 2024-09-15T22:47:21.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:21.411+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0f4c0cf700 con 0x7f0f4c141c40 2024-09-15T22:47:22.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:47:22.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:47:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.269+0000 7f0f42ffd640 1 -- 172.21.15.134:0/2230960127 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v69) ==== 136+0+0 (secure 0 0 0) 0x7f0f3c05d530 con 0x7f0f4c141c40 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 msgr2=0x7f0f3006ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 0x7f0f3006ed40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f4802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 msgr2=0x7f0f4c13b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00c430 tx=0x7f0f3c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 shutdown_connections 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c15d910 0x7f0f4c13d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0f3006c880 0x7f0f3006ed40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f4c141c40 0x7f0f4c13b310 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 --2- 172.21.15.134:0/2230960127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3c80 0x7f0f4c0b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.271+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 >> 172.21.15.134:0/2230960127 conn(0x7f0f4c062810 msgr2=0x7f0f4c13ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.272+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 shutdown_connections 2024-09-15T22:47:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.272+0000 7f0f5470c640 1 -- 172.21.15.134:0/2230960127 wait complete. 2024-09-15T22:47:22.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:47:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.388+0000 7f7f56a0e640 1 Processor -- start 2024-09-15T22:47:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.388+0000 7f7f56a0e640 1 -- start start 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f56a0e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f5015e7b0 0x7f7f50071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f56a0e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 0x7f7f5006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f56a0e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f50071880 con 0x7f7f500b5600 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f56a0e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5006e680 con 0x7f7f5015e7b0 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f56a0e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7f500741c0 con 0x7f7f5006ccb0 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f4ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f5015e7b0 0x7f7f50071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f4ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f5015e7b0 0x7f7f50071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47100/0 (socket says 172.21.15.134:47100) 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.389+0000 7f7f4ffff640 1 -- 172.21.15.134:0/3067025979 learned_addr learned my addr 172.21.15.134:0/3067025979 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f54fab640 1 --2- 172.21.15.134:0/3067025979 >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 0x7f7f5006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f4ffff640 1 -- 172.21.15.134:0/3067025979 >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 msgr2=0x7f7f5006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f4ffff640 1 --2- 172.21.15.134:0/3067025979 >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 0x7f7f5006d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f4ffff640 1 -- 172.21.15.134:0/3067025979 >> v1:172.21.15.177:6789/0 conn(0x7f7f500b5600 legacy=0x7f7f50073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f4ffff640 1 -- 172.21.15.134:0/3067025979 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5006e8d0 con 0x7f7f5015e7b0 2024-09-15T22:47:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f54fab640 1 --2- 172.21.15.134:0/3067025979 >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 0x7f7f5006d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.390+0000 7f7f4ffff640 1 --2- 172.21.15.134:0/3067025979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50071340 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7f500b4df0 tx=0x7f7f4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bfbe76b5e6743e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f4effd640 1 -- 172.21.15.134:0/3067025979 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40037070 con 0x7f7f5015e7b0 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f4effd640 1 -- 172.21.15.134:0/3067025979 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f40032440 con 0x7f7f5015e7b0 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f4effd640 1 -- 172.21.15.134:0/3067025979 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40032810 con 0x7f7f5015e7b0 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3067025979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 msgr2=0x7f7f50071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3067025979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50071340 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7f500b4df0 tx=0x7f7f4002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3067025979 shutdown_connections 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3067025979 >> v2:172.21.15.177:3300/0 conn(0x7f7f5006ccb0 0x7f7f5006d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3067025979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50071340 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3067025979 >> 172.21.15.134:0/3067025979 conn(0x7f7f500b4300 msgr2=0x7f7f500b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:22.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3067025979 shutdown_connections 2024-09-15T22:47:22.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.391+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3067025979 wait complete. 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.392+0000 7f7f56a0e640 1 Processor -- start 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 -- start start 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f5006ccb0 0x7f7f501f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f500b5600 0x7f7f501552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50073590 con 0x7f7f5015e7b0 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f500732b0 con 0x7f7f5006ccb0 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f56a0e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5006d610 con 0x7f7f500b5600 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f54fab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f54fab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47116/0 (socket says 172.21.15.134:47116) 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f54fab640 1 -- 172.21.15.134:0/3765816501 learned_addr learned my addr 172.21.15.134:0/3765816501 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f4ffff640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f5006ccb0 0x7f7f501f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.393+0000 7f7f4f7fe640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f500b5600 0x7f7f501552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 -- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f500b5600 msgr2=0x7f7f501552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f500b5600 0x7f7f501552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 -- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f5006ccb0 msgr2=0x7f7f501f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f5006ccb0 0x7f7f501f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 -- 172.21.15.134:0/3765816501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f50155830 con 0x7f7f5015e7b0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f54fab640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cef0 tx=0x7f7f4800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4801a070 con 0x7f7f5015e7b0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4800d860 con 0x7f7f5015e7b0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f50151740 con 0x7f7f5015e7b0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800dc50 con 0x7f7f5015e7b0 2024-09-15T22:47:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.394+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f50155de0 con 0x7f7f5015e7b0 2024-09-15T22:47:22.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.395+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5006d0d0 con 0x7f7f5015e7b0 2024-09-15T22:47:22.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.395+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f7f4801d070 con 0x7f7f5015e7b0 2024-09-15T22:47:22.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.396+0000 7f7f4cff9640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 0x7f7f3c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.396+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f7f4808c630 con 0x7f7f5015e7b0 2024-09-15T22:47:22.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.396+0000 7f7f4ffff640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 0x7f7f3c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.397+0000 7f7f4ffff640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 0x7f7f3c06ed10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7f40034000 tx=0x7f7f4002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.400+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f48059fe0 con 0x7f7f5015e7b0 2024-09-15T22:47:22.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.586+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7f501568b0 con 0x7f7f3c06c850 2024-09-15T22:47:22.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.588+0000 7f7f4cff9640 1 -- 172.21.15.134:0/3765816501 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7f501568b0 con 0x7f7f3c06c850 2024-09-15T22:47:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:47:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:47:22.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:22.590 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 msgr2=0x7f7f3c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 0x7f7f3c06ed10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7f40034000 tx=0x7f7f4002e000 comp rx=0 tx=0).stop 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 msgr2=0x7f7f50151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cef0 tx=0x7f7f4800a710 comp rx=0 tx=0).stop 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 shutdown_connections 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7f3c06c850 0x7f7f3c06ed10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f5015e7b0 0x7f7f50151200 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f500b5600 0x7f7f501552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 --2- 172.21.15.134:0/3765816501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f5006ccb0 0x7f7f501f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 >> 172.21.15.134:0/3765816501 conn(0x7f7f500b4300 msgr2=0x7f7f50073ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:22.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 shutdown_connections 2024-09-15T22:47:22.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.590+0000 7f7f56a0e640 1 -- 172.21.15.134:0/3765816501 wait complete. 2024-09-15T22:47:22.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:47:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.703+0000 7fc33c186640 1 Processor -- start 2024-09-15T22:47:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.703+0000 7fc33c186640 1 -- start start 2024-09-15T22:47:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33c186640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc33406f130 0x7fc3340b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33c186640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 0x7fc3340ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33c186640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33415c820 con 0x7fc334158e50 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33c186640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc3340b43f0 con 0x7fc33406f130 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33c186640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc3340b3630 con 0x7fc33415c370 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc33406f130 0x7fc3340b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc33406f130 0x7fc3340b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47132/0 (socket says 172.21.15.134:47132) 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 -- 172.21.15.134:0/460432475 learned_addr learned my addr 172.21.15.134:0/460432475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33a723640 1 --2- 172.21.15.134:0/460432475 >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 0x7fc3340ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 -- 172.21.15.134:0/460432475 >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 msgr2=0x7fc3340ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 --2- 172.21.15.134:0/460432475 >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 0x7fc3340ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 -- 172.21.15.134:0/460432475 >> v1:172.21.15.177:6789/0 conn(0x7fc334158e50 legacy=0x7fc33406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc339721640 1 -- 172.21.15.134:0/460432475 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340b3910 con 0x7fc33406f130 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.704+0000 7fc33a723640 1 --2- 172.21.15.134:0/460432475 >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 0x7fc3340ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc339721640 1 --2- 172.21.15.134:0/460432475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33406f130 0x7fc3340b5050 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc3340cd780 tx=0x7fc32402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f0e8bd16bca3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc338f20640 1 -- 172.21.15.134:0/460432475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324004230 con 0x7fc33406f130 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc338f20640 1 -- 172.21.15.134:0/460432475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3240043d0 con 0x7fc33406f130 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc338f20640 1 -- 172.21.15.134:0/460432475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324003810 con 0x7fc33406f130 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc33c186640 1 -- 172.21.15.134:0/460432475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33406f130 msgr2=0x7fc3340b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.705+0000 7fc33c186640 1 --2- 172.21.15.134:0/460432475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33406f130 0x7fc3340b5050 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc3340cd780 tx=0x7fc32402c890 comp rx=0 tx=0).stop 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 -- 172.21.15.134:0/460432475 shutdown_connections 2024-09-15T22:47:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 --2- 172.21.15.134:0/460432475 >> v2:172.21.15.177:3300/0 conn(0x7fc33415c370 0x7fc3340ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 --2- 172.21.15.134:0/460432475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33406f130 0x7fc3340b5050 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 -- 172.21.15.134:0/460432475 >> 172.21.15.134:0/460432475 conn(0x7fc33406bba0 msgr2=0x7fc33406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 -- 172.21.15.134:0/460432475 shutdown_connections 2024-09-15T22:47:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.706+0000 7fc33c186640 1 -- 172.21.15.134:0/460432475 wait complete. 2024-09-15T22:47:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.707+0000 7fc33c186640 1 Processor -- start 2024-09-15T22:47:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.707+0000 7fc33c186640 1 -- start start 2024-09-15T22:47:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc33406f130 0x7fc334148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 0x7fc334145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc334159230 con 0x7fc33415c370 2024-09-15T22:47:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc3340b3ed0 con 0x7fc33406f130 2024-09-15T22:47:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc3340ce740 con 0x7fc334158e50 2024-09-15T22:47:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47136/0 (socket says 172.21.15.134:47136) 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 -- 172.21.15.134:0/617083195 learned_addr learned my addr 172.21.15.134:0/617083195 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc339f22640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc33406f130 0x7fc334148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc339721640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 0x7fc334145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 -- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 msgr2=0x7fc334145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 0x7fc334145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 -- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc33406f130 msgr2=0x7fc334148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc33406f130 0x7fc334148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 -- 172.21.15.134:0/617083195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc334145ab0 con 0x7fc33415c370 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc339721640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 0x7fc334145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33a723640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007e20 tx=0x7fc32c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c01a070 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c003b90 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc334145d90 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00de80 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.708+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc334146350 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.709+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3340ce200 con 0x7fc33415c370 2024-09-15T22:47:22.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.710+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fc32c01d070 con 0x7fc33415c370 2024-09-15T22:47:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.710+0000 7fc32a7fc640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 0x7fc31806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.710+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fc32c08c160 con 0x7fc33415c370 2024-09-15T22:47:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.711+0000 7fc339f22640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 0x7fc31806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.711+0000 7fc339f22640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 0x7fc31806ed10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc330001780 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.714+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc32c010070 con 0x7fc33415c370 2024-09-15T22:47:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.882+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc3340b1820 con 0x7fc33415c370 2024-09-15T22:47:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.883+0000 7fc32a7fc640 1 -- 172.21.15.134:0/617083195 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7fc32c059950 con 0x7fc33415c370 2024-09-15T22:47:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.884+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 msgr2=0x7fc31806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.884+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 0x7fc31806ed10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc330001780 tx=0x7fc330009040 comp rx=0 tx=0).stop 2024-09-15T22:47:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 msgr2=0x7fc3340af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007e20 tx=0x7fc32c00d4a0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 shutdown_connections 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc31806c850 0x7fc31806ed10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc33415c370 0x7fc3340af3c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc334158e50 0x7fc334145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 --2- 172.21.15.134:0/617083195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc33406f130 0x7fc334148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 >> 172.21.15.134:0/617083195 conn(0x7fc33406bba0 msgr2=0x7fc334071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 shutdown_connections 2024-09-15T22:47:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.885+0000 7fc33c186640 1 -- 172.21.15.134:0/617083195 wait complete. 2024-09-15T22:47:22.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-15T22:47:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.999+0000 7f7c4c12a640 1 Processor -- start 2024-09-15T22:47:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:22.999+0000 7f7c4c12a640 1 -- start start 2024-09-15T22:47:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4c12a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4415c4b0 0x7f7c4406f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4c12a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c4406d2c0 0x7f7c4415c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4c12a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4406ff70 con 0x7f7c4406fa40 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4c12a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7c440ced00 con 0x7f7c4406d2c0 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4c12a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440cefe0 con 0x7f7c4415c4b0 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c4406d2c0 0x7f7c4415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c4406d2c0 0x7f7c4415c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47142/0 (socket says 172.21.15.134:47142) 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 -- 172.21.15.134:0/2214342960 learned_addr learned my addr 172.21.15.134:0/2214342960 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c49ec6640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4415c4b0 0x7f7c4406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 -- 172.21.15.134:0/2214342960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4415c4b0 msgr2=0x7f7c4406f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4415c4b0 0x7f7c4406f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 -- 172.21.15.134:0/2214342960 >> v1:172.21.15.177:6789/0 conn(0x7f7c4406fa40 legacy=0x7f7c4406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.000+0000 7f7c4a6c7640 1 -- 172.21.15.134:0/2214342960 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440cf2c0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4a6c7640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c4415c890 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009e50 tx=0x7f7c3c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2650e5547b2d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c48ec4640 1 -- 172.21.15.134:0/2214342960 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c036070 con 0x7f7c4406d2c0 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c48ec4640 1 -- 172.21.15.134:0/2214342960 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c031600 con 0x7f7c4406d2c0 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c48ec4640 1 -- 172.21.15.134:0/2214342960 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0319d0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 -- 172.21.15.134:0/2214342960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 msgr2=0x7f7c4415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c4415c890 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009e50 tx=0x7f7c3c02a710 comp rx=0 tx=0).stop 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 -- 172.21.15.134:0/2214342960 shutdown_connections 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c4415c890 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 --2- 172.21.15.134:0/2214342960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4415c4b0 0x7f7c4406f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 -- 172.21.15.134:0/2214342960 >> 172.21.15.134:0/2214342960 conn(0x7f7c440cdb80 msgr2=0x7f7c440cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 -- 172.21.15.134:0/2214342960 shutdown_connections 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.001+0000 7f7c4c12a640 1 -- 172.21.15.134:0/2214342960 wait complete. 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 Processor -- start 2024-09-15T22:47:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 -- start start 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c44156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4406fa40 0x7f7c441434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c4415c4b0 0x7f7c44143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440cf7e0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4406dfe0 con 0x7f7c4415c4b0 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c4c12a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440cf960 con 0x7f7c4406fa40 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c49ec6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c44156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c49ec6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c44156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47152/0 (socket says 172.21.15.134:47152) 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.003+0000 7f7c49ec6640 1 -- 172.21.15.134:0/493691307 learned_addr learned my addr 172.21.15.134:0/493691307 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c4a6c7640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c4415c4b0 0x7f7c44143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c496c5640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4406fa40 0x7f7c441434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 -- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4406fa40 msgr2=0x7f7c441434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4406fa40 0x7f7c441434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 -- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c4415c4b0 msgr2=0x7f7c44143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c4415c4b0 0x7f7c44143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 -- 172.21.15.134:0/493691307 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c44157010 con 0x7f7c4406d2c0 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c496c5640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c4406fa40 0x7f7c441434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c49ec6640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4406d2c0 0x7f7c44156ad0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800d5d0 tx=0x7f7c3800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c380125f0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c38019070 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c4c12a640 1 -- 172.21.15.134:0/493691307 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4415ddf0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c380129f0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.004+0000 7f7c4c12a640 1 -- 172.21.15.134:0/493691307 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4415e630 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.005+0000 7f7c4c12a640 1 -- 172.21.15.134:0/493691307 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4406f500 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.006+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f7c38012b90 con 0x7f7c4406d2c0 2024-09-15T22:47:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.006+0000 7f7c367fc640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2806c850 0x7f7c2806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.006+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f7c3808c2b0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.006+0000 7f7c496c5640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2806c850 0x7f7c2806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.007+0000 7f7c496c5640 1 --2- 172.21.15.134:0/493691307 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7c2806c850 0x7f7c2806ed10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c44146fb0 tx=0x7f7c40009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.010+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c4415ddf0 con 0x7f7c4406d2c0 2024-09-15T22:47:23.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.200+0000 7f7c4c12a640 1 -- 172.21.15.134:0/493691307 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f7c44073670 con 0x7f7c2806c850 2024-09-15T22:47:23.203 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:23.201+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.203+0000 7f7c367fc640 1 -- 172.21.15.134:0/493691307 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f7c44073670 con 0x7f7c2806c850 2024-09-15T22:47:23.203 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.209 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:23.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-15T22:47:23.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.310+0000 7fdfff4f8640 1 Processor -- start 2024-09-15T22:47:23.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.311+0000 7fdfff4f8640 1 -- start start 2024-09-15T22:47:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.311+0000 7fdfff4f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.311+0000 7fdfff4f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 0x7fdff806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdfff4f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff80cf9a0 con 0x7fdff80b3290 2024-09-15T22:47:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdfff4f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdff80cfcf0 con 0x7fdff80b3d50 2024-09-15T22:47:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdfff4f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdff8162210 con 0x7fdff8161e30 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffca93640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 0x7fdff806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:52118/0 (socket says 172.21.15.134:52118) 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffda95640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdff80b3290 0x7fdff80b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:43890/0 (socket says 172.21.15.134:43890) 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 -- 172.21.15.134:0/1800564863 learned_addr learned my addr 172.21.15.134:0/1800564863 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdfebfff640 1 -- 172.21.15.134:0/1800564863 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246354944 0 0) 0x7fdff80cf9a0 con 0x7fdff80b3290 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdfebfff640 1 -- 172.21.15.134:0/1800564863 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe4003520 con 0x7fdff80b3290 2024-09-15T22:47:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 -- 172.21.15.134:0/1800564863 >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 msgr2=0x7fdff806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 --2- 172.21.15.134:0/1800564863 >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 0x7fdff806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 -- 172.21.15.134:0/1800564863 >> v1:172.21.15.177:6789/0 conn(0x7fdff80b3290 legacy=0x7fdff80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffd294640 1 -- 172.21.15.134:0/1800564863 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80d5210 con 0x7fdff8161e30 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.312+0000 7fdffca93640 1 --2- 172.21.15.134:0/1800564863 >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 0x7fdff806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.313+0000 7fdffd294640 1 --2- 172.21.15.134:0/1800564863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ef1812086e7f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.313+0000 7fdfebfff640 1 -- 172.21.15.134:0/1800564863 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec037070 con 0x7fdff8161e30 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.313+0000 7fdfebfff640 1 -- 172.21.15.134:0/1800564863 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec032440 con 0x7fdff8161e30 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.313+0000 7fdfebfff640 1 -- 172.21.15.134:0/1800564863 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0327f0 con 0x7fdff8161e30 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1800564863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 msgr2=0x7fdff80d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 --2- 172.21.15.134:0/1800564863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec02a270 comp rx=0 tx=0).stop 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1800564863 shutdown_connections 2024-09-15T22:47:23.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 --2- 172.21.15.134:0/1800564863 >> v2:172.21.15.177:3300/0 conn(0x7fdff80b3d50 0x7fdff806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 --2- 172.21.15.134:0/1800564863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80d34a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1800564863 >> 172.21.15.134:0/1800564863 conn(0x7fdff80d1870 msgr2=0x7fdff80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:23.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1800564863 shutdown_connections 2024-09-15T22:47:23.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.314+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1800564863 wait complete. 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.315+0000 7fdfff4f8640 1 Processor -- start 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.315+0000 7fdfff4f8640 1 -- start start 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff80b3290 0x7fdff8154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff80b3d50 0x7fdff80c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80d39e0 con 0x7fdff80b3290 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b3950 con 0x7fdff80b3d50 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfff4f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80ca390 con 0x7fdff8161e30 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff80b3290 0x7fdff8154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff80b3290 0x7fdff8154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47154/0 (socket says 172.21.15.134:47154) 2024-09-15T22:47:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 -- 172.21.15.134:0/1994926891 learned_addr learned my addr 172.21.15.134:0/1994926891 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffda95640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffca93640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff80b3d50 0x7fdff80c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 -- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 msgr2=0x7fdff80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 -- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff80b3d50 msgr2=0x7fdff80c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff80b3d50 0x7fdff80c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 -- 172.21.15.134:0/1994926891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80ca5e0 con 0x7fdff80b3290 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffda95640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdff8161e30 0x7fdff80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffca93640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff80b3d50 0x7fdff80c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdffd294640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff80b3290 0x7fdff8154cf0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0090b0 tx=0x7fdfec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.316+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec037040 con 0x7fdff80b3290 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.317+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec004230 con 0x7fdff80b3290 2024-09-15T22:47:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.317+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003610 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.317+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1994926891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff80ca8c0 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.317+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1994926891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff8156170 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.318+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1994926891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff8155cb0 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.318+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fdfec0037b0 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.319+0000 7fdfe9ffb640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdfdc06c850 0x7fdfdc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.319+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fdfec0acbd0 con 0x7fdff80b3290 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.319+0000 7fdffca93640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdfdc06c850 0x7fdfdc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.319+0000 7fdffca93640 1 --2- 172.21.15.134:0/1994926891 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdfdc06c850 0x7fdfdc06ed10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdff80d48d0 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.323+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdff8155cb0 con 0x7fdff80b3290 2024-09-15T22:47:23.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.512+0000 7fdfff4f8640 1 -- 172.21.15.134:0/1994926891 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fdff8069190 con 0x7fdfdc06c850 2024-09-15T22:47:23.514 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:23.513+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.514+0000 7fdfe9ffb640 1 -- 172.21.15.134:0/1994926891 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fdff8069190 con 0x7fdfdc06c850 2024-09-15T22:47:23.515 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.520 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:23.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-15T22:47:23.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.621+0000 7f510415f640 1 Processor -- start 2024-09-15T22:47:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.622+0000 7f510415f640 1 -- start start 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.622+0000 7f510415f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.622+0000 7f510415f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f50fc15d790 0x7f50fc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f510415f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f50fc0cd3b0 0x7f50fc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f510415f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f50fc06da30 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f510415f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f50fc0715c0 con 0x7f50fc15d790 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f510415f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc06d700 con 0x7f50fc15d3b0 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f50fc0cd3b0 0x7f50fc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f50fc0cd3b0 0x7f50fc0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47166/0 (socket says 172.21.15.134:47166) 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 -- 172.21.15.134:0/2291010407 learned_addr learned my addr 172.21.15.134:0/2291010407 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f5101efb640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51016fa640 1 --2- 172.21.15.134:0/2291010407 >> v2:172.21.15.177:3300/0 conn(0x7f50fc15d790 0x7f50fc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 -- 172.21.15.134:0/2291010407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 msgr2=0x7f50fc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 -- 172.21.15.134:0/2291010407 >> v2:172.21.15.177:3300/0 conn(0x7f50fc15d790 msgr2=0x7f50fc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 --2- 172.21.15.134:0/2291010407 >> v2:172.21.15.177:3300/0 conn(0x7f50fc15d790 0x7f50fc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f51026fc640 1 -- 172.21.15.134:0/2291010407 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc0cde80 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.623+0000 7f5101efb640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f51026fc640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc0cf320 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f50fc06c690 tx=0x7f50f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc265ab2a38332b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f5100ef9640 1 -- 172.21.15.134:0/2291010407 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4036070 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f5100ef9640 1 -- 172.21.15.134:0/2291010407 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f4031600 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f5100ef9640 1 -- 172.21.15.134:0/2291010407 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f40319d0 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 -- 172.21.15.134:0/2291010407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc0cd3b0 msgr2=0x7f50fc0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc0cf320 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f50fc06c690 tx=0x7f50f402a6a0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 -- 172.21.15.134:0/2291010407 shutdown_connections 2024-09-15T22:47:23.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc0cf320 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 --2- 172.21.15.134:0/2291010407 >> v2:172.21.15.177:3300/0 conn(0x7f50fc15d790 0x7f50fc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 --2- 172.21.15.134:0/2291010407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.624+0000 7f510415f640 1 -- 172.21.15.134:0/2291010407 >> 172.21.15.134:0/2291010407 conn(0x7f50fc06bba0 msgr2=0x7f50fc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.625+0000 7f510415f640 1 -- 172.21.15.134:0/2291010407 shutdown_connections 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.625+0000 7f510415f640 1 -- 172.21.15.134:0/2291010407 wait complete. 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 Processor -- start 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 -- start start 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc1f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc1f5030 0x7f50fc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc15cbf0 con 0x7f50fc1f5030 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc0cdba0 con 0x7f50fc0cd3b0 2024-09-15T22:47:23.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.626+0000 7f510415f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc15cd70 con 0x7f50fc15d3b0 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc1f5030 0x7f50fc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc1f5030 0x7f50fc15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47174/0 (socket says 172.21.15.134:47174) 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 -- 172.21.15.134:0/2908519553 learned_addr learned my addr 172.21.15.134:0/2908519553 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f5101efb640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc1f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51016fa640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 -- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 msgr2=0x7f50fc15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50fc15d3b0 0x7f50fc15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 -- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50fc0cd3b0 msgr2=0x7f50fc1f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50fc0cd3b0 0x7f50fc1f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 -- 172.21.15.134:0/2908519553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc0b50e0 con 0x7f50fc1f5030 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f51026fc640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50fc1f5030 0x7f50fc15b9d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009f40 tx=0x7f50f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4036050 con 0x7f50fc1f5030 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f4042070 con 0x7f50fc1f5030 2024-09-15T22:47:23.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f510415f640 1 -- 172.21.15.134:0/2908519553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc0b53c0 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4009510 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.627+0000 7f510415f640 1 -- 172.21.15.134:0/2908519553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc0b4420 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.628+0000 7f510415f640 1 -- 172.21.15.134:0/2908519553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc071080 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.629+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f50f4007bd0 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.629+0000 7f50ee7fc640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f50e006c850 0x7f50e006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.629+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f50f40acd80 con 0x7f50fc1f5030 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.629+0000 7f5101efb640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f50e006c850 0x7f50e006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.630+0000 7f5101efb640 1 --2- 172.21.15.134:0/2908519553 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f50e006c850 0x7f50e006ed10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f50fc15c230 tx=0x7f50f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.633+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50f407a4e0 con 0x7f50fc1f5030 2024-09-15T22:47:23.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.828+0000 7f510415f640 1 -- 172.21.15.134:0/2908519553 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f50fc1e6080 con 0x7f50e006c850 2024-09-15T22:47:23.830 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:23.828+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.830+0000 7f50ee7fc640 1 -- 172.21.15.134:0/2908519553 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f50fc1e6080 con 0x7f50e006c850 2024-09-15T22:47:23.831 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:23.836 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:23.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-15T22:47:23.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.936+0000 7f290a5c4640 1 Processor -- start 2024-09-15T22:47:23.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.937+0000 7f290a5c4640 1 -- start start 2024-09-15T22:47:23.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.937+0000 7f290a5c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2904073150 0x7f29040b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.937+0000 7f290a5c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290406d130 con 0x7f290415e860 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.937+0000 7f290a5c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290406d410 con 0x7f29040b7190 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.937+0000 7f290a5c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f290406d6f0 con 0x7f2904073150 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2903fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f290415e860 0x7f290415ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38956/0 (socket says 172.21.15.134:38956) 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2903fff640 1 -- 172.21.15.134:0/4245262592 learned_addr learned my addr 172.21.15.134:0/4245262592 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378324769 0 0) 0x7f290406d130 con 0x7f290415e860 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28ec003520 con 0x7f290415e860 2024-09-15T22:47:23.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f29037fe640 1 --2- 172.21.15.134:0/4245262592 >> v2:172.21.15.177:3300/0 conn(0x7f2904073150 0x7f29040b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 775433905 0 0) 0x7f28ec003520 con 0x7f290415e860 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 >> v2:172.21.15.177:3300/0 conn(0x7f2904073150 msgr2=0x7f29040b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 --2- 172.21.15.134:0/4245262592 >> v2:172.21.15.177:3300/0 conn(0x7f2904073150 0x7f29040b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 >> v1:172.21.15.177:6789/0 conn(0x7f29040b7190 legacy=0x7f290406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290406d9d0 con 0x7f290415e860 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f28f4001670 con 0x7f290415e860 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 >> v1:172.21.15.134:6789/0 conn(0x7f290415e860 legacy=0x7f290415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 0x7f28ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28ec0051c0 0x7f28ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f290406d6f0 con 0x7f28ec004800 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00c060 con 0x7f28ec0039b0 2024-09-15T22:47:23.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec00c260 con 0x7f28ec0051c0 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f29037fe640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 0x7f28ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2903fff640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.938+0000 7f2908b61640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28ec0051c0 0x7f28ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 -- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28ec0051c0 msgr2=0x7f28ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28ec0051c0 0x7f28ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 -- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec0039b0 msgr2=0x7f28ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 -- 172.21.15.134:0/4245262592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec003520 con 0x7f28ec004800 2024-09-15T22:47:23.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f2908b61640 1 -- 172.21.15.134:0/4245262592 reap_dead start 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f29037fe640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 0x7f28ec004c80 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009ac0 tx=0x7f28ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf70f10421fdca5d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8036070 con 0x7f28ec004800 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f8031400 con 0x7f28ec004800 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.939+0000 7f2902ffd640 1 -- 172.21.15.134:0/4245262592 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8009690 con 0x7f28ec004800 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 -- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 msgr2=0x7f28ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 0x7f28ec004c80 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009ac0 tx=0x7f28ec005830 comp rx=0 tx=0).stop 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 -- 172.21.15.134:0/4245262592 shutdown_connections 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 --2- 172.21.15.134:0/4245262592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ec004800 0x7f28ec004c80 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 -- 172.21.15.134:0/4245262592 >> 172.21.15.134:0/4245262592 conn(0x7f29040b4290 msgr2=0x7f29040b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 -- 172.21.15.134:0/4245262592 shutdown_connections 2024-09-15T22:47:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.940+0000 7f290a5c4640 1 -- 172.21.15.134:0/4245262592 wait complete. 2024-09-15T22:47:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.941+0000 7f290a5c4640 1 Processor -- start 2024-09-15T22:47:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.941+0000 7f290a5c4640 1 -- start start 2024-09-15T22:47:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec004800 0x7f290414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f290415f650 0x7f2904154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29041552c0 0x7f29041573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f290406cd50 con 0x7f290415f650 2024-09-15T22:47:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29040b7600 con 0x7f28ec004800 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f290a5c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f290406ced0 con 0x7f29041552c0 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f290415f650 0x7f2904154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f290415f650 0x7f2904154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47188/0 (socket says 172.21.15.134:47188) 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 -- 172.21.15.134:0/685097427 learned_addr learned my addr 172.21.15.134:0/685097427 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f2908b61640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29041552c0 0x7f29041573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 -- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29041552c0 msgr2=0x7f29041573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f2903fff640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec004800 0x7f290414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29041552c0 0x7f29041573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 -- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec004800 msgr2=0x7f290414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec004800 0x7f290414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f29037fe640 1 -- 172.21.15.134:0/685097427 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2904156f20 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f2908b61640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29041552c0 0x7f29041573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.942+0000 7f2903fff640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28ec004800 0x7f290414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f29037fe640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f290415f650 0x7f2904154d80 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f28f8034040 tx=0x7f28f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f803f020 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f8037040 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8036070 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f290a5c4640 1 -- 172.21.15.134:0/685097427 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290415fb50 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.943+0000 7f290a5c4640 1 -- 172.21.15.134:0/685097427 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2904160110 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.944+0000 7f290a5c4640 1 -- 172.21.15.134:0/685097427 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29041556d0 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.944+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f28f8042020 con 0x7f290415f650 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.945+0000 7f2900ff9640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f28f006c850 0x7f28f006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.945+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f28f80abf70 con 0x7f290415f650 2024-09-15T22:47:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.945+0000 7f2903fff640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f28f006c850 0x7f28f006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.945+0000 7f2903fff640 1 --2- 172.21.15.134:0/685097427 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f28f006c850 0x7f28f006ed10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f28f40017e0 tx=0x7f28f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:23.949+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29041556d0 con 0x7f290415f650 2024-09-15T22:47:24.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.146+0000 7f290a5c4640 1 -- 172.21.15.134:0/685097427 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f29040b6c50 con 0x7f28f006c850 2024-09-15T22:47:24.149 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:24.147+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.148+0000 7f2900ff9640 1 -- 172.21.15.134:0/685097427 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f29040b6c50 con 0x7f28f006c850 2024-09-15T22:47:24.150 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.155 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:24.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-15T22:47:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.257+0000 7f90b37e4640 1 Processor -- start 2024-09-15T22:47:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.257+0000 7f90b37e4640 1 -- start start 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b37e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90ac06bba0 0x7f90ac06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b37e4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90ac15ed20 0x7f90ac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b37e4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac0b4800 con 0x7f90ac148100 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b37e4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac0b58a0 con 0x7f90ac06bba0 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b37e4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac06f270 con 0x7f90ac15ed20 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b0d7f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90ac06bba0 0x7f90ac06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b0d7f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90ac06bba0 0x7f90ac06bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47190/0 (socket says 172.21.15.134:47190) 2024-09-15T22:47:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b0d7f640 1 -- 172.21.15.134:0/2045411845 learned_addr learned my addr 172.21.15.134:0/2045411845 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.258+0000 7f90b1d81640 1 --2- 172.21.15.134:0/2045411845 >> v2:172.21.15.177:3300/0 conn(0x7f90ac15ed20 0x7f90ac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90b0d7f640 1 -- 172.21.15.134:0/2045411845 >> v2:172.21.15.177:3300/0 conn(0x7f90ac15ed20 msgr2=0x7f90ac15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90b0d7f640 1 --2- 172.21.15.134:0/2045411845 >> v2:172.21.15.177:3300/0 conn(0x7f90ac15ed20 0x7f90ac15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90b0d7f640 1 -- 172.21.15.134:0/2045411845 >> v1:172.21.15.177:6789/0 conn(0x7f90ac148100 legacy=0x7f90ac06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90b0d7f640 1 -- 172.21.15.134:0/2045411845 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0b4ae0 con 0x7f90ac06bba0 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90b0d7f640 1 --2- 172.21.15.134:0/2045411845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac06bff0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f90ac062ed0 tx=0x7f909c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c3406ac091d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90a3fff640 1 -- 172.21.15.134:0/2045411845 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c037070 con 0x7f90ac06bba0 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90a3fff640 1 -- 172.21.15.134:0/2045411845 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c032440 con 0x7f90ac06bba0 2024-09-15T22:47:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.259+0000 7f90a3fff640 1 -- 172.21.15.134:0/2045411845 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c032810 con 0x7f90ac06bba0 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 -- 172.21.15.134:0/2045411845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 msgr2=0x7f90ac06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 --2- 172.21.15.134:0/2045411845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac06bff0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f90ac062ed0 tx=0x7f909c02a230 comp rx=0 tx=0).stop 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 -- 172.21.15.134:0/2045411845 shutdown_connections 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 --2- 172.21.15.134:0/2045411845 >> v2:172.21.15.177:3300/0 conn(0x7f90ac15ed20 0x7f90ac15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 --2- 172.21.15.134:0/2045411845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac06bff0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 -- 172.21.15.134:0/2045411845 >> 172.21.15.134:0/2045411845 conn(0x7f90ac062810 msgr2=0x7f90ac06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 -- 172.21.15.134:0/2045411845 shutdown_connections 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.260+0000 7f90b37e4640 1 -- 172.21.15.134:0/2045411845 wait complete. 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.261+0000 7f90b37e4640 1 Processor -- start 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.261+0000 7f90b37e4640 1 -- start start 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90ac148100 0x7f90ac13c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90ac15ed20 0x7f90ac13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac1484e0 con 0x7f90ac06bba0 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac06c530 con 0x7f90ac15ed20 2024-09-15T22:47:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b37e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac0b50a0 con 0x7f90ac148100 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac15bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47202/0 (socket says 172.21.15.134:47202) 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 -- 172.21.15.134:0/1875880895 learned_addr learned my addr 172.21.15.134:0/1875880895 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1d81640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90ac15ed20 0x7f90ac13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b0d7f640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90ac148100 0x7f90ac13c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 -- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90ac148100 msgr2=0x7f90ac13c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90ac148100 0x7f90ac13c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 -- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90ac15ed20 msgr2=0x7f90ac13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90ac15ed20 0x7f90ac13baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 -- 172.21.15.134:0/1875880895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac15c5b0 con 0x7f90ac06bba0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.262+0000 7f90b1580640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90ac06bba0 0x7f90ac15bd20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c430 tx=0x7f90a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.263+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8011790 con 0x7f90ac06bba0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.263+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a8017070 con 0x7f90ac06bba0 2024-09-15T22:47:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.263+0000 7f90b37e4640 1 -- 172.21.15.134:0/1875880895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac15c890 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.263+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8011bb0 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.263+0000 7f90b37e4640 1 -- 172.21.15.134:0/1875880895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac15ce50 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.264+0000 7f90b37e4640 1 -- 172.21.15.134:0/1875880895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac1478e0 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.264+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f90a801c460 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.265+0000 7f90a1ffb640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f909006c850 0x7f909006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.265+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f90a808bc80 con 0x7f90ac06bba0 2024-09-15T22:47:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.265+0000 7f90b0d7f640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f909006c850 0x7f909006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.265+0000 7f90b0d7f640 1 --2- 172.21.15.134:0/1875880895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f909006c850 0x7f909006ed10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f909c034000 tx=0x7f909c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.269+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90a80594f0 con 0x7f90ac06bba0 2024-09-15T22:47:24.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.465+0000 7f90b37e4640 1 -- 172.21.15.134:0/1875880895 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) -- 0x7f90ac0b5380 con 0x7f909006c850 2024-09-15T22:47:24.468 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:24.465+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.467+0000 7f90a1ffb640 1 -- 172.21.15.134:0/1875880895 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f90ac0b5380 con 0x7f909006c850 2024-09-15T22:47:24.468 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.473 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:24.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-15T22:47:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.577+0000 7fec4a9a6640 1 Processor -- start 2024-09-15T22:47:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.577+0000 7fec4a9a6640 1 -- start start 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec4a9a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec4406c2b0 0x7fec4406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec4a9a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fec4406f260 0x7fec4415f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec4a9a6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec440b5390 con 0x7fec44148290 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec4a9a6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fec4406f950 con 0x7fec4406c2b0 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec4a9a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fec4406fc30 con 0x7fec4406f260 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec437fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec4406c2b0 0x7fec4406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec437fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec4406c2b0 0x7fec4406ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47210/0 (socket says 172.21.15.134:47210) 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.578+0000 7fec437fe640 1 -- 172.21.15.134:0/700718854 learned_addr learned my addr 172.21.15.134:0/700718854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec437fe640 1 -- 172.21.15.134:0/700718854 >> v2:172.21.15.177:3300/0 conn(0x7fec4406f260 msgr2=0x7fec4415f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:24.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec48f43640 1 --2- 172.21.15.134:0/700718854 >> v2:172.21.15.177:3300/0 conn(0x7fec4406f260 0x7fec4415f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec437fe640 1 --2- 172.21.15.134:0/700718854 >> v2:172.21.15.177:3300/0 conn(0x7fec4406f260 0x7fec4415f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec437fe640 1 -- 172.21.15.134:0/700718854 >> v1:172.21.15.177:6789/0 conn(0x7fec44148290 legacy=0x7fec4406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:24.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec437fe640 1 -- 172.21.15.134:0/700718854 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4406ff10 con 0x7fec4406c2b0 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec437fe640 1 --2- 172.21.15.134:0/700718854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4406c2b0 0x7fec4406ed20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fec440ae8e0 tx=0x7fec3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdfb597309973d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec42ffd640 1 -- 172.21.15.134:0/700718854 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38037070 con 0x7fec4406c2b0 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.579+0000 7fec42ffd640 1 -- 172.21.15.134:0/700718854 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec38032440 con 0x7fec4406c2b0 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec42ffd640 1 -- 172.21.15.134:0/700718854 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38032810 con 0x7fec4406c2b0 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 -- 172.21.15.134:0/700718854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4406c2b0 msgr2=0x7fec4406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 --2- 172.21.15.134:0/700718854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4406c2b0 0x7fec4406ed20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fec440ae8e0 tx=0x7fec3802a230 comp rx=0 tx=0).stop 2024-09-15T22:47:24.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 -- 172.21.15.134:0/700718854 shutdown_connections 2024-09-15T22:47:24.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 --2- 172.21.15.134:0/700718854 >> v2:172.21.15.177:3300/0 conn(0x7fec4406f260 0x7fec4415f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 --2- 172.21.15.134:0/700718854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4406c2b0 0x7fec4406ed20 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 -- 172.21.15.134:0/700718854 >> 172.21.15.134:0/700718854 conn(0x7fec44062810 msgr2=0x7fec4406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:24.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 -- 172.21.15.134:0/700718854 shutdown_connections 2024-09-15T22:47:24.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.580+0000 7fec4a9a6640 1 -- 172.21.15.134:0/700718854 wait complete. 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.581+0000 7fec4a9a6640 1 Processor -- start 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.581+0000 7fec4a9a6640 1 -- start start 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec4406c2b0 0x7fec441422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec4406f260 0x7fec4415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44148290 0x7fec441e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec4406f670 con 0x7fec44148290 2024-09-15T22:47:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec4415f1e0 con 0x7fec4406f260 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec4a9a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fec4415fc40 con 0x7fec4406c2b0 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec48f43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44148290 0x7fec441e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec48f43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44148290 0x7fec441e9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47220/0 (socket says 172.21.15.134:47220) 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec48f43640 1 -- 172.21.15.134:0/2385262960 learned_addr learned my addr 172.21.15.134:0/2385262960 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec437fe640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec4406f260 0x7fec4415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.582+0000 7fec43fff640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec4406c2b0 0x7fec441422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 -- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec4406c2b0 msgr2=0x7fec441422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec4406c2b0 0x7fec441422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 -- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec4406f260 msgr2=0x7fec4415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec4406f260 0x7fec4415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 -- 172.21.15.134:0/2385262960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec441406a0 con 0x7fec44148290 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec43fff640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec4406c2b0 0x7fec441422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec437fe640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec4406f260 0x7fec4415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec48f43640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44148290 0x7fec441e9240 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00cd70 tx=0x7fec3c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c003b90 con 0x7fec44148290 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c003d30 con 0x7fec44148290 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec4a9a6640 1 -- 172.21.15.134:0/2385262960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec44140980 con 0x7fec44148290 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c004240 con 0x7fec44148290 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.583+0000 7fec4a9a6640 1 -- 172.21.15.134:0/2385262960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec44140f40 con 0x7fec44148290 2024-09-15T22:47:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.584+0000 7fec4a9a6640 1 -- 172.21.15.134:0/2385262960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4406ed20 con 0x7fec44148290 2024-09-15T22:47:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.584+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fec3c0043e0 con 0x7fec44148290 2024-09-15T22:47:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.585+0000 7fec40ff9640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fec3006c850 0x7fec3006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.585+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fec3c08cb40 con 0x7fec44148290 2024-09-15T22:47:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.585+0000 7fec43fff640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fec3006c850 0x7fec3006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.586+0000 7fec43fff640 1 --2- 172.21.15.134:0/2385262960 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fec3006c850 0x7fec3006ed10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec3400a830 tx=0x7fec34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.589+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec3c01d340 con 0x7fec44148290 2024-09-15T22:47:24.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.785+0000 7fec4a9a6640 1 -- 172.21.15.134:0/2385262960 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) -- 0x7fec44144cb0 con 0x7fec3006c850 2024-09-15T22:47:24.788 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:24.786+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.788+0000 7fec40ff9640 1 -- 172.21.15.134:0/2385262960 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fec44144cb0 con 0x7fec3006c850 2024-09-15T22:47:24.788 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:24.794 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:24.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-15T22:47:24.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.893+0000 7f8da03e8640 1 Processor -- start 2024-09-15T22:47:24.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.893+0000 7f8da03e8640 1 -- start start 2024-09-15T22:47:24.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.894+0000 7f8da03e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d98158e50 0x7f8d980b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.894+0000 7f8da03e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 0x7f8d980ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.894+0000 7f8da03e8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9815c800 con 0x7f8d9815c370 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.894+0000 7f8da03e8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8d980b43f0 con 0x7f8d98158e50 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.894+0000 7f8da03e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8d980b3630 con 0x7f8d9806f130 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d98158e50 0x7f8d980b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d98158e50 0x7f8d980b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47234/0 (socket says 172.21.15.134:47234) 2024-09-15T22:47:24.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 -- 172.21.15.134:0/3690112199 learned_addr learned my addr 172.21.15.134:0/3690112199 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e985640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 0x7f8d980ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 -- 172.21.15.134:0/3690112199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 msgr2=0x7f8d980ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:24.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 0x7f8d980ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 -- 172.21.15.134:0/3690112199 >> v1:172.21.15.177:6789/0 conn(0x7f8d9815c370 legacy=0x7f8d9806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e184640 1 -- 172.21.15.134:0/3690112199 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d980b3910 con 0x7f8d98158e50 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.895+0000 7f8d9e985640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 0x7f8d980ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8d9e184640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d98158e50 0x7f8d980b5050 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009e50 tx=0x7f8d9002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e769448bc284f254 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8d9d182640 1 -- 172.21.15.134:0/3690112199 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90036070 con 0x7f8d98158e50 2024-09-15T22:47:24.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8d9d182640 1 -- 172.21.15.134:0/3690112199 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90031600 con 0x7f8d98158e50 2024-09-15T22:47:24.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8d9d182640 1 -- 172.21.15.134:0/3690112199 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d900319d0 con 0x7f8d98158e50 2024-09-15T22:47:24.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 -- 172.21.15.134:0/3690112199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d98158e50 msgr2=0x7f8d980b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d98158e50 0x7f8d980b5050 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009e50 tx=0x7f8d9002a710 comp rx=0 tx=0).stop 2024-09-15T22:47:24.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 -- 172.21.15.134:0/3690112199 shutdown_connections 2024-09-15T22:47:24.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9806f130 0x7f8d980ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 --2- 172.21.15.134:0/3690112199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d98158e50 0x7f8d980b5050 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 -- 172.21.15.134:0/3690112199 >> 172.21.15.134:0/3690112199 conn(0x7f8d9806bba0 msgr2=0x7f8d9806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 -- 172.21.15.134:0/3690112199 shutdown_connections 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.896+0000 7f8da03e8640 1 -- 172.21.15.134:0/3690112199 wait complete. 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.897+0000 7f8da03e8640 1 Processor -- start 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 -- start start 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9806f130 0x7f8d98144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d98158e50 0x7f8d9815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9815c370 0x7f8d980b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98159230 con 0x7f8d9806f130 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8d980b3ed0 con 0x7f8d98158e50 2024-09-15T22:47:24.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8da03e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8d980ce740 con 0x7f8d9815c370 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8d9e184640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9806f130 0x7f8d98144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8d9e184640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9806f130 0x7f8d98144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47242/0 (socket says 172.21.15.134:47242) 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8d9e184640 1 -- 172.21.15.134:0/2011419852 learned_addr learned my addr 172.21.15.134:0/2011419852 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8d9d983640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d98158e50 0x7f8d9815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.898+0000 7f8d9e985640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9815c370 0x7f8d980b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 -- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9815c370 msgr2=0x7f8d980b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d9815c370 0x7f8d980b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 -- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d98158e50 msgr2=0x7f8d9815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d98158e50 0x7f8d9815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 -- 172.21.15.134:0/2011419852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d98145250 con 0x7f8d9806f130 2024-09-15T22:47:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d9e184640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9806f130 0x7f8d98144d10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f8d90034040 tx=0x7f8d90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9003f020 con 0x7f8d9806f130 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90037040 con 0x7f8d9806f130 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90036070 con 0x7f8d9806f130 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8da03e8640 1 -- 172.21.15.134:0/2011419852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9815cc10 con 0x7f8d9806f130 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.899+0000 7f8da03e8640 1 -- 172.21.15.134:0/2011419852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9815d1d0 con 0x7f8d9806f130 2024-09-15T22:47:24.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.900+0000 7f8da03e8640 1 -- 172.21.15.134:0/2011419852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d980ce200 con 0x7f8d9806f130 2024-09-15T22:47:24.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.901+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f8d90042020 con 0x7f8d9806f130 2024-09-15T22:47:24.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.901+0000 7f8d8effd640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d7c06c850 0x7f8d7c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:24.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.901+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f8d900ac520 con 0x7f8d9806f130 2024-09-15T22:47:24.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.901+0000 7f8d9d983640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d7c06c850 0x7f8d7c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:24.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.902+0000 7f8d9d983640 1 --2- 172.21.15.134:0/2011419852 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8d7c06c850 0x7f8d7c06ed10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d98150850 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:24.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:24.906+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d90049030 con 0x7f8d9806f130 2024-09-15T22:47:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.094+0000 7f8da03e8640 1 -- 172.21.15.134:0/2011419852 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7f8d980b49a0 con 0x7f8d7c06c850 2024-09-15T22:47:25.097 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:25.095+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.096+0000 7f8d8effd640 1 -- 172.21.15.134:0/2011419852 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f8d980b49a0 con 0x7f8d7c06c850 2024-09-15T22:47:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.102 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:25.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-15T22:47:25.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.205+0000 7fb24c786640 1 Processor -- start 2024-09-15T22:47:25.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.205+0000 7fb24c786640 1 -- start start 2024-09-15T22:47:25.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24c786640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24c786640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb24415f9f0 0x7fb24406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24c786640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb24415c970 con 0x7fb24406ef60 2024-09-15T22:47:25.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24c786640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb24415fef0 con 0x7fb24415f9f0 2024-09-15T22:47:25.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24c786640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb24415bbb0 con 0x7fb24415b370 2024-09-15T22:47:25.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24a522640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb249d21640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb24415f9f0 0x7fb24406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24ad23640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb24406ef60 0x7fb244071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:43924/0 (socket says 172.21.15.134:43924) 2024-09-15T22:47:25.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24a522640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:52226/0 (socket says 172.21.15.134:52226) 2024-09-15T22:47:25.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb24ad23640 1 -- 172.21.15.134:0/117942275 learned_addr learned my addr 172.21.15.134:0/117942275 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:25.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb249d21640 1 -- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 msgr2=0x7fb244072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb249d21640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb249d21640 1 -- 172.21.15.134:0/117942275 >> v1:172.21.15.177:6789/0 conn(0x7fb24406ef60 legacy=0x7fb244071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.206+0000 7fb249520640 1 -- 172.21.15.134:0/117942275 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766543125 0 0) 0x7fb24415c970 con 0x7fb24406ef60 2024-09-15T22:47:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.207+0000 7fb249d21640 1 -- 172.21.15.134:0/117942275 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24415be90 con 0x7fb24415f9f0 2024-09-15T22:47:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.207+0000 7fb24a522640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.207+0000 7fb249d21640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb24406ea20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097a0 tx=0x7fb23402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a1142357e010c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.207+0000 7fb249520640 1 -- 172.21.15.134:0/117942275 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234037070 con 0x7fb24415f9f0 2024-09-15T22:47:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.207+0000 7fb249520640 1 -- 172.21.15.134:0/117942275 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23402ae50 con 0x7fb24415f9f0 2024-09-15T22:47:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb249520640 1 -- 172.21.15.134:0/117942275 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234032660 con 0x7fb24415f9f0 2024-09-15T22:47:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 -- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 msgr2=0x7fb24406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb24406ea20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097a0 tx=0x7fb23402a100 comp rx=0 tx=0).stop 2024-09-15T22:47:25.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 -- 172.21.15.134:0/117942275 shutdown_connections 2024-09-15T22:47:25.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb24406ea20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 --2- 172.21.15.134:0/117942275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24415b370 0x7fb244072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 -- 172.21.15.134:0/117942275 >> 172.21.15.134:0/117942275 conn(0x7fb24406bba0 msgr2=0x7fb24406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:25.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 -- 172.21.15.134:0/117942275 shutdown_connections 2024-09-15T22:47:25.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.208+0000 7fb24c786640 1 -- 172.21.15.134:0/117942275 wait complete. 2024-09-15T22:47:25.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.209+0000 7fb24c786640 1 Processor -- start 2024-09-15T22:47:25.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.209+0000 7fb24c786640 1 -- start start 2024-09-15T22:47:25.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24406ef60 0x7fb244157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24415b370 0x7fb2441556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb2440b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440731b0 con 0x7fb24415b370 2024-09-15T22:47:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb24415c450 con 0x7fb24415f9f0 2024-09-15T22:47:25.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24c786640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440cf4a0 con 0x7fb24406ef60 2024-09-15T22:47:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24415b370 0x7fb2441556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24415b370 0x7fb2441556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47244/0 (socket says 172.21.15.134:47244) 2024-09-15T22:47:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 -- 172.21.15.134:0/3520663799 learned_addr learned my addr 172.21.15.134:0/3520663799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24ad23640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb2440b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb24a522640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24406ef60 0x7fb244157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 -- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24406ef60 msgr2=0x7fb244157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb24406ef60 0x7fb244157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 -- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 msgr2=0x7fb2440b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb24415f9f0 0x7fb2440b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.210+0000 7fb249d21640 1 -- 172.21.15.134:0/3520663799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24415ec00 con 0x7fb24415b370 2024-09-15T22:47:25.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb249d21640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb24415b370 0x7fb2441556a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097a0 tx=0x7fb2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234037040 con 0x7fb24415b370 2024-09-15T22:47:25.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234004030 con 0x7fb24415b370 2024-09-15T22:47:25.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb24c786640 1 -- 172.21.15.134:0/3520663799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb244155be0 con 0x7fb24415b370 2024-09-15T22:47:25.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234004420 con 0x7fb24415b370 2024-09-15T22:47:25.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.211+0000 7fb24c786640 1 -- 172.21.15.134:0/3520663799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb244154bc0 con 0x7fb24415b370 2024-09-15T22:47:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.212+0000 7fb24c786640 1 -- 172.21.15.134:0/3520663799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24415b750 con 0x7fb24415b370 2024-09-15T22:47:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.212+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fb234003610 con 0x7fb24415b370 2024-09-15T22:47:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.213+0000 7fb23affd640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22806c850 0x7fb22806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.213+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fb2340aca50 con 0x7fb24415b370 2024-09-15T22:47:25.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.213+0000 7fb24a522640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22806c850 0x7fb22806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.213+0000 7fb24a522640 1 --2- 172.21.15.134:0/3520663799 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb22806c850 0x7fb22806ed10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb240009bd0 tx=0x7fb24000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.217+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb23407a470 con 0x7fb24415b370 2024-09-15T22:47:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.409+0000 7fb24c786640 1 -- 172.21.15.134:0/3520663799 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fb244158740 con 0x7fb22806c850 2024-09-15T22:47:25.412 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:25.410+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.411+0000 7fb23affd640 1 -- 172.21.15.134:0/3520663799 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb244158740 con 0x7fb22806c850 2024-09-15T22:47:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.417 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:25.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-15T22:47:25.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.519+0000 7faf05e7b640 1 Processor -- start 2024-09-15T22:47:25.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.519+0000 7faf05e7b640 1 -- start start 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faf05e7b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf000b4e20 0x7faf0015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faf05e7b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000b3570 con 0x7faf00072d10 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faf05e7b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000b3850 con 0x7faf000ccb80 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faf05e7b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7faf000b3b30 con 0x7faf000b4e20 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faefffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faf00072d10 0x7faf0006db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38972/0 (socket says 172.21.15.134:38972) 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.520+0000 7faefffff640 1 -- 172.21.15.134:0/3804350390 learned_addr learned my addr 172.21.15.134:0/3804350390 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:25.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280783334 0 0) 0x7faf000b3570 con 0x7faf00072d10 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee8003520 con 0x7faf00072d10 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefeffd640 1 --2- 172.21.15.134:0/3804350390 >> v2:172.21.15.177:3300/0 conn(0x7faf000b4e20 0x7faf0015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283824823 0 0) 0x7faee8003520 con 0x7faf00072d10 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 >> v2:172.21.15.177:3300/0 conn(0x7faf000b4e20 msgr2=0x7faf0015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 --2- 172.21.15.134:0/3804350390 >> v2:172.21.15.177:3300/0 conn(0x7faf000b4e20 0x7faf0015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 >> v1:172.21.15.177:6789/0 conn(0x7faf000ccb80 legacy=0x7faf000b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000b3e10 con 0x7faf00072d10 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7faef8001670 con 0x7faf00072d10 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 >> v1:172.21.15.134:6789/0 conn(0x7faf00072d10 legacy=0x7faf0006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 0x7faee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee8004800 0x7faee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee80051c0 0x7faee8005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b3b30 con 0x7faee80039b0 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faee80060e0 con 0x7faee80051c0 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faee80062e0 con 0x7faee8004800 2024-09-15T22:47:25.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefeffd640 1 --2- 172.21.15.134:0/3804350390 >> v2:172.21.15.177:3300/0 conn(0x7faf000b4e20 0x7faf0015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 0x7faee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefffff640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee80051c0 0x7faee8005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefeffd640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee8004800 0x7faee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 -- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee8004800 msgr2=0x7faee8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee8004800 0x7faee8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 -- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee80051c0 msgr2=0x7faee8005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee80051c0 0x7faee8005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faeff7fe640 1 -- 172.21.15.134:0/3804350390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee8003520 con 0x7faee80039b0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.521+0000 7faefffff640 1 -- 172.21.15.134:0/3804350390 reap_dead start 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.522+0000 7faeff7fe640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 0x7faee8003dd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7faef0001e50 tx=0x7faee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0351c43fd05276 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.522+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0001a70 con 0x7faee80039b0 2024-09-15T22:47:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.522+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef002ae40 con 0x7faee80039b0 2024-09-15T22:47:25.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.522+0000 7faefe7fc640 1 -- 172.21.15.134:0/3804350390 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0003bb0 con 0x7faee80039b0 2024-09-15T22:47:25.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 -- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 msgr2=0x7faee8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 0x7faee8003dd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7faef0001e50 tx=0x7faee8005830 comp rx=0 tx=0).stop 2024-09-15T22:47:25.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 -- 172.21.15.134:0/3804350390 shutdown_connections 2024-09-15T22:47:25.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 --2- 172.21.15.134:0/3804350390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80039b0 0x7faee8003dd0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 -- 172.21.15.134:0/3804350390 >> 172.21.15.134:0/3804350390 conn(0x7faf0006bba0 msgr2=0x7faf0006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 -- 172.21.15.134:0/3804350390 shutdown_connections 2024-09-15T22:47:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.523+0000 7faf05e7b640 1 -- 172.21.15.134:0/3804350390 wait complete. 2024-09-15T22:47:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.524+0000 7faf05e7b640 1 Processor -- start 2024-09-15T22:47:25.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.524+0000 7faf05e7b640 1 -- start start 2024-09-15T22:47:25.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80039b0 0x7faf00150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00154050 0x7faf000aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf0015ad90 0x7faf0015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf000ccf60 con 0x7faf00154050 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b43d0 con 0x7faf0015ad90 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faf05e7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7faf0015bbd0 con 0x7faee80039b0 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00154050 0x7faf000aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00154050 0x7faf000aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47268/0 (socket says 172.21.15.134:47268) 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 -- 172.21.15.134:0/4009549059 learned_addr learned my addr 172.21.15.134:0/4009549059 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faeff7fe640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80039b0 0x7faf00150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefffff640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf0015ad90 0x7faf0015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 -- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80039b0 msgr2=0x7faf00150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faee80039b0 0x7faf00150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 -- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf0015ad90 msgr2=0x7faf0015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf0015ad90 0x7faf0015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 -- 172.21.15.134:0/4009549059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf001f38a0 con 0x7faf00154050 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faefeffd640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00154050 0x7faf000aa4d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7faef4010890 tx=0x7faef4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.525+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef401a020 con 0x7faf00154050 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.526+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef400eb60 con 0x7faf00154050 2024-09-15T22:47:25.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.526+0000 7faf05e7b640 1 -- 172.21.15.134:0/4009549059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf001f3b80 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.526+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400f040 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.526+0000 7faf05e7b640 1 -- 172.21.15.134:0/4009549059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf001f4140 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.526+0000 7faf05e7b640 1 -- 172.21.15.134:0/4009549059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0015bf60 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.527+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7faef401d020 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.527+0000 7faee7fff640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faeec06c7f0 0x7faeec06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.527+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7faef408c600 con 0x7faf00154050 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.528+0000 7faeff7fe640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faeec06c7f0 0x7faeec06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.528+0000 7faeff7fe640 1 --2- 172.21.15.134:0/4009549059 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7faeec06c7f0 0x7faeec06ecb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faef0032000 tx=0x7faef002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.532+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faef4024020 con 0x7faf00154050 2024-09-15T22:47:25.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.725+0000 7faf05e7b640 1 -- 172.21.15.134:0/4009549059 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7faf0006e780 con 0x7faeec06c7f0 2024-09-15T22:47:25.728 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:25.726+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.728+0000 7faee7fff640 1 -- 172.21.15.134:0/4009549059 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7faf0006e780 con 0x7faeec06c7f0 2024-09-15T22:47:25.729 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:25.733 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:25.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-15T22:47:25.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.836+0000 7fb05752a640 1 Processor -- start 2024-09-15T22:47:25.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.836+0000 7fb05752a640 1 -- start start 2024-09-15T22:47:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb05752a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0500b3c80 0x7fb05015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb05752a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b4060 0x7fb05013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb05752a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0500720f0 con 0x7fb050141c40 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb05752a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb05006d870 con 0x7fb0500b3c80 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb05752a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0501421e0 con 0x7fb0500b4060 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0500b3c80 0x7fb05015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0500b3c80 0x7fb05015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47270/0 (socket says 172.21.15.134:47270) 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 -- 172.21.15.134:0/3430357840 learned_addr learned my addr 172.21.15.134:0/3430357840 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb054ac5640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b4060 0x7fb05013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 -- 172.21.15.134:0/3430357840 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b4060 msgr2=0x7fb05013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b4060 0x7fb05013fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 -- 172.21.15.134:0/3430357840 >> v1:172.21.15.177:6789/0 conn(0x7fb050141c40 legacy=0x7fb05006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:25.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.837+0000 7fb0552c6640 1 -- 172.21.15.134:0/3430357840 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501424c0 con 0x7fb0500b3c80 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.838+0000 7fb0552c6640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0500b3c80 0x7fb05015d4f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd824fb57677ba8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.838+0000 7fb047fff640 1 -- 172.21.15.134:0/3430357840 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c037070 con 0x7fb0500b3c80 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.838+0000 7fb047fff640 1 -- 172.21.15.134:0/3430357840 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c032440 con 0x7fb0500b3c80 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.838+0000 7fb047fff640 1 -- 172.21.15.134:0/3430357840 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c032810 con 0x7fb0500b3c80 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 -- 172.21.15.134:0/3430357840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0500b3c80 msgr2=0x7fb05015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0500b3c80 0x7fb05015d4f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c02a210 comp rx=0 tx=0).stop 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 -- 172.21.15.134:0/3430357840 shutdown_connections 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b4060 0x7fb05013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 --2- 172.21.15.134:0/3430357840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0500b3c80 0x7fb05015d4f0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 -- 172.21.15.134:0/3430357840 >> 172.21.15.134:0/3430357840 conn(0x7fb050062810 msgr2=0x7fb05006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 -- 172.21.15.134:0/3430357840 shutdown_connections 2024-09-15T22:47:25.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.839+0000 7fb05752a640 1 -- 172.21.15.134:0/3430357840 wait complete. 2024-09-15T22:47:25.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.840+0000 7fb05752a640 1 Processor -- start 2024-09-15T22:47:25.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.840+0000 7fb05752a640 1 -- start start 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.840+0000 7fb05752a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b3c80 0x7fb05013b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.840+0000 7fb05752a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb050141c40 0x7fb050159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb05013f0b0 0x7fb050159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb050140140 con 0x7fb050141c40 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb050142a80 con 0x7fb05013f0b0 2024-09-15T22:47:25.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0501402c0 con 0x7fb0500b3c80 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb050141c40 0x7fb050159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb050141c40 0x7fb050159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47276/0 (socket says 172.21.15.134:47276) 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 -- 172.21.15.134:0/2196028249 learned_addr learned my addr 172.21.15.134:0/2196028249 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb0552c6640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b3c80 0x7fb05013b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 -- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b3c80 msgr2=0x7fb05013b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb055ac7640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb05013f0b0 0x7fb050159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500b3c80 0x7fb05013b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 -- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb05013f0b0 msgr2=0x7fb050159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb05013f0b0 0x7fb050159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 -- 172.21.15.134:0/2196028249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501571f0 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb054ac5640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb050141c40 0x7fb050159020 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c7f0 tx=0x7fb04000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040015070 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb040004240 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 -- 172.21.15.134:0/2196028249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501574d0 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040007620 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.841+0000 7fb05752a640 1 -- 172.21.15.134:0/2196028249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb050157a90 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.842+0000 7fb05752a640 1 -- 172.21.15.134:0/2196028249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05013fc00 con 0x7fb050141c40 2024-09-15T22:47:25.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.843+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fb0400079d0 con 0x7fb050141c40 2024-09-15T22:47:25.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.843+0000 7fb045ffb640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb03406c850 0x7fb03406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:25.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.843+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fb04008c490 con 0x7fb050141c40 2024-09-15T22:47:25.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.843+0000 7fb0552c6640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb03406c850 0x7fb03406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:25.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.844+0000 7fb0552c6640 1 --2- 172.21.15.134:0/2196028249 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb03406c850 0x7fb03406ed10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb04c034000 tx=0x7fb04c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:25.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:25.847+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb04005a240 con 0x7fb050141c40 2024-09-15T22:47:26.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.041+0000 7fb05752a640 1 -- 172.21.15.134:0/2196028249 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fb050159aa0 con 0x7fb03406c850 2024-09-15T22:47:26.044 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:26.042+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.044+0000 7fb045ffb640 1 -- 172.21.15.134:0/2196028249 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb050159aa0 con 0x7fb03406c850 2024-09-15T22:47:26.044 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.049 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:26.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-15T22:47:26.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.151+0000 7f20f461e640 1 Processor -- start 2024-09-15T22:47:26.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.151+0000 7f20f461e640 1 -- start start 2024-09-15T22:47:26.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f461e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20ec145d90 0x7f20ec0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f461e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 0x7f20ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f461e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec0b4240 con 0x7f20ec0cd490 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f461e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f20ec06d080 con 0x7f20ec145d90 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f461e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f20ec0b4520 con 0x7f20ec0cfce0 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20ec145d90 0x7f20ec0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20ec145d90 0x7f20ec0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47278/0 (socket says 172.21.15.134:47278) 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 -- 172.21.15.134:0/600623767 learned_addr learned my addr 172.21.15.134:0/600623767 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f2bbb640 1 --2- 172.21.15.134:0/600623767 >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 0x7f20ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 -- 172.21.15.134:0/600623767 >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 msgr2=0x7f20ec06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 --2- 172.21.15.134:0/600623767 >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 0x7f20ec06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 -- 172.21.15.134:0/600623767 >> v1:172.21.15.177:6789/0 conn(0x7f20ec0cd490 legacy=0x7f20ec0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f23ba640 1 -- 172.21.15.134:0/600623767 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec0b4800 con 0x7f20ec145d90 2024-09-15T22:47:26.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.152+0000 7f20f2bbb640 1 --2- 172.21.15.134:0/600623767 >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 0x7f20ec06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:26.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.153+0000 7f20f23ba640 1 --2- 172.21.15.134:0/600623767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec0ccf50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f20ec161250 tx=0x7f20e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ce9b84a54fc79c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.153+0000 7f20f13b8640 1 -- 172.21.15.134:0/600623767 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8037070 con 0x7f20ec145d90 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.153+0000 7f20f13b8640 1 -- 172.21.15.134:0/600623767 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8032440 con 0x7f20ec145d90 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.153+0000 7f20f13b8640 1 -- 172.21.15.134:0/600623767 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8032810 con 0x7f20ec145d90 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 -- 172.21.15.134:0/600623767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 msgr2=0x7f20ec0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 --2- 172.21.15.134:0/600623767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec0ccf50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f20ec161250 tx=0x7f20e802a230 comp rx=0 tx=0).stop 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 -- 172.21.15.134:0/600623767 shutdown_connections 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 --2- 172.21.15.134:0/600623767 >> v2:172.21.15.177:3300/0 conn(0x7f20ec0cfce0 0x7f20ec06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 --2- 172.21.15.134:0/600623767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec0ccf50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 -- 172.21.15.134:0/600623767 >> 172.21.15.134:0/600623767 conn(0x7f20ec06bba0 msgr2=0x7f20ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 -- 172.21.15.134:0/600623767 shutdown_connections 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.154+0000 7f20f461e640 1 -- 172.21.15.134:0/600623767 wait complete. 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.155+0000 7f20f461e640 1 Processor -- start 2024-09-15T22:47:26.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.155+0000 7f20f461e640 1 -- start start 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20ec0cd490 0x7f20ec0aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20ec0cfce0 0x7f20ec0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec0b5790 con 0x7f20ec145d90 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec0b5610 con 0x7f20ec0cfce0 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec146170 con 0x7f20ec0cd490 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60652/0 (socket says 172.21.15.134:60652) 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 -- 172.21.15.134:0/1439610808 learned_addr learned my addr 172.21.15.134:0/1439610808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f1bb9640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20ec0cfce0 0x7f20ec0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f23ba640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20ec0cd490 0x7f20ec0aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 -- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20ec0cd490 msgr2=0x7f20ec0aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20ec0cd490 0x7f20ec0aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 -- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20ec0cfce0 msgr2=0x7f20ec0c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20ec0cfce0 0x7f20ec0c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 -- 172.21.15.134:0/1439610808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec0ab710 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f2bbb640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec145d90 0x7f20ec141d30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ce40 tx=0x7f20e400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401a070 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e400d840 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 -- 172.21.15.134:0/1439610808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec0ab9f0 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400dc30 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.156+0000 7f20f461e640 1 -- 172.21.15.134:0/1439610808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec132530 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.157+0000 7f20f461e640 1 -- 172.21.15.134:0/1439610808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ec132730 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.158+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f20e401d070 con 0x7f20ec145d90 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.158+0000 7f20e2ffd640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f20d006c850 0x7f20d006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.158+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f20e408c630 con 0x7f20ec145d90 2024-09-15T22:47:26.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.159+0000 7f20f23ba640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f20d006c850 0x7f20d006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.159+0000 7f20f23ba640 1 --2- 172.21.15.134:0/1439610808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f20d006c850 0x7f20d006ed10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20e8034000 tx=0x7f20e802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.163+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20ec132730 con 0x7f20ec145d90 2024-09-15T22:47:26.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.357+0000 7f20f461e640 1 -- 172.21.15.134:0/1439610808 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f20ec0ccf50 con 0x7f20d006c850 2024-09-15T22:47:26.360 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:26.359+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.359+0000 7f20e2ffd640 1 -- 172.21.15.134:0/1439610808 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f20ec0ccf50 con 0x7f20d006c850 2024-09-15T22:47:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.365 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:26.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-15T22:47:26.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.467+0000 7fbd2a56d640 1 Processor -- start 2024-09-15T22:47:26.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 -- start start 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd240b61e0 0x7fbd240b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd241625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 0x7fbd24162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbd240d24f0 con 0x7fbd240b61e0 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbd240b6b00 con 0x7fbd240b3540 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd2a56d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbd240d20e0 con 0x7fbd240b3b00 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.468+0000 7fbd23fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd240b61e0 0x7fbd240b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd240b61e0 0x7fbd240b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60668/0 (socket says 172.21.15.134:60668) 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 -- 172.21.15.134:0/1839251197 learned_addr learned my addr 172.21.15.134:0/1839251197 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd237fe640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd241625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd28b0a640 1 --2- 172.21.15.134:0/1839251197 >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 0x7fbd24162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 -- 172.21.15.134:0/1839251197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 msgr2=0x7fbd241625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd241625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 -- 172.21.15.134:0/1839251197 >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 msgr2=0x7fbd24162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 --2- 172.21.15.134:0/1839251197 >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 0x7fbd24162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 -- 172.21.15.134:0/1839251197 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd240cfa70 con 0x7fbd240b61e0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd28b0a640 1 --2- 172.21.15.134:0/1839251197 >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 0x7fbd24162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.469+0000 7fbd23fff640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b61e0 0x7fbd240b65c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fbd240ba200 tx=0x7fbd1402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb231cf1b010a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd22ffd640 1 -- 172.21.15.134:0/1839251197 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14037070 con 0x7fbd240b61e0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd22ffd640 1 -- 172.21.15.134:0/1839251197 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1402ae00 con 0x7fbd240b61e0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd22ffd640 1 -- 172.21.15.134:0/1839251197 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14032660 con 0x7fbd240b61e0 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 -- 172.21.15.134:0/1839251197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b61e0 msgr2=0x7fbd240b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b61e0 0x7fbd240b65c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fbd240ba200 tx=0x7fbd1402a0b0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 -- 172.21.15.134:0/1839251197 shutdown_connections 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 --2- 172.21.15.134:0/1839251197 >> v2:172.21.15.177:3300/0 conn(0x7fbd240b3540 0x7fbd24162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd241625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 --2- 172.21.15.134:0/1839251197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b61e0 0x7fbd240b65c0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 -- 172.21.15.134:0/1839251197 >> 172.21.15.134:0/1839251197 conn(0x7fbd240d11e0 msgr2=0x7fbd240d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 -- 172.21.15.134:0/1839251197 shutdown_connections 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.470+0000 7fbd2a56d640 1 -- 172.21.15.134:0/1839251197 wait complete. 2024-09-15T22:47:26.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.471+0000 7fbd2a56d640 1 Processor -- start 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 -- start start 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b3540 0x7fbd241f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd240b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd240b61e0 0x7fbd240b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2415edc0 con 0x7fbd240b3540 2024-09-15T22:47:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd240d0030 con 0x7fbd240b61e0 2024-09-15T22:47:26.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd2a56d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbd240cd470 con 0x7fbd240b3b00 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd23fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b3540 0x7fbd241f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd23fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b3540 0x7fbd241f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60674/0 (socket says 172.21.15.134:60674) 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd23fff640 1 -- 172.21.15.134:0/303239424 learned_addr learned my addr 172.21.15.134:0/303239424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.472+0000 7fbd237fe640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd240b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd28b0a640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd240b61e0 0x7fbd240b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 -- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 msgr2=0x7fbd240b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240b3b00 0x7fbd240b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 -- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd240b61e0 msgr2=0x7fbd240b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd240b61e0 0x7fbd240b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 -- 172.21.15.134:0/303239424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd240cc860 con 0x7fbd240b3540 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd23fff640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd240b3540 0x7fbd241f7940 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fbd14000c00 tx=0x7fbd140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14042070 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1403e670 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14037040 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd2a56d640 1 -- 172.21.15.134:0/303239424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd240ccb40 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.473+0000 7fbd2a56d640 1 -- 172.21.15.134:0/303239424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd240cd100 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.474+0000 7fbd2a56d640 1 -- 172.21.15.134:0/303239424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd240d1d00 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.475+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fbd1403a040 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.475+0000 7fbd20ff9640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1006c850 0x7fbd1006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.475+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fbd140abe40 con 0x7fbd240b3540 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.475+0000 7fbd237fe640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1006c850 0x7fbd1006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.476+0000 7fbd237fe640 1 --2- 172.21.15.134:0/303239424 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbd1006c850 0x7fbd1006ed10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbd240cea30 tx=0x7fbd18008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.479+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd140b0070 con 0x7fbd240b3540 2024-09-15T22:47:26.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.678+0000 7fbd2a56d640 1 -- 172.21.15.134:0/303239424 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fbd240ba6e0 con 0x7fbd1006c850 2024-09-15T22:47:26.680 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:26.679+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.680+0000 7fbd20ff9640 1 -- 172.21.15.134:0/303239424 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fbd240ba6e0 con 0x7fbd1006c850 2024-09-15T22:47:26.681 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.686 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:26.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-15T22:47:26.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.788+0000 7ffa2ede4640 1 Processor -- start 2024-09-15T22:47:26.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.788+0000 7ffa2ede4640 1 -- start start 2024-09-15T22:47:26.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2ede4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa281481b0 0x7ffa28162260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2ede4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa281629b0 con 0x7ffa2806f800 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2ede4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa28162c90 con 0x7ffa280ae990 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2ede4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffa28162f70 con 0x7ffa281481b0 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2cb80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa281481b0 0x7ffa28162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa1ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffa2806f800 0x7ffa2806ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49104/0 (socket says 172.21.15.134:49104) 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2cb80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa281481b0 0x7ffa28162260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60688/0 (socket says 172.21.15.134:60688) 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa1ffff640 1 -- 172.21.15.134:0/3423855645 learned_addr learned my addr 172.21.15.134:0/3423855645 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3423855645 >> v1:172.21.15.177:6789/0 conn(0x7ffa280ae990 legacy=0x7ffa280aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3423855645 >> v1:172.21.15.134:6789/0 conn(0x7ffa2806f800 legacy=0x7ffa2806ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3423855645 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2806e7c0 con 0x7ffa281481b0 2024-09-15T22:47:26.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.789+0000 7ffa1f7fe640 1 -- 172.21.15.134:0/3423855645 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780836869 0 0) 0x7ffa281629b0 con 0x7ffa2806f800 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.790+0000 7ffa2cb80640 1 --2- 172.21.15.134:0/3423855645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa281481b0 0x7ffa28162260 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009d90 tx=0x7ffa2402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d14e0a7d700b11c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.790+0000 7ffa1f7fe640 1 -- 172.21.15.134:0/3423855645 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24031600 con 0x7ffa281481b0 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.790+0000 7ffa1f7fe640 1 -- 172.21.15.134:0/3423855645 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa240317a0 con 0x7ffa281481b0 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.790+0000 7ffa1f7fe640 1 -- 172.21.15.134:0/3423855645 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24031b70 con 0x7ffa281481b0 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.790+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3423855645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa281481b0 msgr2=0x7ffa28162260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 --2- 172.21.15.134:0/3423855645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa281481b0 0x7ffa28162260 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009d90 tx=0x7ffa2402a610 comp rx=0 tx=0).stop 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3423855645 shutdown_connections 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 --2- 172.21.15.134:0/3423855645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa281481b0 0x7ffa28162260 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3423855645 >> 172.21.15.134:0/3423855645 conn(0x7ffa28062810 msgr2=0x7ffa2806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3423855645 shutdown_connections 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.791+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3423855645 wait complete. 2024-09-15T22:47:26.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.792+0000 7ffa2ede4640 1 Processor -- start 2024-09-15T22:47:26.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.792+0000 7ffa2ede4640 1 -- start start 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa2806f800 0x7ffa28142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa280ae990 0x7ffa28142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa281481b0 0x7ffa281f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2806bba0 con 0x7ffa2806f800 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2806bd20 con 0x7ffa280ae990 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2806bea0 con 0x7ffa281481b0 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa2806f800 0x7ffa28142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa2806f800 0x7ffa28142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60694/0 (socket says 172.21.15.134:60694) 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3125508859 learned_addr learned my addr 172.21.15.134:0/3125508859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:26.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa1ffff640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa280ae990 0x7ffa28142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2d381640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa281481b0 0x7ffa281f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa281481b0 msgr2=0x7ffa281f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa281481b0 0x7ffa281f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa280ae990 msgr2=0x7ffa28142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa280ae990 0x7ffa28142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 -- 172.21.15.134:0/3125508859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2813e940 con 0x7ffa2806f800 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa1ffff640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa280ae990 0x7ffa28142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2cb80640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa2806f800 0x7ffa28142960 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009d90 tx=0x7ffa24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24040070 con 0x7ffa2806f800 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa24030be0 con 0x7ffa2806f800 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3125508859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2813ec20 con 0x7ffa2806f800 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24009450 con 0x7ffa2806f800 2024-09-15T22:47:26.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.793+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3125508859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2813f1e0 con 0x7ffa2806f800 2024-09-15T22:47:26.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.794+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3125508859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2806c290 con 0x7ffa2806f800 2024-09-15T22:47:26.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.795+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7ffa24039040 con 0x7ffa2806f800 2024-09-15T22:47:26.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.795+0000 7ffa1d7fa640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa1406c850 0x7ffa1406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:26.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.795+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7ffa240aca70 con 0x7ffa2806f800 2024-09-15T22:47:26.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.795+0000 7ffa1ffff640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa1406c850 0x7ffa1406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:26.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.796+0000 7ffa1ffff640 1 --2- 172.21.15.134:0/3125508859 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ffa1406c850 0x7ffa1406ed10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffa18007fd0 tx=0x7ffa18009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:26.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.799+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa2407a790 con 0x7ffa2806f800 2024-09-15T22:47:26.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.991+0000 7ffa2ede4640 1 -- 172.21.15.134:0/3125508859 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7ffa2806e400 con 0x7ffa1406c850 2024-09-15T22:47:26.994 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:26.993+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:26.994+0000 7ffa1d7fa640 1 -- 172.21.15.134:0/3125508859 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ffa2806e400 con 0x7ffa1406c850 2024-09-15T22:47:26.994 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:26.999 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:27.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-15T22:47:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.103+0000 7f60d7aa4640 1 Processor -- start 2024-09-15T22:47:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.103+0000 7f60d7aa4640 1 -- start start 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60d00ccb80 0x7f60d015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60d0072d10 0x7f60d00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00b4c50 0x7f60d015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f60d00b50a0 con 0x7f60d00ccb80 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f60d00b3570 con 0x7f60d0072d10 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d7aa4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f60d00b3850 con 0x7f60d00b4c50 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d5840640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60d00ccb80 0x7f60d015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d5840640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60d00ccb80 0x7f60d015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60706/0 (socket says 172.21.15.134:60706) 2024-09-15T22:47:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.104+0000 7f60d5840640 1 -- 172.21.15.134:0/1441465619 learned_addr learned my addr 172.21.15.134:0/1441465619 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d503f640 1 --2- 172.21.15.134:0/1441465619 >> v2:172.21.15.177:3300/0 conn(0x7f60d0072d10 0x7f60d00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d6041640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00b4c50 0x7f60d015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 -- 172.21.15.134:0/1441465619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00b4c50 msgr2=0x7f60d015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00b4c50 0x7f60d015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 -- 172.21.15.134:0/1441465619 >> v2:172.21.15.177:3300/0 conn(0x7f60d0072d10 msgr2=0x7f60d00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 --2- 172.21.15.134:0/1441465619 >> v2:172.21.15.177:3300/0 conn(0x7f60d0072d10 0x7f60d00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 -- 172.21.15.134:0/1441465619 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d00b3b30 con 0x7f60d00ccb80 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.105+0000 7f60d5840640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d00ccb80 0x7f60d015bbd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f60d0158c90 tx=0x7f60c002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8790f8f35f4ea5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d483e640 1 -- 172.21.15.134:0/1441465619 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0036070 con 0x7f60d00ccb80 2024-09-15T22:47:27.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d483e640 1 -- 172.21.15.134:0/1441465619 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c0031600 con 0x7f60d00ccb80 2024-09-15T22:47:27.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d483e640 1 -- 172.21.15.134:0/1441465619 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00319d0 con 0x7f60d00ccb80 2024-09-15T22:47:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 -- 172.21.15.134:0/1441465619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d00ccb80 msgr2=0x7f60d015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d00ccb80 0x7f60d015bbd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f60d0158c90 tx=0x7f60c002a6a0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 -- 172.21.15.134:0/1441465619 shutdown_connections 2024-09-15T22:47:27.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00b4c50 0x7f60d015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 --2- 172.21.15.134:0/1441465619 >> v2:172.21.15.177:3300/0 conn(0x7f60d0072d10 0x7f60d00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 --2- 172.21.15.134:0/1441465619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d00ccb80 0x7f60d015bbd0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 -- 172.21.15.134:0/1441465619 >> 172.21.15.134:0/1441465619 conn(0x7f60d006bba0 msgr2=0x7f60d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 -- 172.21.15.134:0/1441465619 shutdown_connections 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.106+0000 7f60d7aa4640 1 -- 172.21.15.134:0/1441465619 wait complete. 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.107+0000 7f60d7aa4640 1 Processor -- start 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.107+0000 7f60d7aa4640 1 -- start start 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d0072d10 0x7f60d01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60d00b4c50 0x7f60d0144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00ccb80 0x7f60d0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60d00b43d0 con 0x7f60d0072d10 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f60d00b40f0 con 0x7f60d00b4c50 2024-09-15T22:47:27.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d7aa4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f60d00ccf60 con 0x7f60d00ccb80 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d0072d10 0x7f60d01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d0072d10 0x7f60d01542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60714/0 (socket says 172.21.15.134:60714) 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 -- 172.21.15.134:0/2027065823 learned_addr learned my addr 172.21.15.134:0/2027065823 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d503f640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60d00b4c50 0x7f60d0144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d6041640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00ccb80 0x7f60d0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 -- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00ccb80 msgr2=0x7f60d0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60d00ccb80 0x7f60d0143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 -- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60d00b4c50 msgr2=0x7f60d0144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60d00b4c50 0x7f60d0144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d5840640 1 -- 172.21.15.134:0/2027065823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d01559e0 con 0x7f60d0072d10 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.108+0000 7f60d503f640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60d00b4c50 0x7f60d0144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60d5840640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60d0072d10 0x7f60d01542d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f60c0000f80 tx=0x7f60c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0036050 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c0042070 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60d7aa4640 1 -- 172.21.15.134:0/2027065823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d0155cc0 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0009510 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.109+0000 7f60d7aa4640 1 -- 172.21.15.134:0/2027065823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d0156280 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.110+0000 7f60d7aa4640 1 -- 172.21.15.134:0/2027065823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d00711a0 con 0x7f60d0072d10 2024-09-15T22:47:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.110+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f60c0007c70 con 0x7f60d0072d10 2024-09-15T22:47:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.111+0000 7f60ce7fc640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f60bc06c850 0x7f60bc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.111+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f60c00acf50 con 0x7f60d0072d10 2024-09-15T22:47:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.111+0000 7f60d503f640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f60bc06c850 0x7f60bc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.111+0000 7f60d503f640 1 --2- 172.21.15.134:0/2027065823 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f60bc06c850 0x7f60bc06ed10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60c4006fd0 tx=0x7f60c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.115+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60d00711a0 con 0x7f60d0072d10 2024-09-15T22:47:27.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.315+0000 7f60d7aa4640 1 -- 172.21.15.134:0/2027065823 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f60d006ec20 con 0x7f60bc06c850 2024-09-15T22:47:27.323 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.322+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:27.323 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.322+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:27.323 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.322+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:27.323 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.322+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:27.323 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.322+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:27.328 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.327+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.327+0000 7f60ce7fc640 1 -- 172.21.15.134:0/2027065823 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f60d006ec20 con 0x7f60bc06c850 2024-09-15T22:47:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.334 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:27.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-15T22:47:27.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.434+0000 7f6a59ad0640 1 Processor -- start 2024-09-15T22:47:27.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.434+0000 7f6a59ad0640 1 -- start start 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a59ad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a5415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a59ad0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5415bb70 con 0x7f6a5406ec90 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a59ad0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5415be10 con 0x7f6a5406f070 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a59ad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5415c0f0 con 0x7f6a541591a0 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a537fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6a5406ec90 0x7f6a540cca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49116/0 (socket says 172.21.15.134:49116) 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a537fe640 1 -- 172.21.15.134:0/3596180325 learned_addr learned my addr 172.21.15.134:0/3596180325 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a5415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723143817 0 0) 0x7f6a5415bb70 con 0x7f6a5406ec90 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.435+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a3c003520 con 0x7f6a5406ec90 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574502774 0 0) 0x7f6a5415be10 con 0x7f6a5406f070 2024-09-15T22:47:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a5415bb70 con 0x7f6a5406f070 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 272083513 0 0) 0x7f6a3c003520 con 0x7f6a5406ec90 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 msgr2=0x7f6a5415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a5415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 >> v1:172.21.15.177:6789/0 conn(0x7f6a5406f070 legacy=0x7f6a54158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5415c3d0 con 0x7f6a5406ec90 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6a440019f0 con 0x7f6a5406ec90 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a5415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 >> v1:172.21.15.134:6789/0 conn(0x7f6a5406ec90 legacy=0x7f6a540cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a3c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004100 0x7f6a3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c004d40 0x7f6a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5415c0f0 con 0x7f6a3c004d40 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c00dd90 con 0x7f6a3c004100 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c00df90 con 0x7f6a541591a0 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c004d40 0x7f6a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a537fe640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a3c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a52ffd640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004100 0x7f6a3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 -- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 msgr2=0x7f6a3c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a541591a0 0x7f6a3c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 -- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004100 msgr2=0x7f6a3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004100 0x7f6a3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.436+0000 7f6a53fff640 1 -- 172.21.15.134:0/3596180325 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c003520 con 0x7f6a3c004d40 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a53fff640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c004d40 0x7f6a3c0051c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009c40 tx=0x7f6a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547902a6d7579685 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c036070 con 0x7f6a3c004d40 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c031400 con 0x7f6a3c004d40 2024-09-15T22:47:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a527fc640 1 -- 172.21.15.134:0/3596180325 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c009840 con 0x7f6a3c004d40 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a59ad0640 1 -- 172.21.15.134:0/3596180325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c004d40 msgr2=0x7f6a3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a59ad0640 1 --2- 172.21.15.134:0/3596180325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c004d40 0x7f6a3c0051c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009c40 tx=0x7f6a3c005830 comp rx=0 tx=0).stop 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a53fff640 1 -- 172.21.15.134:0/3596180325 reap_dead start 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a59ad0640 1 -- 172.21.15.134:0/3596180325 shutdown_connections 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a59ad0640 1 -- 172.21.15.134:0/3596180325 >> 172.21.15.134:0/3596180325 conn(0x7f6a5406bba0 msgr2=0x7f6a5406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.437+0000 7f6a59ad0640 1 -- 172.21.15.134:0/3596180325 shutdown_connections 2024-09-15T22:47:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.438+0000 7f6a59ad0640 1 -- 172.21.15.134:0/3596180325 wait complete. 2024-09-15T22:47:27.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.439+0000 7f6a59ad0640 1 Processor -- start 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.439+0000 7f6a59ad0640 1 -- start start 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004d40 0x7f6a540b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a54150fb0 0x7f6a54155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a54156530 0x7f6a540b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cf790 con 0x7f6a54150fb0 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cf610 con 0x7f6a3c004d40 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540cf910 con 0x7f6a54156530 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a54150fb0 0x7f6a54155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a54150fb0 0x7f6a54155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60738/0 (socket says 172.21.15.134:60738) 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 -- 172.21.15.134:0/2417652673 learned_addr learned my addr 172.21.15.134:0/2417652673 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a53fff640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a54156530 0x7f6a540b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a537fe640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004d40 0x7f6a540b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 -- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a54156530 msgr2=0x7f6a540b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a54156530 0x7f6a540b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 -- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004d40 msgr2=0x7f6a540b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a3c004d40 0x7f6a540b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 -- 172.21.15.134:0/2417652673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540b1050 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a52ffd640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a54150fb0 0x7f6a54155ff0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800f7a0 tx=0x7f6a4800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4801a070 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a48005320 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48007270 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.440+0000 7f6a59ad0640 1 -- 172.21.15.134:0/2417652673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540b12f0 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.441+0000 7f6a59ad0640 1 -- 172.21.15.134:0/2417652673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a541557f0 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.441+0000 7f6a59ad0640 1 -- 172.21.15.134:0/2417652673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5415fb40 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.442+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f6a4801d070 con 0x7f6a54150fb0 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.442+0000 7f6a3bfff640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4006c850 0x7f6a4006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.443+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f6a4808b650 con 0x7f6a54150fb0 2024-09-15T22:47:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.443+0000 7f6a537fe640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4006c850 0x7f6a4006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.443+0000 7f6a537fe640 1 --2- 172.21.15.134:0/2417652673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4006c850 0x7f6a4006ed10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6a44004d00 tx=0x7f6a44006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.447+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a48058ec0 con 0x7f6a54150fb0 2024-09-15T22:47:27.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.642+0000 7f6a59ad0640 1 -- 172.21.15.134:0/2417652673 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f6a540726c0 con 0x7f6a4006c850 2024-09-15T22:47:27.645 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.644+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.644+0000 7f6a3bfff640 1 -- 172.21.15.134:0/2417652673 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6a540726c0 con 0x7f6a4006c850 2024-09-15T22:47:27.646 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.650 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:27.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-15T22:47:27.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.750+0000 7f3a77c53640 1 Processor -- start 2024-09-15T22:47:27.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.750+0000 7f3a77c53640 1 -- start start 2024-09-15T22:47:27.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a77c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a77c53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 0x7f3a7015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a77c53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a70071de0 con 0x7f3a7015b090 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a77c53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3a700720c0 con 0x7f3a7015b470 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a77c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3a700723a0 con 0x7f3a7006ea00 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a751ee640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a761f0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 0x7f3a7015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a751ee640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:40186/0 (socket says 172.21.15.134:40186) 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a751ee640 1 -- 172.21.15.134:0/4255880057 learned_addr learned my addr 172.21.15.134:0/4255880057 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:27.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a759ef640 1 --1- 172.21.15.134:0/4255880057 >> v1:172.21.15.177:6789/0 conn(0x7f3a7015b090 0x7f3a700715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:40544/0 (socket says 172.21.15.134:40544) 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.751+0000 7f3a751ee640 1 -- 172.21.15.134:0/4255880057 >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 msgr2=0x7f3a7015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a751ee640 1 --2- 172.21.15.134:0/4255880057 >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 0x7f3a7015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a751ee640 1 -- 172.21.15.134:0/4255880057 >> v1:172.21.15.177:6789/0 conn(0x7f3a7015b090 legacy=0x7f3a700715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a751ee640 1 -- 172.21.15.134:0/4255880057 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a70072680 con 0x7f3a7006ea00 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a749ed640 1 -- 172.21.15.134:0/4255880057 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951555979 0 0) 0x7f3a70071de0 con 0x7f3a7015b090 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a761f0640 1 --2- 172.21.15.134:0/4255880057 >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 0x7f3a7015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.752+0000 7f3a751ee640 1 --2- 172.21.15.134:0/4255880057 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009850 tx=0x7f3a6002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9daf83026500fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a749ed640 1 -- 172.21.15.134:0/4255880057 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60004030 con 0x7f3a7006ea00 2024-09-15T22:47:27.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a749ed640 1 -- 172.21.15.134:0/4255880057 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a600041d0 con 0x7f3a7006ea00 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a749ed640 1 -- 172.21.15.134:0/4255880057 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60003610 con 0x7f3a7006ea00 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 -- 172.21.15.134:0/4255880057 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 msgr2=0x7f3a700b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 --2- 172.21.15.134:0/4255880057 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009850 tx=0x7f3a6002a230 comp rx=0 tx=0).stop 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 -- 172.21.15.134:0/4255880057 shutdown_connections 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 --2- 172.21.15.134:0/4255880057 >> v2:172.21.15.177:3300/0 conn(0x7f3a7015b470 0x7f3a7015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 --2- 172.21.15.134:0/4255880057 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7006ea00 0x7f3a700b5420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 -- 172.21.15.134:0/4255880057 >> 172.21.15.134:0/4255880057 conn(0x7f3a7006bba0 msgr2=0x7f3a7006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 -- 172.21.15.134:0/4255880057 shutdown_connections 2024-09-15T22:47:27.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.753+0000 7f3a77c53640 1 -- 172.21.15.134:0/4255880057 wait complete. 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.754+0000 7f3a77c53640 1 Processor -- start 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.754+0000 7f3a77c53640 1 -- start start 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a7006ea00 0x7f3a701576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7015b090 0x7f3a701f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7015b470 0x7f3a701f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7006d080 con 0x7f3a7015b470 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7015be20 con 0x7f3a7006ea00 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a77c53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7006d200 con 0x7f3a7015b090 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a761f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7015b470 0x7f3a701f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a761f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7015b470 0x7f3a701f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60754/0 (socket says 172.21.15.134:60754) 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a761f0640 1 -- 172.21.15.134:0/3423875617 learned_addr learned my addr 172.21.15.134:0/3423875617 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a751ee640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7015b090 0x7f3a701f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.755+0000 7f3a759ef640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a7006ea00 0x7f3a701576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 -- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7015b090 msgr2=0x7f3a701f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a7015b090 0x7f3a701f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 -- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a7006ea00 msgr2=0x7f3a701576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a7006ea00 0x7f3a701576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 -- 172.21.15.134:0/3423875617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a701f8560 con 0x7f3a7015b470 2024-09-15T22:47:27.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a761f0640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7015b470 0x7f3a701f8020 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009e00 tx=0x7f3a680075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68003990 con 0x7f3a7015b470 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a68003b30 con 0x7f3a7015b470 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a77c53640 1 -- 172.21.15.134:0/3423875617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a70157db0 con 0x7f3a7015b470 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68004020 con 0x7f3a7015b470 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.756+0000 7f3a77c53640 1 -- 172.21.15.134:0/3423875617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a701f7820 con 0x7f3a7015b470 2024-09-15T22:47:27.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.757+0000 7f3a77c53640 1 -- 172.21.15.134:0/3423875617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a701582d0 con 0x7f3a7015b470 2024-09-15T22:47:27.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.757+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f3a6801b030 con 0x7f3a7015b470 2024-09-15T22:47:27.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.758+0000 7f3a667fc640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3a5406c850 0x7f3a5406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:27.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.758+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f3a6808bf40 con 0x7f3a7015b470 2024-09-15T22:47:27.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.758+0000 7f3a759ef640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3a5406c850 0x7f3a5406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:27.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.759+0000 7f3a759ef640 1 --2- 172.21.15.134:0/3423875617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3a5406c850 0x7f3a5406ed10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c000f60 tx=0x7f3a6c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:27.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.763+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a68022020 con 0x7f3a7015b470 2024-09-15T22:47:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.948+0000 7f3a77c53640 1 -- 172.21.15.134:0/3423875617 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f3a7006d580 con 0x7f3a5406c850 2024-09-15T22:47:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:27.951+0000 7f3a667fc640 1 -- 172.21.15.134:0/3423875617 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f3a7006d580 con 0x7f3a5406c850 2024-09-15T22:47:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.952 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:27.950+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:27.956 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:27.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-15T22:47:28.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.056+0000 7f5ce90ba640 1 Processor -- start 2024-09-15T22:47:28.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.056+0000 7f5ce90ba640 1 -- start start 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce90ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 0x7f5ce40b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce90ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce90ba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce40af200 con 0x7f5ce40b4b90 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce90ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce40b5ff0 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce90ba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce4148400 con 0x7f5ce4148020 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60764/0 (socket says 172.21.15.134:60764) 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.057+0000 7f5ce359e640 1 -- 172.21.15.134:0/208352259 learned_addr learned my addr 172.21.15.134:0/208352259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce2d9d640 1 --2- 172.21.15.134:0/208352259 >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 0x7f5ce40b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce359e640 1 -- 172.21.15.134:0/208352259 >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 msgr2=0x7f5ce40b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce359e640 1 --2- 172.21.15.134:0/208352259 >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 0x7f5ce40b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce359e640 1 -- 172.21.15.134:0/208352259 >> v1:172.21.15.177:6789/0 conn(0x7f5ce40b4b90 legacy=0x7f5ce40b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce359e640 1 -- 172.21.15.134:0/208352259 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce40b53e0 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce2d9d640 1 --2- 172.21.15.134:0/208352259 >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 0x7f5ce40b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:28.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.058+0000 7f5ce359e640 1 --2- 172.21.15.134:0/208352259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4072ef0 tx=0x7f5cdc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1deb6a0c1d8a5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce1d9b640 1 -- 172.21.15.134:0/208352259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc036070 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce1d9b640 1 -- 172.21.15.134:0/208352259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc031600 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce1d9b640 1 -- 172.21.15.134:0/208352259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0319d0 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 -- 172.21.15.134:0/208352259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce40ae8e0 msgr2=0x7f5ce40aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 --2- 172.21.15.134:0/208352259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4072ef0 tx=0x7f5cdc02a6f0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 -- 172.21.15.134:0/208352259 shutdown_connections 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 --2- 172.21.15.134:0/208352259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40aecc0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 --2- 172.21.15.134:0/208352259 >> v2:172.21.15.177:3300/0 conn(0x7f5ce4148020 0x7f5ce40b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 -- 172.21.15.134:0/208352259 >> 172.21.15.134:0/208352259 conn(0x7f5ce406d0d0 msgr2=0x7f5ce406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 -- 172.21.15.134:0/208352259 shutdown_connections 2024-09-15T22:47:28.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.059+0000 7f5ce90ba640 1 -- 172.21.15.134:0/208352259 wait complete. 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 Processor -- start 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 -- start start 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ce40b4b90 0x7f5ce4160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce4148020 0x7f5ce41419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40b5c80 con 0x7f5ce4148020 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40b59a0 con 0x7f5ce40ae8e0 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce90ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce40b5000 con 0x7f5ce40b4b90 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce4148020 0x7f5ce41419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce4148020 0x7f5ce41419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60776/0 (socket says 172.21.15.134:60776) 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.061+0000 7f5ce359e640 1 -- 172.21.15.134:0/2080672906 learned_addr learned my addr 172.21.15.134:0/2080672906 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce2d9d640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce259c640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ce40b4b90 0x7f5ce4160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 -- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ce40b4b90 msgr2=0x7f5ce4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ce40b4b90 0x7f5ce4160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 -- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ce40ae8e0 msgr2=0x7f5ce40c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ce40ae8e0 0x7f5ce40c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 -- 172.21.15.134:0/2080672906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce41f6120 con 0x7f5ce4148020 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce259c640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ce40b4b90 0x7f5ce4160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce359e640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ce4148020 0x7f5ce41419b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009f40 tx=0x7f5cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc036050 con 0x7f5ce4148020 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc042070 con 0x7f5ce4148020 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce90ba640 1 -- 172.21.15.134:0/2080672906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce41f6400 con 0x7f5ce4148020 2024-09-15T22:47:28.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc009510 con 0x7f5ce4148020 2024-09-15T22:47:28.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.062+0000 7f5ce90ba640 1 -- 172.21.15.134:0/2080672906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce41f69c0 con 0x7f5ce4148020 2024-09-15T22:47:28.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.063+0000 7f5ce90ba640 1 -- 172.21.15.134:0/2080672906 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce40aecc0 con 0x7f5ce4148020 2024-09-15T22:47:28.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.064+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5cdc007bd0 con 0x7f5ce4148020 2024-09-15T22:47:28.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.064+0000 7f5cdb7fe640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5cc406c850 0x7f5cc406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.064+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5cdc0acf20 con 0x7f5ce4148020 2024-09-15T22:47:28.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.064+0000 7f5ce2d9d640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5cc406c850 0x7f5cc406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.065+0000 7f5ce2d9d640 1 --2- 172.21.15.134:0/2080672906 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5cc406c850 0x7f5cc406ed10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4141940 tx=0x7f5ccc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.069+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cdc07acd0 con 0x7f5ce4148020 2024-09-15T22:47:28.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.254+0000 7f5ce90ba640 1 -- 172.21.15.134:0/2080672906 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f5ce41413e0 con 0x7f5cc406c850 2024-09-15T22:47:28.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.257+0000 7f5cdb7fe640 1 -- 172.21.15.134:0/2080672906 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f5ccc004030 con 0x7f5cc406c850 2024-09-15T22:47:28.257 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.257 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:28.256+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.262 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:28.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-15T22:47:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 Processor -- start 2024-09-15T22:47:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 -- start start 2024-09-15T22:47:28.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9454161cc0 0x7f94540aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94540b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945406dc40 con 0x7f9454072290 2024-09-15T22:47:28.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f945406e570 con 0x7f9454161cc0 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.364+0000 7f9458af8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f945406df20 con 0x7f94540b57d0 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9452d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9454072290 0x7f945406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49120/0 (socket says 172.21.15.134:49120) 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9452d9d640 1 -- 172.21.15.134:0/2253878852 learned_addr learned my addr 172.21.15.134:0/2253878852 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f944bfff640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94540b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f945259c640 1 --2- 172.21.15.134:0/2253878852 >> v2:172.21.15.177:3300/0 conn(0x7f9454161cc0 0x7f94540aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771563947 0 0) 0x7f945406dc40 con 0x7f9454072290 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9440003520 con 0x7f9454072290 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2484472555 0 0) 0x7f9440003520 con 0x7f9454072290 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 msgr2=0x7f94540b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94540b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 >> v2:172.21.15.177:3300/0 conn(0x7f9454161cc0 msgr2=0x7f94540aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 --2- 172.21.15.134:0/2253878852 >> v2:172.21.15.177:3300/0 conn(0x7f9454161cc0 0x7f94540aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945406e200 con 0x7f9454072290 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f944c0019f0 con 0x7f9454072290 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 >> v1:172.21.15.134:6789/0 conn(0x7f9454072290 legacy=0x7f945406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9440003f30 0x7f9440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f94400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f945406e570 con 0x7f9440004d40 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f945406df20 con 0x7f9440003f30 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f944000b9c0 con 0x7f94540b57d0 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f9452d9d640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f94400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f944bfff640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9440003f30 0x7f9440004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.365+0000 7f945259c640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 -- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 msgr2=0x7f94400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540b57d0 0x7f94400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 -- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9440003f30 msgr2=0x7f9440004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9440003f30 0x7f9440004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 -- 172.21.15.134:0/2253878852 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9440003520 con 0x7f9440004d40 2024-09-15T22:47:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9452d9d640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f94400051c0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f944c0013d0 tx=0x7f9440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233beec5da82bd07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c00a4e0 con 0x7f9440004d40 2024-09-15T22:47:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c02f070 con 0x7f9440004d40 2024-09-15T22:47:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.366+0000 7f9451d9b640 1 -- 172.21.15.134:0/2253878852 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c02bcd0 con 0x7f9440004d40 2024-09-15T22:47:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 -- 172.21.15.134:0/2253878852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 msgr2=0x7f94400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 --2- 172.21.15.134:0/2253878852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f94400051c0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f944c0013d0 tx=0x7f9440005830 comp rx=0 tx=0).stop 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9452d9d640 1 -- 172.21.15.134:0/2253878852 reap_dead start 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 -- 172.21.15.134:0/2253878852 shutdown_connections 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 -- 172.21.15.134:0/2253878852 >> 172.21.15.134:0/2253878852 conn(0x7f945406bba0 msgr2=0x7f945406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 -- 172.21.15.134:0/2253878852 shutdown_connections 2024-09-15T22:47:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.367+0000 7f9458af8640 1 -- 172.21.15.134:0/2253878852 wait complete. 2024-09-15T22:47:28.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.368+0000 7f9458af8640 1 Processor -- start 2024-09-15T22:47:28.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.368+0000 7f9458af8640 1 -- start start 2024-09-15T22:47:28.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f9454142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94541482d0 0x7f94541f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540cd520 0x7f94540cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94540b4be0 con 0x7f9440004d40 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94540b4a60 con 0x7f94541482d0 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9458af8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f945406f110 con 0x7f94540cd520 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f9454142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f9454142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60786/0 (socket says 172.21.15.134:60786) 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 -- 172.21.15.134:0/526451311 learned_addr learned my addr 172.21.15.134:0/526451311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f9452d9d640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540cd520 0x7f94540cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f944bfff640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94541482d0 0x7f94541f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 -- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540cd520 msgr2=0x7f94540cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94540cd520 0x7f94540cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 -- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94541482d0 msgr2=0x7f94541f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94541482d0 0x7f94541f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.369+0000 7f945259c640 1 -- 172.21.15.134:0/526451311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94540cfa00 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f945259c640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9440004d40 0x7f9454142050 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9444011a70 tx=0x7f9444011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944400fb50 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944400fcf0 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f9458af8640 1 -- 172.21.15.134:0/526451311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94540cfce0 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944400fea0 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.370+0000 7f9458af8640 1 -- 172.21.15.134:0/526451311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94540d02a0 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.371+0000 7f9458af8640 1 -- 172.21.15.134:0/526451311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94540aebf0 con 0x7f9440004d40 2024-09-15T22:47:28.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.371+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f9444012040 con 0x7f9440004d40 2024-09-15T22:47:28.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.372+0000 7f944affd640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f943406c850 0x7f943406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.372+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f944408c490 con 0x7f9440004d40 2024-09-15T22:47:28.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.372+0000 7f944bfff640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f943406c850 0x7f943406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.372+0000 7f944bfff640 1 --2- 172.21.15.134:0/526451311 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f943406c850 0x7f943406ed10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f945415a340 tx=0x7f943c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.376+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9444019030 con 0x7f9440004d40 2024-09-15T22:47:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.565+0000 7f9458af8640 1 -- 172.21.15.134:0/526451311 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f9454072910 con 0x7f943406c850 2024-09-15T22:47:28.568 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:28.567+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.568+0000 7f944affd640 1 -- 172.21.15.134:0/526451311 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f9454072910 con 0x7f943406c850 2024-09-15T22:47:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.575 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:28.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-15T22:47:28.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.677+0000 7f5f2c277640 1 Processor -- start 2024-09-15T22:47:28.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.677+0000 7f5f2c277640 1 -- start start 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2c277640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f241554d0 0x7f5f2415f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2c277640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5f240ae8e0 0x7f5f240b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2c277640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240af050 con 0x7f5f240b5460 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2c277640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5f240b58d0 con 0x7f5f241554d0 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2c277640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5f240af330 con 0x7f5f240ae8e0 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2a013640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f241554d0 0x7f5f2415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2a013640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f241554d0 0x7f5f2415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60796/0 (socket says 172.21.15.134:60796) 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2a814640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5f240b5460 0x7f5f24072a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49122/0 (socket says 172.21.15.134:49122) 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f2a013640 1 -- 172.21.15.134:0/2450713698 learned_addr learned my addr 172.21.15.134:0/2450713698 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.678+0000 7f5f29812640 1 --2- 172.21.15.134:0/2450713698 >> v2:172.21.15.177:3300/0 conn(0x7f5f240ae8e0 0x7f5f240b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f2a013640 1 -- 172.21.15.134:0/2450713698 >> v2:172.21.15.177:3300/0 conn(0x7f5f240ae8e0 msgr2=0x7f5f240b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2450713698 >> v2:172.21.15.177:3300/0 conn(0x7f5f240ae8e0 0x7f5f240b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f2a013640 1 -- 172.21.15.134:0/2450713698 >> v1:172.21.15.134:6789/0 conn(0x7f5f240b5460 legacy=0x7f5f24072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f2a013640 1 -- 172.21.15.134:0/2450713698 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f240af610 con 0x7f5f241554d0 2024-09-15T22:47:28.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f29011640 1 -- 172.21.15.134:0/2450713698 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010228255 0 0) 0x7f5f240af050 con 0x7f5f240b5460 2024-09-15T22:47:28.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2450713698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f241554d0 0x7f5f2415f640 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5f24159160 tx=0x7f5f2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9132b7baed9090 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f29011640 1 -- 172.21.15.134:0/2450713698 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20037070 con 0x7f5f241554d0 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.679+0000 7f5f29011640 1 -- 172.21.15.134:0/2450713698 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f20032440 con 0x7f5f241554d0 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f29011640 1 -- 172.21.15.134:0/2450713698 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20032810 con 0x7f5f241554d0 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 -- 172.21.15.134:0/2450713698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f241554d0 msgr2=0x7f5f2415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 --2- 172.21.15.134:0/2450713698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f241554d0 0x7f5f2415f640 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5f24159160 tx=0x7f5f2002a270 comp rx=0 tx=0).stop 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 -- 172.21.15.134:0/2450713698 shutdown_connections 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 --2- 172.21.15.134:0/2450713698 >> v2:172.21.15.177:3300/0 conn(0x7f5f240ae8e0 0x7f5f240b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 --2- 172.21.15.134:0/2450713698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f241554d0 0x7f5f2415f640 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 -- 172.21.15.134:0/2450713698 >> 172.21.15.134:0/2450713698 conn(0x7f5f2406c9f0 msgr2=0x7f5f2406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 -- 172.21.15.134:0/2450713698 shutdown_connections 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.680+0000 7f5f2c277640 1 -- 172.21.15.134:0/2450713698 wait complete. 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.681+0000 7f5f2c277640 1 Processor -- start 2024-09-15T22:47:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.681+0000 7f5f2c277640 1 -- start start 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f240ae8e0 0x7f5f24155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f240b5460 0x7f5f241574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f241554d0 0x7f5f241455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f240aed70 con 0x7f5f240b5460 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f240afbd0 con 0x7f5f240ae8e0 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2c277640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5f241558b0 con 0x7f5f241554d0 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f240b5460 0x7f5f241574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f240b5460 0x7f5f241574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60798/0 (socket says 172.21.15.134:60798) 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 -- 172.21.15.134:0/2256987127 learned_addr learned my addr 172.21.15.134:0/2256987127 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f240ae8e0 0x7f5f24155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2a814640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f241554d0 0x7f5f241455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 -- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f241554d0 msgr2=0x7f5f241455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f241554d0 0x7f5f241455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 -- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f240ae8e0 msgr2=0x7f5f24155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f240ae8e0 0x7f5f24155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f29812640 1 -- 172.21.15.134:0/2256987127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f24156440 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.682+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f240ae8e0 0x7f5f24155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f29812640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f240b5460 0x7f5f241574e0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400d830 tx=0x7f5f1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400b6c0 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f14019070 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f2c277640 1 -- 172.21.15.134:0/2256987127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f24156720 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400ba80 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.683+0000 7f5f2c277640 1 -- 172.21.15.134:0/2256987127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f24156ce0 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.684+0000 7f5f2c277640 1 -- 172.21.15.134:0/2256987127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f240b4f20 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.684+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7f5f1401e460 con 0x7f5f240b5460 2024-09-15T22:47:28.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.685+0000 7f5f1affd640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5f0806c850 0x7f5f0806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.685+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f5f1408c5f0 con 0x7f5f240b5460 2024-09-15T22:47:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.685+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5f0806c850 0x7f5f0806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.685+0000 7f5f2a013640 1 --2- 172.21.15.134:0/2256987127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5f0806c850 0x7f5f0806ed10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f20034000 tx=0x7f5f2002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.689+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f1405a4b0 con 0x7f5f240b5460 2024-09-15T22:47:28.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.881+0000 7f5f2c277640 1 -- 172.21.15.134:0/2256987127 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) -- 0x7f5f24062ca0 con 0x7f5f0806c850 2024-09-15T22:47:28.884 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:28.883+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.882+0000 7f5f1affd640 1 -- 172.21.15.134:0/2256987127 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f5f24062ca0 con 0x7f5f0806c850 2024-09-15T22:47:28.885 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:28.890 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:28.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-15T22:47:28.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.988+0000 7fc05c931640 1 Processor -- start 2024-09-15T22:47:28.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.988+0000 7fc05c931640 1 -- start start 2024-09-15T22:47:28.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc05c931640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc05815bb80 0x7fc0580b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc05c931640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc058071de0 con 0x7fc05806ea00 2024-09-15T22:47:28.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc05c931640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0580720c0 con 0x7fc05815b090 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc05c931640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc0580723a0 con 0x7fc05815bb80 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc056d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc05815bb80 0x7fc0580b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc055d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc05806ea00 0x7fc05815b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49134/0 (socket says 172.21.15.134:49134) 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc056d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc05815bb80 0x7fc0580b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60804/0 (socket says 172.21.15.134:60804) 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc055d9b640 1 -- 172.21.15.134:0/2139470841 learned_addr learned my addr 172.21.15.134:0/2139470841 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc056d9d640 1 -- 172.21.15.134:0/2139470841 >> v1:172.21.15.177:6789/0 conn(0x7fc05815b090 legacy=0x7fc0580715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc056d9d640 1 -- 172.21.15.134:0/2139470841 >> v1:172.21.15.134:6789/0 conn(0x7fc05806ea00 legacy=0x7fc05815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.989+0000 7fc056d9d640 1 -- 172.21.15.134:0/2139470841 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc058072680 con 0x7fc05815bb80 2024-09-15T22:47:28.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.990+0000 7fc056d9d640 1 --2- 172.21.15.134:0/2139470841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815bb80 0x7fc0580b5420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc05000aea0 tx=0x7fc05002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c2bbbde65d3857 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.990+0000 7fc05559a640 1 -- 172.21.15.134:0/2139470841 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050037070 con 0x7fc05815bb80 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.990+0000 7fc05559a640 1 -- 172.21.15.134:0/2139470841 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc050008640 con 0x7fc05815bb80 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.990+0000 7fc05559a640 1 -- 172.21.15.134:0/2139470841 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050008a10 con 0x7fc05815bb80 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 -- 172.21.15.134:0/2139470841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815bb80 msgr2=0x7fc0580b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 --2- 172.21.15.134:0/2139470841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815bb80 0x7fc0580b5420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc05000aea0 tx=0x7fc05002b7f0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 -- 172.21.15.134:0/2139470841 shutdown_connections 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 --2- 172.21.15.134:0/2139470841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815bb80 0x7fc0580b5420 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 -- 172.21.15.134:0/2139470841 >> 172.21.15.134:0/2139470841 conn(0x7fc05806bba0 msgr2=0x7fc05806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:28.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 -- 172.21.15.134:0/2139470841 shutdown_connections 2024-09-15T22:47:28.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.991+0000 7fc05c931640 1 -- 172.21.15.134:0/2139470841 wait complete. 2024-09-15T22:47:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.992+0000 7fc05c931640 1 Processor -- start 2024-09-15T22:47:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.992+0000 7fc05c931640 1 -- start start 2024-09-15T22:47:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05806ea00 0x7fc05814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815b090 0x7fc058158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc05815bb80 0x7fc0580c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc05806d200 con 0x7fc05815b090 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc05806d080 con 0x7fc05815bb80 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05c931640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc05806d380 con 0x7fc05806ea00 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815b090 0x7fc058158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815b090 0x7fc058158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60818/0 (socket says 172.21.15.134:60818) 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 -- 172.21.15.134:0/3354818700 learned_addr learned my addr 172.21.15.134:0/3354818700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc056d9d640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc05815bb80 0x7fc0580c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc05659c640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05806ea00 0x7fc05814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 -- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05806ea00 msgr2=0x7fc05814ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05806ea00 0x7fc05814ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 -- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc05815bb80 msgr2=0x7fc0580c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc05815bb80 0x7fc0580c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc055d9b640 1 -- 172.21.15.134:0/3354818700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc058157c30 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.993+0000 7fc056d9d640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc05815bb80 0x7fc0580c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc055d9b640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc05815b090 0x7fc058158470 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c400 tx=0x7fc04c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c017070 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c0074e0 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc05c931640 1 -- 172.21.15.134:0/3354818700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc058157f10 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0059a0 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.994+0000 7fc05c931640 1 -- 172.21.15.134:0/3354818700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0580c5880 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.995+0000 7fc05c931640 1 -- 172.21.15.134:0/3354818700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580b5420 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.995+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 91356+0+0 (secure 0 0 0) 0x7fc04c01a070 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.996+0000 7fc046ffd640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc03806c880 0x7fc03806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.996+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fc04c08b100 con 0x7fc05815b090 2024-09-15T22:47:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.996+0000 7fc05659c640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc03806c880 0x7fc03806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:28.997+0000 7fc05659c640 1 --2- 172.21.15.134:0/3354818700 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc03806c880 0x7fc03806ed40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc048004ea0 tx=0x7fc048009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.000+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc04c058a00 con 0x7fc05815b090 2024-09-15T22:47:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.190+0000 7fc05c931640 1 -- 172.21.15.134:0/3354818700 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7fc0580b4e10 con 0x7fc03806c880 2024-09-15T22:47:29.194 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:29.193+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.193+0000 7fc046ffd640 1 -- 172.21.15.134:0/3354818700 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fc0580b4e10 con 0x7fc03806c880 2024-09-15T22:47:29.195 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.200 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:29.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-15T22:47:29.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 Processor -- start 2024-09-15T22:47:29.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 -- start start 2024-09-15T22:47:29.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdcf40d1990 0x7fdcf4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40b7540 0x7fdcf406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf4162260 con 0x7fdcf40b5590 2024-09-15T22:47:29.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.304+0000 7fdcf964c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdcf40d2320 con 0x7fdcf40d1990 2024-09-15T22:47:29.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf964c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf4162540 con 0x7fdcf40b7540 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdcf40d1990 0x7fdcf4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdcf40d1990 0x7fdcf4070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60832/0 (socket says 172.21.15.134:60832) 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 -- 172.21.15.134:0/926653114 learned_addr learned my addr 172.21.15.134:0/926653114 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf37fe640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40b7540 0x7fdcf406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 -- 172.21.15.134:0/926653114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40b7540 msgr2=0x7fdcf406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40b7540 0x7fdcf406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 -- 172.21.15.134:0/926653114 >> v1:172.21.15.177:6789/0 conn(0x7fdcf40b5590 legacy=0x7fdcf40b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.305+0000 7fdcf2ffd640 1 -- 172.21.15.134:0/926653114 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf4162820 con 0x7fdcf40d1990 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf2ffd640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40d1990 0x7fdcf4070c00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009870 tx=0x7fdce402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d0f96fe60dcd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf27fc640 1 -- 172.21.15.134:0/926653114 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4037070 con 0x7fdcf40d1990 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf27fc640 1 -- 172.21.15.134:0/926653114 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4032440 con 0x7fdcf40d1990 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf27fc640 1 -- 172.21.15.134:0/926653114 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4032810 con 0x7fdcf40d1990 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf964c640 1 -- 172.21.15.134:0/926653114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40d1990 msgr2=0x7fdcf4070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.306+0000 7fdcf964c640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40d1990 0x7fdcf4070c00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009870 tx=0x7fdce402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 -- 172.21.15.134:0/926653114 shutdown_connections 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40b7540 0x7fdcf406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 --2- 172.21.15.134:0/926653114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40d1990 0x7fdcf4070c00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 -- 172.21.15.134:0/926653114 >> 172.21.15.134:0/926653114 conn(0x7fdcf406f390 msgr2=0x7fdcf406f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 -- 172.21.15.134:0/926653114 shutdown_connections 2024-09-15T22:47:29.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.307+0000 7fdcf964c640 1 -- 172.21.15.134:0/926653114 wait complete. 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 Processor -- start 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 -- start start 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf40b5590 0x7fdcf4144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40b7540 0x7fdcf4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40d1990 0x7fdcf4156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf40d1d70 con 0x7fdcf40b7540 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4162de0 con 0x7fdcf40b5590 2024-09-15T22:47:29.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.308+0000 7fdcf964c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf406d2f0 con 0x7fdcf40d1990 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40b7540 0x7fdcf4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40b7540 0x7fdcf4153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60848/0 (socket says 172.21.15.134:60848) 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 -- 172.21.15.134:0/453006596 learned_addr learned my addr 172.21.15.134:0/453006596 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcf2ffd640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf40b5590 0x7fdcf4144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcf37fe640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40d1990 0x7fdcf4156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 -- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40d1990 msgr2=0x7fdcf4156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf40d1990 0x7fdcf4156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 -- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf40b5590 msgr2=0x7fdcf4144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf40b5590 0x7fdcf4144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 -- 172.21.15.134:0/453006596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf41569c0 con 0x7fdcf40b7540 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcebfff640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcf40b7540 0x7fdcf4153c70 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c400 tx=0x7fdcdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0052d0 con 0x7fdcf40b7540 2024-09-15T22:47:29.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc005490 con 0x7fdcf40b7540 2024-09-15T22:47:29.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcf964c640 1 -- 172.21.15.134:0/453006596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf4156ca0 con 0x7fdcf40b7540 2024-09-15T22:47:29.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc007260 con 0x7fdcf40b7540 2024-09-15T22:47:29.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.309+0000 7fdcf964c640 1 -- 172.21.15.134:0/453006596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf4157260 con 0x7fdcf40b7540 2024-09-15T22:47:29.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.310+0000 7fdcf964c640 1 -- 172.21.15.134:0/453006596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf406cdb0 con 0x7fdcf40b7540 2024-09-15T22:47:29.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.311+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fdcdc007400 con 0x7fdcf40b7540 2024-09-15T22:47:29.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.311+0000 7fdceb7fe640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdcd406c8e0 0x7fdcd406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.311+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fdcdc08b470 con 0x7fdcf40b7540 2024-09-15T22:47:29.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.311+0000 7fdcf2ffd640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdcd406c8e0 0x7fdcd406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.312+0000 7fdcf2ffd640 1 --2- 172.21.15.134:0/453006596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdcd406c8e0 0x7fdcd406eda0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdce4034000 tx=0x7fdce402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.315+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcdc058c10 con 0x7fdcf40b7540 2024-09-15T22:47:29.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.501+0000 7fdcf964c640 1 -- 172.21.15.134:0/453006596 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fdcf4161ea0 con 0x7fdcd406c8e0 2024-09-15T22:47:29.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.503+0000 7fdceb7fe640 1 -- 172.21.15.134:0/453006596 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fdcf4161ea0 con 0x7fdcd406c8e0 2024-09-15T22:47:29.505 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.505 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:29.503+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.510 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:29.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-15T22:47:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.612+0000 7fc6ef186640 1 Processor -- start 2024-09-15T22:47:29.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.612+0000 7fc6ef186640 1 -- start start 2024-09-15T22:47:29.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.613+0000 7fc6ef186640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc6e815c580 0x7fc6e80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.613+0000 7fc6ef186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.613+0000 7fc6ef186640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e80b78d0 con 0x7fc6e80d2530 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.613+0000 7fc6ef186640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e815c960 con 0x7fc6e815c580 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.613+0000 7fc6ef186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80d2ec0 con 0x7fc6e80b7270 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ed723640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc6e815c580 0x7fc6e80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc6e815c580 0x7fc6e80b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:46490/0 (socket says 172.21.15.134:46490) 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 -- 172.21.15.134:0/396337484 learned_addr learned my addr 172.21.15.134:0/396337484 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ed723640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:40278/0 (socket says 172.21.15.134:40278) 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 -- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 msgr2=0x7fc6e80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 -- 172.21.15.134:0/396337484 >> v1:172.21.15.177:6789/0 conn(0x7fc6e80d2530 legacy=0x7fc6e80b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ecf22640 1 -- 172.21.15.134:0/396337484 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e80b5770 con 0x7fc6e815c580 2024-09-15T22:47:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.614+0000 7fc6ed723640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ecf22640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e80b6250 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd0086b66723654 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6e77fe640 1 -- 172.21.15.134:0/396337484 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8037070 con 0x7fc6e815c580 2024-09-15T22:47:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6e77fe640 1 -- 172.21.15.134:0/396337484 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d8032440 con 0x7fc6e815c580 2024-09-15T22:47:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6e77fe640 1 -- 172.21.15.134:0/396337484 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8032810 con 0x7fc6e815c580 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 -- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 msgr2=0x7fc6e80b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e80b6250 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009870 tx=0x7fc6d802a270 comp rx=0 tx=0).stop 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 -- 172.21.15.134:0/396337484 shutdown_connections 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 --2- 172.21.15.134:0/396337484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e80b6250 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.615+0000 7fc6ef186640 1 -- 172.21.15.134:0/396337484 >> 172.21.15.134:0/396337484 conn(0x7fc6e806f390 msgr2=0x7fc6e806f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.616+0000 7fc6ef186640 1 -- 172.21.15.134:0/396337484 shutdown_connections 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.616+0000 7fc6ef186640 1 -- 172.21.15.134:0/396337484 wait complete. 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.617+0000 7fc6ef186640 1 Processor -- start 2024-09-15T22:47:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.617+0000 7fc6ef186640 1 -- start start 2024-09-15T22:47:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.617+0000 7fc6ef186640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.617+0000 7fc6ef186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80d2530 0x7fc6e8158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e8158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80b5d30 con 0x7fc6e80d2530 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80b7670 con 0x7fc6e815c580 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80d03f0 con 0x7fc6e80b7270 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80d2530 0x7fc6e8158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80d2530 0x7fc6e8158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60864/0 (socket says 172.21.15.134:60864) 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 -- 172.21.15.134:0/1684868822 learned_addr learned my addr 172.21.15.134:0/1684868822 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ed723640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e8158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ecf22640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 -- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 msgr2=0x7fc6e8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6e80b7270 0x7fc6e8154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 -- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 msgr2=0x7fc6e8158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6e815c580 0x7fc6e8158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 -- 172.21.15.134:0/1684868822 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e81554b0 con 0x7fc6e80d2530 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e7fff640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e80d2530 0x7fc6e8158760 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00c790 tx=0x7fc6dc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc016020 con 0x7fc6e80d2530 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc006d50 con 0x7fc6e80d2530 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 -- 172.21.15.134:0/1684868822 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e8155780 con 0x7fc6e80d2530 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc003bb0 con 0x7fc6e80d2530 2024-09-15T22:47:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.618+0000 7fc6ef186640 1 -- 172.21.15.134:0/1684868822 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e81564a0 con 0x7fc6e80d2530 2024-09-15T22:47:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.619+0000 7fc6ef186640 1 -- 172.21.15.134:0/1684868822 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e80d2980 con 0x7fc6e80d2530 2024-09-15T22:47:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.620+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fc6dc0050d0 con 0x7fc6e80d2530 2024-09-15T22:47:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.620+0000 7fc6e57fa640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc6d406c910 0x7fc6d406edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.620+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7fc6dc08bd90 con 0x7fc6e80d2530 2024-09-15T22:47:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.621+0000 7fc6ecf22640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc6d406c910 0x7fc6d406edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.621+0000 7fc6ecf22640 1 --2- 172.21.15.134:0/1684868822 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc6d406c910 0x7fc6d406edd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8034000 tx=0x7fc6d802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.624+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6dc020020 con 0x7fc6e80d2530 2024-09-15T22:47:29.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.814+0000 7fc6ef186640 1 -- 172.21.15.134:0/1684868822 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fc6e8069500 con 0x7fc6d406c910 2024-09-15T22:47:29.817 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:29.816+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.817+0000 7fc6e57fa640 1 -- 172.21.15.134:0/1684868822 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fc6e8069500 con 0x7fc6d406c910 2024-09-15T22:47:29.818 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:29.823 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:29.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-15T22:47:29.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.923+0000 7f0e2c2dd640 1 Processor -- start 2024-09-15T22:47:29.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.923+0000 7f0e2c2dd640 1 -- start start 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e2c2dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e240b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e2c2dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0e240d1fd0 0x7f0e240b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e2c2dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2406ec90 con 0x7f0e240d1860 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e2c2dd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0e240d1dd0 con 0x7f0e240d1fd0 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e2c2dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e240b7800 con 0x7f0e2415e5c0 2024-09-15T22:47:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e29878640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e240d1860 0x7f0e241622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49138/0 (socket says 172.21.15.134:49138) 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.924+0000 7f0e29878640 1 -- 172.21.15.134:0/1124913459 learned_addr learned my addr 172.21.15.134:0/1124913459 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949473965 0 0) 0x7f0e2406ec90 con 0x7f0e240d1860 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a079640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e240b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e0c003520 con 0x7f0e240d1860 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> v2:172.21.15.177:3300/0 conn(0x7f0e240d1fd0 0x7f0e240b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781297002 0 0) 0x7f0e0c003520 con 0x7f0e240d1860 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 msgr2=0x7f0e240b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e240b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 >> v2:172.21.15.177:3300/0 conn(0x7f0e240d1fd0 msgr2=0x7f0e240b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 --2- 172.21.15.134:0/1124913459 >> v2:172.21.15.177:3300/0 conn(0x7f0e240d1fd0 0x7f0e240b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e24073d20 con 0x7f0e240d1860 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0e18001670 con 0x7f0e240d1860 2024-09-15T22:47:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> v2:172.21.15.177:3300/0 conn(0x7f0e240d1fd0 0x7f0e240b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 >> v1:172.21.15.134:6789/0 conn(0x7f0e240d1860 legacy=0x7f0e241622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e0c0039b0 0x7f0e0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e0c004d40 0x7f0e0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e240d1dd0 con 0x7f0e0c004d40 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e240b7800 con 0x7f0e0c0039b0 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0c00baf0 con 0x7f0e2415e5c0 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e0c004d40 0x7f0e0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a079640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e0c0039b0 0x7f0e0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e29878640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 -- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 msgr2=0x7f0e0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e2415e5c0 0x7f0e0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 -- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e0c0039b0 msgr2=0x7f0e0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:29.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e0c0039b0 0x7f0e0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a87a640 1 -- 172.21.15.134:0/1124913459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c003520 con 0x7f0e0c004d40 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.925+0000 7f0e2a079640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e0c0039b0 0x7f0e0c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.926+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e0c004d40 0x7f0e0c0051c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0098a0 tx=0x7f0e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203eb6d969b28a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.926+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00f040 con 0x7f0e0c004d40 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.926+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c02ad20 con 0x7f0e0c004d40 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.926+0000 7f0e29077640 1 -- 172.21.15.134:0/1124913459 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004250 con 0x7f0e0c004d40 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/1124913459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e0c004d40 msgr2=0x7f0e0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 --2- 172.21.15.134:0/1124913459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e0c004d40 0x7f0e0c0051c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0098a0 tx=0x7f0e0c005830 comp rx=0 tx=0).stop 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2a87a640 1 -- 172.21.15.134:0/1124913459 reap_dead start 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/1124913459 shutdown_connections 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/1124913459 >> 172.21.15.134:0/1124913459 conn(0x7f0e240d25b0 msgr2=0x7f0e240d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/1124913459 shutdown_connections 2024-09-15T22:47:29.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.927+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/1124913459 wait complete. 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.928+0000 7f0e2c2dd640 1 Processor -- start 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.928+0000 7f0e2c2dd640 1 -- start start 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e0c004d40 0x7f0e240d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e241e38c0 0x7f0e241e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e240cc830 0x7f0e240cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e240719e0 con 0x7f0e241e38c0 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2406e770 con 0x7f0e240cc830 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0e240b5710 con 0x7f0e0c004d40 2024-09-15T22:47:29.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e241e38c0 0x7f0e241e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e241e38c0 0x7f0e241e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60884/0 (socket says 172.21.15.134:60884) 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 -- 172.21.15.134:0/2328500105 learned_addr learned my addr 172.21.15.134:0/2328500105 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2a87a640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e240cc830 0x7f0e240cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2a079640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e0c004d40 0x7f0e240d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 -- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e0c004d40 msgr2=0x7f0e240d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e0c004d40 0x7f0e240d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 -- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e240cc830 msgr2=0x7f0e240cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e240cc830 0x7f0e240cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 -- 172.21.15.134:0/2328500105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e241e4280 con 0x7f0e241e38c0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e29878640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e241e38c0 0x7f0e241e3d40 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0e18007340 tx=0x7f0e18007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800f8c0 con 0x7f0e241e38c0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18018070 con 0x7f0e241e38c0 2024-09-15T22:47:29.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/2328500105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e240cd1f0 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.929+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800fca0 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.930+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/2328500105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e240cd790 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.930+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/2328500105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2415e9a0 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.931+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f0e1801d460 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.931+0000 7f0e22ffd640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1006c8e0 0x7f0e1006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.931+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f0e1808c050 con 0x7f0e241e38c0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.932+0000 7f0e2a079640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1006c8e0 0x7f0e1006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.932+0000 7f0e2a079640 1 --2- 172.21.15.134:0/2328500105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0e1006c8e0 0x7f0e1006eda0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e140075c0 tx=0x7f0e1400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:29.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:29.935+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e18059ed0 con 0x7f0e241e38c0 2024-09-15T22:47:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.128+0000 7f0e2c2dd640 1 -- 172.21.15.134:0/2328500105 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f0e240d1630 con 0x7f0e1006c8e0 2024-09-15T22:47:30.132 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:30.131+0000 7f4588482640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-15T22:47:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.131+0000 7f0e22ffd640 1 -- 172.21.15.134:0/2328500105 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f0e14015450 con 0x7f0e1006c8e0 2024-09-15T22:47:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-15T22:47:30.137 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T22:47:30.138 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:47:30.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:30.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:30.222 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:47:30.222 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:30.222 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:30.223 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:30.240 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:30.240 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:30.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:47:30.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.433+0000 7f3876952640 1 Processor -- start 2024-09-15T22:47:30.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.433+0000 7f3876952640 1 -- start start 2024-09-15T22:47:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f3876952640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f387015ca40 0x7f387015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f3876952640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387015d390 con 0x7f387015ceb0 2024-09-15T22:47:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f3876952640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387015d670 con 0x7f38700d02a0 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f3876952640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f387015d950 con 0x7f387015ca40 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f387015ca40 0x7f387015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f387015ca40 0x7f387015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60892/0 (socket says 172.21.15.134:60892) 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 -- 172.21.15.134:0/687767185 learned_addr learned my addr 172.21.15.134:0/687767185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 -- 172.21.15.134:0/687767185 >> v1:172.21.15.177:6789/0 conn(0x7f38700d02a0 legacy=0x7f38700d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 -- 172.21.15.134:0/687767185 >> v1:172.21.15.134:6789/0 conn(0x7f387015ceb0 legacy=0x7f38701594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386effd640 1 -- 172.21.15.134:0/687767185 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230018132 0 0) 0x7f387015d390 con 0x7f387015ceb0 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.434+0000 7f386f7fe640 1 -- 172.21.15.134:0/687767185 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387015dc30 con 0x7f387015ca40 2024-09-15T22:47:30.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.435+0000 7f386f7fe640 1 --2- 172.21.15.134:0/687767185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ca40 0x7f387015e430 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cabd0b0b575453a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.435+0000 7f386effd640 1 -- 172.21.15.134:0/687767185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864038070 con 0x7f387015ca40 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.435+0000 7f386effd640 1 -- 172.21.15.134:0/687767185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864031710 con 0x7f387015ca40 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.435+0000 7f386effd640 1 -- 172.21.15.134:0/687767185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864031ae0 con 0x7f387015ca40 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 -- 172.21.15.134:0/687767185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ca40 msgr2=0x7f387015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 --2- 172.21.15.134:0/687767185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ca40 0x7f387015e430 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402c420 comp rx=0 tx=0).stop 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 -- 172.21.15.134:0/687767185 shutdown_connections 2024-09-15T22:47:30.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 --2- 172.21.15.134:0/687767185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ca40 0x7f387015e430 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 -- 172.21.15.134:0/687767185 >> 172.21.15.134:0/687767185 conn(0x7f3870062cc0 msgr2=0x7f387006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:30.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 -- 172.21.15.134:0/687767185 shutdown_connections 2024-09-15T22:47:30.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.436+0000 7f3876952640 1 -- 172.21.15.134:0/687767185 wait complete. 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.437+0000 7f3876952640 1 Processor -- start 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.437+0000 7f3876952640 1 -- start start 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38700d02a0 0x7f387013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f387015ca40 0x7f387015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3870155d10 con 0x7f387015ceb0 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3870155b90 con 0x7f387015ca40 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3876952640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f38700b4790 con 0x7f38700d02a0 2024-09-15T22:47:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60894/0 (socket says 172.21.15.134:60894) 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 -- 172.21.15.134:0/3996558991 learned_addr learned my addr 172.21.15.134:0/3996558991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 -- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38700d02a0 msgr2=0x7f387013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38700d02a0 0x7f387013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 -- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f387015ca40 msgr2=0x7f387015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f387015ca40 0x7f387015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 -- 172.21.15.134:0/3996558991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3870142d40 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.438+0000 7f3874eef640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f386800c780 tx=0x7f386800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.439+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868003da0 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.439+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386800ce30 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.439+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3870072fa0 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.439+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868005290 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.439+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3870073560 con 0x7f387015ceb0 2024-09-15T22:47:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.440+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38700b58a0 con 0x7f387015ceb0 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.440+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f3868005430 con 0x7f387015ceb0 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.440+0000 7f386cff9640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 0x7f385c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.441+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f386808bf10 con 0x7f387015ceb0 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.441+0000 7f386ffff640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 0x7f385c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.441+0000 7f386ffff640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 0x7f385c06eda0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3860003cc0 tx=0x7f38600079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.446+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38700b58a0 con 0x7f387015ceb0 2024-09-15T22:47:30.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.619+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f38700d0680 con 0x7f387015ceb0 2024-09-15T22:47:30.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.620+0000 7f386cff9640 1 -- 172.21.15.134:0/3996558991 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v134) ==== 80+0+0 (secure 0 0 0) 0x7f3868059d00 con 0x7f387015ceb0 2024-09-15T22:47:30.622 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:47:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 msgr2=0x7f385c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 0x7f385c06eda0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3860003cc0 tx=0x7f38600079b0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 msgr2=0x7f387015b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f386800c780 tx=0x7f386800cc40 comp rx=0 tx=0).stop 2024-09-15T22:47:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 shutdown_connections 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f385c06c8e0 0x7f385c06eda0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f387015ceb0 0x7f387015b040 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f387015ca40 0x7f387015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 --2- 172.21.15.134:0/3996558991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38700d02a0 0x7f387013f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 >> 172.21.15.134:0/3996558991 conn(0x7f3870062cc0 msgr2=0x7f3870154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 shutdown_connections 2024-09-15T22:47:30.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.622+0000 7f3876952640 1 -- 172.21.15.134:0/3996558991 wait complete. 2024-09-15T22:47:30.635 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:47:30.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:30.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:30.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:47:30.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:30.663 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:47:30.719 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:30.719 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:30.719 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:30.738 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:30.738 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:30.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:47:30.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.894+0000 7f320b623640 1 Processor -- start 2024-09-15T22:47:30.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.894+0000 7f320b623640 1 -- start start 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f320b623640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f320415c180 0x7f32040cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f320b623640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32040ce230 0x7f32040cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f320b623640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32040ce740 con 0x7f32040cf5b0 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f320b623640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3204072640 con 0x7f32040ce230 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f320b623640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3204072920 con 0x7f320415c180 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32040ce230 0x7f32040cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3209bc0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f32040cf5b0 0x7f3204073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49170/0 (socket says 172.21.15.134:49170) 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3209bc0640 1 -- 172.21.15.134:0/2662346654 learned_addr learned my addr 172.21.15.134:0/2662346654 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32040ce230 0x7f32040cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60900/0 (socket says 172.21.15.134:60900) 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f32093bf640 1 --2- 172.21.15.134:0/2662346654 >> v2:172.21.15.177:3300/0 conn(0x7f320415c180 0x7f32040cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 -- 172.21.15.134:0/2662346654 >> v2:172.21.15.177:3300/0 conn(0x7f320415c180 msgr2=0x7f32040cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:30.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 --2- 172.21.15.134:0/2662346654 >> v2:172.21.15.177:3300/0 conn(0x7f320415c180 0x7f32040cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 -- 172.21.15.134:0/2662346654 >> v1:172.21.15.134:6789/0 conn(0x7f32040cf5b0 legacy=0x7f3204073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f31fbfff640 1 -- 172.21.15.134:0/2662346654 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577524031 0 0) 0x7f32040ce740 con 0x7f32040cf5b0 2024-09-15T22:47:30.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.895+0000 7f3208bbe640 1 -- 172.21.15.134:0/2662346654 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3204072c00 con 0x7f32040ce230 2024-09-15T22:47:30.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.896+0000 7f3208bbe640 1 --2- 172.21.15.134:0/2662346654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040cf070 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f320406cc10 tx=0x7f31f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394ce9276b8b59fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.896+0000 7f31fbfff640 1 -- 172.21.15.134:0/2662346654 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4037070 con 0x7f32040ce230 2024-09-15T22:47:30.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.896+0000 7f31fbfff640 1 -- 172.21.15.134:0/2662346654 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4032440 con 0x7f32040ce230 2024-09-15T22:47:30.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.896+0000 7f31fbfff640 1 -- 172.21.15.134:0/2662346654 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f402ae60 con 0x7f32040ce230 2024-09-15T22:47:30.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 -- 172.21.15.134:0/2662346654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 msgr2=0x7f32040cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 --2- 172.21.15.134:0/2662346654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040cf070 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f320406cc10 tx=0x7f31f402a110 comp rx=0 tx=0).stop 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 -- 172.21.15.134:0/2662346654 shutdown_connections 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 --2- 172.21.15.134:0/2662346654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040cf070 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 --2- 172.21.15.134:0/2662346654 >> v2:172.21.15.177:3300/0 conn(0x7f320415c180 0x7f32040cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 -- 172.21.15.134:0/2662346654 >> 172.21.15.134:0/2662346654 conn(0x7f3204062cc0 msgr2=0x7f320406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 -- 172.21.15.134:0/2662346654 shutdown_connections 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.897+0000 7f320b623640 1 -- 172.21.15.134:0/2662346654 wait complete. 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.898+0000 7f320b623640 1 Processor -- start 2024-09-15T22:47:30.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.898+0000 7f320b623640 1 -- start start 2024-09-15T22:47:30.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 0x7f32040aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320415c180 0x7f32040ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f320415c560 con 0x7f32040ce230 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32040722f0 con 0x7f320415c180 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f320415c6e0 con 0x7f32040cf5b0 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60916/0 (socket says 172.21.15.134:60916) 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 -- 172.21.15.134:0/50944075 learned_addr learned my addr 172.21.15.134:0/50944075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f3209bc0640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320415c180 0x7f32040ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f3208bbe640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 0x7f32040aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 -- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 msgr2=0x7f32040aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 0x7f32040aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 -- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320415c180 msgr2=0x7f32040ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320415c180 0x7f32040ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 -- 172.21.15.134:0/50944075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320415d880 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f3208bbe640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 0x7f32040aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f32093bf640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f320000d800 tx=0x7f320000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320000b6c0 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3200019070 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320000ba80 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.899+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320415db60 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.900+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320415e120 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.901+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32040cf070 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.901+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f320000bc20 con 0x7f32040ce230 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.901+0000 7f31f9ffb640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 0x7f31e806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:30.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.901+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f320008c470 con 0x7f32040ce230 2024-09-15T22:47:30.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.902+0000 7f3208bbe640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 0x7f31e806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:30.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.902+0000 7f3208bbe640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 0x7f31e806eda0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31f4034000 tx=0x7f31f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:30.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:30.905+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f320005a260 con 0x7f32040ce230 2024-09-15T22:47:31.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.081+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3204158e30 con 0x7f32040ce230 2024-09-15T22:47:31.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.082+0000 7f31f9ffb640 1 -- 172.21.15.134:0/50944075 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v134) ==== 80+0+0 (secure 0 0 0) 0x7f3200059b60 con 0x7f32040ce230 2024-09-15T22:47:31.084 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:47:31.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 msgr2=0x7f31e806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 0x7f31e806eda0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31f4034000 tx=0x7f31f402e000 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 msgr2=0x7f32040aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f320000d800 tx=0x7f320000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 shutdown_connections 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320415c180 0x7f32040ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32040cf5b0 0x7f32040aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f31e806c8e0 0x7f31e806eda0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 --2- 172.21.15.134:0/50944075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32040ce230 0x7f32040aaba0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 >> 172.21.15.134:0/50944075 conn(0x7f3204062cc0 msgr2=0x7f320406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 shutdown_connections 2024-09-15T22:47:31.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.084+0000 7f320b623640 1 -- 172.21.15.134:0/50944075 wait complete. 2024-09-15T22:47:31.097 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:47:31.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:31.098 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:31.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:47:31.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:31.131 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:47:31.189 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:31.190 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:31.190 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:31.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:31.206 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:47:31.207 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:31.207 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:31.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:31.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:31.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.347+0000 7f0b410a6640 1 Processor -- start 2024-09-15T22:47:31.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.347+0000 7f0b410a6640 1 -- start start 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b3c15e940 0x7f0b3c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15ed20 0x7f0b3c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b3c0cef90 0x7f0b3c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3c0d1ae0 con 0x7f0b3c15e940 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3c0b7170 con 0x7f0b3c0cef90 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b410a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c0b7aa0 con 0x7f0b3c15ed20 2024-09-15T22:47:31.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b3c15e940 0x7f0b3c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b3c15e940 0x7f0b3c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60924/0 (socket says 172.21.15.134:60924) 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/1406083018 learned_addr learned my addr 172.21.15.134:0/1406083018 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3b59e640 1 --2- 172.21.15.134:0/1406083018 >> v2:172.21.15.177:3300/0 conn(0x7f0b3c0cef90 0x7f0b3c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b33fff640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15ed20 0x7f0b3c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/1406083018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15ed20 msgr2=0x7f0b3c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15ed20 0x7f0b3c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/1406083018 >> v2:172.21.15.177:3300/0 conn(0x7f0b3c0cef90 msgr2=0x7f0b3c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/1406083018 >> v2:172.21.15.177:3300/0 conn(0x7f0b3c0cef90 0x7f0b3c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.348+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/1406083018 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c0d3660 con 0x7f0b3c15e940 2024-09-15T22:47:31.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.349+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c15e940 0x7f0b3c0d1060 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c073e20 tx=0x7f0b2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4323ed474acf36fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.349+0000 7f0b3a59c640 1 -- 172.21.15.134:0/1406083018 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c037070 con 0x7f0b3c15e940 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.349+0000 7f0b3a59c640 1 -- 172.21.15.134:0/1406083018 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2c032440 con 0x7f0b3c15e940 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.349+0000 7f0b3a59c640 1 -- 172.21.15.134:0/1406083018 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c032810 con 0x7f0b3c15e940 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 -- 172.21.15.134:0/1406083018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c15e940 msgr2=0x7f0b3c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c15e940 0x7f0b3c0d1060 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c073e20 tx=0x7f0b2c02a270 comp rx=0 tx=0).stop 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 -- 172.21.15.134:0/1406083018 shutdown_connections 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 --2- 172.21.15.134:0/1406083018 >> v2:172.21.15.177:3300/0 conn(0x7f0b3c0cef90 0x7f0b3c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15ed20 0x7f0b3c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 --2- 172.21.15.134:0/1406083018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c15e940 0x7f0b3c0d1060 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 -- 172.21.15.134:0/1406083018 >> 172.21.15.134:0/1406083018 conn(0x7f0b3c0b6240 msgr2=0x7f0b3c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 -- 172.21.15.134:0/1406083018 shutdown_connections 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.350+0000 7f0b410a6640 1 -- 172.21.15.134:0/1406083018 wait complete. 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.351+0000 7f0b410a6640 1 Processor -- start 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.351+0000 7f0b410a6640 1 -- start start 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15e940 0x7f0b3c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b3c15ed20 0x7f0b3c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c0d3f00 con 0x7f0b3c0cef90 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c0d3c20 con 0x7f0b3c15ed20 2024-09-15T22:47:31.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b410a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c0d1ef0 con 0x7f0b3c15e940 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60926/0 (socket says 172.21.15.134:60926) 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/2203287128 learned_addr learned my addr 172.21.15.134:0/2203287128 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3b59e640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b3c15ed20 0x7f0b3c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b33fff640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15e940 0x7f0b3c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15e940 msgr2=0x7f0b3c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15e940 0x7f0b3c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b3c15ed20 msgr2=0x7f0b3c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b3c15ed20 0x7f0b3c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 -- 172.21.15.134:0/2203287128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c0b53f0 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b3ad9d640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c02a2b0 tx=0x7f0b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.352+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c041020 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.353+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2c0306c0 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.353+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c1f53b0 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.353+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c037040 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.353+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1f5970 con 0x7f0b3c0cef90 2024-09-15T22:47:31.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.353+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c0d1060 con 0x7f0b3c0cef90 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.354+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f0b2c044020 con 0x7f0b3c0cef90 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.354+0000 7f0b337fe640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 0x7f0b1c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.355+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f0b2c0ac600 con 0x7f0b3c0cef90 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.355+0000 7f0b33fff640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 0x7f0b1c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.355+0000 7f0b33fff640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 0x7f0b1c06eda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0b4670 tx=0x7f0b24008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.359+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b2c04b030 con 0x7f0b3c0cef90 2024-09-15T22:47:31.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.555+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b3c076240 con 0x7f0b3c0cef90 2024-09-15T22:47:31.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.556+0000 7f0b337fe640 1 -- 172.21.15.134:0/2203287128 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f0b2c079e30 con 0x7f0b3c0cef90 2024-09-15T22:47:31.557 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:31.557 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":69,"btime":"2024-09-15T22:47:22:264879+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:31.558 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 69 2024-09-15T22:47:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 msgr2=0x7f0b1c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 0x7f0b1c06eda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0b4670 tx=0x7f0b24008040 comp rx=0 tx=0).stop 2024-09-15T22:47:31.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 msgr2=0x7f0b3c156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c02a2b0 tx=0x7f0b2c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 shutdown_connections 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b3c15ed20 0x7f0b3c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b3c15e940 0x7f0b3c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f0b1c06c8e0 0x7f0b1c06eda0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 --2- 172.21.15.134:0/2203287128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b3c0cef90 0x7f0b3c156bf0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 >> 172.21.15.134:0/2203287128 conn(0x7f0b3c0b6240 msgr2=0x7f0b3c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 shutdown_connections 2024-09-15T22:47:31.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.558+0000 7f0b410a6640 1 -- 172.21.15.134:0/2203287128 wait complete. 2024-09-15T22:47:31.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:31.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 Processor -- start 2024-09-15T22:47:31.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 -- start start 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7fd815e940 0x7f7fd80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd80cef90 0x7f7fd80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd80b7170 con 0x7f7fd815ed20 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd80d1ae0 con 0x7f7fd815e940 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.668+0000 7f7fde427640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80b7aa0 con 0x7f7fd80cef90 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7fd815e940 0x7f7fd80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7fd815ed20 0x7f7fd80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49174/0 (socket says 172.21.15.134:49174) 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd77fe640 1 -- 172.21.15.134:0/2087151322 learned_addr learned my addr 172.21.15.134:0/2087151322 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fdc9c4640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd80cef90 0x7f7fd80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd6ffd640 1 -- 172.21.15.134:0/2087151322 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314987398 0 0) 0x7f7fcc001110 con 0x7f7fd815ed20 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd6ffd640 1 -- 172.21.15.134:0/2087151322 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc0003520 con 0x7f7fd815ed20 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd7fff640 1 -- 172.21.15.134:0/2087151322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd80cef90 msgr2=0x7f7fd80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd7fff640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd80cef90 0x7f7fd80d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd7fff640 1 -- 172.21.15.134:0/2087151322 >> v1:172.21.15.134:6789/0 conn(0x7f7fd815ed20 legacy=0x7f7fd80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.669+0000 7f7fd7fff640 1 -- 172.21.15.134:0/2087151322 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd80d3660 con 0x7f7fd815e940 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fd7fff640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd815e940 0x7f7fd80d1060 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80097a0 tx=0x7f7fc802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcefb340c607e960 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fd6ffd640 1 -- 172.21.15.134:0/2087151322 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8037070 con 0x7f7fd815e940 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fd6ffd640 1 -- 172.21.15.134:0/2087151322 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8032440 con 0x7f7fd815e940 2024-09-15T22:47:31.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fd6ffd640 1 -- 172.21.15.134:0/2087151322 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8032810 con 0x7f7fd815e940 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 -- 172.21.15.134:0/2087151322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd815e940 msgr2=0x7f7fd80d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd815e940 0x7f7fd80d1060 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80097a0 tx=0x7f7fc802a210 comp rx=0 tx=0).stop 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 -- 172.21.15.134:0/2087151322 shutdown_connections 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd80cef90 0x7f7fd80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 --2- 172.21.15.134:0/2087151322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd815e940 0x7f7fd80d1060 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 -- 172.21.15.134:0/2087151322 >> 172.21.15.134:0/2087151322 conn(0x7f7fd80b6240 msgr2=0x7f7fd80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 -- 172.21.15.134:0/2087151322 shutdown_connections 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.670+0000 7f7fde427640 1 -- 172.21.15.134:0/2087151322 wait complete. 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 Processor -- start 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 -- start start 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 0x7f7fd81f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd815ed20 0x7f7fd80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80d3f00 con 0x7f7fd80cef90 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80d3c20 con 0x7f7fd815e940 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.672+0000 7f7fde427640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80d3310 con 0x7f7fd815ed20 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60950/0 (socket says 172.21.15.134:60950) 2024-09-15T22:47:31.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 -- 172.21.15.134:0/3379164993 learned_addr learned my addr 172.21.15.134:0/3379164993 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd77fe640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 0x7f7fd81f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fdc9c4640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd815ed20 0x7f7fd80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 -- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd815ed20 msgr2=0x7f7fd80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd815ed20 0x7f7fd80cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 -- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 msgr2=0x7f7fd81f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 0x7f7fd81f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 -- 172.21.15.134:0/3379164993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd80ce0e0 con 0x7f7fd80cef90 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd77fe640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 0x7f7fd81f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd7fff640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80098c0 tx=0x7f7fc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8041030 con 0x7f7fd80cef90 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc803d4e0 con 0x7f7fd80cef90 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8037040 con 0x7f7fd80cef90 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd81e7d40 con 0x7f7fd80cef90 2024-09-15T22:47:31.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.673+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd81e8300 con 0x7f7fd80cef90 2024-09-15T22:47:31.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.674+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd80d1ef0 con 0x7f7fd80cef90 2024-09-15T22:47:31.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.675+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f7fc8044070 con 0x7f7fd80cef90 2024-09-15T22:47:31.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.675+0000 7f7fd4ff9640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 0x7f7fc406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.675+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f7fc80ac650 con 0x7f7fd80cef90 2024-09-15T22:47:31.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.675+0000 7f7fd77fe640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 0x7f7fc406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.676+0000 7f7fd77fe640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 0x7f7fc406eda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fd815be30 tx=0x7f7fcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.679+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fc807a450 con 0x7f7fd80cef90 2024-09-15T22:47:31.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.876+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fd80ba6b0 con 0x7f7fd80cef90 2024-09-15T22:47:31.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.877+0000 7f7fd4ff9640 1 -- 172.21.15.134:0/3379164993 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f7fc8079d50 con 0x7f7fd80cef90 2024-09-15T22:47:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:31.879 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":69,"btime":"2024-09-15T22:47:22:264879+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:31.879 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 69 2024-09-15T22:47:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 msgr2=0x7f7fc406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 0x7f7fc406eda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fd815be30 tx=0x7f7fcc009040 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 msgr2=0x7f7fd81f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80098c0 tx=0x7f7fc80046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 shutdown_connections 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7fd815ed20 0x7f7fd80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fd815e940 0x7f7fd81f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7fc406c8e0 0x7f7fc406eda0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 --2- 172.21.15.134:0/3379164993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fd80cef90 0x7f7fd81f4950 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 >> 172.21.15.134:0/3379164993 conn(0x7f7fd80b6240 msgr2=0x7f7fd80caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 shutdown_connections 2024-09-15T22:47:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.879+0000 7f7fde427640 1 -- 172.21.15.134:0/3379164993 wait complete. 2024-09-15T22:47:31.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:31.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.989+0000 7f860ed49640 1 Processor -- start 2024-09-15T22:47:31.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.989+0000 7f860ed49640 1 -- start start 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860ed49640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 0x7f8608071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860ed49640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86080b5600 0x7f8608073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860ed49640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8608071880 con 0x7f8608073ff0 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860ed49640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f860806e680 con 0x7f86080b5600 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860ed49640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f860806e8d0 con 0x7f860815e7b0 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86080b5600 0x7f8608073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86080b5600 0x7f8608073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60952/0 (socket says 172.21.15.134:60952) 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 -- 172.21.15.134:0/3463404842 learned_addr learned my addr 172.21.15.134:0/3463404842 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860cae5640 1 --2- 172.21.15.134:0/3463404842 >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 0x7f8608071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:31.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 -- 172.21.15.134:0/3463404842 >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 msgr2=0x7f8608071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 --2- 172.21.15.134:0/3463404842 >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 0x7f8608071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 -- 172.21.15.134:0/3463404842 >> v1:172.21.15.177:6789/0 conn(0x7f8608073ff0 legacy=0x7f860806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f8607fff640 1 -- 172.21.15.134:0/3463404842 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860806ebb0 con 0x7f86080b5600 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.990+0000 7f860cae5640 1 --2- 172.21.15.134:0/3463404842 >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 0x7f8608071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f8607fff640 1 --2- 172.21.15.134:0/3463404842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608073ab0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8608050260 tx=0x7f85f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc34a109f5e437 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f86077fe640 1 -- 172.21.15.134:0/3463404842 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4037070 con 0x7f86080b5600 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f86077fe640 1 -- 172.21.15.134:0/3463404842 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f4032440 con 0x7f86080b5600 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f86077fe640 1 -- 172.21.15.134:0/3463404842 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4032810 con 0x7f86080b5600 2024-09-15T22:47:31.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 -- 172.21.15.134:0/3463404842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 msgr2=0x7f8608073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 --2- 172.21.15.134:0/3463404842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608073ab0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8608050260 tx=0x7f85f402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 -- 172.21.15.134:0/3463404842 shutdown_connections 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 --2- 172.21.15.134:0/3463404842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608073ab0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 --2- 172.21.15.134:0/3463404842 >> v2:172.21.15.177:3300/0 conn(0x7f860815e7b0 0x7f8608071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 -- 172.21.15.134:0/3463404842 >> 172.21.15.134:0/3463404842 conn(0x7f86080b4300 msgr2=0x7f86080b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 -- 172.21.15.134:0/3463404842 shutdown_connections 2024-09-15T22:47:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.991+0000 7f860ed49640 1 -- 172.21.15.134:0/3463404842 wait complete. 2024-09-15T22:47:32.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 Processor -- start 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 -- start start 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860815e7b0 0x7f86081613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f860815f030 0x7f8608156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f860806d3c0 con 0x7f86080b5600 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8608073590 con 0x7f860815e7b0 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.993+0000 7f860ed49640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f860806d540 con 0x7f860815f030 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60966/0 (socket says 172.21.15.134:60966) 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 -- 172.21.15.134:0/2619048731 learned_addr learned my addr 172.21.15.134:0/2619048731 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f8607fff640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860815e7b0 0x7f86081613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860d2e6640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f860815f030 0x7f8608156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 -- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f860815f030 msgr2=0x7f8608156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f860815f030 0x7f8608156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 -- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860815e7b0 msgr2=0x7f86081613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860815e7b0 0x7f86081613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 -- 172.21.15.134:0/2619048731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8608157b00 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860cae5640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00e7e0 tx=0x7f85fc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00f040 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc004030 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8608157de0 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc004400 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.994+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8608155590 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.995+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608073ab0 con 0x7f86080b5600 2024-09-15T22:47:32.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.996+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f85fc00c6d0 con 0x7f86080b5600 2024-09-15T22:47:32.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.996+0000 7f86057fa640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 0x7f85ec06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.996+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f85fc08bde0 con 0x7f86080b5600 2024-09-15T22:47:32.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.996+0000 7f8607fff640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 0x7f85ec06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:31.997+0000 7f8607fff640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 0x7f85ec06eda0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85f4034000 tx=0x7f85f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.000+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85fc017020 con 0x7f86080b5600 2024-09-15T22:47:32.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.169+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86080b1a90 con 0x7f86080b5600 2024-09-15T22:47:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.170+0000 7f86057fa640 1 -- 172.21.15.134:0/2619048731 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16864 (secure 0 0 0) 0x7f85fc059500 con 0x7f86080b5600 2024-09-15T22:47:32.171 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:32.171 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":134,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:15.059547+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:12.010666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:12.376443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:32.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 msgr2=0x7f85ec06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 0x7f85ec06eda0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85f4034000 tx=0x7f85f402e000 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 msgr2=0x7f8608155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00e7e0 tx=0x7f85fc00eca0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 shutdown_connections 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f860815f030 0x7f8608156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860815e7b0 0x7f86081613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f85ec06c8e0 0x7f85ec06eda0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 --2- 172.21.15.134:0/2619048731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86080b5600 0x7f8608155050 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 >> 172.21.15.134:0/2619048731 conn(0x7f86080b4300 msgr2=0x7f860806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 shutdown_connections 2024-09-15T22:47:32.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.172+0000 7f860ed49640 1 -- 172.21.15.134:0/2619048731 wait complete. 2024-09-15T22:47:32.185 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:47:32.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:32.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.282+0000 7f63f21ed640 1 Processor -- start 2024-09-15T22:47:32.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.282+0000 7f63f21ed640 1 -- start start 2024-09-15T22:47:32.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63ec15c5e0 0x7f63ec0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63ec0b6d50 0x7f63ec0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec1600e0 0x7f63ec160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec074100 con 0x7f63ec15c5e0 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec0b76d0 con 0x7f63ec0b6d50 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63f21ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec15c9c0 con 0x7f63ec1600e0 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63ec15c5e0 0x7f63ec0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63ec15c5e0 0x7f63ec0712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60970/0 (socket says 172.21.15.134:60970) 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 -- 172.21.15.134:0/636082442 learned_addr learned my addr 172.21.15.134:0/636082442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 -- 172.21.15.134:0/636082442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec1600e0 msgr2=0x7f63ec160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/636082442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec1600e0 0x7f63ec160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 -- 172.21.15.134:0/636082442 >> v2:172.21.15.177:3300/0 conn(0x7f63ec0b6d50 msgr2=0x7f63ec0b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/636082442 >> v2:172.21.15.177:3300/0 conn(0x7f63ec0b6d50 0x7f63ec0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.283+0000 7f63eb7fe640 1 -- 172.21.15.134:0/636082442 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec0b1dd0 con 0x7f63ec15c5e0 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/636082442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec0712b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cf9c0 tx=0x7f63dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a98d08fe31129e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63eaffd640 1 -- 172.21.15.134:0/636082442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc037070 con 0x7f63ec15c5e0 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63eaffd640 1 -- 172.21.15.134:0/636082442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc032440 con 0x7f63ec15c5e0 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63eaffd640 1 -- 172.21.15.134:0/636082442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc032810 con 0x7f63ec15c5e0 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 -- 172.21.15.134:0/636082442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 msgr2=0x7f63ec0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 --2- 172.21.15.134:0/636082442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec0712b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cf9c0 tx=0x7f63dc02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 -- 172.21.15.134:0/636082442 shutdown_connections 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 --2- 172.21.15.134:0/636082442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec1600e0 0x7f63ec160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 --2- 172.21.15.134:0/636082442 >> v2:172.21.15.177:3300/0 conn(0x7f63ec0b6d50 0x7f63ec0b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 --2- 172.21.15.134:0/636082442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec0712b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 -- 172.21.15.134:0/636082442 >> 172.21.15.134:0/636082442 conn(0x7f63ec0b4220 msgr2=0x7f63ec0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 -- 172.21.15.134:0/636082442 shutdown_connections 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.284+0000 7f63f21ed640 1 -- 172.21.15.134:0/636082442 wait complete. 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 Processor -- start 2024-09-15T22:47:32.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 -- start start 2024-09-15T22:47:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec0b6d50 0x7f63ec1ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63ec1600e0 0x7f63ec06e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec073ab0 con 0x7f63ec15c5e0 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0737d0 con 0x7f63ec1600e0 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63f21ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec073d90 con 0x7f63ec0b6d50 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.286+0000 7f63e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60982/0 (socket says 172.21.15.134:60982) 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 -- 172.21.15.134:0/2043414501 learned_addr learned my addr 172.21.15.134:0/2043414501 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63ebfff640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63ec1600e0 0x7f63ec06e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec0b6d50 0x7f63ec1ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 -- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec0b6d50 msgr2=0x7f63ec1ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec0b6d50 0x7f63ec1ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 -- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63ec1600e0 msgr2=0x7f63ec06e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63ec1600e0 0x7f63ec06e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 -- 172.21.15.134:0/2043414501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec1f57f0 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e3fff640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f63d400b440 tx=0x7f63d400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4015020 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4011890 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec06e710 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4011c80 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.287+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec06d410 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.288+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec073130 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.289+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f63d4018020 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.289+0000 7f63e8ff9640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 0x7f63cc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.289+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f63d408bf20 con 0x7f63ec15c5e0 2024-09-15T22:47:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.289+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 0x7f63cc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.290+0000 7f63eb7fe640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 0x7f63cc06eda0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f63dc034000 tx=0x7f63dc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.293+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63d401f020 con 0x7f63ec15c5e0 2024-09-15T22:47:32.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.492+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63ec15be00 con 0x7f63ec15c5e0 2024-09-15T22:47:32.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.493+0000 7f63e8ff9640 1 -- 172.21.15.134:0/2043414501 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f63d408d090 con 0x7f63ec15c5e0 2024-09-15T22:47:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:32.494 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":69,"btime":"2024-09-15T22:47:22:264879+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:32.494 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 69 2024-09-15T22:47:32.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 msgr2=0x7f63cc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 0x7f63cc06eda0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f63dc034000 tx=0x7f63dc02e000 comp rx=0 tx=0).stop 2024-09-15T22:47:32.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 msgr2=0x7f63ec1f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f63d400b440 tx=0x7f63d400b900 comp rx=0 tx=0).stop 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 shutdown_connections 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63ec1600e0 0x7f63ec06e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f63cc06c8e0 0x7f63cc06eda0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ec15c5e0 0x7f63ec1f52b0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 --2- 172.21.15.134:0/2043414501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63ec0b6d50 0x7f63ec1ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 >> 172.21.15.134:0/2043414501 conn(0x7f63ec0b4220 msgr2=0x7f63ec0d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 shutdown_connections 2024-09-15T22:47:32.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.495+0000 7f63f21ed640 1 -- 172.21.15.134:0/2043414501 wait complete. 2024-09-15T22:47:32.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:32.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.604+0000 7f19acaa6640 1 Processor -- start 2024-09-15T22:47:32.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.604+0000 7f19acaa6640 1 -- start start 2024-09-15T22:47:32.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.605+0000 7f19acaa6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19a815ed20 0x7f19a80b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.605+0000 7f19acaa6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19a80cef90 0x7f19a80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.605+0000 7f19acaa6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a80b7170 con 0x7f19a815e940 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.605+0000 7f19acaa6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f19a80b7aa0 con 0x7f19a815ed20 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.605+0000 7f19acaa6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f19a80d3660 con 0x7f19a80cef90 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19a815ed20 0x7f19a80b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19a815ed20 0x7f19a80b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60992/0 (socket says 172.21.15.134:60992) 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 -- 172.21.15.134:0/1974145033 learned_addr learned my addr 172.21.15.134:0/1974145033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a6d9d640 1 --2- 172.21.15.134:0/1974145033 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cef90 0x7f19a80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 -- 172.21.15.134:0/1974145033 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cef90 msgr2=0x7f19a80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 --2- 172.21.15.134:0/1974145033 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cef90 0x7f19a80b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 -- 172.21.15.134:0/1974145033 >> v1:172.21.15.177:6789/0 conn(0x7f19a815e940 legacy=0x7f19a80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:32.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.606+0000 7f19a5d9b640 1 -- 172.21.15.134:0/1974145033 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a80d3940 con 0x7f19a815ed20 2024-09-15T22:47:32.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19a5d9b640 1 --2- 172.21.15.134:0/1974145033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b3220 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f19a806d070 tx=0x7f199802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e78bbfa973c50f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19a559a640 1 -- 172.21.15.134:0/1974145033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998037070 con 0x7f19a815ed20 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19a559a640 1 -- 172.21.15.134:0/1974145033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1998032440 con 0x7f19a815ed20 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19a559a640 1 -- 172.21.15.134:0/1974145033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998032810 con 0x7f19a815ed20 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 -- 172.21.15.134:0/1974145033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 msgr2=0x7f19a80b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 --2- 172.21.15.134:0/1974145033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b3220 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f19a806d070 tx=0x7f199802a2c0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 -- 172.21.15.134:0/1974145033 shutdown_connections 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 --2- 172.21.15.134:0/1974145033 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cef90 0x7f19a80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 --2- 172.21.15.134:0/1974145033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b3220 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 -- 172.21.15.134:0/1974145033 >> 172.21.15.134:0/1974145033 conn(0x7f19a80b6240 msgr2=0x7f19a80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 -- 172.21.15.134:0/1974145033 shutdown_connections 2024-09-15T22:47:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.607+0000 7f19acaa6640 1 -- 172.21.15.134:0/1974145033 wait complete. 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.609+0000 7f19acaa6640 1 Processor -- start 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.609+0000 7f19acaa6640 1 -- start start 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.609+0000 7f19acaa6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a80cef90 0x7f19a814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a815e940 0x7f19a80b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19a80d3310 con 0x7f19a815ed20 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19a80d3f00 con 0x7f19a80cef90 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19a80d1ef0 con 0x7f19a815e940 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60994/0 (socket says 172.21.15.134:60994) 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 -- 172.21.15.134:0/2498889895 learned_addr learned my addr 172.21.15.134:0/2498889895 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a659c640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a80cef90 0x7f19a814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a5d9b640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a815e940 0x7f19a80b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 -- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a815e940 msgr2=0x7f19a80b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a815e940 0x7f19a80b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 -- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a80cef90 msgr2=0x7f19a814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a80cef90 0x7f19a814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 -- 172.21.15.134:0/2498889895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a814ec40 con 0x7f19a815ed20 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19a6d9d640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f19a0007e40 tx=0x7f19a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0014620 con 0x7f19a815ed20 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a0019070 con 0x7f19a815ed20 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a80cdc20 con 0x7f19a815ed20 2024-09-15T22:47:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0014a20 con 0x7f19a815ed20 2024-09-15T22:47:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.610+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a814c490 con 0x7f19a815ed20 2024-09-15T22:47:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.611+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a80d1060 con 0x7f19a815ed20 2024-09-15T22:47:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.612+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f19a0014bc0 con 0x7f19a815ed20 2024-09-15T22:47:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.612+0000 7f199effd640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 0x7f198806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.612+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f19a008c6e0 con 0x7f19a815ed20 2024-09-15T22:47:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.612+0000 7f19a659c640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 0x7f198806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.613+0000 7f19a659c640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 0x7f198806eda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1990004f60 tx=0x7f1990007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.616+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19a0059f10 con 0x7f19a815ed20 2024-09-15T22:47:32.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.816+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19a80ba010 con 0x7f19a815ed20 2024-09-15T22:47:32.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.816+0000 7f199effd640 1 -- 172.21.15.134:0/2498889895 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f19a005e210 con 0x7f19a815ed20 2024-09-15T22:47:32.818 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:32.818 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":69,"btime":"2024-09-15T22:47:22:264879+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:13.404117+0000","modified":"2024-09-15T22:47:15.403079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/4139080869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":4139080869},{"type":"v1","addr":"172.21.15.134:6835","nonce":4139080869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7776,"qdb_cluster":[7776]},"id":10}]} 2024-09-15T22:47:32.818 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 69 2024-09-15T22:47:32.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 msgr2=0x7f198806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 0x7f198806eda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1990004f60 tx=0x7f1990007e30 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 msgr2=0x7f19a80b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f19a0007e40 tx=0x7f19a000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 shutdown_connections 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f198806c8e0 0x7f198806eda0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19a815ed20 0x7f19a80b4650 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a815e940 0x7f19a80b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 --2- 172.21.15.134:0/2498889895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a80cef90 0x7f19a814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 >> 172.21.15.134:0/2498889895 conn(0x7f19a80b6240 msgr2=0x7f19a80b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 shutdown_connections 2024-09-15T22:47:32.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.818+0000 7f19acaa6640 1 -- 172.21.15.134:0/2498889895 wait complete. 2024-09-15T22:47:32.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:32.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.927+0000 7f6ff02b7640 1 Processor -- start 2024-09-15T22:47:32.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.927+0000 7f6ff02b7640 1 -- start start 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6ff02b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fe815e500 0x7f6fe80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6ff02b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe81630c0 con 0x7f6fe815e8e0 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6ff02b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe8074200 con 0x7f6fe8073cb0 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6ff02b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe80b6e80 con 0x7f6fe815e500 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6fee053640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fe815e500 0x7f6fe80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6fee053640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fe815e500 0x7f6fe80b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32776/0 (socket says 172.21.15.134:32776) 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6fed852640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6fe815e8e0 0x7f6fe81622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49178/0 (socket says 172.21.15.134:49178) 2024-09-15T22:47:32.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.928+0000 7f6fee053640 1 -- 172.21.15.134:0/1238242756 learned_addr learned my addr 172.21.15.134:0/1238242756 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fee053640 1 -- 172.21.15.134:0/1238242756 >> v1:172.21.15.177:6789/0 conn(0x7f6fe8073cb0 legacy=0x7f6fe81629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:32.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fee053640 1 -- 172.21.15.134:0/1238242756 >> v1:172.21.15.134:6789/0 conn(0x7f6fe815e8e0 legacy=0x7f6fe81622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fee053640 1 -- 172.21.15.134:0/1238242756 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe80b7160 con 0x7f6fe815e500 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fee053640 1 --2- 172.21.15.134:0/1238242756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe815e500 0x7f6fe80b4460 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40098a0 tx=0x7f6fe402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a892171d7cb5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fed051640 1 -- 172.21.15.134:0/1238242756 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4037070 con 0x7f6fe815e500 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fed051640 1 -- 172.21.15.134:0/1238242756 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4032440 con 0x7f6fe815e500 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.929+0000 7f6fed051640 1 -- 172.21.15.134:0/1238242756 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4032810 con 0x7f6fe815e500 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 -- 172.21.15.134:0/1238242756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe815e500 msgr2=0x7f6fe80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/1238242756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe815e500 0x7f6fe80b4460 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40098a0 tx=0x7f6fe402a250 comp rx=0 tx=0).stop 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 -- 172.21.15.134:0/1238242756 shutdown_connections 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/1238242756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe815e500 0x7f6fe80b4460 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 -- 172.21.15.134:0/1238242756 >> 172.21.15.134:0/1238242756 conn(0x7f6fe8062810 msgr2=0x7f6fe8062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 -- 172.21.15.134:0/1238242756 shutdown_connections 2024-09-15T22:47:32.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.930+0000 7f6ff02b7640 1 -- 172.21.15.134:0/1238242756 wait complete. 2024-09-15T22:47:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.931+0000 7f6ff02b7640 1 Processor -- start 2024-09-15T22:47:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.931+0000 7f6ff02b7640 1 -- start start 2024-09-15T22:47:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 0x7f6fe814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe815e8e0 0x7f6fe8162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80735f0 con 0x7f6fe8073cb0 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8073470 con 0x7f6fe815e500 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6ff02b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe806ccb0 con 0x7f6fe815e8e0 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32784/0 (socket says 172.21.15.134:32784) 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 -- 172.21.15.134:0/2821382610 learned_addr learned my addr 172.21.15.134:0/2821382610 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fed852640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 0x7f6fe814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee854640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe815e8e0 0x7f6fe8162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 -- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe815e8e0 msgr2=0x7f6fe8162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe815e8e0 0x7f6fe8162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 -- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 msgr2=0x7f6fe814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 0x7f6fe814d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 -- 172.21.15.134:0/2821382610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe81500d0 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fed852640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 0x7f6fe814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.932+0000 7f6fee053640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.933+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4037040 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.933+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4004250 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.933+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe403c670 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.933+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe81503b0 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.933+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe81f8c80 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.934+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe80d1cf0 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.934+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f6fe403a070 con 0x7f6fe8073cb0 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.935+0000 7f6fdeffd640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 0x7f6fcc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.935+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f6fe40ac6c0 con 0x7f6fe8073cb0 2024-09-15T22:47:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.935+0000 7f6fed852640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 0x7f6fcc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.935+0000 7f6fed852640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 0x7f6fcc06eda0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8007fd0 tx=0x7f6fd8007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:32.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:32.939+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fe4041020 con 0x7f6fe8073cb0 2024-09-15T22:47:33.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.106+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fe8069160 con 0x7f6fe8073cb0 2024-09-15T22:47:33.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.107+0000 7f6fdeffd640 1 -- 172.21.15.134:0/2821382610 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16864 (secure 0 0 0) 0x7f6fe407a640 con 0x7f6fe8073cb0 2024-09-15T22:47:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:33.109 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":134,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:15.059547+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:12.010666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:12.376443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:33.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 msgr2=0x7f6fcc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 0x7f6fcc06eda0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8007fd0 tx=0x7f6fd8007d60 comp rx=0 tx=0).stop 2024-09-15T22:47:33.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 msgr2=0x7f6fe81f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe40046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 shutdown_connections 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe815e8e0 0x7f6fe8162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe815e500 0x7f6fe814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6fcc06c8e0 0x7f6fcc06eda0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 --2- 172.21.15.134:0/2821382610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fe8073cb0 0x7f6fe81f8740 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 >> 172.21.15.134:0/2821382610 conn(0x7f6fe8062810 msgr2=0x7f6fe80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 shutdown_connections 2024-09-15T22:47:33.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.110+0000 7f6ff02b7640 1 -- 172.21.15.134:0/2821382610 wait complete. 2024-09-15T22:47:33.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:47:33.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.221+0000 7f6ba4d52640 1 Processor -- start 2024-09-15T22:47:33.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.221+0000 7f6ba4d52640 1 -- start start 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6ba4d52640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ba015c180 0x7f6ba00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6ba4d52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ba0073120 0x7f6ba0073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6ba4d52640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba00ce740 con 0x7f6ba00ce230 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6ba4d52640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba0072640 con 0x7f6ba0073120 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6ba4d52640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba0072920 con 0x7f6ba015c180 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ba0073120 0x7f6ba0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ba0073120 0x7f6ba0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32790/0 (socket says 172.21.15.134:32790) 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 -- 172.21.15.134:0/333944033 learned_addr learned my addr 172.21.15.134:0/333944033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9e59c640 1 --2- 172.21.15.134:0/333944033 >> v2:172.21.15.177:3300/0 conn(0x7f6ba015c180 0x7f6ba00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 -- 172.21.15.134:0/333944033 >> v2:172.21.15.177:3300/0 conn(0x7f6ba015c180 msgr2=0x7f6ba00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 --2- 172.21.15.134:0/333944033 >> v2:172.21.15.177:3300/0 conn(0x7f6ba015c180 0x7f6ba00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 -- 172.21.15.134:0/333944033 >> v1:172.21.15.177:6789/0 conn(0x7f6ba00ce230 legacy=0x7f6ba00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.222+0000 7f6b9ed9d640 1 -- 172.21.15.134:0/333944033 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba0072c00 con 0x7f6ba0073120 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.223+0000 7f6b9ed9d640 1 --2- 172.21.15.134:0/333944033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba0073120 0x7f6ba0073570 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6ba006cc10 tx=0x7f6b9802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad881d83d075d359 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.223+0000 7f6b9dd9b640 1 -- 172.21.15.134:0/333944033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98036070 con 0x7f6ba0073120 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.223+0000 7f6b9dd9b640 1 -- 172.21.15.134:0/333944033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b98031600 con 0x7f6ba0073120 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.223+0000 7f6b9dd9b640 1 -- 172.21.15.134:0/333944033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980319d0 con 0x7f6ba0073120 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 -- 172.21.15.134:0/333944033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba0073120 msgr2=0x7f6ba0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/333944033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba0073120 0x7f6ba0073570 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6ba006cc10 tx=0x7f6b9802a660 comp rx=0 tx=0).stop 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 -- 172.21.15.134:0/333944033 shutdown_connections 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/333944033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba0073120 0x7f6ba0073570 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/333944033 >> v2:172.21.15.177:3300/0 conn(0x7f6ba015c180 0x7f6ba00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 -- 172.21.15.134:0/333944033 >> 172.21.15.134:0/333944033 conn(0x7f6ba0062cc0 msgr2=0x7f6ba006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 -- 172.21.15.134:0/333944033 shutdown_connections 2024-09-15T22:47:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.224+0000 7f6ba4d52640 1 -- 172.21.15.134:0/333944033 wait complete. 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.225+0000 7f6ba4d52640 1 Processor -- start 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.225+0000 7f6ba4d52640 1 -- start start 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ba0073120 0x7f6ba015f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba015c180 0x7f6ba015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00cf780 con 0x7f6ba00ce230 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00722f0 con 0x7f6ba015c180 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6ba4d52640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba015c560 con 0x7f6ba0073120 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6b95d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6b95d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32800/0 (socket says 172.21.15.134:32800) 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6b95d9b640 1 -- 172.21.15.134:0/3972041400 learned_addr learned my addr 172.21.15.134:0/3972041400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6b9e59c640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ba0073120 0x7f6ba015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.226+0000 7f6b9ed9d640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba015c180 0x7f6ba015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 -- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ba0073120 msgr2=0x7f6ba015f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ba0073120 0x7f6ba015f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 -- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba015c180 msgr2=0x7f6ba015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba015c180 0x7f6ba015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 -- 172.21.15.134:0/3972041400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba01f36b0 con 0x7f6ba00ce230 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b95d9b640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800b3f0 tx=0x7f6b8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88015020 con 0x7f6ba00ce230 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88011830 con 0x7f6ba00ce230 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01f3990 con 0x7f6ba00ce230 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88011c20 con 0x7f6ba00ce230 2024-09-15T22:47:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.227+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba01f3f50 con 0x7f6ba00ce230 2024-09-15T22:47:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.228+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba00cdcf0 con 0x7f6ba00ce230 2024-09-15T22:47:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.229+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f6b88018020 con 0x7f6ba00ce230 2024-09-15T22:47:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.229+0000 7f6b977fe640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 0x7f6b8006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.229+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5765+0+0 (secure 0 0 0) 0x7f6b8808ba70 con 0x7f6ba00ce230 2024-09-15T22:47:33.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.229+0000 7f6b9e59c640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 0x7f6b8006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.230+0000 7f6b9e59c640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 0x7f6b8006eda0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.233+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b8801f030 con 0x7f6ba00ce230 2024-09-15T22:47:33.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.434+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ba0158cf0 con 0x7f6ba00ce230 2024-09-15T22:47:33.436 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:47:33.435+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:47:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.436+0000 7f6b977fe640 1 -- 172.21.15.134:0/3972041400 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f6b880592a0 con 0x7f6ba00ce230 2024-09-15T22:47:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 msgr2=0x7f6b8006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 0x7f6b8006eda0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 msgr2=0x7f6ba014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800b3f0 tx=0x7f6b8800b8b0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 shutdown_connections 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba015c180 0x7f6ba015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8006c8e0 0x7f6b8006eda0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba00ce230 0x7f6ba014d6e0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 --2- 172.21.15.134:0/3972041400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ba0073120 0x7f6ba015f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 >> 172.21.15.134:0/3972041400 conn(0x7f6ba0062cc0 msgr2=0x7f6ba00cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 shutdown_connections 2024-09-15T22:47:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.439+0000 7f6ba4d52640 1 -- 172.21.15.134:0/3972041400 wait complete. 2024-09-15T22:47:33.442 INFO:tasks.ceph.mds.c.smithi134.stderr: -2715> 2024-09-15T22:47:15.336+0000 7fcbf8f79640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:47:33.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:47:33.470 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:47:33.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.551+0000 7fd6eef7f640 1 Processor -- start 2024-09-15T22:47:33.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.551+0000 7fd6eef7f640 1 -- start start 2024-09-15T22:47:33.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6eef7f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6e806f130 0x7fd6e80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6eef7f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e815c820 con 0x7fd6e8158e50 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6eef7f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e80b43f0 con 0x7fd6e815c370 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6eef7f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e80b3630 con 0x7fd6e806f130 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6ecd1b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd6e8158e50 0x7fd6e806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49194/0 (socket says 172.21.15.134:49194) 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.552+0000 7fd6ecd1b640 1 -- 172.21.15.134:0/1253985535 learned_addr learned my addr 172.21.15.134:0/1253985535 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154979377 0 0) 0x7fd6d8001110 con 0x7fd6e8158e50 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6d0003520 con 0x7fd6e8158e50 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e7fff640 1 --2- 172.21.15.134:0/1253985535 >> v2:172.21.15.177:3300/0 conn(0x7fd6e806f130 0x7fd6e80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2428371151 0 0) 0x7fd6d0003520 con 0x7fd6e8158e50 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 >> v2:172.21.15.177:3300/0 conn(0x7fd6e806f130 msgr2=0x7fd6e80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 --2- 172.21.15.134:0/1253985535 >> v2:172.21.15.177:3300/0 conn(0x7fd6e806f130 0x7fd6e80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 >> v1:172.21.15.177:6789/0 conn(0x7fd6e815c370 legacy=0x7fd6e80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80b3910 con 0x7fd6e8158e50 2024-09-15T22:47:33.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd6d8001840 con 0x7fd6e8158e50 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 >> v1:172.21.15.134:6789/0 conn(0x7fd6e8158e50 legacy=0x7fd6e806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6d00039b0 0x7fd6d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0004800 0x7fd6d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 0x7fd6d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e80b3630 con 0x7fd6d00052e0 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000c1b0 con 0x7fd6d0004800 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d000c3b0 con 0x7fd6d00039b0 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 0x7fd6d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ecd1b640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6d00039b0 0x7fd6d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6e7fff640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0004800 0x7fd6d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6d00039b0 msgr2=0x7fd6d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6d00039b0 0x7fd6d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0004800 msgr2=0x7fd6d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0004800 0x7fd6d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.553+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1253985535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d0003520 con 0x7fd6d00052e0 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.554+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1253985535 reap_dead start 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.554+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 0x7fd6d000b9c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0001e20 tx=0x7fd6d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d944ab4cf198d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.554+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0001a70 con 0x7fd6d00052e0 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.554+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e002ae40 con 0x7fd6d00052e0 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.554+0000 7fd6e77fe640 1 -- 172.21.15.134:0/1253985535 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0003b90 con 0x7fd6d00052e0 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 msgr2=0x7fd6d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 0x7fd6d000b9c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0001e20 tx=0x7fd6d0005830 comp rx=0 tx=0).stop 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1253985535 shutdown_connections 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1253985535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6d00052e0 0x7fd6d000b9c0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1253985535 >> 172.21.15.134:0/1253985535 conn(0x7fd6e806bba0 msgr2=0x7fd6e806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:33.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1253985535 shutdown_connections 2024-09-15T22:47:33.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.555+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1253985535 wait complete. 2024-09-15T22:47:33.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.556+0000 7fd6eef7f640 1 Processor -- start 2024-09-15T22:47:33.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.556+0000 7fd6eef7f640 1 -- start start 2024-09-15T22:47:33.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 0x7fd6e8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6e8152530 0x7fd6e8155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e8159230 con 0x7fd6e8155c80 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e80b3ed0 con 0x7fd6d00052e0 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e80b5050 con 0x7fd6e8152530 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32834/0 (socket says 172.21.15.134:32834) 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1338121993 learned_addr learned my addr 172.21.15.134:0/1338121993 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ecd1b640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 0x7fd6e8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6e7fff640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6e8152530 0x7fd6e8155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6e8152530 msgr2=0x7fd6e8155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6e8152530 0x7fd6e8155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 msgr2=0x7fd6e8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:33.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 0x7fd6e8152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 -- 172.21.15.134:0/1338121993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e8155240 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ecd1b640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 0x7fd6e8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6ed51c640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd6e002a8f0 tx=0x7fd6e00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0007db0 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e002ac40 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e814fd20 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.557+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0005830 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.558+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e8145a60 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.558+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e8155410 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.559+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fd6e0032440 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.559+0000 7fd6e57fa640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 0x7fd6d406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.559+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5851+0+0 (secure 0 0 0) 0x7fd6e00ab660 con 0x7fd6e8155c80 2024-09-15T22:47:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.560+0000 7fd6ecd1b640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 0x7fd6d406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:33.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.560+0000 7fd6ecd1b640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 0x7fd6d406eda0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80012b0 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:33.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.564+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6e0043060 con 0x7fd6e8155c80 2024-09-15T22:47:33.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:33.766+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd6e80b5380 con 0x7fd6e8155c80 2024-09-15T22:47:34.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.438+0000 7fd6e57fa640 1 -- 172.21.15.134:0/1338121993 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7fd6e0079590 con 0x7fd6e8155c80 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 msgr2=0x7fd6d406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 0x7fd6d406eda0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80012b0 tx=0x7fd6d8009040 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 msgr2=0x7fd6e815da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd6e002a8f0 tx=0x7fd6e00014a0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 shutdown_connections 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd6d406c8e0 0x7fd6d406eda0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6e8155c80 0x7fd6e815da50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6e8152530 0x7fd6e8155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 --2- 172.21.15.134:0/1338121993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d00052e0 0x7fd6e8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.440+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 >> 172.21.15.134:0/1338121993 conn(0x7fd6e806bba0 msgr2=0x7fd6e806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:34.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.441+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 shutdown_connections 2024-09-15T22:47:34.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.441+0000 7fd6eef7f640 1 -- 172.21.15.134:0/1338121993 wait complete. 2024-09-15T22:47:34.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.599+0000 7efedf84c640 1 Processor -- start 2024-09-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.599+0000 7efedf84c640 1 -- start start 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.599+0000 7efedf84c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efed8146100 0x7efed806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedf84c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed806e830 con 0x7efed806c0e0 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedf84c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed806eb10 con 0x7efed8072b30 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedf84c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efed806c520 con 0x7efed8146100 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedd5e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efed8146100 0x7efed806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedcde7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7efed806c0e0 0x7efed8072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49200/0 (socket says 172.21.15.134:49200) 2024-09-15T22:47:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedcde7640 1 -- 172.21.15.134:0/2126050549 learned_addr learned my addr 172.21.15.134:0/2126050549 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedd5e8640 1 -- 172.21.15.134:0/2126050549 >> v1:172.21.15.177:6789/0 conn(0x7efed8072b30 legacy=0x7efed815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedd5e8640 1 -- 172.21.15.134:0/2126050549 >> v1:172.21.15.134:6789/0 conn(0x7efed806c0e0 legacy=0x7efed8072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efedd5e8640 1 -- 172.21.15.134:0/2126050549 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed806edf0 con 0x7efed8146100 2024-09-15T22:47:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.600+0000 7efecffff640 1 -- 172.21.15.134:0/2126050549 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622226532 0 0) 0x7efed806e830 con 0x7efed806c0e0 2024-09-15T22:47:34.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedd5e8640 1 --2- 172.21.15.134:0/2126050549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8146100 0x7efed806bba0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7efed40097a0 tx=0x7efed402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1639d56604ebfef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:34.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efecffff640 1 -- 172.21.15.134:0/2126050549 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4037070 con 0x7efed8146100 2024-09-15T22:47:34.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efecffff640 1 -- 172.21.15.134:0/2126050549 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed4032440 con 0x7efed8146100 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efecffff640 1 -- 172.21.15.134:0/2126050549 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4032810 con 0x7efed8146100 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedf84c640 1 -- 172.21.15.134:0/2126050549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8146100 msgr2=0x7efed806bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedf84c640 1 --2- 172.21.15.134:0/2126050549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8146100 0x7efed806bba0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7efed40097a0 tx=0x7efed402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedf84c640 1 -- 172.21.15.134:0/2126050549 shutdown_connections 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedf84c640 1 --2- 172.21.15.134:0/2126050549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8146100 0x7efed806bba0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.601+0000 7efedf84c640 1 -- 172.21.15.134:0/2126050549 >> 172.21.15.134:0/2126050549 conn(0x7efed8062810 msgr2=0x7efed806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.602+0000 7efedf84c640 1 -- 172.21.15.134:0/2126050549 shutdown_connections 2024-09-15T22:47:34.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.602+0000 7efedf84c640 1 -- 172.21.15.134:0/2126050549 wait complete. 2024-09-15T22:47:34.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 Processor -- start 2024-09-15T22:47:34.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 -- start start 2024-09-15T22:47:34.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efed806c0e0 0x7efed8142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:34.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efed8146100 0x7efed80b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efed815d430 con 0x7efed8072b30 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efed815d2b0 con 0x7efed8146100 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.603+0000 7efedf84c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efed815d5b0 con 0x7efed806c0e0 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32850/0 (socket says 172.21.15.134:32850) 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 -- 172.21.15.134:0/1698305281 learned_addr learned my addr 172.21.15.134:0/1698305281 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedd5e8640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efed806c0e0 0x7efed8142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efeddde9640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efed8146100 0x7efed80b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 -- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efed806c0e0 msgr2=0x7efed8142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efed806c0e0 0x7efed8142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 -- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efed8146100 msgr2=0x7efed80b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efed8146100 0x7efed80b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 -- 172.21.15.134:0/1698305281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed80af740 con 0x7efed8072b30 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedcde7640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7efec800c4a0 tx=0x7efec800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8018070 con 0x7efed8072b30 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec80074e0 con 0x7efed8072b30 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed81416c0 con 0x7efed8072b30 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8004a20 con 0x7efed8072b30 2024-09-15T22:47:34.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.604+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed8141960 con 0x7efed8072b30 2024-09-15T22:47:34.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.605+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed815d910 con 0x7efed8072b30 2024-09-15T22:47:34.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.606+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7efec801b070 con 0x7efed8072b30 2024-09-15T22:47:34.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.606+0000 7efecdffb640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 0x7efebc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:34.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.606+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5851+0+0 (secure 0 0 0) 0x7efec808b330 con 0x7efed8072b30 2024-09-15T22:47:34.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.606+0000 7efedd5e8640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 0x7efebc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:34.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.607+0000 7efedd5e8640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 0x7efebc06eda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efed4034000 tx=0x7efed402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:34.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.611+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efec80590d0 con 0x7efed8072b30 2024-09-15T22:47:34.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:34.776+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efed8160ac0 con 0x7efed8072b30 2024-09-15T22:47:35.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.442+0000 7efecdffb640 1 -- 172.21.15.134:0/1698305281 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) ==== 181+0+0 (secure 0 0 0) 0x7efec80589d0 con 0x7efed8072b30 2024-09-15T22:47:35.443 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:47:35.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 msgr2=0x7efebc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 0x7efebc06eda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efed4034000 tx=0x7efed402e000 comp rx=0 tx=0).stop 2024-09-15T22:47:35.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 msgr2=0x7efed813ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7efec800c4a0 tx=0x7efec800c960 comp rx=0 tx=0).stop 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 shutdown_connections 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efed8146100 0x7efed80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efebc06c8e0 0x7efebc06eda0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed8072b30 0x7efed813ee70 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 --2- 172.21.15.134:0/1698305281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efed806c0e0 0x7efed8142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.445+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 >> 172.21.15.134:0/1698305281 conn(0x7efed8062810 msgr2=0x7efed8072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.446+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 shutdown_connections 2024-09-15T22:47:35.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.446+0000 7efedf84c640 1 -- 172.21.15.134:0/1698305281 wait complete. 2024-09-15T22:47:35.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:47:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.567+0000 7ffa17ad0640 1 Processor -- start 2024-09-15T22:47:35.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.567+0000 7ffa17ad0640 1 -- start start 2024-09-15T22:47:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa17ad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b61e0 0x7ffa100b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa17ad0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa100b3b00 0x7ffa101625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa17ad0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa100b6b00 con 0x7ffa100b3540 2024-09-15T22:47:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa17ad0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffa100d24f0 con 0x7ffa100b3b00 2024-09-15T22:47:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa17ad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffa100d20e0 con 0x7ffa100b61e0 2024-09-15T22:47:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1506b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa100b3b00 0x7ffa101625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1606d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffa100b3540 0x7ffa10162b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49210/0 (socket says 172.21.15.134:49210) 2024-09-15T22:47:35.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1606d640 1 -- 172.21.15.134:0/1548673654 learned_addr learned my addr 172.21.15.134:0/1548673654 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1506b640 1 -- 172.21.15.134:0/1548673654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b61e0 msgr2=0x7ffa100b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1506b640 1 --2- 172.21.15.134:0/1548673654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b61e0 0x7ffa100b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1506b640 1 -- 172.21.15.134:0/1548673654 >> v1:172.21.15.134:6789/0 conn(0x7ffa100b3540 legacy=0x7ffa10162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.568+0000 7ffa1506b640 1 -- 172.21.15.134:0/1548673654 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa100cfa70 con 0x7ffa100b3b00 2024-09-15T22:47:35.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.569+0000 7ffa1506b640 1 --2- 172.21.15.134:0/1548673654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa101625d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097a0 tx=0x7ffa0c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a428a612c0be2e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.569+0000 7ffa1486a640 1 -- 172.21.15.134:0/1548673654 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037070 con 0x7ffa100b3b00 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.569+0000 7ffa1486a640 1 -- 172.21.15.134:0/1548673654 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c02adb0 con 0x7ffa100b3b00 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.569+0000 7ffa1486a640 1 -- 172.21.15.134:0/1548673654 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c032660 con 0x7ffa100b3b00 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1548673654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 msgr2=0x7ffa101625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1548673654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa101625d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097a0 tx=0x7ffa0c02a060 comp rx=0 tx=0).stop 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1548673654 shutdown_connections 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1548673654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa101625d0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1548673654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b61e0 0x7ffa100b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1548673654 >> 172.21.15.134:0/1548673654 conn(0x7ffa100d11e0 msgr2=0x7ffa100d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1548673654 shutdown_connections 2024-09-15T22:47:35.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.570+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1548673654 wait complete. 2024-09-15T22:47:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.571+0000 7ffa17ad0640 1 Processor -- start 2024-09-15T22:47:35.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.571+0000 7ffa17ad0640 1 -- start start 2024-09-15T22:47:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 0x7ffa101577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 0x7ffa100b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1015edc0 con 0x7ffa100b3b00 2024-09-15T22:47:35.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100d0030 con 0x7ffa100b61e0 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ffa10161560 con 0x7ffa100b3540 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:32866/0 (socket says 172.21.15.134:32866) 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 -- 172.21.15.134:0/1609702616 learned_addr learned my addr 172.21.15.134:0/1609702616 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 -- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 msgr2=0x7ffa101577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1586c640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 0x7ffa101577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1606d640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 0x7ffa100b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 0x7ffa101577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 -- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 msgr2=0x7ffa100b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 0x7ffa100b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 -- 172.21.15.134:0/1609702616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa10162310 con 0x7ffa100b3b00 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1586c640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 0x7ffa101577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:35.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1606d640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 0x7ffa100b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa1506b640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0096f0 tx=0x7ffa0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c041070 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c03c670 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa10161790 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037040 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.572+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa10161d50 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.573+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa100d1d00 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.574+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7ffa0c044070 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.574+0000 7ffa067fc640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 0x7ff9f406edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.574+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5413+0+0 (secure 0 0 0) 0x7ffa0c0ac570 con 0x7ffa100b3b00 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.574+0000 7ffa1586c640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 0x7ff9f406edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:35.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.575+0000 7ffa1586c640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 0x7ff9f406edd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000a870 tx=0x7ffa00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:35.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.578+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa0c07a550 con 0x7ffa100b3b00 2024-09-15T22:47:35.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:35.744+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa100ba6e0 con 0x7ffa100b3b00 2024-09-15T22:47:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.444+0000 7ffa067fc640 1 -- 172.21.15.134:0/1609702616 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) ==== 169+0+0 (secure 0 0 0) 0x7ffa0c079e50 con 0x7ffa100b3b00 2024-09-15T22:47:36.445 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:47:36.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 msgr2=0x7ff9f406edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 0x7ff9f406edd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000a870 tx=0x7ffa00008040 comp rx=0 tx=0).stop 2024-09-15T22:47:36.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 msgr2=0x7ffa1015fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0096f0 tx=0x7ffa0c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 shutdown_connections 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa100b61e0 0x7ffa100b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff9f406c910 0x7ff9f406edd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa100b3b00 0x7ffa1015fa00 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 --2- 172.21.15.134:0/1609702616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa100b3540 0x7ffa101577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 >> 172.21.15.134:0/1609702616 conn(0x7ffa100d11e0 msgr2=0x7ffa100b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 shutdown_connections 2024-09-15T22:47:36.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.448+0000 7ffa17ad0640 1 -- 172.21.15.134:0/1609702616 wait complete. 2024-09-15T22:47:36.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:47:36.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.567+0000 7fd4bd328640 1 Processor -- start 2024-09-15T22:47:36.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.567+0000 7fd4bd328640 1 -- start start 2024-09-15T22:47:36.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4bd328640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd4b80b3d50 0x7fd4b806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4bd328640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4b806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4bd328640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b80cf9a0 con 0x7fd4b8161e30 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4bd328640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b80cfcf0 con 0x7fd4b80b3d50 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4bd328640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b8162210 con 0x7fd4b80b3290 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b6ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd4b8161e30 0x7fd4b80d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43726/0 (socket says 172.21.15.134:43726) 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b6ffd640 1 -- 172.21.15.134:0/1167454134 learned_addr learned my addr 172.21.15.134:0/1167454134 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4b806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4affff640 1 --2- 172.21.15.134:0/1167454134 >> v2:172.21.15.177:3300/0 conn(0x7fd4b80b3d50 0x7fd4b806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644114835 0 0) 0x7fd4b80cf9a0 con 0x7fd4b8161e30 2024-09-15T22:47:36.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4a4003520 con 0x7fd4b8161e30 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 331114425 0 0) 0x7fd4a4003520 con 0x7fd4b8161e30 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 msgr2=0x7fd4b806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4b806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 >> v2:172.21.15.177:3300/0 conn(0x7fd4b80b3d50 msgr2=0x7fd4b806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 --2- 172.21.15.134:0/1167454134 >> v2:172.21.15.177:3300/0 conn(0x7fd4b80b3d50 0x7fd4b806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b80d5210 con 0x7fd4b8161e30 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd4a8001670 con 0x7fd4b8161e30 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.568+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 >> v1:172.21.15.134:6789/0 conn(0x7fd4b8161e30 legacy=0x7fd4b80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a40039b0 0x7fd4a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4a4004d40 0x7fd4a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b80cfcf0 con 0x7fd4a4004d40 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8162210 con 0x7fd4a40039b0 2024-09-15T22:47:36.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a400b9c0 con 0x7fd4b80b3290 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4a4004d40 0x7fd4a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b6ffd640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a40039b0 0x7fd4a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4affff640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 -- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 msgr2=0x7fd4a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80b3290 0x7fd4a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 -- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a40039b0 msgr2=0x7fd4a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a40039b0 0x7fd4a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.569+0000 7fd4b77fe640 1 -- 172.21.15.134:0/1167454134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a4003520 con 0x7fd4a4004d40 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4a4004d40 0x7fd4a40051c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009fc0 tx=0x7fd4a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dd500cf1f21f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0009c10 con 0x7fd4a4004d40 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b0036070 con 0x7fd4a4004d40 2024-09-15T22:47:36.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4b67fc640 1 -- 172.21.15.134:0/1167454134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0031880 con 0x7fd4a4004d40 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 -- 172.21.15.134:0/1167454134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4a4004d40 msgr2=0x7fd4a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 --2- 172.21.15.134:0/1167454134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4a4004d40 0x7fd4a40051c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009fc0 tx=0x7fd4a4005830 comp rx=0 tx=0).stop 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4b77fe640 1 -- 172.21.15.134:0/1167454134 reap_dead start 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 -- 172.21.15.134:0/1167454134 shutdown_connections 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 -- 172.21.15.134:0/1167454134 >> 172.21.15.134:0/1167454134 conn(0x7fd4b80d1870 msgr2=0x7fd4b80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 -- 172.21.15.134:0/1167454134 shutdown_connections 2024-09-15T22:47:36.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.570+0000 7fd4bd328640 1 -- 172.21.15.134:0/1167454134 wait complete. 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 Processor -- start 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 -- start start 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a4004d40 0x7fd4b814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80cd100 0x7fd4b80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b806de00 con 0x7fd4b80ca890 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b80b3950 con 0x7fd4a4004d40 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4bd328640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b806df80 con 0x7fd4b80cd100 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56482/0 (socket says 172.21.15.134:56482) 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4b77fe640 1 -- 172.21.15.134:0/3870146775 learned_addr learned my addr 172.21.15.134:0/3870146775 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4b6ffd640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a4004d40 0x7fd4b814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.572+0000 7fd4affff640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80cd100 0x7fd4b80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 -- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80cd100 msgr2=0x7fd4b80cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80cd100 0x7fd4b80cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 -- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a4004d40 msgr2=0x7fd4b814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a4004d40 0x7fd4b814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 -- 172.21.15.134:0/3870146775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b814d190 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4b77fe640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0033040 tx=0x7fd4b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0009c10 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b0031df0 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b80cbdd0 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0003bd0 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.573+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b80cc340 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.574+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b806d8c0 con 0x7fd4b80ca890 2024-09-15T22:47:36.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.575+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fd4b0005d10 con 0x7fd4b80ca890 2024-09-15T22:47:36.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.575+0000 7fd4af7fe640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 0x7fd49806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.575+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7fd4b00ace10 con 0x7fd4b80ca890 2024-09-15T22:47:36.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.575+0000 7fd4b6ffd640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 0x7fd49806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.576+0000 7fd4b6ffd640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 0x7fd49806edd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007fd0 tx=0x7fd4a8007970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.579+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4b004a060 con 0x7fd4b80ca890 2024-09-15T22:47:36.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.742+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd4b815e840 con 0x7fd4b80ca890 2024-09-15T22:47:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.746+0000 7fd4af7fe640 1 -- 172.21.15.134:0/3870146775 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fd4b007a990 con 0x7fd4b80ca890 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 msgr2=0x7fd49806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 0x7fd49806edd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007fd0 tx=0x7fd4a8007970 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 msgr2=0x7fd4b80cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0033040 tx=0x7fd4b0009750 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 shutdown_connections 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd49806c910 0x7fd49806edd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4b80ca890 0x7fd4b80cad10 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4b80cd100 0x7fd4b80cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 --2- 172.21.15.134:0/3870146775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a4004d40 0x7fd4b814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 >> 172.21.15.134:0/3870146775 conn(0x7fd4b80d1870 msgr2=0x7fd4b815f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 shutdown_connections 2024-09-15T22:47:36.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.748+0000 7fd4bd328640 1 -- 172.21.15.134:0/3870146775 wait complete. 2024-09-15T22:47:36.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-15T22:47:36.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.863+0000 7f6a730ba640 1 Processor -- start 2024-09-15T22:47:36.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.864+0000 7f6a730ba640 1 -- start start 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.864+0000 7f6a730ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c151c50 0x7f6a6c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.864+0000 7f6a730ba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c0cd5f0 con 0x7f6a6c06c1f0 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.864+0000 7f6a730ba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c0cd8d0 con 0x7f6a6c06be10 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.864+0000 7f6a730ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c0cdbb0 con 0x7f6a6c151c50 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c151c50 0x7f6a6c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a6c151c50 0x7f6a6c0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56494/0 (socket says 172.21.15.134:56494) 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 -- 172.21.15.134:0/571019447 learned_addr learned my addr 172.21.15.134:0/571019447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a71657640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6a6c06c1f0 0x7f6a6c164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43742/0 (socket says 172.21.15.134:43742) 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 -- 172.21.15.134:0/571019447 >> v1:172.21.15.177:6789/0 conn(0x7f6a6c06be10 legacy=0x7f6a6c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 -- 172.21.15.134:0/571019447 >> v1:172.21.15.134:6789/0 conn(0x7f6a6c06c1f0 legacy=0x7f6a6c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/571019447 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750620191 0 0) 0x7f6a6c0cd5f0 con 0x7f6a6c06c1f0 2024-09-15T22:47:36.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.865+0000 7f6a6bfff640 1 -- 172.21.15.134:0/571019447 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0cde90 con 0x7f6a6c151c50 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/571019447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0cd010 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00d150 tx=0x7f6a5c02c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb6ec2585b879a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/571019447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c009600 con 0x7f6a6c151c50 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/571019447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c037070 con 0x7f6a6c151c50 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a6b7fe640 1 -- 172.21.15.134:0/571019447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0099c0 con 0x7f6a6c151c50 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 -- 172.21.15.134:0/571019447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 msgr2=0x7f6a6c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 --2- 172.21.15.134:0/571019447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0cd010 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00d150 tx=0x7f6a5c02c970 comp rx=0 tx=0).stop 2024-09-15T22:47:36.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 -- 172.21.15.134:0/571019447 shutdown_connections 2024-09-15T22:47:36.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 --2- 172.21.15.134:0/571019447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0cd010 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 -- 172.21.15.134:0/571019447 >> 172.21.15.134:0/571019447 conn(0x7f6a6c062cc0 msgr2=0x7f6a6c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:36.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 -- 172.21.15.134:0/571019447 shutdown_connections 2024-09-15T22:47:36.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.866+0000 7f6a730ba640 1 -- 172.21.15.134:0/571019447 wait complete. 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 Processor -- start 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 -- start start 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c06be10 0x7f6a6c14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c06c1f0 0x7f6a6c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c15baa0 con 0x7f6a6c151c50 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0ce690 con 0x7f6a6c06be10 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.868+0000 7f6a730ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c15bc20 con 0x7f6a6c06c1f0 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56500/0 (socket says 172.21.15.134:56500) 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 -- 172.21.15.134:0/3203851145 learned_addr learned my addr 172.21.15.134:0/3203851145 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a70e56640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c06be10 0x7f6a6c14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a6bfff640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c06c1f0 0x7f6a6c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 -- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c06c1f0 msgr2=0x7f6a6c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c06c1f0 0x7f6a6c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 -- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c06be10 msgr2=0x7f6a6c14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c06be10 0x7f6a6c14fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 -- 172.21.15.134:0/3203851145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c1f0b30 con 0x7f6a6c151c50 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a71657640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c450 tx=0x7f6a5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54018070 con 0x7f6a6c151c50 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54007500 con 0x7f6a6c151c50 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004a20 con 0x7f6a6c151c50 2024-09-15T22:47:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c1f0850 con 0x7f6a6c151c50 2024-09-15T22:47:36.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.869+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c156ab0 con 0x7f6a6c151c50 2024-09-15T22:47:36.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.870+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c0cd010 con 0x7f6a6c151c50 2024-09-15T22:47:36.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.871+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f6a5401b070 con 0x7f6a6c151c50 2024-09-15T22:47:36.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.871+0000 7f6a697fa640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 0x7f6a4c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:36.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.871+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7f6a5408aea0 con 0x7f6a6c151c50 2024-09-15T22:47:36.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.871+0000 7f6a70e56640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 0x7f6a4c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:36.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.872+0000 7f6a70e56640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 0x7f6a4c06eda0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a64004f60 tx=0x7f6a64007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:36.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:36.875+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a5408e030 con 0x7f6a6c151c50 2024-09-15T22:47:37.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.104+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f6a6c0b3670 con 0x7f6a6c151c50 2024-09-15T22:47:37.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.450+0000 7f6a697fa640 1 -- 172.21.15.134:0/3203851145 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v346) ==== 151+0+0 (secure 0 0 0) 0x7f6a540589d0 con 0x7f6a6c151c50 2024-09-15T22:47:37.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 msgr2=0x7f6a4c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 0x7f6a4c06eda0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a64004f60 tx=0x7f6a64007e30 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 msgr2=0x7f6a6c0b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c450 tx=0x7f6a5400c910 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 shutdown_connections 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a4c06c8e0 0x7f6a4c06eda0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a6c151c50 0x7f6a6c0b4b10 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6a6c06c1f0 0x7f6a6c0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 --2- 172.21.15.134:0/3203851145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a6c06be10 0x7f6a6c14fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 >> 172.21.15.134:0/3203851145 conn(0x7f6a6c062cc0 msgr2=0x7f6a6c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 shutdown_connections 2024-09-15T22:47:37.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.453+0000 7f6a730ba640 1 -- 172.21.15.134:0/3203851145 wait complete. 2024-09-15T22:47:37.465 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-15T22:47:37.466 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-15T22:47:37.466 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:47:37.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:37.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.564+0000 7f8f435b7640 1 Processor -- start 2024-09-15T22:47:37.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.564+0000 7f8f435b7640 1 -- start start 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f435b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8f3c15ca40 0x7f8f3c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f435b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c15d390 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f435b7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c15d670 con 0x7f8f3c0d02a0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f435b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3c15d950 con 0x7f8f3c15ca40 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f41b54640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8f3c15ceb0 0x7f8f3c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43752/0 (socket says 172.21.15.134:43752) 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f41b54640 1 -- 172.21.15.134:0/2147572947 learned_addr learned my addr 172.21.15.134:0/2147572947 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678488729 0 0) 0x7f8f3c15d390 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f28003520 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.565+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2147572947 >> v2:172.21.15.177:3300/0 conn(0x7f8f3c15ca40 0x7f8f3c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3375093242 0 0) 0x7f8f28003520 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 >> v2:172.21.15.177:3300/0 conn(0x7f8f3c15ca40 msgr2=0x7f8f3c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 --2- 172.21.15.134:0/2147572947 >> v2:172.21.15.177:3300/0 conn(0x7f8f3c15ca40 0x7f8f3c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 >> v1:172.21.15.177:6789/0 conn(0x7f8f3c0d02a0 legacy=0x7f8f3c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c15dc30 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f8f340019f0 con 0x7f8f3c15ceb0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 >> v1:172.21.15.134:6789/0 conn(0x7f8f3c15ceb0 legacy=0x7f8f3c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f280039b0 0x7f8f28003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f28004800 0x7f8f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 0x7f8f2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c15d950 con 0x7f8f280052e0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2800c190 con 0x7f8f28004800 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2800c390 con 0x7f8f280039b0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 0x7f8f2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41353640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f280039b0 0x7f8f28003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f28004800 0x7f8f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 -- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f280039b0 msgr2=0x7f8f28003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f280039b0 0x7f8f28003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 -- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f28004800 msgr2=0x7f8f28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f28004800 0x7f8f28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f41b54640 1 -- 172.21.15.134:0/2147572947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f28003520 con 0x7f8f280052e0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.566+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f28004800 0x7f8f28004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f41b54640 1 -- 172.21.15.134:0/2147572947 reap_dead start 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 0x7f8f2800b9c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c15d2c0 tx=0x7f8f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4717be26332bb881 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400a4c0 con 0x7f8f280052e0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3402f070 con 0x7f8f280052e0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f33fff640 1 -- 172.21.15.134:0/2147572947 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3402bc90 con 0x7f8f280052e0 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f435b7640 1 -- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 msgr2=0x7f8f2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 0x7f8f2800b9c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c15d2c0 tx=0x7f8f28005830 comp rx=0 tx=0).stop 2024-09-15T22:47:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f435b7640 1 -- 172.21.15.134:0/2147572947 shutdown_connections 2024-09-15T22:47:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2147572947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f280052e0 0x7f8f2800b9c0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.567+0000 7f8f435b7640 1 -- 172.21.15.134:0/2147572947 >> 172.21.15.134:0/2147572947 conn(0x7f8f3c062cc0 msgr2=0x7f8f3c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.568+0000 7f8f435b7640 1 -- 172.21.15.134:0/2147572947 shutdown_connections 2024-09-15T22:47:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.568+0000 7f8f435b7640 1 -- 172.21.15.134:0/2147572947 wait complete. 2024-09-15T22:47:37.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 Processor -- start 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 -- start start 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f280052e0 0x7f8f3c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 0x7f8f3c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c155d10 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c155b90 con 0x7f8f280052e0 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.569+0000 7f8f435b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b4790 con 0x7f8f3c14e230 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56520/0 (socket says 172.21.15.134:56520) 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 -- 172.21.15.134:0/2622490250 learned_addr learned my addr 172.21.15.134:0/2622490250 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f41353640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f280052e0 0x7f8f3c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 0x7f8f3c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 -- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 msgr2=0x7f8f3c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 0x7f8f3c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 -- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f280052e0 msgr2=0x7f8f3c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f280052e0 0x7f8f3c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 -- 172.21.15.134:0/2622490250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c14e740 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f41b54640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 0x7f8f3c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f40b52640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00f5b0 tx=0x7f8f2c00fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c013810 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c01a070 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c14ea20 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c013bb0 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.570+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c15a830 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.571+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c0d0680 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.572+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f8f2c012070 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.572+0000 7f8f31ffb640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 0x7f8f2006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.572+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7f8f2c08bc20 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.573+0000 7f8f41353640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 0x7f8f2006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.573+0000 7f8f41353640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 0x7f8f2006edd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f38004f70 tx=0x7f8f38007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.577+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f2c059d10 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.741+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f3c063470 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.742+0000 7f8f31ffb640 1 -- 172.21.15.134:0/2622490250 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+13169 (secure 0 0 0) 0x7f8f2c059610 con 0x7f8f3c14c5b0 2024-09-15T22:47:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:37.743 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":137,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:36.443306+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/4139080869":"2024-09-16T22:47:33.436031+0000","172.21.15.134:6825/4139080869":"2024-09-16T22:47:33.436031+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 msgr2=0x7f8f2006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 0x7f8f2006edd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f38004f70 tx=0x7f8f38007cc0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 msgr2=0x7f8f3c14dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00f5b0 tx=0x7f8f2c00fa70 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 shutdown_connections 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f3c14e230 0x7f8f3c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8f2006c910 0x7f8f2006edd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f3c14c5b0 0x7f8f3c14dcf0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 --2- 172.21.15.134:0/2622490250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f280052e0 0x7f8f3c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 >> 172.21.15.134:0/2622490250 conn(0x7f8f3c062cc0 msgr2=0x7f8f3c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 shutdown_connections 2024-09-15T22:47:37.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.744+0000 7f8f435b7640 1 -- 172.21.15.134:0/2622490250 wait complete. 2024-09-15T22:47:37.757 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:47:37.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:47:37.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.858+0000 7fccd2f8d640 1 Processor -- start 2024-09-15T22:47:37.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.858+0000 7fccd2f8d640 1 -- start start 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd2f8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcccc15c5b0 0x7fcccc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd2f8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcccc0b3be0 0x7fcccc0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd2f8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcccc0d1060 con 0x7fcccc0d0870 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd2f8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc0b4050 con 0x7fcccc15c5b0 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd2f8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc0d1340 con 0x7fcccc0b3be0 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd0d29640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcccc15c5b0 0x7fcccc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd152a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fcccc0d0870 0x7fcccc06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43766/0 (socket says 172.21.15.134:43766) 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd152a640 1 -- 172.21.15.134:0/4087218567 learned_addr learned my addr 172.21.15.134:0/4087218567 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.859+0000 7fccd0d29640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcccc15c5b0 0x7fcccc0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56530/0 (socket says 172.21.15.134:56530) 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fcccbfff640 1 --2- 172.21.15.134:0/4087218567 >> v2:172.21.15.177:3300/0 conn(0x7fcccc0b3be0 0x7fcccc0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fccd0d29640 1 -- 172.21.15.134:0/4087218567 >> v2:172.21.15.177:3300/0 conn(0x7fcccc0b3be0 msgr2=0x7fcccc0d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:37.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fccd0d29640 1 --2- 172.21.15.134:0/4087218567 >> v2:172.21.15.177:3300/0 conn(0x7fcccc0b3be0 0x7fcccc0d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fccd0d29640 1 -- 172.21.15.134:0/4087218567 >> v1:172.21.15.134:6789/0 conn(0x7fcccc0d0870 legacy=0x7fcccc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fcccb7fe640 1 -- 172.21.15.134:0/4087218567 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375997191 0 0) 0x7fcccc0d1060 con 0x7fcccc0d0870 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fccd0d29640 1 -- 172.21.15.134:0/4087218567 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc06e2a0 con 0x7fcccc15c5b0 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fccd0d29640 1 --2- 172.21.15.134:0/4087218567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc0b36a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0cf1e0 tx=0x7fccbc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8309c27ddf5ac2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.860+0000 7fcccb7fe640 1 -- 172.21.15.134:0/4087218567 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007740 con 0x7fcccc15c5b0 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fcccb7fe640 1 -- 172.21.15.134:0/4087218567 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc0078e0 con 0x7fcccc15c5b0 2024-09-15T22:47:37.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fcccb7fe640 1 -- 172.21.15.134:0/4087218567 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007cb0 con 0x7fcccc15c5b0 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 -- 172.21.15.134:0/4087218567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 msgr2=0x7fcccc0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/4087218567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc0b36a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0cf1e0 tx=0x7fccbc02a5f0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 -- 172.21.15.134:0/4087218567 shutdown_connections 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/4087218567 >> v2:172.21.15.177:3300/0 conn(0x7fcccc0b3be0 0x7fcccc0d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/4087218567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc0b36a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 -- 172.21.15.134:0/4087218567 >> 172.21.15.134:0/4087218567 conn(0x7fcccc06d0d0 msgr2=0x7fcccc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 -- 172.21.15.134:0/4087218567 shutdown_connections 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.861+0000 7fccd2f8d640 1 -- 172.21.15.134:0/4087218567 wait complete. 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.862+0000 7fccd2f8d640 1 Processor -- start 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.862+0000 7fccd2f8d640 1 -- start start 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcccc0b3be0 0x7fcccc14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcccc0d0870 0x7fcccc1e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc0d0ca0 con 0x7fcccc15c5b0 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc06e860 con 0x7fcccc0d0870 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd2f8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc0d0e20 con 0x7fcccc0b3be0 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd152a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd152a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56542/0 (socket says 172.21.15.134:56542) 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd152a640 1 -- 172.21.15.134:0/1906747432 learned_addr learned my addr 172.21.15.134:0/1906747432 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fcccbfff640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcccc0d0870 0x7fcccc1e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.863+0000 7fccd0d29640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcccc0b3be0 0x7fcccc14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 -- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcccc0b3be0 msgr2=0x7fcccc14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcccc0b3be0 0x7fcccc14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 -- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcccc0d0870 msgr2=0x7fcccc1e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcccc0d0870 0x7fcccc1e6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 -- 172.21.15.134:0/1906747432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc0af990 con 0x7fcccc15c5b0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd152a640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fccc400c450 tx=0x7fccc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4018070 con 0x7fcccc15c5b0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4007500 con 0x7fcccc15c5b0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4004a20 con 0x7fcccc15c5b0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc0afc70 con 0x7fcccc15c5b0 2024-09-15T22:47:37.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.864+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc14b420 con 0x7fcccc15c5b0 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.865+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc15a710 con 0x7fcccc15c5b0 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.865+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fccc401b070 con 0x7fcccc15c5b0 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.866+0000 7fccc97fa640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 0x7fccb806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.866+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7fccc408af10 con 0x7fcccc15c5b0 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.866+0000 7fccd0d29640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 0x7fccb806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.867+0000 7fccd0d29640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 0x7fccb806edd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc033040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:37.870+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccc4059090 con 0x7fcccc15c5b0 2024-09-15T22:47:38.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.034+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcccc15a430 con 0x7fcccc15c5b0 2024-09-15T22:47:38.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.035+0000 7fccc97fa640 1 -- 172.21.15.134:0/1906747432 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) ==== 93+0+10 (secure 0 0 0) 0x7fccc4058990 con 0x7fcccc15c5b0 2024-09-15T22:47:38.036 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:47:38.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 msgr2=0x7fccb806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 0x7fccb806edd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc033040 comp rx=0 tx=0).stop 2024-09-15T22:47:38.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 msgr2=0x7fcccc14b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fccc400c450 tx=0x7fccc400c910 comp rx=0 tx=0).stop 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 shutdown_connections 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fccb806c910 0x7fccb806edd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcccc15c5b0 0x7fcccc14b770 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcccc0d0870 0x7fcccc1e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 --2- 172.21.15.134:0/1906747432 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcccc0b3be0 0x7fcccc14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 >> 172.21.15.134:0/1906747432 conn(0x7fcccc06d0d0 msgr2=0x7fcccc06ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 shutdown_connections 2024-09-15T22:47:38.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.037+0000 7fccd2f8d640 1 -- 172.21.15.134:0/1906747432 wait complete. 2024-09-15T22:47:38.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-15T22:47:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.146+0000 7f41c4918640 1 Processor -- start 2024-09-15T22:47:38.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.146+0000 7f41c4918640 1 -- start start 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41c4918640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41c015e940 0x7f41c00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41c4918640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c00b7170 con 0x7f41c00cef90 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41c4918640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c00b7aa0 con 0x7f41c015ed20 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41c4918640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f41c00d3660 con 0x7f41c015e940 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41be59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41c015e940 0x7f41c00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41bed9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f41c00cef90 0x7f41c00b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43774/0 (socket says 172.21.15.134:43774) 2024-09-15T22:47:38.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.147+0000 7f41bed9d640 1 -- 172.21.15.134:0/3929352825 learned_addr learned my addr 172.21.15.134:0/3929352825 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.148+0000 7f41be59c640 1 -- 172.21.15.134:0/3929352825 >> v1:172.21.15.177:6789/0 conn(0x7f41c015ed20 legacy=0x7f41c00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.148+0000 7f41be59c640 1 -- 172.21.15.134:0/3929352825 >> v1:172.21.15.134:6789/0 conn(0x7f41c00cef90 legacy=0x7f41c00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.148+0000 7f41be59c640 1 -- 172.21.15.134:0/3929352825 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c00d3940 con 0x7f41c015e940 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.148+0000 7f41bd59a640 1 -- 172.21.15.134:0/3929352825 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033792443 0 0) 0x7f41b8001110 con 0x7f41c00cef90 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.148+0000 7f41be59c640 1 --2- 172.21.15.134:0/3929352825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015e940 0x7f41c00d1060 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea68d9cb69cb7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41bd59a640 1 -- 172.21.15.134:0/3929352825 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007740 con 0x7f41c015e940 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41bd59a640 1 -- 172.21.15.134:0/3929352825 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00078e0 con 0x7f41c015e940 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41bd59a640 1 -- 172.21.15.134:0/3929352825 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007cb0 con 0x7f41c015e940 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 -- 172.21.15.134:0/3929352825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015e940 msgr2=0x7f41c00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 --2- 172.21.15.134:0/3929352825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015e940 0x7f41c00d1060 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b002a730 comp rx=0 tx=0).stop 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 -- 172.21.15.134:0/3929352825 shutdown_connections 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 --2- 172.21.15.134:0/3929352825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015e940 0x7f41c00d1060 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 -- 172.21.15.134:0/3929352825 >> 172.21.15.134:0/3929352825 conn(0x7f41c00b6240 msgr2=0x7f41c00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:38.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 -- 172.21.15.134:0/3929352825 shutdown_connections 2024-09-15T22:47:38.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.149+0000 7f41c4918640 1 -- 172.21.15.134:0/3929352825 wait complete. 2024-09-15T22:47:38.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.150+0000 7f41c4918640 1 Processor -- start 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 -- start start 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41c00cef90 0x7f41c0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 0x7f41c01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00d3310 con 0x7f41c015ed20 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00d3f00 con 0x7f41c015e940 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41c4918640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f41c00d1ef0 con 0x7f41c00cef90 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41bed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41bed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56564/0 (socket says 172.21.15.134:56564) 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.151+0000 7f41bed9d640 1 -- 172.21.15.134:0/611657344 learned_addr learned my addr 172.21.15.134:0/611657344 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41be59c640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41c00cef90 0x7f41c0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bdd9b640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 0x7f41c01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 -- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41c00cef90 msgr2=0x7f41c0158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41c00cef90 0x7f41c0158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 -- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 msgr2=0x7f41c01568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 0x7f41c01568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 -- 172.21.15.134:0/611657344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c00b5260 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bdd9b640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 0x7f41c01568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41bed9d640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c780 tx=0x7f41b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8018070 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b80070d0 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c01592d0 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8007500 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.152+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c0159890 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.153+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0161fa0 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.154+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f41b801b070 con 0x7f41c015ed20 2024-09-15T22:47:38.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.154+0000 7f41aeffd640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 0x7f41a006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.154+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7f41b808af20 con 0x7f41c015ed20 2024-09-15T22:47:38.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.154+0000 7f41be59c640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 0x7f41a006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.155+0000 7f41be59c640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 0x7f41a006eda0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41b0034000 tx=0x7f41b002f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.159+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41c0161fa0 con 0x7f41c015ed20 2024-09-15T22:47:38.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.385+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7f41c00d1060 con 0x7f41c015ed20 2024-09-15T22:47:38.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.452+0000 7f41aeffd640 1 -- 172.21.15.134:0/611657344 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v347) ==== 152+0+0 (secure 0 0 0) 0x7f41c00b7170 con 0x7f41c015ed20 2024-09-15T22:47:38.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 msgr2=0x7f41a006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 0x7f41a006eda0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41b0034000 tx=0x7f41b002f000 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 msgr2=0x7f41c015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c780 tx=0x7f41b800cc40 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 shutdown_connections 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f41a006c8e0 0x7f41a006eda0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41c015ed20 0x7f41c015b410 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c015e940 0x7f41c01568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 --2- 172.21.15.134:0/611657344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41c00cef90 0x7f41c0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 >> 172.21.15.134:0/611657344 conn(0x7f41c00b6240 msgr2=0x7f41c00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 shutdown_connections 2024-09-15T22:47:38.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.454+0000 7f41c4918640 1 -- 172.21.15.134:0/611657344 wait complete. 2024-09-15T22:47:38.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:47:38.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.566+0000 7fbfdc865640 1 Processor -- start 2024-09-15T22:47:38.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.566+0000 7fbfdc865640 1 -- start start 2024-09-15T22:47:38.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd806f430 0x7fbfd80c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbfd815ca80 0x7fbfd8160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbfd80b6a80 0x7fbfd80b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd80b73f0 con 0x7fbfd815ca80 2024-09-15T22:47:38.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd815d290 con 0x7fbfd80b6a80 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfdc865640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd815d570 con 0x7fbfd806f430 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfd5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbfd815ca80 0x7fbfd8160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfd5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbfd815ca80 0x7fbfd8160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56578/0 (socket says 172.21.15.134:56578) 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.567+0000 7fbfd5d9b640 1 -- 172.21.15.134:0/4154794854 learned_addr learned my addr 172.21.15.134:0/4154794854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd6d9d640 1 --2- 172.21.15.134:0/4154794854 >> v2:172.21.15.177:3300/0 conn(0x7fbfd80b6a80 0x7fbfd80b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd659c640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd806f430 0x7fbfd80c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 -- 172.21.15.134:0/4154794854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd806f430 msgr2=0x7fbfd80c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd806f430 0x7fbfd80c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 -- 172.21.15.134:0/4154794854 >> v2:172.21.15.177:3300/0 conn(0x7fbfd80b6a80 msgr2=0x7fbfd80b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/4154794854 >> v2:172.21.15.177:3300/0 conn(0x7fbfd80b6a80 0x7fbfd80b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 -- 172.21.15.134:0/4154794854 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd815d850 con 0x7fbfd815ca80 2024-09-15T22:47:38.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.568+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd815ca80 0x7fbfd8160870 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbfd815a5c0 tx=0x7fbfcc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aea3e53259c227e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfd559a640 1 -- 172.21.15.134:0/4154794854 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc037070 con 0x7fbfd815ca80 2024-09-15T22:47:38.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfd559a640 1 -- 172.21.15.134:0/4154794854 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc032440 con 0x7fbfd815ca80 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfd559a640 1 -- 172.21.15.134:0/4154794854 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc032810 con 0x7fbfd815ca80 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 -- 172.21.15.134:0/4154794854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd815ca80 msgr2=0x7fbfd8160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd815ca80 0x7fbfd8160870 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbfd815a5c0 tx=0x7fbfcc02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 -- 172.21.15.134:0/4154794854 shutdown_connections 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 --2- 172.21.15.134:0/4154794854 >> v2:172.21.15.177:3300/0 conn(0x7fbfd80b6a80 0x7fbfd80b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd815ca80 0x7fbfd8160870 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 --2- 172.21.15.134:0/4154794854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd806f430 0x7fbfd80c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 -- 172.21.15.134:0/4154794854 >> 172.21.15.134:0/4154794854 conn(0x7fbfd806ccb0 msgr2=0x7fbfd806d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 -- 172.21.15.134:0/4154794854 shutdown_connections 2024-09-15T22:47:38.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.569+0000 7fbfdc865640 1 -- 172.21.15.134:0/4154794854 wait complete. 2024-09-15T22:47:38.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 Processor -- start 2024-09-15T22:47:38.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 -- start start 2024-09-15T22:47:38.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd80b6a80 0x7fbfd8148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 0x7fbfd8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd815ce80 con 0x7fbfd806f430 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8160350 con 0x7fbfd80b6a80 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfdc865640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd815d000 con 0x7fbfd815ca80 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfd659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfd659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56590/0 (socket says 172.21.15.134:56590) 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.571+0000 7fbfd659c640 1 -- 172.21.15.134:0/475132651 learned_addr learned my addr 172.21.15.134:0/475132651 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd80b6a80 0x7fbfd8148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd6d9d640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 0x7fbfd8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 -- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 msgr2=0x7fbfd8156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 0x7fbfd8156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 -- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd80b6a80 msgr2=0x7fbfd8148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd80b6a80 0x7fbfd8148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 -- 172.21.15.134:0/475132651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd80c9a00 con 0x7fbfd806f430 2024-09-15T22:47:38.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd6d9d640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 0x7fbfd8156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfd659c640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800eed0 tx=0x7fbfc800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8018020 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc800bd90 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8014620 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd80c9ce0 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.572+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd80ca2a0 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.573+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd80b6eb0 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.574+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fbfc8005d10 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.574+0000 7fbfc6ffd640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 0x7fbfb806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.574+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7fbfc808c5c0 con 0x7fbfd806f430 2024-09-15T22:47:38.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.574+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 0x7fbfb806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:38.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.575+0000 7fbfd5d9b640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 0x7fbfb806edd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc034000 tx=0x7fbfcc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:38.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.578+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfc8022070 con 0x7fbfd806f430 2024-09-15T22:47:38.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.741+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbfd80d01a0 con 0x7fbfd806f430 2024-09-15T22:47:38.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.745+0000 7fbfc6ffd640 1 -- 172.21.15.134:0/475132651 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fbfc805a630 con 0x7fbfd806f430 2024-09-15T22:47:38.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 msgr2=0x7fbfb806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 0x7fbfb806edd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc034000 tx=0x7fbfcc02e000 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 msgr2=0x7fbfd80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800eed0 tx=0x7fbfc800b480 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 shutdown_connections 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd815ca80 0x7fbfd8156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd80b6a80 0x7fbfd8148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbfb806c910 0x7fbfb806edd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 --2- 172.21.15.134:0/475132651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfd806f430 0x7fbfd80caaa0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 >> 172.21.15.134:0/475132651 conn(0x7fbfd806ccb0 msgr2=0x7fbfd806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 shutdown_connections 2024-09-15T22:47:38.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:38.747+0000 7fbfdc865640 1 -- 172.21.15.134:0/475132651 wait complete. 2024-09-15T22:47:38.759 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:47:38.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:38.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:47:38.855 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:47:38.855 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:38.855 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:38.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:38.872 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:38.872 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:38.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:38.891 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:38.892 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:38.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:47:38.928 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:38.928 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:38.950 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:47:38.950 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:47:38.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:39.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.066+0000 7f51f6bfd640 1 Processor -- start 2024-09-15T22:47:39.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.066+0000 7f51f6bfd640 1 -- start start 2024-09-15T22:47:39.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f6bfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51f00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f6bfd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51f015ce80 0x7f51f01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f6bfd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f00d0bc0 con 0x7f51f015ca40 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f6bfd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f51f015d390 con 0x7f51f015ce80 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f6bfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51f015d670 con 0x7f51f00d02a0 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f51f015ca40 0x7f51f015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43790/0 (socket says 172.21.15.134:43790) 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e7fff640 1 -- 172.21.15.134:0/535961714 learned_addr learned my addr 172.21.15.134:0/535961714 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f519a640 1 --2- 172.21.15.134:0/535961714 >> v2:172.21.15.177:3300/0 conn(0x7f51f015ce80 0x7f51f01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51f4999640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51f00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071590072 0 0) 0x7f51f00d0bc0 con 0x7f51f015ca40 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51d8005730 con 0x7f51f015ca40 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1367536817 0 0) 0x7f51d8005730 con 0x7f51f015ca40 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 msgr2=0x7f51f00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51f00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 >> v2:172.21.15.177:3300/0 conn(0x7f51f015ce80 msgr2=0x7f51f01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 --2- 172.21.15.134:0/535961714 >> v2:172.21.15.177:3300/0 conn(0x7f51f015ce80 0x7f51f01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f015d950 con 0x7f51f015ca40 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f51e0001670 con 0x7f51f015ca40 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 >> v1:172.21.15.134:6789/0 conn(0x7f51f015ca40 legacy=0x7f51f015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d8005bc0 0x7f51d8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d8006a10 0x7f51d8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.067+0000 7f51e77fe640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51d80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51f015d390 con 0x7f51d8006a10 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51f015d670 con 0x7f51d8005bc0 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51d800dbd0 con 0x7f51f00d02a0 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d8006a10 0x7f51d8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51f4999640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d8005bc0 0x7f51d8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51f519a640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51d80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 -- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 msgr2=0x7f51d80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51d80073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 -- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d8005bc0 msgr2=0x7f51d8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d8005bc0 0x7f51d8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51e7fff640 1 -- 172.21.15.134:0/535961714 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d8005730 con 0x7f51d8006a10 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.068+0000 7f51f519a640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51f00d02a0 0x7f51d80073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51e7fff640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d8006a10 0x7f51d8006e90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c210 tx=0x7f51d8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb188ea6861c32ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0007d50 con 0x7f51d8006a10 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e0005af0 con 0x7f51d8006a10 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51e77fe640 1 -- 172.21.15.134:0/535961714 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0007070 con 0x7f51d8006a10 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 -- 172.21.15.134:0/535961714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d8006a10 msgr2=0x7f51d8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/535961714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d8006a10 0x7f51d8006e90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c210 tx=0x7f51d8007a40 comp rx=0 tx=0).stop 2024-09-15T22:47:39.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f519a640 1 -- 172.21.15.134:0/535961714 reap_dead start 2024-09-15T22:47:39.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 -- 172.21.15.134:0/535961714 shutdown_connections 2024-09-15T22:47:39.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 -- 172.21.15.134:0/535961714 >> 172.21.15.134:0/535961714 conn(0x7f51f0062cc0 msgr2=0x7f51f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 -- 172.21.15.134:0/535961714 shutdown_connections 2024-09-15T22:47:39.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.069+0000 7f51f6bfd640 1 -- 172.21.15.134:0/535961714 wait complete. 2024-09-15T22:47:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.070+0000 7f51f6bfd640 1 Processor -- start 2024-09-15T22:47:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.070+0000 7f51f6bfd640 1 -- start start 2024-09-15T22:47:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d8006a10 0x7f51f0143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51f00b0430 0x7f51f00b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51f015eb40 con 0x7f51f00affb0 2024-09-15T22:47:39.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51f015df10 con 0x7f51f00b0430 2024-09-15T22:47:39.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51f6bfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51f0155b90 con 0x7f51d8006a10 2024-09-15T22:47:39.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56600/0 (socket says 172.21.15.134:56600) 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.071+0000 7f51e7fff640 1 -- 172.21.15.134:0/3003897490 learned_addr learned my addr 172.21.15.134:0/3003897490 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51f519a640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51f00b0430 0x7f51f00b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51f4999640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d8006a10 0x7f51f0143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 -- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d8006a10 msgr2=0x7f51f0143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d8006a10 0x7f51f0143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 -- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51f00b0430 msgr2=0x7f51f00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51f00b0430 0x7f51f00b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 -- 172.21.15.134:0/3003897490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f0073e10 con 0x7f51f00affb0 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e7fff640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c210 tx=0x7f51e0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0007d50 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e0043070 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f0071420 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0007680 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.072+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f0144200 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.073+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f00b4790 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.073+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f51e0048460 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.074+0000 7f51e57fa640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 0x7f51dc06edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.074+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4999+0+0 (secure 0 0 0) 0x7f51e00ac560 con 0x7f51f00affb0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.074+0000 7f51f4999640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 0x7f51dc06edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.074+0000 7f51f4999640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 0x7f51dc06edd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0099c0 tx=0x7f51ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.078+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51e0005ac0 con 0x7f51f00affb0 2024-09-15T22:47:39.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.279+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51f0159440 con 0x7f51f00affb0 2024-09-15T22:47:39.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.279+0000 7f51e57fa640 1 -- 172.21.15.134:0/3003897490 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3923 (secure 0 0 0) 0x7f51e007a6e0 con 0x7f51f00affb0 2024-09-15T22:47:39.281 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:39.281 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":71,"btime":"2024-09-15T22:47:34:437591+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1050468518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1050468518},{"type":"v1","addr":"172.21.15.177:6834","nonce":1050468518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3998612143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3998612143},{"type":"v1","addr":"172.21.15.177:6835","nonce":3998612143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2965298167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2965298167},{"type":"v1","addr":"172.21.15.134:6834","nonce":2965298167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1228249173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":1228249173},{"type":"v1","addr":"172.21.15.134:6835","nonce":1228249173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-15T22:47:39.281 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 71 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.281+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 msgr2=0x7f51dc06edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.281+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 0x7f51dc06edd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0099c0 tx=0x7f51ec008040 comp rx=0 tx=0).stop 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.281+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 msgr2=0x7f51f00b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.281+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c210 tx=0x7f51e0001a40 comp rx=0 tx=0).stop 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 shutdown_connections 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51f00b0430 0x7f51f00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f51dc06c910 0x7f51dc06edd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51f00affb0 0x7f51f00b1bb0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 --2- 172.21.15.134:0/3003897490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d8006a10 0x7f51f0143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 >> 172.21.15.134:0/3003897490 conn(0x7f51f0062cc0 msgr2=0x7f51f0159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 shutdown_connections 2024-09-15T22:47:39.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.282+0000 7f51f6bfd640 1 -- 172.21.15.134:0/3003897490 wait complete. 2024-09-15T22:47:39.294 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:47:39.294 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:47:39.295 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:47:39.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:39.295 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:47:39.295 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:47:39.295 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:47:39.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:39.295 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:47:39.295 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:47:39.296 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:47:39.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:39.296 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:47:39.296 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:47:39.296 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:47:39.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:47:39.304 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:47:39.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:47:39.305 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:47:39.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:47:39.307 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:47:39.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:47:39.308 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:47:39.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:47:39.348 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:47:39.348 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:39.349 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:47:39.349 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:39.351 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:47:39.351 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:39.352 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:47:39.352 DEBUG:teuthology.parallel:result is None 2024-09-15T22:47:39.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:47:39.423 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:47:39.423 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:47:39.435 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:47:39.435 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:47:39.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.456+0000 7f17319d6640 1 Processor -- start 2024-09-15T22:47:39.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.456+0000 7f17319d6640 1 -- start start 2024-09-15T22:47:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.456+0000 7f17319d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f172c15c5e0 0x7f172c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.456+0000 7f17319d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f172c0b66e0 0x7f172c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f17319d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172c15c9c0 con 0x7f172c0b6d50 2024-09-15T22:47:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f17319d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f172c074100 con 0x7f172c0b66e0 2024-09-15T22:47:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f17319d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f172c0b76d0 con 0x7f172c15c5e0 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f172c0b66e0 0x7f172c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f172c0b66e0 0x7f172c0b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56652/0 (socket says 172.21.15.134:56652) 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 -- 172.21.15.134:0/4178680754 learned_addr learned my addr 172.21.15.134:0/4178680754 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172affd640 1 --2- 172.21.15.134:0/4178680754 >> v2:172.21.15.177:3300/0 conn(0x7f172c15c5e0 0x7f172c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 -- 172.21.15.134:0/4178680754 >> v2:172.21.15.177:3300/0 conn(0x7f172c15c5e0 msgr2=0x7f172c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 --2- 172.21.15.134:0/4178680754 >> v2:172.21.15.177:3300/0 conn(0x7f172c15c5e0 0x7f172c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 -- 172.21.15.134:0/4178680754 >> v1:172.21.15.177:6789/0 conn(0x7f172c0b6d50 legacy=0x7f172c1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.457+0000 7f172b7fe640 1 -- 172.21.15.134:0/4178680754 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c0b1dd0 con 0x7f172c0b66e0 2024-09-15T22:47:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.458+0000 7f172b7fe640 1 --2- 172.21.15.134:0/4178680754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c0b7190 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f172c0638c0 tx=0x7f172402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c55906b59a41679 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.458+0000 7f1729ffb640 1 -- 172.21.15.134:0/4178680754 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724036070 con 0x7f172c0b66e0 2024-09-15T22:47:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.458+0000 7f1729ffb640 1 -- 172.21.15.134:0/4178680754 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724031600 con 0x7f172c0b66e0 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.458+0000 7f1729ffb640 1 -- 172.21.15.134:0/4178680754 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17240319d0 con 0x7f172c0b66e0 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 -- 172.21.15.134:0/4178680754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 msgr2=0x7f172c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 --2- 172.21.15.134:0/4178680754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c0b7190 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f172c0638c0 tx=0x7f172402a730 comp rx=0 tx=0).stop 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 -- 172.21.15.134:0/4178680754 shutdown_connections 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 --2- 172.21.15.134:0/4178680754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c0b7190 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 --2- 172.21.15.134:0/4178680754 >> v2:172.21.15.177:3300/0 conn(0x7f172c15c5e0 0x7f172c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 -- 172.21.15.134:0/4178680754 >> 172.21.15.134:0/4178680754 conn(0x7f172c0b4220 msgr2=0x7f172c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 -- 172.21.15.134:0/4178680754 shutdown_connections 2024-09-15T22:47:39.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.459+0000 7f17319d6640 1 -- 172.21.15.134:0/4178680754 wait complete. 2024-09-15T22:47:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.460+0000 7f17319d6640 1 Processor -- start 2024-09-15T22:47:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.460+0000 7f17319d6640 1 -- start start 2024-09-15T22:47:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172c0b6d50 0x7f172c1e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f172c15c5e0 0x7f172c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f172c073ab0 con 0x7f172c0b66e0 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0737d0 con 0x7f172c0b6d50 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f17319d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f172c073d90 con 0x7f172c15c5e0 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56656/0 (socket says 172.21.15.134:56656) 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 -- 172.21.15.134:0/305532266 learned_addr learned my addr 172.21.15.134:0/305532266 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172a7fc640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172c0b6d50 0x7f172c1e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172b7fe640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f172c15c5e0 0x7f172c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 -- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f172c15c5e0 msgr2=0x7f172c0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f172c15c5e0 0x7f172c0708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 -- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172c0b6d50 msgr2=0x7f172c1e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172c0b6d50 0x7f172c1e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.461+0000 7f172affd640 1 -- 172.21.15.134:0/305532266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c1f59e0 con 0x7f172c0b66e0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f172affd640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e8a0 tx=0x7f171c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c017070 con 0x7f172c0b66e0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c00c940 con 0x7f172c0b66e0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00cd30 con 0x7f172c0b66e0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c1f5cc0 con 0x7f172c0b66e0 2024-09-15T22:47:39.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.462+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c1f6280 con 0x7f172c0b66e0 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.463+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c073130 con 0x7f172c0b66e0 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.463+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f171c01a070 con 0x7f172c0b66e0 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.464+0000 7f1713fff640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.464+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4999+0+0 (secure 0 0 0) 0x7f171c08baf0 con 0x7f172c0b66e0 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.464+0000 7f172a7fc640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.464+0000 7f172a7fc640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 0x7f171806eda0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f172c1e6a80 tx=0x7f1720009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.470+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f171c059590 con 0x7f172c0b66e0 2024-09-15T22:47:39.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-15T22:47:39.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:39.648+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f172c071a60 con 0x7f172c0b66e0 2024-09-15T22:47:40.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.472+0000 7f1713fff640 1 -- 172.21.15.134:0/305532266 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) ==== 97+0+0 (secure 0 0 0) 0x7f171c05d890 con 0x7f172c0b66e0 2024-09-15T22:47:40.474 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 msgr2=0x7f171806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 0x7f171806eda0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f172c1e6a80 tx=0x7f1720009040 comp rx=0 tx=0).stop 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 msgr2=0x7f172c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e8a0 tx=0x7f171c00ed60 comp rx=0 tx=0).stop 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 shutdown_connections 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f172c15c5e0 0x7f172c0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172c0b6d50 0x7f172c1e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 --2- 172.21.15.134:0/305532266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0b66e0 0x7f172c151100 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 >> 172.21.15.134:0/305532266 conn(0x7f172c0b4220 msgr2=0x7f172c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:40.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 shutdown_connections 2024-09-15T22:47:40.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.475+0000 7f17319d6640 1 -- 172.21.15.134:0/305532266 wait complete. 2024-09-15T22:47:40.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:47:40.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.593+0000 7f6ee46e6640 1 Processor -- start 2024-09-15T22:47:40.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.593+0000 7f6ee46e6640 1 -- start start 2024-09-15T22:47:40.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.594+0000 7f6ee46e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6edc163060 0x7f6edc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.594+0000 7f6ee46e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 0x7f6edc0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.594+0000 7f6ee46e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc0d3790 con 0x7f6edc0d2300 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.594+0000 7f6ee46e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6edc0b7610 con 0x7f6edc163060 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.594+0000 7f6ee46e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6edc0d3a70 con 0x7f6edc0b8ab0 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6edc163060 0x7f6edc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6edc163060 0x7f6edc0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56672/0 (socket says 172.21.15.134:56672) 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 -- 172.21.15.134:0/3641477849 learned_addr learned my addr 172.21.15.134:0/3641477849 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 -- 172.21.15.134:0/3641477849 >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 msgr2=0x7f6edc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2c83640 1 --2- 172.21.15.134:0/3641477849 >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 0x7f6edc0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 --2- 172.21.15.134:0/3641477849 >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 0x7f6edc0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 -- 172.21.15.134:0/3641477849 >> v1:172.21.15.177:6789/0 conn(0x7f6edc0d2300 legacy=0x7f6edc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2482640 1 -- 172.21.15.134:0/3641477849 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc0d3d50 con 0x7f6edc163060 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.595+0000 7f6ee2c83640 1 --2- 172.21.15.134:0/3641477849 >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 0x7f6edc0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee2482640 1 --2- 172.21.15.134:0/3641477849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc163060 0x7f6edc0cef90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6edc06e940 tx=0x7f6ed802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07013665a56d7e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee1480640 1 -- 172.21.15.134:0/3641477849 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8037070 con 0x7f6edc163060 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee1480640 1 -- 172.21.15.134:0/3641477849 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed8032440 con 0x7f6edc163060 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee1480640 1 -- 172.21.15.134:0/3641477849 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8032810 con 0x7f6edc163060 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 -- 172.21.15.134:0/3641477849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc163060 msgr2=0x7f6edc0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/3641477849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc163060 0x7f6edc0cef90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6edc06e940 tx=0x7f6ed802a230 comp rx=0 tx=0).stop 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 -- 172.21.15.134:0/3641477849 shutdown_connections 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/3641477849 >> v2:172.21.15.177:3300/0 conn(0x7f6edc0b8ab0 0x7f6edc0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/3641477849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc163060 0x7f6edc0cef90 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 -- 172.21.15.134:0/3641477849 >> 172.21.15.134:0/3641477849 conn(0x7f6edc0b6240 msgr2=0x7f6edc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:40.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 -- 172.21.15.134:0/3641477849 shutdown_connections 2024-09-15T22:47:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.596+0000 7f6ee46e6640 1 -- 172.21.15.134:0/3641477849 wait complete. 2024-09-15T22:47:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 Processor -- start 2024-09-15T22:47:40.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 -- start start 2024-09-15T22:47:40.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 0x7f6edc1638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6edc163060 0x7f6edc0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc0d31f0 con 0x7f6edc0d2300 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc0b3ea0 con 0x7f6edc163060 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee46e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc0d3370 con 0x7f6edc0b8ab0 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee1c81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee1c81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56678/0 (socket says 172.21.15.134:56678) 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.598+0000 7f6ee1c81640 1 -- 172.21.15.134:0/1725864612 learned_addr learned my addr 172.21.15.134:0/1725864612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee2c83640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6edc163060 0x7f6edc0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee2482640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 0x7f6edc1638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 -- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 msgr2=0x7f6edc1638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 0x7f6edc1638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 -- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6edc163060 msgr2=0x7f6edc0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6edc163060 0x7f6edc0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 -- 172.21.15.134:0/1725864612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc0c9530 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee2482640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 0x7f6edc1638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee1c81640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00c430 tx=0x7f6ecc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011790 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc017070 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011bb0 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc0c97a0 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.599+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc0c9d60 con 0x7f6edc0d2300 2024-09-15T22:47:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.600+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6edc0cef90 con 0x7f6edc0d2300 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.600+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f6ecc01c460 con 0x7f6edc0d2300 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.601+0000 7f6ed2ffd640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 0x7f6ec006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.601+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4913+0+0 (secure 0 0 0) 0x7f6ecc08ba20 con 0x7f6edc0d2300 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.601+0000 7f6ee2482640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 0x7f6ec006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.602+0000 7f6ee2482640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 0x7f6ec006edd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8034000 tx=0x7f6ed802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.605+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ecc059bf0 con 0x7f6edc0d2300 2024-09-15T22:47:40.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.831+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6edc161d80 con 0x7f6edc0d2300 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.831+0000 7f6ed2ffd640 1 -- 172.21.15.134:0/1725864612 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f6ecc0594f0 con 0x7f6edc0d2300 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.833 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:40.834 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:47:40.835 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.837 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.838 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:47:40.839 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.840 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.841 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.842 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.843 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:47:40.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:47:40.845 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:47:40.846 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.846 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:40.846 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:47:40.846 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:47:40.849 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:47:40.850 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:47:40.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.833+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 msgr2=0x7f6ec006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.833+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 0x7f6ec006edd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8034000 tx=0x7f6ed802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.833+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 msgr2=0x7f6edc0ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.833+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00c430 tx=0x7f6ecc00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 shutdown_connections 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6edc163060 0x7f6edc0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6ec006c910 0x7f6ec006edd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6edc0d2300 0x7f6edc0ca560 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 --2- 172.21.15.134:0/1725864612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6edc0b8ab0 0x7f6edc1638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 >> 172.21.15.134:0/1725864612 conn(0x7f6edc0b6240 msgr2=0x7f6edc0b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 shutdown_connections 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.834+0000 7f6ee46e6640 1 -- 172.21.15.134:0/1725864612 wait complete. 2024-09-15T22:47:40.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:47:40.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.955+0000 7fba3b586640 1 Processor -- start 2024-09-15T22:47:40.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.955+0000 7fba3b586640 1 -- start start 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba3b586640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 0x7fba340b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba3b586640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba340cef90 0x7fba340b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba3b586640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba340b7170 con 0x7fba3415e940 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba3b586640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fba340b7aa0 con 0x7fba340cef90 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba3b586640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fba340d3660 con 0x7fba3415ed20 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba39b23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba340cef90 0x7fba340b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba39322640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fba3415e940 0x7fba340d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43814/0 (socket says 172.21.15.134:43814) 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba39322640 1 -- 172.21.15.134:0/620770186 learned_addr learned my addr 172.21.15.134:0/620770186 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.956+0000 7fba39b23640 1 --2- 172.21.15.134:0/620770186 >> v2:172.21.15.134:3300/0 conn(0x7fba340cef90 0x7fba340b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56690/0 (socket says 172.21.15.134:56690) 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba38b21640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 0x7fba340b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba39b23640 1 -- 172.21.15.134:0/620770186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 msgr2=0x7fba340b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba33fff640 1 -- 172.21.15.134:0/620770186 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290550297 0 0) 0x7fba24001110 con 0x7fba3415e940 2024-09-15T22:47:40.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba39b23640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 0x7fba340b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba39b23640 1 -- 172.21.15.134:0/620770186 >> v1:172.21.15.134:6789/0 conn(0x7fba3415e940 legacy=0x7fba340d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba39b23640 1 -- 172.21.15.134:0/620770186 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba340d3940 con 0x7fba340cef90 2024-09-15T22:47:40.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba38b21640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 0x7fba340b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:40.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.957+0000 7fba39b23640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba340cef90 0x7fba340b3760 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009d90 tx=0x7fba2c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21abb2d698261b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba33fff640 1 -- 172.21.15.134:0/620770186 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c007740 con 0x7fba340cef90 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba33fff640 1 -- 172.21.15.134:0/620770186 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c0078e0 con 0x7fba340cef90 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba33fff640 1 -- 172.21.15.134:0/620770186 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c007cb0 con 0x7fba340cef90 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 -- 172.21.15.134:0/620770186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba340cef90 msgr2=0x7fba340b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba340cef90 0x7fba340b3760 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009d90 tx=0x7fba2c02a6f0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 -- 172.21.15.134:0/620770186 shutdown_connections 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba340cef90 0x7fba340b3760 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 --2- 172.21.15.134:0/620770186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba3415ed20 0x7fba340b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 -- 172.21.15.134:0/620770186 >> 172.21.15.134:0/620770186 conn(0x7fba340b6240 msgr2=0x7fba340b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:40.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 -- 172.21.15.134:0/620770186 shutdown_connections 2024-09-15T22:47:40.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.958+0000 7fba3b586640 1 -- 172.21.15.134:0/620770186 wait complete. 2024-09-15T22:47:40.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.959+0000 7fba3b586640 1 Processor -- start 2024-09-15T22:47:40.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.959+0000 7fba3b586640 1 -- start start 2024-09-15T22:47:40.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba340cef90 0x7fba341e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba3415ed20 0x7fba341f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d3310 con 0x7fba3415e940 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d3f00 con 0x7fba3415ed20 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba3b586640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fba340d1ef0 con 0x7fba340cef90 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56704/0 (socket says 172.21.15.134:56704) 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 -- 172.21.15.134:0/1863948745 learned_addr learned my addr 172.21.15.134:0/1863948745 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 -- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba340cef90 msgr2=0x7fba341e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba340cef90 0x7fba341e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 -- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba3415ed20 msgr2=0x7fba341f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba3415ed20 0x7fba341f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.960+0000 7fba38b21640 1 -- 172.21.15.134:0/1863948745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba34158960 con 0x7fba3415e940 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba38b21640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c820 tx=0x7fba2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28015070 con 0x7fba3415e940 2024-09-15T22:47:40.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba280079d0 con 0x7fba3415e940 2024-09-15T22:47:40.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28007d80 con 0x7fba3415e940 2024-09-15T22:47:40.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3415b4a0 con 0x7fba3415e940 2024-09-15T22:47:40.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.961+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3414c070 con 0x7fba3415e940 2024-09-15T22:47:40.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.962+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340d1060 con 0x7fba3415e940 2024-09-15T22:47:40.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.962+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fba28018070 con 0x7fba3415e940 2024-09-15T22:47:40.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.963+0000 7fba31ffb640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 0x7fba2006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:40.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.963+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4913+0+0 (secure 0 0 0) 0x7fba2808bba0 con 0x7fba3415e940 2024-09-15T22:47:40.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.963+0000 7fba39322640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 0x7fba2006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:40.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.964+0000 7fba39322640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 0x7fba2006edd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba24001620 tx=0x7fba24001310 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:40.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:40.967+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba28059bd0 con 0x7fba3415e940 2024-09-15T22:47:41.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.134+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fba340ba6b0 con 0x7fba3415e940 2024-09-15T22:47:41.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.134+0000 7fba31ffb640 1 -- 172.21.15.134:0/1863948745 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) ==== 84+0+65 (secure 0 0 0) 0x7fba280594d0 con 0x7fba3415e940 2024-09-15T22:47:41.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:41.136 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 msgr2=0x7fba2006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 0x7fba2006edd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba24001620 tx=0x7fba24001310 comp rx=0 tx=0).stop 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 msgr2=0x7fba341f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c820 tx=0x7fba2800cce0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 shutdown_connections 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba3415ed20 0x7fba341f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fba2006c910 0x7fba2006edd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3415e940 0x7fba341f4030 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 --2- 172.21.15.134:0/1863948745 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba340cef90 0x7fba341e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 >> 172.21.15.134:0/1863948745 conn(0x7fba340b6240 msgr2=0x7fba340cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 shutdown_connections 2024-09-15T22:47:41.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.136+0000 7fba3b586640 1 -- 172.21.15.134:0/1863948745 wait complete. 2024-09-15T22:47:41.148 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:47:41.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:47:41.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.250+0000 7f9f65df1640 1 Processor -- start 2024-09-15T22:47:41.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.250+0000 7f9f65df1640 1 -- start start 2024-09-15T22:47:41.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f600b4f70 0x7f9f6015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 0x7f9f600b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 0x7f9f60160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6015fcd0 con 0x7f9f600b4f70 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f9f600b5890 con 0x7f9f6015fed0 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f65df1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6006e9a0 con 0x7f9f6006fa40 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f600b4f70 0x7f9f6015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f600b4f70 0x7f9f6015f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56718/0 (socket says 172.21.15.134:56718) 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 -- 172.21.15.134:0/3538592394 learned_addr learned my addr 172.21.15.134:0/3538592394 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5effd640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 0x7f9f600b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5ffff640 1 --2- 172.21.15.134:0/3538592394 >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 0x7f9f60160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 -- 172.21.15.134:0/3538592394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 msgr2=0x7f9f600b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 0x7f9f600b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 -- 172.21.15.134:0/3538592394 >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 msgr2=0x7f9f60160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/3538592394 >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 0x7f9f60160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5f7fe640 1 -- 172.21.15.134:0/3538592394 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6006ec80 con 0x7f9f600b4f70 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5ffff640 1 --2- 172.21.15.134:0/3538592394 >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 0x7f9f60160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.251+0000 7f9f5effd640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 0x7f9f600b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.252+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f600b4f70 0x7f9f6015f790 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9f60073290 tx=0x7f9f5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c682a776bd7967dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.252+0000 7f9f5e7fc640 1 -- 172.21.15.134:0/3538592394 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50037070 con 0x7f9f600b4f70 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.252+0000 7f9f5e7fc640 1 -- 172.21.15.134:0/3538592394 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f50032440 con 0x7f9f600b4f70 2024-09-15T22:47:41.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.252+0000 7f9f5e7fc640 1 -- 172.21.15.134:0/3538592394 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50032810 con 0x7f9f600b4f70 2024-09-15T22:47:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 -- 172.21.15.134:0/3538592394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f600b4f70 msgr2=0x7f9f6015f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f600b4f70 0x7f9f6015f790 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9f60073290 tx=0x7f9f5002a270 comp rx=0 tx=0).stop 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 -- 172.21.15.134:0/3538592394 shutdown_connections 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 --2- 172.21.15.134:0/3538592394 >> v2:172.21.15.177:3300/0 conn(0x7f9f6015fed0 0x7f9f60160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f6006fa40 0x7f9f600b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 --2- 172.21.15.134:0/3538592394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f600b4f70 0x7f9f6015f790 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 -- 172.21.15.134:0/3538592394 >> 172.21.15.134:0/3538592394 conn(0x7f9f60062810 msgr2=0x7f9f6006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 -- 172.21.15.134:0/3538592394 shutdown_connections 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.253+0000 7f9f65df1640 1 -- 172.21.15.134:0/3538592394 wait complete. 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.254+0000 7f9f65df1640 1 Processor -- start 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.254+0000 7f9f65df1640 1 -- start start 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f6006fa40 0x7f9f6013bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f600b4f70 0x7f9f6013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006f520 con 0x7f9f6015fed0 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006f240 con 0x7f9f6006fa40 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f65df1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6006e620 con 0x7f9f600b4f70 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56722/0 (socket says 172.21.15.134:56722) 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 -- 172.21.15.134:0/1971390208 learned_addr learned my addr 172.21.15.134:0/1971390208 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 -- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f600b4f70 msgr2=0x7f9f6013ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5effd640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f600b4f70 0x7f9f6013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f6006fa40 0x7f9f6013bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f600b4f70 0x7f9f6013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 -- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f6006fa40 msgr2=0x7f9f6013bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f6006fa40 0x7f9f6013bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.255+0000 7f9f5ffff640 1 -- 172.21.15.134:0/1971390208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f60141ca0 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f5ffff640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009fa0 tx=0x7f9f5800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5801a070 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58003bb0 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58004030 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f60141f80 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.256+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f60142540 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.257+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6006bd50 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.257+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f9f5801d070 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.258+0000 7f9f47fff640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 0x7f9f4c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.258+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4913+0+0 (secure 0 0 0) 0x7f9f5808bf80 con 0x7f9f6015fed0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.258+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 0x7f9f4c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.259+0000 7f9f5f7fe640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 0x7f9f4c06eda0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f50034000 tx=0x7f9f5002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.262+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f58010070 con 0x7f9f6015fed0 2024-09-15T22:47:41.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.428+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9f600b5d60 con 0x7f9f6015fed0 2024-09-15T22:47:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.479+0000 7f9f47fff640 1 -- 172.21.15.134:0/1971390208 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) ==== 138+0+0 (secure 0 0 0) 0x7f9f5805a120 con 0x7f9f6015fed0 2024-09-15T22:47:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:47:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 msgr2=0x7f9f4c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 0x7f9f4c06eda0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f50034000 tx=0x7f9f5002e000 comp rx=0 tx=0).stop 2024-09-15T22:47:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 msgr2=0x7f9f6013f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009fa0 tx=0x7f9f5800d560 comp rx=0 tx=0).stop 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 shutdown_connections 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9f4c06c8e0 0x7f9f4c06eda0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6015fed0 0x7f9f6013f440 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f600b4f70 0x7f9f6013ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 --2- 172.21.15.134:0/1971390208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f6006fa40 0x7f9f6013bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 >> 172.21.15.134:0/1971390208 conn(0x7f9f60062810 msgr2=0x7f9f601614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 shutdown_connections 2024-09-15T22:47:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.483+0000 7f9f65df1640 1 -- 172.21.15.134:0/1971390208 wait complete. 2024-09-15T22:47:41.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:47:41.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.602+0000 7efd1c4ba640 1 Processor -- start 2024-09-15T22:47:41.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.602+0000 7efd1c4ba640 1 -- start start 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1c4ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd141554d0 0x7efd1415f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1c4ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd14072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1c4ba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd140af050 con 0x7efd140ae8e0 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1c4ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efd140af330 con 0x7efd141554d0 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1c4ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd140af610 con 0x7efd140b5630 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd141554d0 0x7efd1415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd141554d0 0x7efd1415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56732/0 (socket says 172.21.15.134:56732) 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 -- 172.21.15.134:0/3808083374 learned_addr learned my addr 172.21.15.134:0/3808083374 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1aa57640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd14072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 -- 172.21.15.134:0/3808083374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 msgr2=0x7efd14072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd14072a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 -- 172.21.15.134:0/3808083374 >> v1:172.21.15.134:6789/0 conn(0x7efd140ae8e0 legacy=0x7efd140b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd1a256640 1 -- 172.21.15.134:0/3808083374 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd140af8f0 con 0x7efd141554d0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.603+0000 7efd19254640 1 -- 172.21.15.134:0/3808083374 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311567329 0 0) 0x7efd140af050 con 0x7efd140ae8e0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.604+0000 7efd1a256640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd141554d0 0x7efd1415f640 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7efd10009870 tx=0x7efd1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2996f87846f47a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.604+0000 7efd19254640 1 -- 172.21.15.134:0/3808083374 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10037070 con 0x7efd141554d0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.604+0000 7efd19254640 1 -- 172.21.15.134:0/3808083374 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd10032440 con 0x7efd141554d0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.604+0000 7efd19254640 1 -- 172.21.15.134:0/3808083374 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10032810 con 0x7efd141554d0 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 -- 172.21.15.134:0/3808083374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd141554d0 msgr2=0x7efd1415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd141554d0 0x7efd1415f640 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7efd10009870 tx=0x7efd1002a270 comp rx=0 tx=0).stop 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 -- 172.21.15.134:0/3808083374 shutdown_connections 2024-09-15T22:47:41.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd14072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/3808083374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd141554d0 0x7efd1415f640 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 -- 172.21.15.134:0/3808083374 >> 172.21.15.134:0/3808083374 conn(0x7efd1406c9f0 msgr2=0x7efd1406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 -- 172.21.15.134:0/3808083374 shutdown_connections 2024-09-15T22:47:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.605+0000 7efd1c4ba640 1 -- 172.21.15.134:0/3808083374 wait complete. 2024-09-15T22:47:41.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.606+0000 7efd1c4ba640 1 Processor -- start 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.606+0000 7efd1c4ba640 1 -- start start 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd140d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd141554d0 0x7efd1415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd141558b0 con 0x7efd140ae8e0 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd140aed70 con 0x7efd141554d0 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1c4ba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd14155a30 con 0x7efd140b5630 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56744/0 (socket says 172.21.15.134:56744) 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 -- 172.21.15.134:0/1004124627 learned_addr learned my addr 172.21.15.134:0/1004124627 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1aa57640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd141554d0 0x7efd1415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd19a55640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd140d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 -- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 msgr2=0x7efd140d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd140d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 -- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd141554d0 msgr2=0x7efd1415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd141554d0 0x7efd1415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 -- 172.21.15.134:0/1004124627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1415bb80 con 0x7efd140ae8e0 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd19a55640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd140d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.607+0000 7efd1a256640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7efd10009870 tx=0x7efd100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.608+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10041020 con 0x7efd140ae8e0 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.608+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd100306c0 con 0x7efd140ae8e0 2024-09-15T22:47:41.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.608+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10037040 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.608+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1415a5a0 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.608+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1415ab60 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.609+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd14073990 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.609+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7efd10044020 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.610+0000 7efd0affd640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 0x7efcf806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.610+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5283+0+0 (secure 0 0 0) 0x7efd100ac440 con 0x7efd140ae8e0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.610+0000 7efd19a55640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 0x7efcf806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.611+0000 7efd19a55640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 0x7efcf806eda0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd14156770 tx=0x7efd04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.614+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd14073990 con 0x7efd140ae8e0 2024-09-15T22:47:41.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:41.779+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efd14161d80 con 0x7efd140ae8e0 2024-09-15T22:47:42.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.482+0000 7efd0affd640 1 -- 172.21.15.134:0/1004124627 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) ==== 170+0+0 (secure 0 0 0) 0x7efd14161d80 con 0x7efd140ae8e0 2024-09-15T22:47:42.483 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:47:42.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 msgr2=0x7efcf806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 0x7efcf806eda0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd14156770 tx=0x7efd04009040 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 msgr2=0x7efd14148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7efd10009870 tx=0x7efd100046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 shutdown_connections 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd141554d0 0x7efd1415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd140b5630 0x7efd140d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efcf806c8e0 0x7efcf806eda0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 --2- 172.21.15.134:0/1004124627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd140ae8e0 0x7efd14148850 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 >> 172.21.15.134:0/1004124627 conn(0x7efd1406c9f0 msgr2=0x7efd1415fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 shutdown_connections 2024-09-15T22:47:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.484+0000 7efd1c4ba640 1 -- 172.21.15.134:0/1004124627 wait complete. 2024-09-15T22:47:42.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:47:42.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.613+0000 7fb1493d6640 1 Processor -- start 2024-09-15T22:47:42.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.613+0000 7fb1493d6640 1 -- start start 2024-09-15T22:47:42.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1493d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb144161e30 0x7fb1440d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1493d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb14406dfd0 0x7fb1440b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1493d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1440cf9a0 con 0x7fb1440b3d50 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1493d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb1440cfcf0 con 0x7fb144161e30 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1493d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb144162210 con 0x7fb14406dfd0 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb142ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb144161e30 0x7fb1440d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1427fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb1440b3d50 0x7fb14406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43828/0 (socket says 172.21.15.134:43828) 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb1427fc640 1 -- 172.21.15.134:0/1697972605 learned_addr learned my addr 172.21.15.134:0/1697972605 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.614+0000 7fb142ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb144161e30 0x7fb1440d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56752/0 (socket says 172.21.15.134:56752) 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb1437fe640 1 --2- 172.21.15.134:0/1697972605 >> v2:172.21.15.177:3300/0 conn(0x7fb14406dfd0 0x7fb1440b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb142ffd640 1 -- 172.21.15.134:0/1697972605 >> v2:172.21.15.177:3300/0 conn(0x7fb14406dfd0 msgr2=0x7fb1440b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb142ffd640 1 --2- 172.21.15.134:0/1697972605 >> v2:172.21.15.177:3300/0 conn(0x7fb14406dfd0 0x7fb1440b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb142ffd640 1 -- 172.21.15.134:0/1697972605 >> v1:172.21.15.134:6789/0 conn(0x7fb1440b3d50 legacy=0x7fb14406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb141ffb640 1 -- 172.21.15.134:0/1697972605 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486881174 0 0) 0x7fb1440cf9a0 con 0x7fb1440b3d50 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb142ffd640 1 -- 172.21.15.134:0/1697972605 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1440d5210 con 0x7fb144161e30 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.615+0000 7fb142ffd640 1 --2- 172.21.15.134:0/1697972605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb144161e30 0x7fb1440d34a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb1440b3ce0 tx=0x7fb13402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244bdc43cfa4de8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb141ffb640 1 -- 172.21.15.134:0/1697972605 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134007740 con 0x7fb144161e30 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb141ffb640 1 -- 172.21.15.134:0/1697972605 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1340078e0 con 0x7fb144161e30 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb141ffb640 1 -- 172.21.15.134:0/1697972605 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134007cb0 con 0x7fb144161e30 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 -- 172.21.15.134:0/1697972605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb144161e30 msgr2=0x7fb1440d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 --2- 172.21.15.134:0/1697972605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb144161e30 0x7fb1440d34a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb1440b3ce0 tx=0x7fb13402a680 comp rx=0 tx=0).stop 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 -- 172.21.15.134:0/1697972605 shutdown_connections 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 --2- 172.21.15.134:0/1697972605 >> v2:172.21.15.177:3300/0 conn(0x7fb14406dfd0 0x7fb1440b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 --2- 172.21.15.134:0/1697972605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb144161e30 0x7fb1440d34a0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 -- 172.21.15.134:0/1697972605 >> 172.21.15.134:0/1697972605 conn(0x7fb1440d1870 msgr2=0x7fb1440d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 -- 172.21.15.134:0/1697972605 shutdown_connections 2024-09-15T22:47:42.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.616+0000 7fb1493d6640 1 -- 172.21.15.134:0/1697972605 wait complete. 2024-09-15T22:47:42.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.617+0000 7fb1493d6640 1 Processor -- start 2024-09-15T22:47:42.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 -- start start 2024-09-15T22:47:42.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1440b3d50 0x7fb1440cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb144161e30 0x7fb1440cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440d39e0 con 0x7fb14406dfd0 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440b3950 con 0x7fb144161e30 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb1493d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb1440b4760 con 0x7fb1440b3d50 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb142ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb142ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56766/0 (socket says 172.21.15.134:56766) 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.618+0000 7fb142ffd640 1 -- 172.21.15.134:0/2029984202 learned_addr learned my addr 172.21.15.134:0/2029984202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb1427fc640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1440b3d50 0x7fb1440cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb1437fe640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb144161e30 0x7fb1440cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 -- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1440b3d50 msgr2=0x7fb1440cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1440b3d50 0x7fb1440cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 -- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb144161e30 msgr2=0x7fb1440cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb144161e30 0x7fb1440cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 -- 172.21.15.134:0/2029984202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1440b4a40 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb142ffd640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb134009e80 tx=0x7fb134004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13403f070 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb134031c40 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134044460 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1440b4d20 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.619+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1440b52e0 con 0x7fb14406dfd0 2024-09-15T22:47:42.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.620+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1440b3290 con 0x7fb14406dfd0 2024-09-15T22:47:42.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.621+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fb13403b410 con 0x7fb14406dfd0 2024-09-15T22:47:42.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.621+0000 7fb13b7fe640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 0x7fb12406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.621+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5665+0+0 (secure 0 0 0) 0x7fb1340ad590 con 0x7fb14406dfd0 2024-09-15T22:47:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.621+0000 7fb1427fc640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 0x7fb12406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.622+0000 7fb1427fc640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 0x7fb12406eda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1440d0b20 tx=0x7fb12c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:42.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.625+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb13407ae80 con 0x7fb14406dfd0 2024-09-15T22:47:42.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:42.825+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb144069190 con 0x7fb14406dfd0 2024-09-15T22:47:43.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.510+0000 7fb13b7fe640 1 -- 172.21.15.134:0/2029984202 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v73) ==== 174+0+0 (secure 0 0 0) 0x7fb13407f180 con 0x7fb14406dfd0 2024-09-15T22:47:43.511 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 22 and data pool 23 2024-09-15T22:47:43.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.523+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 msgr2=0x7fb12406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.523+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 0x7fb12406eda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1440d0b20 tx=0x7fb12c007d50 comp rx=0 tx=0).stop 2024-09-15T22:47:43.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.524+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 msgr2=0x7fb144151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.524+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb134009e80 tx=0x7fb134004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.529+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 shutdown_connections 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.529+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb144161e30 0x7fb1440cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.530+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1440b3d50 0x7fb1440cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.530+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb12406c8e0 0x7fb12406eda0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.530+0000 7fb1493d6640 1 --2- 172.21.15.134:0/2029984202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb14406dfd0 0x7fb144151b80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.530+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 >> 172.21.15.134:0/2029984202 conn(0x7fb1440d1870 msgr2=0x7fb144161070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:43.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.531+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 shutdown_connections 2024-09-15T22:47:43.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.531+0000 7fb1493d6640 1 -- 172.21.15.134:0/2029984202 wait complete. 2024-09-15T22:47:43.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:43.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 Processor -- start 2024-09-15T22:47:43.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 -- start start 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fece00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fece015ed20 0x7fece00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece00b7170 con 0x7fece00cef90 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fece00d1ae0 con 0x7fece015ed20 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.648+0000 7fece598d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fece00b7aa0 con 0x7fece015e940 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecdf7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fece00cef90 0x7fece00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43834/0 (socket says 172.21.15.134:43834) 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecdf7fe640 1 -- 172.21.15.134:0/183955781 learned_addr learned my addr 172.21.15.134:0/183955781 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecdeffd640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fece00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecde7fc640 1 --2- 172.21.15.134:0/183955781 >> v2:172.21.15.177:3300/0 conn(0x7fece015ed20 0x7fece00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593804572 0 0) 0x7fecd8001490 con 0x7fece00cef90 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc8003520 con 0x7fece00cef90 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541346880 0 0) 0x7fecc8003520 con 0x7fece00cef90 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 msgr2=0x7fece00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fece00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 >> v2:172.21.15.177:3300/0 conn(0x7fece015ed20 msgr2=0x7fece00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 --2- 172.21.15.134:0/183955781 >> v2:172.21.15.177:3300/0 conn(0x7fece015ed20 0x7fece00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece00d3660 con 0x7fece00cef90 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fecd8001bc0 con 0x7fece00cef90 2024-09-15T22:47:43.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 >> v1:172.21.15.134:6789/0 conn(0x7fece00cef90 legacy=0x7fece00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc80039b0 0x7fecc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecc8004800 0x7fecc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fecc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fece00b7aa0 con 0x7fecc80039b0 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fecc800b9c0 con 0x7fecc8004800 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fecc800bb40 con 0x7fece015e940 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecdeffd640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc80039b0 0x7fecc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecde7fc640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecc8004800 0x7fecc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.649+0000 7fecdf7fe640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fecc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 -- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 msgr2=0x7fecc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fecc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 -- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecc8004800 msgr2=0x7fecc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecc8004800 0x7fecc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 -- 172.21.15.134:0/183955781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc8003520 con 0x7fecc80039b0 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdf7fe640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fece015e940 0x7fecc80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecdeffd640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc80039b0 0x7fecc8003dd0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009ac0 tx=0x7fecc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf03bbccc035af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0036070 con 0x7fecc80039b0 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd0031400 con 0x7fecc80039b0 2024-09-15T22:47:43.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.650+0000 7fecddffb640 1 -- 172.21.15.134:0/183955781 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0009690 con 0x7fecc80039b0 2024-09-15T22:47:43.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 -- 172.21.15.134:0/183955781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc80039b0 msgr2=0x7fecc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 --2- 172.21.15.134:0/183955781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc80039b0 0x7fecc8003dd0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009ac0 tx=0x7fecc8005830 comp rx=0 tx=0).stop 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fecdf7fe640 1 -- 172.21.15.134:0/183955781 reap_dead start 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 -- 172.21.15.134:0/183955781 shutdown_connections 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 -- 172.21.15.134:0/183955781 >> 172.21.15.134:0/183955781 conn(0x7fece00b6240 msgr2=0x7fece00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 -- 172.21.15.134:0/183955781 shutdown_connections 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.651+0000 7fece598d640 1 -- 172.21.15.134:0/183955781 wait complete. 2024-09-15T22:47:43.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.652+0000 7fece598d640 1 Processor -- start 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.652+0000 7fece598d640 1 -- start start 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 0x7fece015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 0x7fece01f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fece00d3f00 con 0x7fece01f46e0 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fece00d3c20 con 0x7fece014ad70 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fece598d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fece00d3310 con 0x7fecc80039b0 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56788/0 (socket says 172.21.15.134:56788) 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 -- 172.21.15.134:0/750061899 learned_addr learned my addr 172.21.15.134:0/750061899 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecde7fc640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 0x7fece01f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdeffd640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 0x7fece015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 -- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 msgr2=0x7fece015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 0x7fece015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 -- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 msgr2=0x7fece01f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 0x7fece01f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdf7fe640 1 -- 172.21.15.134:0/750061899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece015acb0 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecdeffd640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 0x7fece015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.653+0000 7fecde7fc640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 0x7fece01f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fecdf7fe640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fece00d04f0 tx=0x7fecd800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd800eb30 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd8019070 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8013420 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece015af90 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.654+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece015b550 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.655+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece00d1ef0 con 0x7fece01f46e0 2024-09-15T22:47:43.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.655+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fecd80135c0 con 0x7fece01f46e0 2024-09-15T22:47:43.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.656+0000 7fecc7fff640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 0x7feccc06edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.656+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5765+0+0 (secure 0 0 0) 0x7fecd808c210 con 0x7fece01f46e0 2024-09-15T22:47:43.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.656+0000 7fecdeffd640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 0x7feccc06edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.656+0000 7fecdeffd640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 0x7feccc06edd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fecd0033000 tx=0x7fecd0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.660+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fece00b7170 con 0x7fece01f46e0 2024-09-15T22:47:43.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.825+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fece00ba6b0 con 0x7fece01f46e0 2024-09-15T22:47:43.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.826+0000 7fecc7fff640 1 -- 172.21.15.134:0/750061899 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+16877 (secure 0 0 0) 0x7fecd805a0c0 con 0x7fece01f46e0 2024-09-15T22:47:43.827 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:43.827 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":145,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:42.826489+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:41.447309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:41.798619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 msgr2=0x7feccc06edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 0x7feccc06edd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fecd0033000 tx=0x7fecd0008030 comp rx=0 tx=0).stop 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 msgr2=0x7fece0158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fece00d04f0 tx=0x7fecd800e530 comp rx=0 tx=0).stop 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 shutdown_connections 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7feccc06c910 0x7feccc06edd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fece01f46e0 0x7fece0158700 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fece014ad70 0x7fece01f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 --2- 172.21.15.134:0/750061899 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fecc80039b0 0x7fece015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 >> 172.21.15.134:0/750061899 conn(0x7fece00b6240 msgr2=0x7fece00d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 shutdown_connections 2024-09-15T22:47:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.828+0000 7fece598d640 1 -- 172.21.15.134:0/750061899 wait complete. 2024-09-15T22:47:43.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:43.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.937+0000 7f5ffff8d640 1 Processor -- start 2024-09-15T22:47:43.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.937+0000 7f5ffff8d640 1 -- start start 2024-09-15T22:47:43.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815e940 0x7f5ff80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffff8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ff80cef90 0x7f5ff80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffff8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff80b7170 con 0x7f5ff815ed20 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffff8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff80d1ae0 con 0x7f5ff80cef90 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80b7aa0 con 0x7f5ff815e940 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ff80cef90 0x7f5ff80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ff80cef90 0x7f5ff80d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56790/0 (socket says 172.21.15.134:56790) 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffd528640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5ff815ed20 0x7f5ff80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43850/0 (socket says 172.21.15.134:43850) 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 -- 172.21.15.134:0/2207832242 learned_addr learned my addr 172.21.15.134:0/2207832242 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffdd29640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815e940 0x7f5ff80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 -- 172.21.15.134:0/2207832242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815e940 msgr2=0x7f5ff80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815e940 0x7f5ff80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 -- 172.21.15.134:0/2207832242 >> v1:172.21.15.134:6789/0 conn(0x7f5ff815ed20 legacy=0x7f5ff80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffe52a640 1 -- 172.21.15.134:0/2207832242 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80d3660 con 0x7f5ff80cef90 2024-09-15T22:47:43.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.938+0000 7f5ffcd27640 1 -- 172.21.15.134:0/2207832242 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391052125 0 0) 0x7f5fec001110 con 0x7f5ff815ed20 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffe52a640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff80cef90 0x7f5ff80d15a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009e50 tx=0x7f5ff002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d5065f31d9cfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffcd27640 1 -- 172.21.15.134:0/2207832242 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0036070 con 0x7f5ff80cef90 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffcd27640 1 -- 172.21.15.134:0/2207832242 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0031600 con 0x7f5ff80cef90 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffcd27640 1 -- 172.21.15.134:0/2207832242 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00319d0 con 0x7f5ff80cef90 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2207832242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff80cef90 msgr2=0x7f5ff80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff80cef90 0x7f5ff80d15a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009e50 tx=0x7f5ff002a7a0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2207832242 shutdown_connections 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff80cef90 0x7f5ff80d15a0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2207832242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815e940 0x7f5ff80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.939+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2207832242 >> 172.21.15.134:0/2207832242 conn(0x7f5ff80b6240 msgr2=0x7f5ff80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:43.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.940+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2207832242 shutdown_connections 2024-09-15T22:47:43.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.940+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2207832242 wait complete. 2024-09-15T22:47:43.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 Processor -- start 2024-09-15T22:47:43.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 -- start start 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff80cef90 0x7f5ff80ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815ed20 0x7f5ff81f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80d3f00 con 0x7f5ff815e940 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80d3c20 con 0x7f5ff80cef90 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.941+0000 7f5ffff8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80d3310 con 0x7f5ff815ed20 2024-09-15T22:47:43.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56792/0 (socket says 172.21.15.134:56792) 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 -- 172.21.15.134:0/2796402972 learned_addr learned my addr 172.21.15.134:0/2796402972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffdd29640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff80cef90 0x7f5ff80ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffe52a640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815ed20 0x7f5ff81f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 -- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815ed20 msgr2=0x7f5ff81f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815ed20 0x7f5ff81f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 -- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff80cef90 msgr2=0x7f5ff80ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff80cef90 0x7f5ff80ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 -- 172.21.15.134:0/2796402972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff8157fa0 con 0x7f5ff815e940 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffd528640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c780 tx=0x7f5fec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec018070 con 0x7f5ff815e940 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec0072d0 con 0x7f5ff815e940 2024-09-15T22:47:43.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81591f0 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0047e0 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.942+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff81597b0 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.943+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff80d1f80 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.944+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f5fec01b070 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.944+0000 7f5fea7fc640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 0x7f5fdc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.944+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5765+0+0 (secure 0 0 0) 0x7f5fec08b250 con 0x7f5ff815e940 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.944+0000 7f5ffdd29640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 0x7f5fdc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:43.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.945+0000 7f5ffdd29640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 0x7f5fdc06eda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4006fd0 tx=0x7f5ff4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:43.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:43.948+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ff80b7170 con 0x7f5ff815e940 2024-09-15T22:47:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.113+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff80ba6b0 con 0x7f5ff815e940 2024-09-15T22:47:44.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.114+0000 7f5fea7fc640 1 -- 172.21.15.134:0/2796402972 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+16877 (secure 0 0 0) 0x7f5fec0589f0 con 0x7f5ff815e940 2024-09-15T22:47:44.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:44.116 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":145,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:42.826489+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:41.447309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:41.798619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 msgr2=0x7f5fdc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 0x7f5fdc06eda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4006fd0 tx=0x7f5ff4008040 comp rx=0 tx=0).stop 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 msgr2=0x7f5ff81f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c780 tx=0x7f5fec00cc40 comp rx=0 tx=0).stop 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 shutdown_connections 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ff815ed20 0x7f5ff81f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5fdc06c8e0 0x7f5fdc06eda0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ff815e940 0x7f5ff81f4a30 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 --2- 172.21.15.134:0/2796402972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff80cef90 0x7f5ff80ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 >> 172.21.15.134:0/2796402972 conn(0x7f5ff80b6240 msgr2=0x7f5ff80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 shutdown_connections 2024-09-15T22:47:44.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.116+0000 7f5ffff8d640 1 -- 172.21.15.134:0/2796402972 wait complete. 2024-09-15T22:47:44.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:47:44.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.230+0000 7f99b6752640 1 Processor -- start 2024-09-15T22:47:44.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.230+0000 7f99b6752640 1 -- start start 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b6752640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99b006dfd0 0x7f99b00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b6752640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b00cf9a0 con 0x7f99b0161e30 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b6752640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b0162210 con 0x7f99b00b3d50 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b6752640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f99b00cfcf0 con 0x7f99b006dfd0 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b4cef640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99b006dfd0 0x7f99b00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b4cef640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99b006dfd0 0x7f99b00b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56802/0 (socket says 172.21.15.134:56802) 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99b4cef640 1 -- 172.21.15.134:0/1260519633 learned_addr learned my addr 172.21.15.134:0/1260519633 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:44.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.231+0000 7f99affff640 1 --1- 172.21.15.134:0/1260519633 >> v1:172.21.15.134:6789/0 conn(0x7f99b0161e30 0x7f99b00d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43856/0 (socket says 172.21.15.134:43856) 2024-09-15T22:47:44.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99b4cef640 1 -- 172.21.15.134:0/1260519633 >> v1:172.21.15.177:6789/0 conn(0x7f99b00b3d50 legacy=0x7f99b006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99b4cef640 1 -- 172.21.15.134:0/1260519633 >> v1:172.21.15.134:6789/0 conn(0x7f99b0161e30 legacy=0x7f99b00d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99b4cef640 1 -- 172.21.15.134:0/1260519633 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b00d5210 con 0x7f99b006dfd0 2024-09-15T22:47:44.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99aeffd640 1 -- 172.21.15.134:0/1260519633 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296228144 0 0) 0x7f99b00cf9a0 con 0x7f99b0161e30 2024-09-15T22:47:44.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99b4cef640 1 --2- 172.21.15.134:0/1260519633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b006dfd0 0x7f99b00b78b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c77273bd3c3cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99aeffd640 1 -- 172.21.15.134:0/1260519633 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8036070 con 0x7f99b006dfd0 2024-09-15T22:47:44.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.232+0000 7f99aeffd640 1 -- 172.21.15.134:0/1260519633 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a8031600 con 0x7f99b006dfd0 2024-09-15T22:47:44.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99aeffd640 1 -- 172.21.15.134:0/1260519633 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80319f0 con 0x7f99b006dfd0 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 -- 172.21.15.134:0/1260519633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b006dfd0 msgr2=0x7f99b00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 --2- 172.21.15.134:0/1260519633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b006dfd0 0x7f99b00b78b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a802a7c0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 -- 172.21.15.134:0/1260519633 shutdown_connections 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 --2- 172.21.15.134:0/1260519633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b006dfd0 0x7f99b00b78b0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 -- 172.21.15.134:0/1260519633 >> 172.21.15.134:0/1260519633 conn(0x7f99b00d1870 msgr2=0x7f99b00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 -- 172.21.15.134:0/1260519633 shutdown_connections 2024-09-15T22:47:44.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.233+0000 7f99b6752640 1 -- 172.21.15.134:0/1260519633 wait complete. 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.234+0000 7f99b6752640 1 Processor -- start 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.234+0000 7f99b6752640 1 -- start start 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 0x7f99b01f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 0x7f99b0149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99b00b3290 con 0x7f99b0161e30 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99b00b3950 con 0x7f99b00b3d50 2024-09-15T22:47:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b6752640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99b00b3410 con 0x7f99b006dfd0 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b4cef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b4cef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56806/0 (socket says 172.21.15.134:56806) 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99b4cef640 1 -- 172.21.15.134:0/2393309319 learned_addr learned my addr 172.21.15.134:0/2393309319 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99af7fe640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 0x7f99b0149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.235+0000 7f99affff640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 0x7f99b01f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 -- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 msgr2=0x7f99b01f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 0x7f99b01f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 -- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 msgr2=0x7f99b0149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 0x7f99b0149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 -- 172.21.15.134:0/2393309319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b00ca4d0 con 0x7f99b0161e30 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99af7fe640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 0x7f99b0149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99affff640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 0x7f99b01f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b4cef640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009f70 tx=0x7f99a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8036050 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a8042070 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8009510 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b00ca7b0 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.236+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b00cad70 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.237+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b0069190 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.237+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f99a8004450 con 0x7f99b0161e30 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.238+0000 7f99acff9640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 0x7f999c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.238+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5765+0+0 (secure 0 0 0) 0x7f99a80ace20 con 0x7f99b0161e30 2024-09-15T22:47:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.238+0000 7f99affff640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 0x7f999c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.239+0000 7f99affff640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 0x7f999c06eda0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99a0000f60 tx=0x7f99a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.242+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99a807ac70 con 0x7f99b0161e30 2024-09-15T22:47:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.441+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f99b00ceaf0 con 0x7f99b0161e30 2024-09-15T22:47:44.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.513+0000 7f99acff9640 1 -- 172.21.15.134:0/2393309319 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) ==== 118+0+0 (secure 0 0 0) 0x7f99a807a570 con 0x7f99b0161e30 2024-09-15T22:47:44.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 msgr2=0x7f999c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 0x7f999c06eda0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99a0000f60 tx=0x7f99a0009040 comp rx=0 tx=0).stop 2024-09-15T22:47:44.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 msgr2=0x7f99b0149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009f70 tx=0x7f99a8004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 shutdown_connections 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f999c06c8e0 0x7f999c06eda0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b0161e30 0x7f99b0149d50 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99b00b3d50 0x7f99b0149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 --2- 172.21.15.134:0/2393309319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99b006dfd0 0x7f99b01f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 >> 172.21.15.134:0/2393309319 conn(0x7f99b00d1870 msgr2=0x7f99b00b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 shutdown_connections 2024-09-15T22:47:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.515+0000 7f99b6752640 1 -- 172.21.15.134:0/2393309319 wait complete. 2024-09-15T22:47:44.529 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:47:44.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:47:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.630+0000 7f3626e8d640 1 Processor -- start 2024-09-15T22:47:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.630+0000 7f3626e8d640 1 -- start start 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3626e8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36200d1230 0x7f36200714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3626e8d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3620070c40 0x7f36200b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3626e8d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362015ee60 con 0x7f36200b73a0 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3626e8d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3620162670 con 0x7f3620070c40 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3626e8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f3620162950 con 0x7f36200d1230 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3620070c40 0x7f36200b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3620070c40 0x7f36200b6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56818/0 (socket says 172.21.15.134:56818) 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 -- 172.21.15.134:0/2093203218 learned_addr learned my addr 172.21.15.134:0/2093203218 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f362542a640 1 --1- 172.21.15.134:0/2093203218 >> v1:172.21.15.134:6789/0 conn(0x7f36200b73a0 0x7f36200731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43872/0 (socket says 172.21.15.134:43872) 2024-09-15T22:47:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3624c29640 1 --2- 172.21.15.134:0/2093203218 >> v2:172.21.15.177:3300/0 conn(0x7f36200d1230 0x7f36200714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 -- 172.21.15.134:0/2093203218 >> v2:172.21.15.177:3300/0 conn(0x7f36200d1230 msgr2=0x7f36200714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 --2- 172.21.15.134:0/2093203218 >> v2:172.21.15.177:3300/0 conn(0x7f36200d1230 0x7f36200714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 -- 172.21.15.134:0/2093203218 >> v1:172.21.15.134:6789/0 conn(0x7f36200b73a0 legacy=0x7f36200731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f36177fe640 1 -- 172.21.15.134:0/2093203218 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062353085 0 0) 0x7f362015ee60 con 0x7f36200b73a0 2024-09-15T22:47:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.631+0000 7f3617fff640 1 -- 172.21.15.134:0/2093203218 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3620162c30 con 0x7f3620070c40 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.632+0000 7f3617fff640 1 --2- 172.21.15.134:0/2093203218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3620070c40 0x7f36200b6e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3620072e30 tx=0x7f361002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647ce696f636891 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.632+0000 7f36177fe640 1 -- 172.21.15.134:0/2093203218 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610037070 con 0x7f3620070c40 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.632+0000 7f36177fe640 1 -- 172.21.15.134:0/2093203218 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3610032440 con 0x7f3620070c40 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.632+0000 7f36177fe640 1 -- 172.21.15.134:0/2093203218 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610032810 con 0x7f3620070c40 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 -- 172.21.15.134:0/2093203218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3620070c40 msgr2=0x7f36200b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 --2- 172.21.15.134:0/2093203218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3620070c40 0x7f36200b6e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3620072e30 tx=0x7f361002a270 comp rx=0 tx=0).stop 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 -- 172.21.15.134:0/2093203218 shutdown_connections 2024-09-15T22:47:44.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 --2- 172.21.15.134:0/2093203218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3620070c40 0x7f36200b6e60 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 --2- 172.21.15.134:0/2093203218 >> v2:172.21.15.177:3300/0 conn(0x7f36200d1230 0x7f36200714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 -- 172.21.15.134:0/2093203218 >> 172.21.15.134:0/2093203218 conn(0x7f362006f370 msgr2=0x7f362006f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 -- 172.21.15.134:0/2093203218 shutdown_connections 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.633+0000 7f3626e8d640 1 -- 172.21.15.134:0/2093203218 wait complete. 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.635+0000 7f3626e8d640 1 Processor -- start 2024-09-15T22:47:44.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.635+0000 7f3626e8d640 1 -- start start 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3620070c40 0x7f3620159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b73a0 0x7f36201f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3620071a30 con 0x7f36200d1230 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36200b7830 con 0x7f36200b73a0 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3626e8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f36200aacd0 con 0x7f3620070c40 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56820/0 (socket says 172.21.15.134:56820) 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 -- 172.21.15.134:0/3628719967 learned_addr learned my addr 172.21.15.134:0/3628719967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3617fff640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b73a0 0x7f36201f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f3624c29640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3620070c40 0x7f3620159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 -- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3620070c40 msgr2=0x7f3620159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3620070c40 0x7f3620159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 -- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b73a0 msgr2=0x7f36201f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b73a0 0x7f36201f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.636+0000 7f362542a640 1 -- 172.21.15.134:0/3628719967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36200aafb0 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f362542a640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f361800c7a0 tx=0x7f361800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618018070 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361800a640 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36200ab290 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361800aab0 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.637+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36201f9d80 con 0x7f36200d1230 2024-09-15T22:47:44.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.638+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36200d1610 con 0x7f36200d1230 2024-09-15T22:47:44.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.638+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f361801b070 con 0x7f36200d1230 2024-09-15T22:47:44.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.639+0000 7f36157fa640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 0x7f360c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.639+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f361808b4d0 con 0x7f36200d1230 2024-09-15T22:47:44.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.639+0000 7f3624c29640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 0x7f360c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.639+0000 7f3624c29640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 0x7f360c06eda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f361c0079a0 tx=0x7f361c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.643+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3618058d00 con 0x7f36200d1230 2024-09-15T22:47:44.753 INFO:tasks.ceph.mds.c.smithi134.stderr:2024-09-15T22:47:44.752+0000 7f7b48d41640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:47:44.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:44.841+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3620071bb0 con 0x7f36200d1230 2024-09-15T22:47:45.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.526+0000 7f36157fa640 1 -- 172.21.15.134:0/3628719967 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) ==== 122+0+0 (secure 0 0 0) 0x7f361805d000 con 0x7f36200d1230 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 msgr2=0x7f360c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 0x7f360c06eda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f361c0079a0 tx=0x7f361c008040 comp rx=0 tx=0).stop 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 msgr2=0x7f36200ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f361800c7a0 tx=0x7f361800cc60 comp rx=0 tx=0).stop 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 shutdown_connections 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06c8e0 0x7f360c06eda0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d1230 0x7f36200ad3e0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b73a0 0x7f36201f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 --2- 172.21.15.134:0/3628719967 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3620070c40 0x7f3620159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 >> 172.21.15.134:0/3628719967 conn(0x7f362006f370 msgr2=0x7f36200d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:45.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 shutdown_connections 2024-09-15T22:47:45.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.529+0000 7f3626e8d640 1 -- 172.21.15.134:0/3628719967 wait complete. 2024-09-15T22:47:45.549 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:47:45.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:45.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.652+0000 7ff8198a6640 1 Processor -- start 2024-09-15T22:47:45.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.652+0000 7ff8198a6640 1 -- start start 2024-09-15T22:47:45.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8198a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8198a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff8140cef90 0x7ff8140d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8198a6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8140b7170 con 0x7ff81415ed20 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8198a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff8140d1ae0 con 0x7ff8140cef90 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8198a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff8140b7aa0 con 0x7ff81415e940 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff8137fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff8140cef90 0x7ff8140d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:58984/0 (socket says 172.21.15.134:58984) 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 -- 172.21.15.134:0/3850706237 learned_addr learned my addr 172.21.15.134:0/3850706237 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 -- 172.21.15.134:0/3850706237 >> v2:172.21.15.177:3300/0 conn(0x7ff8140cef90 msgr2=0x7ff8140d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 --2- 172.21.15.134:0/3850706237 >> v2:172.21.15.177:3300/0 conn(0x7ff8140cef90 0x7ff8140d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 -- 172.21.15.134:0/3850706237 >> v1:172.21.15.177:6789/0 conn(0x7ff81415ed20 legacy=0x7ff8140b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.653+0000 7ff812ffd640 1 -- 172.21.15.134:0/3850706237 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8140d3660 con 0x7ff81415e940 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.654+0000 7ff812ffd640 1 --2- 172.21.15.134:0/3850706237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff804009870 tx=0x7ff80402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d96c3e35bd230d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.654+0000 7ff8127fc640 1 -- 172.21.15.134:0/3850706237 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804037070 con 0x7ff81415e940 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.654+0000 7ff8127fc640 1 -- 172.21.15.134:0/3850706237 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80402ae50 con 0x7ff81415e940 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.654+0000 7ff8127fc640 1 -- 172.21.15.134:0/3850706237 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804032860 con 0x7ff81415e940 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 -- 172.21.15.134:0/3850706237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 msgr2=0x7ff8140d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 --2- 172.21.15.134:0/3850706237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff804009870 tx=0x7ff80402a300 comp rx=0 tx=0).stop 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 -- 172.21.15.134:0/3850706237 shutdown_connections 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 --2- 172.21.15.134:0/3850706237 >> v2:172.21.15.177:3300/0 conn(0x7ff8140cef90 0x7ff8140d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 --2- 172.21.15.134:0/3850706237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff8140d1060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 -- 172.21.15.134:0/3850706237 >> 172.21.15.134:0/3850706237 conn(0x7ff8140b6240 msgr2=0x7ff8140b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 -- 172.21.15.134:0/3850706237 shutdown_connections 2024-09-15T22:47:45.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.655+0000 7ff8198a6640 1 -- 172.21.15.134:0/3850706237 wait complete. 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.656+0000 7ff8198a6640 1 Processor -- start 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.656+0000 7ff8198a6640 1 -- start start 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff814156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff81415ed20 0x7ff814154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140d3f00 con 0x7ff8140cef90 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140d3c20 con 0x7ff81415ed20 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8198a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff8140d3310 con 0x7ff81415e940 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56826/0 (socket says 172.21.15.134:56826) 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 -- 172.21.15.134:0/4003742087 learned_addr learned my addr 172.21.15.134:0/4003742087 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff8137fe640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff81415ed20 0x7ff814154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff80a7fc640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff814156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 -- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 msgr2=0x7ff814156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff814156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 -- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff81415ed20 msgr2=0x7ff814154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff81415ed20 0x7ff814154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff812ffd640 1 -- 172.21.15.134:0/4003742087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8140cb4b0 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.657+0000 7ff80a7fc640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff814156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff812ffd640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff804000c00 tx=0x7ff8040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804041070 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80403c660 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81415b400 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804037040 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.658+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81415b9c0 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.659+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8140d1f80 con 0x7ff8140cef90 2024-09-15T22:47:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.659+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7ff804044070 con 0x7ff8140cef90 2024-09-15T22:47:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.660+0000 7ff810ff9640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 0x7ff7f406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.660+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7ff8040ac6e0 con 0x7ff8140cef90 2024-09-15T22:47:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.660+0000 7ff80a7fc640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 0x7ff7f406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.660+0000 7ff80a7fc640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 0x7ff7f406eda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff8140cb7b0 tx=0x7ff7fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.664+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff804079fa0 con 0x7ff8140cef90 2024-09-15T22:47:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.862+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8140ba6b0 con 0x7ff8140cef90 2024-09-15T22:47:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.863+0000 7ff810ff9640 1 -- 172.21.15.134:0/4003742087 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5236 (secure 0 0 0) 0x7ff80407e2a0 con 0x7ff8140cef90 2024-09-15T22:47:45.866 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:45.866 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":75,"btime":"2024-09-15T22:47:45:520820+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:47:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 75 2024-09-15T22:47:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 msgr2=0x7ff7f406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 0x7ff7f406eda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff8140cb7b0 tx=0x7ff7fc009040 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 msgr2=0x7ff8140cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff804000c00 tx=0x7ff8040046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 shutdown_connections 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff81415ed20 0x7ff814154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff81415e940 0x7ff814156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff7f406c8e0 0x7ff7f406eda0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 --2- 172.21.15.134:0/4003742087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8140cef90 0x7ff8140cadf0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 >> 172.21.15.134:0/4003742087 conn(0x7ff8140b6240 msgr2=0x7ff8140b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 shutdown_connections 2024-09-15T22:47:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.865+0000 7ff8198a6640 1 -- 172.21.15.134:0/4003742087 wait complete. 2024-09-15T22:47:45.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:47:45.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.981+0000 7f0818f9d640 1 Processor -- start 2024-09-15T22:47:45.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.981+0000 7f0818f9d640 1 -- start start 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0818f9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f081406f510 0x7f08140b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0818f9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f0814161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0818f9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081406e680 con 0x7f0814162ed0 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0818f9d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f08140b5da0 con 0x7f081406f510 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0818f9d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f081406e2f0 con 0x7f081406f8f0 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0813fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0814162ed0 0x7f0814072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:43878/0 (socket says 172.21.15.134:43878) 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0813fff640 1 -- 172.21.15.134:0/2926953518 learned_addr learned my addr 172.21.15.134:0/2926953518 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:45.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990693186 0 0) 0x7f081406e680 con 0x7f0814162ed0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08137fe640 1 --2- 172.21.15.134:0/2926953518 >> v2:172.21.15.177:3300/0 conn(0x7f081406f510 0x7f08140b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07fc003520 con 0x7f0814162ed0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f0812ffd640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f0814161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677888687 0 0) 0x7f07fc003520 con 0x7f0814162ed0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 msgr2=0x7f0814161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f0814161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 >> v2:172.21.15.177:3300/0 conn(0x7f081406f510 msgr2=0x7f08140b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 --2- 172.21.15.134:0/2926953518 >> v2:172.21.15.177:3300/0 conn(0x7f081406f510 0x7f08140b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08140b57e0 con 0x7f0814162ed0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f080c001a10 con 0x7f0814162ed0 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 >> v1:172.21.15.134:6789/0 conn(0x7f0814162ed0 legacy=0x7f0814072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07fc0039b0 0x7f07fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.982+0000 7f08127fc640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f07fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f08127fc640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07fc004d40 0x7f07fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08140b5da0 con 0x7f07fc004d40 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc00b9f0 con 0x7f07fc0039b0 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc00bbf0 con 0x7f081406f8f0 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07fc004d40 0x7f07fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f08137fe640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07fc0039b0 0x7f07fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0812ffd640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f07fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 -- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 msgr2=0x7f07fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f081406f8f0 0x7f07fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 -- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07fc0039b0 msgr2=0x7f07fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07fc0039b0 0x7f07fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.983+0000 7f0813fff640 1 -- 172.21.15.134:0/2926953518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc003520 con 0x7f07fc004d40 2024-09-15T22:47:45.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0813fff640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07fc004d40 0x7f07fc0051c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f080c00a890 tx=0x7f07fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dee0888b54800e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c00a4e0 con 0x7f07fc004d40 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c02f070 con 0x7f07fc004d40 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f08127fc640 1 -- 172.21.15.134:0/2926953518 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c02bce0 con 0x7f07fc004d40 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 -- 172.21.15.134:0/2926953518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07fc004d40 msgr2=0x7f07fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 --2- 172.21.15.134:0/2926953518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07fc004d40 0x7f07fc0051c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f080c00a890 tx=0x7f07fc005830 comp rx=0 tx=0).stop 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0813fff640 1 -- 172.21.15.134:0/2926953518 reap_dead start 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 -- 172.21.15.134:0/2926953518 shutdown_connections 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 -- 172.21.15.134:0/2926953518 >> 172.21.15.134:0/2926953518 conn(0x7f0814062630 msgr2=0x7f0814062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 -- 172.21.15.134:0/2926953518 shutdown_connections 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.984+0000 7f0818f9d640 1 -- 172.21.15.134:0/2926953518 wait complete. 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.985+0000 7f0818f9d640 1 Processor -- start 2024-09-15T22:47:45.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 -- start start 2024-09-15T22:47:45.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08141592d0 0x7f08140d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08140d0940 0x7f0814145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08140b65e0 con 0x7f0814148650 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f08140b5590 con 0x7f08141592d0 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0818f9d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f081406eb60 con 0x7f08140d0940 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0812ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0812ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56846/0 (socket says 172.21.15.134:56846) 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.986+0000 7f0812ffd640 1 -- 172.21.15.134:0/3616783712 learned_addr learned my addr 172.21.15.134:0/3616783712 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f08137fe640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08141592d0 0x7f08140d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0813fff640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08140d0940 0x7f0814145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 -- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08140d0940 msgr2=0x7f0814145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08140d0940 0x7f0814145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 -- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08141592d0 msgr2=0x7f08140d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:45.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08141592d0 0x7f08140d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 -- 172.21.15.134:0/3616783712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08140cf360 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0812ffd640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f08080119a0 tx=0x7f0808011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080800f9d0 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080800fb70 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08140cf640 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808014440 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.987+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08140cfc00 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.988+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08140b60a0 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.989+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f0808012040 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.989+0000 7f07fbfff640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 0x7f080006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.989+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f080808c600 con 0x7f0814148650 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.989+0000 7f08137fe640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 0x7f080006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:45.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.990+0000 7f08137fe640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 0x7f080006edd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0804009bc0 tx=0x7f0804009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:45.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:45.994+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0808019030 con 0x7f0814148650 2024-09-15T22:47:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.159+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08140cee10 con 0x7f0814148650 2024-09-15T22:47:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.160+0000 7f07fbfff640 1 -- 172.21.15.134:0/3616783712 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16864 (secure 0 0 0) 0x7f080805a3f0 con 0x7f0814148650 2024-09-15T22:47:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:46.163 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":146,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:44.502033+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:41.447309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:41.798619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:47:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 msgr2=0x7f080006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 0x7f080006edd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0804009bc0 tx=0x7f0804009190 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 msgr2=0x7f08140d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f08080119a0 tx=0x7f0808011da0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 shutdown_connections 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08140d0940 0x7f0814145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f080006c910 0x7f080006edd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0814148650 0x7f08140d0400 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 --2- 172.21.15.134:0/3616783712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08141592d0 0x7f08140d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 >> 172.21.15.134:0/3616783712 conn(0x7f0814062630 msgr2=0x7f08140736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.162+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 shutdown_connections 2024-09-15T22:47:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.163+0000 7f0818f9d640 1 -- 172.21.15.134:0/3616783712 wait complete. 2024-09-15T22:47:46.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:47:46.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:46.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-15T22:47:46.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.273+0000 7f61e66af640 1 Processor -- start 2024-09-15T22:47:46.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.273+0000 7f61e66af640 1 -- start start 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61e015c180 0x7f61e00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e00ce230 0x7f61e00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61e00cf5b0 0x7f61e0073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f61e00ce740 con 0x7f61e015c180 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f61e0072640 con 0x7f61e00cf5b0 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61e66af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f61e0072920 con 0x7f61e00ce230 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61e015c180 0x7f61e00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61e015c180 0x7f61e00cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55034/0 (socket says 172.21.15.134:55034) 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 -- 172.21.15.134:0/1382034850 learned_addr learned my addr 172.21.15.134:0/1382034850 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 -- 172.21.15.134:0/1382034850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e00ce230 msgr2=0x7f61e00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 --2- 172.21.15.134:0/1382034850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e00ce230 0x7f61e00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 -- 172.21.15.134:0/1382034850 >> v2:172.21.15.177:3300/0 conn(0x7f61e00cf5b0 msgr2=0x7f61e0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 --2- 172.21.15.134:0/1382034850 >> v2:172.21.15.177:3300/0 conn(0x7f61e00cf5b0 0x7f61e0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.274+0000 7f61dffff640 1 -- 172.21.15.134:0/1382034850 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e0072c00 con 0x7f61e015c180 2024-09-15T22:47:46.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.275+0000 7f61dffff640 1 --2- 172.21.15.134:0/1382034850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e015c180 0x7f61e00cdcf0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f61e00afe30 tx=0x7f61d002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc040faeed35e3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.275+0000 7f61deffd640 1 -- 172.21.15.134:0/1382034850 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0037070 con 0x7f61e015c180 2024-09-15T22:47:46.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.275+0000 7f61deffd640 1 -- 172.21.15.134:0/1382034850 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d0032440 con 0x7f61e015c180 2024-09-15T22:47:46.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.275+0000 7f61deffd640 1 -- 172.21.15.134:0/1382034850 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0032810 con 0x7f61e015c180 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 -- 172.21.15.134:0/1382034850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e015c180 msgr2=0x7f61e00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 --2- 172.21.15.134:0/1382034850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e015c180 0x7f61e00cdcf0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f61e00afe30 tx=0x7f61d002a160 comp rx=0 tx=0).stop 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 -- 172.21.15.134:0/1382034850 shutdown_connections 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 --2- 172.21.15.134:0/1382034850 >> v2:172.21.15.177:3300/0 conn(0x7f61e00cf5b0 0x7f61e0073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 --2- 172.21.15.134:0/1382034850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e00ce230 0x7f61e00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 --2- 172.21.15.134:0/1382034850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e015c180 0x7f61e00cdcf0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 -- 172.21.15.134:0/1382034850 >> 172.21.15.134:0/1382034850 conn(0x7f61e0062cc0 msgr2=0x7f61e006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 -- 172.21.15.134:0/1382034850 shutdown_connections 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.276+0000 7f61e66af640 1 -- 172.21.15.134:0/1382034850 wait complete. 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.277+0000 7f61e66af640 1 Processor -- start 2024-09-15T22:47:46.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.277+0000 7f61e66af640 1 -- start start 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 0x7f61e014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 0x7f61e0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61e015c560 con 0x7f61e00ce230 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61e00722f0 con 0x7f61e00cf5b0 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e66af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f61e015c6e0 con 0x7f61e015c180 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55038/0 (socket says 172.21.15.134:55038) 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 -- 172.21.15.134:0/1533666909 learned_addr learned my addr 172.21.15.134:0/1533666909 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61df7fe640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 0x7f61e014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e4c4c640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 0x7f61e0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 -- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 msgr2=0x7f61e0150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 0x7f61e0150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 -- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 msgr2=0x7f61e014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 0x7f61e014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61dffff640 1 -- 172.21.15.134:0/1533666909 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e00b4380 con 0x7f61e00ce230 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61df7fe640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 0x7f61e014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.278+0000 7f61e4c4c640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 0x7f61e0150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61dffff640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000c00 tx=0x7f61d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0041070 con 0x7f61e00ce230 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d003c890 con 0x7f61e00ce230 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e00b35c0 con 0x7f61e00ce230 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0037040 con 0x7f61e00ce230 2024-09-15T22:47:46.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.279+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e00b3b80 con 0x7f61e00ce230 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.280+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e00736f0 con 0x7f61e00ce230 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.280+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f61d0044070 con 0x7f61e00ce230 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.281+0000 7f61dcff9640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 0x7f61cc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.281+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f61d00accd0 con 0x7f61e00ce230 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.281+0000 7f61df7fe640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 0x7f61cc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.281+0000 7f61df7fe640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 0x7f61cc06eda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61e01f7920 tx=0x7f61d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.285+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61d007ac70 con 0x7f61e00ce230 2024-09-15T22:47:46.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.446+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61e0150940 con 0x7f61cc06c8e0 2024-09-15T22:47:46.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.452+0000 7f61dcff9640 1 -- 172.21.15.134:0/1533666909 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7f61d4009e00 con 0x7f61cc06c8e0 2024-09-15T22:47:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:46.457 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 msgr2=0x7f61cc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 0x7f61cc06eda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61e01f7920 tx=0x7f61d4008040 comp rx=0 tx=0).stop 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 msgr2=0x7f61e015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000c00 tx=0x7f61d00046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 shutdown_connections 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e015c180 0x7f61e0150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e00cf5b0 0x7f61e014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f61cc06c8e0 0x7f61cc06eda0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.455+0000 7f61e66af640 1 --2- 172.21.15.134:0/1533666909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61e00ce230 0x7f61e015a4a0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.456+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 >> 172.21.15.134:0/1533666909 conn(0x7f61e0062cc0 msgr2=0x7f61e00cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.456+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 shutdown_connections 2024-09-15T22:47:46.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.456+0000 7f61e66af640 1 -- 172.21.15.134:0/1533666909 wait complete. 2024-09-15T22:47:46.468 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-15T22:47:45.215260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264652,"kb_used_data":15096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710068,"statfs":{"total":773094113280,"available":772823109632,"internally_reserved":0,"allocated":15458304,"data_stored":7439628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000759"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490041+0000","last_change":"2024-09-15T22:47:41.490041+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490041+0000","last_undegraded":"2024-09-15T22:47:41.490041+0000","last_fullsized":"2024-09-15T22:47:41.490041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.485181+0000","last_change":"2024-09-15T22:47:41.485181+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.485181+0000","last_undegraded":"2024-09-15T22:47:41.485181+0000","last_fullsized":"2024-09-15T22:47:41.485181+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487414+0000","last_change":"2024-09-15T22:47:41.487414+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487414+0000","last_undegraded":"2024-09-15T22:47:41.487414+0000","last_fullsized":"2024-09-15T22:47:41.487414+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491912+0000","last_change":"2024-09-15T22:47:41.491912+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491912+0000","last_undegraded":"2024-09-15T22:47:41.491912+0000","last_fullsized":"2024-09-15T22:47:41.491912+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490090+0000","last_change":"2024-09-15T22:47:41.490090+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490090+0000","last_undegraded":"2024-09-15T22:47:41.490090+0000","last_fullsized":"2024-09-15T22:47:41.490090+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488538+0000","last_change":"2024-09-15T22:47:41.488538+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488538+0000","last_undegraded":"2024-09-15T22:47:41.488538+0000","last_fullsized":"2024-09-15T22:47:41.488538+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490472+0000","last_change":"2024-09-15T22:47:41.490472+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490472+0000","last_undegraded":"2024-09-15T22:47:41.490472+0000","last_fullsized":"2024-09-15T22:47:41.490472+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490556+0000","last_change":"2024-09-15T22:47:41.490556+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490556+0000","last_undegraded":"2024-09-15T22:47:41.490556+0000","last_fullsized":"2024-09-15T22:47:41.490556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487439+0000","last_change":"2024-09-15T22:47:41.487439+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487439+0000","last_undegraded":"2024-09-15T22:47:41.487439+0000","last_fullsized":"2024-09-15T22:47:41.487439+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490691+0000","last_change":"2024-09-15T22:47:41.490691+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490691+0000","last_undegraded":"2024-09-15T22:47:41.490691+0000","last_fullsized":"2024-09-15T22:47:41.490691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490754+0000","last_change":"2024-09-15T22:47:41.490754+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490754+0000","last_undegraded":"2024-09-15T22:47:41.490754+0000","last_fullsized":"2024-09-15T22:47:41.490754+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488751+0000","last_change":"2024-09-15T22:47:41.488751+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488751+0000","last_undegraded":"2024-09-15T22:47:41.488751+0000","last_fullsized":"2024-09-15T22:47:41.488751+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487435+0000","last_change":"2024-09-15T22:47:41.487435+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487435+0000","last_undegraded":"2024-09-15T22:47:41.487435+0000","last_fullsized":"2024-09-15T22:47:41.487435+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488752+0000","last_change":"2024-09-15T22:47:41.488752+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488752+0000","last_undegraded":"2024-09-15T22:47:41.488752+0000","last_fullsized":"2024-09-15T22:47:41.488752+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490471+0000","last_change":"2024-09-15T22:47:41.490471+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490471+0000","last_undegraded":"2024-09-15T22:47:41.490471+0000","last_fullsized":"2024-09-15T22:47:41.490471+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491046+0000","last_change":"2024-09-15T22:47:41.491046+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491046+0000","last_undegraded":"2024-09-15T22:47:41.491046+0000","last_fullsized":"2024-09-15T22:47:41.491046+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.484772+0000","last_change":"2024-09-15T22:47:41.484772+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.484772+0000","last_undegraded":"2024-09-15T22:47:41.484772+0000","last_fullsized":"2024-09-15T22:47:41.484772+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490690+0000","last_change":"2024-09-15T22:47:41.490690+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490690+0000","last_undegraded":"2024-09-15T22:47:41.490690+0000","last_fullsized":"2024-09-15T22:47:41.490690+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491111+0000","last_change":"2024-09-15T22:47:41.491111+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491111+0000","last_undegraded":"2024-09-15T22:47:41.491111+0000","last_fullsized":"2024-09-15T22:47:41.491111+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.489345+0000","last_change":"2024-09-15T22:47:41.489345+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.489345+0000","last_undegraded":"2024-09-15T22:47:41.489345+0000","last_fullsized":"2024-09-15T22:47:41.489345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486481+0000","last_change":"2024-09-15T22:47:41.486481+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486481+0000","last_undegraded":"2024-09-15T22:47:41.486481+0000","last_fullsized":"2024-09-15T22:47:41.486481+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487695+0000","last_change":"2024-09-15T22:47:41.487695+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487695+0000","last_undegraded":"2024-09-15T22:47:41.487695+0000","last_fullsized":"2024-09-15T22:47:41.487695+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486510+0000","last_change":"2024-09-15T22:47:41.486510+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486510+0000","last_undegraded":"2024-09-15T22:47:41.486510+0000","last_fullsized":"2024-09-15T22:47:41.486510+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490138+0000","last_change":"2024-09-15T22:47:41.490138+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490138+0000","last_undegraded":"2024-09-15T22:47:41.490138+0000","last_fullsized":"2024-09-15T22:47:41.490138+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490669+0000","last_change":"2024-09-15T22:47:41.490669+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490669+0000","last_undegraded":"2024-09-15T22:47:41.490669+0000","last_fullsized":"2024-09-15T22:47:41.490669+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490494+0000","last_change":"2024-09-15T22:47:41.490494+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490494+0000","last_undegraded":"2024-09-15T22:47:41.490494+0000","last_fullsized":"2024-09-15T22:47:41.490494+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487499+0000","last_change":"2024-09-15T22:47:41.487499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487499+0000","last_undegraded":"2024-09-15T22:47:41.487499+0000","last_fullsized":"2024-09-15T22:47:41.487499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490079+0000","last_change":"2024-09-15T22:47:41.490079+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490079+0000","last_undegraded":"2024-09-15T22:47:41.490079+0000","last_fullsized":"2024-09-15T22:47:41.490079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490036+0000","last_change":"2024-09-15T22:47:41.490036+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490036+0000","last_undegraded":"2024-09-15T22:47:41.490036+0000","last_fullsized":"2024-09-15T22:47:41.490036+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491453+0000","last_change":"2024-09-15T22:47:41.491453+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491453+0000","last_undegraded":"2024-09-15T22:47:41.491453+0000","last_fullsized":"2024-09-15T22:47:41.491453+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":433,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-15T22:47:41.491928+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:41.491928+0000","last_peered":"2024-09-15T22:47:41.491928+0000","last_clean":"2024-09-15T22:47:41.491928+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:41.491928+0000","last_undegraded":"2024-09-15T22:47:41.491928+0000","last_fullsized":"2024-09-15T22:47:41.491928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:46.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:46.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 Processor -- start 2024-09-15T22:47:46.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 -- start start 2024-09-15T22:47:46.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19c40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c40b7170 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c40b7aa0 con 0x7f19c415e940 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.607+0000 7f19c8cd7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19c40d3660 con 0x7f19c415ed20 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c2d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f19c40cef90 0x7f19c40b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55116/0 (socket says 172.21.15.134:55116) 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c2d9d640 1 -- 172.21.15.134:0/3059753498 learned_addr learned my addr 172.21.15.134:0/3059753498 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19bbfff640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19c40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840048092 0 0) 0x7f19bc001490 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19b0003520 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2544330641 0 0) 0x7f19b0003520 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 msgr2=0x7f19c40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19c40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 >> v1:172.21.15.177:6789/0 conn(0x7f19c415e940 legacy=0x7f19c40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c40d3940 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f19bc001bc0 con 0x7f19c40cef90 2024-09-15T22:47:46.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 >> v1:172.21.15.134:6789/0 conn(0x7f19c40cef90 legacy=0x7f19c40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b00039e0 0x7f19b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b0004390 0x7f19b0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19b00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40d3660 con 0x7f19b0004390 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19b000b9f0 con 0x7f19b00039e0 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19b000bbf0 con 0x7f19c415ed20 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19bbfff640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b0004390 0x7f19b0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c259c640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b00039e0 0x7f19b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.608+0000 7f19c2d9d640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19b00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 -- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 msgr2=0x7f19b00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c415ed20 0x7f19b00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 -- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b00039e0 msgr2=0x7f19b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b00039e0 0x7f19b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 -- 172.21.15.134:0/3059753498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b0003520 con 0x7f19b0004390 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19bbfff640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b0004390 0x7f19b0004860 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009ac0 tx=0x7f19b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab70f05259a26c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac036070 con 0x7f19b0004390 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac031400 con 0x7f19b0004390 2024-09-15T22:47:46.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.609+0000 7f19c1d9b640 1 -- 172.21.15.134:0/3059753498 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac009690 con 0x7f19b0004390 2024-09-15T22:47:46.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 -- 172.21.15.134:0/3059753498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b0004390 msgr2=0x7f19b0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/3059753498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19b0004390 0x7f19b0004860 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009ac0 tx=0x7f19b0005830 comp rx=0 tx=0).stop 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c2d9d640 1 -- 172.21.15.134:0/3059753498 reap_dead start 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 -- 172.21.15.134:0/3059753498 shutdown_connections 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 -- 172.21.15.134:0/3059753498 >> 172.21.15.134:0/3059753498 conn(0x7f19c40b6240 msgr2=0x7f19c40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 -- 172.21.15.134:0/3059753498 shutdown_connections 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.610+0000 7f19c8cd7640 1 -- 172.21.15.134:0/3059753498 wait complete. 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.611+0000 7f19c8cd7640 1 Processor -- start 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.611+0000 7f19c8cd7640 1 -- start start 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b0004390 0x7f19c4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c40cdfb0 0x7f19c40ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40d3310 con 0x7f19c40b54f0 2024-09-15T22:47:46.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40d3f00 con 0x7f19b0004390 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c8cd7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19c40d1ef0 con 0x7f19c40cdfb0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55062/0 (socket says 172.21.15.134:55062) 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c2d9d640 1 -- 172.21.15.134:0/2491162693 learned_addr learned my addr 172.21.15.134:0/2491162693 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c259c640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b0004390 0x7f19c4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19bbfff640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c40cdfb0 0x7f19c40ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.612+0000 7f19c2d9d640 1 -- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c40cdfb0 msgr2=0x7f19c40ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c2d9d640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c40cdfb0 0x7f19c40ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c2d9d640 1 -- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b0004390 msgr2=0x7f19c4157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c2d9d640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b0004390 0x7f19c4157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c2d9d640 1 -- 172.21.15.134:0/2491162693 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c40cba50 con 0x7f19c40b54f0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c2d9d640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000f80 tx=0x7f19bc007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00eaa0 con 0x7f19c40b54f0 2024-09-15T22:47:46.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc018070 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c40cbd30 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00ee80 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.613+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c40cc2f0 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.614+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c40b5eb0 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.614+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f19bc01d460 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.615+0000 7f19baffd640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 0x7f19a406edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.615+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f19bc08c0a0 con 0x7f19c40b54f0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.615+0000 7f19c259c640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 0x7f19a406edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.616+0000 7f19c259c640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 0x7f19a406edd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f19b4000c00 tx=0x7f19b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.619+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19c40b7170 con 0x7f19c40b54f0 2024-09-15T22:47:46.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.782+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19c40cb800 con 0x7f19a406c910 2024-09-15T22:47:46.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.788+0000 7f19baffd640 1 -- 172.21.15.134:0/2491162693 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7f19c40cb800 con 0x7f19a406c910 2024-09-15T22:47:46.791 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:46.792 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 msgr2=0x7f19a406edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 0x7f19a406edd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f19b4000c00 tx=0x7f19b4009040 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 msgr2=0x7f19c40b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000f80 tx=0x7f19bc007b70 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 shutdown_connections 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f19a406c910 0x7f19a406edd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40b54f0 0x7f19c40b5970 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19c40cdfb0 0x7f19c40ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 --2- 172.21.15.134:0/2491162693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19b0004390 0x7f19c4157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 >> 172.21.15.134:0/2491162693 conn(0x7f19c40b6240 msgr2=0x7f19c41603c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 shutdown_connections 2024-09-15T22:47:46.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.791+0000 7f19c8cd7640 1 -- 172.21.15.134:0/2491162693 wait complete. 2024-09-15T22:47:46.803 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-15T22:47:45.215260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264652,"kb_used_data":15096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710068,"statfs":{"total":773094113280,"available":772823109632,"internally_reserved":0,"allocated":15458304,"data_stored":7439628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000759"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490041+0000","last_change":"2024-09-15T22:47:41.490041+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490041+0000","last_undegraded":"2024-09-15T22:47:41.490041+0000","last_fullsized":"2024-09-15T22:47:41.490041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.485181+0000","last_change":"2024-09-15T22:47:41.485181+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.485181+0000","last_undegraded":"2024-09-15T22:47:41.485181+0000","last_fullsized":"2024-09-15T22:47:41.485181+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487414+0000","last_change":"2024-09-15T22:47:41.487414+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487414+0000","last_undegraded":"2024-09-15T22:47:41.487414+0000","last_fullsized":"2024-09-15T22:47:41.487414+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491912+0000","last_change":"2024-09-15T22:47:41.491912+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491912+0000","last_undegraded":"2024-09-15T22:47:41.491912+0000","last_fullsized":"2024-09-15T22:47:41.491912+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490090+0000","last_change":"2024-09-15T22:47:41.490090+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490090+0000","last_undegraded":"2024-09-15T22:47:41.490090+0000","last_fullsized":"2024-09-15T22:47:41.490090+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488538+0000","last_change":"2024-09-15T22:47:41.488538+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488538+0000","last_undegraded":"2024-09-15T22:47:41.488538+0000","last_fullsized":"2024-09-15T22:47:41.488538+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490472+0000","last_change":"2024-09-15T22:47:41.490472+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490472+0000","last_undegraded":"2024-09-15T22:47:41.490472+0000","last_fullsized":"2024-09-15T22:47:41.490472+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490556+0000","last_change":"2024-09-15T22:47:41.490556+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490556+0000","last_undegraded":"2024-09-15T22:47:41.490556+0000","last_fullsized":"2024-09-15T22:47:41.490556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487439+0000","last_change":"2024-09-15T22:47:41.487439+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487439+0000","last_undegraded":"2024-09-15T22:47:41.487439+0000","last_fullsized":"2024-09-15T22:47:41.487439+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490691+0000","last_change":"2024-09-15T22:47:41.490691+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490691+0000","last_undegraded":"2024-09-15T22:47:41.490691+0000","last_fullsized":"2024-09-15T22:47:41.490691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490754+0000","last_change":"2024-09-15T22:47:41.490754+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490754+0000","last_undegraded":"2024-09-15T22:47:41.490754+0000","last_fullsized":"2024-09-15T22:47:41.490754+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488751+0000","last_change":"2024-09-15T22:47:41.488751+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488751+0000","last_undegraded":"2024-09-15T22:47:41.488751+0000","last_fullsized":"2024-09-15T22:47:41.488751+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487435+0000","last_change":"2024-09-15T22:47:41.487435+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487435+0000","last_undegraded":"2024-09-15T22:47:41.487435+0000","last_fullsized":"2024-09-15T22:47:41.487435+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488752+0000","last_change":"2024-09-15T22:47:41.488752+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488752+0000","last_undegraded":"2024-09-15T22:47:41.488752+0000","last_fullsized":"2024-09-15T22:47:41.488752+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490471+0000","last_change":"2024-09-15T22:47:41.490471+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490471+0000","last_undegraded":"2024-09-15T22:47:41.490471+0000","last_fullsized":"2024-09-15T22:47:41.490471+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491046+0000","last_change":"2024-09-15T22:47:41.491046+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491046+0000","last_undegraded":"2024-09-15T22:47:41.491046+0000","last_fullsized":"2024-09-15T22:47:41.491046+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.484772+0000","last_change":"2024-09-15T22:47:41.484772+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.484772+0000","last_undegraded":"2024-09-15T22:47:41.484772+0000","last_fullsized":"2024-09-15T22:47:41.484772+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490690+0000","last_change":"2024-09-15T22:47:41.490690+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490690+0000","last_undegraded":"2024-09-15T22:47:41.490690+0000","last_fullsized":"2024-09-15T22:47:41.490690+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491111+0000","last_change":"2024-09-15T22:47:41.491111+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491111+0000","last_undegraded":"2024-09-15T22:47:41.491111+0000","last_fullsized":"2024-09-15T22:47:41.491111+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.489345+0000","last_change":"2024-09-15T22:47:41.489345+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.489345+0000","last_undegraded":"2024-09-15T22:47:41.489345+0000","last_fullsized":"2024-09-15T22:47:41.489345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486481+0000","last_change":"2024-09-15T22:47:41.486481+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486481+0000","last_undegraded":"2024-09-15T22:47:41.486481+0000","last_fullsized":"2024-09-15T22:47:41.486481+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487695+0000","last_change":"2024-09-15T22:47:41.487695+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487695+0000","last_undegraded":"2024-09-15T22:47:41.487695+0000","last_fullsized":"2024-09-15T22:47:41.487695+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486510+0000","last_change":"2024-09-15T22:47:41.486510+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486510+0000","last_undegraded":"2024-09-15T22:47:41.486510+0000","last_fullsized":"2024-09-15T22:47:41.486510+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490138+0000","last_change":"2024-09-15T22:47:41.490138+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490138+0000","last_undegraded":"2024-09-15T22:47:41.490138+0000","last_fullsized":"2024-09-15T22:47:41.490138+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490669+0000","last_change":"2024-09-15T22:47:41.490669+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490669+0000","last_undegraded":"2024-09-15T22:47:41.490669+0000","last_fullsized":"2024-09-15T22:47:41.490669+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490494+0000","last_change":"2024-09-15T22:47:41.490494+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490494+0000","last_undegraded":"2024-09-15T22:47:41.490494+0000","last_fullsized":"2024-09-15T22:47:41.490494+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487499+0000","last_change":"2024-09-15T22:47:41.487499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487499+0000","last_undegraded":"2024-09-15T22:47:41.487499+0000","last_fullsized":"2024-09-15T22:47:41.487499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490079+0000","last_change":"2024-09-15T22:47:41.490079+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490079+0000","last_undegraded":"2024-09-15T22:47:41.490079+0000","last_fullsized":"2024-09-15T22:47:41.490079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490036+0000","last_change":"2024-09-15T22:47:41.490036+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490036+0000","last_undegraded":"2024-09-15T22:47:41.490036+0000","last_fullsized":"2024-09-15T22:47:41.490036+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491453+0000","last_change":"2024-09-15T22:47:41.491453+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491453+0000","last_undegraded":"2024-09-15T22:47:41.491453+0000","last_fullsized":"2024-09-15T22:47:41.491453+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":433,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-15T22:47:41.491928+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:41.491928+0000","last_peered":"2024-09-15T22:47:41.491928+0000","last_clean":"2024-09-15T22:47:41.491928+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:41.491928+0000","last_undegraded":"2024-09-15T22:47:41.491928+0000","last_fullsized":"2024-09-15T22:47:41.491928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:46.806 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.940+0000 7f7766b98640 1 Processor -- start 2024-09-15T22:47:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.940+0000 7f7766b98640 1 -- start start 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f7766b98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f7760162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f7766b98640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f776015ebb0 0x7f77600b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f7766b98640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776015f520 con 0x7f77600b3840 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f7766b98640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f776015fae0 con 0x7f776015ebb0 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f7766b98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f776015f800 con 0x7f7760162860 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f775ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f776015ebb0 0x7f77600b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f775ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f776015ebb0 0x7f77600b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55072/0 (socket says 172.21.15.134:55072) 2024-09-15T22:47:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.941+0000 7f775ffff640 1 -- 172.21.15.134:0/3493057564 learned_addr learned my addr 172.21.15.134:0/3493057564 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f7764934640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f7760162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f775ffff640 1 -- 172.21.15.134:0/3493057564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 msgr2=0x7f7760162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f775ffff640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f7760162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f775ffff640 1 -- 172.21.15.134:0/3493057564 >> v1:172.21.15.177:6789/0 conn(0x7f77600b3840 legacy=0x7f776006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f775ffff640 1 -- 172.21.15.134:0/3493057564 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600b2b00 con 0x7f776015ebb0 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.942+0000 7f775ffff640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f776015ebb0 0x7f77600b3300 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7748009870 tx=0x7f774802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e5a974e81c3afe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f775f7fe640 1 -- 172.21.15.134:0/3493057564 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748037070 con 0x7f776015ebb0 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f775f7fe640 1 -- 172.21.15.134:0/3493057564 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748032440 con 0x7f776015ebb0 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f775f7fe640 1 -- 172.21.15.134:0/3493057564 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748032810 con 0x7f776015ebb0 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 -- 172.21.15.134:0/3493057564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f776015ebb0 msgr2=0x7f77600b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f776015ebb0 0x7f77600b3300 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7748009870 tx=0x7f774802a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 -- 172.21.15.134:0/3493057564 shutdown_connections 2024-09-15T22:47:46.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f776015ebb0 0x7f77600b3300 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 --2- 172.21.15.134:0/3493057564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f7760162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 -- 172.21.15.134:0/3493057564 >> 172.21.15.134:0/3493057564 conn(0x7f776006ce90 msgr2=0x7f776006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:46.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 -- 172.21.15.134:0/3493057564 shutdown_connections 2024-09-15T22:47:46.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.943+0000 7f7766b98640 1 -- 172.21.15.134:0/3493057564 wait complete. 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.944+0000 7f7766b98640 1 Processor -- start 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.944+0000 7f7766b98640 1 -- start start 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 0x7f7760159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f77601ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f776006c430 con 0x7f77600b3840 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f776006c2b0 con 0x7f776015ebb0 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7766b98640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f776015eff0 con 0x7f7760162860 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7764934640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7764934640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55078/0 (socket says 172.21.15.134:55078) 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7764934640 1 -- 172.21.15.134:0/1247274088 learned_addr learned my addr 172.21.15.134:0/1247274088 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f7765135640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f77601ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.945+0000 7f775ffff640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 0x7f7760159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 -- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 msgr2=0x7f77601ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f77601ea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 -- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 msgr2=0x7f7760159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 0x7f7760159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 -- 172.21.15.134:0/1247274088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760157dd0 con 0x7f77600b3840 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f775ffff640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 0x7f7760159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7764934640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7750007e70 tx=0x7f775000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750014620 con 0x7f77600b3840 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750019070 con 0x7f77600b3840 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77601580b0 con 0x7f77600b3840 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750014a00 con 0x7f77600b3840 2024-09-15T22:47:46.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.946+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7760158670 con 0x7f77600b3840 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.947+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77600b3300 con 0x7f77600b3840 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.947+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f7750014ba0 con 0x7f77600b3840 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.948+0000 7f775d7fa640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 0x7f774006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.948+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f775008c860 con 0x7f77600b3840 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.948+0000 7f775ffff640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 0x7f774006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:46.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.949+0000 7f775ffff640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 0x7f774006eda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7748034000 tx=0x7f774802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:46.952+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f775005a650 con 0x7f77600b3840 2024-09-15T22:47:47.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.116+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f776006d3f0 con 0x7f774006c8e0 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.121+0000 7f775d7fa640 1 -- 172.21.15.134:0/1247274088 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7f776006d3f0 con 0x7f774006c8e0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 msgr2=0x7f774006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 0x7f774006eda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7748034000 tx=0x7f774802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 msgr2=0x7f7760154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7750007e70 tx=0x7f775000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 shutdown_connections 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7760162860 0x7f77601ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f776015ebb0 0x7f7760159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f774006c8e0 0x7f774006eda0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 --2- 172.21.15.134:0/1247274088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77600b3840 0x7f7760154a60 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 >> 172.21.15.134:0/1247274088 conn(0x7f776006ce90 msgr2=0x7f77600b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 shutdown_connections 2024-09-15T22:47:47.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.125+0000 7f7766b98640 1 -- 172.21.15.134:0/1247274088 wait complete. 2024-09-15T22:47:47.137 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-15T22:47:45.215260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264652,"kb_used_data":15096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710068,"statfs":{"total":773094113280,"available":772823109632,"internally_reserved":0,"allocated":15458304,"data_stored":7439628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000759"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490041+0000","last_change":"2024-09-15T22:47:41.490041+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490041+0000","last_undegraded":"2024-09-15T22:47:41.490041+0000","last_fullsized":"2024-09-15T22:47:41.490041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.485181+0000","last_change":"2024-09-15T22:47:41.485181+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.485181+0000","last_undegraded":"2024-09-15T22:47:41.485181+0000","last_fullsized":"2024-09-15T22:47:41.485181+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487414+0000","last_change":"2024-09-15T22:47:41.487414+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487414+0000","last_undegraded":"2024-09-15T22:47:41.487414+0000","last_fullsized":"2024-09-15T22:47:41.487414+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491912+0000","last_change":"2024-09-15T22:47:41.491912+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491912+0000","last_undegraded":"2024-09-15T22:47:41.491912+0000","last_fullsized":"2024-09-15T22:47:41.491912+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490090+0000","last_change":"2024-09-15T22:47:41.490090+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490090+0000","last_undegraded":"2024-09-15T22:47:41.490090+0000","last_fullsized":"2024-09-15T22:47:41.490090+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488538+0000","last_change":"2024-09-15T22:47:41.488538+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488538+0000","last_undegraded":"2024-09-15T22:47:41.488538+0000","last_fullsized":"2024-09-15T22:47:41.488538+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490472+0000","last_change":"2024-09-15T22:47:41.490472+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490472+0000","last_undegraded":"2024-09-15T22:47:41.490472+0000","last_fullsized":"2024-09-15T22:47:41.490472+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490556+0000","last_change":"2024-09-15T22:47:41.490556+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490556+0000","last_undegraded":"2024-09-15T22:47:41.490556+0000","last_fullsized":"2024-09-15T22:47:41.490556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487439+0000","last_change":"2024-09-15T22:47:41.487439+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487439+0000","last_undegraded":"2024-09-15T22:47:41.487439+0000","last_fullsized":"2024-09-15T22:47:41.487439+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490691+0000","last_change":"2024-09-15T22:47:41.490691+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490691+0000","last_undegraded":"2024-09-15T22:47:41.490691+0000","last_fullsized":"2024-09-15T22:47:41.490691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490754+0000","last_change":"2024-09-15T22:47:41.490754+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490754+0000","last_undegraded":"2024-09-15T22:47:41.490754+0000","last_fullsized":"2024-09-15T22:47:41.490754+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488751+0000","last_change":"2024-09-15T22:47:41.488751+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488751+0000","last_undegraded":"2024-09-15T22:47:41.488751+0000","last_fullsized":"2024-09-15T22:47:41.488751+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487435+0000","last_change":"2024-09-15T22:47:41.487435+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487435+0000","last_undegraded":"2024-09-15T22:47:41.487435+0000","last_fullsized":"2024-09-15T22:47:41.487435+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.488752+0000","last_change":"2024-09-15T22:47:41.488752+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.488752+0000","last_undegraded":"2024-09-15T22:47:41.488752+0000","last_fullsized":"2024-09-15T22:47:41.488752+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490471+0000","last_change":"2024-09-15T22:47:41.490471+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490471+0000","last_undegraded":"2024-09-15T22:47:41.490471+0000","last_fullsized":"2024-09-15T22:47:41.490471+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491046+0000","last_change":"2024-09-15T22:47:41.491046+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491046+0000","last_undegraded":"2024-09-15T22:47:41.491046+0000","last_fullsized":"2024-09-15T22:47:41.491046+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.484772+0000","last_change":"2024-09-15T22:47:41.484772+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.484772+0000","last_undegraded":"2024-09-15T22:47:41.484772+0000","last_fullsized":"2024-09-15T22:47:41.484772+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490690+0000","last_change":"2024-09-15T22:47:41.490690+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490690+0000","last_undegraded":"2024-09-15T22:47:41.490690+0000","last_fullsized":"2024-09-15T22:47:41.490690+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491111+0000","last_change":"2024-09-15T22:47:41.491111+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491111+0000","last_undegraded":"2024-09-15T22:47:41.491111+0000","last_fullsized":"2024-09-15T22:47:41.491111+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486499+0000","last_change":"2024-09-15T22:47:41.486499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486499+0000","last_undegraded":"2024-09-15T22:47:41.486499+0000","last_fullsized":"2024-09-15T22:47:41.486499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.489345+0000","last_change":"2024-09-15T22:47:41.489345+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.489345+0000","last_undegraded":"2024-09-15T22:47:41.489345+0000","last_fullsized":"2024-09-15T22:47:41.489345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486481+0000","last_change":"2024-09-15T22:47:41.486481+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486481+0000","last_undegraded":"2024-09-15T22:47:41.486481+0000","last_fullsized":"2024-09-15T22:47:41.486481+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487695+0000","last_change":"2024-09-15T22:47:41.487695+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487695+0000","last_undegraded":"2024-09-15T22:47:41.487695+0000","last_fullsized":"2024-09-15T22:47:41.487695+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.486510+0000","last_change":"2024-09-15T22:47:41.486510+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.486510+0000","last_undegraded":"2024-09-15T22:47:41.486510+0000","last_fullsized":"2024-09-15T22:47:41.486510+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490138+0000","last_change":"2024-09-15T22:47:41.490138+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490138+0000","last_undegraded":"2024-09-15T22:47:41.490138+0000","last_fullsized":"2024-09-15T22:47:41.490138+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490669+0000","last_change":"2024-09-15T22:47:41.490669+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490669+0000","last_undegraded":"2024-09-15T22:47:41.490669+0000","last_fullsized":"2024-09-15T22:47:41.490669+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490494+0000","last_change":"2024-09-15T22:47:41.490494+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490494+0000","last_undegraded":"2024-09-15T22:47:41.490494+0000","last_fullsized":"2024-09-15T22:47:41.490494+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.487499+0000","last_change":"2024-09-15T22:47:41.487499+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.487499+0000","last_undegraded":"2024-09-15T22:47:41.487499+0000","last_fullsized":"2024-09-15T22:47:41.487499+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490079+0000","last_change":"2024-09-15T22:47:41.490079+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490079+0000","last_undegraded":"2024-09-15T22:47:41.490079+0000","last_fullsized":"2024-09-15T22:47:41.490079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.490036+0000","last_change":"2024-09-15T22:47:41.490036+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.490036+0000","last_undegraded":"2024-09-15T22:47:41.490036+0000","last_fullsized":"2024-09-15T22:47:41.490036+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:47:42.480759+0000","last_change":"2024-09-15T22:47:42.480759+0000","last_active":"2024-09-15T22:47:42.480759+0000","last_peered":"2024-09-15T22:47:42.480759+0000","last_clean":"2024-09-15T22:47:42.480759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:42.480759+0000","last_undegraded":"2024-09-15T22:47:42.480759+0000","last_fullsized":"2024-09-15T22:47:42.480759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":143,"state":"creating+peering","last_fresh":"2024-09-15T22:47:41.491453+0000","last_change":"2024-09-15T22:47:41.491453+0000","last_active":"2024-09-15T22:47:41.474011+0000","last_peered":"2024-09-15T22:47:41.474011+0000","last_clean":"2024-09-15T22:47:41.474011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:47:41.491453+0000","last_undegraded":"2024-09-15T22:47:41.491453+0000","last_fullsized":"2024-09-15T22:47:41.491453+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":433,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-15T22:47:41.491928+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:41.491928+0000","last_peered":"2024-09-15T22:47:41.491928+0000","last_clean":"2024-09-15T22:47:41.491928+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:41.491928+0000","last_undegraded":"2024-09-15T22:47:41.491928+0000","last_fullsized":"2024-09-15T22:47:41.491928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1789952,"data_stored":785298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1375666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":779425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3f is not active+clean 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3e is not active+clean 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3d is not active+clean 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3c is not active+clean 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3b is not active+clean 2024-09-15T22:47:47.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3a is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.39 is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.38 is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.37 is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.36 is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:PG 23.35 is not active+clean 2024-09-15T22:47:47.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.34 is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.33 is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.32 is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.31 is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.30 is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2f is not active+clean 2024-09-15T22:47:47.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2e is not active+clean 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2d is not active+clean 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2c is not active+clean 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2b is not active+clean 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2a is not active+clean 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.144 INFO:tasks.ceph.ceph_manager.ceph:PG 23.29 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:PG 23.28 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:PG 23.27 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:PG 23.26 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:PG 23.25 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:PG 23.24 is not active+clean 2024-09-15T22:47:47.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 23.23 is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 23.22 is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 23.21 is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 23.20 is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1e is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1f is not active+clean 2024-09-15T22:47:47.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490041+0000', 'last_change': '2024-09-15T22:47:41.490041+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490041+0000', 'last_undegraded': '2024-09-15T22:47:41.490041+0000', 'last_fullsized': '2024-09-15T22:47:41.490041+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1f is not active+clean 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1e is not active+clean 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.485181+0000', 'last_change': '2024-09-15T22:47:41.485181+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.485181+0000', 'last_undegraded': '2024-09-15T22:47:41.485181+0000', 'last_fullsized': '2024-09-15T22:47:41.485181+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1c is not active+clean 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1d is not active+clean 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.487414+0000', 'last_change': '2024-09-15T22:47:41.487414+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.487414+0000', 'last_undegraded': '2024-09-15T22:47:41.487414+0000', 'last_fullsized': '2024-09-15T22:47:41.487414+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1d is not active+clean 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.147 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1c is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.491912+0000', 'last_change': '2024-09-15T22:47:41.491912+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.491912+0000', 'last_undegraded': '2024-09-15T22:47:41.491912+0000', 'last_fullsized': '2024-09-15T22:47:41.491912+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1a is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1b is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490090+0000', 'last_change': '2024-09-15T22:47:41.490090+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490090+0000', 'last_undegraded': '2024-09-15T22:47:41.490090+0000', 'last_fullsized': '2024-09-15T22:47:41.490090+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1b is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1a is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.488538+0000', 'last_change': '2024-09-15T22:47:41.488538+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.488538+0000', 'last_undegraded': '2024-09-15T22:47:41.488538+0000', 'last_fullsized': '2024-09-15T22:47:41.488538+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:PG 23.18 is not active+clean 2024-09-15T22:47:47.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 22.19 is not active+clean 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490472+0000', 'last_change': '2024-09-15T22:47:41.490472+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490472+0000', 'last_undegraded': '2024-09-15T22:47:41.490472+0000', 'last_fullsized': '2024-09-15T22:47:41.490472+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 23.19 is not active+clean 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 22.18 is not active+clean 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490556+0000', 'last_change': '2024-09-15T22:47:41.490556+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490556+0000', 'last_undegraded': '2024-09-15T22:47:41.490556+0000', 'last_fullsized': '2024-09-15T22:47:41.490556+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 23.17 is not active+clean 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 22.16 is not active+clean 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.487439+0000', 'last_change': '2024-09-15T22:47:41.487439+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.487439+0000', 'last_undegraded': '2024-09-15T22:47:41.487439+0000', 'last_fullsized': '2024-09-15T22:47:41.487439+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:47:47.149 INFO:tasks.ceph.ceph_manager.ceph:PG 23.14 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:PG 22.15 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490691+0000', 'last_change': '2024-09-15T22:47:41.490691+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490691+0000', 'last_undegraded': '2024-09-15T22:47:41.490691+0000', 'last_fullsized': '2024-09-15T22:47:41.490691+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:PG 23.15 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:PG 22.14 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490754+0000', 'last_change': '2024-09-15T22:47:41.490754+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490754+0000', 'last_undegraded': '2024-09-15T22:47:41.490754+0000', 'last_fullsized': '2024-09-15T22:47:41.490754+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:PG 23.12 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:PG 22.13 is not active+clean 2024-09-15T22:47:47.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.488751+0000', 'last_change': '2024-09-15T22:47:41.488751+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.488751+0000', 'last_undegraded': '2024-09-15T22:47:41.488751+0000', 'last_fullsized': '2024-09-15T22:47:41.488751+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:PG 23.13 is not active+clean 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:PG 22.12 is not active+clean 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.487435+0000', 'last_change': '2024-09-15T22:47:41.487435+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.487435+0000', 'last_undegraded': '2024-09-15T22:47:41.487435+0000', 'last_fullsized': '2024-09-15T22:47:41.487435+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:PG 23.10 is not active+clean 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:PG 22.11 is not active+clean 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.488752+0000', 'last_change': '2024-09-15T22:47:41.488752+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.488752+0000', 'last_undegraded': '2024-09-15T22:47:41.488752+0000', 'last_fullsized': '2024-09-15T22:47:41.488752+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:PG 23.11 is not active+clean 2024-09-15T22:47:47.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:PG 22.10 is not active+clean 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490471+0000', 'last_change': '2024-09-15T22:47:41.490471+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490471+0000', 'last_undegraded': '2024-09-15T22:47:41.490471+0000', 'last_fullsized': '2024-09-15T22:47:41.490471+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:PG 23.e is not active+clean 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:PG 22.f is not active+clean 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.491046+0000', 'last_change': '2024-09-15T22:47:41.491046+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.491046+0000', 'last_undegraded': '2024-09-15T22:47:41.491046+0000', 'last_fullsized': '2024-09-15T22:47:41.491046+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:PG 23.f is not active+clean 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:PG 22.e is not active+clean 2024-09-15T22:47:47.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.484772+0000', 'last_change': '2024-09-15T22:47:41.484772+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.484772+0000', 'last_undegraded': '2024-09-15T22:47:41.484772+0000', 'last_fullsized': '2024-09-15T22:47:41.484772+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:PG 23.c is not active+clean 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:PG 22.d is not active+clean 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490690+0000', 'last_change': '2024-09-15T22:47:41.490690+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490690+0000', 'last_undegraded': '2024-09-15T22:47:41.490690+0000', 'last_fullsized': '2024-09-15T22:47:41.490690+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:PG 23.d is not active+clean 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:PG 22.c is not active+clean 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.486499+0000', 'last_change': '2024-09-15T22:47:41.486499+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.486499+0000', 'last_undegraded': '2024-09-15T22:47:41.486499+0000', 'last_fullsized': '2024-09-15T22:47:41.486499+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:PG 23.a is not active+clean 2024-09-15T22:47:47.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:PG 22.b is not active+clean 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.491111+0000', 'last_change': '2024-09-15T22:47:41.491111+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.491111+0000', 'last_undegraded': '2024-09-15T22:47:41.491111+0000', 'last_fullsized': '2024-09-15T22:47:41.491111+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:PG 23.b is not active+clean 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:PG 22.a is not active+clean 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.486499+0000', 'last_change': '2024-09-15T22:47:41.486499+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.486499+0000', 'last_undegraded': '2024-09-15T22:47:41.486499+0000', 'last_fullsized': '2024-09-15T22:47:41.486499+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:PG 23.8 is not active+clean 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:PG 22.9 is not active+clean 2024-09-15T22:47:47.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.489345+0000', 'last_change': '2024-09-15T22:47:41.489345+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.489345+0000', 'last_undegraded': '2024-09-15T22:47:41.489345+0000', 'last_fullsized': '2024-09-15T22:47:41.489345+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 23.9 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 22.8 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.486481+0000', 'last_change': '2024-09-15T22:47:41.486481+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.486481+0000', 'last_undegraded': '2024-09-15T22:47:41.486481+0000', 'last_fullsized': '2024-09-15T22:47:41.486481+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 23.6 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 22.7 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.487695+0000', 'last_change': '2024-09-15T22:47:41.487695+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.487695+0000', 'last_undegraded': '2024-09-15T22:47:41.487695+0000', 'last_fullsized': '2024-09-15T22:47:41.487695+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 23.7 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:PG 22.6 is not active+clean 2024-09-15T22:47:47.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.486510+0000', 'last_change': '2024-09-15T22:47:41.486510+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.486510+0000', 'last_undegraded': '2024-09-15T22:47:41.486510+0000', 'last_fullsized': '2024-09-15T22:47:41.486510+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:PG 23.4 is not active+clean 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:PG 22.5 is not active+clean 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490138+0000', 'last_change': '2024-09-15T22:47:41.490138+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490138+0000', 'last_undegraded': '2024-09-15T22:47:41.490138+0000', 'last_fullsized': '2024-09-15T22:47:41.490138+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:PG 23.5 is not active+clean 2024-09-15T22:47:47.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 22.4 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490669+0000', 'last_change': '2024-09-15T22:47:41.490669+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490669+0000', 'last_undegraded': '2024-09-15T22:47:41.490669+0000', 'last_fullsized': '2024-09-15T22:47:41.490669+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490494+0000', 'last_change': '2024-09-15T22:47:41.490494+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490494+0000', 'last_undegraded': '2024-09-15T22:47:41.490494+0000', 'last_fullsized': '2024-09-15T22:47:41.490494+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.487499+0000', 'last_change': '2024-09-15T22:47:41.487499+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.487499+0000', 'last_undegraded': '2024-09-15T22:47:41.487499+0000', 'last_fullsized': '2024-09-15T22:47:41.487499+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:PG 23.0 is not active+clean 2024-09-15T22:47:47.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1 is not active+clean 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490079+0000', 'last_change': '2024-09-15T22:47:41.490079+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490079+0000', 'last_undegraded': '2024-09-15T22:47:41.490079+0000', 'last_fullsized': '2024-09-15T22:47:41.490079+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1 is not active+clean 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:PG 22.0 is not active+clean 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.490036+0000', 'last_change': '2024-09-15T22:47:41.490036+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.490036+0000', 'last_undegraded': '2024-09-15T22:47:41.490036+0000', 'last_fullsized': '2024-09-15T22:47:41.490036+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:PG 23.16 is not active+clean 2024-09-15T22:47:47.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:47:42.480759+0000', 'last_change': '2024-09-15T22:47:42.480759+0000', 'last_active': '2024-09-15T22:47:42.480759+0000', 'last_peered': '2024-09-15T22:47:42.480759+0000', 'last_clean': '2024-09-15T22:47:42.480759+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:42.480759+0000', 'last_undegraded': '2024-09-15T22:47:42.480759+0000', 'last_fullsized': '2024-09-15T22:47:42.480759+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:42.480759+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:47:47.159 INFO:tasks.ceph.ceph_manager.ceph:PG 22.17 is not active+clean 2024-09-15T22:47:47.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 143, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:47:41.491453+0000', 'last_change': '2024-09-15T22:47:41.491453+0000', 'last_active': '2024-09-15T22:47:41.474011+0000', 'last_peered': '2024-09-15T22:47:41.474011+0000', 'last_clean': '2024-09-15T22:47:41.474011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:47:41.491453+0000', 'last_undegraded': '2024-09-15T22:47:41.491453+0000', 'last_fullsized': '2024-09-15T22:47:41.491453+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'last_clean_scrub_stamp': '2024-09-15T22:47:41.474011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:47:47.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:47:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.277+0000 7f90fbbe4640 1 Processor -- start 2024-09-15T22:47:47.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.277+0000 7f90fbbe4640 1 -- start start 2024-09-15T22:47:47.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90fbbe4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90f40d02a0 0x7f90f40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90fbbe4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f415ceb0 0x7f90f41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90fbbe4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90f40d0bc0 con 0x7f90f415ca40 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90fbbe4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f90f415d390 con 0x7f90f40d02a0 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90fbbe4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90f415d670 con 0x7f90f415ceb0 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90f40d02a0 0x7f90f40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90f40d02a0 0x7f90f40d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55092/0 (socket says 172.21.15.134:55092) 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 -- 172.21.15.134:0/110830097 learned_addr learned my addr 172.21.15.134:0/110830097 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 -- 172.21.15.134:0/110830097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f415ceb0 msgr2=0x7f90f41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 --2- 172.21.15.134:0/110830097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f415ceb0 0x7f90f41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.278+0000 7f90f9980640 1 -- 172.21.15.134:0/110830097 >> v1:172.21.15.177:6789/0 conn(0x7f90f415ca40 legacy=0x7f90f415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.279+0000 7f90f9980640 1 -- 172.21.15.134:0/110830097 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f415d950 con 0x7f90f40d02a0 2024-09-15T22:47:47.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.279+0000 7f90f9980640 1 --2- 172.21.15.134:0/110830097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40d02a0 0x7f90f40d0680 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f90f000bb10 tx=0x7f90f002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9c226668bdbd63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.279+0000 7f90f897e640 1 -- 172.21.15.134:0/110830097 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0032710 con 0x7f90f40d02a0 2024-09-15T22:47:47.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.279+0000 7f90f897e640 1 -- 172.21.15.134:0/110830097 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f00328b0 con 0x7f90f40d02a0 2024-09-15T22:47:47.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.279+0000 7f90f897e640 1 -- 172.21.15.134:0/110830097 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0032ca0 con 0x7f90f40d02a0 2024-09-15T22:47:47.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 -- 172.21.15.134:0/110830097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40d02a0 msgr2=0x7f90f40d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/110830097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40d02a0 0x7f90f40d0680 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f90f000bb10 tx=0x7f90f002c850 comp rx=0 tx=0).stop 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 -- 172.21.15.134:0/110830097 shutdown_connections 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/110830097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f415ceb0 0x7f90f41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/110830097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40d02a0 0x7f90f40d0680 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 -- 172.21.15.134:0/110830097 >> 172.21.15.134:0/110830097 conn(0x7f90f4062cc0 msgr2=0x7f90f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 -- 172.21.15.134:0/110830097 shutdown_connections 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.280+0000 7f90fbbe4640 1 -- 172.21.15.134:0/110830097 wait complete. 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.281+0000 7f90fbbe4640 1 Processor -- start 2024-09-15T22:47:47.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.281+0000 7f90fbbe4640 1 -- start start 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f40d02a0 0x7f90f4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 0x7f90f40ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90f415eb40 con 0x7f90f415ca40 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90f415df10 con 0x7f90f415ceb0 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fbbe4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f90f4155b90 con 0x7f90f40d02a0 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55094/0 (socket says 172.21.15.134:55094) 2024-09-15T22:47:47.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 -- 172.21.15.134:0/3428540473 learned_addr learned my addr 172.21.15.134:0/3428540473 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f9980640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f40d02a0 0x7f90f4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fa181640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 0x7f90f40ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 -- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f40d02a0 msgr2=0x7f90f4158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f40d02a0 0x7f90f4158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 -- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 msgr2=0x7f90f40ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 0x7f90f40ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 -- 172.21.15.134:0/3428540473 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f40cea10 con 0x7f90f415ca40 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90fa181640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 0x7f90f40ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.282+0000 7f90f917f640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f90e400b3f0 tx=0x7f90e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.283+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4015020 con 0x7f90f415ca40 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.283+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e4011830 con 0x7f90f415ca40 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.283+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f4158c90 con 0x7f90f415ca40 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.283+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4011c20 con 0x7f90f415ca40 2024-09-15T22:47:47.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.283+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f4071d60 con 0x7f90f415ca40 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.284+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f40b4790 con 0x7f90f415ca40 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.284+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f90e4018020 con 0x7f90f415ca40 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.284+0000 7f90ea7fc640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 0x7f90d806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.285+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f90e408bab0 con 0x7f90f415ca40 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.285+0000 7f90f9980640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 0x7f90d806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.285+0000 7f90f9980640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 0x7f90d806edd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f90f0037000 tx=0x7f90f0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.289+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90e401f030 con 0x7f90f415ca40 2024-09-15T22:47:47.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.518+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f90f40b5550 con 0x7f90f415ca40 2024-09-15T22:47:47.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.519+0000 7f90ea7fc640 1 -- 172.21.15.134:0/3428540473 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1702 (secure 0 0 0) 0x7f90e4059930 con 0x7f90f415ca40 2024-09-15T22:47:47.520 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:47.520 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":404,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":146,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":271003648,"bytes_avail":772823109632,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":75,"btime":"2024-09-15T22:47:45:520820+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":8250}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-15T22:46:17.194552+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:47:47.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.520+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 msgr2=0x7f90d806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 0x7f90d806edd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f90f0037000 tx=0x7f90f0032000 comp rx=0 tx=0).stop 2024-09-15T22:47:47.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 msgr2=0x7f90f4072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f90e400b3f0 tx=0x7f90e400b8b0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 shutdown_connections 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90f415ceb0 0x7f90f40ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f90d806c910 0x7f90d806edd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f415ca40 0x7f90f4072840 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 --2- 172.21.15.134:0/3428540473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90f40d02a0 0x7f90f4158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 >> 172.21.15.134:0/3428540473 conn(0x7f90f4062cc0 msgr2=0x7f90f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 shutdown_connections 2024-09-15T22:47:47.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.521+0000 7f90fbbe4640 1 -- 172.21.15.134:0/3428540473 wait complete. 2024-09-15T22:47:47.533 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:47:47.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.631+0000 7f46f85f6640 1 Processor -- start 2024-09-15T22:47:47.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.631+0000 7f46f85f6640 1 -- start start 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 0x7f46f00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46f015ca40 0x7f46f015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46f015ce80 0x7f46f01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f46f00d0bc0 con 0x7f46f015ce80 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f46f015d390 con 0x7f46f015ca40 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f85f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f46f015d670 con 0x7f46f00d02a0 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f6b93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46f015ce80 0x7f46f01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f6b93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46f015ce80 0x7f46f01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55098/0 (socket says 172.21.15.134:55098) 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f6b93640 1 -- 172.21.15.134:0/1918915614 learned_addr learned my addr 172.21.15.134:0/1918915614 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f5b91640 1 --2- 172.21.15.134:0/1918915614 >> v2:172.21.15.177:3300/0 conn(0x7f46f015ca40 0x7f46f015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.632+0000 7f46f6392640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 0x7f46f00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 -- 172.21.15.134:0/1918915614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 msgr2=0x7f46f00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 0x7f46f00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 -- 172.21.15.134:0/1918915614 >> v2:172.21.15.177:3300/0 conn(0x7f46f015ca40 msgr2=0x7f46f015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 --2- 172.21.15.134:0/1918915614 >> v2:172.21.15.177:3300/0 conn(0x7f46f015ca40 0x7f46f015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 -- 172.21.15.134:0/1918915614 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f015d950 con 0x7f46f015ce80 2024-09-15T22:47:47.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6392640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 0x7f46f00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:47.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f6b93640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f015ce80 0x7f46f01594c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f46f006f400 tx=0x7f46e802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7735d9e7841435f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f5390640 1 -- 172.21.15.134:0/1918915614 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8036070 con 0x7f46f015ce80 2024-09-15T22:47:47.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f5390640 1 -- 172.21.15.134:0/1918915614 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8031600 con 0x7f46f015ce80 2024-09-15T22:47:47.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.633+0000 7f46f5390640 1 -- 172.21.15.134:0/1918915614 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e80319d0 con 0x7f46f015ce80 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 -- 172.21.15.134:0/1918915614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f015ce80 msgr2=0x7f46f01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f015ce80 0x7f46f01594c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f46f006f400 tx=0x7f46e802a610 comp rx=0 tx=0).stop 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 -- 172.21.15.134:0/1918915614 shutdown_connections 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f015ce80 0x7f46f01594c0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 --2- 172.21.15.134:0/1918915614 >> v2:172.21.15.177:3300/0 conn(0x7f46f015ca40 0x7f46f015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 --2- 172.21.15.134:0/1918915614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f00d02a0 0x7f46f00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 -- 172.21.15.134:0/1918915614 >> 172.21.15.134:0/1918915614 conn(0x7f46f0062cc0 msgr2=0x7f46f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 -- 172.21.15.134:0/1918915614 shutdown_connections 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.634+0000 7f46f85f6640 1 -- 172.21.15.134:0/1918915614 wait complete. 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.635+0000 7f46f85f6640 1 Processor -- start 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.635+0000 7f46f85f6640 1 -- start start 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 0x7f46f0158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f015ce80 0x7f46f00726c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0155b90 con 0x7f46f00d02a0 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46f015df10 con 0x7f46f015ca40 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f85f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f46f0155d10 con 0x7f46f015ce80 2024-09-15T22:47:47.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55102/0 (socket says 172.21.15.134:55102) 2024-09-15T22:47:47.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 -- 172.21.15.134:0/2583584973 learned_addr learned my addr 172.21.15.134:0/2583584973 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:47.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f5b91640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 0x7f46f0158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6b93640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f015ce80 0x7f46f00726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 -- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f015ce80 msgr2=0x7f46f00726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f015ce80 0x7f46f00726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 -- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 msgr2=0x7f46f0158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 0x7f46f0158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f6392640 1 -- 172.21.15.134:0/2583584973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f014db50 con 0x7f46f00d02a0 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.636+0000 7f46f5b91640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 0x7f46f0158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:47.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46f6392640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00fa60 tx=0x7f46ec00ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec009c30 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ec009dd0 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f014de30 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec004250 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.637+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f014e3f0 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.638+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f00b4790 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.638+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f46ec003610 con 0x7f46f00d02a0 2024-09-15T22:47:47.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.639+0000 7f46e6ffd640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 0x7f46d406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.639+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f46ec08e570 con 0x7f46f00d02a0 2024-09-15T22:47:47.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.639+0000 7f46f5b91640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 0x7f46d406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.639+0000 7f46f5b91640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 0x7f46d406eda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f46f00b5720 tx=0x7f46e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.643+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46ec05bc00 con 0x7f46f00d02a0 2024-09-15T22:47:47.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.806+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46f014e7f0 con 0x7f46d406c8e0 2024-09-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.812+0000 7f46e6ffd640 1 -- 172.21.15.134:0/2583584973 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252485 (secure 0 0 0) 0x7f46f014e7f0 con 0x7f46d406c8e0 2024-09-15T22:47:47.816 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 msgr2=0x7f46d406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 0x7f46d406eda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f46f00b5720 tx=0x7f46e0008040 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 msgr2=0x7f46f0073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00fa60 tx=0x7f46ec00ff20 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 shutdown_connections 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.815+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46f015ce80 0x7f46f00726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46f015ca40 0x7f46f0158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46d406c8e0 0x7f46d406eda0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 --2- 172.21.15.134:0/2583584973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46f00d02a0 0x7f46f0073ac0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 >> 172.21.15.134:0/2583584973 conn(0x7f46f0062cc0 msgr2=0x7f46f00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 shutdown_connections 2024-09-15T22:47:47.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:47.816+0000 7f46f85f6640 1 -- 172.21.15.134:0/2583584973 wait complete. 2024-09-15T22:47:47.828 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-15T22:47:47.215651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265032,"kb_used_data":15496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709688,"statfs":{"total":773094113280,"available":772822720512,"internally_reserved":0,"allocated":15867904,"data_stored":7624084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.731218"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506257+0000","last_change":"2024-09-15T22:47:43.531865+0000","last_active":"2024-09-15T22:47:44.506257+0000","last_peered":"2024-09-15T22:47:44.506257+0000","last_clean":"2024-09-15T22:47:44.506257+0000","last_became_active":"2024-09-15T22:47:43.531641+0000","last_became_peered":"2024-09-15T22:47:43.531641+0000","last_unstale":"2024-09-15T22:47:44.506257+0000","last_undegraded":"2024-09-15T22:47:44.506257+0000","last_fullsized":"2024-09-15T22:47:44.506257+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:41.796107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506210+0000","last_change":"2024-09-15T22:47:43.529356+0000","last_active":"2024-09-15T22:47:44.506210+0000","last_peered":"2024-09-15T22:47:44.506210+0000","last_clean":"2024-09-15T22:47:44.506210+0000","last_became_active":"2024-09-15T22:47:43.529078+0000","last_became_peered":"2024-09-15T22:47:43.529078+0000","last_unstale":"2024-09-15T22:47:44.506210+0000","last_undegraded":"2024-09-15T22:47:44.506210+0000","last_fullsized":"2024-09-15T22:47:44.506210+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.366784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506127+0000","last_change":"2024-09-15T22:47:43.529100+0000","last_active":"2024-09-15T22:47:44.506127+0000","last_peered":"2024-09-15T22:47:44.506127+0000","last_clean":"2024-09-15T22:47:44.506127+0000","last_became_active":"2024-09-15T22:47:43.528775+0000","last_became_peered":"2024-09-15T22:47:43.528775+0000","last_unstale":"2024-09-15T22:47:44.506127+0000","last_undegraded":"2024-09-15T22:47:44.506127+0000","last_fullsized":"2024-09-15T22:47:44.506127+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:50.166567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509849+0000","last_change":"2024-09-15T22:47:43.527278+0000","last_active":"2024-09-15T22:47:44.509849+0000","last_peered":"2024-09-15T22:47:44.509849+0000","last_clean":"2024-09-15T22:47:44.509849+0000","last_became_active":"2024-09-15T22:47:43.526967+0000","last_became_peered":"2024-09-15T22:47:43.526967+0000","last_unstale":"2024-09-15T22:47:44.509849+0000","last_undegraded":"2024-09-15T22:47:44.509849+0000","last_fullsized":"2024-09-15T22:47:44.509849+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:27.527686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635534+0000","last_change":"2024-09-15T22:47:43.516590+0000","last_active":"2024-09-15T22:47:44.635534+0000","last_peered":"2024-09-15T22:47:44.635534+0000","last_clean":"2024-09-15T22:47:44.635534+0000","last_became_active":"2024-09-15T22:47:43.515870+0000","last_became_peered":"2024-09-15T22:47:43.515870+0000","last_unstale":"2024-09-15T22:47:44.635534+0000","last_undegraded":"2024-09-15T22:47:44.635534+0000","last_fullsized":"2024-09-15T22:47:44.635534+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:23.151489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635257+0000","last_change":"2024-09-15T22:47:43.524230+0000","last_active":"2024-09-15T22:47:44.635257+0000","last_peered":"2024-09-15T22:47:44.635257+0000","last_clean":"2024-09-15T22:47:44.635257+0000","last_became_active":"2024-09-15T22:47:43.523919+0000","last_became_peered":"2024-09-15T22:47:43.523919+0000","last_unstale":"2024-09-15T22:47:44.635257+0000","last_undegraded":"2024-09-15T22:47:44.635257+0000","last_fullsized":"2024-09-15T22:47:44.635257+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:23.151489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509534+0000","last_change":"2024-09-15T22:47:43.513952+0000","last_active":"2024-09-15T22:47:44.509534+0000","last_peered":"2024-09-15T22:47:44.509534+0000","last_clean":"2024-09-15T22:47:44.509534+0000","last_became_active":"2024-09-15T22:47:43.513683+0000","last_became_peered":"2024-09-15T22:47:43.513683+0000","last_unstale":"2024-09-15T22:47:44.509534+0000","last_undegraded":"2024-09-15T22:47:44.509534+0000","last_fullsized":"2024-09-15T22:47:44.509534+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:38.324230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635033+0000","last_change":"2024-09-15T22:47:43.524277+0000","last_active":"2024-09-15T22:47:44.635033+0000","last_peered":"2024-09-15T22:47:44.635033+0000","last_clean":"2024-09-15T22:47:44.635033+0000","last_became_active":"2024-09-15T22:47:43.523994+0000","last_became_peered":"2024-09-15T22:47:43.523994+0000","last_unstale":"2024-09-15T22:47:44.635033+0000","last_undegraded":"2024-09-15T22:47:44.635033+0000","last_fullsized":"2024-09-15T22:47:44.635033+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:40.138345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635122+0000","last_change":"2024-09-15T22:47:43.515831+0000","last_active":"2024-09-15T22:47:44.635122+0000","last_peered":"2024-09-15T22:47:44.635122+0000","last_clean":"2024-09-15T22:47:44.635122+0000","last_became_active":"2024-09-15T22:47:43.515567+0000","last_became_peered":"2024-09-15T22:47:43.515567+0000","last_unstale":"2024-09-15T22:47:44.635122+0000","last_undegraded":"2024-09-15T22:47:44.635122+0000","last_fullsized":"2024-09-15T22:47:44.635122+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:22.570248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635330+0000","last_change":"2024-09-15T22:47:43.523476+0000","last_active":"2024-09-15T22:47:44.635330+0000","last_peered":"2024-09-15T22:47:44.635330+0000","last_clean":"2024-09-15T22:47:44.635330+0000","last_became_active":"2024-09-15T22:47:43.523214+0000","last_became_peered":"2024-09-15T22:47:43.523214+0000","last_unstale":"2024-09-15T22:47:44.635330+0000","last_undegraded":"2024-09-15T22:47:44.635330+0000","last_fullsized":"2024-09-15T22:47:44.635330+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.366784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635508+0000","last_change":"2024-09-15T22:47:43.528564+0000","last_active":"2024-09-15T22:47:44.635508+0000","last_peered":"2024-09-15T22:47:44.635508+0000","last_clean":"2024-09-15T22:47:44.635508+0000","last_became_active":"2024-09-15T22:47:43.527183+0000","last_became_peered":"2024-09-15T22:47:43.527183+0000","last_unstale":"2024-09-15T22:47:44.635508+0000","last_undegraded":"2024-09-15T22:47:44.635508+0000","last_fullsized":"2024-09-15T22:47:44.635508+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:04.218829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520041+0000","last_change":"2024-09-15T22:47:43.521236+0000","last_active":"2024-09-15T22:47:44.520041+0000","last_peered":"2024-09-15T22:47:44.520041+0000","last_clean":"2024-09-15T22:47:44.520041+0000","last_became_active":"2024-09-15T22:47:43.520942+0000","last_became_peered":"2024-09-15T22:47:43.520942+0000","last_unstale":"2024-09-15T22:47:44.520041+0000","last_undegraded":"2024-09-15T22:47:44.520041+0000","last_fullsized":"2024-09-15T22:47:44.520041+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:14.047014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520040+0000","last_change":"2024-09-15T22:47:43.530401+0000","last_active":"2024-09-15T22:47:44.520040+0000","last_peered":"2024-09-15T22:47:44.520040+0000","last_clean":"2024-09-15T22:47:44.520040+0000","last_became_active":"2024-09-15T22:47:43.530110+0000","last_became_peered":"2024-09-15T22:47:43.530110+0000","last_unstale":"2024-09-15T22:47:44.520040+0000","last_undegraded":"2024-09-15T22:47:44.520040+0000","last_fullsized":"2024-09-15T22:47:44.520040+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:10.742775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635182+0000","last_change":"2024-09-15T22:47:43.520902+0000","last_active":"2024-09-15T22:47:44.635182+0000","last_peered":"2024-09-15T22:47:44.635182+0000","last_clean":"2024-09-15T22:47:44.635182+0000","last_became_active":"2024-09-15T22:47:43.520467+0000","last_became_peered":"2024-09-15T22:47:43.520467+0000","last_unstale":"2024-09-15T22:47:44.635182+0000","last_undegraded":"2024-09-15T22:47:44.635182+0000","last_fullsized":"2024-09-15T22:47:44.635182+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:37.683513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635323+0000","last_change":"2024-09-15T22:47:43.530257+0000","last_active":"2024-09-15T22:47:44.635323+0000","last_peered":"2024-09-15T22:47:44.635323+0000","last_clean":"2024-09-15T22:47:44.635323+0000","last_became_active":"2024-09-15T22:47:43.529966+0000","last_became_peered":"2024-09-15T22:47:43.529966+0000","last_unstale":"2024-09-15T22:47:44.635323+0000","last_undegraded":"2024-09-15T22:47:44.635323+0000","last_fullsized":"2024-09-15T22:47:44.635323+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:29.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508743+0000","last_change":"2024-09-15T22:47:43.521481+0000","last_active":"2024-09-15T22:47:44.508743+0000","last_peered":"2024-09-15T22:47:44.508743+0000","last_clean":"2024-09-15T22:47:44.508743+0000","last_became_active":"2024-09-15T22:47:43.521206+0000","last_became_peered":"2024-09-15T22:47:43.521206+0000","last_unstale":"2024-09-15T22:47:44.508743+0000","last_undegraded":"2024-09-15T22:47:44.508743+0000","last_fullsized":"2024-09-15T22:47:44.508743+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:53.553915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635544+0000","last_change":"2024-09-15T22:47:43.522856+0000","last_active":"2024-09-15T22:47:44.635544+0000","last_peered":"2024-09-15T22:47:44.635544+0000","last_clean":"2024-09-15T22:47:44.635544+0000","last_became_active":"2024-09-15T22:47:43.522594+0000","last_became_peered":"2024-09-15T22:47:43.522594+0000","last_unstale":"2024-09-15T22:47:44.635544+0000","last_undegraded":"2024-09-15T22:47:44.635544+0000","last_fullsized":"2024-09-15T22:47:44.635544+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:40.025948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510016+0000","last_change":"2024-09-15T22:47:43.519070+0000","last_active":"2024-09-15T22:47:44.510016+0000","last_peered":"2024-09-15T22:47:44.510016+0000","last_clean":"2024-09-15T22:47:44.510016+0000","last_became_active":"2024-09-15T22:47:43.518613+0000","last_became_peered":"2024-09-15T22:47:43.518613+0000","last_unstale":"2024-09-15T22:47:44.510016+0000","last_undegraded":"2024-09-15T22:47:44.510016+0000","last_fullsized":"2024-09-15T22:47:44.510016+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:39.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509183+0000","last_change":"2024-09-15T22:47:43.518245+0000","last_active":"2024-09-15T22:47:44.509183+0000","last_peered":"2024-09-15T22:47:44.509183+0000","last_clean":"2024-09-15T22:47:44.509183+0000","last_became_active":"2024-09-15T22:47:43.517958+0000","last_became_peered":"2024-09-15T22:47:43.517958+0000","last_unstale":"2024-09-15T22:47:44.509183+0000","last_undegraded":"2024-09-15T22:47:44.509183+0000","last_fullsized":"2024-09-15T22:47:44.509183+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:04.338085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520145+0000","last_change":"2024-09-15T22:47:43.520655+0000","last_active":"2024-09-15T22:47:44.520145+0000","last_peered":"2024-09-15T22:47:44.520145+0000","last_clean":"2024-09-15T22:47:44.520145+0000","last_became_active":"2024-09-15T22:47:43.520367+0000","last_became_peered":"2024-09-15T22:47:43.520367+0000","last_unstale":"2024-09-15T22:47:44.520145+0000","last_undegraded":"2024-09-15T22:47:44.520145+0000","last_fullsized":"2024-09-15T22:47:44.520145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:41.549667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635205+0000","last_change":"2024-09-15T22:47:43.526543+0000","last_active":"2024-09-15T22:47:44.635205+0000","last_peered":"2024-09-15T22:47:44.635205+0000","last_clean":"2024-09-15T22:47:44.635205+0000","last_became_active":"2024-09-15T22:47:43.526294+0000","last_became_peered":"2024-09-15T22:47:43.526294+0000","last_unstale":"2024-09-15T22:47:44.635205+0000","last_undegraded":"2024-09-15T22:47:44.635205+0000","last_fullsized":"2024-09-15T22:47:44.635205+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:04.218829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635698+0000","last_change":"2024-09-15T22:47:43.525912+0000","last_active":"2024-09-15T22:47:44.635698+0000","last_peered":"2024-09-15T22:47:44.635698+0000","last_clean":"2024-09-15T22:47:44.635698+0000","last_became_active":"2024-09-15T22:47:43.525633+0000","last_became_peered":"2024-09-15T22:47:43.525633+0000","last_unstale":"2024-09-15T22:47:44.635698+0000","last_undegraded":"2024-09-15T22:47:44.635698+0000","last_fullsized":"2024-09-15T22:47:44.635698+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:26.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635633+0000","last_change":"2024-09-15T22:47:43.527258+0000","last_active":"2024-09-15T22:47:44.635633+0000","last_peered":"2024-09-15T22:47:44.635633+0000","last_clean":"2024-09-15T22:47:44.635633+0000","last_became_active":"2024-09-15T22:47:43.526845+0000","last_became_peered":"2024-09-15T22:47:43.526845+0000","last_unstale":"2024-09-15T22:47:44.635633+0000","last_undegraded":"2024-09-15T22:47:44.635633+0000","last_fullsized":"2024-09-15T22:47:44.635633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:47.732162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634856+0000","last_change":"2024-09-15T22:47:43.517084+0000","last_active":"2024-09-15T22:47:44.634856+0000","last_peered":"2024-09-15T22:47:44.634856+0000","last_clean":"2024-09-15T22:47:44.634856+0000","last_became_active":"2024-09-15T22:47:43.516229+0000","last_became_peered":"2024-09-15T22:47:43.516229+0000","last_unstale":"2024-09-15T22:47:44.634856+0000","last_undegraded":"2024-09-15T22:47:44.634856+0000","last_fullsized":"2024-09-15T22:47:44.634856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:15.751182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635969+0000","last_change":"2024-09-15T22:47:43.515657+0000","last_active":"2024-09-15T22:47:44.635969+0000","last_peered":"2024-09-15T22:47:44.635969+0000","last_clean":"2024-09-15T22:47:44.635969+0000","last_became_active":"2024-09-15T22:47:43.515348+0000","last_became_peered":"2024-09-15T22:47:43.515348+0000","last_unstale":"2024-09-15T22:47:44.635969+0000","last_undegraded":"2024-09-15T22:47:44.635969+0000","last_fullsized":"2024-09-15T22:47:44.635969+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:58.102508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636058+0000","last_change":"2024-09-15T22:47:43.528135+0000","last_active":"2024-09-15T22:47:44.636058+0000","last_peered":"2024-09-15T22:47:44.636058+0000","last_clean":"2024-09-15T22:47:44.636058+0000","last_became_active":"2024-09-15T22:47:43.525230+0000","last_became_peered":"2024-09-15T22:47:43.525230+0000","last_unstale":"2024-09-15T22:47:44.636058+0000","last_undegraded":"2024-09-15T22:47:44.636058+0000","last_fullsized":"2024-09-15T22:47:44.636058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:39.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635922+0000","last_change":"2024-09-15T22:47:43.509871+0000","last_active":"2024-09-15T22:47:44.635922+0000","last_peered":"2024-09-15T22:47:44.635922+0000","last_clean":"2024-09-15T22:47:44.635922+0000","last_became_active":"2024-09-15T22:47:43.509518+0000","last_became_peered":"2024-09-15T22:47:43.509518+0000","last_unstale":"2024-09-15T22:47:44.635922+0000","last_undegraded":"2024-09-15T22:47:44.635922+0000","last_fullsized":"2024-09-15T22:47:44.635922+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:58.511518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509209+0000","last_change":"2024-09-15T22:47:43.518508+0000","last_active":"2024-09-15T22:47:44.509209+0000","last_peered":"2024-09-15T22:47:44.509209+0000","last_clean":"2024-09-15T22:47:44.509209+0000","last_became_active":"2024-09-15T22:47:43.518028+0000","last_became_peered":"2024-09-15T22:47:43.518028+0000","last_unstale":"2024-09-15T22:47:44.509209+0000","last_undegraded":"2024-09-15T22:47:44.509209+0000","last_fullsized":"2024-09-15T22:47:44.509209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:09.591206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505966+0000","last_change":"2024-09-15T22:47:43.518023+0000","last_active":"2024-09-15T22:47:44.505966+0000","last_peered":"2024-09-15T22:47:44.505966+0000","last_clean":"2024-09-15T22:47:44.505966+0000","last_became_active":"2024-09-15T22:47:43.517747+0000","last_became_peered":"2024-09-15T22:47:43.517747+0000","last_unstale":"2024-09-15T22:47:44.505966+0000","last_undegraded":"2024-09-15T22:47:44.505966+0000","last_fullsized":"2024-09-15T22:47:44.505966+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:37.683513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635276+0000","last_change":"2024-09-15T22:47:43.520072+0000","last_active":"2024-09-15T22:47:44.635276+0000","last_peered":"2024-09-15T22:47:44.635276+0000","last_clean":"2024-09-15T22:47:44.635276+0000","last_became_active":"2024-09-15T22:47:43.519791+0000","last_became_peered":"2024-09-15T22:47:43.519791+0000","last_unstale":"2024-09-15T22:47:44.635276+0000","last_undegraded":"2024-09-15T22:47:44.635276+0000","last_fullsized":"2024-09-15T22:47:44.635276+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:50.166567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505805+0000","last_change":"2024-09-15T22:47:43.530725+0000","last_active":"2024-09-15T22:47:44.505805+0000","last_peered":"2024-09-15T22:47:44.505805+0000","last_clean":"2024-09-15T22:47:44.505805+0000","last_became_active":"2024-09-15T22:47:43.530470+0000","last_became_peered":"2024-09-15T22:47:43.530470+0000","last_unstale":"2024-09-15T22:47:44.505805+0000","last_undegraded":"2024-09-15T22:47:44.505805+0000","last_fullsized":"2024-09-15T22:47:44.505805+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:40.138345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635638+0000","last_change":"2024-09-15T22:47:43.523643+0000","last_active":"2024-09-15T22:47:44.635638+0000","last_peered":"2024-09-15T22:47:44.635638+0000","last_clean":"2024-09-15T22:47:44.635638+0000","last_became_active":"2024-09-15T22:47:43.523365+0000","last_became_peered":"2024-09-15T22:47:43.523365+0000","last_unstale":"2024-09-15T22:47:44.635638+0000","last_undegraded":"2024-09-15T22:47:44.635638+0000","last_fullsized":"2024-09-15T22:47:44.635638+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:26.697688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510021+0000","last_change":"2024-09-15T22:47:43.531002+0000","last_active":"2024-09-15T22:47:44.510021+0000","last_peered":"2024-09-15T22:47:44.510021+0000","last_clean":"2024-09-15T22:47:44.510021+0000","last_became_active":"2024-09-15T22:47:43.530528+0000","last_became_peered":"2024-09-15T22:47:43.530528+0000","last_unstale":"2024-09-15T22:47:44.510021+0000","last_undegraded":"2024-09-15T22:47:44.510021+0000","last_fullsized":"2024-09-15T22:47:44.510021+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.965805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"145'4","reported_seq":18,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506289+0000","last_change":"2024-09-15T22:47:42.497199+0000","last_active":"2024-09-15T22:47:44.506289+0000","last_peered":"2024-09-15T22:47:44.506289+0000","last_clean":"2024-09-15T22:47:44.506289+0000","last_became_active":"2024-09-15T22:47:42.496877+0000","last_became_peered":"2024-09-15T22:47:42.496877+0000","last_unstale":"2024-09-15T22:47:44.506289+0000","last_undegraded":"2024-09-15T22:47:44.506289+0000","last_fullsized":"2024-09-15T22:47:44.506289+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:06.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506278+0000","last_change":"2024-09-15T22:47:43.533091+0000","last_active":"2024-09-15T22:47:44.506278+0000","last_peered":"2024-09-15T22:47:44.506278+0000","last_clean":"2024-09-15T22:47:44.506278+0000","last_became_active":"2024-09-15T22:47:43.532802+0000","last_became_peered":"2024-09-15T22:47:43.532802+0000","last_unstale":"2024-09-15T22:47:44.506278+0000","last_undegraded":"2024-09-15T22:47:44.506278+0000","last_fullsized":"2024-09-15T22:47:44.506278+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635323+0000","last_change":"2024-09-15T22:47:42.501765+0000","last_active":"2024-09-15T22:47:44.635323+0000","last_peered":"2024-09-15T22:47:44.635323+0000","last_clean":"2024-09-15T22:47:44.635323+0000","last_became_active":"2024-09-15T22:47:42.501441+0000","last_became_peered":"2024-09-15T22:47:42.501441+0000","last_unstale":"2024-09-15T22:47:44.635323+0000","last_undegraded":"2024-09-15T22:47:44.635323+0000","last_fullsized":"2024-09-15T22:47:44.635323+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:33.261998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635369+0000","last_change":"2024-09-15T22:47:43.518805+0000","last_active":"2024-09-15T22:47:44.635369+0000","last_peered":"2024-09-15T22:47:44.635369+0000","last_clean":"2024-09-15T22:47:44.635369+0000","last_became_active":"2024-09-15T22:47:43.518540+0000","last_became_peered":"2024-09-15T22:47:43.518540+0000","last_unstale":"2024-09-15T22:47:44.635369+0000","last_undegraded":"2024-09-15T22:47:44.635369+0000","last_fullsized":"2024-09-15T22:47:44.635369+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:26.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635114+0000","last_change":"2024-09-15T22:47:42.493765+0000","last_active":"2024-09-15T22:47:44.635114+0000","last_peered":"2024-09-15T22:47:44.635114+0000","last_clean":"2024-09-15T22:47:44.635114+0000","last_became_active":"2024-09-15T22:47:42.492657+0000","last_became_peered":"2024-09-15T22:47:42.492657+0000","last_unstale":"2024-09-15T22:47:44.635114+0000","last_undegraded":"2024-09-15T22:47:44.635114+0000","last_fullsized":"2024-09-15T22:47:44.635114+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:17.233339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635107+0000","last_change":"2024-09-15T22:47:43.524651+0000","last_active":"2024-09-15T22:47:44.635107+0000","last_peered":"2024-09-15T22:47:44.635107+0000","last_clean":"2024-09-15T22:47:44.635107+0000","last_became_active":"2024-09-15T22:47:43.524316+0000","last_became_peered":"2024-09-15T22:47:43.524316+0000","last_unstale":"2024-09-15T22:47:44.635107+0000","last_undegraded":"2024-09-15T22:47:44.635107+0000","last_fullsized":"2024-09-15T22:47:44.635107+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.949658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636043+0000","last_change":"2024-09-15T22:47:42.500463+0000","last_active":"2024-09-15T22:47:44.636043+0000","last_peered":"2024-09-15T22:47:44.636043+0000","last_clean":"2024-09-15T22:47:44.636043+0000","last_became_active":"2024-09-15T22:47:42.500190+0000","last_became_peered":"2024-09-15T22:47:42.500190+0000","last_unstale":"2024-09-15T22:47:44.636043+0000","last_undegraded":"2024-09-15T22:47:44.636043+0000","last_fullsized":"2024-09-15T22:47:44.636043+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:25.271042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509764+0000","last_change":"2024-09-15T22:47:43.526299+0000","last_active":"2024-09-15T22:47:44.509764+0000","last_peered":"2024-09-15T22:47:44.509764+0000","last_clean":"2024-09-15T22:47:44.509764+0000","last_became_active":"2024-09-15T22:47:43.526011+0000","last_became_peered":"2024-09-15T22:47:43.526011+0000","last_unstale":"2024-09-15T22:47:44.509764+0000","last_undegraded":"2024-09-15T22:47:44.509764+0000","last_fullsized":"2024-09-15T22:47:44.509764+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:25.683316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505918+0000","last_change":"2024-09-15T22:47:42.505044+0000","last_active":"2024-09-15T22:47:44.505918+0000","last_peered":"2024-09-15T22:47:44.505918+0000","last_clean":"2024-09-15T22:47:44.505918+0000","last_became_active":"2024-09-15T22:47:42.504780+0000","last_became_peered":"2024-09-15T22:47:42.504780+0000","last_unstale":"2024-09-15T22:47:44.505918+0000","last_undegraded":"2024-09-15T22:47:44.505918+0000","last_fullsized":"2024-09-15T22:47:44.505918+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:27.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635372+0000","last_change":"2024-09-15T22:47:43.524430+0000","last_active":"2024-09-15T22:47:44.635372+0000","last_peered":"2024-09-15T22:47:44.635372+0000","last_clean":"2024-09-15T22:47:44.635372+0000","last_became_active":"2024-09-15T22:47:43.524134+0000","last_became_peered":"2024-09-15T22:47:43.524134+0000","last_unstale":"2024-09-15T22:47:44.635372+0000","last_undegraded":"2024-09-15T22:47:44.635372+0000","last_fullsized":"2024-09-15T22:47:44.635372+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:58.511518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509671+0000","last_change":"2024-09-15T22:47:42.507892+0000","last_active":"2024-09-15T22:47:44.509671+0000","last_peered":"2024-09-15T22:47:44.509671+0000","last_clean":"2024-09-15T22:47:44.509671+0000","last_became_active":"2024-09-15T22:47:42.507494+0000","last_became_peered":"2024-09-15T22:47:42.507494+0000","last_unstale":"2024-09-15T22:47:44.509671+0000","last_undegraded":"2024-09-15T22:47:44.509671+0000","last_fullsized":"2024-09-15T22:47:44.509671+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.126615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635097+0000","last_change":"2024-09-15T22:47:43.527627+0000","last_active":"2024-09-15T22:47:44.635097+0000","last_peered":"2024-09-15T22:47:44.635097+0000","last_clean":"2024-09-15T22:47:44.635097+0000","last_became_active":"2024-09-15T22:47:43.527083+0000","last_became_peered":"2024-09-15T22:47:43.527083+0000","last_unstale":"2024-09-15T22:47:44.635097+0000","last_undegraded":"2024-09-15T22:47:44.635097+0000","last_fullsized":"2024-09-15T22:47:44.635097+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505826+0000","last_change":"2024-09-15T22:47:42.497706+0000","last_active":"2024-09-15T22:47:44.505826+0000","last_peered":"2024-09-15T22:47:44.505826+0000","last_clean":"2024-09-15T22:47:44.505826+0000","last_became_active":"2024-09-15T22:47:42.497421+0000","last_became_peered":"2024-09-15T22:47:42.497421+0000","last_unstale":"2024-09-15T22:47:44.505826+0000","last_undegraded":"2024-09-15T22:47:44.505826+0000","last_fullsized":"2024-09-15T22:47:44.505826+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:02.732447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509393+0000","last_change":"2024-09-15T22:47:43.528388+0000","last_active":"2024-09-15T22:47:44.509393+0000","last_peered":"2024-09-15T22:47:44.509393+0000","last_clean":"2024-09-15T22:47:44.509393+0000","last_became_active":"2024-09-15T22:47:43.527768+0000","last_became_peered":"2024-09-15T22:47:43.527768+0000","last_unstale":"2024-09-15T22:47:44.509393+0000","last_undegraded":"2024-09-15T22:47:44.509393+0000","last_fullsized":"2024-09-15T22:47:44.509393+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:37.459832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634965+0000","last_change":"2024-09-15T22:47:42.493097+0000","last_active":"2024-09-15T22:47:44.634965+0000","last_peered":"2024-09-15T22:47:44.634965+0000","last_clean":"2024-09-15T22:47:44.634965+0000","last_became_active":"2024-09-15T22:47:42.492788+0000","last_became_peered":"2024-09-15T22:47:42.492788+0000","last_unstale":"2024-09-15T22:47:44.634965+0000","last_undegraded":"2024-09-15T22:47:44.634965+0000","last_fullsized":"2024-09-15T22:47:44.634965+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:01:55.535764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509051+0000","last_change":"2024-09-15T22:47:43.516543+0000","last_active":"2024-09-15T22:47:44.509051+0000","last_peered":"2024-09-15T22:47:44.509051+0000","last_clean":"2024-09-15T22:47:44.509051+0000","last_became_active":"2024-09-15T22:47:43.516288+0000","last_became_peered":"2024-09-15T22:47:43.516288+0000","last_unstale":"2024-09-15T22:47:44.509051+0000","last_undegraded":"2024-09-15T22:47:44.509051+0000","last_fullsized":"2024-09-15T22:47:44.509051+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:05.834094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635359+0000","last_change":"2024-09-15T22:47:42.502429+0000","last_active":"2024-09-15T22:47:44.635359+0000","last_peered":"2024-09-15T22:47:44.635359+0000","last_clean":"2024-09-15T22:47:44.635359+0000","last_became_active":"2024-09-15T22:47:42.502065+0000","last_became_peered":"2024-09-15T22:47:42.502065+0000","last_unstale":"2024-09-15T22:47:44.635359+0000","last_undegraded":"2024-09-15T22:47:44.635359+0000","last_fullsized":"2024-09-15T22:47:44.635359+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509347+0000","last_change":"2024-09-15T22:47:43.517205+0000","last_active":"2024-09-15T22:47:44.509347+0000","last_peered":"2024-09-15T22:47:44.509347+0000","last_clean":"2024-09-15T22:47:44.509347+0000","last_became_active":"2024-09-15T22:47:43.516917+0000","last_became_peered":"2024-09-15T22:47:43.516917+0000","last_unstale":"2024-09-15T22:47:44.509347+0000","last_undegraded":"2024-09-15T22:47:44.509347+0000","last_fullsized":"2024-09-15T22:47:44.509347+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:43.040820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"145'3","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636071+0000","last_change":"2024-09-15T22:47:42.492536+0000","last_active":"2024-09-15T22:47:44.636071+0000","last_peered":"2024-09-15T22:47:44.636071+0000","last_clean":"2024-09-15T22:47:44.636071+0000","last_became_active":"2024-09-15T22:47:42.492258+0000","last_became_peered":"2024-09-15T22:47:42.492258+0000","last_unstale":"2024-09-15T22:47:44.636071+0000","last_undegraded":"2024-09-15T22:47:44.636071+0000","last_fullsized":"2024-09-15T22:47:44.636071+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:39.131597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506157+0000","last_change":"2024-09-15T22:47:43.518742+0000","last_active":"2024-09-15T22:47:44.506157+0000","last_peered":"2024-09-15T22:47:44.506157+0000","last_clean":"2024-09-15T22:47:44.506157+0000","last_became_active":"2024-09-15T22:47:43.518438+0000","last_became_peered":"2024-09-15T22:47:43.518438+0000","last_unstale":"2024-09-15T22:47:44.506157+0000","last_undegraded":"2024-09-15T22:47:44.506157+0000","last_fullsized":"2024-09-15T22:47:44.506157+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:29.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"145'6","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635805+0000","last_change":"2024-09-15T22:47:42.497870+0000","last_active":"2024-09-15T22:47:44.635805+0000","last_peered":"2024-09-15T22:47:44.635805+0000","last_clean":"2024-09-15T22:47:44.635805+0000","last_became_active":"2024-09-15T22:47:42.497517+0000","last_became_peered":"2024-09-15T22:47:42.497517+0000","last_unstale":"2024-09-15T22:47:44.635805+0000","last_undegraded":"2024-09-15T22:47:44.635805+0000","last_fullsized":"2024-09-15T22:47:44.635805+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508761+0000","last_change":"2024-09-15T22:47:43.522920+0000","last_active":"2024-09-15T22:47:44.508761+0000","last_peered":"2024-09-15T22:47:44.508761+0000","last_clean":"2024-09-15T22:47:44.508761+0000","last_became_active":"2024-09-15T22:47:43.522601+0000","last_became_peered":"2024-09-15T22:47:43.522601+0000","last_unstale":"2024-09-15T22:47:44.508761+0000","last_undegraded":"2024-09-15T22:47:44.508761+0000","last_fullsized":"2024-09-15T22:47:44.508761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.987708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509710+0000","last_change":"2024-09-15T22:47:42.501679+0000","last_active":"2024-09-15T22:47:44.509710+0000","last_peered":"2024-09-15T22:47:44.509710+0000","last_clean":"2024-09-15T22:47:44.509710+0000","last_became_active":"2024-09-15T22:47:42.501404+0000","last_became_peered":"2024-09-15T22:47:42.501404+0000","last_unstale":"2024-09-15T22:47:44.509710+0000","last_undegraded":"2024-09-15T22:47:44.509710+0000","last_fullsized":"2024-09-15T22:47:44.509710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:38.846276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635774+0000","last_change":"2024-09-15T22:47:43.523716+0000","last_active":"2024-09-15T22:47:44.635774+0000","last_peered":"2024-09-15T22:47:44.635774+0000","last_clean":"2024-09-15T22:47:44.635774+0000","last_became_active":"2024-09-15T22:47:43.523300+0000","last_became_peered":"2024-09-15T22:47:43.523300+0000","last_unstale":"2024-09-15T22:47:44.635774+0000","last_undegraded":"2024-09-15T22:47:44.635774+0000","last_fullsized":"2024-09-15T22:47:44.635774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:14.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635444+0000","last_change":"2024-09-15T22:47:42.494248+0000","last_active":"2024-09-15T22:47:44.635444+0000","last_peered":"2024-09-15T22:47:44.635444+0000","last_clean":"2024-09-15T22:47:44.635444+0000","last_became_active":"2024-09-15T22:47:42.493969+0000","last_became_peered":"2024-09-15T22:47:42.493969+0000","last_unstale":"2024-09-15T22:47:44.635444+0000","last_undegraded":"2024-09-15T22:47:44.635444+0000","last_fullsized":"2024-09-15T22:47:44.635444+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:23.893832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635730+0000","last_change":"2024-09-15T22:47:43.520031+0000","last_active":"2024-09-15T22:47:44.635730+0000","last_peered":"2024-09-15T22:47:44.635730+0000","last_clean":"2024-09-15T22:47:44.635730+0000","last_became_active":"2024-09-15T22:47:43.519766+0000","last_became_peered":"2024-09-15T22:47:43.519766+0000","last_unstale":"2024-09-15T22:47:44.635730+0000","last_undegraded":"2024-09-15T22:47:44.635730+0000","last_fullsized":"2024-09-15T22:47:44.635730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:49.465229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509230+0000","last_change":"2024-09-15T22:47:42.496158+0000","last_active":"2024-09-15T22:47:44.509230+0000","last_peered":"2024-09-15T22:47:44.509230+0000","last_clean":"2024-09-15T22:47:44.509230+0000","last_became_active":"2024-09-15T22:47:42.495684+0000","last_became_peered":"2024-09-15T22:47:42.495684+0000","last_unstale":"2024-09-15T22:47:44.509230+0000","last_undegraded":"2024-09-15T22:47:44.509230+0000","last_fullsized":"2024-09-15T22:47:44.509230+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:51.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635399+0000","last_change":"2024-09-15T22:47:43.518355+0000","last_active":"2024-09-15T22:47:44.635399+0000","last_peered":"2024-09-15T22:47:44.635399+0000","last_clean":"2024-09-15T22:47:44.635399+0000","last_became_active":"2024-09-15T22:47:43.518071+0000","last_became_peered":"2024-09-15T22:47:43.518071+0000","last_unstale":"2024-09-15T22:47:44.635399+0000","last_undegraded":"2024-09-15T22:47:44.635399+0000","last_fullsized":"2024-09-15T22:47:44.635399+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:41.796107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"145'8","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634826+0000","last_change":"2024-09-15T22:47:42.496081+0000","last_active":"2024-09-15T22:47:44.634826+0000","last_peered":"2024-09-15T22:47:44.634826+0000","last_clean":"2024-09-15T22:47:44.634826+0000","last_became_active":"2024-09-15T22:47:42.495781+0000","last_became_peered":"2024-09-15T22:47:42.495781+0000","last_unstale":"2024-09-15T22:47:44.634826+0000","last_undegraded":"2024-09-15T22:47:44.634826+0000","last_fullsized":"2024-09-15T22:47:44.634826+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:01.935252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509390+0000","last_change":"2024-09-15T22:47:43.528772+0000","last_active":"2024-09-15T22:47:44.509390+0000","last_peered":"2024-09-15T22:47:44.509390+0000","last_clean":"2024-09-15T22:47:44.509390+0000","last_became_active":"2024-09-15T22:47:43.528499+0000","last_became_peered":"2024-09-15T22:47:43.528499+0000","last_unstale":"2024-09-15T22:47:44.509390+0000","last_undegraded":"2024-09-15T22:47:44.509390+0000","last_fullsized":"2024-09-15T22:47:44.509390+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:43.295304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635997+0000","last_change":"2024-09-15T22:47:42.496730+0000","last_active":"2024-09-15T22:47:44.635997+0000","last_peered":"2024-09-15T22:47:44.635997+0000","last_clean":"2024-09-15T22:47:44.635997+0000","last_became_active":"2024-09-15T22:47:42.496456+0000","last_became_peered":"2024-09-15T22:47:42.496456+0000","last_unstale":"2024-09-15T22:47:44.635997+0000","last_undegraded":"2024-09-15T22:47:44.635997+0000","last_fullsized":"2024-09-15T22:47:44.635997+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:23.893832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510123+0000","last_change":"2024-09-15T22:47:43.516452+0000","last_active":"2024-09-15T22:47:44.510123+0000","last_peered":"2024-09-15T22:47:44.510123+0000","last_clean":"2024-09-15T22:47:44.510123+0000","last_became_active":"2024-09-15T22:47:43.516134+0000","last_became_peered":"2024-09-15T22:47:43.516134+0000","last_unstale":"2024-09-15T22:47:44.510123+0000","last_undegraded":"2024-09-15T22:47:44.510123+0000","last_fullsized":"2024-09-15T22:47:44.510123+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.724622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635429+0000","last_change":"2024-09-15T22:47:42.500652+0000","last_active":"2024-09-15T22:47:44.635429+0000","last_peered":"2024-09-15T22:47:44.635429+0000","last_clean":"2024-09-15T22:47:44.635429+0000","last_became_active":"2024-09-15T22:47:42.500379+0000","last_became_peered":"2024-09-15T22:47:42.500379+0000","last_unstale":"2024-09-15T22:47:44.635429+0000","last_undegraded":"2024-09-15T22:47:44.635429+0000","last_fullsized":"2024-09-15T22:47:44.635429+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:14.421670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510181+0000","last_change":"2024-09-15T22:47:43.527271+0000","last_active":"2024-09-15T22:47:44.510181+0000","last_peered":"2024-09-15T22:47:44.510181+0000","last_clean":"2024-09-15T22:47:44.510181+0000","last_became_active":"2024-09-15T22:47:43.526829+0000","last_became_peered":"2024-09-15T22:47:43.526829+0000","last_unstale":"2024-09-15T22:47:44.510181+0000","last_undegraded":"2024-09-15T22:47:44.510181+0000","last_fullsized":"2024-09-15T22:47:44.510181+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:37.402634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636055+0000","last_change":"2024-09-15T22:47:42.497476+0000","last_active":"2024-09-15T22:47:44.636055+0000","last_peered":"2024-09-15T22:47:44.636055+0000","last_clean":"2024-09-15T22:47:44.636055+0000","last_became_active":"2024-09-15T22:47:42.496984+0000","last_became_peered":"2024-09-15T22:47:42.496984+0000","last_unstale":"2024-09-15T22:47:44.636055+0000","last_undegraded":"2024-09-15T22:47:44.636055+0000","last_fullsized":"2024-09-15T22:47:44.636055+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:31.686549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636053+0000","last_change":"2024-09-15T22:47:43.523539+0000","last_active":"2024-09-15T22:47:44.636053+0000","last_peered":"2024-09-15T22:47:44.636053+0000","last_clean":"2024-09-15T22:47:44.636053+0000","last_became_active":"2024-09-15T22:47:43.523238+0000","last_became_peered":"2024-09-15T22:47:43.523238+0000","last_unstale":"2024-09-15T22:47:44.636053+0000","last_undegraded":"2024-09-15T22:47:44.636053+0000","last_fullsized":"2024-09-15T22:47:44.636053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:34.133363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520190+0000","last_change":"2024-09-15T22:47:42.501160+0000","last_active":"2024-09-15T22:47:44.520190+0000","last_peered":"2024-09-15T22:47:44.520190+0000","last_clean":"2024-09-15T22:47:44.520190+0000","last_became_active":"2024-09-15T22:47:42.500526+0000","last_became_peered":"2024-09-15T22:47:42.500526+0000","last_unstale":"2024-09-15T22:47:44.520190+0000","last_undegraded":"2024-09-15T22:47:44.520190+0000","last_fullsized":"2024-09-15T22:47:44.520190+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:31.598640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505860+0000","last_change":"2024-09-15T22:47:43.529502+0000","last_active":"2024-09-15T22:47:44.505860+0000","last_peered":"2024-09-15T22:47:44.505860+0000","last_clean":"2024-09-15T22:47:44.505860+0000","last_became_active":"2024-09-15T22:47:43.529054+0000","last_became_peered":"2024-09-15T22:47:43.529054+0000","last_unstale":"2024-09-15T22:47:44.505860+0000","last_undegraded":"2024-09-15T22:47:44.505860+0000","last_fullsized":"2024-09-15T22:47:44.505860+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:22.570248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635765+0000","last_change":"2024-09-15T22:47:42.496386+0000","last_active":"2024-09-15T22:47:44.635765+0000","last_peered":"2024-09-15T22:47:44.635765+0000","last_clean":"2024-09-15T22:47:44.635765+0000","last_became_active":"2024-09-15T22:47:42.496104+0000","last_became_peered":"2024-09-15T22:47:42.496104+0000","last_unstale":"2024-09-15T22:47:44.635765+0000","last_undegraded":"2024-09-15T22:47:44.635765+0000","last_fullsized":"2024-09-15T22:47:44.635765+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:05.941751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635705+0000","last_change":"2024-09-15T22:47:43.523571+0000","last_active":"2024-09-15T22:47:44.635705+0000","last_peered":"2024-09-15T22:47:44.635705+0000","last_clean":"2024-09-15T22:47:44.635705+0000","last_became_active":"2024-09-15T22:47:43.522998+0000","last_became_peered":"2024-09-15T22:47:43.522998+0000","last_unstale":"2024-09-15T22:47:44.635705+0000","last_undegraded":"2024-09-15T22:47:44.635705+0000","last_fullsized":"2024-09-15T22:47:44.635705+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:18.594588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.519917+0000","last_change":"2024-09-15T22:47:42.496892+0000","last_active":"2024-09-15T22:47:44.519917+0000","last_peered":"2024-09-15T22:47:44.519917+0000","last_clean":"2024-09-15T22:47:44.519917+0000","last_became_active":"2024-09-15T22:47:42.496457+0000","last_became_peered":"2024-09-15T22:47:42.496457+0000","last_unstale":"2024-09-15T22:47:44.519917+0000","last_undegraded":"2024-09-15T22:47:44.519917+0000","last_fullsized":"2024-09-15T22:47:44.519917+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:24.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505770+0000","last_change":"2024-09-15T22:47:43.523643+0000","last_active":"2024-09-15T22:47:44.505770+0000","last_peered":"2024-09-15T22:47:44.505770+0000","last_clean":"2024-09-15T22:47:44.505770+0000","last_became_active":"2024-09-15T22:47:43.523319+0000","last_became_peered":"2024-09-15T22:47:43.523319+0000","last_unstale":"2024-09-15T22:47:44.505770+0000","last_undegraded":"2024-09-15T22:47:44.505770+0000","last_fullsized":"2024-09-15T22:47:44.505770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:49.918899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509480+0000","last_change":"2024-09-15T22:47:42.507819+0000","last_active":"2024-09-15T22:47:44.509480+0000","last_peered":"2024-09-15T22:47:44.509480+0000","last_clean":"2024-09-15T22:47:44.509480+0000","last_became_active":"2024-09-15T22:47:42.507434+0000","last_became_peered":"2024-09-15T22:47:42.507434+0000","last_unstale":"2024-09-15T22:47:44.509480+0000","last_undegraded":"2024-09-15T22:47:44.509480+0000","last_fullsized":"2024-09-15T22:47:44.509480+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:13.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509175+0000","last_change":"2024-09-15T22:47:43.511408+0000","last_active":"2024-09-15T22:47:44.509175+0000","last_peered":"2024-09-15T22:47:44.509175+0000","last_clean":"2024-09-15T22:47:44.509175+0000","last_became_active":"2024-09-15T22:47:43.511136+0000","last_became_peered":"2024-09-15T22:47:43.511136+0000","last_unstale":"2024-09-15T22:47:44.509175+0000","last_undegraded":"2024-09-15T22:47:44.509175+0000","last_fullsized":"2024-09-15T22:47:44.509175+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:09.563984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.519941+0000","last_change":"2024-09-15T22:47:42.501259+0000","last_active":"2024-09-15T22:47:44.519941+0000","last_peered":"2024-09-15T22:47:44.519941+0000","last_clean":"2024-09-15T22:47:44.519941+0000","last_became_active":"2024-09-15T22:47:42.500881+0000","last_became_peered":"2024-09-15T22:47:42.500881+0000","last_unstale":"2024-09-15T22:47:44.519941+0000","last_undegraded":"2024-09-15T22:47:44.519941+0000","last_fullsized":"2024-09-15T22:47:44.519941+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:36.395886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636069+0000","last_change":"2024-09-15T22:47:43.528192+0000","last_active":"2024-09-15T22:47:44.636069+0000","last_peered":"2024-09-15T22:47:44.636069+0000","last_clean":"2024-09-15T22:47:44.636069+0000","last_became_active":"2024-09-15T22:47:43.527827+0000","last_became_peered":"2024-09-15T22:47:43.527827+0000","last_unstale":"2024-09-15T22:47:44.636069+0000","last_undegraded":"2024-09-15T22:47:44.636069+0000","last_fullsized":"2024-09-15T22:47:44.636069+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:57.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635649+0000","last_change":"2024-09-15T22:47:42.500418+0000","last_active":"2024-09-15T22:47:44.635649+0000","last_peered":"2024-09-15T22:47:44.635649+0000","last_clean":"2024-09-15T22:47:44.635649+0000","last_became_active":"2024-09-15T22:47:42.500136+0000","last_became_peered":"2024-09-15T22:47:42.500136+0000","last_unstale":"2024-09-15T22:47:44.635649+0000","last_undegraded":"2024-09-15T22:47:44.635649+0000","last_fullsized":"2024-09-15T22:47:44.635649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:31.686549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510248+0000","last_change":"2024-09-15T22:47:43.522006+0000","last_active":"2024-09-15T22:47:44.510248+0000","last_peered":"2024-09-15T22:47:44.510248+0000","last_clean":"2024-09-15T22:47:44.510248+0000","last_became_active":"2024-09-15T22:47:43.521626+0000","last_became_peered":"2024-09-15T22:47:43.521626+0000","last_unstale":"2024-09-15T22:47:44.510248+0000","last_undegraded":"2024-09-15T22:47:44.510248+0000","last_fullsized":"2024-09-15T22:47:44.510248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:25.814111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"146'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520192+0000","last_change":"2024-09-15T22:47:42.507766+0000","last_active":"2024-09-15T22:47:44.520192+0000","last_peered":"2024-09-15T22:47:44.520192+0000","last_clean":"2024-09-15T22:47:44.520192+0000","last_became_active":"2024-09-15T22:47:42.507427+0000","last_became_peered":"2024-09-15T22:47:42.507427+0000","last_unstale":"2024-09-15T22:47:44.520192+0000","last_undegraded":"2024-09-15T22:47:44.520192+0000","last_fullsized":"2024-09-15T22:47:44.520192+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:57.427956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510199+0000","last_change":"2024-09-15T22:47:43.510997+0000","last_active":"2024-09-15T22:47:44.510199+0000","last_peered":"2024-09-15T22:47:44.510199+0000","last_clean":"2024-09-15T22:47:44.510199+0000","last_became_active":"2024-09-15T22:47:43.510647+0000","last_became_peered":"2024-09-15T22:47:43.510647+0000","last_unstale":"2024-09-15T22:47:44.510199+0000","last_undegraded":"2024-09-15T22:47:44.510199+0000","last_fullsized":"2024-09-15T22:47:44.510199+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:58.434704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506209+0000","last_change":"2024-09-15T22:47:42.503704+0000","last_active":"2024-09-15T22:47:44.506209+0000","last_peered":"2024-09-15T22:47:44.506209+0000","last_clean":"2024-09-15T22:47:44.506209+0000","last_became_active":"2024-09-15T22:47:42.503423+0000","last_became_peered":"2024-09-15T22:47:42.503423+0000","last_unstale":"2024-09-15T22:47:44.506209+0000","last_undegraded":"2024-09-15T22:47:44.506209+0000","last_fullsized":"2024-09-15T22:47:44.506209+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:48.336453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509865+0000","last_change":"2024-09-15T22:47:43.514676+0000","last_active":"2024-09-15T22:47:44.509865+0000","last_peered":"2024-09-15T22:47:44.509865+0000","last_clean":"2024-09-15T22:47:44.509865+0000","last_became_active":"2024-09-15T22:47:43.514381+0000","last_became_peered":"2024-09-15T22:47:43.514381+0000","last_unstale":"2024-09-15T22:47:44.509865+0000","last_undegraded":"2024-09-15T22:47:44.509865+0000","last_fullsized":"2024-09-15T22:47:44.509865+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:21.256882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636049+0000","last_change":"2024-09-15T22:47:42.500709+0000","last_active":"2024-09-15T22:47:44.636049+0000","last_peered":"2024-09-15T22:47:44.636049+0000","last_clean":"2024-09-15T22:47:44.636049+0000","last_became_active":"2024-09-15T22:47:42.499288+0000","last_became_peered":"2024-09-15T22:47:42.499288+0000","last_unstale":"2024-09-15T22:47:44.636049+0000","last_undegraded":"2024-09-15T22:47:44.636049+0000","last_fullsized":"2024-09-15T22:47:44.636049+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:48.912151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635428+0000","last_change":"2024-09-15T22:47:43.529938+0000","last_active":"2024-09-15T22:47:44.635428+0000","last_peered":"2024-09-15T22:47:44.635428+0000","last_clean":"2024-09-15T22:47:44.635428+0000","last_became_active":"2024-09-15T22:47:43.529655+0000","last_became_peered":"2024-09-15T22:47:43.529655+0000","last_unstale":"2024-09-15T22:47:44.635428+0000","last_undegraded":"2024-09-15T22:47:44.635428+0000","last_fullsized":"2024-09-15T22:47:44.635428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:58.102508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635649+0000","last_change":"2024-09-15T22:47:42.501069+0000","last_active":"2024-09-15T22:47:44.635649+0000","last_peered":"2024-09-15T22:47:44.635649+0000","last_clean":"2024-09-15T22:47:44.635649+0000","last_became_active":"2024-09-15T22:47:42.500784+0000","last_became_peered":"2024-09-15T22:47:42.500784+0000","last_unstale":"2024-09-15T22:47:44.635649+0000","last_undegraded":"2024-09-15T22:47:44.635649+0000","last_fullsized":"2024-09-15T22:47:44.635649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:45.051317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505837+0000","last_change":"2024-09-15T22:47:43.518854+0000","last_active":"2024-09-15T22:47:44.505837+0000","last_peered":"2024-09-15T22:47:44.505837+0000","last_clean":"2024-09-15T22:47:44.505837+0000","last_became_active":"2024-09-15T22:47:43.518575+0000","last_became_peered":"2024-09-15T22:47:43.518575+0000","last_unstale":"2024-09-15T22:47:44.505837+0000","last_undegraded":"2024-09-15T22:47:44.505837+0000","last_fullsized":"2024-09-15T22:47:44.505837+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.949658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508803+0000","last_change":"2024-09-15T22:47:42.496415+0000","last_active":"2024-09-15T22:47:44.508803+0000","last_peered":"2024-09-15T22:47:44.508803+0000","last_clean":"2024-09-15T22:47:44.508803+0000","last_became_active":"2024-09-15T22:47:42.496137+0000","last_became_peered":"2024-09-15T22:47:42.496137+0000","last_unstale":"2024-09-15T22:47:44.508803+0000","last_undegraded":"2024-09-15T22:47:44.508803+0000","last_fullsized":"2024-09-15T22:47:44.508803+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:02.859152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508886+0000","last_change":"2024-09-15T22:47:43.520223+0000","last_active":"2024-09-15T22:47:44.508886+0000","last_peered":"2024-09-15T22:47:44.508886+0000","last_clean":"2024-09-15T22:47:44.508886+0000","last_became_active":"2024-09-15T22:47:43.519900+0000","last_became_peered":"2024-09-15T22:47:43.519900+0000","last_unstale":"2024-09-15T22:47:44.508886+0000","last_undegraded":"2024-09-15T22:47:44.508886+0000","last_fullsized":"2024-09-15T22:47:44.508886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:51.073480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505838+0000","last_change":"2024-09-15T22:47:42.503002+0000","last_active":"2024-09-15T22:47:44.505838+0000","last_peered":"2024-09-15T22:47:44.505838+0000","last_clean":"2024-09-15T22:47:44.505838+0000","last_became_active":"2024-09-15T22:47:42.502676+0000","last_became_peered":"2024-09-15T22:47:42.502676+0000","last_unstale":"2024-09-15T22:47:44.505838+0000","last_undegraded":"2024-09-15T22:47:44.505838+0000","last_fullsized":"2024-09-15T22:47:44.505838+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:23.905753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505779+0000","last_change":"2024-09-15T22:47:43.517449+0000","last_active":"2024-09-15T22:47:44.505779+0000","last_peered":"2024-09-15T22:47:44.505779+0000","last_clean":"2024-09-15T22:47:44.505779+0000","last_became_active":"2024-09-15T22:47:43.517161+0000","last_became_peered":"2024-09-15T22:47:43.517161+0000","last_unstale":"2024-09-15T22:47:44.505779+0000","last_undegraded":"2024-09-15T22:47:44.505779+0000","last_fullsized":"2024-09-15T22:47:44.505779+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:06.948499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505646+0000","last_change":"2024-09-15T22:47:42.498810+0000","last_active":"2024-09-15T22:47:44.505646+0000","last_peered":"2024-09-15T22:47:44.505646+0000","last_clean":"2024-09-15T22:47:44.505646+0000","last_became_active":"2024-09-15T22:47:42.498542+0000","last_became_peered":"2024-09-15T22:47:42.498542+0000","last_unstale":"2024-09-15T22:47:44.505646+0000","last_undegraded":"2024-09-15T22:47:44.505646+0000","last_fullsized":"2024-09-15T22:47:44.505646+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:12.687746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509430+0000","last_change":"2024-09-15T22:47:43.515905+0000","last_active":"2024-09-15T22:47:44.509430+0000","last_peered":"2024-09-15T22:47:44.509430+0000","last_clean":"2024-09-15T22:47:44.509430+0000","last_became_active":"2024-09-15T22:47:43.515538+0000","last_became_peered":"2024-09-15T22:47:43.515538+0000","last_unstale":"2024-09-15T22:47:44.509430+0000","last_undegraded":"2024-09-15T22:47:44.509430+0000","last_fullsized":"2024-09-15T22:47:44.509430+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:51.066048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635907+0000","last_change":"2024-09-15T22:47:42.497314+0000","last_active":"2024-09-15T22:47:44.635907+0000","last_peered":"2024-09-15T22:47:44.635907+0000","last_clean":"2024-09-15T22:47:44.635907+0000","last_became_active":"2024-09-15T22:47:42.497036+0000","last_became_peered":"2024-09-15T22:47:42.497036+0000","last_unstale":"2024-09-15T22:47:44.635907+0000","last_undegraded":"2024-09-15T22:47:44.635907+0000","last_fullsized":"2024-09-15T22:47:44.635907+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:17.233339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":439,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634910+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:44.634910+0000","last_peered":"2024-09-15T22:47:44.634910+0000","last_clean":"2024-09-15T22:47:44.634910+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:44.634910+0000","last_undegraded":"2024-09-15T22:47:44.634910+0000","last_fullsized":"2024-09-15T22:47:44.634910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":804816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":804850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33564,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338276,"statfs":{"total":96636764160,"available":96602394624,"internally_reserved":0,"allocated":2428928,"data_stored":1395856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1830912,"data_stored":804850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32996,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338844,"statfs":{"total":96636764160,"available":96602976256,"internally_reserved":0,"allocated":1843200,"data_stored":806450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1830912,"data_stored":805398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33580,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338260,"statfs":{"total":96636764160,"available":96602378240,"internally_reserved":0,"allocated":2445312,"data_stored":1396978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1830912,"data_stored":804886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:50.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:47:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.944+0000 7efc77053640 1 Processor -- start 2024-09-15T22:47:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.944+0000 7efc77053640 1 -- start start 2024-09-15T22:47:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 0x7efc7015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc700cd130 0x7efc7006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc7006c0e0 0x7efc7015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efc700b52b0 con 0x7efc700cd130 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efc7015bf90 con 0x7efc700b4ed0 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc77053640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc700cd5c0 con 0x7efc7006c0e0 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc700cd130 0x7efc7006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc700cd130 0x7efc7006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55114/0 (socket says 172.21.15.134:55114) 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 -- 172.21.15.134:0/1051156443 learned_addr learned my addr 172.21.15.134:0/1051156443 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc74def640 1 --2- 172.21.15.134:0/1051156443 >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 0x7efc7015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc755f0640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc7006c0e0 0x7efc7015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 -- 172.21.15.134:0/1051156443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc7006c0e0 msgr2=0x7efc7015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc7006c0e0 0x7efc7015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 -- 172.21.15.134:0/1051156443 >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 msgr2=0x7efc7015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 --2- 172.21.15.134:0/1051156443 >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 0x7efc7015ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc6ffff640 1 -- 172.21.15.134:0/1051156443 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700cd8a0 con 0x7efc700cd130 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.945+0000 7efc74def640 1 --2- 172.21.15.134:0/1051156443 >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 0x7efc7015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.946+0000 7efc6ffff640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700cd130 0x7efc7006bba0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7efc7006c8d0 tx=0x7efc5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a058cf304bb4258a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.946+0000 7efc6f7fe640 1 -- 172.21.15.134:0/1051156443 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c037070 con 0x7efc700cd130 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.946+0000 7efc6f7fe640 1 -- 172.21.15.134:0/1051156443 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c032440 con 0x7efc700cd130 2024-09-15T22:47:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.946+0000 7efc6f7fe640 1 -- 172.21.15.134:0/1051156443 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c032810 con 0x7efc700cd130 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 -- 172.21.15.134:0/1051156443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700cd130 msgr2=0x7efc7006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700cd130 0x7efc7006bba0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7efc7006c8d0 tx=0x7efc5c02a180 comp rx=0 tx=0).stop 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 -- 172.21.15.134:0/1051156443 shutdown_connections 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc7006c0e0 0x7efc7015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 --2- 172.21.15.134:0/1051156443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700cd130 0x7efc7006bba0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 --2- 172.21.15.134:0/1051156443 >> v2:172.21.15.177:3300/0 conn(0x7efc700b4ed0 0x7efc7015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 -- 172.21.15.134:0/1051156443 >> 172.21.15.134:0/1051156443 conn(0x7efc70062cc0 msgr2=0x7efc7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 -- 172.21.15.134:0/1051156443 shutdown_connections 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.947+0000 7efc77053640 1 -- 172.21.15.134:0/1051156443 wait complete. 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.948+0000 7efc77053640 1 Processor -- start 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.948+0000 7efc77053640 1 -- start start 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 0x7efc70151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 0x7efc70073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc700cde60 con 0x7efc700b2760 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc700ce140 con 0x7efc7006c0e0 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc77053640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efc700ce660 con 0x7efc700b4ed0 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc755f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc755f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55128/0 (socket says 172.21.15.134:55128) 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc755f0640 1 -- 172.21.15.134:0/2747038408 learned_addr learned my addr 172.21.15.134:0/2747038408 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc6ffff640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 0x7efc70073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 -- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 msgr2=0x7efc70073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.949+0000 7efc74def640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 0x7efc70151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 0x7efc70073660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 -- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 msgr2=0x7efc70151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 0x7efc70151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 -- 172.21.15.134:0/2747038408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700b2c20 con 0x7efc700b2760 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc6ffff640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 0x7efc70073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc74def640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 0x7efc70151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc755f0640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efc68007ef0 tx=0x7efc680106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68018070 con 0x7efc700b2760 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68013880 con 0x7efc700b2760 2024-09-15T22:47:50.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc701449b0 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68013c70 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.950+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc70073ba0 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.951+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc701447a0 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.951+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7efc6801b070 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.952+0000 7efc6d7fa640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 0x7efc5406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.952+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7efc6808f040 con 0x7efc700b2760 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.952+0000 7efc74def640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 0x7efc5406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.953+0000 7efc74def640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 0x7efc5406eda0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc64006fd0 tx=0x7efc64008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:50.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:50.956+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc6805cdb0 con 0x7efc700b2760 2024-09-15T22:47:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.119+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc700d0ee0 con 0x7efc5406c8e0 2024-09-15T22:47:51.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.125+0000 7efc6d7fa640 1 -- 172.21.15.134:0/2747038408 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252485 (secure 0 0 0) 0x7efc700d0ee0 con 0x7efc5406c8e0 2024-09-15T22:47:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:51.130 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:47:51.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 msgr2=0x7efc5406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 0x7efc5406eda0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc64006fd0 tx=0x7efc64008040 comp rx=0 tx=0).stop 2024-09-15T22:47:51.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 msgr2=0x7efc70159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efc68007ef0 tx=0x7efc680106c0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 shutdown_connections 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efc5406c8e0 0x7efc5406eda0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc700b2760 0x7efc70159730 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc700b4ed0 0x7efc70073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.128+0000 7efc77053640 1 --2- 172.21.15.134:0/2747038408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc7006c0e0 0x7efc70151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.129+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 >> 172.21.15.134:0/2747038408 conn(0x7efc70062cc0 msgr2=0x7efc700d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.129+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 shutdown_connections 2024-09-15T22:47:51.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.129+0000 7efc77053640 1 -- 172.21.15.134:0/2747038408 wait complete. 2024-09-15T22:47:51.141 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-15T22:47:49.216358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265032,"kb_used_data":15496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709688,"statfs":{"total":773094113280,"available":772822720512,"internally_reserved":0,"allocated":15867904,"data_stored":7624084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.732363"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506257+0000","last_change":"2024-09-15T22:47:43.531865+0000","last_active":"2024-09-15T22:47:44.506257+0000","last_peered":"2024-09-15T22:47:44.506257+0000","last_clean":"2024-09-15T22:47:44.506257+0000","last_became_active":"2024-09-15T22:47:43.531641+0000","last_became_peered":"2024-09-15T22:47:43.531641+0000","last_unstale":"2024-09-15T22:47:44.506257+0000","last_undegraded":"2024-09-15T22:47:44.506257+0000","last_fullsized":"2024-09-15T22:47:44.506257+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:41.796107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506210+0000","last_change":"2024-09-15T22:47:43.529356+0000","last_active":"2024-09-15T22:47:44.506210+0000","last_peered":"2024-09-15T22:47:44.506210+0000","last_clean":"2024-09-15T22:47:44.506210+0000","last_became_active":"2024-09-15T22:47:43.529078+0000","last_became_peered":"2024-09-15T22:47:43.529078+0000","last_unstale":"2024-09-15T22:47:44.506210+0000","last_undegraded":"2024-09-15T22:47:44.506210+0000","last_fullsized":"2024-09-15T22:47:44.506210+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.366784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506127+0000","last_change":"2024-09-15T22:47:43.529100+0000","last_active":"2024-09-15T22:47:44.506127+0000","last_peered":"2024-09-15T22:47:44.506127+0000","last_clean":"2024-09-15T22:47:44.506127+0000","last_became_active":"2024-09-15T22:47:43.528775+0000","last_became_peered":"2024-09-15T22:47:43.528775+0000","last_unstale":"2024-09-15T22:47:44.506127+0000","last_undegraded":"2024-09-15T22:47:44.506127+0000","last_fullsized":"2024-09-15T22:47:44.506127+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:50.166567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509849+0000","last_change":"2024-09-15T22:47:43.527278+0000","last_active":"2024-09-15T22:47:44.509849+0000","last_peered":"2024-09-15T22:47:44.509849+0000","last_clean":"2024-09-15T22:47:44.509849+0000","last_became_active":"2024-09-15T22:47:43.526967+0000","last_became_peered":"2024-09-15T22:47:43.526967+0000","last_unstale":"2024-09-15T22:47:44.509849+0000","last_undegraded":"2024-09-15T22:47:44.509849+0000","last_fullsized":"2024-09-15T22:47:44.509849+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:27.527686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635534+0000","last_change":"2024-09-15T22:47:43.516590+0000","last_active":"2024-09-15T22:47:44.635534+0000","last_peered":"2024-09-15T22:47:44.635534+0000","last_clean":"2024-09-15T22:47:44.635534+0000","last_became_active":"2024-09-15T22:47:43.515870+0000","last_became_peered":"2024-09-15T22:47:43.515870+0000","last_unstale":"2024-09-15T22:47:44.635534+0000","last_undegraded":"2024-09-15T22:47:44.635534+0000","last_fullsized":"2024-09-15T22:47:44.635534+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:23.151489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635257+0000","last_change":"2024-09-15T22:47:43.524230+0000","last_active":"2024-09-15T22:47:44.635257+0000","last_peered":"2024-09-15T22:47:44.635257+0000","last_clean":"2024-09-15T22:47:44.635257+0000","last_became_active":"2024-09-15T22:47:43.523919+0000","last_became_peered":"2024-09-15T22:47:43.523919+0000","last_unstale":"2024-09-15T22:47:44.635257+0000","last_undegraded":"2024-09-15T22:47:44.635257+0000","last_fullsized":"2024-09-15T22:47:44.635257+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:23.151489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509534+0000","last_change":"2024-09-15T22:47:43.513952+0000","last_active":"2024-09-15T22:47:44.509534+0000","last_peered":"2024-09-15T22:47:44.509534+0000","last_clean":"2024-09-15T22:47:44.509534+0000","last_became_active":"2024-09-15T22:47:43.513683+0000","last_became_peered":"2024-09-15T22:47:43.513683+0000","last_unstale":"2024-09-15T22:47:44.509534+0000","last_undegraded":"2024-09-15T22:47:44.509534+0000","last_fullsized":"2024-09-15T22:47:44.509534+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:38.324230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635033+0000","last_change":"2024-09-15T22:47:43.524277+0000","last_active":"2024-09-15T22:47:44.635033+0000","last_peered":"2024-09-15T22:47:44.635033+0000","last_clean":"2024-09-15T22:47:44.635033+0000","last_became_active":"2024-09-15T22:47:43.523994+0000","last_became_peered":"2024-09-15T22:47:43.523994+0000","last_unstale":"2024-09-15T22:47:44.635033+0000","last_undegraded":"2024-09-15T22:47:44.635033+0000","last_fullsized":"2024-09-15T22:47:44.635033+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:40.138345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635122+0000","last_change":"2024-09-15T22:47:43.515831+0000","last_active":"2024-09-15T22:47:44.635122+0000","last_peered":"2024-09-15T22:47:44.635122+0000","last_clean":"2024-09-15T22:47:44.635122+0000","last_became_active":"2024-09-15T22:47:43.515567+0000","last_became_peered":"2024-09-15T22:47:43.515567+0000","last_unstale":"2024-09-15T22:47:44.635122+0000","last_undegraded":"2024-09-15T22:47:44.635122+0000","last_fullsized":"2024-09-15T22:47:44.635122+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:22.570248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635330+0000","last_change":"2024-09-15T22:47:43.523476+0000","last_active":"2024-09-15T22:47:44.635330+0000","last_peered":"2024-09-15T22:47:44.635330+0000","last_clean":"2024-09-15T22:47:44.635330+0000","last_became_active":"2024-09-15T22:47:43.523214+0000","last_became_peered":"2024-09-15T22:47:43.523214+0000","last_unstale":"2024-09-15T22:47:44.635330+0000","last_undegraded":"2024-09-15T22:47:44.635330+0000","last_fullsized":"2024-09-15T22:47:44.635330+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:15.366784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635508+0000","last_change":"2024-09-15T22:47:43.528564+0000","last_active":"2024-09-15T22:47:44.635508+0000","last_peered":"2024-09-15T22:47:44.635508+0000","last_clean":"2024-09-15T22:47:44.635508+0000","last_became_active":"2024-09-15T22:47:43.527183+0000","last_became_peered":"2024-09-15T22:47:43.527183+0000","last_unstale":"2024-09-15T22:47:44.635508+0000","last_undegraded":"2024-09-15T22:47:44.635508+0000","last_fullsized":"2024-09-15T22:47:44.635508+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:04.218829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520041+0000","last_change":"2024-09-15T22:47:43.521236+0000","last_active":"2024-09-15T22:47:44.520041+0000","last_peered":"2024-09-15T22:47:44.520041+0000","last_clean":"2024-09-15T22:47:44.520041+0000","last_became_active":"2024-09-15T22:47:43.520942+0000","last_became_peered":"2024-09-15T22:47:43.520942+0000","last_unstale":"2024-09-15T22:47:44.520041+0000","last_undegraded":"2024-09-15T22:47:44.520041+0000","last_fullsized":"2024-09-15T22:47:44.520041+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:14.047014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520040+0000","last_change":"2024-09-15T22:47:43.530401+0000","last_active":"2024-09-15T22:47:44.520040+0000","last_peered":"2024-09-15T22:47:44.520040+0000","last_clean":"2024-09-15T22:47:44.520040+0000","last_became_active":"2024-09-15T22:47:43.530110+0000","last_became_peered":"2024-09-15T22:47:43.530110+0000","last_unstale":"2024-09-15T22:47:44.520040+0000","last_undegraded":"2024-09-15T22:47:44.520040+0000","last_fullsized":"2024-09-15T22:47:44.520040+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:10.742775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635182+0000","last_change":"2024-09-15T22:47:43.520902+0000","last_active":"2024-09-15T22:47:44.635182+0000","last_peered":"2024-09-15T22:47:44.635182+0000","last_clean":"2024-09-15T22:47:44.635182+0000","last_became_active":"2024-09-15T22:47:43.520467+0000","last_became_peered":"2024-09-15T22:47:43.520467+0000","last_unstale":"2024-09-15T22:47:44.635182+0000","last_undegraded":"2024-09-15T22:47:44.635182+0000","last_fullsized":"2024-09-15T22:47:44.635182+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:37.683513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635323+0000","last_change":"2024-09-15T22:47:43.530257+0000","last_active":"2024-09-15T22:47:44.635323+0000","last_peered":"2024-09-15T22:47:44.635323+0000","last_clean":"2024-09-15T22:47:44.635323+0000","last_became_active":"2024-09-15T22:47:43.529966+0000","last_became_peered":"2024-09-15T22:47:43.529966+0000","last_unstale":"2024-09-15T22:47:44.635323+0000","last_undegraded":"2024-09-15T22:47:44.635323+0000","last_fullsized":"2024-09-15T22:47:44.635323+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:29.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508743+0000","last_change":"2024-09-15T22:47:43.521481+0000","last_active":"2024-09-15T22:47:44.508743+0000","last_peered":"2024-09-15T22:47:44.508743+0000","last_clean":"2024-09-15T22:47:44.508743+0000","last_became_active":"2024-09-15T22:47:43.521206+0000","last_became_peered":"2024-09-15T22:47:43.521206+0000","last_unstale":"2024-09-15T22:47:44.508743+0000","last_undegraded":"2024-09-15T22:47:44.508743+0000","last_fullsized":"2024-09-15T22:47:44.508743+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:53.553915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635544+0000","last_change":"2024-09-15T22:47:43.522856+0000","last_active":"2024-09-15T22:47:44.635544+0000","last_peered":"2024-09-15T22:47:44.635544+0000","last_clean":"2024-09-15T22:47:44.635544+0000","last_became_active":"2024-09-15T22:47:43.522594+0000","last_became_peered":"2024-09-15T22:47:43.522594+0000","last_unstale":"2024-09-15T22:47:44.635544+0000","last_undegraded":"2024-09-15T22:47:44.635544+0000","last_fullsized":"2024-09-15T22:47:44.635544+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:40.025948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510016+0000","last_change":"2024-09-15T22:47:43.519070+0000","last_active":"2024-09-15T22:47:44.510016+0000","last_peered":"2024-09-15T22:47:44.510016+0000","last_clean":"2024-09-15T22:47:44.510016+0000","last_became_active":"2024-09-15T22:47:43.518613+0000","last_became_peered":"2024-09-15T22:47:43.518613+0000","last_unstale":"2024-09-15T22:47:44.510016+0000","last_undegraded":"2024-09-15T22:47:44.510016+0000","last_fullsized":"2024-09-15T22:47:44.510016+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:39.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509183+0000","last_change":"2024-09-15T22:47:43.518245+0000","last_active":"2024-09-15T22:47:44.509183+0000","last_peered":"2024-09-15T22:47:44.509183+0000","last_clean":"2024-09-15T22:47:44.509183+0000","last_became_active":"2024-09-15T22:47:43.517958+0000","last_became_peered":"2024-09-15T22:47:43.517958+0000","last_unstale":"2024-09-15T22:47:44.509183+0000","last_undegraded":"2024-09-15T22:47:44.509183+0000","last_fullsized":"2024-09-15T22:47:44.509183+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:04.338085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520145+0000","last_change":"2024-09-15T22:47:43.520655+0000","last_active":"2024-09-15T22:47:44.520145+0000","last_peered":"2024-09-15T22:47:44.520145+0000","last_clean":"2024-09-15T22:47:44.520145+0000","last_became_active":"2024-09-15T22:47:43.520367+0000","last_became_peered":"2024-09-15T22:47:43.520367+0000","last_unstale":"2024-09-15T22:47:44.520145+0000","last_undegraded":"2024-09-15T22:47:44.520145+0000","last_fullsized":"2024-09-15T22:47:44.520145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:41.549667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635205+0000","last_change":"2024-09-15T22:47:43.526543+0000","last_active":"2024-09-15T22:47:44.635205+0000","last_peered":"2024-09-15T22:47:44.635205+0000","last_clean":"2024-09-15T22:47:44.635205+0000","last_became_active":"2024-09-15T22:47:43.526294+0000","last_became_peered":"2024-09-15T22:47:43.526294+0000","last_unstale":"2024-09-15T22:47:44.635205+0000","last_undegraded":"2024-09-15T22:47:44.635205+0000","last_fullsized":"2024-09-15T22:47:44.635205+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:04.218829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635698+0000","last_change":"2024-09-15T22:47:43.525912+0000","last_active":"2024-09-15T22:47:44.635698+0000","last_peered":"2024-09-15T22:47:44.635698+0000","last_clean":"2024-09-15T22:47:44.635698+0000","last_became_active":"2024-09-15T22:47:43.525633+0000","last_became_peered":"2024-09-15T22:47:43.525633+0000","last_unstale":"2024-09-15T22:47:44.635698+0000","last_undegraded":"2024-09-15T22:47:44.635698+0000","last_fullsized":"2024-09-15T22:47:44.635698+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:26.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635633+0000","last_change":"2024-09-15T22:47:43.527258+0000","last_active":"2024-09-15T22:47:44.635633+0000","last_peered":"2024-09-15T22:47:44.635633+0000","last_clean":"2024-09-15T22:47:44.635633+0000","last_became_active":"2024-09-15T22:47:43.526845+0000","last_became_peered":"2024-09-15T22:47:43.526845+0000","last_unstale":"2024-09-15T22:47:44.635633+0000","last_undegraded":"2024-09-15T22:47:44.635633+0000","last_fullsized":"2024-09-15T22:47:44.635633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:47.732162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634856+0000","last_change":"2024-09-15T22:47:43.517084+0000","last_active":"2024-09-15T22:47:44.634856+0000","last_peered":"2024-09-15T22:47:44.634856+0000","last_clean":"2024-09-15T22:47:44.634856+0000","last_became_active":"2024-09-15T22:47:43.516229+0000","last_became_peered":"2024-09-15T22:47:43.516229+0000","last_unstale":"2024-09-15T22:47:44.634856+0000","last_undegraded":"2024-09-15T22:47:44.634856+0000","last_fullsized":"2024-09-15T22:47:44.634856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:15.751182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635969+0000","last_change":"2024-09-15T22:47:43.515657+0000","last_active":"2024-09-15T22:47:44.635969+0000","last_peered":"2024-09-15T22:47:44.635969+0000","last_clean":"2024-09-15T22:47:44.635969+0000","last_became_active":"2024-09-15T22:47:43.515348+0000","last_became_peered":"2024-09-15T22:47:43.515348+0000","last_unstale":"2024-09-15T22:47:44.635969+0000","last_undegraded":"2024-09-15T22:47:44.635969+0000","last_fullsized":"2024-09-15T22:47:44.635969+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:58.102508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636058+0000","last_change":"2024-09-15T22:47:43.528135+0000","last_active":"2024-09-15T22:47:44.636058+0000","last_peered":"2024-09-15T22:47:44.636058+0000","last_clean":"2024-09-15T22:47:44.636058+0000","last_became_active":"2024-09-15T22:47:43.525230+0000","last_became_peered":"2024-09-15T22:47:43.525230+0000","last_unstale":"2024-09-15T22:47:44.636058+0000","last_undegraded":"2024-09-15T22:47:44.636058+0000","last_fullsized":"2024-09-15T22:47:44.636058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:39.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635922+0000","last_change":"2024-09-15T22:47:43.509871+0000","last_active":"2024-09-15T22:47:44.635922+0000","last_peered":"2024-09-15T22:47:44.635922+0000","last_clean":"2024-09-15T22:47:44.635922+0000","last_became_active":"2024-09-15T22:47:43.509518+0000","last_became_peered":"2024-09-15T22:47:43.509518+0000","last_unstale":"2024-09-15T22:47:44.635922+0000","last_undegraded":"2024-09-15T22:47:44.635922+0000","last_fullsized":"2024-09-15T22:47:44.635922+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:58.511518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509209+0000","last_change":"2024-09-15T22:47:43.518508+0000","last_active":"2024-09-15T22:47:44.509209+0000","last_peered":"2024-09-15T22:47:44.509209+0000","last_clean":"2024-09-15T22:47:44.509209+0000","last_became_active":"2024-09-15T22:47:43.518028+0000","last_became_peered":"2024-09-15T22:47:43.518028+0000","last_unstale":"2024-09-15T22:47:44.509209+0000","last_undegraded":"2024-09-15T22:47:44.509209+0000","last_fullsized":"2024-09-15T22:47:44.509209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:09.591206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505966+0000","last_change":"2024-09-15T22:47:43.518023+0000","last_active":"2024-09-15T22:47:44.505966+0000","last_peered":"2024-09-15T22:47:44.505966+0000","last_clean":"2024-09-15T22:47:44.505966+0000","last_became_active":"2024-09-15T22:47:43.517747+0000","last_became_peered":"2024-09-15T22:47:43.517747+0000","last_unstale":"2024-09-15T22:47:44.505966+0000","last_undegraded":"2024-09-15T22:47:44.505966+0000","last_fullsized":"2024-09-15T22:47:44.505966+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:37.683513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635276+0000","last_change":"2024-09-15T22:47:43.520072+0000","last_active":"2024-09-15T22:47:44.635276+0000","last_peered":"2024-09-15T22:47:44.635276+0000","last_clean":"2024-09-15T22:47:44.635276+0000","last_became_active":"2024-09-15T22:47:43.519791+0000","last_became_peered":"2024-09-15T22:47:43.519791+0000","last_unstale":"2024-09-15T22:47:44.635276+0000","last_undegraded":"2024-09-15T22:47:44.635276+0000","last_fullsized":"2024-09-15T22:47:44.635276+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:50.166567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505805+0000","last_change":"2024-09-15T22:47:43.530725+0000","last_active":"2024-09-15T22:47:44.505805+0000","last_peered":"2024-09-15T22:47:44.505805+0000","last_clean":"2024-09-15T22:47:44.505805+0000","last_became_active":"2024-09-15T22:47:43.530470+0000","last_became_peered":"2024-09-15T22:47:43.530470+0000","last_unstale":"2024-09-15T22:47:44.505805+0000","last_undegraded":"2024-09-15T22:47:44.505805+0000","last_fullsized":"2024-09-15T22:47:44.505805+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:40.138345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635638+0000","last_change":"2024-09-15T22:47:43.523643+0000","last_active":"2024-09-15T22:47:44.635638+0000","last_peered":"2024-09-15T22:47:44.635638+0000","last_clean":"2024-09-15T22:47:44.635638+0000","last_became_active":"2024-09-15T22:47:43.523365+0000","last_became_peered":"2024-09-15T22:47:43.523365+0000","last_unstale":"2024-09-15T22:47:44.635638+0000","last_undegraded":"2024-09-15T22:47:44.635638+0000","last_fullsized":"2024-09-15T22:47:44.635638+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:26.697688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510021+0000","last_change":"2024-09-15T22:47:43.531002+0000","last_active":"2024-09-15T22:47:44.510021+0000","last_peered":"2024-09-15T22:47:44.510021+0000","last_clean":"2024-09-15T22:47:44.510021+0000","last_became_active":"2024-09-15T22:47:43.530528+0000","last_became_peered":"2024-09-15T22:47:43.530528+0000","last_unstale":"2024-09-15T22:47:44.510021+0000","last_undegraded":"2024-09-15T22:47:44.510021+0000","last_fullsized":"2024-09-15T22:47:44.510021+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.965805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"145'4","reported_seq":18,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506289+0000","last_change":"2024-09-15T22:47:42.497199+0000","last_active":"2024-09-15T22:47:44.506289+0000","last_peered":"2024-09-15T22:47:44.506289+0000","last_clean":"2024-09-15T22:47:44.506289+0000","last_became_active":"2024-09-15T22:47:42.496877+0000","last_became_peered":"2024-09-15T22:47:42.496877+0000","last_unstale":"2024-09-15T22:47:44.506289+0000","last_undegraded":"2024-09-15T22:47:44.506289+0000","last_fullsized":"2024-09-15T22:47:44.506289+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:06.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506278+0000","last_change":"2024-09-15T22:47:43.533091+0000","last_active":"2024-09-15T22:47:44.506278+0000","last_peered":"2024-09-15T22:47:44.506278+0000","last_clean":"2024-09-15T22:47:44.506278+0000","last_became_active":"2024-09-15T22:47:43.532802+0000","last_became_peered":"2024-09-15T22:47:43.532802+0000","last_unstale":"2024-09-15T22:47:44.506278+0000","last_undegraded":"2024-09-15T22:47:44.506278+0000","last_fullsized":"2024-09-15T22:47:44.506278+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635323+0000","last_change":"2024-09-15T22:47:42.501765+0000","last_active":"2024-09-15T22:47:44.635323+0000","last_peered":"2024-09-15T22:47:44.635323+0000","last_clean":"2024-09-15T22:47:44.635323+0000","last_became_active":"2024-09-15T22:47:42.501441+0000","last_became_peered":"2024-09-15T22:47:42.501441+0000","last_unstale":"2024-09-15T22:47:44.635323+0000","last_undegraded":"2024-09-15T22:47:44.635323+0000","last_fullsized":"2024-09-15T22:47:44.635323+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:33.261998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635369+0000","last_change":"2024-09-15T22:47:43.518805+0000","last_active":"2024-09-15T22:47:44.635369+0000","last_peered":"2024-09-15T22:47:44.635369+0000","last_clean":"2024-09-15T22:47:44.635369+0000","last_became_active":"2024-09-15T22:47:43.518540+0000","last_became_peered":"2024-09-15T22:47:43.518540+0000","last_unstale":"2024-09-15T22:47:44.635369+0000","last_undegraded":"2024-09-15T22:47:44.635369+0000","last_fullsized":"2024-09-15T22:47:44.635369+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:26.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635114+0000","last_change":"2024-09-15T22:47:42.493765+0000","last_active":"2024-09-15T22:47:44.635114+0000","last_peered":"2024-09-15T22:47:44.635114+0000","last_clean":"2024-09-15T22:47:44.635114+0000","last_became_active":"2024-09-15T22:47:42.492657+0000","last_became_peered":"2024-09-15T22:47:42.492657+0000","last_unstale":"2024-09-15T22:47:44.635114+0000","last_undegraded":"2024-09-15T22:47:44.635114+0000","last_fullsized":"2024-09-15T22:47:44.635114+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:17.233339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635107+0000","last_change":"2024-09-15T22:47:43.524651+0000","last_active":"2024-09-15T22:47:44.635107+0000","last_peered":"2024-09-15T22:47:44.635107+0000","last_clean":"2024-09-15T22:47:44.635107+0000","last_became_active":"2024-09-15T22:47:43.524316+0000","last_became_peered":"2024-09-15T22:47:43.524316+0000","last_unstale":"2024-09-15T22:47:44.635107+0000","last_undegraded":"2024-09-15T22:47:44.635107+0000","last_fullsized":"2024-09-15T22:47:44.635107+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.949658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636043+0000","last_change":"2024-09-15T22:47:42.500463+0000","last_active":"2024-09-15T22:47:44.636043+0000","last_peered":"2024-09-15T22:47:44.636043+0000","last_clean":"2024-09-15T22:47:44.636043+0000","last_became_active":"2024-09-15T22:47:42.500190+0000","last_became_peered":"2024-09-15T22:47:42.500190+0000","last_unstale":"2024-09-15T22:47:44.636043+0000","last_undegraded":"2024-09-15T22:47:44.636043+0000","last_fullsized":"2024-09-15T22:47:44.636043+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:25.271042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509764+0000","last_change":"2024-09-15T22:47:43.526299+0000","last_active":"2024-09-15T22:47:44.509764+0000","last_peered":"2024-09-15T22:47:44.509764+0000","last_clean":"2024-09-15T22:47:44.509764+0000","last_became_active":"2024-09-15T22:47:43.526011+0000","last_became_peered":"2024-09-15T22:47:43.526011+0000","last_unstale":"2024-09-15T22:47:44.509764+0000","last_undegraded":"2024-09-15T22:47:44.509764+0000","last_fullsized":"2024-09-15T22:47:44.509764+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:25.683316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505918+0000","last_change":"2024-09-15T22:47:42.505044+0000","last_active":"2024-09-15T22:47:44.505918+0000","last_peered":"2024-09-15T22:47:44.505918+0000","last_clean":"2024-09-15T22:47:44.505918+0000","last_became_active":"2024-09-15T22:47:42.504780+0000","last_became_peered":"2024-09-15T22:47:42.504780+0000","last_unstale":"2024-09-15T22:47:44.505918+0000","last_undegraded":"2024-09-15T22:47:44.505918+0000","last_fullsized":"2024-09-15T22:47:44.505918+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:27.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635372+0000","last_change":"2024-09-15T22:47:43.524430+0000","last_active":"2024-09-15T22:47:44.635372+0000","last_peered":"2024-09-15T22:47:44.635372+0000","last_clean":"2024-09-15T22:47:44.635372+0000","last_became_active":"2024-09-15T22:47:43.524134+0000","last_became_peered":"2024-09-15T22:47:43.524134+0000","last_unstale":"2024-09-15T22:47:44.635372+0000","last_undegraded":"2024-09-15T22:47:44.635372+0000","last_fullsized":"2024-09-15T22:47:44.635372+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:58.511518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509671+0000","last_change":"2024-09-15T22:47:42.507892+0000","last_active":"2024-09-15T22:47:44.509671+0000","last_peered":"2024-09-15T22:47:44.509671+0000","last_clean":"2024-09-15T22:47:44.509671+0000","last_became_active":"2024-09-15T22:47:42.507494+0000","last_became_peered":"2024-09-15T22:47:42.507494+0000","last_unstale":"2024-09-15T22:47:44.509671+0000","last_undegraded":"2024-09-15T22:47:44.509671+0000","last_fullsized":"2024-09-15T22:47:44.509671+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.126615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635097+0000","last_change":"2024-09-15T22:47:43.527627+0000","last_active":"2024-09-15T22:47:44.635097+0000","last_peered":"2024-09-15T22:47:44.635097+0000","last_clean":"2024-09-15T22:47:44.635097+0000","last_became_active":"2024-09-15T22:47:43.527083+0000","last_became_peered":"2024-09-15T22:47:43.527083+0000","last_unstale":"2024-09-15T22:47:44.635097+0000","last_undegraded":"2024-09-15T22:47:44.635097+0000","last_fullsized":"2024-09-15T22:47:44.635097+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505826+0000","last_change":"2024-09-15T22:47:42.497706+0000","last_active":"2024-09-15T22:47:44.505826+0000","last_peered":"2024-09-15T22:47:44.505826+0000","last_clean":"2024-09-15T22:47:44.505826+0000","last_became_active":"2024-09-15T22:47:42.497421+0000","last_became_peered":"2024-09-15T22:47:42.497421+0000","last_unstale":"2024-09-15T22:47:44.505826+0000","last_undegraded":"2024-09-15T22:47:44.505826+0000","last_fullsized":"2024-09-15T22:47:44.505826+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:02.732447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509393+0000","last_change":"2024-09-15T22:47:43.528388+0000","last_active":"2024-09-15T22:47:44.509393+0000","last_peered":"2024-09-15T22:47:44.509393+0000","last_clean":"2024-09-15T22:47:44.509393+0000","last_became_active":"2024-09-15T22:47:43.527768+0000","last_became_peered":"2024-09-15T22:47:43.527768+0000","last_unstale":"2024-09-15T22:47:44.509393+0000","last_undegraded":"2024-09-15T22:47:44.509393+0000","last_fullsized":"2024-09-15T22:47:44.509393+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:37.459832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634965+0000","last_change":"2024-09-15T22:47:42.493097+0000","last_active":"2024-09-15T22:47:44.634965+0000","last_peered":"2024-09-15T22:47:44.634965+0000","last_clean":"2024-09-15T22:47:44.634965+0000","last_became_active":"2024-09-15T22:47:42.492788+0000","last_became_peered":"2024-09-15T22:47:42.492788+0000","last_unstale":"2024-09-15T22:47:44.634965+0000","last_undegraded":"2024-09-15T22:47:44.634965+0000","last_fullsized":"2024-09-15T22:47:44.634965+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:01:55.535764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509051+0000","last_change":"2024-09-15T22:47:43.516543+0000","last_active":"2024-09-15T22:47:44.509051+0000","last_peered":"2024-09-15T22:47:44.509051+0000","last_clean":"2024-09-15T22:47:44.509051+0000","last_became_active":"2024-09-15T22:47:43.516288+0000","last_became_peered":"2024-09-15T22:47:43.516288+0000","last_unstale":"2024-09-15T22:47:44.509051+0000","last_undegraded":"2024-09-15T22:47:44.509051+0000","last_fullsized":"2024-09-15T22:47:44.509051+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:05.834094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635359+0000","last_change":"2024-09-15T22:47:42.502429+0000","last_active":"2024-09-15T22:47:44.635359+0000","last_peered":"2024-09-15T22:47:44.635359+0000","last_clean":"2024-09-15T22:47:44.635359+0000","last_became_active":"2024-09-15T22:47:42.502065+0000","last_became_peered":"2024-09-15T22:47:42.502065+0000","last_unstale":"2024-09-15T22:47:44.635359+0000","last_undegraded":"2024-09-15T22:47:44.635359+0000","last_fullsized":"2024-09-15T22:47:44.635359+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509347+0000","last_change":"2024-09-15T22:47:43.517205+0000","last_active":"2024-09-15T22:47:44.509347+0000","last_peered":"2024-09-15T22:47:44.509347+0000","last_clean":"2024-09-15T22:47:44.509347+0000","last_became_active":"2024-09-15T22:47:43.516917+0000","last_became_peered":"2024-09-15T22:47:43.516917+0000","last_unstale":"2024-09-15T22:47:44.509347+0000","last_undegraded":"2024-09-15T22:47:44.509347+0000","last_fullsized":"2024-09-15T22:47:44.509347+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:43.040820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"145'3","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636071+0000","last_change":"2024-09-15T22:47:42.492536+0000","last_active":"2024-09-15T22:47:44.636071+0000","last_peered":"2024-09-15T22:47:44.636071+0000","last_clean":"2024-09-15T22:47:44.636071+0000","last_became_active":"2024-09-15T22:47:42.492258+0000","last_became_peered":"2024-09-15T22:47:42.492258+0000","last_unstale":"2024-09-15T22:47:44.636071+0000","last_undegraded":"2024-09-15T22:47:44.636071+0000","last_fullsized":"2024-09-15T22:47:44.636071+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:39.131597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506157+0000","last_change":"2024-09-15T22:47:43.518742+0000","last_active":"2024-09-15T22:47:44.506157+0000","last_peered":"2024-09-15T22:47:44.506157+0000","last_clean":"2024-09-15T22:47:44.506157+0000","last_became_active":"2024-09-15T22:47:43.518438+0000","last_became_peered":"2024-09-15T22:47:43.518438+0000","last_unstale":"2024-09-15T22:47:44.506157+0000","last_undegraded":"2024-09-15T22:47:44.506157+0000","last_fullsized":"2024-09-15T22:47:44.506157+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:29.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"145'6","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635805+0000","last_change":"2024-09-15T22:47:42.497870+0000","last_active":"2024-09-15T22:47:44.635805+0000","last_peered":"2024-09-15T22:47:44.635805+0000","last_clean":"2024-09-15T22:47:44.635805+0000","last_became_active":"2024-09-15T22:47:42.497517+0000","last_became_peered":"2024-09-15T22:47:42.497517+0000","last_unstale":"2024-09-15T22:47:44.635805+0000","last_undegraded":"2024-09-15T22:47:44.635805+0000","last_fullsized":"2024-09-15T22:47:44.635805+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508761+0000","last_change":"2024-09-15T22:47:43.522920+0000","last_active":"2024-09-15T22:47:44.508761+0000","last_peered":"2024-09-15T22:47:44.508761+0000","last_clean":"2024-09-15T22:47:44.508761+0000","last_became_active":"2024-09-15T22:47:43.522601+0000","last_became_peered":"2024-09-15T22:47:43.522601+0000","last_unstale":"2024-09-15T22:47:44.508761+0000","last_undegraded":"2024-09-15T22:47:44.508761+0000","last_fullsized":"2024-09-15T22:47:44.508761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.987708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509710+0000","last_change":"2024-09-15T22:47:42.501679+0000","last_active":"2024-09-15T22:47:44.509710+0000","last_peered":"2024-09-15T22:47:44.509710+0000","last_clean":"2024-09-15T22:47:44.509710+0000","last_became_active":"2024-09-15T22:47:42.501404+0000","last_became_peered":"2024-09-15T22:47:42.501404+0000","last_unstale":"2024-09-15T22:47:44.509710+0000","last_undegraded":"2024-09-15T22:47:44.509710+0000","last_fullsized":"2024-09-15T22:47:44.509710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:38.846276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635774+0000","last_change":"2024-09-15T22:47:43.523716+0000","last_active":"2024-09-15T22:47:44.635774+0000","last_peered":"2024-09-15T22:47:44.635774+0000","last_clean":"2024-09-15T22:47:44.635774+0000","last_became_active":"2024-09-15T22:47:43.523300+0000","last_became_peered":"2024-09-15T22:47:43.523300+0000","last_unstale":"2024-09-15T22:47:44.635774+0000","last_undegraded":"2024-09-15T22:47:44.635774+0000","last_fullsized":"2024-09-15T22:47:44.635774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:14.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635444+0000","last_change":"2024-09-15T22:47:42.494248+0000","last_active":"2024-09-15T22:47:44.635444+0000","last_peered":"2024-09-15T22:47:44.635444+0000","last_clean":"2024-09-15T22:47:44.635444+0000","last_became_active":"2024-09-15T22:47:42.493969+0000","last_became_peered":"2024-09-15T22:47:42.493969+0000","last_unstale":"2024-09-15T22:47:44.635444+0000","last_undegraded":"2024-09-15T22:47:44.635444+0000","last_fullsized":"2024-09-15T22:47:44.635444+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:23.893832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635730+0000","last_change":"2024-09-15T22:47:43.520031+0000","last_active":"2024-09-15T22:47:44.635730+0000","last_peered":"2024-09-15T22:47:44.635730+0000","last_clean":"2024-09-15T22:47:44.635730+0000","last_became_active":"2024-09-15T22:47:43.519766+0000","last_became_peered":"2024-09-15T22:47:43.519766+0000","last_unstale":"2024-09-15T22:47:44.635730+0000","last_undegraded":"2024-09-15T22:47:44.635730+0000","last_fullsized":"2024-09-15T22:47:44.635730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:49.465229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509230+0000","last_change":"2024-09-15T22:47:42.496158+0000","last_active":"2024-09-15T22:47:44.509230+0000","last_peered":"2024-09-15T22:47:44.509230+0000","last_clean":"2024-09-15T22:47:44.509230+0000","last_became_active":"2024-09-15T22:47:42.495684+0000","last_became_peered":"2024-09-15T22:47:42.495684+0000","last_unstale":"2024-09-15T22:47:44.509230+0000","last_undegraded":"2024-09-15T22:47:44.509230+0000","last_fullsized":"2024-09-15T22:47:44.509230+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:51.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635399+0000","last_change":"2024-09-15T22:47:43.518355+0000","last_active":"2024-09-15T22:47:44.635399+0000","last_peered":"2024-09-15T22:47:44.635399+0000","last_clean":"2024-09-15T22:47:44.635399+0000","last_became_active":"2024-09-15T22:47:43.518071+0000","last_became_peered":"2024-09-15T22:47:43.518071+0000","last_unstale":"2024-09-15T22:47:44.635399+0000","last_undegraded":"2024-09-15T22:47:44.635399+0000","last_fullsized":"2024-09-15T22:47:44.635399+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:41.796107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"145'8","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634826+0000","last_change":"2024-09-15T22:47:42.496081+0000","last_active":"2024-09-15T22:47:44.634826+0000","last_peered":"2024-09-15T22:47:44.634826+0000","last_clean":"2024-09-15T22:47:44.634826+0000","last_became_active":"2024-09-15T22:47:42.495781+0000","last_became_peered":"2024-09-15T22:47:42.495781+0000","last_unstale":"2024-09-15T22:47:44.634826+0000","last_undegraded":"2024-09-15T22:47:44.634826+0000","last_fullsized":"2024-09-15T22:47:44.634826+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:01.935252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509390+0000","last_change":"2024-09-15T22:47:43.528772+0000","last_active":"2024-09-15T22:47:44.509390+0000","last_peered":"2024-09-15T22:47:44.509390+0000","last_clean":"2024-09-15T22:47:44.509390+0000","last_became_active":"2024-09-15T22:47:43.528499+0000","last_became_peered":"2024-09-15T22:47:43.528499+0000","last_unstale":"2024-09-15T22:47:44.509390+0000","last_undegraded":"2024-09-15T22:47:44.509390+0000","last_fullsized":"2024-09-15T22:47:44.509390+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:43.295304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635997+0000","last_change":"2024-09-15T22:47:42.496730+0000","last_active":"2024-09-15T22:47:44.635997+0000","last_peered":"2024-09-15T22:47:44.635997+0000","last_clean":"2024-09-15T22:47:44.635997+0000","last_became_active":"2024-09-15T22:47:42.496456+0000","last_became_peered":"2024-09-15T22:47:42.496456+0000","last_unstale":"2024-09-15T22:47:44.635997+0000","last_undegraded":"2024-09-15T22:47:44.635997+0000","last_fullsized":"2024-09-15T22:47:44.635997+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:23.893832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510123+0000","last_change":"2024-09-15T22:47:43.516452+0000","last_active":"2024-09-15T22:47:44.510123+0000","last_peered":"2024-09-15T22:47:44.510123+0000","last_clean":"2024-09-15T22:47:44.510123+0000","last_became_active":"2024-09-15T22:47:43.516134+0000","last_became_peered":"2024-09-15T22:47:43.516134+0000","last_unstale":"2024-09-15T22:47:44.510123+0000","last_undegraded":"2024-09-15T22:47:44.510123+0000","last_fullsized":"2024-09-15T22:47:44.510123+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.724622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635429+0000","last_change":"2024-09-15T22:47:42.500652+0000","last_active":"2024-09-15T22:47:44.635429+0000","last_peered":"2024-09-15T22:47:44.635429+0000","last_clean":"2024-09-15T22:47:44.635429+0000","last_became_active":"2024-09-15T22:47:42.500379+0000","last_became_peered":"2024-09-15T22:47:42.500379+0000","last_unstale":"2024-09-15T22:47:44.635429+0000","last_undegraded":"2024-09-15T22:47:44.635429+0000","last_fullsized":"2024-09-15T22:47:44.635429+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:14.421670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510181+0000","last_change":"2024-09-15T22:47:43.527271+0000","last_active":"2024-09-15T22:47:44.510181+0000","last_peered":"2024-09-15T22:47:44.510181+0000","last_clean":"2024-09-15T22:47:44.510181+0000","last_became_active":"2024-09-15T22:47:43.526829+0000","last_became_peered":"2024-09-15T22:47:43.526829+0000","last_unstale":"2024-09-15T22:47:44.510181+0000","last_undegraded":"2024-09-15T22:47:44.510181+0000","last_fullsized":"2024-09-15T22:47:44.510181+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:37.402634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636055+0000","last_change":"2024-09-15T22:47:42.497476+0000","last_active":"2024-09-15T22:47:44.636055+0000","last_peered":"2024-09-15T22:47:44.636055+0000","last_clean":"2024-09-15T22:47:44.636055+0000","last_became_active":"2024-09-15T22:47:42.496984+0000","last_became_peered":"2024-09-15T22:47:42.496984+0000","last_unstale":"2024-09-15T22:47:44.636055+0000","last_undegraded":"2024-09-15T22:47:44.636055+0000","last_fullsized":"2024-09-15T22:47:44.636055+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:31.686549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636053+0000","last_change":"2024-09-15T22:47:43.523539+0000","last_active":"2024-09-15T22:47:44.636053+0000","last_peered":"2024-09-15T22:47:44.636053+0000","last_clean":"2024-09-15T22:47:44.636053+0000","last_became_active":"2024-09-15T22:47:43.523238+0000","last_became_peered":"2024-09-15T22:47:43.523238+0000","last_unstale":"2024-09-15T22:47:44.636053+0000","last_undegraded":"2024-09-15T22:47:44.636053+0000","last_fullsized":"2024-09-15T22:47:44.636053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:34.133363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520190+0000","last_change":"2024-09-15T22:47:42.501160+0000","last_active":"2024-09-15T22:47:44.520190+0000","last_peered":"2024-09-15T22:47:44.520190+0000","last_clean":"2024-09-15T22:47:44.520190+0000","last_became_active":"2024-09-15T22:47:42.500526+0000","last_became_peered":"2024-09-15T22:47:42.500526+0000","last_unstale":"2024-09-15T22:47:44.520190+0000","last_undegraded":"2024-09-15T22:47:44.520190+0000","last_fullsized":"2024-09-15T22:47:44.520190+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:31.598640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505860+0000","last_change":"2024-09-15T22:47:43.529502+0000","last_active":"2024-09-15T22:47:44.505860+0000","last_peered":"2024-09-15T22:47:44.505860+0000","last_clean":"2024-09-15T22:47:44.505860+0000","last_became_active":"2024-09-15T22:47:43.529054+0000","last_became_peered":"2024-09-15T22:47:43.529054+0000","last_unstale":"2024-09-15T22:47:44.505860+0000","last_undegraded":"2024-09-15T22:47:44.505860+0000","last_fullsized":"2024-09-15T22:47:44.505860+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:22.570248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635765+0000","last_change":"2024-09-15T22:47:42.496386+0000","last_active":"2024-09-15T22:47:44.635765+0000","last_peered":"2024-09-15T22:47:44.635765+0000","last_clean":"2024-09-15T22:47:44.635765+0000","last_became_active":"2024-09-15T22:47:42.496104+0000","last_became_peered":"2024-09-15T22:47:42.496104+0000","last_unstale":"2024-09-15T22:47:44.635765+0000","last_undegraded":"2024-09-15T22:47:44.635765+0000","last_fullsized":"2024-09-15T22:47:44.635765+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:05.941751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635705+0000","last_change":"2024-09-15T22:47:43.523571+0000","last_active":"2024-09-15T22:47:44.635705+0000","last_peered":"2024-09-15T22:47:44.635705+0000","last_clean":"2024-09-15T22:47:44.635705+0000","last_became_active":"2024-09-15T22:47:43.522998+0000","last_became_peered":"2024-09-15T22:47:43.522998+0000","last_unstale":"2024-09-15T22:47:44.635705+0000","last_undegraded":"2024-09-15T22:47:44.635705+0000","last_fullsized":"2024-09-15T22:47:44.635705+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:18.594588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.519917+0000","last_change":"2024-09-15T22:47:42.496892+0000","last_active":"2024-09-15T22:47:44.519917+0000","last_peered":"2024-09-15T22:47:44.519917+0000","last_clean":"2024-09-15T22:47:44.519917+0000","last_became_active":"2024-09-15T22:47:42.496457+0000","last_became_peered":"2024-09-15T22:47:42.496457+0000","last_unstale":"2024-09-15T22:47:44.519917+0000","last_undegraded":"2024-09-15T22:47:44.519917+0000","last_fullsized":"2024-09-15T22:47:44.519917+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:24.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505770+0000","last_change":"2024-09-15T22:47:43.523643+0000","last_active":"2024-09-15T22:47:44.505770+0000","last_peered":"2024-09-15T22:47:44.505770+0000","last_clean":"2024-09-15T22:47:44.505770+0000","last_became_active":"2024-09-15T22:47:43.523319+0000","last_became_peered":"2024-09-15T22:47:43.523319+0000","last_unstale":"2024-09-15T22:47:44.505770+0000","last_undegraded":"2024-09-15T22:47:44.505770+0000","last_fullsized":"2024-09-15T22:47:44.505770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:49.918899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509480+0000","last_change":"2024-09-15T22:47:42.507819+0000","last_active":"2024-09-15T22:47:44.509480+0000","last_peered":"2024-09-15T22:47:44.509480+0000","last_clean":"2024-09-15T22:47:44.509480+0000","last_became_active":"2024-09-15T22:47:42.507434+0000","last_became_peered":"2024-09-15T22:47:42.507434+0000","last_unstale":"2024-09-15T22:47:44.509480+0000","last_undegraded":"2024-09-15T22:47:44.509480+0000","last_fullsized":"2024-09-15T22:47:44.509480+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:13.846711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509175+0000","last_change":"2024-09-15T22:47:43.511408+0000","last_active":"2024-09-15T22:47:44.509175+0000","last_peered":"2024-09-15T22:47:44.509175+0000","last_clean":"2024-09-15T22:47:44.509175+0000","last_became_active":"2024-09-15T22:47:43.511136+0000","last_became_peered":"2024-09-15T22:47:43.511136+0000","last_unstale":"2024-09-15T22:47:44.509175+0000","last_undegraded":"2024-09-15T22:47:44.509175+0000","last_fullsized":"2024-09-15T22:47:44.509175+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:09.563984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.519941+0000","last_change":"2024-09-15T22:47:42.501259+0000","last_active":"2024-09-15T22:47:44.519941+0000","last_peered":"2024-09-15T22:47:44.519941+0000","last_clean":"2024-09-15T22:47:44.519941+0000","last_became_active":"2024-09-15T22:47:42.500881+0000","last_became_peered":"2024-09-15T22:47:42.500881+0000","last_unstale":"2024-09-15T22:47:44.519941+0000","last_undegraded":"2024-09-15T22:47:44.519941+0000","last_fullsized":"2024-09-15T22:47:44.519941+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:36.395886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636069+0000","last_change":"2024-09-15T22:47:43.528192+0000","last_active":"2024-09-15T22:47:44.636069+0000","last_peered":"2024-09-15T22:47:44.636069+0000","last_clean":"2024-09-15T22:47:44.636069+0000","last_became_active":"2024-09-15T22:47:43.527827+0000","last_became_peered":"2024-09-15T22:47:43.527827+0000","last_unstale":"2024-09-15T22:47:44.636069+0000","last_undegraded":"2024-09-15T22:47:44.636069+0000","last_fullsized":"2024-09-15T22:47:44.636069+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:57.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635649+0000","last_change":"2024-09-15T22:47:42.500418+0000","last_active":"2024-09-15T22:47:44.635649+0000","last_peered":"2024-09-15T22:47:44.635649+0000","last_clean":"2024-09-15T22:47:44.635649+0000","last_became_active":"2024-09-15T22:47:42.500136+0000","last_became_peered":"2024-09-15T22:47:42.500136+0000","last_unstale":"2024-09-15T22:47:44.635649+0000","last_undegraded":"2024-09-15T22:47:44.635649+0000","last_fullsized":"2024-09-15T22:47:44.635649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:31.686549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510248+0000","last_change":"2024-09-15T22:47:43.522006+0000","last_active":"2024-09-15T22:47:44.510248+0000","last_peered":"2024-09-15T22:47:44.510248+0000","last_clean":"2024-09-15T22:47:44.510248+0000","last_became_active":"2024-09-15T22:47:43.521626+0000","last_became_peered":"2024-09-15T22:47:43.521626+0000","last_unstale":"2024-09-15T22:47:44.510248+0000","last_undegraded":"2024-09-15T22:47:44.510248+0000","last_fullsized":"2024-09-15T22:47:44.510248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:25.814111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"146'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.520192+0000","last_change":"2024-09-15T22:47:42.507766+0000","last_active":"2024-09-15T22:47:44.520192+0000","last_peered":"2024-09-15T22:47:44.520192+0000","last_clean":"2024-09-15T22:47:44.520192+0000","last_became_active":"2024-09-15T22:47:42.507427+0000","last_became_peered":"2024-09-15T22:47:42.507427+0000","last_unstale":"2024-09-15T22:47:44.520192+0000","last_undegraded":"2024-09-15T22:47:44.520192+0000","last_fullsized":"2024-09-15T22:47:44.520192+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:57.427956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.510199+0000","last_change":"2024-09-15T22:47:43.510997+0000","last_active":"2024-09-15T22:47:44.510199+0000","last_peered":"2024-09-15T22:47:44.510199+0000","last_clean":"2024-09-15T22:47:44.510199+0000","last_became_active":"2024-09-15T22:47:43.510647+0000","last_became_peered":"2024-09-15T22:47:43.510647+0000","last_unstale":"2024-09-15T22:47:44.510199+0000","last_undegraded":"2024-09-15T22:47:44.510199+0000","last_fullsized":"2024-09-15T22:47:44.510199+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:58.434704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.506209+0000","last_change":"2024-09-15T22:47:42.503704+0000","last_active":"2024-09-15T22:47:44.506209+0000","last_peered":"2024-09-15T22:47:44.506209+0000","last_clean":"2024-09-15T22:47:44.506209+0000","last_became_active":"2024-09-15T22:47:42.503423+0000","last_became_peered":"2024-09-15T22:47:42.503423+0000","last_unstale":"2024-09-15T22:47:44.506209+0000","last_undegraded":"2024-09-15T22:47:44.506209+0000","last_fullsized":"2024-09-15T22:47:44.506209+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:48.336453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509865+0000","last_change":"2024-09-15T22:47:43.514676+0000","last_active":"2024-09-15T22:47:44.509865+0000","last_peered":"2024-09-15T22:47:44.509865+0000","last_clean":"2024-09-15T22:47:44.509865+0000","last_became_active":"2024-09-15T22:47:43.514381+0000","last_became_peered":"2024-09-15T22:47:43.514381+0000","last_unstale":"2024-09-15T22:47:44.509865+0000","last_undegraded":"2024-09-15T22:47:44.509865+0000","last_fullsized":"2024-09-15T22:47:44.509865+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:21.256882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.636049+0000","last_change":"2024-09-15T22:47:42.500709+0000","last_active":"2024-09-15T22:47:44.636049+0000","last_peered":"2024-09-15T22:47:44.636049+0000","last_clean":"2024-09-15T22:47:44.636049+0000","last_became_active":"2024-09-15T22:47:42.499288+0000","last_became_peered":"2024-09-15T22:47:42.499288+0000","last_unstale":"2024-09-15T22:47:44.636049+0000","last_undegraded":"2024-09-15T22:47:44.636049+0000","last_fullsized":"2024-09-15T22:47:44.636049+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:48.912151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635428+0000","last_change":"2024-09-15T22:47:43.529938+0000","last_active":"2024-09-15T22:47:44.635428+0000","last_peered":"2024-09-15T22:47:44.635428+0000","last_clean":"2024-09-15T22:47:44.635428+0000","last_became_active":"2024-09-15T22:47:43.529655+0000","last_became_peered":"2024-09-15T22:47:43.529655+0000","last_unstale":"2024-09-15T22:47:44.635428+0000","last_undegraded":"2024-09-15T22:47:44.635428+0000","last_fullsized":"2024-09-15T22:47:44.635428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:58.102508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635649+0000","last_change":"2024-09-15T22:47:42.501069+0000","last_active":"2024-09-15T22:47:44.635649+0000","last_peered":"2024-09-15T22:47:44.635649+0000","last_clean":"2024-09-15T22:47:44.635649+0000","last_became_active":"2024-09-15T22:47:42.500784+0000","last_became_peered":"2024-09-15T22:47:42.500784+0000","last_unstale":"2024-09-15T22:47:44.635649+0000","last_undegraded":"2024-09-15T22:47:44.635649+0000","last_fullsized":"2024-09-15T22:47:44.635649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:45.051317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505837+0000","last_change":"2024-09-15T22:47:43.518854+0000","last_active":"2024-09-15T22:47:44.505837+0000","last_peered":"2024-09-15T22:47:44.505837+0000","last_clean":"2024-09-15T22:47:44.505837+0000","last_became_active":"2024-09-15T22:47:43.518575+0000","last_became_peered":"2024-09-15T22:47:43.518575+0000","last_unstale":"2024-09-15T22:47:44.505837+0000","last_undegraded":"2024-09-15T22:47:44.505837+0000","last_fullsized":"2024-09-15T22:47:44.505837+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.949658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508803+0000","last_change":"2024-09-15T22:47:42.496415+0000","last_active":"2024-09-15T22:47:44.508803+0000","last_peered":"2024-09-15T22:47:44.508803+0000","last_clean":"2024-09-15T22:47:44.508803+0000","last_became_active":"2024-09-15T22:47:42.496137+0000","last_became_peered":"2024-09-15T22:47:42.496137+0000","last_unstale":"2024-09-15T22:47:44.508803+0000","last_undegraded":"2024-09-15T22:47:44.508803+0000","last_fullsized":"2024-09-15T22:47:44.508803+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:02.859152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.508886+0000","last_change":"2024-09-15T22:47:43.520223+0000","last_active":"2024-09-15T22:47:44.508886+0000","last_peered":"2024-09-15T22:47:44.508886+0000","last_clean":"2024-09-15T22:47:44.508886+0000","last_became_active":"2024-09-15T22:47:43.519900+0000","last_became_peered":"2024-09-15T22:47:43.519900+0000","last_unstale":"2024-09-15T22:47:44.508886+0000","last_undegraded":"2024-09-15T22:47:44.508886+0000","last_fullsized":"2024-09-15T22:47:44.508886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:51.073480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505838+0000","last_change":"2024-09-15T22:47:42.503002+0000","last_active":"2024-09-15T22:47:44.505838+0000","last_peered":"2024-09-15T22:47:44.505838+0000","last_clean":"2024-09-15T22:47:44.505838+0000","last_became_active":"2024-09-15T22:47:42.502676+0000","last_became_peered":"2024-09-15T22:47:42.502676+0000","last_unstale":"2024-09-15T22:47:44.505838+0000","last_undegraded":"2024-09-15T22:47:44.505838+0000","last_fullsized":"2024-09-15T22:47:44.505838+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:23.905753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505779+0000","last_change":"2024-09-15T22:47:43.517449+0000","last_active":"2024-09-15T22:47:44.505779+0000","last_peered":"2024-09-15T22:47:44.505779+0000","last_clean":"2024-09-15T22:47:44.505779+0000","last_became_active":"2024-09-15T22:47:43.517161+0000","last_became_peered":"2024-09-15T22:47:43.517161+0000","last_unstale":"2024-09-15T22:47:44.505779+0000","last_undegraded":"2024-09-15T22:47:44.505779+0000","last_fullsized":"2024-09-15T22:47:44.505779+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:06.948499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.505646+0000","last_change":"2024-09-15T22:47:42.498810+0000","last_active":"2024-09-15T22:47:44.505646+0000","last_peered":"2024-09-15T22:47:44.505646+0000","last_clean":"2024-09-15T22:47:44.505646+0000","last_became_active":"2024-09-15T22:47:42.498542+0000","last_became_peered":"2024-09-15T22:47:42.498542+0000","last_unstale":"2024-09-15T22:47:44.505646+0000","last_undegraded":"2024-09-15T22:47:44.505646+0000","last_fullsized":"2024-09-15T22:47:44.505646+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:12.687746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.509430+0000","last_change":"2024-09-15T22:47:43.515905+0000","last_active":"2024-09-15T22:47:44.509430+0000","last_peered":"2024-09-15T22:47:44.509430+0000","last_clean":"2024-09-15T22:47:44.509430+0000","last_became_active":"2024-09-15T22:47:43.515538+0000","last_became_peered":"2024-09-15T22:47:43.515538+0000","last_unstale":"2024-09-15T22:47:44.509430+0000","last_undegraded":"2024-09-15T22:47:44.509430+0000","last_fullsized":"2024-09-15T22:47:44.509430+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:42.480759+0000","last_clean_scrub_stamp":"2024-09-15T22:47:42.480759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:51.066048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.635907+0000","last_change":"2024-09-15T22:47:42.497314+0000","last_active":"2024-09-15T22:47:44.635907+0000","last_peered":"2024-09-15T22:47:44.635907+0000","last_clean":"2024-09-15T22:47:44.635907+0000","last_became_active":"2024-09-15T22:47:42.497036+0000","last_became_peered":"2024-09-15T22:47:42.497036+0000","last_unstale":"2024-09-15T22:47:44.635907+0000","last_undegraded":"2024-09-15T22:47:44.635907+0000","last_fullsized":"2024-09-15T22:47:44.635907+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:47:41.474011+0000","last_clean_scrub_stamp":"2024-09-15T22:47:41.474011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:17.233339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":439,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-15T22:47:44.634910+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:47:44.634910+0000","last_peered":"2024-09-15T22:47:44.634910+0000","last_clean":"2024-09-15T22:47:44.634910+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:47:44.634910+0000","last_undegraded":"2024-09-15T22:47:44.634910+0000","last_fullsized":"2024-09-15T22:47:44.634910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":804816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":804850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33564,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338276,"statfs":{"total":96636764160,"available":96602394624,"internally_reserved":0,"allocated":2428928,"data_stored":1395856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1830912,"data_stored":804850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32996,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338844,"statfs":{"total":96636764160,"available":96602976256,"internally_reserved":0,"allocated":1843200,"data_stored":806450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1830912,"data_stored":805398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33580,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338260,"statfs":{"total":96636764160,"available":96602378240,"internally_reserved":0,"allocated":2445312,"data_stored":1396978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1830912,"data_stored":804886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:47:51.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:47:51.145 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:47:51.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.285+0000 7fe5ba4d2640 1 Processor -- start 2024-09-15T22:47:51.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.285+0000 7fe5ba4d2640 1 -- start start 2024-09-15T22:47:51.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5ba4d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 0x7fe5b40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5ba4d2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5b40b3b40 0x7fe5b40d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5ba4d2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b40b6b30 con 0x7fe5b40b6710 2024-09-15T22:47:51.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5ba4d2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe5b415eb50 con 0x7fe5b40b3b40 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5ba4d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b40d2320 con 0x7fe5b415e770 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5b8a6f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5b40b3b40 0x7fe5b40d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.286+0000 7fe5b37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe5b40b6710 0x7fe5b40b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55132/0 (socket says 172.21.15.134:55132) 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b37fe640 1 -- 172.21.15.134:0/292860110 learned_addr learned my addr 172.21.15.134:0/292860110 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b3fff640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 0x7fe5b40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b8a6f640 1 -- 172.21.15.134:0/292860110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 msgr2=0x7fe5b40b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b8a6f640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 0x7fe5b40b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b8a6f640 1 -- 172.21.15.134:0/292860110 >> v1:172.21.15.134:6789/0 conn(0x7fe5b40b6710 legacy=0x7fe5b40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b2ffd640 1 -- 172.21.15.134:0/292860110 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908797727 0 0) 0x7fe5b40b6b30 con 0x7fe5b40b6710 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b8a6f640 1 -- 172.21.15.134:0/292860110 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b40d25e0 con 0x7fe5b40b3b40 2024-09-15T22:47:51.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b3fff640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 0x7fe5b40b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.287+0000 7fe5b8a6f640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b3b40 0x7fe5b40d33a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009d90 tx=0x7fe5ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea89e51e5c1e9908 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5b2ffd640 1 -- 172.21.15.134:0/292860110 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac031600 con 0x7fe5b40b3b40 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5b2ffd640 1 -- 172.21.15.134:0/292860110 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ac0317a0 con 0x7fe5b40b3b40 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5b2ffd640 1 -- 172.21.15.134:0/292860110 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac031b70 con 0x7fe5b40b3b40 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/292860110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b3b40 msgr2=0x7fe5b40d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b3b40 0x7fe5b40d33a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009d90 tx=0x7fe5ac02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/292860110 shutdown_connections 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b3b40 0x7fe5b40d33a0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/292860110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b415e770 0x7fe5b40b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/292860110 >> 172.21.15.134:0/292860110 conn(0x7fe5b4062a50 msgr2=0x7fe5b4062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/292860110 shutdown_connections 2024-09-15T22:47:51.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.288+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/292860110 wait complete. 2024-09-15T22:47:51.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.289+0000 7fe5ba4d2640 1 Processor -- start 2024-09-15T22:47:51.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 -- start start 2024-09-15T22:47:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b40b3b40 0x7fe5b4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 0x7fe5b4160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b40d2e80 con 0x7fe5b40b6710 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b40d2ba0 con 0x7fe5b415e770 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5ba4d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b40b76a0 con 0x7fe5b40b3b40 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.290+0000 7fe5b37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55142/0 (socket says 172.21.15.134:55142) 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 -- 172.21.15.134:0/469374760 learned_addr learned my addr 172.21.15.134:0/469374760 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b3fff640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b40b3b40 0x7fe5b4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b8a6f640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 0x7fe5b4160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 -- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b40b3b40 msgr2=0x7fe5b4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b40b3b40 0x7fe5b4158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 -- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 msgr2=0x7fe5b4160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 0x7fe5b4160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 -- 172.21.15.134:0/469374760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b415b7e0 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b8a6f640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 0x7fe5b4160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b37fe640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c4b0 tx=0x7fe5a800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8018070 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a8007500 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b40cd450 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004a20 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.291+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b40cda10 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.292+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b40b61d0 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.293+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fe5a801b070 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.293+0000 7fe5b0ff9640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 0x7fe5a006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.293+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fe5a808b240 con 0x7fe5b40b6710 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.293+0000 7fe5b3fff640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 0x7fe5a006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.294+0000 7fe5b3fff640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 0x7fe5a006eda0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400aac0 tx=0x7fe5a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.297+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5a8058b30 con 0x7fe5b40b6710 2024-09-15T22:47:51.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.527+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe5b40cdea0 con 0x7fe5b40b6710 2024-09-15T22:47:51.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.529+0000 7fe5b0ff9640 1 -- 172.21.15.134:0/469374760 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7fe5a805ce30 con 0x7fe5b40b6710 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:47:51.531 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:47:51.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 msgr2=0x7fe5a006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 0x7fe5a006eda0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400aac0 tx=0x7fe5a4008040 comp rx=0 tx=0).stop 2024-09-15T22:47:51.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 msgr2=0x7fe5b415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c4b0 tx=0x7fe5a800c970 comp rx=0 tx=0).stop 2024-09-15T22:47:51.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 shutdown_connections 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5b415e770 0x7fe5b4160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe5a006c8e0 0x7fe5a006eda0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5b40b6710 0x7fe5b415adf0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 --2- 172.21.15.134:0/469374760 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5b40b3b40 0x7fe5b4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 >> 172.21.15.134:0/469374760 conn(0x7fe5b4062a50 msgr2=0x7fe5b4062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 shutdown_connections 2024-09-15T22:47:51.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.532+0000 7fe5ba4d2640 1 -- 172.21.15.134:0/469374760 wait complete. 2024-09-15T22:47:51.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:47:51.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.641+0000 7f11c44a5640 1 Processor -- start 2024-09-15T22:47:51.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.641+0000 7f11c44a5640 1 -- start start 2024-09-15T22:47:51.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c44a5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11bc06be10 0x7f11bc0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c44a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c44a5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc0cd5f0 con 0x7f11bc151540 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c44a5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc0cd8d0 con 0x7f11bc06be10 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c44a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc0cdbb0 con 0x7f11bc06c1f0 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11bc06be10 0x7f11bc0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11bc06be10 0x7f11bc0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55156/0 (socket says 172.21.15.134:55156) 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2a42640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f11bc151540 0x7f11bc15e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55144/0 (socket says 172.21.15.134:55144) 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 -- 172.21.15.134:0/376662689 learned_addr learned my addr 172.21.15.134:0/376662689 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c1a40640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 -- 172.21.15.134:0/376662689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 msgr2=0x7f11bc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 -- 172.21.15.134:0/376662689 >> v1:172.21.15.134:6789/0 conn(0x7f11bc151540 legacy=0x7f11bc15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c2241640 1 -- 172.21.15.134:0/376662689 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc0cde90 con 0x7f11bc06be10 2024-09-15T22:47:51.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.642+0000 7f11c123f640 1 -- 172.21.15.134:0/376662689 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735293685 0 0) 0x7f11bc0cd5f0 con 0x7f11bc151540 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c2241640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc06be10 0x7f11bc0cd010 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f11b800bb00 tx=0x7f11b802c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29dc58cbdb5bab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c123f640 1 -- 172.21.15.134:0/376662689 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b803a070 con 0x7f11bc06be10 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c123f640 1 -- 172.21.15.134:0/376662689 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8032480 con 0x7f11bc06be10 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c123f640 1 -- 172.21.15.134:0/376662689 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8032850 con 0x7f11bc06be10 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 -- 172.21.15.134:0/376662689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc06be10 msgr2=0x7f11bc0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc06be10 0x7f11bc0cd010 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f11b800bb00 tx=0x7f11b802c6e0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 -- 172.21.15.134:0/376662689 shutdown_connections 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 --2- 172.21.15.134:0/376662689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc06be10 0x7f11bc0cd010 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.643+0000 7f11c44a5640 1 -- 172.21.15.134:0/376662689 >> 172.21.15.134:0/376662689 conn(0x7f11bc062cc0 msgr2=0x7f11bc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.644+0000 7f11c44a5640 1 -- 172.21.15.134:0/376662689 shutdown_connections 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.644+0000 7f11c44a5640 1 -- 172.21.15.134:0/376662689 wait complete. 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 Processor -- start 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 -- start start 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc06be10 0x7f11bc154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc1519b0 con 0x7f11bc151540 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0ce690 con 0x7f11bc06be10 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c44a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc151b30 con 0x7f11bc06c1f0 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.645+0000 7f11c2a42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55170/0 (socket says 172.21.15.134:55170) 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 -- 172.21.15.134:0/1985647953 learned_addr learned my addr 172.21.15.134:0/1985647953 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c1a40640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2241640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc06be10 0x7f11bc154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 -- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 msgr2=0x7f11bc15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 -- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc06be10 msgr2=0x7f11bc154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc06be10 0x7f11bc154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 -- 172.21.15.134:0/1985647953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc15c9c0 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c2a42640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c700 tx=0x7f11b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4018070 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b400ce10 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b400a860 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc154e50 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.646+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc1523f0 con 0x7f11bc151540 2024-09-15T22:47:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.647+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc0cd010 con 0x7f11bc151540 2024-09-15T22:47:51.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.648+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f11b401b070 con 0x7f11bc151540 2024-09-15T22:47:51.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.648+0000 7f11b2ffd640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 0x7f11a006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.648+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f11b408b570 con 0x7f11bc151540 2024-09-15T22:47:51.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.648+0000 7f11c2241640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 0x7f11a006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.649+0000 7f11c2241640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 0x7f11a006eda0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11b8037000 tx=0x7f11b8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.652+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b40593f0 con 0x7f11bc151540 2024-09-15T22:47:51.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.852+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11bc152890 con 0x7f11bc151540 2024-09-15T22:47:51.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.853+0000 7f11b2ffd640 1 -- 172.21.15.134:0/1985647953 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5236 (secure 0 0 0) 0x7f11b4058cf0 con 0x7f11bc151540 2024-09-15T22:47:51.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:51.854 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":75,"btime":"2024-09-15T22:47:45:520820+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:47:51.854 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 75 2024-09-15T22:47:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 msgr2=0x7f11a006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 0x7f11a006eda0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11b8037000 tx=0x7f11b8030000 comp rx=0 tx=0).stop 2024-09-15T22:47:51.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 msgr2=0x7f11bc1efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c700 tx=0x7f11b400cbc0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 shutdown_connections 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11a006c8e0 0x7f11a006eda0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc151540 0x7f11bc1efcc0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc06c1f0 0x7f11bc15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 --2- 172.21.15.134:0/1985647953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc06be10 0x7f11bc154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 >> 172.21.15.134:0/1985647953 conn(0x7f11bc062cc0 msgr2=0x7f11bc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 shutdown_connections 2024-09-15T22:47:51.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:51.855+0000 7f11c44a5640 1 -- 172.21.15.134:0/1985647953 wait complete. 2024-09-15T22:47:52.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:47:42.826823+0000', 'modified': '2024-09-15T22:47:44.843147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8250': {'gid': 8250, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/2960551881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6825', 'nonce': 2960551881}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 2960551881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8250, 'qdb_cluster': [8250]} 2024-09-15T22:47:52.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:47:52.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:47:52.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.371+0000 7f53d37e8640 1 Processor -- start 2024-09-15T22:47:52.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.371+0000 7f53d37e8640 1 -- start start 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d37e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53cc0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d37e8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53cc06c1f0 0x7f53cc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d37e8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53cc0cd5f0 con 0x7f53cc06be10 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d37e8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f53cc0cd8d0 con 0x7f53cc06c1f0 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d37e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc0cdbb0 con 0x7f53cc151c50 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d1584640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f53cc06be10 0x7f53cc151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55156/0 (socket says 172.21.15.134:55156) 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d1584640 1 -- 172.21.15.134:0/453065958 learned_addr learned my addr 172.21.15.134:0/453065958 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d1d85640 1 --2- 172.21.15.134:0/453065958 >> v2:172.21.15.177:3300/0 conn(0x7f53cc06c1f0 0x7f53cc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53d0d83640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53cc0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183399025 0 0) 0x7f53cc0cd5f0 con 0x7f53cc06be10 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53b8003520 con 0x7f53cc06be10 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609134834 0 0) 0x7f53b8003520 con 0x7f53cc06be10 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 msgr2=0x7f53cc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53cc0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 >> v2:172.21.15.177:3300/0 conn(0x7f53cc06c1f0 msgr2=0x7f53cc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 --2- 172.21.15.134:0/453065958 >> v2:172.21.15.177:3300/0 conn(0x7f53cc06c1f0 0x7f53cc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc0cde90 con 0x7f53cc06be10 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.372+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f53c8001670 con 0x7f53cc06be10 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 >> v1:172.21.15.134:6789/0 conn(0x7f53cc06be10 legacy=0x7f53cc151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b80039b0 0x7f53b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b8004d40 0x7f53b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0cd8d0 con 0x7f53b80039b0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0cdbb0 con 0x7f53b8004d40 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f53b800b9c0 con 0x7f53cc151c50 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b80039b0 0x7f53b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d0d83640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1d85640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b8004d40 0x7f53b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 -- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 msgr2=0x7f53b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc151c50 0x7f53b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 -- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b8004d40 msgr2=0x7f53b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b8004d40 0x7f53b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.373+0000 7f53d1584640 1 -- 172.21.15.134:0/453065958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b8003520 con 0x7f53b80039b0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d1584640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b80039b0 0x7f53b8003dd0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f53c800d220 tx=0x7f53b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eff21f4842197dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8033020 con 0x7f53b80039b0 2024-09-15T22:47:52.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c8005af0 con 0x7f53b80039b0 2024-09-15T22:47:52.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53c3fff640 1 -- 172.21.15.134:0/453065958 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c800c040 con 0x7f53b80039b0 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 -- 172.21.15.134:0/453065958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b80039b0 msgr2=0x7f53b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 --2- 172.21.15.134:0/453065958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b80039b0 0x7f53b8003dd0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f53c800d220 tx=0x7f53b8005830 comp rx=0 tx=0).stop 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d1d85640 1 -- 172.21.15.134:0/453065958 reap_dead start 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 -- 172.21.15.134:0/453065958 shutdown_connections 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 -- 172.21.15.134:0/453065958 >> 172.21.15.134:0/453065958 conn(0x7f53cc062cc0 msgr2=0x7f53cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 -- 172.21.15.134:0/453065958 shutdown_connections 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.374+0000 7f53d37e8640 1 -- 172.21.15.134:0/453065958 wait complete. 2024-09-15T22:47:52.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 Processor -- start 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 -- start start 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 0x7f53cc1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc0aa950 0x7f53cc0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0cd010 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0ce690 con 0x7f53b80039b0 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d37e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc0cd190 con 0x7f53cc0aa950 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d0d83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.376+0000 7f53d0d83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55196/0 (socket says 172.21.15.134:55196) 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 -- 172.21.15.134:0/1596919136 learned_addr learned my addr 172.21.15.134:0/1596919136 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d1584640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 0x7f53cc1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d1d85640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc0aa950 0x7f53cc0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 -- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc0aa950 msgr2=0x7f53cc0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc0aa950 0x7f53cc0ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 -- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 msgr2=0x7f53cc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 0x7f53cc1503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 -- 172.21.15.134:0/1596919136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc0aaeb0 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d1584640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 0x7f53cc1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d0d83640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0119a0 tx=0x7f53bc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53c1ffb640 1 -- 172.21.15.134:0/1596919136 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00faf0 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53c1ffb640 1 -- 172.21.15.134:0/1596919136 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc00fc90 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53c1ffb640 1 -- 172.21.15.134:0/1596919136 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc014440 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc0ab190 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.377+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc0ab750 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.379+0000 7f53c1ffb640 1 -- 172.21.15.134:0/1596919136 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f53bc012040 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.379+0000 7f53c1ffb640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 0x7f53b006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.379+0000 7f53c1ffb640 1 -- 172.21.15.134:0/1596919136 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f53bc08c660 con 0x7f53cc0aa4d0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.379+0000 7f53d1584640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 0x7f53b006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.380+0000 7f53d1584640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 0x7f53b006eda0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f53c8034000 tx=0x7f53c802f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.380+0000 7f53d6660740 1 Processor -- start 2024-09-15T22:47:52.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.380+0000 7f53d6660740 1 -- start start 2024-09-15T22:47:52.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eaef500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eb0b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560a4ea27520 con 0x560a4eac2a80 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560a4e9cf3e0 con 0x560a4eaef120 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x560a4ea234e0 con 0x560a4eb09ae0 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55206/0 (socket says 172.21.15.134:55206) 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 -- 172.21.15.134:0/3108258329 learned_addr learned my addr 172.21.15.134:0/3108258329 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1584640 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eaef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d0d83640 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eb0b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 -- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 msgr2=0x560a4eb0b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eb0b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 -- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 msgr2=0x560a4eaef500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eaef500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 -- 172.21.15.134:0/3108258329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4e9ea2f0 con 0x560a4eac2a80 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53d1d85640 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b59b0 tx=0x7f53c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132b90fd55c9f718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53aeffd640 1 -- 172.21.15.134:0/3108258329 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4003b90 con 0x560a4eac2a80 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53aeffd640 1 -- 172.21.15.134:0/3108258329 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c401e070 con 0x560a4eac2a80 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.381+0000 7f53aeffd640 1 -- 172.21.15.134:0/3108258329 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004030 con 0x560a4eac2a80 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 -- 172.21.15.134:0/3108258329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 msgr2=0x560a4eb0b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b59b0 tx=0x7f53c4009750 comp rx=0 tx=0).stop 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 -- 172.21.15.134:0/3108258329 shutdown_connections 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eac2a80 0x560a4eb0b7d0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eb0b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 --2- 172.21.15.134:0/3108258329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eaef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 -- 172.21.15.134:0/3108258329 >> 172.21.15.134:0/3108258329 conn(0x560a4eac1a80 msgr2=0x560a4eb09f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 -- 172.21.15.134:0/3108258329 shutdown_connections 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.382+0000 7f53d6660740 1 -- 172.21.15.134:0/3108258329 wait complete. 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.383+0000 7f53d6660740 1 -- start start 2024-09-15T22:47:52.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.383+0000 7f53d6660740 1 Processor -- start 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eac4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eaeaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560a4eaefee0 con 0x560a4eae8b30 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560a4e9b0450 con 0x560a4eaef120 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x560a4eb0a770 con 0x560a4eb09ae0 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 10 client.0 _ll_register_callbacks cb 0x560a4e739ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55214/0 (socket says 172.21.15.134:55214) 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 -- 172.21.15.134:0/1322439025 learned_addr learned my addr 172.21.15.134:0/1322439025 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d0d83640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eaeaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1584640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eac4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 -- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 msgr2=0x560a4eaeaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eaeaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 -- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 msgr2=0x560a4eac4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eac4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 -- 172.21.15.134:0/1322439025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4e73a2d0 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d1d85640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f53c401a000 tx=0x7f53c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a820f22b77b098 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004450 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f53c40045f0 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.384+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c401e070 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f53c4009c10 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 10 client.8415 fetch_fsmap learned FSMap version 75 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x560a4e8046b0 con 0x560a4eae8b30 2024-09-15T22:47:52.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c401e070 con 0x560a4eae8b30 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f53c4016430 con 0x560a4eae8b30 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 10 client.8415 fetch_fsmap finished waiting for FSMap version 75 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 10 client.8415 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 20 client.8415 populate_metadata read hostname 'smithi134' 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eb29f90 0x560a4eb2c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 4 client.8415 mds_command: new command op to 8250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 --> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a4ea34c50 con 0x560a4eb29f90 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d1584640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eb29f90 0x560a4eb2c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53a7fff640 10 client.8415 ms_handle_connect on v2:172.21.15.134:6825/2960551881 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.385+0000 7f53d1584640 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eb29f90 0x560a4eb2c380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bff22e2469b7259 server_cookie=e13a24b55b9af47b in_seq=0 out_seq=0 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53a7fff640 1 -- 172.21.15.134:0/1322439025 <== mds.0 v2:172.21.15.134:6825/2960551881 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a4ea34c50 con 0x560a4eb29f90 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53a7fff640 10 client.8415 handle_command_reply: tid=0 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 client.8415 shutdown 2024-09-15T22:47:52.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 msgr2=0x560a4eb05e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f53c401a000 tx=0x7f53c4004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 shutdown_connections 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eb29f90 0x560a4eb2c380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eae8b30 0x560a4eb05e60 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eb09ae0 0x560a4eaeaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53a7fff640 0 client.8415 ms_handle_reset on v2:172.21.15.134:6825/2960551881 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 --2- 172.21.15.134:0/1322439025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eaef120 0x560a4eac4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 >> 172.21.15.134:0/1322439025 conn(0x560a4eac2a80 msgr2=0x560a4eb138d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 shutdown_connections 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 1 -- 172.21.15.134:0/1322439025 wait complete. 2024-09-15T22:47:52.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.386+0000 7f53d6660740 20 client.8415 trim_cache size 0 max 16384 2024-09-15T22:47:52.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:47:52.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 Processor -- start 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 -- start start 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eb13ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1fbff0 con 0x560a4eb09ae0 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc15d230 con 0x560a4eae8b30 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc1fb9a0 con 0x560a4eaef120 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.404+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55224/0 (socket says 172.21.15.134:55224) 2024-09-15T22:47:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 -- 172.21.15.134:0/852531415 learned_addr learned my addr 172.21.15.134:0/852531415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1584640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eb13ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d0d83640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 -- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 msgr2=0x560a4eb091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 -- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 msgr2=0x560a4eb13ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eb13ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 -- 172.21.15.134:0/852531415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4eaef870 con 0x560a4eb09ae0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1584640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eb13ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53d1d85640 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009f10 tx=0x7f53c4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946fbe5216b35d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53ae7fc640 1 -- 172.21.15.134:0/852531415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4016cb0 con 0x560a4eb09ae0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53ae7fc640 1 -- 172.21.15.134:0/852531415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c401e040 con 0x560a4eb09ae0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.405+0000 7f53ae7fc640 1 -- 172.21.15.134:0/852531415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004250 con 0x560a4eb09ae0 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- 172.21.15.134:0/852531415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 msgr2=0x560a4eac52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009f10 tx=0x7f53c4023000 comp rx=0 tx=0).stop 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- 172.21.15.134:0/852531415 shutdown_connections 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eac52e0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 --2- 172.21.15.134:0/852531415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eb13ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- 172.21.15.134:0/852531415 >> 172.21.15.134:0/852531415 conn(0x560a4eac2a80 msgr2=0x560a4eb0b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- 172.21.15.134:0/852531415 shutdown_connections 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- 172.21.15.134:0/852531415 wait complete. 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.406+0000 7f53d6660740 1 -- start start 2024-09-15T22:47:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 Processor -- start 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eabf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb1cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560a4eae9230 con 0x560a4eb09ae0 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560a4eb05380 con 0x560a4eae8b30 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.407+0000 7f53d6660740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x560a4eb06470 con 0x560a4eaef120 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d6660740 10 client.0 _ll_register_callbacks cb 0x7f53b80036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55238/0 (socket says 172.21.15.134:55238) 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 -- 172.21.15.134:0/2530456987 learned_addr learned my addr 172.21.15.134:0/2530456987 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1584640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eabf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d0d83640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb1cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 -- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 msgr2=0x560a4eb1cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb1cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 -- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 msgr2=0x560a4eabf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eabf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 -- 172.21.15.134:0/2530456987 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4eb1d250 con 0x560a4eb09ae0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d0d83640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb1cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d1d85640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009dd0 tx=0x7f53c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c99accfe7dcd04d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4016df0 con 0x560a4eb09ae0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c401e040 con 0x560a4eb09ae0 2024-09-15T22:47:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f53c4004250 con 0x560a4eb09ae0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f53c404b050 con 0x560a4eb09ae0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d6660740 10 client.8421 fetch_fsmap learned FSMap version 75 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.408+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x560a4eb8fce0 con 0x560a4eb09ae0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c401e040 con 0x560a4eb09ae0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f53c404e020 con 0x560a4eb09ae0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 10 client.8421 fetch_fsmap finished waiting for FSMap version 75 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 10 client.8421 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 20 client.8421 populate_metadata read hostname 'smithi134' 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eae9c50 0x560a4eaea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 4 client.8421 mds_command: new command op to 8250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 --> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] -- command(tid 0: {"prefix": "status"}) -- 0x560a4eac65c0 con 0x560a4eae9c50 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d1584640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eae9c50 0x560a4eaea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53a7fff640 10 client.8421 ms_handle_connect on v2:172.21.15.134:6825/2960551881 2024-09-15T22:47:52.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53d1584640 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eae9c50 0x560a4eaea030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e215d184848917d8 server_cookie=d676bce140fd6a29 in_seq=0 out_seq=0 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53a7fff640 1 -- 172.21.15.134:0/2530456987 <== mds.0 v2:172.21.15.134:6825/2960551881 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x560a4eac65c0 con 0x560a4eae9c50 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.409+0000 7f53a7fff640 10 client.8421 handle_command_reply: tid=0 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 client.8421 shutdown 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 msgr2=0x560a4eb8bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009dd0 tx=0x7f53c400b040 comp rx=0 tx=0).stop 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 shutdown_connections 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:6825/2960551881,v1:172.21.15.134:6835/2960551881] conn(0x560a4eae9c50 0x560a4eaea030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a4eb09ae0 0x560a4eb8bb20 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a4eaef120 0x560a4eb1cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 --2- 172.21.15.134:0/2530456987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a4eae8b30 0x560a4eabf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 >> 172.21.15.134:0/2530456987 conn(0x560a4eac2a80 msgr2=0x560a4eac0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53a7fff640 0 client.8421 ms_handle_reset on v2:172.21.15.134:6825/2960551881 2024-09-15T22:47:52.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 shutdown_connections 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 1 -- 172.21.15.134:0/2530456987 wait complete. 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.410+0000 7f53d6660740 20 client.8421 trim_cache size 0 max 16384 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 8250, 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 8.8988703539999996, 2024-09-15T22:47:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 75, 2024-09-15T22:47:52.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 146, 2024-09-15T22:47:52.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 146, 2024-09-15T22:47:52.419 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 12.986575867999999 2024-09-15T22:47:52.419 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 msgr2=0x7f53b006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 0x7f53b006eda0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f53c8034000 tx=0x7f53c802f000 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 msgr2=0x7f53cc0abac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0119a0 tx=0x7f53bc011e60 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 shutdown_connections 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc0aa950 0x7f53cc0ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f53b006c8e0 0x7f53b006eda0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0aa4d0 0x7f53cc0abac0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 --2- 172.21.15.134:0/1596919136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b80039b0 0x7f53cc1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 >> 172.21.15.134:0/1596919136 conn(0x7f53cc062cc0 msgr2=0x7f53cc1594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 shutdown_connections 2024-09-15T22:47:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.411+0000 7f53d37e8640 1 -- 172.21.15.134:0/1596919136 wait complete. 2024-09-15T22:47:52.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:47:52.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.597+0000 7f8b01a82640 1 Processor -- start 2024-09-15T22:47:52.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.597+0000 7f8b01a82640 1 -- start start 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8b01a82640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8afc0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8b01a82640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8afc0cef90 0x7f8afc0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8b01a82640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc0b7170 con 0x7f8afc15e940 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8b01a82640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8afc0b7aa0 con 0x7f8afc0cef90 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8b01a82640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc0d3660 con 0x7f8afc15ed20 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afb7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8afc15e940 0x7f8afc0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55162/0 (socket says 172.21.15.134:55162) 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afb7fe640 1 -- 172.21.15.134:0/1164554897 learned_addr learned my addr 172.21.15.134:0/1164554897 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afbfff640 1 --2- 172.21.15.134:0/1164554897 >> v2:172.21.15.177:3300/0 conn(0x7f8afc0cef90 0x7f8afc0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afaffd640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8afc0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675237039 0 0) 0x7f8aec001110 con 0x7f8afc15e940 2024-09-15T22:47:52.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae4003520 con 0x7f8afc15e940 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2943139164 0 0) 0x7f8ae4003520 con 0x7f8afc15e940 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 msgr2=0x7f8afc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8afc0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 >> v2:172.21.15.177:3300/0 conn(0x7f8afc0cef90 msgr2=0x7f8afc0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 --2- 172.21.15.134:0/1164554897 >> v2:172.21.15.177:3300/0 conn(0x7f8afc0cef90 0x7f8afc0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc0d3940 con 0x7f8afc15e940 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afbfff640 1 --2- 172.21.15.134:0/1164554897 >> v2:172.21.15.177:3300/0 conn(0x7f8afc0cef90 0x7f8afc0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f8aec001840 con 0x7f8afc15e940 2024-09-15T22:47:52.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 >> v1:172.21.15.134:6789/0 conn(0x7f8afc15e940 legacy=0x7f8afc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8ae40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4003f30 0x7f8ae4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ae4004d40 0x7f8ae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0b7aa0 con 0x7f8ae4003f30 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0d3660 con 0x7f8ae4004d40 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae400b9f0 con 0x7f8afc15ed20 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afaffd640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4003f30 0x7f8ae4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afb7fe640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8ae40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.598+0000 7f8afbfff640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ae4004d40 0x7f8ae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 -- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 msgr2=0x7f8ae40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8afc15ed20 0x7f8ae40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 -- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ae4004d40 msgr2=0x7f8ae40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ae4004d40 0x7f8ae40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 -- 172.21.15.134:0/1164554897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae4003520 con 0x7f8ae4003f30 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afaffd640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4003f30 0x7f8ae4004800 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009ac0 tx=0x7f8ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2001135fcdabb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.599+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0036070 con 0x7f8ae4003f30 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0031400 con 0x7f8ae4003f30 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8afa7fc640 1 -- 172.21.15.134:0/1164554897 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0009690 con 0x7f8ae4003f30 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 -- 172.21.15.134:0/1164554897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4003f30 msgr2=0x7f8ae4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 --2- 172.21.15.134:0/1164554897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4003f30 0x7f8ae4004800 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009ac0 tx=0x7f8ae4005830 comp rx=0 tx=0).stop 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8afbfff640 1 -- 172.21.15.134:0/1164554897 reap_dead start 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 -- 172.21.15.134:0/1164554897 shutdown_connections 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 -- 172.21.15.134:0/1164554897 >> 172.21.15.134:0/1164554897 conn(0x7f8afc0b6240 msgr2=0x7f8afc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 -- 172.21.15.134:0/1164554897 shutdown_connections 2024-09-15T22:47:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.600+0000 7f8b01a82640 1 -- 172.21.15.134:0/1164554897 wait complete. 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.601+0000 7f8b01a82640 1 Processor -- start 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.601+0000 7f8b01a82640 1 -- start start 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ae4003f30 0x7f8afc14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8afc0cc610 0x7f8afc0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0d3310 con 0x7f8afc0c9d10 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0d3f00 con 0x7f8afc0cc610 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8b01a82640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc0d1ef0 con 0x7f8ae4003f30 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8afaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8afaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55252/0 (socket says 172.21.15.134:55252) 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8afaffd640 1 -- 172.21.15.134:0/3495795865 learned_addr learned my addr 172.21.15.134:0/3495795865 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8afbfff640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8afc0cc610 0x7f8afc0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.602+0000 7f8afb7fe640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ae4003f30 0x7f8afc14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 -- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ae4003f30 msgr2=0x7f8afc14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ae4003f30 0x7f8afc14bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 -- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8afc0cc610 msgr2=0x7f8afc0cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8afc0cc610 0x7f8afc0cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 -- 172.21.15.134:0/3495795865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc0cd390 con 0x7f8afc0c9d10 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8afaffd640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8af0034040 tx=0x7f8af0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0040020 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0003c60 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc149540 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0036040 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.603+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc149b00 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.604+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc0736b0 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.604+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f8af0043020 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.605+0000 7f8ae3fff640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 0x7f8ae806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.605+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f8af00abe40 con 0x7f8afc0c9d10 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.605+0000 7f8afb7fe640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 0x7f8ae806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.606+0000 7f8afb7fe640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 0x7f8ae806eda0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0012f0 tx=0x7f8aec007aa0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.609+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8afc0736b0 con 0x7f8afc0c9d10 2024-09-15T22:47:52.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.808+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8afc0d1060 con 0x7f8afc0c9d10 2024-09-15T22:47:52.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.809+0000 7f8ae3fff640 1 -- 172.21.15.134:0/3495795865 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) ==== 53+0+73 (secure 0 0 0) 0x7f8af004a070 con 0x7f8afc0c9d10 2024-09-15T22:47:52.813 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:47:52.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 msgr2=0x7f8ae806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 0x7f8ae806eda0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0012f0 tx=0x7f8aec007aa0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 msgr2=0x7f8afc0ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8af0034040 tx=0x7f8af0004730 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 shutdown_connections 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8afc0cc610 0x7f8afc0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae806c8e0 0x7f8ae806eda0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8afc0c9d10 0x7f8afc0ca190 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 --2- 172.21.15.134:0/3495795865 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ae4003f30 0x7f8afc14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 >> 172.21.15.134:0/3495795865 conn(0x7f8afc0b6240 msgr2=0x7f8afc0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 shutdown_connections 2024-09-15T22:47:52.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:52.811+0000 7f8b01a82640 1 -- 172.21.15.134:0/3495795865 wait complete. 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:47:52.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:47:52.824 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:52.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:52.824 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:47:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:47:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:52.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:52.843 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:47:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:47:52.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:52.905 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:47:52.962 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:47:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:47:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:47:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:47:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:47:52.963 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:47:52.963 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:47:52.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:47:52.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:47:52.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:47:52.964 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:47:53.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:47:53.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:53.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.089 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:47:53.104 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:47:53.104 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:47:53.105 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:53.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:47:53.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:53.169 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:53.224 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:47:53.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:53.225 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:53.280 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:47:53.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:53.363 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:53.363 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:53.363 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:47:53.377 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:47:53.378 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:47:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:47:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:47:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:47:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:47:53.379 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:47:53.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:47:53.445 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:47:53.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:47:53.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:53.545 INFO:teuthology.orchestra.run.smithi134.stdout:client7438 2024-09-15T22:47:53.546 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:47:53.546 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:53.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:47:53.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.698+0000 7fc4f904c640 1 Processor -- start 2024-09-15T22:47:53.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.698+0000 7fc4f904c640 1 -- start start 2024-09-15T22:47:53.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f904c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f904c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f415ce80 0x7fc4f41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f904c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f40d0bc0 con 0x7fc4f415ca40 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f904c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f415d390 con 0x7fc4f415ce80 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f904c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f415d670 con 0x7fc4f40d02a0 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f415ce80 0x7fc4f41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f415ce80 0x7fc4f41594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55262/0 (socket says 172.21.15.134:55262) 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 -- 172.21.15.134:0/1949495554 learned_addr learned my addr 172.21.15.134:0/1949495554 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f259c640 1 --1- 172.21.15.134:0/1949495554 >> v1:172.21.15.134:6789/0 conn(0x7fc4f415ca40 0x7fc4f415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55166/0 (socket says 172.21.15.134:55166) 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 -- 172.21.15.134:0/1949495554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 msgr2=0x7fc4f40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f2d9d640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 -- 172.21.15.134:0/1949495554 >> v1:172.21.15.134:6789/0 conn(0x7fc4f415ca40 legacy=0x7fc4f415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f359e640 1 -- 172.21.15.134:0/1949495554 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f415d950 con 0x7fc4f415ce80 2024-09-15T22:47:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f1d9b640 1 -- 172.21.15.134:0/1949495554 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231641722 0 0) 0x7fc4f40d0bc0 con 0x7fc4f415ca40 2024-09-15T22:47:53.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.699+0000 7fc4f2d9d640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:53.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.700+0000 7fc4f359e640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ce80 0x7fc4f41594c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009870 tx=0x7fc4ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff91300aab915c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:53.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.700+0000 7fc4f1d9b640 1 -- 172.21.15.134:0/1949495554 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec037070 con 0x7fc4f415ce80 2024-09-15T22:47:53.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.700+0000 7fc4f1d9b640 1 -- 172.21.15.134:0/1949495554 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec032440 con 0x7fc4f415ce80 2024-09-15T22:47:53.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.700+0000 7fc4f1d9b640 1 -- 172.21.15.134:0/1949495554 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec032810 con 0x7fc4f415ce80 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 -- 172.21.15.134:0/1949495554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ce80 msgr2=0x7fc4f41594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ce80 0x7fc4f41594c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009870 tx=0x7fc4ec02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 -- 172.21.15.134:0/1949495554 shutdown_connections 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ce80 0x7fc4f41594c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1949495554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 -- 172.21.15.134:0/1949495554 >> 172.21.15.134:0/1949495554 conn(0x7fc4f4062cc0 msgr2=0x7fc4f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 -- 172.21.15.134:0/1949495554 shutdown_connections 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.701+0000 7fc4f904c640 1 -- 172.21.15.134:0/1949495554 wait complete. 2024-09-15T22:47:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.702+0000 7fc4f904c640 1 Processor -- start 2024-09-15T22:47:53.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.702+0000 7fc4f904c640 1 -- start start 2024-09-15T22:47:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 0x7fc4f40b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f415eb40 con 0x7fc4f415ca40 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f415df10 con 0x7fc4f415ce80 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f904c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f4155b90 con 0x7fc4f40d02a0 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55270/0 (socket says 172.21.15.134:55270) 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f259c640 1 -- 172.21.15.134:0/1426622492 learned_addr learned my addr 172.21.15.134:0/1426622492 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f359e640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 0x7fc4f40b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.703+0000 7fc4f2d9d640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 -- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 msgr2=0x7fc4f41582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f41582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 -- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 msgr2=0x7fc4f40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 0x7fc4f40b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 -- 172.21.15.134:0/1426622492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f41f0450 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f359e640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 0x7fc4f40b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f259c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c410 tx=0x7fc4dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0074e0 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc0047e0 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f41f0730 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc004bd0 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.704+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41f34b0 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.705+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f41f32c0 con 0x7fc4f415ca40 2024-09-15T22:47:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.705+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fc4dc011070 con 0x7fc4f415ca40 2024-09-15T22:47:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.706+0000 7fc4eb7fe640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 0x7fc4d406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.706+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fc4dc08bc80 con 0x7fc4f415ca40 2024-09-15T22:47:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.706+0000 7fc4f2d9d640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 0x7fc4d406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.707+0000 7fc4f2d9d640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 0x7fc4d406eda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007510 tx=0x7fc4e40074a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.710+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4dc059a70 con 0x7fc4f415ca40 2024-09-15T22:47:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.907+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4f40b4790 con 0x7fc4f415ca40 2024-09-15T22:47:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.908+0000 7fc4eb7fe640 1 -- 172.21.15.134:0/1426622492 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) ==== 53+0+73 (secure 0 0 0) 0x7fc4dc059370 con 0x7fc4f415ca40 2024-09-15T22:47:53.909 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:47:53.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 msgr2=0x7fc4d406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 0x7fc4d406eda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007510 tx=0x7fc4e40074a0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 msgr2=0x7fc4f41efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c410 tx=0x7fc4dc00c8d0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 shutdown_connections 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f415ce80 0x7fc4f40b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4d406c8e0 0x7fc4d406eda0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f415ca40 0x7fc4f41efc20 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 --2- 172.21.15.134:0/1426622492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40d02a0 0x7fc4f41582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 >> 172.21.15.134:0/1426622492 conn(0x7fc4f4062cc0 msgr2=0x7fc4f4154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 shutdown_connections 2024-09-15T22:47:53.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:53.910+0000 7fc4f904c640 1 -- 172.21.15.134:0/1426622492 wait complete. 2024-09-15T22:47:53.922 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:47:53.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:47:53.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:47:53.922 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:47:53.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:53.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:47:53.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:47:53.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:47:53.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:53.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.923 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:47:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:47:53.943 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:47:53.943 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:47:53.943 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:53.944 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42409sec preferred_lft 42409sec 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:47:53.946 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:47:53.946 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:47:53.946 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:47:53.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:53.946 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:47:54.011 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:47:54.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:54.013 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:47:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:47:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:47:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:47:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:47:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:47:54.074 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:47:54.074 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:47:54.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:47:54.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:47:54.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:47:54.075 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:47:54.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:47:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:54.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:54.206 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:47:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:47:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:47:54.223 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:54.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:54.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:47:54.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:54.288 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:54.343 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:47:54.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:47:54.343 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:54.399 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:47:54.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:54.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:54.482 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:54.482 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:54.482 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:47:54.506 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:47:54.507 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:47:54.507 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:47:54.507 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:47:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:47:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:47:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:47:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:47:54.508 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:47:54.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:54.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:47:54.575 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:47:54.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:47:54.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:47:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:47:54.671 INFO:teuthology.orchestra.run.smithi177.stdout:client6665 2024-09-15T22:47:54.671 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:47:54.671 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:47:54.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:47:54.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.795+0000 7f67ba0c9640 1 Processor -- start 2024-09-15T22:47:54.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.795+0000 7f67ba0c9640 1 -- start start 2024-09-15T22:47:54.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67ba0c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67b4145d90 0x7f67b40ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67ba0c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f67b40cfce0 0x7f67b406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67ba0c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b40b4240 con 0x7f67b40cd490 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67ba0c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f67b406d080 con 0x7f67b4145d90 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67ba0c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f67b40b4520 con 0x7f67b40cfce0 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67b4145d90 0x7f67b40ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67b4145d90 0x7f67b40ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55274/0 (socket says 172.21.15.134:55274) 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 -- 172.21.15.134:0/1678578946 learned_addr learned my addr 172.21.15.134:0/1678578946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b3fff640 1 --2- 172.21.15.134:0/1678578946 >> v2:172.21.15.177:3300/0 conn(0x7f67b40cfce0 0x7f67b406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 -- 172.21.15.134:0/1678578946 >> v2:172.21.15.177:3300/0 conn(0x7f67b40cfce0 msgr2=0x7f67b406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 --2- 172.21.15.134:0/1678578946 >> v2:172.21.15.177:3300/0 conn(0x7f67b40cfce0 0x7f67b406d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 -- 172.21.15.134:0/1678578946 >> v1:172.21.15.177:6789/0 conn(0x7f67b40cd490 legacy=0x7f67b40cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.796+0000 7f67b37fe640 1 -- 172.21.15.134:0/1678578946 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b40b4800 con 0x7f67b4145d90 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.797+0000 7f67b37fe640 1 --2- 172.21.15.134:0/1678578946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40ccf50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f67b4161250 tx=0x7f67a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b8b3f6157b4011 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:54.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.797+0000 7f67b27fc640 1 -- 172.21.15.134:0/1678578946 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4036070 con 0x7f67b4145d90 2024-09-15T22:47:54.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.797+0000 7f67b27fc640 1 -- 172.21.15.134:0/1678578946 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a4031600 con 0x7f67b4145d90 2024-09-15T22:47:54.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.797+0000 7f67b27fc640 1 -- 172.21.15.134:0/1678578946 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a40319d0 con 0x7f67b4145d90 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1678578946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 msgr2=0x7f67b40ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1678578946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40ccf50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f67b4161250 tx=0x7f67a402a730 comp rx=0 tx=0).stop 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1678578946 shutdown_connections 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1678578946 >> v2:172.21.15.177:3300/0 conn(0x7f67b40cfce0 0x7f67b406d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1678578946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40ccf50 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1678578946 >> 172.21.15.134:0/1678578946 conn(0x7f67b406bba0 msgr2=0x7f67b406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1678578946 shutdown_connections 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.798+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1678578946 wait complete. 2024-09-15T22:47:54.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.799+0000 7f67ba0c9640 1 Processor -- start 2024-09-15T22:47:54.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.799+0000 7f67ba0c9640 1 -- start start 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67b40cd490 0x7f67b40af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67b40cfce0 0x7f67b41f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b5790 con 0x7f67b4145d90 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b5610 con 0x7f67b40cd490 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67ba0c9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f67b4146170 con 0x7f67b40cfce0 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55286/0 (socket says 172.21.15.134:55286) 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 -- 172.21.15.134:0/1693285174 learned_addr learned my addr 172.21.15.134:0/1693285174 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b37fe640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67b40cd490 0x7f67b40af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b2ffd640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67b40cfce0 0x7f67b41f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 -- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67b40cfce0 msgr2=0x7f67b41f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67b40cfce0 0x7f67b41f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 -- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67b40cd490 msgr2=0x7f67b40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67b40cd490 0x7f67b40af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.800+0000 7f67b3fff640 1 -- 172.21.15.134:0/1693285174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b40c59a0 con 0x7f67b4145d90 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f67b3fff640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00e860 tx=0x7f67ac00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac017070 con 0x7f67b4145d90 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac00c6d0 con 0x7f67b4145d90 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b40c5c80 con 0x7f67b4145d90 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00cac0 con 0x7f67b4145d90 2024-09-15T22:47:54.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.801+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b40c6240 con 0x7f67b4145d90 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.802+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b40ccf50 con 0x7f67b4145d90 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.802+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f67ac01a070 con 0x7f67b4145d90 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.803+0000 7f679bfff640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 0x7f67a006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.803+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f67ac08c4b0 con 0x7f67b4145d90 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.803+0000 7f67b37fe640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 0x7f67a006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:54.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.803+0000 7f67b37fe640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 0x7f67a006eda0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67a4033000 tx=0x7f67a4009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:54.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:54.807+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67ac059ad0 con 0x7f67b4145d90 2024-09-15T22:47:55.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.006+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f67b40cdde0 con 0x7f67b4145d90 2024-09-15T22:47:55.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.566+0000 7f679bfff640 1 -- 172.21.15.134:0/1693285174 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v76) ==== 136+0+0 (secure 0 0 0) 0x7f67ac05ddd0 con 0x7f67b4145d90 2024-09-15T22:47:55.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 msgr2=0x7f67a006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 0x7f67a006eda0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67a4033000 tx=0x7f67a4009000 comp rx=0 tx=0).stop 2024-09-15T22:47:55.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 msgr2=0x7f67b40c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00e860 tx=0x7f67ac00ed20 comp rx=0 tx=0).stop 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 shutdown_connections 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f67a006c8e0 0x7f67a006eda0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b4145d90 0x7f67b40c6d00 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67b40cfce0 0x7f67b41f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 --2- 172.21.15.134:0/1693285174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67b40cd490 0x7f67b40af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 >> 172.21.15.134:0/1693285174 conn(0x7f67b406bba0 msgr2=0x7f67b40b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 shutdown_connections 2024-09-15T22:47:55.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.569+0000 7f67ba0c9640 1 -- 172.21.15.134:0/1693285174 wait complete. 2024-09-15T22:47:55.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:47:55.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.682+0000 7f7efaa1e640 1 Processor -- start 2024-09-15T22:47:55.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.682+0000 7f7efaa1e640 1 -- start start 2024-09-15T22:47:55.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7efaa1e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7ef415ceb0 0x7f7ef41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7efaa1e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef415d390 con 0x7f7ef40d02a0 2024-09-15T22:47:55.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7efaa1e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef415d670 con 0x7f7ef415ca40 2024-09-15T22:47:55.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7efaa1e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef415d950 con 0x7f7ef415ceb0 2024-09-15T22:47:55.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7ef3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7ef40d02a0 0x7f7ef40d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55182/0 (socket says 172.21.15.134:55182) 2024-09-15T22:47:55.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3992599786 learned_addr learned my addr 172.21.15.134:0/3992599786 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7ef8fbb640 1 --2- 172.21.15.134:0/3992599786 >> v2:172.21.15.177:3300/0 conn(0x7f7ef415ceb0 0x7f7ef41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.683+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979112821 0 0) 0x7f7ef415d390 con 0x7f7ef40d02a0 2024-09-15T22:47:55.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7edc005730 con 0x7f7ef40d02a0 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734270173 0 0) 0x7f7edc005730 con 0x7f7ef40d02a0 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 >> v2:172.21.15.177:3300/0 conn(0x7f7ef415ceb0 msgr2=0x7f7ef41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 --2- 172.21.15.134:0/3992599786 >> v2:172.21.15.177:3300/0 conn(0x7f7ef415ceb0 0x7f7ef41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 >> v1:172.21.15.177:6789/0 conn(0x7f7ef415ca40 legacy=0x7f7ef415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef415dc30 con 0x7f7ef40d02a0 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7ee4001670 con 0x7f7ef40d02a0 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 >> v1:172.21.15.134:6789/0 conn(0x7f7ef40d02a0 legacy=0x7f7ef40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7edc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7edc006a10 0x7f7edc006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7edc0073d0 0x7f7edc00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef415d950 con 0x7f7edc005bc0 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc003550 con 0x7f7edc006a10 2024-09-15T22:47:55.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7edc003750 con 0x7f7edc0073d0 2024-09-15T22:47:55.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7edc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef37fe640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7edc006a10 0x7f7edc006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef8fbb640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7edc0073d0 0x7f7edc00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7edc0073d0 msgr2=0x7f7edc00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7edc0073d0 0x7f7edc00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7edc006a10 msgr2=0x7f7edc006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7edc006a10 0x7f7edc006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3992599786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc005730 con 0x7f7edc005bc0 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef8fbb640 1 -- 172.21.15.134:0/3992599786 reap_dead start 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.684+0000 7f7ef37fe640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7edc006a10 0x7f7edc006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7edc005fe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c210 tx=0x7f7edc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5173f56ae21c0c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4007d30 con 0x7f7edc005bc0 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee4005ad0 con 0x7f7edc005bc0 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7ef2ffd640 1 -- 172.21.15.134:0/3992599786 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4007070 con 0x7f7edc005bc0 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 msgr2=0x7f7edc005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.685+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7edc005fe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c210 tx=0x7f7edc007a40 comp rx=0 tx=0).stop 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.686+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3992599786 shutdown_connections 2024-09-15T22:47:55.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.686+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3992599786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7edc005fe0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.686+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3992599786 >> 172.21.15.134:0/3992599786 conn(0x7f7ef4062cc0 msgr2=0x7f7ef406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.686+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3992599786 shutdown_connections 2024-09-15T22:47:55.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.686+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3992599786 wait complete. 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.687+0000 7f7efaa1e640 1 Processor -- start 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.687+0000 7f7efaa1e640 1 -- start start 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef4153c60 0x7f7ef41540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071610 0x7f7ef4071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4155d10 con 0x7f7edc005bc0 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4155b90 con 0x7f7ef4071610 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40b4790 con 0x7f7ef4153c60 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55300/0 (socket says 172.21.15.134:55300) 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3498437379 learned_addr learned my addr 172.21.15.134:0/3498437379 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef8fbb640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071610 0x7f7ef4071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef37fe640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef4153c60 0x7f7ef41540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef4153c60 msgr2=0x7f7ef41540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef4153c60 0x7f7ef41540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071610 msgr2=0x7f7ef4071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071610 0x7f7ef4071a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 -- 172.21.15.134:0/3498437379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef4072360 con 0x7f7edc005bc0 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef3fff640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c210 tx=0x7f7ee4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4037040 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee4041070 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef4072640 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4001670 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.688+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef4157450 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.689+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef40d0680 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.690+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f7ee4004a20 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.690+0000 7f7ef0ff9640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 0x7f7ee006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.690+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f7ee40ab6b0 con 0x7f7edc005bc0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.690+0000 7f7ef37fe640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 0x7f7ee006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.691+0000 7f7ef37fe640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 0x7f7ee006edd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000c00 tx=0x7f7ee8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.695+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ee4044370 con 0x7f7edc005bc0 2024-09-15T22:47:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.879+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7ef406d310 con 0x7f7ee006c910 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.881+0000 7f7ef0ff9640 1 -- 172.21.15.134:0/3498437379 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7ef406d310 con 0x7f7ee006c910 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:47:55.882 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:47:55.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 msgr2=0x7f7ee006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 0x7f7ee006edd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000c00 tx=0x7f7ee8009040 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 msgr2=0x7f7ef414c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c210 tx=0x7f7ee4001a40 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 shutdown_connections 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071610 0x7f7ef4071a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef4153c60 0x7f7ef41540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7ee006c910 0x7f7ee006edd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 --2- 172.21.15.134:0/3498437379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7edc005bc0 0x7f7ef414c990 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 >> 172.21.15.134:0/3498437379 conn(0x7f7ef4062cc0 msgr2=0x7f7ef40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 shutdown_connections 2024-09-15T22:47:55.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.883+0000 7f7efaa1e640 1 -- 172.21.15.134:0/3498437379 wait complete. 2024-09-15T22:47:55.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:47:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.995+0000 7f36b0c7b640 1 Processor -- start 2024-09-15T22:47:55.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.995+0000 7f36b0c7b640 1 -- start start 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36b0c7b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36ac158e50 0x7f36ac0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36b0c7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac15c370 0x7f36ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36b0c7b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac15c800 con 0x7f36ac06ef60 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36b0c7b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac06f3d0 con 0x7f36ac158e50 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36b0c7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0b43f0 con 0x7f36ac15c370 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36ac158e50 0x7f36ac0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f36ac06ef60 0x7f36ac15ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55190/0 (socket says 172.21.15.134:55190) 2024-09-15T22:47:55.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36ac158e50 0x7f36ac0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55310/0 (socket says 172.21.15.134:55310) 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aad9d640 1 -- 172.21.15.134:0/4156266724 learned_addr learned my addr 172.21.15.134:0/4156266724 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36a1d9b640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac15c370 0x7f36ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 -- 172.21.15.134:0/4156266724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac15c370 msgr2=0x7f36ac06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac15c370 0x7f36ac06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 -- 172.21.15.134:0/4156266724 >> v1:172.21.15.134:6789/0 conn(0x7f36ac06ef60 legacy=0x7f36ac15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36a9d9b640 1 -- 172.21.15.134:0/4156266724 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884696996 0 0) 0x7f36ac15c800 con 0x7f36ac06ef60 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.996+0000 7f36aa59c640 1 -- 172.21.15.134:0/4156266724 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac0b3630 con 0x7f36ac158e50 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36aa59c640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac158e50 0x7f36ac0b5050 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a629974b507a7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36a9d9b640 1 -- 172.21.15.134:0/4156266724 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c037070 con 0x7f36ac158e50 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36a9d9b640 1 -- 172.21.15.134:0/4156266724 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c032440 con 0x7f36ac158e50 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36a9d9b640 1 -- 172.21.15.134:0/4156266724 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c032810 con 0x7f36ac158e50 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36b0c7b640 1 -- 172.21.15.134:0/4156266724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac158e50 msgr2=0x7f36ac0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.997+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac158e50 0x7f36ac0b5050 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02a180 comp rx=0 tx=0).stop 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 -- 172.21.15.134:0/4156266724 shutdown_connections 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac15c370 0x7f36ac06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/4156266724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac158e50 0x7f36ac0b5050 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 -- 172.21.15.134:0/4156266724 >> 172.21.15.134:0/4156266724 conn(0x7f36ac06bba0 msgr2=0x7f36ac06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 -- 172.21.15.134:0/4156266724 shutdown_connections 2024-09-15T22:47:56.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.998+0000 7f36b0c7b640 1 -- 172.21.15.134:0/4156266724 wait complete. 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.999+0000 7f36b0c7b640 1 Processor -- start 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:55.999+0000 7f36b0c7b640 1 -- start start 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 0x7f36ac156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36ac158e50 0x7f36ac0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0b3ed0 con 0x7f36ac15c370 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0b3bf0 con 0x7f36ac158e50 2024-09-15T22:47:56.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36b0c7b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac159230 con 0x7f36ac06ef60 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55318/0 (socket says 172.21.15.134:55318) 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 -- 172.21.15.134:0/3827750892 learned_addr learned my addr 172.21.15.134:0/3827750892 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36a1d9b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36ac158e50 0x7f36ac0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aa59c640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 0x7f36ac156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 -- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 msgr2=0x7f36ac156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 0x7f36ac156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 -- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36ac158e50 msgr2=0x7f36ac0ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36ac158e50 0x7f36ac0ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 -- 172.21.15.134:0/3827750892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac0acfe0 con 0x7f36ac15c370 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aa59c640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 0x7f36ac156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36aad9d640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c7d0 tx=0x7f36a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.000+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4018070 con 0x7f36ac15c370 2024-09-15T22:47:56.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.001+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a400a640 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.001+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac0ad2c0 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.001+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400aa70 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.001+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac0ad880 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.002+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac06ea20 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.002+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f36a400ac10 con 0x7f36ac15c370 2024-09-15T22:47:56.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.002+0000 7f36a37fe640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 0x7f368c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.003+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f36a408b620 con 0x7f36ac15c370 2024-09-15T22:47:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.003+0000 7f36aa59c640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 0x7f368c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.003+0000 7f36aa59c640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 0x7f368c06eda0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.007+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36a4058d40 con 0x7f36ac15c370 2024-09-15T22:47:56.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.172+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f36ac0cc500 con 0x7f36ac15c370 2024-09-15T22:47:56.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.173+0000 7f36a37fe640 1 -- 172.21.15.134:0/3827750892 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f36a405d040 con 0x7f36ac15c370 2024-09-15T22:47:56.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 msgr2=0x7f368c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 0x7f368c06eda0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).stop 2024-09-15T22:47:56.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 msgr2=0x7f36ac06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c7d0 tx=0x7f36a400cc90 comp rx=0 tx=0).stop 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 shutdown_connections 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f368c06c8e0 0x7f368c06eda0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac15c370 0x7f36ac06d910 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36ac158e50 0x7f36ac0ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 --2- 172.21.15.134:0/3827750892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36ac06ef60 0x7f36ac156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 >> 172.21.15.134:0/3827750892 conn(0x7f36ac06bba0 msgr2=0x7f36ac15b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 shutdown_connections 2024-09-15T22:47:56.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.175+0000 7f36b0c7b640 1 -- 172.21.15.134:0/3827750892 wait complete. 2024-09-15T22:47:56.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:56.189 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol73620) 2024-09-15T22:47:56.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:56.221 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp22580/subvol52911) 2024-09-15T22:47:56.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol73620 2024-09-15T22:47:56.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.427+0000 7f047f50a640 1 Processor -- start 2024-09-15T22:47:56.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047f50a640 1 -- start start 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047f50a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0478161e30 0x7f04780d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047f50a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04780cf9a0 con 0x7f047806dfd0 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047f50a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0478162210 con 0x7f04780b3d50 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047f50a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f04780cfcf0 con 0x7f0478161e30 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047d2a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0478161e30 0x7f04780d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.428+0000 7f047daa7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f047806dfd0 0x7f04780b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36166/0 (socket says 172.21.15.134:36166) 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.429+0000 7f047daa7640 1 -- 172.21.15.134:0/2312944874 learned_addr learned my addr 172.21.15.134:0/2312944874 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.429+0000 7f047d2a6640 1 -- 172.21.15.134:0/2312944874 >> v1:172.21.15.177:6789/0 conn(0x7f04780b3d50 legacy=0x7f047806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.429+0000 7f047d2a6640 1 -- 172.21.15.134:0/2312944874 >> v1:172.21.15.134:6789/0 conn(0x7f047806dfd0 legacy=0x7f04780b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.429+0000 7f047d2a6640 1 -- 172.21.15.134:0/2312944874 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04780d5210 con 0x7f0478161e30 2024-09-15T22:47:56.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.429+0000 7f047d2a6640 1 --2- 172.21.15.134:0/2312944874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0478161e30 0x7f04780d34a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f04740097a0 tx=0x7f047402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58944c457e187c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f046ffff640 1 -- 172.21.15.134:0/2312944874 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474037070 con 0x7f0478161e30 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f046ffff640 1 -- 172.21.15.134:0/2312944874 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474032440 con 0x7f0478161e30 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f046ffff640 1 -- 172.21.15.134:0/2312944874 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474032810 con 0x7f0478161e30 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 -- 172.21.15.134:0/2312944874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0478161e30 msgr2=0x7f04780d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 --2- 172.21.15.134:0/2312944874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0478161e30 0x7f04780d34a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f04740097a0 tx=0x7f047402a230 comp rx=0 tx=0).stop 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 -- 172.21.15.134:0/2312944874 shutdown_connections 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 --2- 172.21.15.134:0/2312944874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0478161e30 0x7f04780d34a0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 -- 172.21.15.134:0/2312944874 >> 172.21.15.134:0/2312944874 conn(0x7f04780d1870 msgr2=0x7f04780d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 -- 172.21.15.134:0/2312944874 shutdown_connections 2024-09-15T22:47:56.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.430+0000 7f047f50a640 1 -- 172.21.15.134:0/2312944874 wait complete. 2024-09-15T22:47:56.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.431+0000 7f047f50a640 1 Processor -- start 2024-09-15T22:47:56.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.431+0000 7f047f50a640 1 -- start start 2024-09-15T22:47:56.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047806dfd0 0x7f047814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 0x7f04780cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04780d39e0 con 0x7f04780b3d50 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04780b3950 con 0x7f047806dfd0 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047f50a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f04780cb2a0 con 0x7f0478161e30 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047caa5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047caa5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53310/0 (socket says 172.21.15.134:53310) 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047caa5640 1 -- 172.21.15.134:0/3459627092 learned_addr learned my addr 172.21.15.134:0/3459627092 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047d2a6640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047806dfd0 0x7f047814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.432+0000 7f047daa7640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 0x7f04780cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 -- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 msgr2=0x7f04780cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 0x7f04780cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 -- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047806dfd0 msgr2=0x7f047814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047806dfd0 0x7f047814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 -- 172.21.15.134:0/3459627092 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04780c8ea0 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047daa7640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 0x7f04780cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047caa5640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f046800c430 tx=0x7f046800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468017070 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04680052d0 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04780c9140 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468003830 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.433+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047814cff0 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.434+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04780b3290 con 0x7f04780b3d50 2024-09-15T22:47:56.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.434+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f046801a070 con 0x7f04780b3d50 2024-09-15T22:47:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.435+0000 7f046dffb640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 0x7f045c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.435+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f046808b3b0 con 0x7f04780b3d50 2024-09-15T22:47:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.435+0000 7f047d2a6640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 0x7f045c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.435+0000 7f047d2a6640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 0x7f045c06eda0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0474034000 tx=0x7f047402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.439+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0468058ac0 con 0x7f04780b3d50 2024-09-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.629+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol73620", "target": ["mon-mgr", ""]}) -- 0x7f04780ceb10 con 0x7f045c06c8e0 2024-09-15T22:47:56.636 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:56.635+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:56.637 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:56.635+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:56.637 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:56.635+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:56.637 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:56.635+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:56.637 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:47:56.635+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:47:56.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.662+0000 7f046dffb640 1 -- 172.21.15.134:0/3459627092 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f04780ceb10 con 0x7f045c06c8e0 2024-09-15T22:47:56.664 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol73620 2024-09-15T22:47:56.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 msgr2=0x7f045c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 0x7f045c06eda0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0474034000 tx=0x7f047402e000 comp rx=0 tx=0).stop 2024-09-15T22:47:56.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 msgr2=0x7f04780caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f046800c430 tx=0x7f046800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 shutdown_connections 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0478161e30 0x7f04780cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f045c06c8e0 0x7f045c06eda0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04780b3d50 0x7f04780caa50 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 --2- 172.21.15.134:0/3459627092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f047806dfd0 0x7f047814cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 >> 172.21.15.134:0/3459627092 conn(0x7f04780d1870 msgr2=0x7f047806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 shutdown_connections 2024-09-15T22:47:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.665+0000 7f047f50a640 1 -- 172.21.15.134:0/3459627092 wait complete. 2024-09-15T22:47:56.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol52911 subvol_grp22580 2024-09-15T22:47:56.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.777+0000 7f02efb49640 1 Processor -- start 2024-09-15T22:47:56.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 -- start start 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e815e840 0x7f02e8073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02e80b49a0 0x7f02e806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e8073790 con 0x7f02e8073bb0 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f02e80b1da0 con 0x7f02e80b49a0 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.778+0000 7f02efb49640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f02e806ccb0 con 0x7f02e815e840 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ee0e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02e80b49a0 0x7f02e806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ed0e4640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f02e8073bb0 0x7f02e80b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36168/0 (socket says 172.21.15.134:36168) 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ed0e4640 1 -- 172.21.15.134:0/3631550424 learned_addr learned my addr 172.21.15.134:0/3631550424 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:47:56.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ed8e5640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e815e840 0x7f02e8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ee0e6640 1 -- 172.21.15.134:0/3631550424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e815e840 msgr2=0x7f02e8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ee0e6640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e815e840 0x7f02e8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ee0e6640 1 -- 172.21.15.134:0/3631550424 >> v1:172.21.15.134:6789/0 conn(0x7f02e8073bb0 legacy=0x7f02e80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ec8e3640 1 -- 172.21.15.134:0/3631550424 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675841034 0 0) 0x7f02e8073790 con 0x7f02e8073bb0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.779+0000 7f02ee0e6640 1 -- 172.21.15.134:0/3631550424 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e80740b0 con 0x7f02e80b49a0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02ee0e6640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e80b49a0 0x7f02e806d9e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60aa454f12ebdac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02ec8e3640 1 -- 172.21.15.134:0/3631550424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007740 con 0x7f02e80b49a0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02ec8e3640 1 -- 172.21.15.134:0/3631550424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e00078e0 con 0x7f02e80b49a0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02ec8e3640 1 -- 172.21.15.134:0/3631550424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007cb0 con 0x7f02e80b49a0 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 -- 172.21.15.134:0/3631550424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e80b49a0 msgr2=0x7f02e806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e80b49a0 0x7f02e806d9e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e002a530 comp rx=0 tx=0).stop 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 -- 172.21.15.134:0/3631550424 shutdown_connections 2024-09-15T22:47:56.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e80b49a0 0x7f02e806d9e0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 --2- 172.21.15.134:0/3631550424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e815e840 0x7f02e8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 -- 172.21.15.134:0/3631550424 >> 172.21.15.134:0/3631550424 conn(0x7f02e8062630 msgr2=0x7f02e8062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 -- 172.21.15.134:0/3631550424 shutdown_connections 2024-09-15T22:47:56.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.780+0000 7f02efb49640 1 -- 172.21.15.134:0/3631550424 wait complete. 2024-09-15T22:47:56.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 Processor -- start 2024-09-15T22:47:56.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 -- start start 2024-09-15T22:47:56.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 0x7f02e81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 0x7f02e8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02e806d1e0 con 0x7f02e8073bb0 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02e806d550 con 0x7f02e815e840 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02efb49640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f02e815ec20 con 0x7f02e80b49a0 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02ed8e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02ed8e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53338/0 (socket says 172.21.15.134:53338) 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.782+0000 7f02ed8e5640 1 -- 172.21.15.134:0/4042360915 learned_addr learned my addr 172.21.15.134:0/4042360915 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ee0e6640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 0x7f02e8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed0e4640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 0x7f02e81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 -- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 msgr2=0x7f02e81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 0x7f02e81582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 -- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 msgr2=0x7f02e8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 0x7f02e8155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 -- 172.21.15.134:0/4042360915 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81607e0 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ee0e6640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 0x7f02e8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed0e4640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 0x7f02e81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02ed8e5640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f02e400d620 tx=0x7f02e400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400b620 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e4019070 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400ba00 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e8160ac0 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.783+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e8161080 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.784+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e8073250 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.785+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7f02e400bba0 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.785+0000 7f02de7fc640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 0x7f02cc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.785+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f02e408c350 con 0x7f02e8073bb0 2024-09-15T22:47:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.785+0000 7f02ed0e4640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 0x7f02cc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.786+0000 7f02ed0e4640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 0x7f02cc06eda0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f02e81f86a0 tx=0x7f02d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.789+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02e405a1d0 con 0x7f02e8073bb0 2024-09-15T22:47:56.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.977+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol52911", "group_name": "subvol_grp22580", "target": ["mon-mgr", ""]}) -- 0x7f02e8062d90 con 0x7f02cc06c8e0 2024-09-15T22:47:56.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:56.998+0000 7f02de7fc640 1 -- 172.21.15.134:0/4042360915 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02e8062d90 con 0x7f02cc06c8e0 2024-09-15T22:47:56.999 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp22580/subvol52911 2024-09-15T22:47:57.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 msgr2=0x7f02cc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 0x7f02cc06eda0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f02e81f86a0 tx=0x7f02d8009040 comp rx=0 tx=0).stop 2024-09-15T22:47:57.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 msgr2=0x7f02e815fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f02e400d620 tx=0x7f02e400dae0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 shutdown_connections 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e815e840 0x7f02e8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02e80b49a0 0x7f02e81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f02cc06c8e0 0x7f02cc06eda0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 --2- 172.21.15.134:0/4042360915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02e8073bb0 0x7f02e815fee0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 >> 172.21.15.134:0/4042360915 conn(0x7f02e8062630 msgr2=0x7f02e815cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 shutdown_connections 2024-09-15T22:47:57.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.000+0000 7f02efb49640 1 -- 172.21.15.134:0/4042360915 wait complete. 2024-09-15T22:47:57.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol73620 2024-09-15T22:47:57.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.112+0000 7fe0f4b8d640 1 Processor -- start 2024-09-15T22:47:57.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.112+0000 7fe0f4b8d640 1 -- start start 2024-09-15T22:47:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.113+0000 7fe0f4b8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.113+0000 7fe0f4b8d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0f006dfd0 0x7fe0f00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.113+0000 7fe0f4b8d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f00cf9a0 con 0x7fe0f00b3d50 2024-09-15T22:47:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.113+0000 7fe0f4b8d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f00cfcf0 con 0x7fe0f006dfd0 2024-09-15T22:47:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.113+0000 7fe0f4b8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f0162210 con 0x7fe0f0161e30 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0eed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0f006dfd0 0x7fe0f00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:43624/0 (socket says 172.21.15.134:43624) 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 -- 172.21.15.134:0/484157908 learned_addr learned my addr 172.21.15.134:0/484157908 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0edd9b640 1 --1- 172.21.15.134:0/484157908 >> v1:172.21.15.177:6789/0 conn(0x7fe0f00b3d50 0x7fe0f006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:37026/0 (socket says 172.21.15.134:37026) 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 -- 172.21.15.134:0/484157908 >> v2:172.21.15.177:3300/0 conn(0x7fe0f006dfd0 msgr2=0x7fe0f00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 --2- 172.21.15.134:0/484157908 >> v2:172.21.15.177:3300/0 conn(0x7fe0f006dfd0 0x7fe0f00b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 -- 172.21.15.134:0/484157908 >> v1:172.21.15.177:6789/0 conn(0x7fe0f00b3d50 legacy=0x7fe0f006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.114+0000 7fe0ee59c640 1 -- 172.21.15.134:0/484157908 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f00d5210 con 0x7fe0f0161e30 2024-09-15T22:47:57.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0ee59c640 1 --2- 172.21.15.134:0/484157908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c5699ebc1f4815 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0ed59a640 1 -- 172.21.15.134:0/484157908 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8037070 con 0x7fe0f0161e30 2024-09-15T22:47:57.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0ed59a640 1 -- 172.21.15.134:0/484157908 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8032440 con 0x7fe0f0161e30 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0ed59a640 1 -- 172.21.15.134:0/484157908 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8032810 con 0x7fe0f0161e30 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/484157908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 msgr2=0x7fe0f00d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.115+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/484157908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e802a270 comp rx=0 tx=0).stop 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/484157908 shutdown_connections 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/484157908 >> v2:172.21.15.177:3300/0 conn(0x7fe0f006dfd0 0x7fe0f00b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/484157908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f0161e30 0x7fe0f00d34a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/484157908 >> 172.21.15.134:0/484157908 conn(0x7fe0f00d1870 msgr2=0x7fe0f00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/484157908 shutdown_connections 2024-09-15T22:47:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.116+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/484157908 wait complete. 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.117+0000 7fe0f4b8d640 1 Processor -- start 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.117+0000 7fe0f4b8d640 1 -- start start 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0f006dfd0 0x7fe0f0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 0x7fe0f00c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f00d39e0 con 0x7fe0f0161e30 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f00b3950 con 0x7fe0f006dfd0 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0f4b8d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f00cbd80 con 0x7fe0f00b3d50 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53352/0 (socket says 172.21.15.134:53352) 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 -- 172.21.15.134:0/690437577 learned_addr learned my addr 172.21.15.134:0/690437577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0ee59c640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0f006dfd0 0x7fe0f0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0edd9b640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 0x7fe0f00c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 -- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 msgr2=0x7fe0f00c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 0x7fe0f00c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 -- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0f006dfd0 msgr2=0x7fe0f0153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0f006dfd0 0x7fe0f0153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 -- 172.21.15.134:0/690437577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f00c9750 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0edd9b640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 0x7fe0f00c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0eed9d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000efc0 tx=0x7fe0e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.118+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0018020 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.119+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e0014480 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.119+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f00c9a30 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.119+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0014870 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.119+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f00cb420 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.120+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f00c9c30 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.120+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 21) ==== 91407+0+0 (secure 0 0 0) 0x7fe0e0005d10 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.120+0000 7fe0e6ffd640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 0x7fe0d006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.121+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fe0e008cc80 con 0x7fe0f0161e30 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.121+0000 7fe0ee59c640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 0x7fe0d006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.121+0000 7fe0ee59c640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 0x7fe0d006edd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8034000 tx=0x7fe0e802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.125+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0e0022030 con 0x7fe0f0161e30 2024-09-15T22:47:57.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.317+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol73620", "target": ["mon-mgr", ""]}) -- 0x7fe0f00b3290 con 0x7fe0d006c910 2024-09-15T22:47:57.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.323+0000 7fe0e6ffd640 1 -- 172.21.15.134:0/690437577 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7fe0f00b3290 con 0x7fe0d006c910 2024-09-15T22:47:57.325 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol73620 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 msgr2=0x7fe0d006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 0x7fe0d006edd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8034000 tx=0x7fe0e802e000 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 msgr2=0x7fe0f00cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000efc0 tx=0x7fe0e000c490 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 shutdown_connections 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe0d006c910 0x7fe0d006edd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0161e30 0x7fe0f00cd980 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0f00b3d50 0x7fe0f00c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 --2- 172.21.15.134:0/690437577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0f006dfd0 0x7fe0f0153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 >> 172.21.15.134:0/690437577 conn(0x7fe0f00d1870 msgr2=0x7fe0f015e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 shutdown_connections 2024-09-15T22:47:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:57.325+0000 7fe0f4b8d640 1 -- 172.21.15.134:0/690437577 wait complete. 2024-09-15T22:47:57.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:57.338 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/c967c113eaf43736ee6bbeb0c4a42d7a.meta) 2024-09-15T22:47:59.432 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:47:59.432 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:47:59.432 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:47:59.433 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol73620 2024-09-15T22:47:59.433 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:47:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:47:59.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol52911 subvol_grp22580 2024-09-15T22:47:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.549+0000 7f666bf26640 1 Processor -- start 2024-09-15T22:47:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.549+0000 7f666bf26640 1 -- start start 2024-09-15T22:47:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f666406bba0 0x7f666406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f66640720f0 0x7f6664072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f66640b58a0 con 0x7f666406bba0 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f66641484e0 con 0x7f66640720f0 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666bf26640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f666406c500 con 0x7f6664148100 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f666406bba0 0x7f666406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f666406bba0 0x7f666406bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53354/0 (socket says 172.21.15.134:53354) 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 -- 172.21.15.134:0/3242880462 learned_addr learned my addr 172.21.15.134:0/3242880462 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f666a4c3640 1 --2- 172.21.15.134:0/3242880462 >> v2:172.21.15.177:3300/0 conn(0x7f66640720f0 0x7f6664072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f6669cc2640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 -- 172.21.15.134:0/3242880462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 msgr2=0x7f666406eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666406eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 -- 172.21.15.134:0/3242880462 >> v2:172.21.15.177:3300/0 conn(0x7f66640720f0 msgr2=0x7f6664072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 --2- 172.21.15.134:0/3242880462 >> v2:172.21.15.177:3300/0 conn(0x7f66640720f0 0x7f6664072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.550+0000 7f66694c1640 1 -- 172.21.15.134:0/3242880462 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66640b4800 con 0x7f666406bba0 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.551+0000 7f66694c1640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f666406bba0 0x7f666406bfc0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f666406f5b0 tx=0x7f665402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b787bd87033ba778 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.551+0000 7f6668cc0640 1 -- 172.21.15.134:0/3242880462 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654037070 con 0x7f666406bba0 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.551+0000 7f6668cc0640 1 -- 172.21.15.134:0/3242880462 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6654032440 con 0x7f666406bba0 2024-09-15T22:47:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.551+0000 7f6668cc0640 1 -- 172.21.15.134:0/3242880462 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654032810 con 0x7f666406bba0 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 -- 172.21.15.134:0/3242880462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f666406bba0 msgr2=0x7f666406bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f666406bba0 0x7f666406bfc0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f666406f5b0 tx=0x7f665402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 -- 172.21.15.134:0/3242880462 shutdown_connections 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 --2- 172.21.15.134:0/3242880462 >> v2:172.21.15.177:3300/0 conn(0x7f66640720f0 0x7f6664072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f666406bba0 0x7f666406bfc0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 --2- 172.21.15.134:0/3242880462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666406eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 -- 172.21.15.134:0/3242880462 >> 172.21.15.134:0/3242880462 conn(0x7f6664062810 msgr2=0x7f666406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 -- 172.21.15.134:0/3242880462 shutdown_connections 2024-09-15T22:47:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.552+0000 7f666bf26640 1 -- 172.21.15.134:0/3242880462 wait complete. 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.553+0000 7f666bf26640 1 Processor -- start 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.553+0000 7f666bf26640 1 -- start start 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f666406bba0 0x7f666413b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66640b50a0 con 0x7f66640720f0 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f66640b4dc0 con 0x7f666406bba0 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f66640b5380 con 0x7f6664148100 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53366/0 (socket says 172.21.15.134:53366) 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 -- 172.21.15.134:0/563122491 learned_addr learned my addr 172.21.15.134:0/563122491 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f6669cc2640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f666406bba0 0x7f666413b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666a4c3640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 -- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 msgr2=0x7f666415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 -- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f666406bba0 msgr2=0x7f666413b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f666406bba0 0x7f666413b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 -- 172.21.15.134:0/563122491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66640aea80 con 0x7f66640720f0 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666a4c3640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f66694c1640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f665402a220 tx=0x7f66540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654041020 con 0x7f66640720f0 2024-09-15T22:47:59.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540306c0 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66640aed60 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.554+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654037040 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.555+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66640af320 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.555+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666406fd50 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.556+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 91458+0+0 (secure 0 0 0) 0x7f6654044020 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.556+0000 7f665a7fc640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 0x7f664806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.556+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f66540ac6b0 con 0x7f66640720f0 2024-09-15T22:47:59.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.557+0000 7f6669cc2640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 0x7f664806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.557+0000 7f6669cc2640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 0x7f664806ee30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6660007920 tx=0x7f6660008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.561+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f665404b030 con 0x7f66640720f0 2024-09-15T22:47:59.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.753+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol52911", "group_name": "subvol_grp22580", "target": ["mon-mgr", ""]}) -- 0x7f66640d04e0 con 0x7f664806c970 2024-09-15T22:47:59.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.759+0000 7f665a7fc640 1 -- 172.21.15.134:0/563122491 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f66640d04e0 con 0x7f664806c970 2024-09-15T22:47:59.760 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp22580/subvol52911 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.760+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 msgr2=0x7f664806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.760+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 0x7f664806ee30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6660007920 tx=0x7f6660008040 comp rx=0 tx=0).stop 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.760+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 msgr2=0x7f66640b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.760+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f665402a220 tx=0x7f66540046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 shutdown_connections 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6664148100 0x7f666415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f664806c970 0x7f664806ee30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66640720f0 0x7f66640b18d0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 --2- 172.21.15.134:0/563122491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f666406bba0 0x7f666413b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 >> 172.21.15.134:0/563122491 conn(0x7f6664062810 msgr2=0x7f6664144460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 shutdown_connections 2024-09-15T22:47:59.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:47:59.761+0000 7f666bf26640 1 -- 172.21.15.134:0/563122491 wait complete. 2024-09-15T22:47:59.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:47:59.773 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/9c02d19ef672111334500e53da96557d.meta) 2024-09-15T22:48:04.431 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:48:04.431 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:48:04.431 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:48:04.431 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/subvol_grp22580/subvol52911 2024-09-15T22:48:04.432 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:48:04.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:04.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol73620 2024-09-15T22:48:04.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.543+0000 7f7066d26640 1 Processor -- start 2024-09-15T22:48:04.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.543+0000 7f7066d26640 1 -- start start 2024-09-15T22:48:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f7066d26640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70600aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f7066d26640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70600b57d0 0x7f70600b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f7066d26640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706006dc40 con 0x7f7060072290 2024-09-15T22:48:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f7066d26640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f706006e570 con 0x7f70600b57d0 2024-09-15T22:48:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f7066d26640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f706006df20 con 0x7f7060161cc0 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f70652c3640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7060072290 0x7f706006ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36172/0 (socket says 172.21.15.134:36172) 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f70652c3640 1 -- 172.21.15.134:0/2568903161 learned_addr learned my addr 172.21.15.134:0/2568903161 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.544+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147233996 0 0) 0x7f706006dc40 con 0x7f7060072290 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7057fff640 1 --2- 172.21.15.134:0/2568903161 >> v2:172.21.15.177:3300/0 conn(0x7f70600b57d0 0x7f70600b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7048003520 con 0x7f7060072290 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70600aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1433528697 0 0) 0x7f7048003520 con 0x7f7060072290 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 msgr2=0x7f70600aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70600aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 >> v2:172.21.15.177:3300/0 conn(0x7f70600b57d0 msgr2=0x7f70600b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 --2- 172.21.15.134:0/2568903161 >> v2:172.21.15.177:3300/0 conn(0x7f70600b57d0 0x7f70600b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706006e200 con 0x7f7060072290 2024-09-15T22:48:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7058001670 con 0x7f7060072290 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 >> v1:172.21.15.134:6789/0 conn(0x7f7060072290 legacy=0x7f706006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70480039b0 0x7f7048003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048004800 0x7f7048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f706006e570 con 0x7f70480039b0 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f706006df20 con 0x7f7048004800 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f704800b9c0 con 0x7f7060161cc0 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70480039b0 0x7f7048003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7057fff640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048004800 0x7f7048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f70652c3640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 -- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 msgr2=0x7f70480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7060161cc0 0x7f70480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 -- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048004800 msgr2=0x7f7048004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048004800 0x7f7048004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.545+0000 7f7064ac2640 1 -- 172.21.15.134:0/2568903161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7048003520 con 0x7f70480039b0 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.546+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70480039b0 0x7f7048003dd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f705c009fc0 tx=0x7f7048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38afc9d6d71a1a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.546+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c009c10 con 0x7f70480039b0 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.546+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f705c036070 con 0x7f70480039b0 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.546+0000 7f70577fe640 1 -- 172.21.15.134:0/2568903161 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c031880 con 0x7f70480039b0 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 -- 172.21.15.134:0/2568903161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70480039b0 msgr2=0x7f7048003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 --2- 172.21.15.134:0/2568903161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70480039b0 0x7f7048003dd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f705c009fc0 tx=0x7f7048005830 comp rx=0 tx=0).stop 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f70652c3640 1 -- 172.21.15.134:0/2568903161 reap_dead start 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 -- 172.21.15.134:0/2568903161 shutdown_connections 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 -- 172.21.15.134:0/2568903161 >> 172.21.15.134:0/2568903161 conn(0x7f706006bba0 msgr2=0x7f706006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 -- 172.21.15.134:0/2568903161 shutdown_connections 2024-09-15T22:48:04.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.547+0000 7f7066d26640 1 -- 172.21.15.134:0/2568903161 wait complete. 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.548+0000 7f7066d26640 1 Processor -- start 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.548+0000 7f7066d26640 1 -- start start 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70480039b0 0x7f70601591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706014d780 0x7f706015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f706006f290 con 0x7f706015d5d0 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f706006f110 con 0x7f706014d780 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7066d26640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f706006f410 con 0x7f70480039b0 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53388/0 (socket says 172.21.15.134:53388) 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 -- 172.21.15.134:0/2360494902 learned_addr learned my addr 172.21.15.134:0/2360494902 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7057fff640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706014d780 0x7f706015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70480039b0 0x7f70601591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 -- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70480039b0 msgr2=0x7f70601591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70480039b0 0x7f70601591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 -- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706014d780 msgr2=0x7f706015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706014d780 0x7f706015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 -- 172.21.15.134:0/2360494902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70601583e0 con 0x7f706015d5d0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70652c3640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7060062a30 tx=0x7f705800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.549+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705800c610 con 0x7f706015d5d0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.550+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058018070 con 0x7f706015d5d0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.550+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70601586c0 con 0x7f706015d5d0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.550+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705800c9f0 con 0x7f706015d5d0 2024-09-15T22:48:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.550+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706014dc00 con 0x7f706015d5d0 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.551+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70600b5c10 con 0x7f706015d5d0 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.551+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 91458+0+0 (secure 0 0 0) 0x7f705800cb90 con 0x7f706015d5d0 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.552+0000 7f70557fa640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 0x7f704c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.552+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f705808b960 con 0x7f706015d5d0 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.552+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 0x7f704c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.552+0000 7f7064ac2640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 0x7f704c06ee30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f705c035000 tx=0x7f705c02f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.556+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7058059240 con 0x7f706015d5d0 2024-09-15T22:48:04.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.749+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol73620", "target": ["mon-mgr", ""]}) -- 0x7f706015bb60 con 0x7f704c06c970 2024-09-15T22:48:04.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.768+0000 7f70557fa640 1 -- 172.21.15.134:0/2360494902 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f706015bb60 con 0x7f704c06c970 2024-09-15T22:48:04.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 msgr2=0x7f704c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 0x7f704c06ee30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f705c035000 tx=0x7f705c02f000 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 msgr2=0x7f70600cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7060062a30 tx=0x7f705800eb90 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 shutdown_connections 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f704c06c970 0x7f704c06ee30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706015d5d0 0x7f70600cf890 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706014d780 0x7f706015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 --2- 172.21.15.134:0/2360494902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70480039b0 0x7f70601591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 >> 172.21.15.134:0/2360494902 conn(0x7f706006bba0 msgr2=0x7f70600b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 shutdown_connections 2024-09-15T22:48:04.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.771+0000 7f7066d26640 1 -- 172.21.15.134:0/2360494902 wait complete. 2024-09-15T22:48:04.775 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.774+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.775 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.774+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.776 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.774+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.776 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.774+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.776 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.774+0000 7f458b488640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol52911 subvol_grp22580 2024-09-15T22:48:04.790 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.789+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.790 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.789+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.790 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.789+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.790 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.789+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.790 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:04.789+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:04.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.886+0000 7f325c178640 1 Processor -- start 2024-09-15T22:48:04.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.886+0000 7f325c178640 1 -- start start 2024-09-15T22:48:04.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325c178640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32540b4060 0x7f325415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325c178640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254141c40 0x7f325406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325c178640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32540720f0 con 0x7f32540b3c80 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325c178640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f325406d870 con 0x7f32540b4060 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325c178640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f32541421e0 con 0x7f3254141c40 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259713640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32540b4060 0x7f325415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259f14640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f32540b3c80 0x7f325413fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36186/0 (socket says 172.21.15.134:36186) 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259f14640 1 -- 172.21.15.134:0/210056339 learned_addr learned my addr 172.21.15.134:0/210056339 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f325a715640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254141c40 0x7f325406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259713640 1 -- 172.21.15.134:0/210056339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254141c40 msgr2=0x7f325406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259713640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254141c40 0x7f325406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259713640 1 -- 172.21.15.134:0/210056339 >> v1:172.21.15.134:6789/0 conn(0x7f32540b3c80 legacy=0x7f325413fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3259713640 1 -- 172.21.15.134:0/210056339 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541424c0 con 0x7f32540b4060 2024-09-15T22:48:04.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.887+0000 7f3258f12640 1 -- 172.21.15.134:0/210056339 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512099418 0 0) 0x7f32540720f0 con 0x7f32540b3c80 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f3259713640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32540b4060 0x7f325415d4f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f324402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13ac6aaaeaa65f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f3258f12640 1 -- 172.21.15.134:0/210056339 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244037070 con 0x7f32540b4060 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f3258f12640 1 -- 172.21.15.134:0/210056339 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244032440 con 0x7f32540b4060 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f3258f12640 1 -- 172.21.15.134:0/210056339 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244032810 con 0x7f32540b4060 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 -- 172.21.15.134:0/210056339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32540b4060 msgr2=0x7f325415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32540b4060 0x7f325415d4f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f324402a180 comp rx=0 tx=0).stop 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 -- 172.21.15.134:0/210056339 shutdown_connections 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254141c40 0x7f325406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 --2- 172.21.15.134:0/210056339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32540b4060 0x7f325415d4f0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.888+0000 7f325c178640 1 -- 172.21.15.134:0/210056339 >> 172.21.15.134:0/210056339 conn(0x7f3254062810 msgr2=0x7f325406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.889+0000 7f325c178640 1 -- 172.21.15.134:0/210056339 shutdown_connections 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.889+0000 7f325c178640 1 -- 172.21.15.134:0/210056339 wait complete. 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 Processor -- start 2024-09-15T22:48:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 -- start start 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32540b3c80 0x7f325413cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254159360 0x7f3254159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f325406c0e0 con 0x7f3254141c40 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3254142a80 con 0x7f32540b3c80 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.890+0000 7f325c178640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f325406c260 con 0x7f3254159360 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53408/0 (socket says 172.21.15.134:53408) 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 -- 172.21.15.134:0/3049355632 learned_addr learned my addr 172.21.15.134:0/3049355632 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f325a715640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254159360 0x7f3254159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259f14640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32540b3c80 0x7f325413cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 -- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254159360 msgr2=0x7f3254159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254159360 0x7f3254159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 -- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32540b3c80 msgr2=0x7f325413cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32540b3c80 0x7f325413cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 -- 172.21.15.134:0/3049355632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3254144a20 con 0x7f3254141c40 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f3259713640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f32440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244037050 con 0x7f3254141c40 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244038040 con 0x7f3254141c40 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3254144d00 con 0x7f3254141c40 2024-09-15T22:48:04.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244004470 con 0x7f3254141c40 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.891+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3254157140 con 0x7f3254141c40 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.892+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325406bba0 con 0x7f3254141c40 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.893+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 91458+0+0 (secure 0 0 0) 0x7f3244030900 con 0x7f3254141c40 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.893+0000 7f324a7fc640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 0x7f323806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.893+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f32440ac890 con 0x7f3254141c40 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.893+0000 7f3259f14640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 0x7f323806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.894+0000 7f3259f14640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 0x7f323806ee30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3250000f60 tx=0x7f3250007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:04.897+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f324407a290 con 0x7f3254141c40 2024-09-15T22:48:05.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.087+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol52911", "group_name": "subvol_grp22580", "target": ["mon-mgr", ""]}) -- 0x7f325413e270 con 0x7f323806c970 2024-09-15T22:48:05.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.105+0000 7f324a7fc640 1 -- 172.21.15.134:0/3049355632 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f325413e270 con 0x7f323806c970 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 msgr2=0x7f323806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 0x7f323806ee30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3250000f60 tx=0x7f3250007d50 comp rx=0 tx=0).stop 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 msgr2=0x7f32541f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f32440046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 shutdown_connections 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3254159360 0x7f3254159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f323806c970 0x7f323806ee30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3254141c40 0x7f32541f2c20 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 --2- 172.21.15.134:0/3049355632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32540b3c80 0x7f325413cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 >> 172.21.15.134:0/3049355632 conn(0x7f3254062810 msgr2=0x7f325415bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 shutdown_connections 2024-09-15T22:48:05.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.107+0000 7f325c178640 1 -- 172.21.15.134:0/3049355632 wait complete. 2024-09-15T22:48:05.120 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:48:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:05.170 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:48:05.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:05.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp22580 2024-09-15T22:48:05.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.276+0000 7f7102647640 1 Processor -- start 2024-09-15T22:48:05.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.276+0000 7f7102647640 1 -- start start 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7102647640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70fc0b5050 0x7f70fc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7102647640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70fc0b5500 con 0x7f70fc06f130 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7102647640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70fc0b43f0 con 0x7f70fc158e50 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7102647640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f70fc0b3630 con 0x7f70fc0b5050 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7100be4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70fc0b5050 0x7f70fc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f70fb7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f70fc06f130 0x7f70fc0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36194/0 (socket says 172.21.15.134:36194) 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f70fb7fe640 1 -- 172.21.15.134:0/3929745563 learned_addr learned my addr 172.21.15.134:0/3929745563 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f70faffd640 1 -- 172.21.15.134:0/3929745563 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071683372 0 0) 0x7f70f0001290 con 0x7f70fc06f130 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f70faffd640 1 -- 172.21.15.134:0/3929745563 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70e4003520 con 0x7f70fc06f130 2024-09-15T22:48:05.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7100be4640 1 -- 172.21.15.134:0/3929745563 >> v1:172.21.15.177:6789/0 conn(0x7f70fc158e50 legacy=0x7f70fc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:05.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7100be4640 1 -- 172.21.15.134:0/3929745563 >> v1:172.21.15.134:6789/0 conn(0x7f70fc06f130 legacy=0x7f70fc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.277+0000 7f7100be4640 1 -- 172.21.15.134:0/3929745563 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc0b3910 con 0x7f70fc0b5050 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.278+0000 7f7100be4640 1 --2- 172.21.15.134:0/3929745563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc0b5050 0x7f70fc15c370 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009d90 tx=0x7f70f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d422d702a61bd84f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.278+0000 7f70faffd640 1 -- 172.21.15.134:0/3929745563 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4007740 con 0x7f70fc0b5050 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.278+0000 7f70faffd640 1 -- 172.21.15.134:0/3929745563 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f40078e0 con 0x7f70fc0b5050 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.278+0000 7f70faffd640 1 -- 172.21.15.134:0/3929745563 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4007cb0 con 0x7f70fc0b5050 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 -- 172.21.15.134:0/3929745563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc0b5050 msgr2=0x7f70fc15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 --2- 172.21.15.134:0/3929745563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc0b5050 0x7f70fc15c370 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009d90 tx=0x7f70f402a660 comp rx=0 tx=0).stop 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 -- 172.21.15.134:0/3929745563 shutdown_connections 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 --2- 172.21.15.134:0/3929745563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc0b5050 0x7f70fc15c370 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 -- 172.21.15.134:0/3929745563 >> 172.21.15.134:0/3929745563 conn(0x7f70fc06bba0 msgr2=0x7f70fc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:05.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 -- 172.21.15.134:0/3929745563 shutdown_connections 2024-09-15T22:48:05.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.279+0000 7f7102647640 1 -- 172.21.15.134:0/3929745563 wait complete. 2024-09-15T22:48:05.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.280+0000 7f7102647640 1 Processor -- start 2024-09-15T22:48:05.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.280+0000 7f7102647640 1 -- start start 2024-09-15T22:48:05.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b5050 0x7f70fc144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc158e50 0x7f70fc0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc159230 con 0x7f70fc06f130 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc0b3ed0 con 0x7f70fc158e50 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7102647640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70fc0ce910 con 0x7f70fc0b5050 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53422/0 (socket says 172.21.15.134:53422) 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 -- 172.21.15.134:0/2593845393 learned_addr learned my addr 172.21.15.134:0/2593845393 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fb7fe640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b5050 0x7f70fc144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f7100be4640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc158e50 0x7f70fc0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 -- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b5050 msgr2=0x7f70fc144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b5050 0x7f70fc144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 -- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc158e50 msgr2=0x7f70fc0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc158e50 0x7f70fc0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 -- 172.21.15.134:0/2593845393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc145230 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.281+0000 7f70fbfff640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c3f0 tx=0x7f70ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.282+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0052d0 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.282+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec005490 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.282+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec007260 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.282+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc147460 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.282+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc147a20 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.283+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70fc15c370 con 0x7f70fc06f130 2024-09-15T22:48:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.283+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 91458+0+0 (secure 0 0 0) 0x7f70ec007400 con 0x7f70fc06f130 2024-09-15T22:48:05.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.283+0000 7f70f8ff9640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 0x7f70e806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.284+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f70ec08b5f0 con 0x7f70fc06f130 2024-09-15T22:48:05.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.284+0000 7f70fb7fe640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 0x7f70e806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.284+0000 7f70fb7fe640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 0x7f70e806ee30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06e5b0 tx=0x7f70f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.288+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70ec059300 con 0x7f70fc06f130 2024-09-15T22:48:05.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.473+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp22580", "target": ["mon-mgr", ""]}) -- 0x7f70fc06e170 con 0x7f70e806c970 2024-09-15T22:48:05.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.478+0000 7f70f8ff9640 1 -- 172.21.15.134:0/2593845393 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70fc06e170 con 0x7f70e806c970 2024-09-15T22:48:05.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 msgr2=0x7f70e806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 0x7f70e806ee30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06e5b0 tx=0x7f70f0009040 comp rx=0 tx=0).stop 2024-09-15T22:48:05.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 msgr2=0x7f70fc144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c3f0 tx=0x7f70ec00c8b0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 shutdown_connections 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc158e50 0x7f70fc0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b5050 0x7f70fc144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f70e806c970 0x7f70e806ee30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 --2- 172.21.15.134:0/2593845393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70fc06f130 0x7f70fc144650 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 >> 172.21.15.134:0/2593845393 conn(0x7f70fc06bba0 msgr2=0x7f70fc0729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 shutdown_connections 2024-09-15T22:48:05.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.480+0000 7f7102647640 1 -- 172.21.15.134:0/2593845393 wait complete. 2024-09-15T22:48:05.492 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:48:05.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:05.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:05.580 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:48:05.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:05.580 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:05.580 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:05.597 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:05.597 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:05.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:48:05.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.790+0000 7ff8808ac640 1 Processor -- start 2024-09-15T22:48:05.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.790+0000 7ff8808ac640 1 -- start start 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff8808ac640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff87c15e940 0x7ff87c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff8808ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87c0b7170 con 0x7ff87c15ed20 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff8808ac640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87c0b7aa0 con 0x7ff87c0cef90 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff8808ac640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff87c0d3660 con 0x7ff87c15e940 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff87a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff87c15e940 0x7ff87c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff879d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff87c15ed20 0x7ff87c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36204/0 (socket says 172.21.15.134:36204) 2024-09-15T22:48:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.791+0000 7ff879d9b640 1 -- 172.21.15.134:0/2909408542 learned_addr learned my addr 172.21.15.134:0/2909408542 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.792+0000 7ff87a59c640 1 -- 172.21.15.134:0/2909408542 >> v1:172.21.15.177:6789/0 conn(0x7ff87c0cef90 legacy=0x7ff87c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.792+0000 7ff87a59c640 1 -- 172.21.15.134:0/2909408542 >> v1:172.21.15.134:6789/0 conn(0x7ff87c15ed20 legacy=0x7ff87c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.792+0000 7ff87959a640 1 -- 172.21.15.134:0/2909408542 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643791912 0 0) 0x7ff870001110 con 0x7ff87c15ed20 2024-09-15T22:48:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.792+0000 7ff87a59c640 1 -- 172.21.15.134:0/2909408542 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c0d3940 con 0x7ff87c15e940 2024-09-15T22:48:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.792+0000 7ff87a59c640 1 --2- 172.21.15.134:0/2909408542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15e940 0x7ff87c0d1060 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009d90 tx=0x7ff86c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9a457ab62872bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff87959a640 1 -- 172.21.15.134:0/2909408542 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c007740 con 0x7ff87c15e940 2024-09-15T22:48:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff87959a640 1 -- 172.21.15.134:0/2909408542 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c0078e0 con 0x7ff87c15e940 2024-09-15T22:48:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff87959a640 1 -- 172.21.15.134:0/2909408542 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c007cb0 con 0x7ff87c15e940 2024-09-15T22:48:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 -- 172.21.15.134:0/2909408542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15e940 msgr2=0x7ff87c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2909408542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15e940 0x7ff87c0d1060 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009d90 tx=0x7ff86c02a730 comp rx=0 tx=0).stop 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 -- 172.21.15.134:0/2909408542 shutdown_connections 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2909408542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15e940 0x7ff87c0d1060 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 -- 172.21.15.134:0/2909408542 >> 172.21.15.134:0/2909408542 conn(0x7ff87c0b6240 msgr2=0x7ff87c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 -- 172.21.15.134:0/2909408542 shutdown_connections 2024-09-15T22:48:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.793+0000 7ff8808ac640 1 -- 172.21.15.134:0/2909408542 wait complete. 2024-09-15T22:48:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 Processor -- start 2024-09-15T22:48:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 -- start start 2024-09-15T22:48:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff87c0cef90 0x7ff87c1f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff87c15e940 0x7ff87c145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c0d3310 con 0x7ff87c15ed20 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c0d3f00 con 0x7ff87c15e940 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff8808ac640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c0d1ef0 con 0x7ff87c0cef90 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.795+0000 7ff87ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53426/0 (socket says 172.21.15.134:53426) 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 -- 172.21.15.134:0/2074395726 learned_addr learned my addr 172.21.15.134:0/2074395726 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff879d9b640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff87c15e940 0x7ff87c145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 -- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff87c0cef90 msgr2=0x7ff87c1f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff87c0cef90 0x7ff87c1f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 -- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff87c15e940 msgr2=0x7ff87c145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff87c15e940 0x7ff87c145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 -- 172.21.15.134:0/2074395726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c15a880 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff87ad9d640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c390 tx=0x7ff87400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874017070 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8740035f0 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c1f8bd0 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740039e0 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.796+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c1f9190 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.797+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c0d1060 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.797+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7ff87401a070 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.798+0000 7ff86affd640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 0x7ff85c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.798+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7ff874089280 con 0x7ff87c15ed20 2024-09-15T22:48:05.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.798+0000 7ff87a59c640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 0x7ff85c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:05.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.799+0000 7ff87a59c640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 0x7ff85c06ef50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:05.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.802+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8740592e0 con 0x7ff87c15ed20 2024-09-15T22:48:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.981+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff87c15e260 con 0x7ff87c15ed20 2024-09-15T22:48:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.982+0000 7ff86affd640 1 -- 172.21.15.134:0/2074395726 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v146) ==== 80+0+0 (secure 0 0 0) 0x7ff874058be0 con 0x7ff87c15ed20 2024-09-15T22:48:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.983+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 msgr2=0x7ff85c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.983+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 0x7ff85c06ef50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.983+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 msgr2=0x7ff87c161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.983+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c390 tx=0x7ff87400c850 comp rx=0 tx=0).stop 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 shutdown_connections 2024-09-15T22:48:05.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff85c06ca90 0x7ff85c06ef50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff87c15ed20 0x7ff87c161250 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff87c15e940 0x7ff87c145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 --2- 172.21.15.134:0/2074395726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff87c0cef90 0x7ff87c1f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 >> 172.21.15.134:0/2074395726 conn(0x7ff87c0b6240 msgr2=0x7ff87c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 shutdown_connections 2024-09-15T22:48:05.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:05.984+0000 7ff8808ac640 1 -- 172.21.15.134:0/2074395726 wait complete. 2024-09-15T22:48:05.996 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:48:05.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:05.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:06.026 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:48:06.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:06.026 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:48:06.081 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:06.081 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:06.081 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:06.101 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:06.101 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:06.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:48:06.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.258+0000 7f503bec3640 1 Processor -- start 2024-09-15T22:48:06.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.258+0000 7f503bec3640 1 -- start start 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503bec3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f503415e860 0x7f50340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503bec3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50340b8ab0 0x7f50340b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503bec3640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50340d34d0 con 0x7f50340b61f0 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503bec3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f50340b6b80 con 0x7f503415e860 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503bec3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f50340d3790 con 0x7f50340b8ab0 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f503415e860 0x7f50340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f503415e860 0x7f50340cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39572/0 (socket says 172.21.15.134:39572) 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 -- 172.21.15.134:0/2832153452 learned_addr learned my addr 172.21.15.134:0/2832153452 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f503a460640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50340b8ab0 0x7f50340b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 -- 172.21.15.134:0/2832153452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50340b8ab0 msgr2=0x7f50340b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50340b8ab0 0x7f50340b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 -- 172.21.15.134:0/2832153452 >> v1:172.21.15.177:6789/0 conn(0x7f50340b61f0 legacy=0x7f503406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.259+0000 7f5039c5f640 1 -- 172.21.15.134:0/2832153452 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340d3a70 con 0x7f503415e860 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f5039c5f640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f503415e860 0x7f50340cf720 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5030009870 tx=0x7f503002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa69ee9d17bd6507 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f5038c5d640 1 -- 172.21.15.134:0/2832153452 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030037070 con 0x7f503415e860 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f5038c5d640 1 -- 172.21.15.134:0/2832153452 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503002ae50 con 0x7f503415e860 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f5038c5d640 1 -- 172.21.15.134:0/2832153452 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030032860 con 0x7f503415e860 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f503bec3640 1 -- 172.21.15.134:0/2832153452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f503415e860 msgr2=0x7f50340cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.260+0000 7f503bec3640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f503415e860 0x7f50340cf720 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5030009870 tx=0x7f503002a300 comp rx=0 tx=0).stop 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 -- 172.21.15.134:0/2832153452 shutdown_connections 2024-09-15T22:48:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50340b8ab0 0x7f50340b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 --2- 172.21.15.134:0/2832153452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f503415e860 0x7f50340cf720 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 -- 172.21.15.134:0/2832153452 >> 172.21.15.134:0/2832153452 conn(0x7f5034062c60 msgr2=0x7f50340d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 -- 172.21.15.134:0/2832153452 shutdown_connections 2024-09-15T22:48:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.261+0000 7f503bec3640 1 -- 172.21.15.134:0/2832153452 wait complete. 2024-09-15T22:48:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 Processor -- start 2024-09-15T22:48:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 -- start start 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 0x7f50340cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 0x7f5034155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f50340d4310 con 0x7f50340b8ab0 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.262+0000 7f503bec3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f50340d4030 con 0x7f50340b61f0 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503bec3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f503415ec40 con 0x7f503415e860 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39576/0 (socket says 172.21.15.134:39576) 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 -- 172.21.15.134:0/628304384 learned_addr learned my addr 172.21.15.134:0/628304384 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 -- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 msgr2=0x7f5034155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503a460640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 0x7f5034155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f5039c5f640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 0x7f50340cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 0x7f5034155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 -- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 msgr2=0x7f50340cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 0x7f50340cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 -- 172.21.15.134:0/628304384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340ce0a0 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503a460640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 0x7f5034155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f5039c5f640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 0x7f50340cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503945e640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f502400c430 tx=0x7f502400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024017070 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50240052d0 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024003850 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503415f0e0 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.263+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503415f6a0 con 0x7f50340b8ab0 2024-09-15T22:48:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.264+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f503415f8a0 con 0x7f50340b8ab0 2024-09-15T22:48:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.265+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f502401a070 con 0x7f50340b8ab0 2024-09-15T22:48:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.265+0000 7f502a7fc640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 0x7f501806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.265+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f50240891d0 con 0x7f50340b8ab0 2024-09-15T22:48:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.265+0000 7f5039c5f640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 0x7f501806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.266+0000 7f5039c5f640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 0x7f501806ef50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5030034000 tx=0x7f503002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.269+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f503415f8a0 con 0x7f50340b8ab0 2024-09-15T22:48:06.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.445+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f50340b3ad0 con 0x7f50340b8ab0 2024-09-15T22:48:06.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.446+0000 7f502a7fc640 1 -- 172.21.15.134:0/628304384 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v146) ==== 80+0+0 (secure 0 0 0) 0x7f5024059230 con 0x7f50340b8ab0 2024-09-15T22:48:06.447 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 msgr2=0x7f501806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 0x7f501806ef50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5030034000 tx=0x7f503002e000 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 msgr2=0x7f50340c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f502400c430 tx=0x7f502400c8f0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 shutdown_connections 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f503415e860 0x7f5034155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f501806ca90 0x7f501806ef50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50340b8ab0 0x7f50340c81d0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 --2- 172.21.15.134:0/628304384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50340b61f0 0x7f50340cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 >> 172.21.15.134:0/628304384 conn(0x7f5034062c60 msgr2=0x7f50340b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:06.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 shutdown_connections 2024-09-15T22:48:06.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.448+0000 7f503bec3640 1 -- 172.21.15.134:0/628304384 wait complete. 2024-09-15T22:48:06.461 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:48:06.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:06.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:06.493 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:48:06.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:06.494 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:48:06.551 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:06.551 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:06.551 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:06.567 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:06.567 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:06.567 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:06.567 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:06.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:06.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:06.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.705+0000 7fd04052c640 1 Processor -- start 2024-09-15T22:48:06.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.705+0000 7fd04052c640 1 -- start start 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd04052c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd03815ceb0 0x7fd0381594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd04052c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03815d390 con 0x7fd0380d02a0 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd04052c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03815d670 con 0x7fd03815ca40 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd04052c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd03815d950 con 0x7fd03815ceb0 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd03e2c8640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd0380d02a0 0x7fd0380d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50350/0 (socket says 172.21.15.134:50350) 2024-09-15T22:48:06.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd03e2c8640 1 -- 172.21.15.134:0/758874332 learned_addr learned my addr 172.21.15.134:0/758874332 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd03eac9640 1 --2- 172.21.15.134:0/758874332 >> v2:172.21.15.177:3300/0 conn(0x7fd03815ceb0 0x7fd0381594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437283267 0 0) 0x7fd03815d390 con 0x7fd0380d02a0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.706+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd024003520 con 0x7fd0380d02a0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777139283 0 0) 0x7fd03815d670 con 0x7fd03815ca40 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03815d390 con 0x7fd03815ca40 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3053688072 0 0) 0x7fd024003520 con 0x7fd0380d02a0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 >> v2:172.21.15.177:3300/0 conn(0x7fd03815ceb0 msgr2=0x7fd0381594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 --2- 172.21.15.134:0/758874332 >> v2:172.21.15.177:3300/0 conn(0x7fd03815ceb0 0x7fd0381594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 >> v1:172.21.15.177:6789/0 conn(0x7fd03815ca40 legacy=0x7fd03815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03815dc30 con 0x7fd0380d02a0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd034001670 con 0x7fd0380d02a0 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 >> v1:172.21.15.134:6789/0 conn(0x7fd0380d02a0 legacy=0x7fd0380d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 0x7fd024003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024004800 0x7fd024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd024005210 0x7fd02400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd03815d950 con 0x7fd024003b90 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd02400c140 con 0x7fd024005210 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd02400c340 con 0x7fd024004800 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03eac9640 1 --2- 172.21.15.134:0/758874332 >> v2:172.21.15.177:3300/0 conn(0x7fd03815ceb0 0x7fd0381594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 0x7fd024003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03dac7640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024004800 0x7fd024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03eac9640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd024005210 0x7fd02400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 -- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024004800 msgr2=0x7fd024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024004800 0x7fd024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 -- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd024005210 msgr2=0x7fd02400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd024005210 0x7fd02400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03e2c8640 1 -- 172.21.15.134:0/758874332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd024003520 con 0x7fd024003b90 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03eac9640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd024005210 0x7fd02400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.707+0000 7fd03eac9640 1 -- 172.21.15.134:0/758874332 reap_dead start 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 0x7fd024003f90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c0e0 tx=0x7fd024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4c81111e2aa9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034007c40 con 0x7fd024003b90 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd034005ad0 con 0x7fd024003b90 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd03d2c6640 1 -- 172.21.15.134:0/758874332 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034007070 con 0x7fd024003b90 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd04052c640 1 -- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 msgr2=0x7fd024003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.708+0000 7fd04052c640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 0x7fd024003f90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c0e0 tx=0x7fd024005830 comp rx=0 tx=0).stop 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.709+0000 7fd04052c640 1 -- 172.21.15.134:0/758874332 shutdown_connections 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.709+0000 7fd04052c640 1 --2- 172.21.15.134:0/758874332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd024003b90 0x7fd024003f90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.709+0000 7fd04052c640 1 -- 172.21.15.134:0/758874332 >> 172.21.15.134:0/758874332 conn(0x7fd038062cc0 msgr2=0x7fd03806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.709+0000 7fd04052c640 1 -- 172.21.15.134:0/758874332 shutdown_connections 2024-09-15T22:48:06.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.709+0000 7fd04052c640 1 -- 172.21.15.134:0/758874332 wait complete. 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.710+0000 7fd04052c640 1 Processor -- start 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.710+0000 7fd04052c640 1 -- start start 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024003b90 0x7fd03814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0381f4c20 0x7fd0381f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd038155d10 con 0x7fd0381f4280 2024-09-15T22:48:06.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd038155b90 con 0x7fd0381f4c20 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd0380b4790 con 0x7fd024003b90 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39596/0 (socket says 172.21.15.134:39596) 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 -- 172.21.15.134:0/442471617 learned_addr learned my addr 172.21.15.134:0/442471617 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024003b90 0x7fd03814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03eac9640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0381f4c20 0x7fd0381f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 -- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024003b90 msgr2=0x7fd03814bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024003b90 0x7fd03814bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 -- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0381f4c20 msgr2=0x7fd0381f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0381f4c20 0x7fd0381f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 -- 172.21.15.134:0/442471617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0380ab080 con 0x7fd0381f4280 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd03dac7640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fd02800e570 tx=0x7fd02800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280052e0 con 0x7fd0381f4280 2024-09-15T22:48:06.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd028018070 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028003830 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0380ab360 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.711+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03815ad70 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.712+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03815af70 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.713+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fd0280039d0 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.713+0000 7fd02effd640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 0x7fd01c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.713+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fd028089990 con 0x7fd0381f4280 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.713+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 0x7fd01c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.714+0000 7fd03e2c8640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 0x7fd01c06ef80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd034032000 tx=0x7fd03402d000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:06.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.717+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd03815af70 con 0x7fd0381f4280 2024-09-15T22:48:06.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.917+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0380d0680 con 0x7fd0381f4280 2024-09-15T22:48:06.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.917+0000 7fd02effd640 1 -- 172.21.15.134:0/442471617 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5236 (secure 0 0 0) 0x7fd0280593a0 con 0x7fd0381f4280 2024-09-15T22:48:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:06.919 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"btime":"2024-09-15T22:47:55:559965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:48:06.919 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 76 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 msgr2=0x7fd01c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 0x7fd01c06ef80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd034032000 tx=0x7fd03402d000 comp rx=0 tx=0).stop 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 msgr2=0x7fd0381f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fd02800e570 tx=0x7fd02800ea30 comp rx=0 tx=0).stop 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 shutdown_connections 2024-09-15T22:48:06.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0381f4c20 0x7fd0381f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd01c06cac0 0x7fd01c06ef80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0381f4280 0x7fd0381f46e0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 --2- 172.21.15.134:0/442471617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd024003b90 0x7fd03814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.919+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 >> 172.21.15.134:0/442471617 conn(0x7fd038062cc0 msgr2=0x7fd0380b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.920+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 shutdown_connections 2024-09-15T22:48:06.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:06.920+0000 7fd04052c640 1 -- 172.21.15.134:0/442471617 wait complete. 2024-09-15T22:48:06.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:07.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.029+0000 7fe9602e6640 1 Processor -- start 2024-09-15T22:48:07.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.029+0000 7fe9602e6640 1 -- start start 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe9602e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 0x7fe95815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe9602e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe95806e570 0x7fe9580712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe9602e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95815fbf0 con 0x7fe9580b6a20 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe9602e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe9580b7870 con 0x7fe95806e570 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe9602e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580708a0 con 0x7fe95815c250 2024-09-15T22:48:07.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe95d881640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe95806e570 0x7fe9580712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.030+0000 7fe95d881640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe95806e570 0x7fe9580712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39612/0 (socket says 172.21.15.134:39612) 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 -- 172.21.15.134:0/2116218261 learned_addr learned my addr 172.21.15.134:0/2116218261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95e082640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 0x7fe95815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 -- 172.21.15.134:0/2116218261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 msgr2=0x7fe95815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 0x7fe95815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 -- 172.21.15.134:0/2116218261 >> v1:172.21.15.177:6789/0 conn(0x7fe9580b6a20 legacy=0x7fe9580b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 -- 172.21.15.134:0/2116218261 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe958071830 con 0x7fe95806e570 2024-09-15T22:48:07.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95e082640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 0x7fe95815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:07.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.031+0000 7fe95d881640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95806e570 0x7fe9580712f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe948009870 tx=0x7fe94802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72375ee8d99467c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe95d080640 1 -- 172.21.15.134:0/2116218261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948037070 con 0x7fe95806e570 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe95d080640 1 -- 172.21.15.134:0/2116218261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe948032440 con 0x7fe95806e570 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe95d080640 1 -- 172.21.15.134:0/2116218261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948032810 con 0x7fe95806e570 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 -- 172.21.15.134:0/2116218261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95806e570 msgr2=0x7fe9580712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95806e570 0x7fe9580712f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe948009870 tx=0x7fe94802a210 comp rx=0 tx=0).stop 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 -- 172.21.15.134:0/2116218261 shutdown_connections 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95806e570 0x7fe9580712f0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 --2- 172.21.15.134:0/2116218261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95815c250 0x7fe95815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 -- 172.21.15.134:0/2116218261 >> 172.21.15.134:0/2116218261 conn(0x7fe9580b4220 msgr2=0x7fe9580b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 -- 172.21.15.134:0/2116218261 shutdown_connections 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.032+0000 7fe9602e6640 1 -- 172.21.15.134:0/2116218261 wait complete. 2024-09-15T22:48:07.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.033+0000 7fe9602e6640 1 Processor -- start 2024-09-15T22:48:07.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.033+0000 7fe9602e6640 1 -- start start 2024-09-15T22:48:07.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95806e570 0x7fe958151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9580b6a20 0x7fe958151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe95806ecf0 con 0x7fe95815c250 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe958070e60 con 0x7fe9580b6a20 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe9602e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe958070af0 con 0x7fe95806e570 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39614/0 (socket says 172.21.15.134:39614) 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 -- 172.21.15.134:0/771898843 learned_addr learned my addr 172.21.15.134:0/771898843 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e082640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95806e570 0x7fe958151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95d881640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9580b6a20 0x7fe958151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 -- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95806e570 msgr2=0x7fe958151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95806e570 0x7fe958151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 -- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9580b6a20 msgr2=0x7fe958151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9580b6a20 0x7fe958151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.034+0000 7fe95e883640 1 -- 172.21.15.134:0/771898843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581555e0 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe95e883640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c780 tx=0x7fe95000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950004b60 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950004d00 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95000aa90 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95815c8b0 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.035+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95815ce70 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.036+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9580712f0 con 0x7fe95815c250 2024-09-15T22:48:07.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.036+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fe95000ac30 con 0x7fe95815c250 2024-09-15T22:48:07.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.037+0000 7fe94effd640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 0x7fe93c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.037+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fe950089f60 con 0x7fe95815c250 2024-09-15T22:48:07.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.037+0000 7fe95e082640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 0x7fe93c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.038+0000 7fe95e082640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 0x7fe93c06ef50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe958155260 tx=0x7fe954008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.041+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe950020070 con 0x7fe95815c250 2024-09-15T22:48:07.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.241+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9580b7650 con 0x7fe95815c250 2024-09-15T22:48:07.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.241+0000 7fe94effd640 1 -- 172.21.15.134:0/771898843 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5236 (secure 0 0 0) 0x7fe9581555e0 con 0x7fe95815c250 2024-09-15T22:48:07.243 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:07.243 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"btime":"2024-09-15T22:47:55:559965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:48:07.243 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 76 2024-09-15T22:48:07.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 msgr2=0x7fe93c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 0x7fe93c06ef50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe958155260 tx=0x7fe954008040 comp rx=0 tx=0).stop 2024-09-15T22:48:07.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 msgr2=0x7fe95815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c780 tx=0x7fe95000cc40 comp rx=0 tx=0).stop 2024-09-15T22:48:07.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 shutdown_connections 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe93c06ca90 0x7fe93c06ef50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe95815c250 0x7fe95815d670 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9580b6a20 0x7fe958151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 --2- 172.21.15.134:0/771898843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe95806e570 0x7fe958151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.243+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 >> 172.21.15.134:0/771898843 conn(0x7fe9580b4220 msgr2=0x7fe95815b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.244+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 shutdown_connections 2024-09-15T22:48:07.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.244+0000 7fe9602e6640 1 -- 172.21.15.134:0/771898843 wait complete. 2024-09-15T22:48:07.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:07.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.352+0000 7fb576eaf640 1 Processor -- start 2024-09-15T22:48:07.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.352+0000 7fb576eaf640 1 -- start start 2024-09-15T22:48:07.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb576eaf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb57015ca40 0x7fb57015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb576eaf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb57015ceb0 0x7fb5701594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb576eaf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb57015d390 con 0x7fb5700d02a0 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb576eaf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb57015d670 con 0x7fb57015ceb0 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb576eaf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb57015d950 con 0x7fb57015ca40 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb57544c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb57015ceb0 0x7fb5701594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb57544c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb57015ceb0 0x7fb5701594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39626/0 (socket says 172.21.15.134:39626) 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.353+0000 7fb57544c640 1 -- 172.21.15.134:0/1962657833 learned_addr learned my addr 172.21.15.134:0/1962657833 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb57544c640 1 -- 172.21.15.134:0/1962657833 >> v2:172.21.15.177:3300/0 conn(0x7fb57015ca40 msgr2=0x7fb57015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb57544c640 1 --2- 172.21.15.134:0/1962657833 >> v2:172.21.15.177:3300/0 conn(0x7fb57015ca40 0x7fb57015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb57544c640 1 -- 172.21.15.134:0/1962657833 >> v1:172.21.15.177:6789/0 conn(0x7fb5700d02a0 legacy=0x7fb5700d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb57544c640 1 -- 172.21.15.134:0/1962657833 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57015dc30 con 0x7fb57015ceb0 2024-09-15T22:48:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb57544c640 1 --2- 172.21.15.134:0/1962657833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57015ceb0 0x7fb5701594c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fb5700cf320 tx=0x7fb56802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72218baa2860292 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb56f7fe640 1 -- 172.21.15.134:0/1962657833 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568036070 con 0x7fb57015ceb0 2024-09-15T22:48:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb56f7fe640 1 -- 172.21.15.134:0/1962657833 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568031600 con 0x7fb57015ceb0 2024-09-15T22:48:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.354+0000 7fb56f7fe640 1 -- 172.21.15.134:0/1962657833 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5680319d0 con 0x7fb57015ceb0 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 -- 172.21.15.134:0/1962657833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57015ceb0 msgr2=0x7fb5701594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 --2- 172.21.15.134:0/1962657833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57015ceb0 0x7fb5701594c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fb5700cf320 tx=0x7fb56802a660 comp rx=0 tx=0).stop 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 -- 172.21.15.134:0/1962657833 shutdown_connections 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 --2- 172.21.15.134:0/1962657833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57015ceb0 0x7fb5701594c0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 --2- 172.21.15.134:0/1962657833 >> v2:172.21.15.177:3300/0 conn(0x7fb57015ca40 0x7fb57015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 -- 172.21.15.134:0/1962657833 >> 172.21.15.134:0/1962657833 conn(0x7fb570062cc0 msgr2=0x7fb57006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 -- 172.21.15.134:0/1962657833 shutdown_connections 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.355+0000 7fb576eaf640 1 -- 172.21.15.134:0/1962657833 wait complete. 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.356+0000 7fb576eaf640 1 Processor -- start 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.356+0000 7fb576eaf640 1 -- start start 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb57015ca40 0x7fb57014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 0x7fb5701ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb570155d10 con 0x7fb5700d02a0 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb570155b90 con 0x7fb57015ca40 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb576eaf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb5700b4790 con 0x7fb57015ceb0 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39640/0 (socket says 172.21.15.134:39640) 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 -- 172.21.15.134:0/3610469802 learned_addr learned my addr 172.21.15.134:0/3610469802 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb56ffff640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb57015ca40 0x7fb57014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb57544c640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 0x7fb5701ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 -- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 msgr2=0x7fb5701ef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 0x7fb5701ef410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 -- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb57015ca40 msgr2=0x7fb57014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb57015ca40 0x7fb57014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb574c4b640 1 -- 172.21.15.134:0/3610469802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57014d690 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.357+0000 7fb57544c640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 0x7fb5701ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb574c4b640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fb56400b3e0 tx=0x7fb56400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564015020 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb564011850 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57014d970 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564011c40 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.358+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57014df30 con 0x7fb5700d02a0 2024-09-15T22:48:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.359+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5700d0680 con 0x7fb5700d02a0 2024-09-15T22:48:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.359+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb564018020 con 0x7fb5700d02a0 2024-09-15T22:48:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.360+0000 7fb56d7fa640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 0x7fb55406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.360+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fb564089d90 con 0x7fb5700d02a0 2024-09-15T22:48:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.360+0000 7fb56ffff640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 0x7fb55406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.361+0000 7fb56ffff640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 0x7fb55406ef50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5700734b0 tx=0x7fb55c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.364+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb56401f020 con 0x7fb5700d02a0 2024-09-15T22:48:07.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.535+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb57006ca90 con 0x7fb5700d02a0 2024-09-15T22:48:07.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.536+0000 7fb56d7fa640 1 -- 172.21.15.134:0/3610469802 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16864 (secure 0 0 0) 0x7fb5640172c0 con 0x7fb5700d02a0 2024-09-15T22:48:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:07.538 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":146,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:44.502033+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:41.447309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:41.798619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.538+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 msgr2=0x7fb55406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.538+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 0x7fb55406ef50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5700734b0 tx=0x7fb55c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.538+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 msgr2=0x7fb5701f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.538+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fb56400b3e0 tx=0x7fb56400b8a0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 shutdown_connections 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb57015ceb0 0x7fb5701ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb57015ca40 0x7fb57014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb55406ca90 0x7fb55406ef50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 --2- 172.21.15.134:0/3610469802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700d02a0 0x7fb5701f2f10 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 >> 172.21.15.134:0/3610469802 conn(0x7fb570062cc0 msgr2=0x7fb570154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 shutdown_connections 2024-09-15T22:48:07.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.539+0000 7fb576eaf640 1 -- 172.21.15.134:0/3610469802 wait complete. 2024-09-15T22:48:07.551 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:48:07.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:07.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.652+0000 7fd4e6077640 1 Processor -- start 2024-09-15T22:48:07.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.652+0000 7fd4e6077640 1 -- start start 2024-09-15T22:48:07.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4e6077640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd4e006f1e0 0x7fd4e0169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4e6077640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e015ecf0 con 0x7fd4e015c300 2024-09-15T22:48:07.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4e6077640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e015c6e0 con 0x7fd4e00cd300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4e6077640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e015efb0 con 0x7fd4e006f1e0 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4df7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd4e015c300 0x7fd4e00affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50366/0 (socket says 172.21.15.134:50366) 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4df7fe640 1 -- 172.21.15.134:0/1858144266 learned_addr learned my addr 172.21.15.134:0/1858144266 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883526906 0 0) 0x7fd4e015ecf0 con 0x7fd4e015c300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4cc003520 con 0x7fd4e015c300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4dffff640 1 --2- 172.21.15.134:0/1858144266 >> v2:172.21.15.177:3300/0 conn(0x7fd4e006f1e0 0x7fd4e0169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039697414 0 0) 0x7fd4cc003520 con 0x7fd4e015c300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 >> v2:172.21.15.177:3300/0 conn(0x7fd4e006f1e0 msgr2=0x7fd4e0169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 --2- 172.21.15.134:0/1858144266 >> v2:172.21.15.177:3300/0 conn(0x7fd4e006f1e0 0x7fd4e0169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 >> v1:172.21.15.177:6789/0 conn(0x7fd4e00cd300 legacy=0x7fd4e006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e015f290 con 0x7fd4e015c300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd4d0001670 con 0x7fd4e015c300 2024-09-15T22:48:07.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 >> v1:172.21.15.134:6789/0 conn(0x7fd4e015c300 legacy=0x7fd4e00affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4cc0052e0 0x7fd4cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e015efb0 con 0x7fd4cc004800 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc00c1b0 con 0x7fd4cc0052e0 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4cc00c3b0 con 0x7fd4cc0039b0 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4df7fe640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.653+0000 7fd4dffff640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4cc0052e0 0x7fd4cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 -- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc0039b0 msgr2=0x7fd4cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 -- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4cc0052e0 msgr2=0x7fd4cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4cc0052e0 0x7fd4cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 -- 172.21.15.134:0/1858144266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc003520 con 0x7fd4cc004800 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4dffff640 1 -- 172.21.15.134:0/1858144266 reap_dead start 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001720 tx=0x7fd4cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce33b26c0f423b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.654+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8001370 con 0x7fd4cc004800 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c80052d0 con 0x7fd4cc004800 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4deffd640 1 -- 172.21.15.134:0/1858144266 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c802ab90 con 0x7fd4cc004800 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 -- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 msgr2=0x7fd4cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001720 tx=0x7fd4cc005830 comp rx=0 tx=0).stop 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 -- 172.21.15.134:0/1858144266 shutdown_connections 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 --2- 172.21.15.134:0/1858144266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 -- 172.21.15.134:0/1858144266 >> 172.21.15.134:0/1858144266 conn(0x7fd4e006cae0 msgr2=0x7fd4e006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 -- 172.21.15.134:0/1858144266 shutdown_connections 2024-09-15T22:48:07.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.655+0000 7fd4e6077640 1 -- 172.21.15.134:0/1858144266 wait complete. 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.656+0000 7fd4e6077640 1 Processor -- start 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.656+0000 7fd4e6077640 1 -- start start 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc004800 0x7fd4e00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4e0146490 0x7fd4e0146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0071880 con 0x7fd4e00cfac0 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e015f850 con 0x7fd4e0146490 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4e6077640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e006ead0 con 0x7fd4cc004800 2024-09-15T22:48:07.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39670/0 (socket says 172.21.15.134:39670) 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 -- 172.21.15.134:0/2662300555 learned_addr learned my addr 172.21.15.134:0/2662300555 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 -- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc004800 msgr2=0x7fd4e00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc004800 0x7fd4e00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 -- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4e0146490 msgr2=0x7fd4e0146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4e0146490 0x7fd4e0146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.657+0000 7fd4d7fff640 1 -- 172.21.15.134:0/2662300555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e015d550 con 0x7fd4e00cfac0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4d7fff640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001840 tx=0x7fd4c8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8037040 con 0x7fd4e00cfac0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c8005480 con 0x7fd4e00cfac0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e015d830 con 0x7fd4e00cfac0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8007a30 con 0x7fd4e00cfac0 2024-09-15T22:48:07.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.658+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e015ddf0 con 0x7fd4e00cfac0 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.659+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e006ee00 con 0x7fd4e00cfac0 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.659+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fd4c8043020 con 0x7fd4e00cfac0 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.660+0000 7fd4dcff9640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 0x7fd4c006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.660+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fd4c80a9150 con 0x7fd4e00cfac0 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.660+0000 7fd4df7fe640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 0x7fd4c006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.660+0000 7fd4df7fe640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 0x7fd4c006ef50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0001b80 tx=0x7fd4d0001c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.664+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4c804a020 con 0x7fd4e00cfac0 2024-09-15T22:48:07.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.863+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4e00af4b0 con 0x7fd4e00cfac0 2024-09-15T22:48:07.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.863+0000 7fd4dcff9640 1 -- 172.21.15.134:0/2662300555 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5236 (secure 0 0 0) 0x7fd4c8079120 con 0x7fd4e00cfac0 2024-09-15T22:48:07.865 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:07.865 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"btime":"2024-09-15T22:47:55:559965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:48:07.865 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 76 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 msgr2=0x7fd4c006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 0x7fd4c006ef50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0001b80 tx=0x7fd4d0001c10 comp rx=0 tx=0).stop 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 msgr2=0x7fd4e00cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001840 tx=0x7fd4c8001120 comp rx=0 tx=0).stop 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 shutdown_connections 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4e0146490 0x7fd4e0146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd4c006ca90 0x7fd4c006ef50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e00cfac0 0x7fd4e00cff20 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 --2- 172.21.15.134:0/2662300555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4cc004800 0x7fd4e00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 >> 172.21.15.134:0/2662300555 conn(0x7fd4e006cae0 msgr2=0x7fd4e00b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 shutdown_connections 2024-09-15T22:48:07.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.865+0000 7fd4e6077640 1 -- 172.21.15.134:0/2662300555 wait complete. 2024-09-15T22:48:07.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:07.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.975+0000 7fb68adfd640 1 Processor -- start 2024-09-15T22:48:07.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.975+0000 7fb68adfd640 1 -- start start 2024-09-15T22:48:07.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68adfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb6840cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68adfd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6840cd5f0 con 0x7fb68406c1f0 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68adfd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6840cd8d0 con 0x7fb68406be10 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68adfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840cdbb0 con 0x7fb684151c50 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68939a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb68406c1f0 0x7fb684164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50372/0 (socket says 172.21.15.134:50372) 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb68939a640 1 -- 172.21.15.134:0/4247326126 learned_addr learned my addr 172.21.15.134:0/4247326126 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67bfff640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb6840cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902731026 0 0) 0x7fb6840cd5f0 con 0x7fb68406c1f0 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb66c004630 con 0x7fb68406c1f0 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 191873039 0 0) 0x7fb66c004630 con 0x7fb68406c1f0 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 msgr2=0x7fb6840cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb6840cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 >> v1:172.21.15.177:6789/0 conn(0x7fb68406be10 legacy=0x7fb684151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840cde90 con 0x7fb68406c1f0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.976+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb67c0019f0 con 0x7fb68406c1f0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 >> v1:172.21.15.134:6789/0 conn(0x7fb68406c1f0 legacy=0x7fb684164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c004af0 0x7fb66c004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb66c005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb66c005e50 0x7fb66c0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840cdbb0 con 0x7fb66c005e50 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c00cbb0 con 0x7fb66c004af0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c00cdb0 con 0x7fb684151c50 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb66c005e50 0x7fb66c0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb688b99640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c004af0 0x7fb66c004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb67bfff640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb66c005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 -- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 msgr2=0x7fb66c005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb684151c50 0x7fb66c005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 -- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c004af0 msgr2=0x7fb66c004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c004af0 0x7fb66c004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.977+0000 7fb68939a640 1 -- 172.21.15.134:0/4247326126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c004630 con 0x7fb66c005e50 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68939a640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb66c005e50 0x7fb66c0062d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00a810 tx=0x7fb66c006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b75810e1101d5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00a460 con 0x7fb66c005e50 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c02f070 con 0x7fb66c005e50 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb67b7fe640 1 -- 172.21.15.134:0/4247326126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c02bc90 con 0x7fb66c005e50 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 -- 172.21.15.134:0/4247326126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb66c005e50 msgr2=0x7fb66c0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 --2- 172.21.15.134:0/4247326126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb66c005e50 0x7fb66c0062d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00a810 tx=0x7fb66c006940 comp rx=0 tx=0).stop 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68939a640 1 -- 172.21.15.134:0/4247326126 reap_dead start 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 -- 172.21.15.134:0/4247326126 shutdown_connections 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 -- 172.21.15.134:0/4247326126 >> 172.21.15.134:0/4247326126 conn(0x7fb684062cc0 msgr2=0x7fb68406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 -- 172.21.15.134:0/4247326126 shutdown_connections 2024-09-15T22:48:07.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.978+0000 7fb68adfd640 1 -- 172.21.15.134:0/4247326126 wait complete. 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.979+0000 7fb68adfd640 1 Processor -- start 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 -- start start 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 0x7fb68414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 0x7fb684072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840cd010 con 0x7fb6841f08f0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840ce690 con 0x7fb66c005e50 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb68adfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840cd190 con 0x7fb68415bcb0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.980+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39682/0 (socket says 172.21.15.134:39682) 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 -- 172.21.15.134:0/1223061646 learned_addr learned my addr 172.21.15.134:0/1223061646 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb68939a640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 0x7fb684072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb688b99640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 0x7fb68414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 -- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 msgr2=0x7fb684072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 0x7fb684072a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 -- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 msgr2=0x7fb68414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 0x7fb68414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 -- 172.21.15.134:0/1223061646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68414d0f0 con 0x7fb6841f08f0 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb68939a640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 0x7fb684072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb688b99640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 0x7fb68414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb67bfff640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fb6740119a0 tx=0x7fb674011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67400fa90 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67400fc30 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674014440 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68415c4e0 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.981+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68415caa0 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.982+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68415baa0 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.983+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb674012040 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.983+0000 7fb6797fa640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 0x7fb67006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.983+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fb67408a420 con 0x7fb6841f08f0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.983+0000 7fb688b99640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 0x7fb67006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.984+0000 7fb688b99640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 0x7fb67006ef80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb6800035f0 tx=0x7fb680009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:07.987+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb68414d0f0 con 0x7fb6841f08f0 2024-09-15T22:48:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.183+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6840b0f10 con 0x7fb6841f08f0 2024-09-15T22:48:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.183+0000 7fb6797fa640 1 -- 172.21.15.134:0/1223061646 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5236 (secure 0 0 0) 0x7fb674019030 con 0x7fb6841f08f0 2024-09-15T22:48:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:08.185 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":76,"btime":"2024-09-15T22:47:55:559965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:47:42.826823+0000","modified":"2024-09-15T22:47:44.843147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/2960551881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2960551881},{"type":"v1","addr":"172.21.15.134:6835","nonce":2960551881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8250,"qdb_cluster":[8250]},"id":11}]} 2024-09-15T22:48:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 76 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.185+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 msgr2=0x7fb67006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.185+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 0x7fb67006ef80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb6800035f0 tx=0x7fb680009040 comp rx=0 tx=0).stop 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.185+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 msgr2=0x7fb68415d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.185+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fb6740119a0 tx=0x7fb674011e60 comp rx=0 tx=0).stop 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 shutdown_connections 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb68415bcb0 0x7fb684072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb67006cac0 0x7fb67006ef80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6841f08f0 0x7fb68415d790 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 --2- 172.21.15.134:0/1223061646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb66c005e50 0x7fb68414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 >> 172.21.15.134:0/1223061646 conn(0x7fb684062cc0 msgr2=0x7fb6840b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 shutdown_connections 2024-09-15T22:48:08.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.186+0000 7fb68adfd640 1 -- 172.21.15.134:0/1223061646 wait complete. 2024-09-15T22:48:08.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:08.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.295+0000 7fe731d3b640 1 Processor -- start 2024-09-15T22:48:08.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.295+0000 7fe731d3b640 1 -- start start 2024-09-15T22:48:08.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe731d3b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe72c073830 0x7fe72c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe731d3b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c0ce740 con 0x7fe72c0cf070 2024-09-15T22:48:08.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe731d3b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c072640 con 0x7fe72c15c180 2024-09-15T22:48:08.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe731d3b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe72c072920 con 0x7fe72c073830 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe72affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe72c0cf070 0x7fe72c073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50380/0 (socket says 172.21.15.134:50380) 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe72affd640 1 -- 172.21.15.134:0/450405974 learned_addr learned my addr 172.21.15.134:0/450405974 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe72bfff640 1 --2- 172.21.15.134:0/450405974 >> v2:172.21.15.177:3300/0 conn(0x7fe72c073830 0x7fe72c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.296+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669637042 0 0) 0x7fe72c0ce740 con 0x7fe72c0cf070 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe714003520 con 0x7fe72c0cf070 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1841706326 0 0) 0x7fe714003520 con 0x7fe72c0cf070 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 >> v2:172.21.15.177:3300/0 conn(0x7fe72c073830 msgr2=0x7fe72c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 --2- 172.21.15.134:0/450405974 >> v2:172.21.15.177:3300/0 conn(0x7fe72c073830 0x7fe72c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 >> v1:172.21.15.177:6789/0 conn(0x7fe72c15c180 legacy=0x7fe72c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c072c00 con 0x7fe72c0cf070 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fe720001670 con 0x7fe72c0cf070 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72bfff640 1 --2- 172.21.15.134:0/450405974 >> v2:172.21.15.177:3300/0 conn(0x7fe72c073830 0x7fe72c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:08.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 >> v1:172.21.15.134:6789/0 conn(0x7fe72c0cf070 legacy=0x7fe72c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 0x7fe714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe714004800 0x7fe714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140051c0 0x7fe71400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c072920 con 0x7fe7140039b0 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe71400c160 con 0x7fe714004800 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe71400c360 con 0x7fe7140051c0 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 0x7fe714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72affd640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe714004800 0x7fe714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72bfff640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140051c0 0x7fe71400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 -- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140051c0 msgr2=0x7fe71400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140051c0 0x7fe71400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 -- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe714004800 msgr2=0x7fe714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe714004800 0x7fe714004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72b7fe640 1 -- 172.21.15.134:0/450405974 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe714003520 con 0x7fe7140039b0 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72bfff640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140051c0 0x7fe71400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.297+0000 7fe72bfff640 1 -- 172.21.15.134:0/450405974 reap_dead start 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.298+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 0x7fe714003dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe71c001750 tx=0x7fe714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5835f83c9da21811 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.298+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c001370 con 0x7fe7140039b0 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.298+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c0052d0 con 0x7fe7140039b0 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.298+0000 7fe72a7fc640 1 -- 172.21.15.134:0/450405974 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c02abc0 con 0x7fe7140039b0 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 -- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 msgr2=0x7fe714003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 0x7fe714003dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe71c001750 tx=0x7fe714005830 comp rx=0 tx=0).stop 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 -- 172.21.15.134:0/450405974 shutdown_connections 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 --2- 172.21.15.134:0/450405974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7140039b0 0x7fe714003dd0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 -- 172.21.15.134:0/450405974 >> 172.21.15.134:0/450405974 conn(0x7fe72c062cc0 msgr2=0x7fe72c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 -- 172.21.15.134:0/450405974 shutdown_connections 2024-09-15T22:48:08.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.299+0000 7fe731d3b640 1 -- 172.21.15.134:0/450405974 wait complete. 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.300+0000 7fe731d3b640 1 Processor -- start 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.300+0000 7fe731d3b640 1 -- start start 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 0x7fe72c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 0x7fe72c0ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c15c560 con 0x7fe72c0aa540 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c0722f0 con 0x7fe72c0ae730 2024-09-15T22:48:08.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c15c6e0 con 0x7fe7140039b0 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39704/0 (socket says 172.21.15.134:39704) 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 -- 172.21.15.134:0/1126061503 learned_addr learned my addr 172.21.15.134:0/1126061503 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 0x7fe72c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72bfff640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 0x7fe72c0ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 -- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 msgr2=0x7fe72c14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 0x7fe72c14bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 -- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 msgr2=0x7fe72c0ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 0x7fe72c0ac190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 -- 172.21.15.134:0/1126061503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c0aebf0 con 0x7fe72c0aa540 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 0x7fe72c14bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72bfff640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 0x7fe72c0ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe72affd640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe720007340 tx=0x7fe720007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000f8c0 con 0x7fe72c0aa540 2024-09-15T22:48:08.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720018070 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c0aeed0 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000fca0 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.301+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c0af490 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.302+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c0cf4e0 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.303+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fe72001d460 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.303+0000 7fe713fff640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 0x7fe71806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.303+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7fe72008c6c0 con 0x7fe72c0aa540 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.304+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 0x7fe71806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.304+0000 7fe72b7fe640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 0x7fe71806ef50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe71c032000 tx=0x7fe71c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.308+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe720059f10 con 0x7fe72c0aa540 2024-09-15T22:48:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.473+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe72c0cc660 con 0x7fe72c0aa540 2024-09-15T22:48:08.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.474+0000 7fe713fff640 1 -- 172.21.15.134:0/1126061503 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16864 (secure 0 0 0) 0x7fe720059810 con 0x7fe72c0aa540 2024-09-15T22:48:08.476 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:08.476 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":146,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:47:44.502033+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:47:41.447309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T22:47:41.798619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 msgr2=0x7fe71806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 0x7fe71806ef50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe71c032000 tx=0x7fe71c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 msgr2=0x7fe72c0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe720007340 tx=0x7fe720007800 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 shutdown_connections 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe72c0ae730 0x7fe72c0ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe71806ca90 0x7fe71806ef50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0aa540 0x7fe72c0ae1f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 --2- 172.21.15.134:0/1126061503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7140039b0 0x7fe72c14bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 >> 172.21.15.134:0/1126061503 conn(0x7fe72c062cc0 msgr2=0x7fe72c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 shutdown_connections 2024-09-15T22:48:08.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.476+0000 7fe731d3b640 1 -- 172.21.15.134:0/1126061503 wait complete. 2024-09-15T22:48:08.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:48:08.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.587+0000 7f9c9cdf8640 1 Processor -- start 2024-09-15T22:48:08.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.587+0000 7f9c9cdf8640 1 -- start start 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c9cdf8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 0x7f9c980cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c9cdf8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c980cd5f0 con 0x7f9c9806c1f0 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c9cdf8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c980cd8d0 con 0x7f9c9806be10 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c9cdf8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9c980cdbb0 con 0x7f9c98151c50 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c96d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9c9806c1f0 0x7f9c98164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50386/0 (socket says 172.21.15.134:50386) 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c96d9d640 1 -- 172.21.15.134:0/1382507982 learned_addr learned my addr 172.21.15.134:0/1382507982 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.588+0000 7f9c95d9b640 1 --2- 172.21.15.134:0/1382507982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 0x7f9c980cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117444228 0 0) 0x7f9c980cd5f0 con 0x7f9c9806c1f0 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c80005730 con 0x7f9c9806c1f0 2024-09-15T22:48:08.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c95d9b640 1 -- 172.21.15.134:0/1382507982 >> v1:172.21.15.177:6789/0 conn(0x7f9c9806be10 legacy=0x7f9c98151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412457033 0 0) 0x7f9c980cd8d0 con 0x7f9c9806be10 2024-09-15T22:48:08.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c95d9b640 1 -- 172.21.15.134:0/1382507982 >> v1:172.21.15.134:6789/0 conn(0x7f9c9806c1f0 legacy=0x7f9c98164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.589+0000 7f9c95d9b640 1 -- 172.21.15.134:0/1382507982 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c980cde90 con 0x7f9c98151c50 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c95d9b640 1 --2- 172.21.15.134:0/1382507982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 0x7f9c980cd010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00a970 tx=0x7f9c8c02a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8002634bb982a52c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c00b040 con 0x7f9c98151c50 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c02f710 con 0x7f9c98151c50 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9559a640 1 -- 172.21.15.134:0/1382507982 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c02fac0 con 0x7f9c98151c50 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/1382507982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 msgr2=0x7f9c980cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/1382507982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 0x7f9c980cd010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00a970 tx=0x7f9c8c02a4c0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/1382507982 shutdown_connections 2024-09-15T22:48:08.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/1382507982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c98151c50 0x7f9c980cd010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/1382507982 >> 172.21.15.134:0/1382507982 conn(0x7f9c98062cc0 msgr2=0x7f9c9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/1382507982 shutdown_connections 2024-09-15T22:48:08.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.590+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/1382507982 wait complete. 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 Processor -- start 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 -- start start 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c9806be10 0x7f9c9813fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c9806c1f0 0x7f9c9813f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9815baa0 con 0x7f9c98151c50 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9c980ce690 con 0x7f9c9806be10 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c9cdf8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9815bc20 con 0x7f9c9806c1f0 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.592+0000 7f9c96d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39712/0 (socket says 172.21.15.134:39712) 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 -- 172.21.15.134:0/4004319682 learned_addr learned my addr 172.21.15.134:0/4004319682 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c95d9b640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c9806c1f0 0x7f9c9813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c9659c640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c9806be10 0x7f9c9813fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 -- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c9806c1f0 msgr2=0x7f9c9813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c9806c1f0 0x7f9c9813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 -- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c9806be10 msgr2=0x7f9c9813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c9806be10 0x7f9c9813fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 -- 172.21.15.134:0/4004319682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9813f960 con 0x7f9c98151c50 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c96d9d640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c460 tx=0x7f9c9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90017070 con 0x7f9c98151c50 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90005ce0 con 0x7f9c98151c50 2024-09-15T22:48:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c98140380 con 0x7f9c98151c50 2024-09-15T22:48:08.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900072b0 con 0x7f9c98151c50 2024-09-15T22:48:08.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.593+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c98142880 con 0x7f9c98151c50 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.594+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c980cd010 con 0x7f9c98151c50 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.595+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f9c9001a070 con 0x7f9c98151c50 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.595+0000 7f9c86ffd640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 0x7f9c7806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.595+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5765+0+0 (secure 0 0 0) 0x7f9c90089110 con 0x7f9c98151c50 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.595+0000 7f9c9659c640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 0x7f9c7806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.596+0000 7f9c9659c640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 0x7f9c7806ef50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c880012e0 tx=0x7f9c88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.599+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c90058b20 con 0x7f9c98151c50 2024-09-15T22:48:08.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.797+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c9806d030 con 0x7f9c98151c50 2024-09-15T22:48:08.799 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:48:08.798+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:48:08.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.799+0000 7f9c86ffd640 1 -- 172.21.15.134:0/4004319682 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f9c9005ce20 con 0x7f9c98151c50 2024-09-15T22:48:08.800 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 msgr2=0x7f9c7806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 0x7f9c7806ef50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c880012e0 tx=0x7f9c88009040 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 msgr2=0x7f9c98141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c460 tx=0x7f9c9000c920 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 shutdown_connections 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f9c7806ca90 0x7f9c7806ef50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c98151c50 0x7f9c98141c80 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c9806c1f0 0x7f9c9813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 --2- 172.21.15.134:0/4004319682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c9806be10 0x7f9c9813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.801+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 >> 172.21.15.134:0/4004319682 conn(0x7f9c98062cc0 msgr2=0x7f9c980b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.802+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 shutdown_connections 2024-09-15T22:48:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.802+0000 7f9c9cdf8640 1 -- 172.21.15.134:0/4004319682 wait complete. 2024-09-15T22:48:08.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:48:08.840 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:48:08.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.915+0000 7f3dca045640 1 Processor -- start 2024-09-15T22:48:08.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.915+0000 7f3dca045640 1 -- start start 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dca045640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dc40b57d0 0x7f3dc40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dca045640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc4072290 0x7f3dc4072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dca045640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dc406dc40 con 0x7f3dc4161cc0 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dca045640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc40af300 con 0x7f3dc40b57d0 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dca045640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc4072c40 con 0x7f3dc4072290 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dc40b57d0 0x7f3dc40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dc40b57d0 0x7f3dc40b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39726/0 (socket says 172.21.15.134:39726) 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 -- 172.21.15.134:0/3010900973 learned_addr learned my addr 172.21.15.134:0/3010900973 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:08.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc3fff640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc4072290 0x7f3dc4072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 -- 172.21.15.134:0/3010900973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc4072290 msgr2=0x7f3dc4072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:08.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc4072290 0x7f3dc4072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 -- 172.21.15.134:0/3010900973 >> v1:172.21.15.177:6789/0 conn(0x7f3dc4161cc0 legacy=0x7f3dc40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc27fc640 1 -- 172.21.15.134:0/3010900973 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257719320 0 0) 0x7f3dc406dc40 con 0x7f3dc4161cc0 2024-09-15T22:48:08.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.916+0000 7f3dc2ffd640 1 -- 172.21.15.134:0/3010900973 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc406df20 con 0x7f3dc40b57d0 2024-09-15T22:48:08.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.917+0000 7f3dc2ffd640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc40b57d0 0x7f3dc40b5c40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009870 tx=0x7f3db802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d282af89b9d9c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.917+0000 7f3dc27fc640 1 -- 172.21.15.134:0/3010900973 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8037070 con 0x7f3dc40b57d0 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.917+0000 7f3dc27fc640 1 -- 172.21.15.134:0/3010900973 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db8032440 con 0x7f3dc40b57d0 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.917+0000 7f3dc27fc640 1 -- 172.21.15.134:0/3010900973 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8032810 con 0x7f3dc40b57d0 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 -- 172.21.15.134:0/3010900973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc40b57d0 msgr2=0x7f3dc40b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc40b57d0 0x7f3dc40b5c40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009870 tx=0x7f3db802a270 comp rx=0 tx=0).stop 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 -- 172.21.15.134:0/3010900973 shutdown_connections 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc4072290 0x7f3dc4072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 --2- 172.21.15.134:0/3010900973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc40b57d0 0x7f3dc40b5c40 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 -- 172.21.15.134:0/3010900973 >> 172.21.15.134:0/3010900973 conn(0x7f3dc406bba0 msgr2=0x7f3dc406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 -- 172.21.15.134:0/3010900973 shutdown_connections 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.918+0000 7f3dca045640 1 -- 172.21.15.134:0/3010900973 wait complete. 2024-09-15T22:48:08.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.919+0000 7f3dca045640 1 Processor -- start 2024-09-15T22:48:08.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.919+0000 7f3dca045640 1 -- start start 2024-09-15T22:48:08.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc40b57d0 0x7f3dc4150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3dc4161cc0 0x7f3dc40cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc40b4a60 con 0x7f3dc4072290 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc406e570 con 0x7f3dc4161cc0 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dca045640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc40b4be0 con 0x7f3dc40b57d0 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39732/0 (socket says 172.21.15.134:39732) 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 -- 172.21.15.134:0/1106627858 learned_addr learned my addr 172.21.15.134:0/1106627858 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 -- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc40b57d0 msgr2=0x7f3dc4150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc40b57d0 0x7f3dc4150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 -- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3dc4161cc0 msgr2=0x7f3dc40cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3dc4161cc0 0x7f3dc40cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 -- 172.21.15.134:0/1106627858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc40ce550 con 0x7f3dc4072290 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dc37fe640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c410 tx=0x7f3db400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.920+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4017070 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.921+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40035f0 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.921+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc41572a0 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.921+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40039e0 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.921+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc4157860 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.922+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc4072700 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.922+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f3db401a070 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.923+0000 7f3dabfff640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 0x7f3db006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.923+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5851+0+0 (secure 0 0 0) 0x7f3db40891a0 con 0x7f3dc4072290 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.923+0000 7f3dc2ffd640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 0x7f3db006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:08.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.923+0000 7f3dc2ffd640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 0x7f3db006ef80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3db8034000 tx=0x7f3db802c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:08.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:08.927+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3db4059200 con 0x7f3dc4072290 2024-09-15T22:48:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.125+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3dc40b3fd0 con 0x7f3dc4072290 2024-09-15T22:48:09.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.809+0000 7f3dabfff640 1 -- 172.21.15.134:0/1106627858 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7f3db4058b00 con 0x7f3dc4072290 2024-09-15T22:48:09.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 msgr2=0x7f3db006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 0x7f3db006ef80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3db8034000 tx=0x7f3db802c000 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 msgr2=0x7f3dc41f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c410 tx=0x7f3db400c8d0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 shutdown_connections 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3dc4161cc0 0x7f3dc40cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3dc40b57d0 0x7f3dc4150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f3db006cac0 0x7f3db006ef80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 --2- 172.21.15.134:0/1106627858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dc4072290 0x7f3dc41f5470 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 >> 172.21.15.134:0/1106627858 conn(0x7f3dc406bba0 msgr2=0x7f3dc4160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 shutdown_connections 2024-09-15T22:48:09.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.812+0000 7f3dca045640 1 -- 172.21.15.134:0/1106627858 wait complete. 2024-09-15T22:48:09.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:48:09.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.976+0000 7f6e30a65640 1 Processor -- start 2024-09-15T22:48:09.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.976+0000 7f6e30a65640 1 -- start start 2024-09-15T22:48:09.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.976+0000 7f6e30a65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6e2c15c330 0x7f6e2c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e30a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c0d0e60 0x7f6e2c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e30a65640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c0b3bf0 con 0x7f6e2c0afce0 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e30a65640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6e2c15cd70 con 0x7f6e2c15c330 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e30a65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2c15d050 con 0x7f6e2c0d0e60 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6e2c15c330 0x7f6e2c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2ad9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c0d0e60 0x7f6e2c0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6e2c15c330 0x7f6e2c15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:42954/0 (socket says 172.21.15.134:42954) 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e21d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6e2c0afce0 0x7f6e2c0d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:46442/0 (socket says 172.21.15.134:46442) 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 -- 172.21.15.134:0/332953136 learned_addr learned my addr 172.21.15.134:0/332953136 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 -- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c0d0e60 msgr2=0x7f6e2c0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 --2- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c0d0e60 0x7f6e2c0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 -- 172.21.15.134:0/332953136 >> v1:172.21.15.177:6789/0 conn(0x7f6e2c0afce0 legacy=0x7f6e2c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.977+0000 7f6e2a59c640 1 -- 172.21.15.134:0/332953136 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c15d330 con 0x7f6e2c15c330 2024-09-15T22:48:09.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.978+0000 7f6e2a59c640 1 --2- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c15c330 0x7f6e2c15c710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009870 tx=0x7f6e1c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d29ebd329cb6f0a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.978+0000 7f6e29d9b640 1 -- 172.21.15.134:0/332953136 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c037070 con 0x7f6e2c15c330 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.978+0000 7f6e29d9b640 1 -- 172.21.15.134:0/332953136 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c032440 con 0x7f6e2c15c330 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.978+0000 7f6e29d9b640 1 -- 172.21.15.134:0/332953136 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c032810 con 0x7f6e2c15c330 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 -- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c15c330 msgr2=0x7f6e2c15c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 --2- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c15c330 0x7f6e2c15c710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009870 tx=0x7f6e1c02a270 comp rx=0 tx=0).stop 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 -- 172.21.15.134:0/332953136 shutdown_connections 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 --2- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c0d0e60 0x7f6e2c0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 --2- 172.21.15.134:0/332953136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c15c330 0x7f6e2c15c710 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 -- 172.21.15.134:0/332953136 >> 172.21.15.134:0/332953136 conn(0x7f6e2c06bba0 msgr2=0x7f6e2c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:09.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 -- 172.21.15.134:0/332953136 shutdown_connections 2024-09-15T22:48:09.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.979+0000 7f6e30a65640 1 -- 172.21.15.134:0/332953136 wait complete. 2024-09-15T22:48:09.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.980+0000 7f6e30a65640 1 Processor -- start 2024-09-15T22:48:09.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.980+0000 7f6e30a65640 1 -- start start 2024-09-15T22:48:09.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 0x7f6e2c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c15c330 0x7f6e2c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c15d9d0 con 0x7f6e2c0afce0 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c15d850 con 0x7f6e2c0d0e60 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e30a65640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2c071730 con 0x7f6e2c15c330 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39742/0 (socket says 172.21.15.134:39742) 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 -- 172.21.15.134:0/52940210 learned_addr learned my addr 172.21.15.134:0/52940210 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2ad9d640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c15c330 0x7f6e2c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e21d9b640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 0x7f6e2c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 -- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c15c330 msgr2=0x7f6e2c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c15c330 0x7f6e2c0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 -- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 msgr2=0x7f6e2c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 0x7f6e2c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 -- 172.21.15.134:0/52940210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c0ac7c0 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e21d9b640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 0x7f6e2c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.981+0000 7f6e2a59c640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02a2b0 tx=0x7f6e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.982+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c037040 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.982+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c042070 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.982+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c0acaa0 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.982+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c030880 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.982+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c0ad060 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.983+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c15c710 con 0x7f6e2c0afce0 2024-09-15T22:48:09.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.983+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f6e1c030a20 con 0x7f6e2c0afce0 2024-09-15T22:48:09.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.984+0000 7f6e237fe640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 0x7f6e0c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:09.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.984+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5851+0+0 (secure 0 0 0) 0x7f6e1c0aa750 con 0x7f6e2c0afce0 2024-09-15T22:48:09.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.984+0000 7f6e21d9b640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 0x7f6e0c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:09.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.984+0000 7f6e21d9b640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 0x7f6e0c06ef50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0b20b0 tx=0x7f6e14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:09.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:09.988+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e1c045360 con 0x7f6e2c0afce0 2024-09-15T22:48:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.154+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6e2c15ec50 con 0x7f6e2c0afce0 2024-09-15T22:48:10.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.811+0000 7f6e237fe640 1 -- 172.21.15.134:0/52940210 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) ==== 181+0+0 (secure 0 0 0) 0x7f6e1c07a730 con 0x7f6e2c0afce0 2024-09-15T22:48:10.812 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:48:10.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 msgr2=0x7f6e0c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:10.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 0x7f6e0c06ef50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0b20b0 tx=0x7f6e14009040 comp rx=0 tx=0).stop 2024-09-15T22:48:10.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 msgr2=0x7f6e2c14d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02a2b0 tx=0x7f6e1c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 shutdown_connections 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e2c15c330 0x7f6e2c0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2c0d0e60 0x7f6e2c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6e0c06ca90 0x7f6e0c06ef50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 --2- 172.21.15.134:0/52940210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2c0afce0 0x7f6e2c14d0f0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 >> 172.21.15.134:0/52940210 conn(0x7f6e2c06bba0 msgr2=0x7f6e2c15f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 shutdown_connections 2024-09-15T22:48:10.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.814+0000 7f6e30a65640 1 -- 172.21.15.134:0/52940210 wait complete. 2024-09-15T22:48:10.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:48:10.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.931+0000 7fb9cf6c3640 1 Processor -- start 2024-09-15T22:48:10.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.931+0000 7fb9cf6c3640 1 -- start start 2024-09-15T22:48:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9c80ccb80 0x7fb9c815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c8072d10 0x7fb9c80b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c80b50a0 con 0x7fb9c8072d10 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c80b3570 con 0x7fb9c80ccb80 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9cf6c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c80b3850 con 0x7fb9c80b4c50 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c8072d10 0x7fb9c80b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c8072d10 0x7fb9c80b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39748/0 (socket says 172.21.15.134:39748) 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 -- 172.21.15.134:0/2007378755 learned_addr learned my addr 172.21.15.134:0/2007378755 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 -- 172.21.15.134:0/2007378755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 msgr2=0x7fb9c815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 --2- 172.21.15.134:0/2007378755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 -- 172.21.15.134:0/2007378755 >> v2:172.21.15.177:3300/0 conn(0x7fb9c80ccb80 msgr2=0x7fb9c815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 --2- 172.21.15.134:0/2007378755 >> v2:172.21.15.177:3300/0 conn(0x7fb9c80ccb80 0x7fb9c815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.932+0000 7fb9ccc5e640 1 -- 172.21.15.134:0/2007378755 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c80b3b30 con 0x7fb9c8072d10 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9ccc5e640 1 --2- 172.21.15.134:0/2007378755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c8072d10 0x7fb9c80b4710 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fb9c806f4e0 tx=0x7fb9b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc070d1d35fe920 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9bffff640 1 -- 172.21.15.134:0/2007378755 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8037070 con 0x7fb9c8072d10 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9bffff640 1 -- 172.21.15.134:0/2007378755 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8032440 con 0x7fb9c8072d10 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9bffff640 1 -- 172.21.15.134:0/2007378755 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8032810 con 0x7fb9c8072d10 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/2007378755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c8072d10 msgr2=0x7fb9c80b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.933+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/2007378755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c8072d10 0x7fb9c80b4710 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fb9c806f4e0 tx=0x7fb9b802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/2007378755 shutdown_connections 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/2007378755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/2007378755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c8072d10 0x7fb9c80b4710 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/2007378755 >> v2:172.21.15.177:3300/0 conn(0x7fb9c80ccb80 0x7fb9c815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/2007378755 >> 172.21.15.134:0/2007378755 conn(0x7fb9c806bba0 msgr2=0x7fb9c806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/2007378755 shutdown_connections 2024-09-15T22:48:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.934+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/2007378755 wait complete. 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.935+0000 7fb9cf6c3640 1 Processor -- start 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.935+0000 7fb9cf6c3640 1 -- start start 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c8072d10 0x7fb9c81542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c81672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80b43d0 con 0x7fb9c80ccb80 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80b40f0 con 0x7fb9c8072d10 2024-09-15T22:48:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.936+0000 7fb9cf6c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c80ccf60 con 0x7fb9c80b4c50 2024-09-15T22:48:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.937+0000 7fb9cdc60640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.937+0000 7fb9cdc60640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39758/0 (socket says 172.21.15.134:39758) 2024-09-15T22:48:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.937+0000 7fb9cdc60640 1 -- 172.21.15.134:0/3598528048 learned_addr learned my addr 172.21.15.134:0/3598528048 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:10.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.938+0000 7fb9cd45f640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c8072d10 0x7fb9c81542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.939+0000 7fb9cdc60640 1 -- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 msgr2=0x7fb9c81672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.938+0000 7fb9ccc5e640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c81672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.940+0000 7fb9cdc60640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c81672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.940+0000 7fb9cdc60640 1 -- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c8072d10 msgr2=0x7fb9c81542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.940+0000 7fb9cdc60640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c8072d10 0x7fb9c81542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.940+0000 7fb9cdc60640 1 -- 172.21.15.134:0/3598528048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c80cf950 con 0x7fb9c80ccb80 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.940+0000 7fb9ccc5e640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c81672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:10.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9cdc60640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b9e0 tx=0x7fb9c000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0019070 con 0x7fb9c80ccb80 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c000cac0 con 0x7fb9c80ccb80 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0014440 con 0x7fb9c80ccb80 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c81585d0 con 0x7fb9c80ccb80 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.941+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c80cfbf0 con 0x7fb9c80ccb80 2024-09-15T22:48:10.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.942+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c80b4710 con 0x7fb9c80ccb80 2024-09-15T22:48:10.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.943+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb9c001c070 con 0x7fb9c80ccb80 2024-09-15T22:48:10.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.943+0000 7fb9bdffb640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 0x7fb9ac06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:10.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.943+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5413+0+0 (secure 0 0 0) 0x7fb9c0089b10 con 0x7fb9c80ccb80 2024-09-15T22:48:10.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.945+0000 7fb9cd45f640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 0x7fb9ac06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:10.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.945+0000 7fb9cd45f640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 0x7fb9ac06ef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8071eb0 tx=0x7fb9c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:10.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:10.949+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9c0059b70 con 0x7fb9c80ccb80 2024-09-15T22:48:11.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.114+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb9c8071c00 con 0x7fb9c80ccb80 2024-09-15T22:48:11.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.818+0000 7fb9bdffb640 1 -- 172.21.15.134:0/3598528048 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) ==== 169+0+0 (secure 0 0 0) 0x7fb9c0059470 con 0x7fb9c80ccb80 2024-09-15T22:48:11.820 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:48:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 msgr2=0x7fb9ac06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 0x7fb9ac06ef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8071eb0 tx=0x7fb9c4008040 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 msgr2=0x7fb9c80ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b9e0 tx=0x7fb9c000bea0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 shutdown_connections 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9ac06ca90 0x7fb9ac06ef50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ccb80 0x7fb9c80ae8e0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c80b4c50 0x7fb9c81672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 --2- 172.21.15.134:0/3598528048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c8072d10 0x7fb9c81542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 >> 172.21.15.134:0/3598528048 conn(0x7fb9c806bba0 msgr2=0x7fb9c815e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 shutdown_connections 2024-09-15T22:48:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.821+0000 7fb9cf6c3640 1 -- 172.21.15.134:0/3598528048 wait complete. 2024-09-15T22:48:11.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:48:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.942+0000 7f268203c640 1 Processor -- start 2024-09-15T22:48:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.942+0000 7f268203c640 1 -- start start 2024-09-15T22:48:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f268203c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f267c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f268203c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f267c06f130 0x7f267c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f268203c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c0b43f0 con 0x7f267c15c370 2024-09-15T22:48:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f268203c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f267c15c7d0 con 0x7f267c06f130 2024-09-15T22:48:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f268203c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f267c0b3630 con 0x7f267c158e50 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f267c15c370 0x7f267c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50402/0 (socket says 172.21.15.134:50402) 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267affd640 1 -- 172.21.15.134:0/3149682844 learned_addr learned my addr 172.21.15.134:0/3149682844 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274034300 0 0) 0x7f267c0b43f0 con 0x7f267c15c370 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2664003520 con 0x7f267c15c370 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267bfff640 1 --2- 172.21.15.134:0/3149682844 >> v2:172.21.15.177:3300/0 conn(0x7f267c06f130 0x7f267c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267b7fe640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f267c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4190306486 0 0) 0x7f2664003520 con 0x7f267c15c370 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 msgr2=0x7f267c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f267c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 >> v2:172.21.15.177:3300/0 conn(0x7f267c06f130 msgr2=0x7f267c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:11.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 --2- 172.21.15.134:0/3149682844 >> v2:172.21.15.177:3300/0 conn(0x7f267c06f130 0x7f267c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c0b3910 con 0x7f267c15c370 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f26700017f0 con 0x7f267c15c370 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.943+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 >> v1:172.21.15.134:6789/0 conn(0x7f267c15c370 legacy=0x7f267c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f26640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664003fe0 0x7f2664004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2664004d40 0x7f26640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f267c15c7d0 con 0x7f2664004d40 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b3630 con 0x7f2664003fe0 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f266400bbd0 con 0x7f267c158e50 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2664004d40 0x7f26640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267b7fe640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f26640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267affd640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664003fe0 0x7f2664004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 -- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 msgr2=0x7f26640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:11.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c158e50 0x7f26640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 -- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664003fe0 msgr2=0x7f2664004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664003fe0 0x7f2664004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.944+0000 7f267bfff640 1 -- 172.21.15.134:0/3149682844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2664003520 con 0x7f2664004d40 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f267bfff640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2664004d40 0x7f26640051c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f2674007330 tx=0x7f2664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa67ec018fff6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674009be0 con 0x7f2664004d40 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674036600 con 0x7f2664004d40 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f267a7fc640 1 -- 172.21.15.134:0/3149682844 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26740369d0 con 0x7f2664004d40 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f268203c640 1 -- 172.21.15.134:0/3149682844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2664004d40 msgr2=0x7f26640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f268203c640 1 --2- 172.21.15.134:0/3149682844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2664004d40 0x7f26640051c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f2674007330 tx=0x7f2664005830 comp rx=0 tx=0).stop 2024-09-15T22:48:11.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f267bfff640 1 -- 172.21.15.134:0/3149682844 reap_dead start 2024-09-15T22:48:11.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f268203c640 1 -- 172.21.15.134:0/3149682844 shutdown_connections 2024-09-15T22:48:11.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.945+0000 7f268203c640 1 -- 172.21.15.134:0/3149682844 >> 172.21.15.134:0/3149682844 conn(0x7f267c06bba0 msgr2=0x7f267c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:11.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.946+0000 7f268203c640 1 -- 172.21.15.134:0/3149682844 shutdown_connections 2024-09-15T22:48:11.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.946+0000 7f268203c640 1 -- 172.21.15.134:0/3149682844 wait complete. 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.947+0000 7f268203c640 1 Processor -- start 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.947+0000 7f268203c640 1 -- start start 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664004d40 0x7f267c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 0x7f267c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f267c159230 con 0x7f267c15ca00 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b3ed0 con 0x7f2664004d40 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f267c0b5050 con 0x7f267c14db80 2024-09-15T22:48:11.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39782/0 (socket says 172.21.15.134:39782) 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 -- 172.21.15.134:0/2427445270 learned_addr learned my addr 172.21.15.134:0/2427445270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267b7fe640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664004d40 0x7f267c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267affd640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 0x7f267c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 -- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 msgr2=0x7f267c155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 0x7f267c155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 -- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664004d40 msgr2=0x7f267c14d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664004d40 0x7f267c14d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 -- 172.21.15.134:0/2427445270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c1502d0 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267affd640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 0x7f267c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f267bfff640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f267402b070 tx=0x7f2674004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674009be0 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674036400 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c14fec0 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674038e10 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.948+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c150870 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.950+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c0b53e0 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.950+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f267402e870 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.950+0000 7f2663fff640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 0x7f266806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.950+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7f26740acc20 con 0x7f267c15ca00 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.951+0000 7f267b7fe640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 0x7f266806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:11.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.951+0000 7f267b7fe640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 0x7f266806ef80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a920 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:11.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:11.955+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f267404a060 con 0x7f267c15ca00 2024-09-15T22:48:12.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.120+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f267c0cf020 con 0x7f267c15ca00 2024-09-15T22:48:12.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.123+0000 7f2663fff640 1 -- 172.21.15.134:0/2427445270 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f2674032030 con 0x7f267c15ca00 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 msgr2=0x7f266806ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 0x7f266806ef80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a920 tx=0x7f266c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 msgr2=0x7f267c156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f267402b070 tx=0x7f2674004ab0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 shutdown_connections 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f266806cac0 0x7f266806ef80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f267c15ca00 0x7f267c156430 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f267c14db80 0x7f267c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.130+0000 7f268203c640 1 --2- 172.21.15.134:0/2427445270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2664004d40 0x7f267c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.131+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 >> 172.21.15.134:0/2427445270 conn(0x7f267c06bba0 msgr2=0x7f267c06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:12.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.131+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 shutdown_connections 2024-09-15T22:48:12.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.131+0000 7f268203c640 1 -- 172.21.15.134:0/2427445270 wait complete. 2024-09-15T22:48:12.145 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-15T22:48:12.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.240+0000 7f46ccf0a640 1 Processor -- start 2024-09-15T22:48:12.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.240+0000 7f46ccf0a640 1 -- start start 2024-09-15T22:48:12.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.241+0000 7f46ccf0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 0x7f46c80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.241+0000 7f46ccf0a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c80cef90 0x7f46c80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.241+0000 7f46ccf0a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c80b7170 con 0x7f46c815ed20 2024-09-15T22:48:12.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.241+0000 7f46ccf0a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f46c80d1ae0 con 0x7f46c80cef90 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.241+0000 7f46ccf0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80b7aa0 con 0x7f46c815e940 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c80cef90 0x7f46c80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 0x7f46c80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c80cef90 0x7f46c80d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:43024/0 (socket says 172.21.15.134:43024) 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 -- 172.21.15.134:0/767207944 learned_addr learned my addr 172.21.15.134:0/767207944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c5d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f46c815ed20 0x7f46c80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:46452/0 (socket says 172.21.15.134:46452) 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 -- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 msgr2=0x7f46c80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 0x7f46c80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 -- 172.21.15.134:0/767207944 >> v1:172.21.15.177:6789/0 conn(0x7f46c815ed20 legacy=0x7f46c80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c6d9d640 1 -- 172.21.15.134:0/767207944 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80d3660 con 0x7f46c80cef90 2024-09-15T22:48:12.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.242+0000 7f46c659c640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 0x7f46c80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.243+0000 7f46c6d9d640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c80cef90 0x7f46c80d15a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1364e5153c648e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.243+0000 7f46c559a640 1 -- 172.21.15.134:0/767207944 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0037070 con 0x7f46c80cef90 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.243+0000 7f46c559a640 1 -- 172.21.15.134:0/767207944 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c002ae50 con 0x7f46c80cef90 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.243+0000 7f46c559a640 1 -- 172.21.15.134:0/767207944 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0032860 con 0x7f46c80cef90 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 -- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c80cef90 msgr2=0x7f46c80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c80cef90 0x7f46c80d15a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c002a300 comp rx=0 tx=0).stop 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 -- 172.21.15.134:0/767207944 shutdown_connections 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c80cef90 0x7f46c80d15a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/767207944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815e940 0x7f46c80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 -- 172.21.15.134:0/767207944 >> 172.21.15.134:0/767207944 conn(0x7f46c80b6240 msgr2=0x7f46c80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 -- 172.21.15.134:0/767207944 shutdown_connections 2024-09-15T22:48:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.244+0000 7f46ccf0a640 1 -- 172.21.15.134:0/767207944 wait complete. 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.245+0000 7f46ccf0a640 1 Processor -- start 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.245+0000 7f46ccf0a640 1 -- start start 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 0x7f46c81eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815ed20 0x7f46c8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80d3f00 con 0x7f46c80cef90 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80d3c20 con 0x7f46c815e940 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46ccf0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d3310 con 0x7f46c815ed20 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46c659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46c659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39794/0 (socket says 172.21.15.134:39794) 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.246+0000 7f46c659c640 1 -- 172.21.15.134:0/2492489334 learned_addr learned my addr 172.21.15.134:0/2492489334 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 -- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815ed20 msgr2=0x7f46c8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815ed20 0x7f46c8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c5d9b640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 0x7f46c81eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 -- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 msgr2=0x7f46c81eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 0x7f46c81eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 -- 172.21.15.134:0/2492489334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c81f5a00 con 0x7f46c80cef90 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c5d9b640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 0x7f46c81eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46c659c640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f46b800efc0 tx=0x7f46b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8018020 con 0x7f46c80cef90 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b8014680 con 0x7f46c80cef90 2024-09-15T22:48:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8014a50 con 0x7f46c80cef90 2024-09-15T22:48:12.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c81f5ce0 con 0x7f46c80cef90 2024-09-15T22:48:12.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.247+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c81583b0 con 0x7f46c80cef90 2024-09-15T22:48:12.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.248+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c80d1f80 con 0x7f46c80cef90 2024-09-15T22:48:12.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.248+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f46b8005d10 con 0x7f46c80cef90 2024-09-15T22:48:12.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.249+0000 7f46beffd640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 0x7f46a806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.249+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7f46b808acd0 con 0x7f46c80cef90 2024-09-15T22:48:12.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.249+0000 7f46c5d9b640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 0x7f46a806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.250+0000 7f46c5d9b640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 0x7f46a806ef50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46c8076360 tx=0x7f46b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.253+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46b8022030 con 0x7f46c80cef90 2024-09-15T22:48:12.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.481+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7f46c80b99f0 con 0x7f46c80cef90 2024-09-15T22:48:12.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.819+0000 7f46beffd640 1 -- 172.21.15.134:0/2492489334 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v377) ==== 149+0+0 (secure 0 0 0) 0x7f46b8010040 con 0x7f46c80cef90 2024-09-15T22:48:12.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 msgr2=0x7f46a806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 0x7f46a806ef50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46c8076360 tx=0x7f46b0009040 comp rx=0 tx=0).stop 2024-09-15T22:48:12.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 msgr2=0x7f46c81576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f46b800efc0 tx=0x7f46b800c490 comp rx=0 tx=0).stop 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 shutdown_connections 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c815ed20 0x7f46c8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c815e940 0x7f46c81eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f46a806ca90 0x7f46a806ef50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 --2- 172.21.15.134:0/2492489334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46c80cef90 0x7f46c81576b0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 >> 172.21.15.134:0/2492489334 conn(0x7f46c80b6240 msgr2=0x7f46c80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 shutdown_connections 2024-09-15T22:48:12.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.821+0000 7f46ccf0a640 1 -- 172.21.15.134:0/2492489334 wait complete. 2024-09-15T22:48:12.834 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-15T22:48:12.835 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-15T22:48:12.835 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:48:12.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:12.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.930+0000 7fd3981b7640 1 Processor -- start 2024-09-15T22:48:12.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 -- start start 2024-09-15T22:48:12.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 0x7fd3900d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd39015ce80 0x7fd3901594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3900d0bc0 con 0x7fd39015ca40 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd39015d390 con 0x7fd39015ce80 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.931+0000 7fd3981b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd39015d670 con 0x7fd3900d02a0 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395752640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd39015ca40 0x7fd39015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50414/0 (socket says 172.21.15.134:50414) 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395752640 1 -- 172.21.15.134:0/1048396690 learned_addr learned my addr 172.21.15.134:0/1048396690 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395f53640 1 --2- 172.21.15.134:0/1048396690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 0x7fd3900d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd396754640 1 --2- 172.21.15.134:0/1048396690 >> v2:172.21.15.177:3300/0 conn(0x7fd39015ce80 0x7fd3901594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547486537 0 0) 0x7fd3900d0bc0 con 0x7fd39015ca40 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd378003520 con 0x7fd39015ca40 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395f53640 1 -- 172.21.15.134:0/1048396690 >> v2:172.21.15.177:3300/0 conn(0x7fd39015ce80 msgr2=0x7fd3901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395f53640 1 --2- 172.21.15.134:0/1048396690 >> v2:172.21.15.177:3300/0 conn(0x7fd39015ce80 0x7fd3901594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395f53640 1 -- 172.21.15.134:0/1048396690 >> v1:172.21.15.134:6789/0 conn(0x7fd39015ca40 legacy=0x7fd39015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4122202537 0 0) 0x7fd378003520 con 0x7fd39015ca40 2024-09-15T22:48:12.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.932+0000 7fd395f53640 1 -- 172.21.15.134:0/1048396690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39015d950 con 0x7fd3900d02a0 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.933+0000 7fd395f53640 1 --2- 172.21.15.134:0/1048396690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 0x7fd3900d0680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3880097a0 tx=0x7fd38802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42af0a18d8c4bf94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.933+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388037070 con 0x7fd3900d02a0 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.933+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38802ab10 con 0x7fd3900d02a0 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.933+0000 7fd394f51640 1 -- 172.21.15.134:0/1048396690 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384001670 con 0x7fd3900d02a0 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 -- 172.21.15.134:0/1048396690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 msgr2=0x7fd3900d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 --2- 172.21.15.134:0/1048396690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 0x7fd3900d0680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3880097a0 tx=0x7fd38802a080 comp rx=0 tx=0).stop 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 -- 172.21.15.134:0/1048396690 shutdown_connections 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 --2- 172.21.15.134:0/1048396690 >> v2:172.21.15.177:3300/0 conn(0x7fd39015ce80 0x7fd3901594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 --2- 172.21.15.134:0/1048396690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3900d02a0 0x7fd3900d0680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 -- 172.21.15.134:0/1048396690 >> 172.21.15.134:0/1048396690 conn(0x7fd390062cc0 msgr2=0x7fd39006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 -- 172.21.15.134:0/1048396690 shutdown_connections 2024-09-15T22:48:12.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.934+0000 7fd3981b7640 1 -- 172.21.15.134:0/1048396690 wait complete. 2024-09-15T22:48:12.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.935+0000 7fd3981b7640 1 Processor -- start 2024-09-15T22:48:12.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.935+0000 7fd3981b7640 1 -- start start 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd39015ca40 0x7fd39015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 0x7fd390143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd39015eb40 con 0x7fd3900d02a0 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd39015df10 con 0x7fd39015ce80 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd390155b90 con 0x7fd39015ca40 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39802/0 (socket says 172.21.15.134:39802) 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 -- 172.21.15.134:0/381882521 learned_addr learned my addr 172.21.15.134:0/381882521 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395752640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd39015ca40 0x7fd39015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd396754640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 0x7fd390143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 -- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd39015ca40 msgr2=0x7fd39015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd39015ca40 0x7fd39015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 -- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 msgr2=0x7fd390143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 0x7fd390143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 -- 172.21.15.134:0/381882521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39015c820 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd396754640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 0x7fd390143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd395f53640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd388035040 tx=0x7fd3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388037050 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd388043070 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39015a500 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388006e10 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.936+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39015aac0 con 0x7fd3900d02a0 2024-09-15T22:48:12.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.937+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3900b4790 con 0x7fd3900d02a0 2024-09-15T22:48:12.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.938+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fd38803ca10 con 0x7fd3900d02a0 2024-09-15T22:48:12.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.938+0000 7fd38e7fc640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 0x7fd37c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:12.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.939+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7fd3880aa9f0 con 0x7fd3900d02a0 2024-09-15T22:48:12.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.939+0000 7fd395752640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 0x7fd37c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:12.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.939+0000 7fd395752640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 0x7fd37c06ef50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cc690 tx=0x7fd384009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:12.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:12.943+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd39015c820 con 0x7fd3900d02a0 2024-09-15T22:48:13.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.107+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3900b3c70 con 0x7fd3900d02a0 2024-09-15T22:48:13.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.108+0000 7fd38e7fc640 1 -- 172.21.15.134:0/381882521 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+13169 (secure 0 0 0) 0x7fd3900b3c70 con 0x7fd3900d02a0 2024-09-15T22:48:13.110 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":149,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:11.812270+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/2960551881":"2024-09-16T22:48:08.798658+0000","172.21.15.134:6825/2960551881":"2024-09-16T22:48:08.798658+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 msgr2=0x7fd37c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 0x7fd37c06ef50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cc690 tx=0x7fd384009040 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 msgr2=0x7fd390159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd388035040 tx=0x7fd3880046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 shutdown_connections 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39015ce80 0x7fd390143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd39015ca40 0x7fd39015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd37c06ca90 0x7fd37c06ef50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 --2- 172.21.15.134:0/381882521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900d02a0 0x7fd390159eb0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 >> 172.21.15.134:0/381882521 conn(0x7fd390062cc0 msgr2=0x7fd39015e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 shutdown_connections 2024-09-15T22:48:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.110+0000 7fd3981b7640 1 -- 172.21.15.134:0/381882521 wait complete. 2024-09-15T22:48:13.124 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:48:13.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:48:13.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.224+0000 7f362499f640 1 Processor -- start 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.224+0000 7f362499f640 1 -- start start 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f362499f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f362006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f362499f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36200d2530 0x7f36200d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f362499f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36200ced30 con 0x7f36200b5f50 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f362499f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f36200d20a0 con 0x7f36200d2530 2024-09-15T22:48:13.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f362499f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f36200cf010 con 0x7f362015e390 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36200d2530 0x7f36200d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36200d2530 0x7f36200d29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39812/0 (socket says 172.21.15.134:39812) 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 -- 172.21.15.134:0/4232877810 learned_addr learned my addr 172.21.15.134:0/4232877810 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361f7fe640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f362006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 -- 172.21.15.134:0/4232877810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 msgr2=0x7f362006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f362006c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 -- 172.21.15.134:0/4232877810 >> v1:172.21.15.177:6789/0 conn(0x7f36200b5f50 legacy=0x7f36200b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:13.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.225+0000 7f361ffff640 1 -- 172.21.15.134:0/4232877810 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36200cf2f0 con 0x7f36200d2530 2024-09-15T22:48:13.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.226+0000 7f361ffff640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f36200d29e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f36180098a0 tx=0x7f361802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf21d8b391dbacd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.226+0000 7f361e7fc640 1 -- 172.21.15.134:0/4232877810 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618037070 con 0x7f36200d2530 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.226+0000 7f361e7fc640 1 -- 172.21.15.134:0/4232877810 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3618032440 con 0x7f36200d2530 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.226+0000 7f361e7fc640 1 -- 172.21.15.134:0/4232877810 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618032810 con 0x7f36200d2530 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 -- 172.21.15.134:0/4232877810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 msgr2=0x7f36200d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f36200d29e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f36180098a0 tx=0x7f361802a250 comp rx=0 tx=0).stop 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 -- 172.21.15.134:0/4232877810 shutdown_connections 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f36200d29e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 --2- 172.21.15.134:0/4232877810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f362006c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 -- 172.21.15.134:0/4232877810 >> 172.21.15.134:0/4232877810 conn(0x7f36200d1130 msgr2=0x7f36200d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 -- 172.21.15.134:0/4232877810 shutdown_connections 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.227+0000 7f362499f640 1 -- 172.21.15.134:0/4232877810 wait complete. 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.228+0000 7f362499f640 1 Processor -- start 2024-09-15T22:48:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.228+0000 7f362499f640 1 -- start start 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b5f50 0x7f36201480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f36200b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f362015e770 con 0x7f36200d2530 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36200cf8b0 con 0x7f36200b5f50 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f362499f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f362015e8f0 con 0x7f362015e390 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39820/0 (socket says 172.21.15.134:39820) 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 -- 172.21.15.134:0/890852134 learned_addr learned my addr 172.21.15.134:0/890852134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361ffff640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f36200b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361f7fe640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b5f50 0x7f36201480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 -- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 msgr2=0x7f36200b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f36200b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 -- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b5f50 msgr2=0x7f36201480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b5f50 0x7f36201480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 -- 172.21.15.134:0/890852134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36201485e0 con 0x7f36200d2530 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.229+0000 7f361effd640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f361400c400 tx=0x7f361400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.230+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614011790 con 0x7f36200d2530 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.230+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3614017070 con 0x7f36200d2530 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.230+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362015f890 con 0x7f36200d2530 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.230+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614011bb0 con 0x7f36200d2530 2024-09-15T22:48:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.230+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36200cd660 con 0x7f36200d2530 2024-09-15T22:48:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.231+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36200b6370 con 0x7f36200d2530 2024-09-15T22:48:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.231+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f361401c460 con 0x7f36200d2530 2024-09-15T22:48:13.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.231+0000 7f3607fff640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 0x7f360c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.232+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7f3614089b00 con 0x7f36200d2530 2024-09-15T22:48:13.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.232+0000 7f361f7fe640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 0x7f360c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.232+0000 7f361f7fe640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 0x7f360c06ef80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f361000f360 tx=0x7f3610007710 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.236+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36201485e0 con 0x7f36200d2530 2024-09-15T22:48:13.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.400+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f36200d38f0 con 0x7f36200d2530 2024-09-15T22:48:13.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.401+0000 7f3607fff640 1 -- 172.21.15.134:0/890852134 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) ==== 93+0+10 (secure 0 0 0) 0x7f3614059510 con 0x7f36200d2530 2024-09-15T22:48:13.403 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 msgr2=0x7f360c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 0x7f360c06ef80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f361000f360 tx=0x7f3610007710 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 msgr2=0x7f3620160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f361400c400 tx=0x7f361400c8c0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 shutdown_connections 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f362015e390 0x7f36200b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f360c06cac0 0x7f360c06ef80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36200d2530 0x7f3620160090 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 --2- 172.21.15.134:0/890852134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36200b5f50 0x7f36201480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 >> 172.21.15.134:0/890852134 conn(0x7f36200d1130 msgr2=0x7f36200d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 shutdown_connections 2024-09-15T22:48:13.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.403+0000 7f362499f640 1 -- 172.21.15.134:0/890852134 wait complete. 2024-09-15T22:48:13.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-15T22:48:13.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.512+0000 7fdc96b03640 1 Processor -- start 2024-09-15T22:48:13.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.512+0000 7fdc96b03640 1 -- start start 2024-09-15T22:48:13.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc96b03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 0x7fdc900b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc96b03640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 0x7fdc900b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc96b03640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc900b5a60 con 0x7fdc900b3550 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc96b03640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdc900b3ed0 con 0x7fdc900ce910 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc96b03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdc900b5d00 con 0x7fdc9015c3d0 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc950a0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 0x7fdc900b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc9489f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 0x7fdc900b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc87fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdc900b3550 0x7fdc900ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:46474/0 (socket says 172.21.15.134:46474) 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc87fff640 1 -- 172.21.15.134:0/639400900 learned_addr learned my addr 172.21.15.134:0/639400900 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc950a0640 1 --2- 172.21.15.134:0/639400900 >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 0x7fdc900b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:43064/0 (socket says 172.21.15.134:43064) 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc9489f640 1 -- 172.21.15.134:0/639400900 >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 msgr2=0x7fdc900b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc9489f640 1 --2- 172.21.15.134:0/639400900 >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 0x7fdc900b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc9489f640 1 -- 172.21.15.134:0/639400900 >> v1:172.21.15.177:6789/0 conn(0x7fdc900b3550 legacy=0x7fdc900ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.513+0000 7fdc9489f640 1 -- 172.21.15.134:0/639400900 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc900b5fe0 con 0x7fdc9015c3d0 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.514+0000 7fdc9489f640 1 --2- 172.21.15.134:0/639400900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 0x7fdc900b67e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097a0 tx=0x7fdc8c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488324f591d3a071 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.514+0000 7fdc877fe640 1 -- 172.21.15.134:0/639400900 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c037070 con 0x7fdc9015c3d0 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.514+0000 7fdc877fe640 1 -- 172.21.15.134:0/639400900 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c032440 con 0x7fdc9015c3d0 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.514+0000 7fdc877fe640 1 -- 172.21.15.134:0/639400900 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c032810 con 0x7fdc9015c3d0 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 -- 172.21.15.134:0/639400900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 msgr2=0x7fdc900b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 --2- 172.21.15.134:0/639400900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 0x7fdc900b67e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097a0 tx=0x7fdc8c02a180 comp rx=0 tx=0).stop 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 -- 172.21.15.134:0/639400900 shutdown_connections 2024-09-15T22:48:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 --2- 172.21.15.134:0/639400900 >> v2:172.21.15.177:3300/0 conn(0x7fdc900ce910 0x7fdc900b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 --2- 172.21.15.134:0/639400900 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc9015c3d0 0x7fdc900b67e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 -- 172.21.15.134:0/639400900 >> 172.21.15.134:0/639400900 conn(0x7fdc9006ce90 msgr2=0x7fdc9006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 -- 172.21.15.134:0/639400900 shutdown_connections 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.515+0000 7fdc96b03640 1 -- 172.21.15.134:0/639400900 wait complete. 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.516+0000 7fdc96b03640 1 Processor -- start 2024-09-15T22:48:13.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.516+0000 7fdc96b03640 1 -- start start 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc900b3550 0x7fdc90149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc900ce910 0x7fdc9014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc900cef70 con 0x7fdc9015c3d0 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc900b6d20 con 0x7fdc900b3550 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc96b03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdc900cf0f0 con 0x7fdc900ce910 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39828/0 (socket says 172.21.15.134:39828) 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 -- 172.21.15.134:0/2793208147 learned_addr learned my addr 172.21.15.134:0/2793208147 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc9489f640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc900b3550 0x7fdc90149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc87fff640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc900ce910 0x7fdc9014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 -- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc900ce910 msgr2=0x7fdc9014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc900ce910 0x7fdc9014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 -- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc900b3550 msgr2=0x7fdc90149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc900b3550 0x7fdc90149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.517+0000 7fdc950a0640 1 -- 172.21.15.134:0/2793208147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9014e100 con 0x7fdc9015c3d0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc950a0640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800efc0 tx=0x7fdc8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88018020 con 0x7fdc9015c3d0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc88014480 con 0x7fdc9015c3d0 2024-09-15T22:48:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc90148c30 con 0x7fdc9015c3d0 2024-09-15T22:48:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88014870 con 0x7fdc9015c3d0 2024-09-15T22:48:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.518+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc901494d0 con 0x7fdc9015c3d0 2024-09-15T22:48:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.519+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc900b3990 con 0x7fdc9015c3d0 2024-09-15T22:48:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.519+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fdc88005d10 con 0x7fdc9015c3d0 2024-09-15T22:48:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.520+0000 7fdc857fa640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 0x7fdc7c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.520+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7fdc8808a7c0 con 0x7fdc9015c3d0 2024-09-15T22:48:13.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.520+0000 7fdc9489f640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 0x7fdc7c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.520+0000 7fdc9489f640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 0x7fdc7c06ef50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c034000 tx=0x7fdc8c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.524+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc88022070 con 0x7fdc9015c3d0 2024-09-15T22:48:13.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.754+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7fdc900b0f60 con 0x7fdc9015c3d0 2024-09-15T22:48:13.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.825+0000 7fdc857fa640 1 -- 172.21.15.134:0/2793208147 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v378) ==== 148+0+0 (secure 0 0 0) 0x7fdc88010040 con 0x7fdc9015c3d0 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 msgr2=0x7fdc7c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 0x7fdc7c06ef50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c034000 tx=0x7fdc8c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 msgr2=0x7fdc9014dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800efc0 tx=0x7fdc8800c490 comp rx=0 tx=0).stop 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 shutdown_connections 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdc7c06ca90 0x7fdc7c06ef50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc9015c3d0 0x7fdc9014dbc0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc900ce910 0x7fdc9014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 --2- 172.21.15.134:0/2793208147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc900b3550 0x7fdc90149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 >> 172.21.15.134:0/2793208147 conn(0x7fdc9006ce90 msgr2=0x7fdc901598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 shutdown_connections 2024-09-15T22:48:13.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.827+0000 7fdc96b03640 1 -- 172.21.15.134:0/2793208147 wait complete. 2024-09-15T22:48:13.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:48:13.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.938+0000 7f40906d2640 1 Processor -- start 2024-09-15T22:48:13.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.938+0000 7f40906d2640 1 -- start start 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f40906d2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f408815b090 0x7f40880b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f40906d2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f408806ea00 0x7f4088164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f40906d2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4088071de0 con 0x7f40880715b0 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f40906d2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f40880720c0 con 0x7f408815b090 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f40906d2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f40880723a0 con 0x7f408806ea00 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f408e46e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f408815b090 0x7f40880b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f408dc6d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f40880715b0 0x7f408815b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50420/0 (socket says 172.21.15.134:50420) 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f408e46e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f408815b090 0x7f40880b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39844/0 (socket says 172.21.15.134:39844) 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.939+0000 7f408e46e640 1 -- 172.21.15.134:0/3480772070 learned_addr learned my addr 172.21.15.134:0/3480772070 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:13.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408e46e640 1 -- 172.21.15.134:0/3480772070 >> v2:172.21.15.177:3300/0 conn(0x7f408806ea00 msgr2=0x7f4088164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:13.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408e46e640 1 --2- 172.21.15.134:0/3480772070 >> v2:172.21.15.177:3300/0 conn(0x7f408806ea00 0x7f4088164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408e46e640 1 -- 172.21.15.134:0/3480772070 >> v1:172.21.15.134:6789/0 conn(0x7f40880715b0 legacy=0x7f408815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408e46e640 1 -- 172.21.15.134:0/3480772070 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088072680 con 0x7f408815b090 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408e46e640 1 --2- 172.21.15.134:0/3480772070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408815b090 0x7f40880b5420 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f408806cb80 tx=0x7f408402b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f0b5bab295a9af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.940+0000 7f408d46c640 1 -- 172.21.15.134:0/3480772070 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084038070 con 0x7f408815b090 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f408d46c640 1 -- 172.21.15.134:0/3480772070 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084033640 con 0x7f408815b090 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f408d46c640 1 -- 172.21.15.134:0/3480772070 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084033a10 con 0x7f408815b090 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 -- 172.21.15.134:0/3480772070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408815b090 msgr2=0x7f40880b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 --2- 172.21.15.134:0/3480772070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408815b090 0x7f40880b5420 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f408806cb80 tx=0x7f408402b380 comp rx=0 tx=0).stop 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 -- 172.21.15.134:0/3480772070 shutdown_connections 2024-09-15T22:48:13.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 --2- 172.21.15.134:0/3480772070 >> v2:172.21.15.177:3300/0 conn(0x7f408806ea00 0x7f4088164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 --2- 172.21.15.134:0/3480772070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408815b090 0x7f40880b5420 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 -- 172.21.15.134:0/3480772070 >> 172.21.15.134:0/3480772070 conn(0x7f408806bba0 msgr2=0x7f408806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:13.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 -- 172.21.15.134:0/3480772070 shutdown_connections 2024-09-15T22:48:13.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.941+0000 7f40906d2640 1 -- 172.21.15.134:0/3480772070 wait complete. 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.942+0000 7f40906d2640 1 Processor -- start 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.942+0000 7f40906d2640 1 -- start start 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 0x7f40880aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 0x7f4088157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4088071ba0 con 0x7f408806ea00 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4088071a20 con 0x7f40880715b0 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f40906d2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f408815bb80 con 0x7f408815b090 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f408e46e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f408e46e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39858/0 (socket says 172.21.15.134:39858) 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.943+0000 7f408e46e640 1 -- 172.21.15.134:0/2995697120 learned_addr learned my addr 172.21.15.134:0/2995697120 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:13.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408dc6d640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 0x7f40880aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408ec6f640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 0x7f4088157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 -- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 msgr2=0x7f4088157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 0x7f4088157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 -- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 msgr2=0x7f40880aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 0x7f40880aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 -- 172.21.15.134:0/2995697120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088149da0 con 0x7f408806ea00 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408dc6d640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 0x7f40880aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408ec6f640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 0x7f4088157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f408e46e640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f4084000c00 tx=0x7f40840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084043070 con 0x7f408806ea00 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084031970 con 0x7f408806ea00 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408814a080 con 0x7f408806ea00 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084038040 con 0x7f408806ea00 2024-09-15T22:48:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.944+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408814a640 con 0x7f408806ea00 2024-09-15T22:48:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.945+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40880b5420 con 0x7f408806ea00 2024-09-15T22:48:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.945+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f4084046070 con 0x7f408806ea00 2024-09-15T22:48:13.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.946+0000 7f407effd640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 0x7f406c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:13.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.946+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7f40840a9d90 con 0x7f408806ea00 2024-09-15T22:48:13.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.946+0000 7f408dc6d640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 0x7f406c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:13.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.947+0000 7f408dc6d640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 0x7f406c06ef50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40880cfa80 tx=0x7f4078009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:13.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:13.951+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4084079df0 con 0x7f408806ea00 2024-09-15T22:48:14.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.116+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f40880b3610 con 0x7f408806ea00 2024-09-15T22:48:14.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.119+0000 7f407effd640 1 -- 172.21.15.134:0/2995697120 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f40840796f0 con 0x7f408806ea00 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 msgr2=0x7f406c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 0x7f406c06ef50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40880cfa80 tx=0x7f4078009040 comp rx=0 tx=0).stop 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 msgr2=0x7f4088147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f4084000c00 tx=0x7f40840046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 shutdown_connections 2024-09-15T22:48:14.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f408815b090 0x7f4088157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40880715b0 0x7f40880aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f406c06ca90 0x7f406c06ef50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 --2- 172.21.15.134:0/2995697120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408806ea00 0x7f4088147050 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.121+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 >> 172.21.15.134:0/2995697120 conn(0x7f408806bba0 msgr2=0x7f408815a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.122+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 shutdown_connections 2024-09-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.122+0000 7f40906d2640 1 -- 172.21.15.134:0/2995697120 wait complete. 2024-09-15T22:48:14.134 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:48:14.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:14.182 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:14.226 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:48:14.226 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:14.226 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:14.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:14.242 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:14.242 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:14.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:14.284 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:14.284 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:14.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:14.299 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:14.299 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:14.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:14.342 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:48:14.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:14.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 Processor -- start 2024-09-15T22:48:14.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 -- start start 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a9015c3d0 0x7f1a900b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a900b3550 0x7f1a900b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 0x7f1a900ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1a900b3ed0 con 0x7f1a9015c3d0 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f1a900b5a60 con 0x7f1a900ce200 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.439+0000 7f1a94d66640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900b5d00 con 0x7f1a900b3550 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a9015c3d0 0x7f1a900b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a9015c3d0 0x7f1a900b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39868/0 (socket says 172.21.15.134:39868) 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 -- 172.21.15.134:0/1268605782 learned_addr learned my addr 172.21.15.134:0/1268605782 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:14.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 -- 172.21.15.134:0/1268605782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a900b3550 msgr2=0x7f1a900b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/1268605782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a900b3550 0x7f1a900b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 -- 172.21.15.134:0/1268605782 >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 msgr2=0x7f1a900ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8ed9d640 1 --2- 172.21.15.134:0/1268605782 >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 0x7f1a900ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/1268605782 >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 0x7f1a900ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8e59c640 1 -- 172.21.15.134:0/1268605782 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900b5fe0 con 0x7f1a9015c3d0 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.440+0000 7f1a8ed9d640 1 --2- 172.21.15.134:0/1268605782 >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 0x7f1a900ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/1268605782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9015c3d0 0x7f1a900b67e0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1a9015fe70 tx=0x7f1a8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b526f1bb4afe02f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a8d59a640 1 -- 172.21.15.134:0/1268605782 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88037070 con 0x7f1a9015c3d0 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a8d59a640 1 -- 172.21.15.134:0/1268605782 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88032440 con 0x7f1a9015c3d0 2024-09-15T22:48:14.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a8d59a640 1 -- 172.21.15.134:0/1268605782 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88032810 con 0x7f1a9015c3d0 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 -- 172.21.15.134:0/1268605782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9015c3d0 msgr2=0x7f1a900b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 --2- 172.21.15.134:0/1268605782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9015c3d0 0x7f1a900b67e0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1a9015fe70 tx=0x7f1a8802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 -- 172.21.15.134:0/1268605782 shutdown_connections 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 --2- 172.21.15.134:0/1268605782 >> v2:172.21.15.177:3300/0 conn(0x7f1a900ce200 0x7f1a900ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 --2- 172.21.15.134:0/1268605782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a900b3550 0x7f1a900b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 --2- 172.21.15.134:0/1268605782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9015c3d0 0x7f1a900b67e0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 -- 172.21.15.134:0/1268605782 >> 172.21.15.134:0/1268605782 conn(0x7f1a9006ce90 msgr2=0x7f1a9006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 -- 172.21.15.134:0/1268605782 shutdown_connections 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.441+0000 7f1a94d66640 1 -- 172.21.15.134:0/1268605782 wait complete. 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 Processor -- start 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 -- start start 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 0x7f1a900ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a9015c3d0 0x7f1a90158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900cebf0 con 0x7f1a900b3550 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900b6d20 con 0x7f1a900ce200 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.443+0000 7f1a94d66640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900cef70 con 0x7f1a9015c3d0 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39874/0 (socket says 172.21.15.134:39874) 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 -- 172.21.15.134:0/821419511 learned_addr learned my addr 172.21.15.134:0/821419511 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8ed9d640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a9015c3d0 0x7f1a90158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8dd9b640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 0x7f1a900ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 -- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a9015c3d0 msgr2=0x7f1a90158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a9015c3d0 0x7f1a90158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 -- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 msgr2=0x7f1a900ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 0x7f1a900ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 -- 172.21.15.134:0/821419511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900af0c0 con 0x7f1a900b3550 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8dd9b640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 0x7f1a900ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a8e59c640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1a8802a220 tx=0x7f1a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88037040 con 0x7f1a900b3550 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88042070 con 0x7f1a900b3550 2024-09-15T22:48:14.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a900af3a0 con 0x7f1a900b3550 2024-09-15T22:48:14.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88030bb0 con 0x7f1a900b3550 2024-09-15T22:48:14.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.444+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a900af960 con 0x7f1a900b3550 2024-09-15T22:48:14.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.445+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a900ce6b0 con 0x7f1a900b3550 2024-09-15T22:48:14.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.446+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f1a88047460 con 0x7f1a900b3550 2024-09-15T22:48:14.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.446+0000 7f1a86ffd640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 0x7f1a7006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.446+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4999+0+0 (secure 0 0 0) 0x7f1a880aaa40 con 0x7f1a900b3550 2024-09-15T22:48:14.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.446+0000 7f1a8dd9b640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 0x7f1a7006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.447+0000 7f1a8dd9b640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 0x7f1a7006ef50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a901f6370 tx=0x7f1a78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.450+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a88045360 con 0x7f1a900b3550 2024-09-15T22:48:14.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.650+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a9015ba30 con 0x7f1a900b3550 2024-09-15T22:48:14.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.651+0000 7f1a86ffd640 1 -- 172.21.15.134:0/821419511 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3920 (secure 0 0 0) 0x7f1a8807aaa0 con 0x7f1a900b3550 2024-09-15T22:48:14.652 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:14.653 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":78,"btime":"2024-09-15T22:48:09:800705+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/1259197056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1259197056},{"type":"v1","addr":"172.21.15.177:6834","nonce":1259197056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/439386357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":439386357},{"type":"v1","addr":"172.21.15.177:6835","nonce":439386357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1164076329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1164076329},{"type":"v1","addr":"172.21.15.134:6834","nonce":1164076329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2052252640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2052252640},{"type":"v1","addr":"172.21.15.134:6835","nonce":2052252640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-09-15T22:48:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 78 2024-09-15T22:48:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 msgr2=0x7f1a7006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 0x7f1a7006ef50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a901f6370 tx=0x7f1a78008040 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 msgr2=0x7f1a90156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1a8802a220 tx=0x7f1a880046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 shutdown_connections 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a9015c3d0 0x7f1a90158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a900ce200 0x7f1a900ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1a7006ca90 0x7f1a7006ef50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 --2- 172.21.15.134:0/821419511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a900b3550 0x7f1a90156e30 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 >> 172.21.15.134:0/821419511 conn(0x7f1a9006ce90 msgr2=0x7f1a9006f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 shutdown_connections 2024-09-15T22:48:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.653+0000 7f1a94d66640 1 -- 172.21.15.134:0/821419511 wait complete. 2024-09-15T22:48:14.666 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:48:14.666 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:48:14.666 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:48:14.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:14.666 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:48:14.666 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:48:14.667 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:48:14.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:14.667 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:48:14.667 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:48:14.667 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:48:14.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:14.667 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:48:14.667 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:48:14.668 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:48:14.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:14.675 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:48:14.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:48:14.676 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:48:14.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:48:14.679 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:48:14.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:48:14.680 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:48:14.680 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:48:14.718 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:48:14.718 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:14.719 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:48:14.719 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:14.722 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:48:14.722 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:14.722 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:48:14.723 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:14.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:48:14.793 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:48:14.794 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:48:14.803 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:48:14.804 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:48:14.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.824+0000 7f60bcd0a640 1 Processor -- start 2024-09-15T22:48:14.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.824+0000 7f60bcd0a640 1 -- start start 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60bcd0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60b80cd7a0 0x7f60b80cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60bcd0a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 0x7f60b80cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60bcd0a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b80ce0c0 con 0x7f60b80cfc90 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60bcd0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f60b815e0e0 con 0x7f60b80cd7a0 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60bcd0a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f60b815e3c0 con 0x7f60b80b5640 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60b80cd7a0 0x7f60b80cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60b80cd7a0 0x7f60b80cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39894/0 (socket says 172.21.15.134:39894) 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 -- 172.21.15.134:0/485935802 learned_addr learned my addr 172.21.15.134:0/485935802 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b5d9b640 1 --2- 172.21.15.134:0/485935802 >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 0x7f60b80cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 -- 172.21.15.134:0/485935802 >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 msgr2=0x7f60b80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 --2- 172.21.15.134:0/485935802 >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 0x7f60b80cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.825+0000 7f60b659c640 1 -- 172.21.15.134:0/485935802 >> v1:172.21.15.177:6789/0 conn(0x7f60b80cfc90 legacy=0x7f60b806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.826+0000 7f60b659c640 1 -- 172.21.15.134:0/485935802 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b815e6a0 con 0x7f60b80cd7a0 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.826+0000 7f60b5d9b640 1 --2- 172.21.15.134:0/485935802 >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 0x7f60b80cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:14.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.826+0000 7f60b659c640 1 --2- 172.21.15.134:0/485935802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cd7a0 0x7f60b80cdb80 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f60b8070d00 tx=0x7f60a802b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9782cbd3ba1f0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60b559a640 1 -- 172.21.15.134:0/485935802 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8008730 con 0x7f60b80cd7a0 2024-09-15T22:48:14.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60b559a640 1 -- 172.21.15.134:0/485935802 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a80088d0 con 0x7f60b80cd7a0 2024-09-15T22:48:14.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60b559a640 1 -- 172.21.15.134:0/485935802 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8008ca0 con 0x7f60b80cd7a0 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 -- 172.21.15.134:0/485935802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cd7a0 msgr2=0x7f60b80cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/485935802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cd7a0 0x7f60b80cdb80 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f60b8070d00 tx=0x7f60a802b420 comp rx=0 tx=0).stop 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 -- 172.21.15.134:0/485935802 shutdown_connections 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/485935802 >> v2:172.21.15.177:3300/0 conn(0x7f60b80b5640 0x7f60b80cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/485935802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cd7a0 0x7f60b80cdb80 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.830+0000 7f60bcd0a640 1 -- 172.21.15.134:0/485935802 >> 172.21.15.134:0/485935802 conn(0x7f60b8062cc0 msgr2=0x7f60b806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:14.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.831+0000 7f60bcd0a640 1 -- 172.21.15.134:0/485935802 shutdown_connections 2024-09-15T22:48:14.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.831+0000 7f60bcd0a640 1 -- 172.21.15.134:0/485935802 wait complete. 2024-09-15T22:48:14.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.832+0000 7f60bcd0a640 1 Processor -- start 2024-09-15T22:48:14.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.832+0000 7f60bcd0a640 1 -- start start 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60b80b5640 0x7f60b8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60b80cd7a0 0x7f60b81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60b815a820 con 0x7f60b80cfc90 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f60b815ec60 con 0x7f60b80b5640 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60bcd0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f60b815a9a0 con 0x7f60b80cd7a0 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39906/0 (socket says 172.21.15.134:39906) 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 -- 172.21.15.134:0/1412694989 learned_addr learned my addr 172.21.15.134:0/1412694989 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60b80b5640 0x7f60b8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b5d9b640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60b80cd7a0 0x7f60b81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 -- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60b80cd7a0 msgr2=0x7f60b81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60b80cd7a0 0x7f60b81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 -- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60b80b5640 msgr2=0x7f60b8157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60b80b5640 0x7f60b8157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 -- 172.21.15.134:0/1412694989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b8150710 con 0x7f60b80cfc90 2024-09-15T22:48:14.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.833+0000 7f60b6d9d640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c730 tx=0x7f60b000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.836+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0016020 con 0x7f60b80cfc90 2024-09-15T22:48:14.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.836+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b81583d0 con 0x7f60b80cfc90 2024-09-15T22:48:14.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.836+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b0006d50 con 0x7f60b80cfc90 2024-09-15T22:48:14.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.836+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0003bb0 con 0x7f60b80cfc90 2024-09-15T22:48:14.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.836+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b8158990 con 0x7f60b80cfc90 2024-09-15T22:48:14.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.837+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b806f030 con 0x7f60b80cfc90 2024-09-15T22:48:14.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.837+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f60b00050d0 con 0x7f60b80cfc90 2024-09-15T22:48:14.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.838+0000 7f60a6ffd640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 0x7f609806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:14.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.838+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 4999+0+0 (secure 0 0 0) 0x7f60b0089950 con 0x7f60b80cfc90 2024-09-15T22:48:14.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.838+0000 7f60b659c640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 0x7f609806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:14.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.838+0000 7f60b659c640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 0x7f609806ef50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f60a8035000 tx=0x7f60a8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:14.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:14.842+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60b0020020 con 0x7f60b80cfc90 2024-09-15T22:48:15.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.019+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f60b80b1950 con 0x7f60b80cfc90 2024-09-15T22:48:15.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.853+0000 7f60a6ffd640 1 -- 172.21.15.134:0/1412694989 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) ==== 97+0+0 (secure 0 0 0) 0x7f60b00592e0 con 0x7f60b80cfc90 2024-09-15T22:48:15.857 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:48:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 msgr2=0x7f609806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 0x7f609806ef50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f60a8035000 tx=0x7f60a8030000 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 msgr2=0x7f60b814cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c730 tx=0x7f60b000cb30 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 shutdown_connections 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f609806ca90 0x7f609806ef50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b80cfc90 0x7f60b814cb40 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60b80cd7a0 0x7f60b81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 --2- 172.21.15.134:0/1412694989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60b80b5640 0x7f60b8157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 >> 172.21.15.134:0/1412694989 conn(0x7f60b8062cc0 msgr2=0x7f60b80aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 shutdown_connections 2024-09-15T22:48:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.856+0000 7f60bcd0a640 1 -- 172.21.15.134:0/1412694989 wait complete. 2024-09-15T22:48:15.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:48:15.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.970+0000 7fc4d0645640 1 Processor -- start 2024-09-15T22:48:15.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.970+0000 7fc4d0645640 1 -- start start 2024-09-15T22:48:15.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4d0645640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4c80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4d0645640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc4c815ce80 0x7fc4c81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4d0645640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c80d0bc0 con 0x7fc4c815ca40 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4d0645640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c815d390 con 0x7fc4c815ce80 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4d0645640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c815d670 con 0x7fc4c80d02a0 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cdbe0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc4c815ca40 0x7fc4c815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50442/0 (socket says 172.21.15.134:50442) 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cdbe0640 1 -- 172.21.15.134:0/3498773546 learned_addr learned my addr 172.21.15.134:0/3498773546 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4c80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cebe2640 1 --2- 172.21.15.134:0/3498773546 >> v2:172.21.15.177:3300/0 conn(0x7fc4c815ce80 0x7fc4c81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382453052 0 0) 0x7fc4c80d0bc0 con 0x7fc4c815ca40 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4b4003520 con 0x7fc4c815ca40 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930822012 0 0) 0x7fc4b4003520 con 0x7fc4c815ca40 2024-09-15T22:48:15.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 msgr2=0x7fc4c80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4c80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 >> v2:172.21.15.177:3300/0 conn(0x7fc4c815ce80 msgr2=0x7fc4c81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 --2- 172.21.15.134:0/3498773546 >> v2:172.21.15.177:3300/0 conn(0x7fc4c815ce80 0x7fc4c81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c815d950 con 0x7fc4c815ca40 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc4b8001670 con 0x7fc4c815ca40 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 >> v1:172.21.15.134:6789/0 conn(0x7fc4c815ca40 legacy=0x7fc4c815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4b4004800 0x7fc4b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c815d390 con 0x7fc4b40039b0 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c815d670 con 0x7fc4b4004800 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.971+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b400b9c0 con 0x7fc4c80d02a0 2024-09-15T22:48:15.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4cdbe0640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4b4004800 0x7fc4b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4cebe2640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 msgr2=0x7fc4b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4b4004800 msgr2=0x7fc4b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4b4004800 0x7fc4b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/3498773546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b4003520 con 0x7fc4b40039b0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4cdbe0640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4b4004800 0x7fc4b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4cebe2640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c80d02a0 0x7fc4b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.972+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4b4003dd0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009af0 tx=0x7fc4b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a359fcd14464bc29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4036070 con 0x7fc4b40039b0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4031400 con 0x7fc4b40039b0 2024-09-15T22:48:15.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4cd3df640 1 -- 172.21.15.134:0/3498773546 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4009690 con 0x7fc4b40039b0 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 -- 172.21.15.134:0/3498773546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 msgr2=0x7fc4b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 --2- 172.21.15.134:0/3498773546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4b4003dd0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009af0 tx=0x7fc4b4005830 comp rx=0 tx=0).stop 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4cebe2640 1 -- 172.21.15.134:0/3498773546 reap_dead start 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 -- 172.21.15.134:0/3498773546 shutdown_connections 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 -- 172.21.15.134:0/3498773546 >> 172.21.15.134:0/3498773546 conn(0x7fc4c8062cc0 msgr2=0x7fc4c806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 -- 172.21.15.134:0/3498773546 shutdown_connections 2024-09-15T22:48:15.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.973+0000 7fc4d0645640 1 -- 172.21.15.134:0/3498773546 wait complete. 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.974+0000 7fc4d0645640 1 Processor -- start 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.974+0000 7fc4d0645640 1 -- start start 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c8072290 0x7fc4c8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c80726f0 0x7fc4c81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c815eb40 con 0x7fc4b40039b0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c815df10 con 0x7fc4c80726f0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4d0645640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c8155b90 con 0x7fc4c8072290 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39920/0 (socket says 172.21.15.134:39920) 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/528222875 learned_addr learned my addr 172.21.15.134:0/528222875 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c8072290 msgr2=0x7fc4c8153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c8072290 0x7fc4c8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c80726f0 msgr2=0x7fc4c81541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.975+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c80726f0 0x7fc4c81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4ce3e1640 1 -- 172.21.15.134:0/528222875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c8072be0 con 0x7fc4b40039b0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4ce3e1640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4034040 tx=0x7fc4c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4041020 con 0x7fc4b40039b0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c403c470 con 0x7fc4b40039b0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c8072ec0 con 0x7fc4b40039b0 2024-09-15T22:48:15.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4036040 con 0x7fc4b40039b0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.976+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c8073480 con 0x7fc4b40039b0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.977+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c80b4790 con 0x7fc4b40039b0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.977+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fc4c4044020 con 0x7fc4b40039b0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.978+0000 7fc4beffd640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 0x7fc4ac06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.978+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4913+0+0 (secure 0 0 0) 0x7fc4c40acb10 con 0x7fc4b40039b0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.978+0000 7fc4cdbe0640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 0x7fc4ac06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:15.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.979+0000 7fc4cdbe0640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 0x7fc4ac06ef50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001c50 tx=0x7fc4b8001bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:15.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:15.982+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4c404b030 con 0x7fc4b40039b0 2024-09-15T22:48:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.209+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc4c815b4b0 con 0x7fc4b40039b0 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.210+0000 7fc4beffd640 1 -- 172.21.15.134:0/528222875 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fc4c407a570 con 0x7fc4b40039b0 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.211 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:48:16.212 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:16.213 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:48:16.215 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:48:16.217 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.218 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.220 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.222 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:48:16.224 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:48:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:48:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 msgr2=0x7fc4ac06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 0x7fc4ac06ef50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001c50 tx=0x7fc4b8001bc0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 msgr2=0x7fc4c8147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4034040 tx=0x7fc4c4004730 comp rx=0 tx=0).stop 2024-09-15T22:48:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 shutdown_connections 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c80726f0 0x7fc4c81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c8072290 0x7fc4c8153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc4ac06ca90 0x7fc4ac06ef50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 --2- 172.21.15.134:0/528222875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b40039b0 0x7fc4c8147e00 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 >> 172.21.15.134:0/528222875 conn(0x7fc4c8062cc0 msgr2=0x7fc4c80b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 shutdown_connections 2024-09-15T22:48:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.212+0000 7fc4d0645640 1 -- 172.21.15.134:0/528222875 wait complete. 2024-09-15T22:48:16.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:48:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.332+0000 7f8134dc4640 1 Processor -- start 2024-09-15T22:48:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.332+0000 7f8134dc4640 1 -- start start 2024-09-15T22:48:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f8134dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f81300b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f8134dc4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81300cef90 0x7f81300b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f8134dc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81300b7170 con 0x7f813015e940 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f8134dc4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f81300b7aa0 con 0x7f81300cef90 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f8134dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f81300d3660 con 0x7f813015ed20 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f812ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81300cef90 0x7f81300b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f812ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81300cef90 0x7f81300b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50824/0 (socket says 172.21.15.134:50824) 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f812ed9d640 1 -- 172.21.15.134:0/4116686939 learned_addr learned my addr 172.21.15.134:0/4116686939 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.333+0000 7f812e59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f813015e940 0x7f81300d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55330/0 (socket says 172.21.15.134:55330) 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.334+0000 7f812ed9d640 1 -- 172.21.15.134:0/4116686939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 msgr2=0x7f81300b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.334+0000 7f812ed9d640 1 --2- 172.21.15.134:0/4116686939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f81300b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.334+0000 7f812ed9d640 1 -- 172.21.15.134:0/4116686939 >> v1:172.21.15.134:6789/0 conn(0x7f813015e940 legacy=0x7f81300d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.334+0000 7f812ed9d640 1 -- 172.21.15.134:0/4116686939 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81300d3940 con 0x7f81300cef90 2024-09-15T22:48:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.334+0000 7f812ed9d640 1 --2- 172.21.15.134:0/4116686939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f81300b3760 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8128009870 tx=0x7f812802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da017ed5c86c960 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f812d59a640 1 -- 172.21.15.134:0/4116686939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128037070 con 0x7f81300cef90 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f812d59a640 1 -- 172.21.15.134:0/4116686939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128032440 con 0x7f81300cef90 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f812d59a640 1 -- 172.21.15.134:0/4116686939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128032810 con 0x7f81300cef90 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 -- 172.21.15.134:0/4116686939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 msgr2=0x7f81300b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 --2- 172.21.15.134:0/4116686939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f81300b3760 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8128009870 tx=0x7f812802a200 comp rx=0 tx=0).stop 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 -- 172.21.15.134:0/4116686939 shutdown_connections 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 --2- 172.21.15.134:0/4116686939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f81300b3760 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 --2- 172.21.15.134:0/4116686939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f81300b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 -- 172.21.15.134:0/4116686939 >> 172.21.15.134:0/4116686939 conn(0x7f81300b6240 msgr2=0x7f81300b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 -- 172.21.15.134:0/4116686939 shutdown_connections 2024-09-15T22:48:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.335+0000 7f8134dc4640 1 -- 172.21.15.134:0/4116686939 wait complete. 2024-09-15T22:48:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 Processor -- start 2024-09-15T22:48:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 -- start start 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 0x7f8130158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f8130158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81300d3310 con 0x7f81300cef90 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81300d3f00 con 0x7f813015e940 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f8134dc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f81300d1ef0 con 0x7f813015ed20 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f812e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f812e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50840/0 (socket says 172.21.15.134:50840) 2024-09-15T22:48:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.337+0000 7f812e59c640 1 -- 172.21.15.134:0/1352791961 learned_addr learned my addr 172.21.15.134:0/1352791961 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 -- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 msgr2=0x7f8130158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812ed9d640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f8130158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f8130158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 -- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 msgr2=0x7f8130158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812dd9b640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 0x7f8130158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 0x7f8130158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 -- 172.21.15.134:0/1352791961 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813015ac50 con 0x7f81300cef90 2024-09-15T22:48:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812dd9b640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 0x7f8130158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f812e59c640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f812000cb60 tx=0x7f812000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120018070 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8120004d60 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812000ad80 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813015af30 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.338+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813015b4f0 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.339+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81300d1060 con 0x7f81300cef90 2024-09-15T22:48:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.340+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f812001b070 con 0x7f81300cef90 2024-09-15T22:48:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.340+0000 7f8126ffd640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 0x7f811006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.340+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4913+0+0 (secure 0 0 0) 0x7f8120089830 con 0x7f81300cef90 2024-09-15T22:48:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.340+0000 7f812dd9b640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 0x7f811006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.341+0000 7f812dd9b640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 0x7f811006ef50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f81300cb6f0 tx=0x7f8118008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.344+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81300b7170 con 0x7f81300cef90 2024-09-15T22:48:16.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.511+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f81300cc850 con 0x7f81300cef90 2024-09-15T22:48:16.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.511+0000 7f8126ffd640 1 -- 172.21.15.134:0/1352791961 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) ==== 84+0+65 (secure 0 0 0) 0x7f81300cc850 con 0x7f81300cef90 2024-09-15T22:48:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:16.513 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:48:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:48:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:48:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:16.514 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:48:16.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.513+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 msgr2=0x7f811006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.513+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 0x7f811006ef50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f81300cb6f0 tx=0x7f8118008040 comp rx=0 tx=0).stop 2024-09-15T22:48:16.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.513+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 msgr2=0x7f813015a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.513+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f812000cb60 tx=0x7f812000a430 comp rx=0 tx=0).stop 2024-09-15T22:48:16.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 shutdown_connections 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f813015ed20 0x7f8130158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813015e940 0x7f8130158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f811006ca90 0x7f811006ef50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 --2- 172.21.15.134:0/1352791961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81300cef90 0x7f813015a3b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 >> 172.21.15.134:0/1352791961 conn(0x7f81300b6240 msgr2=0x7f813015feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 shutdown_connections 2024-09-15T22:48:16.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.514+0000 7f8134dc4640 1 -- 172.21.15.134:0/1352791961 wait complete. 2024-09-15T22:48:16.526 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:48:16.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:48:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.629+0000 7ff28214b640 1 Processor -- start 2024-09-15T22:48:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.629+0000 7ff28214b640 1 -- start start 2024-09-15T22:48:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff28214b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff27c15f9f0 0x7ff27c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff28214b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c15c970 con 0x7ff27c15b370 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff28214b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c15bbb0 con 0x7ff27c06f130 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff28214b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff27c15fef0 con 0x7ff27c15f9f0 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff27c15f9f0 0x7ff27c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff27c15f9f0 0x7ff27c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50856/0 (socket says 172.21.15.134:50856) 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 -- 172.21.15.134:0/1923466126 learned_addr learned my addr 172.21.15.134:0/1923466126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27b7fe640 1 --1- 172.21.15.134:0/1923466126 >> v1:172.21.15.134:6789/0 conn(0x7ff27c15b370 0x7ff27c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55332/0 (socket says 172.21.15.134:55332) 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 -- 172.21.15.134:0/1923466126 >> v1:172.21.15.177:6789/0 conn(0x7ff27c06f130 legacy=0x7ff27c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 -- 172.21.15.134:0/1923466126 >> v1:172.21.15.134:6789/0 conn(0x7ff27c15b370 legacy=0x7ff27c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27a7fc640 1 -- 172.21.15.134:0/1923466126 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112866741 0 0) 0x7ff27c15c970 con 0x7ff27c15b370 2024-09-15T22:48:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.630+0000 7ff27bfff640 1 -- 172.21.15.134:0/1923466126 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c15be90 con 0x7ff27c15f9f0 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.631+0000 7ff27bfff640 1 --2- 172.21.15.134:0/1923466126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c072560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff27402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119c0868ef687d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.631+0000 7ff27a7fc640 1 -- 172.21.15.134:0/1923466126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274036070 con 0x7ff27c15f9f0 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.631+0000 7ff27a7fc640 1 -- 172.21.15.134:0/1923466126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274031600 con 0x7ff27c15f9f0 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.631+0000 7ff27a7fc640 1 -- 172.21.15.134:0/1923466126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740319d0 con 0x7ff27c15f9f0 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 -- 172.21.15.134:0/1923466126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 msgr2=0x7ff27c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 --2- 172.21.15.134:0/1923466126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c072560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff27402a6d0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 -- 172.21.15.134:0/1923466126 shutdown_connections 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 --2- 172.21.15.134:0/1923466126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c072560 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 -- 172.21.15.134:0/1923466126 >> 172.21.15.134:0/1923466126 conn(0x7ff27c06bba0 msgr2=0x7ff27c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 -- 172.21.15.134:0/1923466126 shutdown_connections 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.632+0000 7ff28214b640 1 -- 172.21.15.134:0/1923466126 wait complete. 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.633+0000 7ff28214b640 1 Processor -- start 2024-09-15T22:48:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.633+0000 7ff28214b640 1 -- start start 2024-09-15T22:48:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c06f130 0x7ff27c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff27c15b370 0x7ff27c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0731b0 con 0x7ff27c15f9f0 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c15c450 con 0x7ff27c06f130 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c15b750 con 0x7ff27c15b370 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50862/0 (socket says 172.21.15.134:50862) 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 -- 172.21.15.134:0/765044782 learned_addr learned my addr 172.21.15.134:0/765044782 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27b7fe640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c06f130 0x7ff27c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27affd640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff27c15b370 0x7ff27c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 -- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff27c15b370 msgr2=0x7ff27c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff27c15b370 0x7ff27c152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 -- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c06f130 msgr2=0x7ff27c144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c06f130 0x7ff27c144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 -- 172.21.15.134:0/765044782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1530a0 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff27bfff640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274041070 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274003990 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c153380 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.634+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274036040 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.635+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c153940 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.635+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c072560 con 0x7ff27c15f9f0 2024-09-15T22:48:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.636+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7ff274007820 con 0x7ff27c15f9f0 2024-09-15T22:48:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.636+0000 7ff263fff640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 0x7ff26806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.637+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4913+0+0 (secure 0 0 0) 0x7ff2740aa810 con 0x7ff27c15f9f0 2024-09-15T22:48:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.637+0000 7ff27b7fe640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 0x7ff26806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.637+0000 7ff27b7fe640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 0x7ff26806ef50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:16.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.641+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff27404b020 con 0x7ff27c15f9f0 2024-09-15T22:48:16.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:16.807+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff27c145330 con 0x7ff27c15f9f0 2024-09-15T22:48:17.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.123+0000 7ff263fff640 1 -- 172.21.15.134:0/765044782 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) ==== 138+0+0 (secure 0 0 0) 0x7ff27407a2e0 con 0x7ff27c15f9f0 2024-09-15T22:48:17.125 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 msgr2=0x7ff26806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 0x7ff26806ef50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c007d50 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 msgr2=0x7ff27c1f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff274004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 shutdown_connections 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff26806ca90 0x7ff26806ef50 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c007d50 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c15f9f0 0x7ff27c1f4fe0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff27c15b370 0x7ff27c152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 --2- 172.21.15.134:0/765044782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c06f130 0x7ff27c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 >> 172.21.15.134:0/765044782 conn(0x7ff27c06bba0 msgr2=0x7ff27c0b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.126+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 shutdown_connections 2024-09-15T22:48:17.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.127+0000 7ff28214b640 1 -- 172.21.15.134:0/765044782 wait complete. 2024-09-15T22:48:17.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:48:17.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.247+0000 7f83849e8640 1 Processor -- start 2024-09-15T22:48:17.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.247+0000 7f83849e8640 1 -- start start 2024-09-15T22:48:17.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.248+0000 7f83849e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f8380073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.248+0000 7f83849e8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83800b73d0 0x7f838015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.248+0000 7f83849e8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f838015fef0 con 0x7f838015fab0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.248+0000 7f83849e8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8380073530 con 0x7f83800b73d0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.248+0000 7f83849e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83800b5600 con 0x7f83800b6ff0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837ed9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f838015fab0 0x7f8380160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55334/0 (socket says 172.21.15.134:55334) 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837ed9d640 1 -- 172.21.15.134:0/1231070453 learned_addr learned my addr 172.21.15.134:0/1231070453 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837dd9b640 1 --2- 172.21.15.134:0/1231070453 >> v2:172.21.15.177:3300/0 conn(0x7f83800b73d0 0x7f838015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421427620 0 0) 0x7f838015fef0 con 0x7f838015fab0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837e59c640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f8380073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8368003520 con 0x7f838015fab0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1255769942 0 0) 0x7f8368003520 con 0x7f838015fab0 2024-09-15T22:48:17.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 msgr2=0x7f8380073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f8380073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 >> v2:172.21.15.177:3300/0 conn(0x7f83800b73d0 msgr2=0x7f838015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 --2- 172.21.15.134:0/1231070453 >> v2:172.21.15.177:3300/0 conn(0x7f83800b73d0 0x7f838015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83800b58e0 con 0x7f838015fab0 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f83780019f0 con 0x7f838015fab0 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 >> v1:172.21.15.134:6789/0 conn(0x7f838015fab0 legacy=0x7f8380160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f83680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b5600 con 0x7f83680039b0 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f836800b9c0 con 0x7f8368004800 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f836800bb40 con 0x7f83800b6ff0 2024-09-15T22:48:17.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837e59c640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837dd9b640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.249+0000 7f837ed9d640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f83680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 -- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 msgr2=0x7f83680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83800b6ff0 0x7f83680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 -- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8368004800 msgr2=0x7f8368004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 -- 172.21.15.134:0/1231070453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368003520 con 0x7f83680039b0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837e59c640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83680039b0 0x7f8368003dd0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ac0 tx=0x7f8368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d454c5cac1bb77f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370036070 con 0x7f83680039b0 2024-09-15T22:48:17.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370031400 con 0x7f83680039b0 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.250+0000 7f837d59a640 1 -- 172.21.15.134:0/1231070453 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370009690 con 0x7f83680039b0 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 -- 172.21.15.134:0/1231070453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83680039b0 msgr2=0x7f8368003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 --2- 172.21.15.134:0/1231070453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83680039b0 0x7f8368003dd0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ac0 tx=0x7f8368005830 comp rx=0 tx=0).stop 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f837ed9d640 1 -- 172.21.15.134:0/1231070453 reap_dead start 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 -- 172.21.15.134:0/1231070453 shutdown_connections 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 -- 172.21.15.134:0/1231070453 >> 172.21.15.134:0/1231070453 conn(0x7f8380062630 msgr2=0x7f8380062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 -- 172.21.15.134:0/1231070453 shutdown_connections 2024-09-15T22:48:17.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.251+0000 7f83849e8640 1 -- 172.21.15.134:0/1231070453 wait complete. 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.252+0000 7f83849e8640 1 Processor -- start 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.252+0000 7f83849e8640 1 -- start start 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83680039b0 0x7f838014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 0x7f8380153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b6180 con 0x7f83801557f0 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b5ea0 con 0x7f83680039b0 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f83849e8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f83800b6460 con 0x7f83801512d0 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50880/0 (socket says 172.21.15.134:50880) 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 -- 172.21.15.134:0/672267929 learned_addr learned my addr 172.21.15.134:0/672267929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837e59c640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83680039b0 0x7f838014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837ed9d640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 0x7f8380153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 -- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 msgr2=0x7f8380153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 0x7f8380153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 -- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83680039b0 msgr2=0x7f838014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83680039b0 0x7f838014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837dd9b640 1 -- 172.21.15.134:0/672267929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380152760 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.253+0000 7f837ed9d640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 0x7f8380153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f837dd9b640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f83740119c0 tx=0x7f8374011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837400faf0 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837400fc90 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374014440 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8380152a40 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.254+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838015cde0 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.255+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380152c10 con 0x7f83801557f0 2024-09-15T22:48:17.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.256+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f8374012040 con 0x7f83801557f0 2024-09-15T22:48:17.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.256+0000 7f836effd640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 0x7f836006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:17.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.256+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5283+0+0 (secure 0 0 0) 0x7f837408a340 con 0x7f83801557f0 2024-09-15T22:48:17.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.256+0000 7f837e59c640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 0x7f836006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:17.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.257+0000 7f837e59c640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 0x7f836006ef80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8370033000 tx=0x7f8370008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:17.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.260+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8380152c10 con 0x7f83801557f0 2024-09-15T22:48:17.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:17.425+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f838015c8f0 con 0x7f83801557f0 2024-09-15T22:48:18.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.129+0000 7f836effd640 1 -- 172.21.15.134:0/672267929 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) ==== 170+0+0 (secure 0 0 0) 0x7f8374019030 con 0x7f83801557f0 2024-09-15T22:48:18.130 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:48:18.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 msgr2=0x7f836006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 0x7f836006ef80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8370033000 tx=0x7f8370008030 comp rx=0 tx=0).stop 2024-09-15T22:48:18.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 msgr2=0x7f83801537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f83740119c0 tx=0x7f8374011e80 comp rx=0 tx=0).stop 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 shutdown_connections 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83801512d0 0x7f8380153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f836006cac0 0x7f836006ef80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83801557f0 0x7f83801537e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 --2- 172.21.15.134:0/672267929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83680039b0 0x7f838014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 >> 172.21.15.134:0/672267929 conn(0x7f8380062630 msgr2=0x7f838015fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 shutdown_connections 2024-09-15T22:48:18.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.132+0000 7f83849e8640 1 -- 172.21.15.134:0/672267929 wait complete. 2024-09-15T22:48:18.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:48:18.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.262+0000 7fb27a3f8640 1 Processor -- start 2024-09-15T22:48:18.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.262+0000 7fb27a3f8640 1 -- start start 2024-09-15T22:48:18.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb27a3f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb274161e30 0x7fb2740d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb27a3f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2740b3d50 0x7fb27406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb27a3f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2740cf9a0 con 0x7fb2740b3290 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb27a3f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb2740cfcf0 con 0x7fb2740b3d50 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb27a3f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb274162210 con 0x7fb274161e30 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb2737fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2740b3d50 0x7fb27406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb278995640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb2740b3290 0x7fb2740b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55340/0 (socket says 172.21.15.134:55340) 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb278995640 1 -- 172.21.15.134:0/189548044 learned_addr learned my addr 172.21.15.134:0/189548044 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb2737fe640 1 -- 172.21.15.134:0/189548044 >> v2:172.21.15.177:3300/0 conn(0x7fb274161e30 msgr2=0x7fb2740d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb2737fe640 1 --2- 172.21.15.134:0/189548044 >> v2:172.21.15.177:3300/0 conn(0x7fb274161e30 0x7fb2740d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb2737fe640 1 -- 172.21.15.134:0/189548044 >> v1:172.21.15.134:6789/0 conn(0x7fb2740b3290 legacy=0x7fb2740b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb272ffd640 1 -- 172.21.15.134:0/189548044 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536217674 0 0) 0x7fb2740cf9a0 con 0x7fb2740b3290 2024-09-15T22:48:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.263+0000 7fb2737fe640 1 -- 172.21.15.134:0/189548044 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2740d5210 con 0x7fb2740b3d50 2024-09-15T22:48:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb2737fe640 1 --2- 172.21.15.134:0/189548044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb27406d8c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb27408dc90 tx=0x7fb26802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434fdd2e5345c4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb272ffd640 1 -- 172.21.15.134:0/189548044 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268037070 con 0x7fb2740b3d50 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb272ffd640 1 -- 172.21.15.134:0/189548044 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268032440 con 0x7fb2740b3d50 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb272ffd640 1 -- 172.21.15.134:0/189548044 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268032810 con 0x7fb2740b3d50 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 -- 172.21.15.134:0/189548044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 msgr2=0x7fb27406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/189548044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb27406d8c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb27408dc90 tx=0x7fb26802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 -- 172.21.15.134:0/189548044 shutdown_connections 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/189548044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb27406d8c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/189548044 >> v2:172.21.15.177:3300/0 conn(0x7fb274161e30 0x7fb2740d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 -- 172.21.15.134:0/189548044 >> 172.21.15.134:0/189548044 conn(0x7fb2740d1870 msgr2=0x7fb2740d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 -- 172.21.15.134:0/189548044 shutdown_connections 2024-09-15T22:48:18.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.264+0000 7fb27a3f8640 1 -- 172.21.15.134:0/189548044 wait complete. 2024-09-15T22:48:18.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 Processor -- start 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 -- start start 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 0x7fb2741475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274161e30 0x7fb27415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740d39e0 con 0x7fb2740b3d50 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740b3950 con 0x7fb274161e30 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.266+0000 7fb27a3f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb274147b10 con 0x7fb2740b3290 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50908/0 (socket says 172.21.15.134:50908) 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 -- 172.21.15.134:0/75568122 learned_addr learned my addr 172.21.15.134:0/75568122 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb278995640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274161e30 0x7fb27415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb273fff640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 0x7fb2741475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 -- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 msgr2=0x7fb2741475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 0x7fb2741475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 -- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274161e30 msgr2=0x7fb27415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274161e30 0x7fb27415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 -- 172.21.15.134:0/75568122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2740ccaf0 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb273fff640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 0x7fb2741475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb2737fe640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb268009890 tx=0x7fb2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268037040 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268004230 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268032e20 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2740ccdd0 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.267+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2740cd390 con 0x7fb2740b3d50 2024-09-15T22:48:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.268+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2740d34a0 con 0x7fb2740b3d50 2024-09-15T22:48:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.269+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb268030770 con 0x7fb2740b3d50 2024-09-15T22:48:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.269+0000 7fb270ff9640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 0x7fb26006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.269+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5665+0+0 (secure 0 0 0) 0x7fb2680ab0d0 con 0x7fb2740b3d50 2024-09-15T22:48:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.270+0000 7fb273fff640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 0x7fb26006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.270+0000 7fb273fff640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 0x7fb26006ef50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb264009890 tx=0x7fb264008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.274+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb26807b0b0 con 0x7fb2740b3d50 2024-09-15T22:48:18.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:18.470+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb274069190 con 0x7fb2740b3d50 2024-09-15T22:48:19.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.130+0000 7fb270ff9640 1 -- 172.21.15.134:0/75568122 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v80) ==== 174+0+0 (secure 0 0 0) 0x7fb26807a9b0 con 0x7fb2740b3d50 2024-09-15T22:48:19.132 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 24 and data pool 25 2024-09-15T22:48:19.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 msgr2=0x7fb26006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 0x7fb26006ef50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb264009890 tx=0x7fb264008040 comp rx=0 tx=0).stop 2024-09-15T22:48:19.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 msgr2=0x7fb2740cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb268009890 tx=0x7fb2680046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 shutdown_connections 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274161e30 0x7fb27415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb26006ca90 0x7fb26006ef50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2740b3d50 0x7fb2740cdb90 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 --2- 172.21.15.134:0/75568122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2740b3290 0x7fb2741475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.134+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 >> 172.21.15.134:0/75568122 conn(0x7fb2740d1870 msgr2=0x7fb2740d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.136+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 shutdown_connections 2024-09-15T22:48:19.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.137+0000 7fb27a3f8640 1 -- 172.21.15.134:0/75568122 wait complete. 2024-09-15T22:48:19.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:19.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.269+0000 7fd03aedd640 1 Processor -- start 2024-09-15T22:48:19.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.269+0000 7fd03aedd640 1 -- start start 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03aedd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd0340d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03aedd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd03415ce80 0x7fd0341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03aedd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340d0bc0 con 0x7fd03415ca40 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03aedd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd03415d390 con 0x7fd03415ce80 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03aedd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd03415d670 con 0x7fd0340d02a0 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03947a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd03415ce80 0x7fd0341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd038c79640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd0340d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd02bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd03415ca40 0x7fd03415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:47094/0 (socket says 172.21.15.134:47094) 2024-09-15T22:48:19.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd02bfff640 1 -- 172.21.15.134:0/4120735969 learned_addr learned my addr 172.21.15.134:0/4120735969 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd02b7fe640 1 -- 172.21.15.134:0/4120735969 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366652788 0 0) 0x7fd0340d0bc0 con 0x7fd03415ca40 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd02b7fe640 1 -- 172.21.15.134:0/4120735969 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd01c003520 con 0x7fd03415ca40 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03947a640 1 -- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 msgr2=0x7fd0340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03947a640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd0340d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03947a640 1 -- 172.21.15.134:0/4120735969 >> v1:172.21.15.177:6789/0 conn(0x7fd03415ca40 legacy=0x7fd03415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.270+0000 7fd03947a640 1 -- 172.21.15.134:0/4120735969 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03415d950 con 0x7fd03415ce80 2024-09-15T22:48:19.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.271+0000 7fd038c79640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd0340d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.271+0000 7fd03947a640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0341594c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009d90 tx=0x7fd02c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f120c2897729b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.271+0000 7fd02b7fe640 1 -- 172.21.15.134:0/4120735969 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c031600 con 0x7fd03415ce80 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.271+0000 7fd02b7fe640 1 -- 172.21.15.134:0/4120735969 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c0317a0 con 0x7fd03415ce80 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.271+0000 7fd02b7fe640 1 -- 172.21.15.134:0/4120735969 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c031b50 con 0x7fd03415ce80 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 -- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 msgr2=0x7fd0341594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0341594c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009d90 tx=0x7fd02c02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 -- 172.21.15.134:0/4120735969 shutdown_connections 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0341594c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 --2- 172.21.15.134:0/4120735969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd0340d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 -- 172.21.15.134:0/4120735969 >> 172.21.15.134:0/4120735969 conn(0x7fd034062cc0 msgr2=0x7fd03406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 -- 172.21.15.134:0/4120735969 shutdown_connections 2024-09-15T22:48:19.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.272+0000 7fd03aedd640 1 -- 172.21.15.134:0/4120735969 wait complete. 2024-09-15T22:48:19.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.273+0000 7fd03aedd640 1 Processor -- start 2024-09-15T22:48:19.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.273+0000 7fd03aedd640 1 -- start start 2024-09-15T22:48:19.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd034158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0340ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd03415eb40 con 0x7fd03415ca40 2024-09-15T22:48:19.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd03415df10 con 0x7fd03415ce80 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd03aedd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd034155b90 con 0x7fd0340d02a0 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50920/0 (socket says 172.21.15.134:50920) 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.274+0000 7fd02bfff640 1 -- 172.21.15.134:0/580017054 learned_addr learned my addr 172.21.15.134:0/580017054 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd038c79640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd034158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd03947a640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0340ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 -- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 msgr2=0x7fd034158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd034158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 -- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 msgr2=0x7fd0340ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0340ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 -- 172.21.15.134:0/580017054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340b1de0 con 0x7fd03415ca40 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd03947a640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0340ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd02bfff640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c3e0 tx=0x7fd02400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024017070 con 0x7fd03415ca40 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024005ce0 con 0x7fd03415ca40 2024-09-15T22:48:19.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0340b20c0 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0240072d0 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.275+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341580d0 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.276+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0340b4790 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.276+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fd02401a070 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.277+0000 7fd0297fa640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 0x7fd02006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.277+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5765+0+0 (secure 0 0 0) 0x7fd0240890b0 con 0x7fd03415ca40 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.277+0000 7fd038c79640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 0x7fd02006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.278+0000 7fd038c79640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 0x7fd02006ef80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd0341f7470 tx=0x7fd030008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.281+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd024058ac0 con 0x7fd03415ca40 2024-09-15T22:48:19.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.447+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0340d0a90 con 0x7fd03415ca40 2024-09-15T22:48:19.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.448+0000 7fd0297fa640 1 -- 172.21.15.134:0/580017054 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16821 (secure 0 0 0) 0x7fd02405cdc0 con 0x7fd03415ca40 2024-09-15T22:48:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:19.450 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":157,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:18.472310+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:16.826530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:17.445065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 msgr2=0x7fd02006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 0x7fd02006ef80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd0341f7470 tx=0x7fd030008040 comp rx=0 tx=0).stop 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 msgr2=0x7fd034147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c3e0 tx=0x7fd02400c8a0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 shutdown_connections 2024-09-15T22:48:19.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd03415ce80 0x7fd0340ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd02006cac0 0x7fd02006ef80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03415ca40 0x7fd034147fb0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 --2- 172.21.15.134:0/580017054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0340d02a0 0x7fd034158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.450+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 >> 172.21.15.134:0/580017054 conn(0x7fd034062cc0 msgr2=0x7fd03406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.451+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 shutdown_connections 2024-09-15T22:48:19.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.451+0000 7fd03aedd640 1 -- 172.21.15.134:0/580017054 wait complete. 2024-09-15T22:48:19.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:19.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.559+0000 7f55a03cf640 1 Processor -- start 2024-09-15T22:48:19.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.559+0000 7f55a03cf640 1 -- start start 2024-09-15T22:48:19.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.560+0000 7f55a03cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55980b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.560+0000 7f55a03cf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55980b7170 con 0x7f559815ed20 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.560+0000 7f55a03cf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55980b7aa0 con 0x7f559815e940 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.560+0000 7f55a03cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f55980d3660 con 0x7f55980b8f90 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.560+0000 7f559d96a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f559815ed20 0x7f55980b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55348/0 (socket says 172.21.15.134:55348) 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d96a640 1 -- 172.21.15.134:0/1978024629 learned_addr learned my addr 172.21.15.134:0/1978024629 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e96c640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55980b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248882917 0 0) 0x7f558c001110 con 0x7f559815ed20 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5580003520 con 0x7f559815ed20 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940466858 0 0) 0x7f55980b7aa0 con 0x7f559815e940 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f558c001110 con 0x7f559815e940 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 460944729 0 0) 0x7f5580003520 con 0x7f559815ed20 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 msgr2=0x7f55980b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55980b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 >> v1:172.21.15.177:6789/0 conn(0x7f559815e940 legacy=0x7f55980d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55980d3940 con 0x7f559815ed20 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f558c001840 con 0x7f559815ed20 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e96c640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55980b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 >> v1:172.21.15.134:6789/0 conn(0x7f559815ed20 legacy=0x7f55980b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5580003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5580004800 0x7f5580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55980d3660 con 0x7f5580003b70 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f558000ba70 con 0x7f5580004800 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f558000bc20 con 0x7f55980b8f90 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5580003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e96c640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d96a640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5580004800 0x7f5580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 -- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 msgr2=0x7f55800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 -- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5580004800 msgr2=0x7f5580004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5580004800 0x7f5580004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e16b640 1 -- 172.21.15.134:0/1978024629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5580003520 con 0x7f5580003b70 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559e96c640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b8f90 0x7f55800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.561+0000 7f559d96a640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5580004800 0x7f5580004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.562+0000 7f559e16b640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5580003f90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f55880018a0 tx=0x7f5580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7293bff739f2e1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.562+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55880014f0 con 0x7f5580003b70 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.562+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55880052d0 con 0x7f5580003b70 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.562+0000 7f559d169640 1 -- 172.21.15.134:0/1978024629 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558802ac40 con 0x7f5580003b70 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 -- 172.21.15.134:0/1978024629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 msgr2=0x7f5580003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 --2- 172.21.15.134:0/1978024629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5580003f90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f55880018a0 tx=0x7f5580005830 comp rx=0 tx=0).stop 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f559e96c640 1 -- 172.21.15.134:0/1978024629 reap_dead start 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 -- 172.21.15.134:0/1978024629 shutdown_connections 2024-09-15T22:48:19.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 -- 172.21.15.134:0/1978024629 >> 172.21.15.134:0/1978024629 conn(0x7f55980b6240 msgr2=0x7f55980b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 -- 172.21.15.134:0/1978024629 shutdown_connections 2024-09-15T22:48:19.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.563+0000 7f55a03cf640 1 -- 172.21.15.134:0/1978024629 wait complete. 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.564+0000 7f55a03cf640 1 Processor -- start 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.564+0000 7f55a03cf640 1 -- start start 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55980cd9d0 0x7f55980cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b55c0 0x7f55980b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55980d3310 con 0x7f5580003b70 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55980d3f00 con 0x7f55980cd9d0 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f55980d1ef0 con 0x7f55980b55c0 2024-09-15T22:48:19.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50936/0 (socket says 172.21.15.134:50936) 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 -- 172.21.15.134:0/3375037136 learned_addr learned my addr 172.21.15.134:0/3375037136 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559d96a640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55980cd9d0 0x7f55980cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 -- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b55c0 msgr2=0x7f55980b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b55c0 0x7f55980b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 -- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55980cd9d0 msgr2=0x7f55980cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55980cd9d0 0x7f55980cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 -- 172.21.15.134:0/3375037136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5598155060 con 0x7f5580003b70 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f559e16b640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f5588005040 tx=0x7f55880012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558803f020 con 0x7f5580003b70 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588005480 con 0x7f5580003b70 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55981e8f60 con 0x7f5580003b70 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.565+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588037040 con 0x7f5580003b70 2024-09-15T22:48:19.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.566+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55981e94e0 con 0x7f5580003b70 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.566+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55980cef90 con 0x7f5580003b70 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.567+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f5588042020 con 0x7f5580003b70 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.567+0000 7f5596ffd640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 0x7f558406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.568+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5765+0+0 (secure 0 0 0) 0x7f55880a9950 con 0x7f5580003b70 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.568+0000 7f559d96a640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 0x7f558406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.568+0000 7f559d96a640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 0x7f558406ef80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f558c000fd0 tx=0x7f558c001340 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.572+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5588049030 con 0x7f5580003b70 2024-09-15T22:48:19.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.736+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55980ba6b0 con 0x7f5580003b70 2024-09-15T22:48:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.737+0000 7f5596ffd640 1 -- 172.21.15.134:0/3375037136 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16821 (secure 0 0 0) 0x7f5598155060 con 0x7f5580003b70 2024-09-15T22:48:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:19.739 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":157,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:18.472310+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:16.826530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:17.445065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:19.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 msgr2=0x7f558406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 0x7f558406ef80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f558c000fd0 tx=0x7f558c001340 comp rx=0 tx=0).stop 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 msgr2=0x7f5598154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f5588005040 tx=0x7f55880012d0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 shutdown_connections 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55980b55c0 0x7f55980b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55980cd9d0 0x7f55980cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f558406cac0 0x7f558406ef80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 --2- 172.21.15.134:0/3375037136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5580003b70 0x7f5598154b20 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 >> 172.21.15.134:0/3375037136 conn(0x7f55980b6240 msgr2=0x7f559815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 shutdown_connections 2024-09-15T22:48:19.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.739+0000 7f55a03cf640 1 -- 172.21.15.134:0/3375037136 wait complete. 2024-09-15T22:48:19.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:48:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.851+0000 7f42f2959640 1 Processor -- start 2024-09-15T22:48:19.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 -- start start 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42ec0b1da0 0x7f42ec15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42ec0d1ed0 0x7f42ec0d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0d0980 0x7f42ec073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f42ec070c80 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f42ec15d9d0 con 0x7f42ec0b1da0 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42f2959640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec070930 con 0x7f42ec0d0980 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.852+0000 7f42eb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42ec0d1ed0 0x7f42ec0d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42ec0d1ed0 0x7f42ec0d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50942/0 (socket says 172.21.15.134:50942) 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 -- 172.21.15.134:0/2534828240 learned_addr learned my addr 172.21.15.134:0/2534828240 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:19.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42f0ef6640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0d0980 0x7f42ec073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42ebfff640 1 --2- 172.21.15.134:0/2534828240 >> v2:172.21.15.177:3300/0 conn(0x7f42ec0b1da0 0x7f42ec15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 -- 172.21.15.134:0/2534828240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0d0980 msgr2=0x7f42ec073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0d0980 0x7f42ec073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 -- 172.21.15.134:0/2534828240 >> v2:172.21.15.177:3300/0 conn(0x7f42ec0b1da0 msgr2=0x7f42ec15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/2534828240 >> v2:172.21.15.177:3300/0 conn(0x7f42ec0b1da0 0x7f42ec15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.853+0000 7f42eb7fe640 1 -- 172.21.15.134:0/2534828240 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec0b71d0 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0d0440 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f42ec075d00 tx=0x7f42e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6377f8e6a50d9467 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42eaffd640 1 -- 172.21.15.134:0/2534828240 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0037070 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42eaffd640 1 -- 172.21.15.134:0/2534828240 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e0032440 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42eaffd640 1 -- 172.21.15.134:0/2534828240 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0032810 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 -- 172.21.15.134:0/2534828240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d1ed0 msgr2=0x7f42ec0d0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0d0440 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f42ec075d00 tx=0x7f42e002a140 comp rx=0 tx=0).stop 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 -- 172.21.15.134:0/2534828240 shutdown_connections 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0d0980 0x7f42ec073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 --2- 172.21.15.134:0/2534828240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0d0440 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 --2- 172.21.15.134:0/2534828240 >> v2:172.21.15.177:3300/0 conn(0x7f42ec0b1da0 0x7f42ec15d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 -- 172.21.15.134:0/2534828240 >> 172.21.15.134:0/2534828240 conn(0x7f42ec0b4290 msgr2=0x7f42ec0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 -- 172.21.15.134:0/2534828240 shutdown_connections 2024-09-15T22:48:19.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.854+0000 7f42f2959640 1 -- 172.21.15.134:0/2534828240 wait complete. 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.855+0000 7f42f2959640 1 Processor -- start 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 -- start start 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0b1da0 0x7f42ec0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec073690 con 0x7f42ec0d0980 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec0b7790 con 0x7f42ec0d1ed0 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42f2959640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec073810 con 0x7f42ec0b1da0 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42eb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42eb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50944/0 (socket says 172.21.15.134:50944) 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.856+0000 7f42eb7fe640 1 -- 172.21.15.134:0/1465894827 learned_addr learned my addr 172.21.15.134:0/1465894827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42f0ef6640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42ebfff640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0b1da0 0x7f42ec0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 -- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0b1da0 msgr2=0x7f42ec0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0b1da0 0x7f42ec0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 -- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42ec0d1ed0 msgr2=0x7f42ec0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 -- 172.21.15.134:0/1465894827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec158070 con 0x7f42ec0d0980 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42eb7fe640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f42e002a180 tx=0x7f42e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0037040 con 0x7f42ec0d0980 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e0042070 con 0x7f42ec0d0980 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec06de30 con 0x7f42ec0d0980 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0030bb0 con 0x7f42ec0d0980 2024-09-15T22:48:19.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.857+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec06e3f0 con 0x7f42ec0d0980 2024-09-15T22:48:19.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.858+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec158240 con 0x7f42ec0d0980 2024-09-15T22:48:19.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.858+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f42e0047460 con 0x7f42ec0d0980 2024-09-15T22:48:19.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.859+0000 7f42e8ff9640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 0x7f42d806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:19.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.859+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5765+0+0 (secure 0 0 0) 0x7f42e00aa970 con 0x7f42ec0d0980 2024-09-15T22:48:19.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.859+0000 7f42ebfff640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 0x7f42d806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:19.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.860+0000 7f42ebfff640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 0x7f42d806ef50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00aaf0 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:19.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:19.863+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42e007a380 con 0x7f42ec0d0980 2024-09-15T22:48:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.063+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f42ec073150 con 0x7f42ec0d0980 2024-09-15T22:48:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.146+0000 7f42e8ff9640 1 -- 172.21.15.134:0/1465894827 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) ==== 118+0+0 (secure 0 0 0) 0x7f42e007e680 con 0x7f42ec0d0980 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 msgr2=0x7f42d806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 0x7f42d806ef50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00aaf0 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 msgr2=0x7f42ec06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f42e002a180 tx=0x7f42e00046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 shutdown_connections 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42ec0d1ed0 0x7f42ec0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f42d806ca90 0x7f42d806ef50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ec0d0980 0x7f42ec06d6c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 --2- 172.21.15.134:0/1465894827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42ec0b1da0 0x7f42ec0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 >> 172.21.15.134:0/1465894827 conn(0x7f42ec0b4290 msgr2=0x7f42ec071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:20.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 shutdown_connections 2024-09-15T22:48:20.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.149+0000 7f42f2959640 1 -- 172.21.15.134:0/1465894827 wait complete. 2024-09-15T22:48:20.161 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:48:20.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:48:20.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.261+0000 7f34bed31640 1 Processor -- start 2024-09-15T22:48:20.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.261+0000 7f34bed31640 1 -- start start 2024-09-15T22:48:20.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bed31640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f34b815e950 0x7f34b80b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bed31640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34b80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bed31640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b815ed30 con 0x7f34b80d04a0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bed31640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f34b80d0f40 con 0x7f34b815e950 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bed31640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f34b80d1220 con 0x7f34b80d2ac0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34affff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f34b80d04a0 0x7f34b80d23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55360/0 (socket says 172.21.15.134:55360) 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34affff640 1 -- 172.21.15.134:0/694915519 learned_addr learned my addr 172.21.15.134:0/694915519 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096710115 0 0) 0x7f34b815ed30 con 0x7f34b80d04a0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bcacd640 1 --2- 172.21.15.134:0/694915519 >> v2:172.21.15.177:3300/0 conn(0x7f34b815e950 0x7f34b80b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34b80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34a0003520 con 0x7f34b80d04a0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1281770789 0 0) 0x7f34a0003520 con 0x7f34b80d04a0 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 msgr2=0x7f34b80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:20.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34b80d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 >> v2:172.21.15.177:3300/0 conn(0x7f34b815e950 msgr2=0x7f34b80b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 --2- 172.21.15.134:0/694915519 >> v2:172.21.15.177:3300/0 conn(0x7f34b815e950 0x7f34b80b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b806d420 con 0x7f34b80d04a0 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f34a8001670 con 0x7f34b80d04a0 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 >> v1:172.21.15.134:6789/0 conn(0x7f34b80d04a0 legacy=0x7f34b80d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a0003f30 0x7f34a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a0004d40 0x7f34a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80d0f40 con 0x7f34a0004d40 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80d1220 con 0x7f34a0003f30 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.262+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f34a000b9c0 con 0x7f34b80d2ac0 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a0004d40 0x7f34a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bcacd640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34affff640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a0003f30 0x7f34a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 -- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 msgr2=0x7f34a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34b80d2ac0 0x7f34a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 -- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a0003f30 msgr2=0x7f34a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a0003f30 0x7f34a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.263+0000 7f34bd2ce640 1 -- 172.21.15.134:0/694915519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a0003520 con 0x7f34a0004d40 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a0004d40 0x7f34a00051c0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009f90 tx=0x7f34a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890cbfc3a3d2d122 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0009c10 con 0x7f34a0004d40 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0036070 con 0x7f34a0004d40 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34af7fe640 1 -- 172.21.15.134:0/694915519 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0031630 con 0x7f34a0004d40 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 -- 172.21.15.134:0/694915519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a0004d40 msgr2=0x7f34a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 --2- 172.21.15.134:0/694915519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a0004d40 0x7f34a00051c0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009f90 tx=0x7f34a0005830 comp rx=0 tx=0).stop 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bd2ce640 1 -- 172.21.15.134:0/694915519 reap_dead start 2024-09-15T22:48:20.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 -- 172.21.15.134:0/694915519 shutdown_connections 2024-09-15T22:48:20.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 -- 172.21.15.134:0/694915519 >> 172.21.15.134:0/694915519 conn(0x7f34b806f310 msgr2=0x7f34b806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:20.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 -- 172.21.15.134:0/694915519 shutdown_connections 2024-09-15T22:48:20.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.264+0000 7f34bed31640 1 -- 172.21.15.134:0/694915519 wait complete. 2024-09-15T22:48:20.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.265+0000 7f34bed31640 1 Processor -- start 2024-09-15T22:48:20.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.265+0000 7f34bed31640 1 -- start start 2024-09-15T22:48:20.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a0004d40 0x7f34b8161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b81489a0 0x7f34b815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34b806d040 con 0x7f34b8145f00 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80cf410 con 0x7f34b81489a0 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bed31640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f34b806d1c0 con 0x7f34a0004d40 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bd2ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bd2ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50962/0 (socket says 172.21.15.134:50962) 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bd2ce640 1 -- 172.21.15.134:0/640473903 learned_addr learned my addr 172.21.15.134:0/640473903 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.266+0000 7f34bcacd640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a0004d40 0x7f34b8161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34affff640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b81489a0 0x7f34b815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 -- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a0004d40 msgr2=0x7f34b8161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a0004d40 0x7f34b8161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 -- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b81489a0 msgr2=0x7f34b815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:20.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b81489a0 0x7f34b815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 -- 172.21.15.134:0/640473903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b8157610 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bd2ce640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f34b0033040 tx=0x7f34b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0009c10 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0031d50 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b8157880 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0044650 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.267+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b8157e40 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.268+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b80d36f0 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.269+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f34b0005d10 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.269+0000 7f34ad7fa640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 0x7f34a406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.269+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f34b00aa720 con 0x7f34b8145f00 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.269+0000 7f34bcacd640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 0x7f34a406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:20.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.270+0000 7f34bcacd640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 0x7f34a406ef80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009c40 tx=0x7f34b4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:20.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.273+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34b007a780 con 0x7f34b8145f00 2024-09-15T22:48:20.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:20.470+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f34b815ed30 con 0x7f34b8145f00 2024-09-15T22:48:21.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.154+0000 7f34ad7fa640 1 -- 172.21.15.134:0/640473903 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) ==== 122+0+0 (secure 0 0 0) 0x7f34b007a080 con 0x7f34b8145f00 2024-09-15T22:48:21.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 msgr2=0x7f34a406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 0x7f34a406ef80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009c40 tx=0x7f34b4009190 comp rx=0 tx=0).stop 2024-09-15T22:48:21.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 msgr2=0x7f34b8158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f34b0033040 tx=0x7f34b0009750 comp rx=0 tx=0).stop 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 shutdown_connections 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f34a406cac0 0x7f34a406ef80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b8145f00 0x7f34b8158620 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b81489a0 0x7f34b815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 --2- 172.21.15.134:0/640473903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a0004d40 0x7f34b8161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 >> 172.21.15.134:0/640473903 conn(0x7f34b806f310 msgr2=0x7f34b80b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 shutdown_connections 2024-09-15T22:48:21.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.156+0000 7f34bed31640 1 -- 172.21.15.134:0/640473903 wait complete. 2024-09-15T22:48:21.169 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:48:21.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:21.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 Processor -- start 2024-09-15T22:48:21.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 -- start start 2024-09-15T22:48:21.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e440b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e440b7170 con 0x7f7e4415e940 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e440b7aa0 con 0x7f7e440cef90 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.268+0000 7f7e4a09b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7e440d3660 con 0x7f7e4415ed20 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e437fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7e4415e940 0x7f7e440d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55366/0 (socket says 172.21.15.134:55366) 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e437fe640 1 -- 172.21.15.134:0/221011071 learned_addr learned my addr 172.21.15.134:0/221011071 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e3affd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e440b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764936180 0 0) 0x7f7e34001110 con 0x7f7e4415e940 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e30003520 con 0x7f7e4415e940 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 41203319 0 0) 0x7f7e30003520 con 0x7f7e4415e940 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 msgr2=0x7f7e440b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e440b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 >> v1:172.21.15.177:6789/0 conn(0x7f7e440cef90 legacy=0x7f7e440b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440d3940 con 0x7f7e4415e940 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f7e34001840 con 0x7f7e4415e940 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 >> v1:172.21.15.134:6789/0 conn(0x7f7e4415e940 legacy=0x7f7e440d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e30004d40 0x7f7e300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440d3660 con 0x7f7e30004d40 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3000bb30 con 0x7f7e300039e0 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7e3000bd30 con 0x7f7e4415ed20 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e43fff640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e30004d40 0x7f7e300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e437fe640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.269+0000 7f7e3affd640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 -- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 msgr2=0x7f7e30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e4415ed20 0x7f7e30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 -- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e300039e0 msgr2=0x7f7e30003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 -- 172.21.15.134:0/221011071 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e30003520 con 0x7f7e30004d40 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e43fff640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e30004d40 0x7f7e300051c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c001e20 tx=0x7f7e30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11175287e02499d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c001a70 con 0x7f7e30004d40 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c02ae40 con 0x7f7e30004d40 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.270+0000 7f7e42ffd640 1 -- 172.21.15.134:0/221011071 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c003bb0 con 0x7f7e30004d40 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 -- 172.21.15.134:0/221011071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e30004d40 msgr2=0x7f7e300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/221011071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e30004d40 0x7f7e300051c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c001e20 tx=0x7f7e30005830 comp rx=0 tx=0).stop 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e43fff640 1 -- 172.21.15.134:0/221011071 reap_dead start 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 -- 172.21.15.134:0/221011071 shutdown_connections 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 -- 172.21.15.134:0/221011071 >> 172.21.15.134:0/221011071 conn(0x7f7e440b6240 msgr2=0x7f7e440b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 -- 172.21.15.134:0/221011071 shutdown_connections 2024-09-15T22:48:21.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.271+0000 7f7e4a09b640 1 -- 172.21.15.134:0/221011071 wait complete. 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.272+0000 7f7e4a09b640 1 Processor -- start 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.272+0000 7f7e4a09b640 1 -- start start 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 0x7f7e44158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e441f4640 0x7f7e44155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440d3310 con 0x7f7e440ca430 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440d3f00 con 0x7f7e30004d40 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e4a09b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7e440d1ef0 con 0x7f7e441f4640 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e43fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e43fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50966/0 (socket says 172.21.15.134:50966) 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e43fff640 1 -- 172.21.15.134:0/3668202395 learned_addr learned my addr 172.21.15.134:0/3668202395 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e437fe640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 0x7f7e44158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e3affd640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e441f4640 0x7f7e44155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e43fff640 1 -- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e441f4640 msgr2=0x7f7e44155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.273+0000 7f7e43fff640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e441f4640 0x7f7e44155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e43fff640 1 -- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 msgr2=0x7f7e44158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e43fff640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 0x7f7e44158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e43fff640 1 -- 172.21.15.134:0/3668202395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e44155bd0 con 0x7f7e440ca430 2024-09-15T22:48:21.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e437fe640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 0x7f7e44158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e43fff640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005040 tx=0x7f7e3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c03f030 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c02ac40 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e44146110 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007db0 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.274+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441f4ac0 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.275+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e440cadf0 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.275+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f7e3c042070 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.276+0000 7f7e40ff9640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 0x7f7e2406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.276+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f7e3c0aba80 con 0x7f7e440ca430 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.276+0000 7f7e437fe640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 0x7f7e2406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.276+0000 7f7e437fe640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 0x7f7e2406ef50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7e340012b0 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.280+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e3c079360 con 0x7f7e440ca430 2024-09-15T22:48:21.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.479+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e440d1060 con 0x7f7e440ca430 2024-09-15T22:48:21.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.480+0000 7f7e40ff9640 1 -- 172.21.15.134:0/3668202395 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5236 (secure 0 0 0) 0x7f7e3c078c60 con 0x7f7e440ca430 2024-09-15T22:48:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:21.481 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":82,"btime":"2024-09-15T22:48:21:148051+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:21.482 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 82 2024-09-15T22:48:21.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 msgr2=0x7f7e2406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 0x7f7e2406ef50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7e340012b0 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 msgr2=0x7f7e440ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005040 tx=0x7f7e3c0014a0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 shutdown_connections 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7e2406ca90 0x7f7e2406ef50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e440ca430 0x7f7e440ca8b0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e441f4640 0x7f7e44155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 --2- 172.21.15.134:0/3668202395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e30004d40 0x7f7e44158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 >> 172.21.15.134:0/3668202395 conn(0x7f7e440b6240 msgr2=0x7f7e440b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 shutdown_connections 2024-09-15T22:48:21.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.482+0000 7f7e4a09b640 1 -- 172.21.15.134:0/3668202395 wait complete. 2024-09-15T22:48:21.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:21.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.591+0000 7fb6821d8640 1 Processor -- start 2024-09-15T22:48:21.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.591+0000 7fb6821d8640 1 -- start start 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb6821d8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb67c0b4b70 0x7fb67c0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb6821d8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c074200 con 0x7fb67c15e500 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb6821d8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0b6e80 con 0x7fb67c15e8e0 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb6821d8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb67c0b7160 con 0x7fb67c0b4b70 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb67b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb67c15e500 0x7fb67c0b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55374/0 (socket says 172.21.15.134:55374) 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb67b7fe640 1 -- 172.21.15.134:0/2675123303 learned_addr learned my addr 172.21.15.134:0/2675123303 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb67affd640 1 --2- 172.21.15.134:0/2675123303 >> v2:172.21.15.177:3300/0 conn(0x7fb67c0b4b70 0x7fb67c0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199616449 0 0) 0x7fb67c074200 con 0x7fb67c15e500 2024-09-15T22:48:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.592+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb664003520 con 0x7fb67c15e500 2024-09-15T22:48:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.593+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1807431082 0 0) 0x7fb664003520 con 0x7fb67c15e500 2024-09-15T22:48:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.593+0000 7fb67affd640 1 -- 172.21.15.134:0/2675123303 >> v1:172.21.15.177:6789/0 conn(0x7fb67c15e8e0 legacy=0x7fb67c0d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.593+0000 7fb67affd640 1 -- 172.21.15.134:0/2675123303 >> v1:172.21.15.134:6789/0 conn(0x7fb67c15e500 legacy=0x7fb67c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.593+0000 7fb67affd640 1 -- 172.21.15.134:0/2675123303 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c0b7440 con 0x7fb67c0b4b70 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.593+0000 7fb67affd640 1 --2- 172.21.15.134:0/2675123303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b4b70 0x7fb67c0d2460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097d0 tx=0x7fb67002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8142f160a1af86 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670037070 con 0x7fb67c0b4b70 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67002abf0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb67a7fc640 1 -- 172.21.15.134:0/2675123303 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c001670 con 0x7fb67c0b4b70 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 -- 172.21.15.134:0/2675123303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b4b70 msgr2=0x7fb67c0d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 --2- 172.21.15.134:0/2675123303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b4b70 0x7fb67c0d2460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097d0 tx=0x7fb67002a160 comp rx=0 tx=0).stop 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 -- 172.21.15.134:0/2675123303 shutdown_connections 2024-09-15T22:48:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 --2- 172.21.15.134:0/2675123303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b4b70 0x7fb67c0d2460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 -- 172.21.15.134:0/2675123303 >> 172.21.15.134:0/2675123303 conn(0x7fb67c062810 msgr2=0x7fb67c062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 -- 172.21.15.134:0/2675123303 shutdown_connections 2024-09-15T22:48:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.594+0000 7fb6821d8640 1 -- 172.21.15.134:0/2675123303 wait complete. 2024-09-15T22:48:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.595+0000 7fb6821d8640 1 Processor -- start 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 -- start start 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c15e500 0x7fb67c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c15e8e0 0x7fb67c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c06ce30 con 0x7fb67c0b4b70 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c06ccb0 con 0x7fb67c15e8e0 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb6821d8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb67c073cb0 con 0x7fb67c15e500 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb67b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb67b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50972/0 (socket says 172.21.15.134:50972) 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.596+0000 7fb67b7fe640 1 -- 172.21.15.134:0/17052172 learned_addr learned my addr 172.21.15.134:0/17052172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 -- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c15e500 msgr2=0x7fb67c15a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67affd640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c15e500 0x7fb67c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67bfff640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c15e8e0 0x7fb67c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c15e500 0x7fb67c15a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 -- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c15e8e0 msgr2=0x7fb67c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c15e8e0 0x7fb67c158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 -- 172.21.15.134:0/17052172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c159030 con 0x7fb67c0b4b70 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb67b7fe640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c750 tx=0x7fb66c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c017070 con 0x7fb67c0b4b70 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66c005ad0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c007070 con 0x7fb67c0b4b70 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c159310 con 0x7fb67c0b4b70 2024-09-15T22:48:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.597+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c159bb0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.598+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c159700 con 0x7fb67c0b4b70 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.599+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb66c01a070 con 0x7fb67c0b4b70 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.599+0000 7fb663fff640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 0x7fb66806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.599+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fb66c089340 con 0x7fb67c0b4b70 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.599+0000 7fb67affd640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 0x7fb66806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.600+0000 7fb67affd640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 0x7fb66806ef50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb67002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.603+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb66c0593a0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.768+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb67c0d1cf0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.769+0000 7fb663fff640 1 -- 172.21.15.134:0/17052172 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+16808 (secure 0 0 0) 0x7fb66c058ca0 con 0x7fb67c0b4b70 2024-09-15T22:48:21.771 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:21.771 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":158,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:20.131700+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:16.826530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:17.445065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 msgr2=0x7fb66806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 0x7fb66806ef50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb67002e000 comp rx=0 tx=0).stop 2024-09-15T22:48:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 msgr2=0x7fb67c14c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c750 tx=0x7fb66c00cc10 comp rx=0 tx=0).stop 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 shutdown_connections 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c15e8e0 0x7fb67c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c15e500 0x7fb67c15a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb66806ca90 0x7fb66806ef50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 --2- 172.21.15.134:0/17052172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67c0b4b70 0x7fb67c14c2f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 >> 172.21.15.134:0/17052172 conn(0x7fb67c062810 msgr2=0x7fb67c15d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 shutdown_connections 2024-09-15T22:48:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.772+0000 7fb6821d8640 1 -- 172.21.15.134:0/17052172 wait complete. 2024-09-15T22:48:21.784 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:48:21.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:21.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.884+0000 7fbae5303640 1 Processor -- start 2024-09-15T22:48:21.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.884+0000 7fbae5303640 1 -- start start 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbae5303640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbae015e940 0x7fbae00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbae5303640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015ed20 0x7fbae00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbae5303640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae00b7170 con 0x7fbae00cef90 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbae5303640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbae00d1ae0 con 0x7fbae015e940 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbae5303640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbae00b7aa0 con 0x7fbae015ed20 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbadeffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbae015e940 0x7fbae00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbadeffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbae015e940 0x7fbae00d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50982/0 (socket says 172.21.15.134:50982) 2024-09-15T22:48:21.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbadeffd640 1 -- 172.21.15.134:0/3592636539 learned_addr learned my addr 172.21.15.134:0/3592636539 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:21.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.885+0000 7fbade7fc640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015ed20 0x7fbae00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbadeffd640 1 -- 172.21.15.134:0/3592636539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015ed20 msgr2=0x7fbae00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:21.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015ed20 0x7fbae00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbadeffd640 1 -- 172.21.15.134:0/3592636539 >> v1:172.21.15.177:6789/0 conn(0x7fbae00cef90 legacy=0x7fbae00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbadeffd640 1 -- 172.21.15.134:0/3592636539 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae00d3660 con 0x7fbae015e940 2024-09-15T22:48:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015e940 0x7fbae00d1060 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009e50 tx=0x7fbad002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a093e9ea1b78143 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbaddffb640 1 -- 172.21.15.134:0/3592636539 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0036070 con 0x7fbae015e940 2024-09-15T22:48:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbaddffb640 1 -- 172.21.15.134:0/3592636539 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad0031600 con 0x7fbae015e940 2024-09-15T22:48:21.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.886+0000 7fbaddffb640 1 -- 172.21.15.134:0/3592636539 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad00319d0 con 0x7fbae015e940 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 -- 172.21.15.134:0/3592636539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015e940 msgr2=0x7fbae00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015e940 0x7fbae00d1060 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009e50 tx=0x7fbad002a7a0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 -- 172.21.15.134:0/3592636539 shutdown_connections 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015ed20 0x7fbae00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 --2- 172.21.15.134:0/3592636539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015e940 0x7fbae00d1060 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 -- 172.21.15.134:0/3592636539 >> 172.21.15.134:0/3592636539 conn(0x7fbae00b6240 msgr2=0x7fbae00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 -- 172.21.15.134:0/3592636539 shutdown_connections 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.887+0000 7fbae5303640 1 -- 172.21.15.134:0/3592636539 wait complete. 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.888+0000 7fbae5303640 1 Processor -- start 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.888+0000 7fbae5303640 1 -- start start 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 0x7fbae015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015e940 0x7fbae01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbae00d3f00 con 0x7fbae015ed20 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbae00d3c20 con 0x7fbae00cef90 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbae5303640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fbae00d3310 con 0x7fbae015e940 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50994/0 (socket says 172.21.15.134:50994) 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 -- 172.21.15.134:0/3346472671 learned_addr learned my addr 172.21.15.134:0/3346472671 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbade7fc640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015e940 0x7fbae01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 0x7fbae015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 -- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015e940 msgr2=0x7fbae01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015e940 0x7fbae01549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 -- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 msgr2=0x7fbae015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 0x7fbae015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.889+0000 7fbadf7fe640 1 -- 172.21.15.134:0/3346472671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae01558f0 con 0x7fbae015ed20 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 0x7fbae015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbadf7fe640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbad800c3c0 tx=0x7fbad800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80052d0 con 0x7fbae015ed20 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad8005470 con 0x7fbae015ed20 2024-09-15T22:48:21.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8007240 con 0x7fbae015ed20 2024-09-15T22:48:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae0155bd0 con 0x7fbae015ed20 2024-09-15T22:48:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.890+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae0156190 con 0x7fbae015ed20 2024-09-15T22:48:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.891+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae00d1f80 con 0x7fbae015ed20 2024-09-15T22:48:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.891+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fbad80073e0 con 0x7fbae015ed20 2024-09-15T22:48:21.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.892+0000 7fbac77fe640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 0x7fbacc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.892+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fbad80891b0 con 0x7fbae015ed20 2024-09-15T22:48:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.892+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 0x7fbacc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.892+0000 7fbadeffd640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 0x7fbacc06ef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbad0033000 tx=0x7fbad0009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:21.896+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbae00b7170 con 0x7fbae015ed20 2024-09-15T22:48:22.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.058+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbae00ba6b0 con 0x7fbacc06ca90 2024-09-15T22:48:22.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.064+0000 7fbac77fe640 1 -- 172.21.15.134:0/3346472671 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240247 (secure 0 0 0) 0x7fbae00ba6b0 con 0x7fbacc06ca90 2024-09-15T22:48:22.068 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:22.069 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:22.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 msgr2=0x7fbacc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 0x7fbacc06ef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbad0033000 tx=0x7fbad0009000 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 msgr2=0x7fbae00cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbad800c3c0 tx=0x7fbad800c880 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 shutdown_connections 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fbacc06ca90 0x7fbacc06ef50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae015ed20 0x7fbae00cd0b0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbae015e940 0x7fbae01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 --2- 172.21.15.134:0/3346472671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbae00cef90 0x7fbae015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.066+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 >> 172.21.15.134:0/3346472671 conn(0x7fbae00b6240 msgr2=0x7fbae0160fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.067+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 shutdown_connections 2024-09-15T22:48:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.067+0000 7fbae5303640 1 -- 172.21.15.134:0/3346472671 wait complete. 2024-09-15T22:48:22.079 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-15T22:48:21.224048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265816,"kb_used_data":16276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708904,"statfs":{"total":773094113280,"available":772821917696,"internally_reserved":0,"allocated":16666624,"data_stored":7975505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.097530"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128525+0000","last_change":"2024-09-15T22:48:17.128525+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128525+0000","last_undegraded":"2024-09-15T22:48:17.128525+0000","last_fullsized":"2024-09-15T22:48:17.128525+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129802+0000","last_change":"2024-09-15T22:48:17.129802+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129802+0000","last_undegraded":"2024-09-15T22:48:17.129802+0000","last_fullsized":"2024-09-15T22:48:17.129802+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130847+0000","last_change":"2024-09-15T22:48:17.130847+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130847+0000","last_undegraded":"2024-09-15T22:48:17.130847+0000","last_fullsized":"2024-09-15T22:48:17.130847+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129635+0000","last_change":"2024-09-15T22:48:17.129635+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129635+0000","last_undegraded":"2024-09-15T22:48:17.129635+0000","last_fullsized":"2024-09-15T22:48:17.129635+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131196+0000","last_change":"2024-09-15T22:48:17.131196+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131196+0000","last_undegraded":"2024-09-15T22:48:17.131196+0000","last_fullsized":"2024-09-15T22:48:17.131196+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130098+0000","last_change":"2024-09-15T22:48:17.130098+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130098+0000","last_undegraded":"2024-09-15T22:48:17.130098+0000","last_fullsized":"2024-09-15T22:48:17.130098+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129816+0000","last_change":"2024-09-15T22:48:17.129816+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129816+0000","last_undegraded":"2024-09-15T22:48:17.129816+0000","last_fullsized":"2024-09-15T22:48:17.129816+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.133426+0000","last_change":"2024-09-15T22:48:17.133426+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.133426+0000","last_undegraded":"2024-09-15T22:48:17.133426+0000","last_fullsized":"2024-09-15T22:48:17.133426+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127774+0000","last_change":"2024-09-15T22:48:17.127774+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127774+0000","last_undegraded":"2024-09-15T22:48:17.127774+0000","last_fullsized":"2024-09-15T22:48:17.127774+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130213+0000","last_change":"2024-09-15T22:48:17.130213+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130213+0000","last_undegraded":"2024-09-15T22:48:17.130213+0000","last_fullsized":"2024-09-15T22:48:17.130213+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130751+0000","last_change":"2024-09-15T22:48:17.130751+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130751+0000","last_undegraded":"2024-09-15T22:48:17.130751+0000","last_fullsized":"2024-09-15T22:48:17.130751+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129370+0000","last_change":"2024-09-15T22:48:17.129370+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129370+0000","last_undegraded":"2024-09-15T22:48:17.129370+0000","last_fullsized":"2024-09-15T22:48:17.129370+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127752+0000","last_change":"2024-09-15T22:48:17.127752+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127752+0000","last_undegraded":"2024-09-15T22:48:17.127752+0000","last_fullsized":"2024-09-15T22:48:17.127752+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130003+0000","last_change":"2024-09-15T22:48:17.130003+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130003+0000","last_undegraded":"2024-09-15T22:48:17.130003+0000","last_fullsized":"2024-09-15T22:48:17.130003+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129376+0000","last_change":"2024-09-15T22:48:17.129376+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129376+0000","last_undegraded":"2024-09-15T22:48:17.129376+0000","last_fullsized":"2024-09-15T22:48:17.129376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131281+0000","last_change":"2024-09-15T22:48:17.131281+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131281+0000","last_undegraded":"2024-09-15T22:48:17.131281+0000","last_fullsized":"2024-09-15T22:48:17.131281+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136988+0000","last_change":"2024-09-15T22:48:17.136988+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136988+0000","last_undegraded":"2024-09-15T22:48:17.136988+0000","last_fullsized":"2024-09-15T22:48:17.136988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130176+0000","last_change":"2024-09-15T22:48:17.130176+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130176+0000","last_undegraded":"2024-09-15T22:48:17.130176+0000","last_fullsized":"2024-09-15T22:48:17.130176+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136144+0000","last_change":"2024-09-15T22:48:17.136144+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136144+0000","last_undegraded":"2024-09-15T22:48:17.136144+0000","last_fullsized":"2024-09-15T22:48:17.136144+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136193+0000","last_change":"2024-09-15T22:48:17.136193+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136193+0000","last_undegraded":"2024-09-15T22:48:17.136193+0000","last_fullsized":"2024-09-15T22:48:17.136193+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132433+0000","last_change":"2024-09-15T22:48:17.132433+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132433+0000","last_undegraded":"2024-09-15T22:48:17.132433+0000","last_fullsized":"2024-09-15T22:48:17.132433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132439+0000","last_change":"2024-09-15T22:48:17.132439+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132439+0000","last_undegraded":"2024-09-15T22:48:17.132439+0000","last_fullsized":"2024-09-15T22:48:17.132439+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129866+0000","last_change":"2024-09-15T22:48:17.129866+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129866+0000","last_undegraded":"2024-09-15T22:48:17.129866+0000","last_fullsized":"2024-09-15T22:48:17.129866+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128597+0000","last_change":"2024-09-15T22:48:17.128597+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128597+0000","last_undegraded":"2024-09-15T22:48:17.128597+0000","last_fullsized":"2024-09-15T22:48:17.128597+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130106+0000","last_change":"2024-09-15T22:48:17.130106+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130106+0000","last_undegraded":"2024-09-15T22:48:17.130106+0000","last_fullsized":"2024-09-15T22:48:17.130106+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127773+0000","last_change":"2024-09-15T22:48:17.127773+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127773+0000","last_undegraded":"2024-09-15T22:48:17.127773+0000","last_fullsized":"2024-09-15T22:48:17.127773+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127749+0000","last_change":"2024-09-15T22:48:17.127749+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127749+0000","last_undegraded":"2024-09-15T22:48:17.127749+0000","last_fullsized":"2024-09-15T22:48:17.127749+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127748+0000","last_change":"2024-09-15T22:48:17.127748+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127748+0000","last_undegraded":"2024-09-15T22:48:17.127748+0000","last_fullsized":"2024-09-15T22:48:17.127748+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136209+0000","last_change":"2024-09-15T22:48:17.136209+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136209+0000","last_undegraded":"2024-09-15T22:48:17.136209+0000","last_fullsized":"2024-09-15T22:48:17.136209+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129368+0000","last_change":"2024-09-15T22:48:17.129368+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129368+0000","last_undegraded":"2024-09-15T22:48:17.129368+0000","last_fullsized":"2024-09-15T22:48:17.129368+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":454,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-15T22:48:17.126283+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:17.126283+0000","last_peered":"2024-09-15T22:48:17.126283+0000","last_clean":"2024-09-15T22:48:17.126283+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:17.126283+0000","last_undegraded":"2024-09-15T22:48:17.126283+0000","last_fullsized":"2024-09-15T22:48:17.126283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509529,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509528,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1945600,"data_stored":854485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:22.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.217+0000 7f28a29d6640 1 Processor -- start 2024-09-15T22:48:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.217+0000 7f28a29d6640 1 -- start start 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f28a29d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f28a29d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f28a29d6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f289c0ce740 con 0x7f289c0cf5b0 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f28a29d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f289c072640 con 0x7f289c0ce230 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f28a29d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f289c072920 con 0x7f289c15c180 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f289b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f289bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f289b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:49952/0 (socket says 172.21.15.134:49952) 2024-09-15T22:48:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f289bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:46930/0 (socket says 172.21.15.134:46930) 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.218+0000 7f289b7fe640 1 -- 172.21.15.134:0/3602106067 learned_addr learned my addr 172.21.15.134:0/3602106067 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289bfff640 1 -- 172.21.15.134:0/3602106067 >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 msgr2=0x7f289c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289bfff640 1 --2- 172.21.15.134:0/3602106067 >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289bfff640 1 -- 172.21.15.134:0/3602106067 >> v1:172.21.15.177:6789/0 conn(0x7f289c0cf5b0 legacy=0x7f289c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289bfff640 1 -- 172.21.15.134:0/3602106067 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c072c00 con 0x7f289c15c180 2024-09-15T22:48:22.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289b7fe640 1 --2- 172.21.15.134:0/3602106067 >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.219+0000 7f289bfff640 1 --2- 172.21.15.134:0/3602106067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097a0 tx=0x7f288c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f2a2bae16bd4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f289affd640 1 -- 172.21.15.134:0/3602106067 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c037070 con 0x7f289c15c180 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f289affd640 1 -- 172.21.15.134:0/3602106067 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c02ae50 con 0x7f289c15c180 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f289affd640 1 -- 172.21.15.134:0/3602106067 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c032660 con 0x7f289c15c180 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 -- 172.21.15.134:0/3602106067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 msgr2=0x7f289c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 --2- 172.21.15.134:0/3602106067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097a0 tx=0x7f288c02a100 comp rx=0 tx=0).stop 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 -- 172.21.15.134:0/3602106067 shutdown_connections 2024-09-15T22:48:22.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 --2- 172.21.15.134:0/3602106067 >> v2:172.21.15.177:3300/0 conn(0x7f289c0ce230 0x7f289c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 --2- 172.21.15.134:0/3602106067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c15c180 0x7f289c0cdcf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 -- 172.21.15.134:0/3602106067 >> 172.21.15.134:0/3602106067 conn(0x7f289c062cc0 msgr2=0x7f289c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 -- 172.21.15.134:0/3602106067 shutdown_connections 2024-09-15T22:48:22.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.220+0000 7f28a29d6640 1 -- 172.21.15.134:0/3602106067 wait complete. 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.221+0000 7f28a29d6640 1 Processor -- start 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 -- start start 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c0ce230 0x7f289c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f289c0cf5b0 0x7f289c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f289c15c560 con 0x7f289c15c180 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f289c0722f0 con 0x7f289c0cf5b0 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a29d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f289c15c6e0 con 0x7f289c0ce230 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a0f73640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a0f73640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51010/0 (socket says 172.21.15.134:51010) 2024-09-15T22:48:22.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f28a0f73640 1 -- 172.21.15.134:0/2725060295 learned_addr learned my addr 172.21.15.134:0/2725060295 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.222+0000 7f289bfff640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c0ce230 0x7f289c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f289b7fe640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f289c0cf5b0 0x7f289c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 -- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c0ce230 msgr2=0x7f289c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c0ce230 0x7f289c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 -- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f289c0cf5b0 msgr2=0x7f289c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f289c0cf5b0 0x7f289c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 -- 172.21.15.134:0/2725060295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c15ca30 con 0x7f289c15c180 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a0f73640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f289400c760 tx=0x7f289400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894003b70 con 0x7f289c15c180 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894003d10 con 0x7f289c15c180 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c15ccd0 con 0x7f289c15c180 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289400aa90 con 0x7f289c15c180 2024-09-15T22:48:22.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.223+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c15d290 con 0x7f289c15c180 2024-09-15T22:48:22.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.224+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c0cf070 con 0x7f289c15c180 2024-09-15T22:48:22.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.225+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f289400ac30 con 0x7f289c15c180 2024-09-15T22:48:22.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.225+0000 7f2898ff9640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 0x7f288806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.225+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f2894089a70 con 0x7f289c15c180 2024-09-15T22:48:22.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.225+0000 7f289bfff640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 0x7f288806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.226+0000 7f289bfff640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 0x7f288806ef50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f288c034000 tx=0x7f288c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.230+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2894059480 con 0x7f289c15c180 2024-09-15T22:48:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.390+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f289c073e00 con 0x7f288806ca90 2024-09-15T22:48:22.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.396+0000 7f2898ff9640 1 -- 172.21.15.134:0/2725060295 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240247 (secure 0 0 0) 0x7f289c073e00 con 0x7f288806ca90 2024-09-15T22:48:22.399 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:22.401 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 msgr2=0x7f288806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 0x7f288806ef50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f288c034000 tx=0x7f288c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 msgr2=0x7f289c1509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f289400c760 tx=0x7f289400cc20 comp rx=0 tx=0).stop 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 shutdown_connections 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f288806ca90 0x7f288806ef50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f289c15c180 0x7f289c1509f0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f289c0cf5b0 0x7f289c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 --2- 172.21.15.134:0/2725060295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f289c0ce230 0x7f289c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 >> 172.21.15.134:0/2725060295 conn(0x7f289c062cc0 msgr2=0x7f289c0cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 shutdown_connections 2024-09-15T22:48:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.399+0000 7f28a29d6640 1 -- 172.21.15.134:0/2725060295 wait complete. 2024-09-15T22:48:22.411 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-15T22:48:21.224048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265816,"kb_used_data":16276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708904,"statfs":{"total":773094113280,"available":772821917696,"internally_reserved":0,"allocated":16666624,"data_stored":7975505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.097530"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128525+0000","last_change":"2024-09-15T22:48:17.128525+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128525+0000","last_undegraded":"2024-09-15T22:48:17.128525+0000","last_fullsized":"2024-09-15T22:48:17.128525+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129802+0000","last_change":"2024-09-15T22:48:17.129802+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129802+0000","last_undegraded":"2024-09-15T22:48:17.129802+0000","last_fullsized":"2024-09-15T22:48:17.129802+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130847+0000","last_change":"2024-09-15T22:48:17.130847+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130847+0000","last_undegraded":"2024-09-15T22:48:17.130847+0000","last_fullsized":"2024-09-15T22:48:17.130847+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129635+0000","last_change":"2024-09-15T22:48:17.129635+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129635+0000","last_undegraded":"2024-09-15T22:48:17.129635+0000","last_fullsized":"2024-09-15T22:48:17.129635+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131196+0000","last_change":"2024-09-15T22:48:17.131196+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131196+0000","last_undegraded":"2024-09-15T22:48:17.131196+0000","last_fullsized":"2024-09-15T22:48:17.131196+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130098+0000","last_change":"2024-09-15T22:48:17.130098+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130098+0000","last_undegraded":"2024-09-15T22:48:17.130098+0000","last_fullsized":"2024-09-15T22:48:17.130098+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129816+0000","last_change":"2024-09-15T22:48:17.129816+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129816+0000","last_undegraded":"2024-09-15T22:48:17.129816+0000","last_fullsized":"2024-09-15T22:48:17.129816+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.133426+0000","last_change":"2024-09-15T22:48:17.133426+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.133426+0000","last_undegraded":"2024-09-15T22:48:17.133426+0000","last_fullsized":"2024-09-15T22:48:17.133426+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127774+0000","last_change":"2024-09-15T22:48:17.127774+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127774+0000","last_undegraded":"2024-09-15T22:48:17.127774+0000","last_fullsized":"2024-09-15T22:48:17.127774+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130213+0000","last_change":"2024-09-15T22:48:17.130213+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130213+0000","last_undegraded":"2024-09-15T22:48:17.130213+0000","last_fullsized":"2024-09-15T22:48:17.130213+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130751+0000","last_change":"2024-09-15T22:48:17.130751+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130751+0000","last_undegraded":"2024-09-15T22:48:17.130751+0000","last_fullsized":"2024-09-15T22:48:17.130751+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129370+0000","last_change":"2024-09-15T22:48:17.129370+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129370+0000","last_undegraded":"2024-09-15T22:48:17.129370+0000","last_fullsized":"2024-09-15T22:48:17.129370+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127752+0000","last_change":"2024-09-15T22:48:17.127752+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127752+0000","last_undegraded":"2024-09-15T22:48:17.127752+0000","last_fullsized":"2024-09-15T22:48:17.127752+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130003+0000","last_change":"2024-09-15T22:48:17.130003+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130003+0000","last_undegraded":"2024-09-15T22:48:17.130003+0000","last_fullsized":"2024-09-15T22:48:17.130003+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129376+0000","last_change":"2024-09-15T22:48:17.129376+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129376+0000","last_undegraded":"2024-09-15T22:48:17.129376+0000","last_fullsized":"2024-09-15T22:48:17.129376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131281+0000","last_change":"2024-09-15T22:48:17.131281+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131281+0000","last_undegraded":"2024-09-15T22:48:17.131281+0000","last_fullsized":"2024-09-15T22:48:17.131281+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136988+0000","last_change":"2024-09-15T22:48:17.136988+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136988+0000","last_undegraded":"2024-09-15T22:48:17.136988+0000","last_fullsized":"2024-09-15T22:48:17.136988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130176+0000","last_change":"2024-09-15T22:48:17.130176+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130176+0000","last_undegraded":"2024-09-15T22:48:17.130176+0000","last_fullsized":"2024-09-15T22:48:17.130176+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136144+0000","last_change":"2024-09-15T22:48:17.136144+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136144+0000","last_undegraded":"2024-09-15T22:48:17.136144+0000","last_fullsized":"2024-09-15T22:48:17.136144+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136193+0000","last_change":"2024-09-15T22:48:17.136193+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136193+0000","last_undegraded":"2024-09-15T22:48:17.136193+0000","last_fullsized":"2024-09-15T22:48:17.136193+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132433+0000","last_change":"2024-09-15T22:48:17.132433+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132433+0000","last_undegraded":"2024-09-15T22:48:17.132433+0000","last_fullsized":"2024-09-15T22:48:17.132433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132439+0000","last_change":"2024-09-15T22:48:17.132439+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132439+0000","last_undegraded":"2024-09-15T22:48:17.132439+0000","last_fullsized":"2024-09-15T22:48:17.132439+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129866+0000","last_change":"2024-09-15T22:48:17.129866+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129866+0000","last_undegraded":"2024-09-15T22:48:17.129866+0000","last_fullsized":"2024-09-15T22:48:17.129866+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128597+0000","last_change":"2024-09-15T22:48:17.128597+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128597+0000","last_undegraded":"2024-09-15T22:48:17.128597+0000","last_fullsized":"2024-09-15T22:48:17.128597+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130106+0000","last_change":"2024-09-15T22:48:17.130106+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130106+0000","last_undegraded":"2024-09-15T22:48:17.130106+0000","last_fullsized":"2024-09-15T22:48:17.130106+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127773+0000","last_change":"2024-09-15T22:48:17.127773+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127773+0000","last_undegraded":"2024-09-15T22:48:17.127773+0000","last_fullsized":"2024-09-15T22:48:17.127773+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127749+0000","last_change":"2024-09-15T22:48:17.127749+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127749+0000","last_undegraded":"2024-09-15T22:48:17.127749+0000","last_fullsized":"2024-09-15T22:48:17.127749+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127748+0000","last_change":"2024-09-15T22:48:17.127748+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127748+0000","last_undegraded":"2024-09-15T22:48:17.127748+0000","last_fullsized":"2024-09-15T22:48:17.127748+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136209+0000","last_change":"2024-09-15T22:48:17.136209+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136209+0000","last_undegraded":"2024-09-15T22:48:17.136209+0000","last_fullsized":"2024-09-15T22:48:17.136209+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129368+0000","last_change":"2024-09-15T22:48:17.129368+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129368+0000","last_undegraded":"2024-09-15T22:48:17.129368+0000","last_fullsized":"2024-09-15T22:48:17.129368+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":454,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-15T22:48:17.126283+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:17.126283+0000","last_peered":"2024-09-15T22:48:17.126283+0000","last_clean":"2024-09-15T22:48:17.126283+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:17.126283+0000","last_undegraded":"2024-09-15T22:48:17.126283+0000","last_fullsized":"2024-09-15T22:48:17.126283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509529,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509528,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1945600,"data_stored":854485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:22.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:22.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:48:22.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:48:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.548+0000 7fef532af640 1 Processor -- start 2024-09-15T22:48:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.549+0000 7fef532af640 1 -- start start 2024-09-15T22:48:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef532af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c15b5b0 0x7fef4c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef532af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ce6c0 0x7fef4c0729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef532af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c15fb70 con 0x7fef4c15f190 2024-09-15T22:48:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef532af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c160130 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef532af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c15fe50 con 0x7fef4c15b5b0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ce6c0 0x7fef4c0729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ce6c0 0x7fef4c0729b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51026/0 (socket says 172.21.15.134:51026) 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 -- 172.21.15.134:0/2286035237 learned_addr learned my addr 172.21.15.134:0/2286035237 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5104b640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c15b5b0 0x7fef4c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 -- 172.21.15.134:0/2286035237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c15b5b0 msgr2=0x7fef4c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c15b5b0 0x7fef4c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 -- 172.21.15.134:0/2286035237 >> v1:172.21.15.177:6789/0 conn(0x7fef4c15f190 legacy=0x7fef4c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.550+0000 7fef5184c640 1 -- 172.21.15.134:0/2286035237 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c0721b0 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.551+0000 7fef5184c640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c0ce6c0 0x7fef4c0729b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fef44009e50 tx=0x7fef4402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcedb3d17fe561b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.551+0000 7fef43fff640 1 -- 172.21.15.134:0/2286035237 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44036070 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.551+0000 7fef43fff640 1 -- 172.21.15.134:0/2286035237 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44031600 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.551+0000 7fef43fff640 1 -- 172.21.15.134:0/2286035237 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440319d0 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 -- 172.21.15.134:0/2286035237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c0ce6c0 msgr2=0x7fef4c0729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c0ce6c0 0x7fef4c0729b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fef44009e50 tx=0x7fef4402a710 comp rx=0 tx=0).stop 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 -- 172.21.15.134:0/2286035237 shutdown_connections 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c0ce6c0 0x7fef4c0729b0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 --2- 172.21.15.134:0/2286035237 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c15b5b0 0x7fef4c0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 -- 172.21.15.134:0/2286035237 >> 172.21.15.134:0/2286035237 conn(0x7fef4c0b32d0 msgr2=0x7fef4c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 -- 172.21.15.134:0/2286035237 shutdown_connections 2024-09-15T22:48:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.552+0000 7fef532af640 1 -- 172.21.15.134:0/2286035237 wait complete. 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.553+0000 7fef532af640 1 Processor -- start 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.553+0000 7fef532af640 1 -- start start 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c0ce6c0 0x7fef4c14c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4c15f190 0x7fef4c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0ceeb0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c15b990 con 0x7fef4c15f190 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef532af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0cf030 con 0x7fef4c0ce6c0 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51032/0 (socket says 172.21.15.134:51032) 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 -- 172.21.15.134:0/1054254711 learned_addr learned my addr 172.21.15.134:0/1054254711 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5184c640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4c15f190 0x7fef4c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5104b640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c0ce6c0 0x7fef4c14c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 -- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c0ce6c0 msgr2=0x7fef4c14c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c0ce6c0 0x7fef4c14c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 -- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4c15f190 msgr2=0x7fef4c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4c15f190 0x7fef4c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 -- 172.21.15.134:0/1054254711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c1e6020 con 0x7fef4c15b5b0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.554+0000 7fef5084a640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c470 tx=0x7fef3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.555+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0052d0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.555+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c005470 con 0x7fef4c15b5b0 2024-09-15T22:48:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.555+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c1e6300 con 0x7fef4c15b5b0 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.555+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c007260 con 0x7fef4c15b5b0 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.555+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1e68c0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.556+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c15f5d0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.556+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fef3c007400 con 0x7fef4c15b5b0 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.557+0000 7fef41ffb640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 0x7fef3006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.557+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fef3c0892d0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.557+0000 7fef5104b640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 0x7fef3006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.557+0000 7fef5104b640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 0x7fef3006ef50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fef4c157860 tx=0x7fef48009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.561+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef3c058ce0 con 0x7fef4c15b5b0 2024-09-15T22:48:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.725+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef4c0b3ec0 con 0x7fef3006ca90 2024-09-15T22:48:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.731+0000 7fef41ffb640 1 -- 172.21.15.134:0/1054254711 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240247 (secure 0 0 0) 0x7fef4c0b3ec0 con 0x7fef3006ca90 2024-09-15T22:48:22.735 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:22.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 msgr2=0x7fef3006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 0x7fef3006ef50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fef4c157860 tx=0x7fef48009190 comp rx=0 tx=0).stop 2024-09-15T22:48:22.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 msgr2=0x7fef4c15bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c470 tx=0x7fef3c001e70 comp rx=0 tx=0).stop 2024-09-15T22:48:22.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 shutdown_connections 2024-09-15T22:48:22.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4c15f190 0x7fef4c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fef3006ca90 0x7fef3006ef50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c15b5b0 0x7fef4c15bb10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 --2- 172.21.15.134:0/1054254711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef4c0ce6c0 0x7fef4c14c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.734+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 >> 172.21.15.134:0/1054254711 conn(0x7fef4c0b32d0 msgr2=0x7fef4c0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.735+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 shutdown_connections 2024-09-15T22:48:22.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.735+0000 7fef532af640 1 -- 172.21.15.134:0/1054254711 wait complete. 2024-09-15T22:48:22.747 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-15T22:48:21.224048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265816,"kb_used_data":16276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708904,"statfs":{"total":773094113280,"available":772821917696,"internally_reserved":0,"allocated":16666624,"data_stored":7975505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.097530"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128525+0000","last_change":"2024-09-15T22:48:17.128525+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128525+0000","last_undegraded":"2024-09-15T22:48:17.128525+0000","last_fullsized":"2024-09-15T22:48:17.128525+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129802+0000","last_change":"2024-09-15T22:48:17.129802+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129802+0000","last_undegraded":"2024-09-15T22:48:17.129802+0000","last_fullsized":"2024-09-15T22:48:17.129802+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130847+0000","last_change":"2024-09-15T22:48:17.130847+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130847+0000","last_undegraded":"2024-09-15T22:48:17.130847+0000","last_fullsized":"2024-09-15T22:48:17.130847+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129635+0000","last_change":"2024-09-15T22:48:17.129635+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129635+0000","last_undegraded":"2024-09-15T22:48:17.129635+0000","last_fullsized":"2024-09-15T22:48:17.129635+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131196+0000","last_change":"2024-09-15T22:48:17.131196+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131196+0000","last_undegraded":"2024-09-15T22:48:17.131196+0000","last_fullsized":"2024-09-15T22:48:17.131196+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130098+0000","last_change":"2024-09-15T22:48:17.130098+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130098+0000","last_undegraded":"2024-09-15T22:48:17.130098+0000","last_fullsized":"2024-09-15T22:48:17.130098+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129816+0000","last_change":"2024-09-15T22:48:17.129816+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129816+0000","last_undegraded":"2024-09-15T22:48:17.129816+0000","last_fullsized":"2024-09-15T22:48:17.129816+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.133426+0000","last_change":"2024-09-15T22:48:17.133426+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.133426+0000","last_undegraded":"2024-09-15T22:48:17.133426+0000","last_fullsized":"2024-09-15T22:48:17.133426+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127774+0000","last_change":"2024-09-15T22:48:17.127774+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127774+0000","last_undegraded":"2024-09-15T22:48:17.127774+0000","last_fullsized":"2024-09-15T22:48:17.127774+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130213+0000","last_change":"2024-09-15T22:48:17.130213+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130213+0000","last_undegraded":"2024-09-15T22:48:17.130213+0000","last_fullsized":"2024-09-15T22:48:17.130213+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130751+0000","last_change":"2024-09-15T22:48:17.130751+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130751+0000","last_undegraded":"2024-09-15T22:48:17.130751+0000","last_fullsized":"2024-09-15T22:48:17.130751+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129370+0000","last_change":"2024-09-15T22:48:17.129370+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129370+0000","last_undegraded":"2024-09-15T22:48:17.129370+0000","last_fullsized":"2024-09-15T22:48:17.129370+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127752+0000","last_change":"2024-09-15T22:48:17.127752+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127752+0000","last_undegraded":"2024-09-15T22:48:17.127752+0000","last_fullsized":"2024-09-15T22:48:17.127752+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130003+0000","last_change":"2024-09-15T22:48:17.130003+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130003+0000","last_undegraded":"2024-09-15T22:48:17.130003+0000","last_fullsized":"2024-09-15T22:48:17.130003+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129376+0000","last_change":"2024-09-15T22:48:17.129376+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129376+0000","last_undegraded":"2024-09-15T22:48:17.129376+0000","last_fullsized":"2024-09-15T22:48:17.129376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.131281+0000","last_change":"2024-09-15T22:48:17.131281+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.131281+0000","last_undegraded":"2024-09-15T22:48:17.131281+0000","last_fullsized":"2024-09-15T22:48:17.131281+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136988+0000","last_change":"2024-09-15T22:48:17.136988+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136988+0000","last_undegraded":"2024-09-15T22:48:17.136988+0000","last_fullsized":"2024-09-15T22:48:17.136988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132437+0000","last_change":"2024-09-15T22:48:17.132437+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132437+0000","last_undegraded":"2024-09-15T22:48:17.132437+0000","last_fullsized":"2024-09-15T22:48:17.132437+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130176+0000","last_change":"2024-09-15T22:48:17.130176+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130176+0000","last_undegraded":"2024-09-15T22:48:17.130176+0000","last_fullsized":"2024-09-15T22:48:17.130176+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136144+0000","last_change":"2024-09-15T22:48:17.136144+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136144+0000","last_undegraded":"2024-09-15T22:48:17.136144+0000","last_fullsized":"2024-09-15T22:48:17.136144+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136193+0000","last_change":"2024-09-15T22:48:17.136193+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136193+0000","last_undegraded":"2024-09-15T22:48:17.136193+0000","last_fullsized":"2024-09-15T22:48:17.136193+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132433+0000","last_change":"2024-09-15T22:48:17.132433+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132433+0000","last_undegraded":"2024-09-15T22:48:17.132433+0000","last_fullsized":"2024-09-15T22:48:17.132433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.132439+0000","last_change":"2024-09-15T22:48:17.132439+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.132439+0000","last_undegraded":"2024-09-15T22:48:17.132439+0000","last_fullsized":"2024-09-15T22:48:17.132439+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129866+0000","last_change":"2024-09-15T22:48:17.129866+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129866+0000","last_undegraded":"2024-09-15T22:48:17.129866+0000","last_fullsized":"2024-09-15T22:48:17.129866+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.128597+0000","last_change":"2024-09-15T22:48:17.128597+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.128597+0000","last_undegraded":"2024-09-15T22:48:17.128597+0000","last_fullsized":"2024-09-15T22:48:17.128597+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.130106+0000","last_change":"2024-09-15T22:48:17.130106+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.130106+0000","last_undegraded":"2024-09-15T22:48:17.130106+0000","last_fullsized":"2024-09-15T22:48:17.130106+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127773+0000","last_change":"2024-09-15T22:48:17.127773+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127773+0000","last_undegraded":"2024-09-15T22:48:17.127773+0000","last_fullsized":"2024-09-15T22:48:17.127773+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127749+0000","last_change":"2024-09-15T22:48:17.127749+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127749+0000","last_undegraded":"2024-09-15T22:48:17.127749+0000","last_fullsized":"2024-09-15T22:48:17.127749+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.127748+0000","last_change":"2024-09-15T22:48:17.127748+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.127748+0000","last_undegraded":"2024-09-15T22:48:17.127748+0000","last_fullsized":"2024-09-15T22:48:17.127748+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.136209+0000","last_change":"2024-09-15T22:48:17.136209+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.136209+0000","last_undegraded":"2024-09-15T22:48:17.136209+0000","last_fullsized":"2024-09-15T22:48:17.136209+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:18.125254+0000","last_change":"2024-09-15T22:48:18.125254+0000","last_active":"2024-09-15T22:48:18.125254+0000","last_peered":"2024-09-15T22:48:18.125254+0000","last_clean":"2024-09-15T22:48:18.125254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:18.125254+0000","last_undegraded":"2024-09-15T22:48:18.125254+0000","last_fullsized":"2024-09-15T22:48:18.125254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2024-09-15T22:48:17.129368+0000","last_change":"2024-09-15T22:48:17.129368+0000","last_active":"2024-09-15T22:48:17.123057+0000","last_peered":"2024-09-15T22:48:17.123057+0000","last_clean":"2024-09-15T22:48:17.123057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:17.129368+0000","last_undegraded":"2024-09-15T22:48:17.129368+0000","last_fullsized":"2024-09-15T22:48:17.129368+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":454,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-15T22:48:17.126283+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:17.126283+0000","last_peered":"2024-09-15T22:48:17.126283+0000","last_clean":"2024-09-15T22:48:17.126283+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:17.126283+0000","last_undegraded":"2024-09-15T22:48:17.126283+0000","last_fullsized":"2024-09-15T22:48:17.126283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509529,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509528,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1933312,"data_stored":848612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509528,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2527232,"data_stored":1438980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1945600,"data_stored":854485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3f is not active+clean 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3e is not active+clean 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3d is not active+clean 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3c is not active+clean 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3b is not active+clean 2024-09-15T22:48:22.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3a is not active+clean 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.39 is not active+clean 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.38 is not active+clean 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.37 is not active+clean 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.36 is not active+clean 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.752 INFO:tasks.ceph.ceph_manager.ceph:PG 25.35 is not active+clean 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:PG 25.34 is not active+clean 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:PG 25.33 is not active+clean 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:PG 25.32 is not active+clean 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:PG 25.31 is not active+clean 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.753 INFO:tasks.ceph.ceph_manager.ceph:PG 25.30 is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2f is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2e is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2d is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2c is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2b is not active+clean 2024-09-15T22:48:22.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2a is not active+clean 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.29 is not active+clean 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.28 is not active+clean 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.27 is not active+clean 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.26 is not active+clean 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.755 INFO:tasks.ceph.ceph_manager.ceph:PG 25.25 is not active+clean 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:PG 25.24 is not active+clean 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:PG 25.23 is not active+clean 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:PG 25.22 is not active+clean 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:PG 25.21 is not active+clean 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.756 INFO:tasks.ceph.ceph_manager.ceph:PG 25.20 is not active+clean 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1e is not active+clean 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1f is not active+clean 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.128525+0000', 'last_change': '2024-09-15T22:48:17.128525+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.128525+0000', 'last_undegraded': '2024-09-15T22:48:17.128525+0000', 'last_fullsized': '2024-09-15T22:48:17.128525+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1f is not active+clean 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1e is not active+clean 2024-09-15T22:48:22.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129802+0000', 'last_change': '2024-09-15T22:48:17.129802+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129802+0000', 'last_undegraded': '2024-09-15T22:48:17.129802+0000', 'last_fullsized': '2024-09-15T22:48:17.129802+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1c is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1d is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130847+0000', 'last_change': '2024-09-15T22:48:17.130847+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130847+0000', 'last_undegraded': '2024-09-15T22:48:17.130847+0000', 'last_fullsized': '2024-09-15T22:48:17.130847+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1d is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1c is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129635+0000', 'last_change': '2024-09-15T22:48:17.129635+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129635+0000', 'last_undegraded': '2024-09-15T22:48:17.129635+0000', 'last_fullsized': '2024-09-15T22:48:17.129635+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1a is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1b is not active+clean 2024-09-15T22:48:22.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.131196+0000', 'last_change': '2024-09-15T22:48:17.131196+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.131196+0000', 'last_undegraded': '2024-09-15T22:48:17.131196+0000', 'last_fullsized': '2024-09-15T22:48:17.131196+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1b is not active+clean 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1a is not active+clean 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130098+0000', 'last_change': '2024-09-15T22:48:17.130098+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130098+0000', 'last_undegraded': '2024-09-15T22:48:17.130098+0000', 'last_fullsized': '2024-09-15T22:48:17.130098+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:PG 25.19 is not active+clean 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:PG 24.18 is not active+clean 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129816+0000', 'last_change': '2024-09-15T22:48:17.129816+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129816+0000', 'last_undegraded': '2024-09-15T22:48:17.129816+0000', 'last_fullsized': '2024-09-15T22:48:17.129816+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:PG 25.16 is not active+clean 2024-09-15T22:48:22.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:PG 24.17 is not active+clean 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.133426+0000', 'last_change': '2024-09-15T22:48:17.133426+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.133426+0000', 'last_undegraded': '2024-09-15T22:48:17.133426+0000', 'last_fullsized': '2024-09-15T22:48:17.133426+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:PG 25.17 is not active+clean 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:PG 24.16 is not active+clean 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.127774+0000', 'last_change': '2024-09-15T22:48:17.127774+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.127774+0000', 'last_undegraded': '2024-09-15T22:48:17.127774+0000', 'last_fullsized': '2024-09-15T22:48:17.127774+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:PG 25.14 is not active+clean 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:PG 24.15 is not active+clean 2024-09-15T22:48:22.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130213+0000', 'last_change': '2024-09-15T22:48:17.130213+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130213+0000', 'last_undegraded': '2024-09-15T22:48:17.130213+0000', 'last_fullsized': '2024-09-15T22:48:17.130213+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:PG 24.14 is not active+clean 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130751+0000', 'last_change': '2024-09-15T22:48:17.130751+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130751+0000', 'last_undegraded': '2024-09-15T22:48:17.130751+0000', 'last_fullsized': '2024-09-15T22:48:17.130751+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:PG 25.12 is not active+clean 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:PG 24.13 is not active+clean 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129370+0000', 'last_change': '2024-09-15T22:48:17.129370+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129370+0000', 'last_undegraded': '2024-09-15T22:48:17.129370+0000', 'last_fullsized': '2024-09-15T22:48:17.129370+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:22.761 INFO:tasks.ceph.ceph_manager.ceph:PG 25.13 is not active+clean 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:PG 24.12 is not active+clean 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.127752+0000', 'last_change': '2024-09-15T22:48:17.127752+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.127752+0000', 'last_undegraded': '2024-09-15T22:48:17.127752+0000', 'last_fullsized': '2024-09-15T22:48:17.127752+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:PG 25.10 is not active+clean 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:PG 24.11 is not active+clean 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130003+0000', 'last_change': '2024-09-15T22:48:17.130003+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130003+0000', 'last_undegraded': '2024-09-15T22:48:17.130003+0000', 'last_fullsized': '2024-09-15T22:48:17.130003+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.762 INFO:tasks.ceph.ceph_manager.ceph:PG 25.11 is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 24.10 is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129376+0000', 'last_change': '2024-09-15T22:48:17.129376+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129376+0000', 'last_undegraded': '2024-09-15T22:48:17.129376+0000', 'last_fullsized': '2024-09-15T22:48:17.129376+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 25.e is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 24.f is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.131281+0000', 'last_change': '2024-09-15T22:48:17.131281+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.131281+0000', 'last_undegraded': '2024-09-15T22:48:17.131281+0000', 'last_fullsized': '2024-09-15T22:48:17.131281+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 25.f is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 24.e is not active+clean 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.136988+0000', 'last_change': '2024-09-15T22:48:17.136988+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.136988+0000', 'last_undegraded': '2024-09-15T22:48:17.136988+0000', 'last_fullsized': '2024-09-15T22:48:17.136988+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:22.763 INFO:tasks.ceph.ceph_manager.ceph:PG 25.c is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:PG 24.d is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.132437+0000', 'last_change': '2024-09-15T22:48:17.132437+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.132437+0000', 'last_undegraded': '2024-09-15T22:48:17.132437+0000', 'last_fullsized': '2024-09-15T22:48:17.132437+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:PG 25.d is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:PG 24.c is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.132437+0000', 'last_change': '2024-09-15T22:48:17.132437+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.132437+0000', 'last_undegraded': '2024-09-15T22:48:17.132437+0000', 'last_fullsized': '2024-09-15T22:48:17.132437+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:PG 25.a is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:PG 24.b is not active+clean 2024-09-15T22:48:22.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130176+0000', 'last_change': '2024-09-15T22:48:17.130176+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130176+0000', 'last_undegraded': '2024-09-15T22:48:17.130176+0000', 'last_fullsized': '2024-09-15T22:48:17.130176+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 25.b is not active+clean 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 24.a is not active+clean 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.136144+0000', 'last_change': '2024-09-15T22:48:17.136144+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.136144+0000', 'last_undegraded': '2024-09-15T22:48:17.136144+0000', 'last_fullsized': '2024-09-15T22:48:17.136144+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 25.8 is not active+clean 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 24.9 is not active+clean 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.136193+0000', 'last_change': '2024-09-15T22:48:17.136193+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.136193+0000', 'last_undegraded': '2024-09-15T22:48:17.136193+0000', 'last_fullsized': '2024-09-15T22:48:17.136193+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 25.9 is not active+clean 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.765 INFO:tasks.ceph.ceph_manager.ceph:PG 24.8 is not active+clean 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.132433+0000', 'last_change': '2024-09-15T22:48:17.132433+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.132433+0000', 'last_undegraded': '2024-09-15T22:48:17.132433+0000', 'last_fullsized': '2024-09-15T22:48:17.132433+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:PG 25.6 is not active+clean 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:PG 24.7 is not active+clean 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.132439+0000', 'last_change': '2024-09-15T22:48:17.132439+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.132439+0000', 'last_undegraded': '2024-09-15T22:48:17.132439+0000', 'last_fullsized': '2024-09-15T22:48:17.132439+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:PG 24.6 is not active+clean 2024-09-15T22:48:22.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129866+0000', 'last_change': '2024-09-15T22:48:17.129866+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129866+0000', 'last_undegraded': '2024-09-15T22:48:17.129866+0000', 'last_fullsized': '2024-09-15T22:48:17.129866+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 25.4 is not active+clean 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 24.5 is not active+clean 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.128597+0000', 'last_change': '2024-09-15T22:48:17.128597+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.128597+0000', 'last_undegraded': '2024-09-15T22:48:17.128597+0000', 'last_fullsized': '2024-09-15T22:48:17.128597+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 25.5 is not active+clean 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 24.4 is not active+clean 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.130106+0000', 'last_change': '2024-09-15T22:48:17.130106+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.130106+0000', 'last_undegraded': '2024-09-15T22:48:17.130106+0000', 'last_fullsized': '2024-09-15T22:48:17.130106+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2 is not active+clean 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.767 INFO:tasks.ceph.ceph_manager.ceph:PG 24.3 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.127773+0000', 'last_change': '2024-09-15T22:48:17.127773+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.127773+0000', 'last_undegraded': '2024-09-15T22:48:17.127773+0000', 'last_fullsized': '2024-09-15T22:48:17.127773+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:PG 24.2 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.127749+0000', 'last_change': '2024-09-15T22:48:17.127749+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.127749+0000', 'last_undegraded': '2024-09-15T22:48:17.127749+0000', 'last_fullsized': '2024-09-15T22:48:17.127749+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:PG 25.0 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.127748+0000', 'last_change': '2024-09-15T22:48:17.127748+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.127748+0000', 'last_undegraded': '2024-09-15T22:48:17.127748+0000', 'last_fullsized': '2024-09-15T22:48:17.127748+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1 is not active+clean 2024-09-15T22:48:22.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:PG 24.0 is not active+clean 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.136209+0000', 'last_change': '2024-09-15T22:48:17.136209+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.136209+0000', 'last_undegraded': '2024-09-15T22:48:17.136209+0000', 'last_fullsized': '2024-09-15T22:48:17.136209+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:PG 25.18 is not active+clean 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:18.125254+0000', 'last_change': '2024-09-15T22:48:18.125254+0000', 'last_active': '2024-09-15T22:48:18.125254+0000', 'last_peered': '2024-09-15T22:48:18.125254+0000', 'last_clean': '2024-09-15T22:48:18.125254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:18.125254+0000', 'last_undegraded': '2024-09-15T22:48:18.125254+0000', 'last_fullsized': '2024-09-15T22:48:18.125254+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:18.125254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:PG 24.19 is not active+clean 2024-09-15T22:48:22.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:17.129368+0000', 'last_change': '2024-09-15T22:48:17.129368+0000', 'last_active': '2024-09-15T22:48:17.123057+0000', 'last_peered': '2024-09-15T22:48:17.123057+0000', 'last_clean': '2024-09-15T22:48:17.123057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:17.129368+0000', 'last_undegraded': '2024-09-15T22:48:17.129368+0000', 'last_fullsized': '2024-09-15T22:48:17.129368+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:17.123057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:22.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:48:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.882+0000 7f884cc6e640 1 Processor -- start 2024-09-15T22:48:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.882+0000 7f884cc6e640 1 -- start start 2024-09-15T22:48:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884cc6e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8848151c50 0x7f88480cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884cc6e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480cd5f0 con 0x7f884806be10 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884cc6e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480cd8d0 con 0x7f884806c1f0 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884cc6e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f88480cdbb0 con 0x7f8848151c50 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f883ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8848151c50 0x7f88480cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884659c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f884806be10 0x7f8848151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55380/0 (socket says 172.21.15.134:55380) 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f884659c640 1 -- 172.21.15.134:0/1060683179 learned_addr learned my addr 172.21.15.134:0/1060683179 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f883ffff640 1 -- 172.21.15.134:0/1060683179 >> v1:172.21.15.177:6789/0 conn(0x7f884806c1f0 legacy=0x7f8848164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f883ffff640 1 -- 172.21.15.134:0/1060683179 >> v1:172.21.15.134:6789/0 conn(0x7f884806be10 legacy=0x7f8848151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f883ffff640 1 -- 172.21.15.134:0/1060683179 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88480cde90 con 0x7f8848151c50 2024-09-15T22:48:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.883+0000 7f8845d9b640 1 -- 172.21.15.134:0/1060683179 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249511263 0 0) 0x7f88480cd5f0 con 0x7f884806be10 2024-09-15T22:48:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f883ffff640 1 --2- 172.21.15.134:0/1060683179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f88480cd010 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f88300097a0 tx=0x7f883002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f85fe99ce062128 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f8845d9b640 1 -- 172.21.15.134:0/1060683179 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830037070 con 0x7f8848151c50 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f8845d9b640 1 -- 172.21.15.134:0/1060683179 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8830032440 con 0x7f8848151c50 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f8845d9b640 1 -- 172.21.15.134:0/1060683179 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830032810 con 0x7f8848151c50 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f884cc6e640 1 -- 172.21.15.134:0/1060683179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 msgr2=0x7f88480cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.884+0000 7f884cc6e640 1 --2- 172.21.15.134:0/1060683179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f88480cd010 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f88300097a0 tx=0x7f883002a1e0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.885+0000 7f884cc6e640 1 -- 172.21.15.134:0/1060683179 shutdown_connections 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.885+0000 7f884cc6e640 1 --2- 172.21.15.134:0/1060683179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f88480cd010 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.885+0000 7f884cc6e640 1 -- 172.21.15.134:0/1060683179 >> 172.21.15.134:0/1060683179 conn(0x7f8848062cc0 msgr2=0x7f884806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.885+0000 7f884cc6e640 1 -- 172.21.15.134:0/1060683179 shutdown_connections 2024-09-15T22:48:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.885+0000 7f884cc6e640 1 -- 172.21.15.134:0/1060683179 wait complete. 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.886+0000 7f884cc6e640 1 Processor -- start 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.886+0000 7f884cc6e640 1 -- start start 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f884806be10 0x7f8848151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f884806c1f0 0x7f884814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f884815baa0 con 0x7f8848151c50 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88480ce690 con 0x7f884806c1f0 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f884815bc20 con 0x7f884806be10 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51062/0 (socket says 172.21.15.134:51062) 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 -- 172.21.15.134:0/3134342110 learned_addr learned my addr 172.21.15.134:0/3134342110 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884659c640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f884806be10 0x7f8848151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f883ffff640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f884806c1f0 0x7f884814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 -- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f884806be10 msgr2=0x7f8848151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f884806be10 0x7f8848151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 -- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f884806c1f0 msgr2=0x7f884814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f884806c1f0 0x7f884814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 -- 172.21.15.134:0/3134342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88481557f0 con 0x7f8848151c50 2024-09-15T22:48:22.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f8846d9d640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7b0 tx=0x7f884000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840004b60 con 0x7f8848151c50 2024-09-15T22:48:22.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8840004d00 con 0x7f8848151c50 2024-09-15T22:48:22.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8848155ad0 con 0x7f8848151c50 2024-09-15T22:48:22.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884000aa90 con 0x7f8848151c50 2024-09-15T22:48:22.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.887+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8848156090 con 0x7f8848151c50 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.889+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88480cd010 con 0x7f8848151c50 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.889+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f884000ac30 con 0x7f8848151c50 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.889+0000 7f883effd640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 0x7f882806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.890+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f884008c6e0 con 0x7f8848151c50 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.890+0000 7f884659c640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 0x7f882806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:22.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.890+0000 7f884659c640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 0x7f882806ef50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8838000f60 tx=0x7f8838007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:22.894+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8840020070 con 0x7f8848151c50 2024-09-15T22:48:23.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.121+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f88480afd70 con 0x7f8848151c50 2024-09-15T22:48:23.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.122+0000 7f883effd640 1 -- 172.21.15.134:0/3134342110 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1574 (secure 0 0 0) 0x7f8840059970 con 0x7f8848151c50 2024-09-15T22:48:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:23.123 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":440,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":272195584,"bytes_avail":772821917696,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":82,"btime":"2024-09-15T22:48:21:148051+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"b","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-15T22:48:09.221406+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.123+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 msgr2=0x7f882806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.123+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 0x7f882806ef50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8838000f60 tx=0x7f8838007d50 comp rx=0 tx=0).stop 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.123+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 msgr2=0x7f8848073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.123+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7b0 tx=0x7f884000cc70 comp rx=0 tx=0).stop 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 shutdown_connections 2024-09-15T22:48:23.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f882806ca90 0x7f882806ef50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8848151c50 0x7f8848073150 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f884806c1f0 0x7f884814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 --2- 172.21.15.134:0/3134342110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f884806be10 0x7f8848151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 >> 172.21.15.134:0/3134342110 conn(0x7f8848062cc0 msgr2=0x7f88480b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 shutdown_connections 2024-09-15T22:48:23.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.124+0000 7f884cc6e640 1 -- 172.21.15.134:0/3134342110 wait complete. 2024-09-15T22:48:23.136 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:48:23.136 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.233+0000 7f260a423640 1 Processor -- start 2024-09-15T22:48:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.233+0000 7f260a423640 1 -- start start 2024-09-15T22:48:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.234+0000 7f260a423640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.234+0000 7f260a423640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.234+0000 7f260a423640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26040b5a60 con 0x7f26040ce200 2024-09-15T22:48:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.234+0000 7f260a423640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f26040b3ed0 con 0x7f26040b3550 2024-09-15T22:48:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.234+0000 7f260a423640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f26040b5d00 con 0x7f260415c3d0 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f26037fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f26037fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:49990/0 (socket says 172.21.15.134:49990) 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:46980/0 (socket says 172.21.15.134:46980) 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f26037fe640 1 -- 172.21.15.134:0/469133119 learned_addr learned my addr 172.21.15.134:0/469133119 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f26089c0640 1 --1- 172.21.15.134:0/469133119 >> v1:172.21.15.177:6789/0 conn(0x7f26040ce200 0x7f26040ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:47158/0 (socket says 172.21.15.134:47158) 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2602ffd640 1 -- 172.21.15.134:0/469133119 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684486992 0 0) 0x7f26040b5a60 con 0x7f26040ce200 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2602ffd640 1 -- 172.21.15.134:0/469133119 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25ec003520 con 0x7f26040ce200 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 -- 172.21.15.134:0/469133119 >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 msgr2=0x7f26040b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 --2- 172.21.15.134:0/469133119 >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 -- 172.21.15.134:0/469133119 >> v1:172.21.15.177:6789/0 conn(0x7f26040ce200 legacy=0x7f26040ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f2603fff640 1 -- 172.21.15.134:0/469133119 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26040b5fe0 con 0x7f260415c3d0 2024-09-15T22:48:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.235+0000 7f26037fe640 1 --2- 172.21.15.134:0/469133119 >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f2603fff640 1 --2- 172.21.15.134:0/469133119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097a0 tx=0x7f25f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6457e12979a101ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f2602ffd640 1 -- 172.21.15.134:0/469133119 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4037070 con 0x7f260415c3d0 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f2602ffd640 1 -- 172.21.15.134:0/469133119 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4032440 con 0x7f260415c3d0 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f2602ffd640 1 -- 172.21.15.134:0/469133119 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40327f0 con 0x7f260415c3d0 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f260a423640 1 -- 172.21.15.134:0/469133119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 msgr2=0x7f26040b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.236+0000 7f260a423640 1 --2- 172.21.15.134:0/469133119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097a0 tx=0x7f25f402a180 comp rx=0 tx=0).stop 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 -- 172.21.15.134:0/469133119 shutdown_connections 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 --2- 172.21.15.134:0/469133119 >> v2:172.21.15.177:3300/0 conn(0x7f26040b3550 0x7f26040b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 --2- 172.21.15.134:0/469133119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040b67e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 -- 172.21.15.134:0/469133119 >> 172.21.15.134:0/469133119 conn(0x7f260406ce90 msgr2=0x7f260406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 -- 172.21.15.134:0/469133119 shutdown_connections 2024-09-15T22:48:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.237+0000 7f260a423640 1 -- 172.21.15.134:0/469133119 wait complete. 2024-09-15T22:48:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.238+0000 7f260a423640 1 Processor -- start 2024-09-15T22:48:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.238+0000 7f260a423640 1 -- start start 2024-09-15T22:48:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26040ce200 0x7f26041540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26040cef70 con 0x7f26040b3550 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26040b6d20 con 0x7f26040ce200 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f26040cf0f0 con 0x7f260415c3d0 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51068/0 (socket says 172.21.15.134:51068) 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 -- 172.21.15.134:0/4248372581 learned_addr learned my addr 172.21.15.134:0/4248372581 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f26089c0640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f26037fe640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26040ce200 0x7f26041540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 -- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 msgr2=0x7f26040af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 -- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26040ce200 msgr2=0x7f26041540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26040ce200 0x7f26041540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 -- 172.21.15.134:0/4248372581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26040af830 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2603fff640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4041020 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f403d620 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26040afad0 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4037040 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.239+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26040b0090 con 0x7f26040b3550 2024-09-15T22:48:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.240+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260415fc10 con 0x7f26040b3550 2024-09-15T22:48:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.241+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f25f4044020 con 0x7f26040b3550 2024-09-15T22:48:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.241+0000 7f2600ff9640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 0x7f25f006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.241+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f25f40aa490 con 0x7f26040b3550 2024-09-15T22:48:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.242+0000 7f26037fe640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 0x7f25f006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.242+0000 7f26037fe640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 0x7f25f006ef80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f26041f7300 tx=0x7f25f8009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.246+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f260415fc10 con 0x7f26040b3550 2024-09-15T22:48:23.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.407+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26040b16a0 con 0x7f25f006cac0 2024-09-15T22:48:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.413+0000 7f2600ff9640 1 -- 172.21.15.134:0/4248372581 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f26040b16a0 con 0x7f25f006cac0 2024-09-15T22:48:23.417 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 msgr2=0x7f25f006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 0x7f25f006ef80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f26041f7300 tx=0x7f25f8009240 comp rx=0 tx=0).stop 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 msgr2=0x7f2604157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f40046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 shutdown_connections 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f260415c3d0 0x7f26040af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26040ce200 0x7f26041540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f25f006cac0 0x7f25f006ef80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 --2- 172.21.15.134:0/4248372581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26040b3550 0x7f2604157680 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 >> 172.21.15.134:0/4248372581 conn(0x7f260406ce90 msgr2=0x7f26040ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 shutdown_connections 2024-09-15T22:48:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:23.417+0000 7f260a423640 1 -- 172.21.15.134:0/4248372581 wait complete. 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-15T22:48:23.224459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266224,"kb_used_data":16712,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708496,"statfs":{"total":773094113280,"available":772821499904,"internally_reserved":0,"allocated":17113088,"data_stored":8177580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001375"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195670+0000","last_change":"2024-09-15T22:48:19.142050+0000","last_active":"2024-09-15T22:48:21.195670+0000","last_peered":"2024-09-15T22:48:21.195670+0000","last_clean":"2024-09-15T22:48:21.195670+0000","last_became_active":"2024-09-15T22:48:19.141712+0000","last_became_peered":"2024-09-15T22:48:19.141712+0000","last_unstale":"2024-09-15T22:48:21.195670+0000","last_undegraded":"2024-09-15T22:48:21.195670+0000","last_fullsized":"2024-09-15T22:48:21.195670+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:45.349803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091713+0000","last_change":"2024-09-15T22:48:19.152312+0000","last_active":"2024-09-15T22:48:21.091713+0000","last_peered":"2024-09-15T22:48:21.091713+0000","last_clean":"2024-09-15T22:48:21.091713+0000","last_became_active":"2024-09-15T22:48:19.152051+0000","last_became_peered":"2024-09-15T22:48:19.152051+0000","last_unstale":"2024-09-15T22:48:21.091713+0000","last_undegraded":"2024-09-15T22:48:21.091713+0000","last_fullsized":"2024-09-15T22:48:21.091713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:17.440601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140612+0000","last_change":"2024-09-15T22:48:19.150185+0000","last_active":"2024-09-15T22:48:21.140612+0000","last_peered":"2024-09-15T22:48:21.140612+0000","last_clean":"2024-09-15T22:48:21.140612+0000","last_became_active":"2024-09-15T22:48:19.149539+0000","last_became_peered":"2024-09-15T22:48:19.149539+0000","last_unstale":"2024-09-15T22:48:21.140612+0000","last_undegraded":"2024-09-15T22:48:21.140612+0000","last_fullsized":"2024-09-15T22:48:21.140612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:36.774431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091507+0000","last_change":"2024-09-15T22:48:19.154730+0000","last_active":"2024-09-15T22:48:21.091507+0000","last_peered":"2024-09-15T22:48:21.091507+0000","last_clean":"2024-09-15T22:48:21.091507+0000","last_became_active":"2024-09-15T22:48:19.154217+0000","last_became_peered":"2024-09-15T22:48:19.154217+0000","last_unstale":"2024-09-15T22:48:21.091507+0000","last_undegraded":"2024-09-15T22:48:21.091507+0000","last_fullsized":"2024-09-15T22:48:21.091507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:41.594152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196181+0000","last_change":"2024-09-15T22:48:19.163216+0000","last_active":"2024-09-15T22:48:21.196181+0000","last_peered":"2024-09-15T22:48:21.196181+0000","last_clean":"2024-09-15T22:48:21.196181+0000","last_became_active":"2024-09-15T22:48:19.162934+0000","last_became_peered":"2024-09-15T22:48:19.162934+0000","last_unstale":"2024-09-15T22:48:21.196181+0000","last_undegraded":"2024-09-15T22:48:21.196181+0000","last_fullsized":"2024-09-15T22:48:21.196181+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:13.104326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137058+0000","last_change":"2024-09-15T22:48:19.161992+0000","last_active":"2024-09-15T22:48:20.137058+0000","last_peered":"2024-09-15T22:48:20.137058+0000","last_clean":"2024-09-15T22:48:20.137058+0000","last_became_active":"2024-09-15T22:48:19.161716+0000","last_became_peered":"2024-09-15T22:48:19.161716+0000","last_unstale":"2024-09-15T22:48:20.137058+0000","last_undegraded":"2024-09-15T22:48:20.137058+0000","last_fullsized":"2024-09-15T22:48:20.137058+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:05.124783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137258+0000","last_change":"2024-09-15T22:48:19.154426+0000","last_active":"2024-09-15T22:48:20.137258+0000","last_peered":"2024-09-15T22:48:20.137258+0000","last_clean":"2024-09-15T22:48:20.137258+0000","last_became_active":"2024-09-15T22:48:19.154153+0000","last_became_peered":"2024-09-15T22:48:19.154153+0000","last_unstale":"2024-09-15T22:48:20.137258+0000","last_undegraded":"2024-09-15T22:48:20.137258+0000","last_fullsized":"2024-09-15T22:48:20.137258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:10.610300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195488+0000","last_change":"2024-09-15T22:48:19.157496+0000","last_active":"2024-09-15T22:48:21.195488+0000","last_peered":"2024-09-15T22:48:21.195488+0000","last_clean":"2024-09-15T22:48:21.195488+0000","last_became_active":"2024-09-15T22:48:19.157220+0000","last_became_peered":"2024-09-15T22:48:19.157220+0000","last_unstale":"2024-09-15T22:48:21.195488+0000","last_undegraded":"2024-09-15T22:48:21.195488+0000","last_fullsized":"2024-09-15T22:48:21.195488+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:15.497518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091635+0000","last_change":"2024-09-15T22:48:19.157074+0000","last_active":"2024-09-15T22:48:21.091635+0000","last_peered":"2024-09-15T22:48:21.091635+0000","last_clean":"2024-09-15T22:48:21.091635+0000","last_became_active":"2024-09-15T22:48:19.156785+0000","last_became_peered":"2024-09-15T22:48:19.156785+0000","last_unstale":"2024-09-15T22:48:21.091635+0000","last_undegraded":"2024-09-15T22:48:21.091635+0000","last_fullsized":"2024-09-15T22:48:21.091635+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:25.811061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136252+0000","last_change":"2024-09-15T22:48:19.141719+0000","last_active":"2024-09-15T22:48:20.136252+0000","last_peered":"2024-09-15T22:48:20.136252+0000","last_clean":"2024-09-15T22:48:20.136252+0000","last_became_active":"2024-09-15T22:48:19.141446+0000","last_became_peered":"2024-09-15T22:48:19.141446+0000","last_unstale":"2024-09-15T22:48:20.136252+0000","last_undegraded":"2024-09-15T22:48:20.136252+0000","last_fullsized":"2024-09-15T22:48:20.136252+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:00.586748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195541+0000","last_change":"2024-09-15T22:48:19.150580+0000","last_active":"2024-09-15T22:48:21.195541+0000","last_peered":"2024-09-15T22:48:21.195541+0000","last_clean":"2024-09-15T22:48:21.195541+0000","last_became_active":"2024-09-15T22:48:19.150314+0000","last_became_peered":"2024-09-15T22:48:19.150314+0000","last_unstale":"2024-09-15T22:48:21.195541+0000","last_undegraded":"2024-09-15T22:48:21.195541+0000","last_fullsized":"2024-09-15T22:48:21.195541+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:29.759685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041606+0000","last_change":"2024-09-15T22:48:19.143010+0000","last_active":"2024-09-15T22:48:21.041606+0000","last_peered":"2024-09-15T22:48:21.041606+0000","last_clean":"2024-09-15T22:48:21.041606+0000","last_became_active":"2024-09-15T22:48:19.142722+0000","last_became_peered":"2024-09-15T22:48:19.142722+0000","last_unstale":"2024-09-15T22:48:21.041606+0000","last_undegraded":"2024-09-15T22:48:21.041606+0000","last_fullsized":"2024-09-15T22:48:21.041606+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:41.080333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195440+0000","last_change":"2024-09-15T22:48:19.139352+0000","last_active":"2024-09-15T22:48:21.195440+0000","last_peered":"2024-09-15T22:48:21.195440+0000","last_clean":"2024-09-15T22:48:21.195440+0000","last_became_active":"2024-09-15T22:48:19.139086+0000","last_became_peered":"2024-09-15T22:48:19.139086+0000","last_unstale":"2024-09-15T22:48:21.195440+0000","last_undegraded":"2024-09-15T22:48:21.195440+0000","last_fullsized":"2024-09-15T22:48:21.195440+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:53.675502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091327+0000","last_change":"2024-09-15T22:48:19.156463+0000","last_active":"2024-09-15T22:48:21.091327+0000","last_peered":"2024-09-15T22:48:21.091327+0000","last_clean":"2024-09-15T22:48:21.091327+0000","last_became_active":"2024-09-15T22:48:19.155631+0000","last_became_peered":"2024-09-15T22:48:19.155631+0000","last_unstale":"2024-09-15T22:48:21.091327+0000","last_undegraded":"2024-09-15T22:48:21.091327+0000","last_fullsized":"2024-09-15T22:48:21.091327+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:15.782839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195416+0000","last_change":"2024-09-15T22:48:19.151274+0000","last_active":"2024-09-15T22:48:21.195416+0000","last_peered":"2024-09-15T22:48:21.195416+0000","last_clean":"2024-09-15T22:48:21.195416+0000","last_became_active":"2024-09-15T22:48:19.150985+0000","last_became_peered":"2024-09-15T22:48:19.150985+0000","last_unstale":"2024-09-15T22:48:21.195416+0000","last_undegraded":"2024-09-15T22:48:21.195416+0000","last_fullsized":"2024-09-15T22:48:21.195416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:30.690778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140295+0000","last_change":"2024-09-15T22:48:19.149780+0000","last_active":"2024-09-15T22:48:21.140295+0000","last_peered":"2024-09-15T22:48:21.140295+0000","last_clean":"2024-09-15T22:48:21.140295+0000","last_became_active":"2024-09-15T22:48:19.149471+0000","last_became_peered":"2024-09-15T22:48:19.149471+0000","last_unstale":"2024-09-15T22:48:21.140295+0000","last_undegraded":"2024-09-15T22:48:21.140295+0000","last_fullsized":"2024-09-15T22:48:21.140295+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:14.566426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136833+0000","last_change":"2024-09-15T22:48:19.157111+0000","last_active":"2024-09-15T22:48:20.136833+0000","last_peered":"2024-09-15T22:48:20.136833+0000","last_clean":"2024-09-15T22:48:20.136833+0000","last_became_active":"2024-09-15T22:48:19.156736+0000","last_became_peered":"2024-09-15T22:48:19.156736+0000","last_unstale":"2024-09-15T22:48:20.136833+0000","last_undegraded":"2024-09-15T22:48:20.136833+0000","last_fullsized":"2024-09-15T22:48:20.136833+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:51.851742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137373+0000","last_change":"2024-09-15T22:48:19.151859+0000","last_active":"2024-09-15T22:48:20.137373+0000","last_peered":"2024-09-15T22:48:20.137373+0000","last_clean":"2024-09-15T22:48:20.137373+0000","last_became_active":"2024-09-15T22:48:19.151602+0000","last_became_peered":"2024-09-15T22:48:19.151602+0000","last_unstale":"2024-09-15T22:48:20.137373+0000","last_undegraded":"2024-09-15T22:48:20.137373+0000","last_fullsized":"2024-09-15T22:48:20.137373+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.079198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140649+0000","last_change":"2024-09-15T22:48:19.158845+0000","last_active":"2024-09-15T22:48:21.140649+0000","last_peered":"2024-09-15T22:48:21.140649+0000","last_clean":"2024-09-15T22:48:21.140649+0000","last_became_active":"2024-09-15T22:48:19.158592+0000","last_became_peered":"2024-09-15T22:48:19.158592+0000","last_unstale":"2024-09-15T22:48:21.140649+0000","last_undegraded":"2024-09-15T22:48:21.140649+0000","last_fullsized":"2024-09-15T22:48:21.140649+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:09.864139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195965+0000","last_change":"2024-09-15T22:48:19.154295+0000","last_active":"2024-09-15T22:48:21.195965+0000","last_peered":"2024-09-15T22:48:21.195965+0000","last_clean":"2024-09-15T22:48:21.195965+0000","last_became_active":"2024-09-15T22:48:19.153926+0000","last_became_peered":"2024-09-15T22:48:19.153926+0000","last_unstale":"2024-09-15T22:48:21.195965+0000","last_undegraded":"2024-09-15T22:48:21.195965+0000","last_fullsized":"2024-09-15T22:48:21.195965+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:41.426612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140377+0000","last_change":"2024-09-15T22:48:19.144997+0000","last_active":"2024-09-15T22:48:21.140377+0000","last_peered":"2024-09-15T22:48:21.140377+0000","last_clean":"2024-09-15T22:48:21.140377+0000","last_became_active":"2024-09-15T22:48:19.144041+0000","last_became_peered":"2024-09-15T22:48:19.144041+0000","last_unstale":"2024-09-15T22:48:21.140377+0000","last_undegraded":"2024-09-15T22:48:21.140377+0000","last_fullsized":"2024-09-15T22:48:21.140377+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:36.868649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195944+0000","last_change":"2024-09-15T22:48:19.160630+0000","last_active":"2024-09-15T22:48:21.195944+0000","last_peered":"2024-09-15T22:48:21.195944+0000","last_clean":"2024-09-15T22:48:21.195944+0000","last_became_active":"2024-09-15T22:48:19.159980+0000","last_became_peered":"2024-09-15T22:48:19.159980+0000","last_unstale":"2024-09-15T22:48:21.195944+0000","last_undegraded":"2024-09-15T22:48:21.195944+0000","last_fullsized":"2024-09-15T22:48:21.195944+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:59.524351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136016+0000","last_change":"2024-09-15T22:48:19.152905+0000","last_active":"2024-09-15T22:48:20.136016+0000","last_peered":"2024-09-15T22:48:20.136016+0000","last_clean":"2024-09-15T22:48:20.136016+0000","last_became_active":"2024-09-15T22:48:19.152638+0000","last_became_peered":"2024-09-15T22:48:19.152638+0000","last_unstale":"2024-09-15T22:48:20.136016+0000","last_undegraded":"2024-09-15T22:48:20.136016+0000","last_fullsized":"2024-09-15T22:48:20.136016+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195567+0000","last_change":"2024-09-15T22:48:19.152290+0000","last_active":"2024-09-15T22:48:21.195567+0000","last_peered":"2024-09-15T22:48:21.195567+0000","last_clean":"2024-09-15T22:48:21.195567+0000","last_became_active":"2024-09-15T22:48:19.151979+0000","last_became_peered":"2024-09-15T22:48:19.151979+0000","last_unstale":"2024-09-15T22:48:21.195567+0000","last_undegraded":"2024-09-15T22:48:21.195567+0000","last_fullsized":"2024-09-15T22:48:21.195567+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:16.640300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091643+0000","last_change":"2024-09-15T22:48:19.151126+0000","last_active":"2024-09-15T22:48:21.091643+0000","last_peered":"2024-09-15T22:48:21.091643+0000","last_clean":"2024-09-15T22:48:21.091643+0000","last_became_active":"2024-09-15T22:48:19.150859+0000","last_became_peered":"2024-09-15T22:48:19.150859+0000","last_unstale":"2024-09-15T22:48:21.091643+0000","last_undegraded":"2024-09-15T22:48:21.091643+0000","last_fullsized":"2024-09-15T22:48:21.091643+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:05.199213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041533+0000","last_change":"2024-09-15T22:48:19.148420+0000","last_active":"2024-09-15T22:48:21.041533+0000","last_peered":"2024-09-15T22:48:21.041533+0000","last_clean":"2024-09-15T22:48:21.041533+0000","last_became_active":"2024-09-15T22:48:19.148161+0000","last_became_peered":"2024-09-15T22:48:19.148161+0000","last_unstale":"2024-09-15T22:48:21.041533+0000","last_undegraded":"2024-09-15T22:48:21.041533+0000","last_fullsized":"2024-09-15T22:48:21.041533+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:48.532544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140808+0000","last_change":"2024-09-15T22:48:19.145211+0000","last_active":"2024-09-15T22:48:21.140808+0000","last_peered":"2024-09-15T22:48:21.140808+0000","last_clean":"2024-09-15T22:48:21.140808+0000","last_became_active":"2024-09-15T22:48:19.144827+0000","last_became_peered":"2024-09-15T22:48:19.144827+0000","last_unstale":"2024-09-15T22:48:21.140808+0000","last_undegraded":"2024-09-15T22:48:21.140808+0000","last_fullsized":"2024-09-15T22:48:21.140808+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:31.369608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136586+0000","last_change":"2024-09-15T22:48:19.153312+0000","last_active":"2024-09-15T22:48:20.136586+0000","last_peered":"2024-09-15T22:48:20.136586+0000","last_clean":"2024-09-15T22:48:20.136586+0000","last_became_active":"2024-09-15T22:48:19.152499+0000","last_became_peered":"2024-09-15T22:48:19.152499+0000","last_unstale":"2024-09-15T22:48:20.136586+0000","last_undegraded":"2024-09-15T22:48:20.136586+0000","last_fullsized":"2024-09-15T22:48:20.136586+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:47.148511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041468+0000","last_change":"2024-09-15T22:48:19.148700+0000","last_active":"2024-09-15T22:48:21.041468+0000","last_peered":"2024-09-15T22:48:21.041468+0000","last_clean":"2024-09-15T22:48:21.041468+0000","last_became_active":"2024-09-15T22:48:19.148396+0000","last_became_peered":"2024-09-15T22:48:19.148396+0000","last_unstale":"2024-09-15T22:48:21.041468+0000","last_undegraded":"2024-09-15T22:48:21.041468+0000","last_fullsized":"2024-09-15T22:48:21.041468+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:41.765005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041555+0000","last_change":"2024-09-15T22:48:19.142969+0000","last_active":"2024-09-15T22:48:21.041555+0000","last_peered":"2024-09-15T22:48:21.041555+0000","last_clean":"2024-09-15T22:48:21.041555+0000","last_became_active":"2024-09-15T22:48:19.142677+0000","last_became_peered":"2024-09-15T22:48:19.142677+0000","last_unstale":"2024-09-15T22:48:21.041555+0000","last_undegraded":"2024-09-15T22:48:21.041555+0000","last_fullsized":"2024-09-15T22:48:21.041555+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.135887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195536+0000","last_change":"2024-09-15T22:48:19.163196+0000","last_active":"2024-09-15T22:48:21.195536+0000","last_peered":"2024-09-15T22:48:21.195536+0000","last_clean":"2024-09-15T22:48:21.195536+0000","last_became_active":"2024-09-15T22:48:19.162904+0000","last_became_peered":"2024-09-15T22:48:19.162904+0000","last_unstale":"2024-09-15T22:48:21.195536+0000","last_undegraded":"2024-09-15T22:48:21.195536+0000","last_fullsized":"2024-09-15T22:48:21.195536+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:32.929695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195726+0000","last_change":"2024-09-15T22:48:19.158189+0000","last_active":"2024-09-15T22:48:21.195726+0000","last_peered":"2024-09-15T22:48:21.195726+0000","last_clean":"2024-09-15T22:48:21.195726+0000","last_became_active":"2024-09-15T22:48:19.157624+0000","last_became_peered":"2024-09-15T22:48:19.157624+0000","last_unstale":"2024-09-15T22:48:21.195726+0000","last_undegraded":"2024-09-15T22:48:21.195726+0000","last_fullsized":"2024-09-15T22:48:21.195726+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:51.120744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196055+0000","last_change":"2024-09-15T22:48:19.162464+0000","last_active":"2024-09-15T22:48:21.196055+0000","last_peered":"2024-09-15T22:48:21.196055+0000","last_clean":"2024-09-15T22:48:21.196055+0000","last_became_active":"2024-09-15T22:48:19.162146+0000","last_became_peered":"2024-09-15T22:48:19.162146+0000","last_unstale":"2024-09-15T22:48:21.196055+0000","last_undegraded":"2024-09-15T22:48:21.196055+0000","last_fullsized":"2024-09-15T22:48:21.196055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:17.472090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"157'4","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140675+0000","last_change":"2024-09-15T22:48:18.142526+0000","last_active":"2024-09-15T22:48:21.140675+0000","last_peered":"2024-09-15T22:48:21.140675+0000","last_clean":"2024-09-15T22:48:21.140675+0000","last_became_active":"2024-09-15T22:48:18.141924+0000","last_became_peered":"2024-09-15T22:48:18.141924+0000","last_unstale":"2024-09-15T22:48:21.140675+0000","last_undegraded":"2024-09-15T22:48:21.140675+0000","last_fullsized":"2024-09-15T22:48:21.140675+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:33.077001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136676+0000","last_change":"2024-09-15T22:48:19.147529+0000","last_active":"2024-09-15T22:48:20.136676+0000","last_peered":"2024-09-15T22:48:20.136676+0000","last_clean":"2024-09-15T22:48:20.136676+0000","last_became_active":"2024-09-15T22:48:19.147220+0000","last_became_peered":"2024-09-15T22:48:19.147220+0000","last_unstale":"2024-09-15T22:48:20.136676+0000","last_undegraded":"2024-09-15T22:48:20.136676+0000","last_fullsized":"2024-09-15T22:48:20.136676+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.130586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041468+0000","last_change":"2024-09-15T22:48:18.145925+0000","last_active":"2024-09-15T22:48:21.041468+0000","last_peered":"2024-09-15T22:48:21.041468+0000","last_clean":"2024-09-15T22:48:21.041468+0000","last_became_active":"2024-09-15T22:48:18.145655+0000","last_became_peered":"2024-09-15T22:48:18.145655+0000","last_unstale":"2024-09-15T22:48:21.041468+0000","last_undegraded":"2024-09-15T22:48:21.041468+0000","last_fullsized":"2024-09-15T22:48:21.041468+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:58.522154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091593+0000","last_change":"2024-09-15T22:48:19.150942+0000","last_active":"2024-09-15T22:48:21.091593+0000","last_peered":"2024-09-15T22:48:21.091593+0000","last_clean":"2024-09-15T22:48:21.091593+0000","last_became_active":"2024-09-15T22:48:19.150488+0000","last_became_peered":"2024-09-15T22:48:19.150488+0000","last_unstale":"2024-09-15T22:48:21.091593+0000","last_undegraded":"2024-09-15T22:48:21.091593+0000","last_fullsized":"2024-09-15T22:48:21.091593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:58.214743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196053+0000","last_change":"2024-09-15T22:48:18.149208+0000","last_active":"2024-09-15T22:48:21.196053+0000","last_peered":"2024-09-15T22:48:21.196053+0000","last_clean":"2024-09-15T22:48:21.196053+0000","last_became_active":"2024-09-15T22:48:18.148930+0000","last_became_peered":"2024-09-15T22:48:18.148930+0000","last_unstale":"2024-09-15T22:48:21.196053+0000","last_undegraded":"2024-09-15T22:48:21.196053+0000","last_fullsized":"2024-09-15T22:48:21.196053+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:00.920087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091624+0000","last_change":"2024-09-15T22:48:19.153512+0000","last_active":"2024-09-15T22:48:21.091624+0000","last_peered":"2024-09-15T22:48:21.091624+0000","last_clean":"2024-09-15T22:48:21.091624+0000","last_became_active":"2024-09-15T22:48:19.153241+0000","last_became_peered":"2024-09-15T22:48:19.153241+0000","last_unstale":"2024-09-15T22:48:21.091624+0000","last_undegraded":"2024-09-15T22:48:21.091624+0000","last_fullsized":"2024-09-15T22:48:21.091624+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:13.328007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041649+0000","last_change":"2024-09-15T22:48:18.146645+0000","last_active":"2024-09-15T22:48:21.041649+0000","last_peered":"2024-09-15T22:48:21.041649+0000","last_clean":"2024-09-15T22:48:21.041649+0000","last_became_active":"2024-09-15T22:48:18.146379+0000","last_became_peered":"2024-09-15T22:48:18.146379+0000","last_unstale":"2024-09-15T22:48:21.041649+0000","last_undegraded":"2024-09-15T22:48:21.041649+0000","last_fullsized":"2024-09-15T22:48:21.041649+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:40.424415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136884+0000","last_change":"2024-09-15T22:48:19.153393+0000","last_active":"2024-09-15T22:48:20.136884+0000","last_peered":"2024-09-15T22:48:20.136884+0000","last_clean":"2024-09-15T22:48:20.136884+0000","last_became_active":"2024-09-15T22:48:19.152966+0000","last_became_peered":"2024-09-15T22:48:19.152966+0000","last_unstale":"2024-09-15T22:48:20.136884+0000","last_undegraded":"2024-09-15T22:48:20.136884+0000","last_fullsized":"2024-09-15T22:48:20.136884+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.656958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196040+0000","last_change":"2024-09-15T22:48:18.149730+0000","last_active":"2024-09-15T22:48:21.196040+0000","last_peered":"2024-09-15T22:48:21.196040+0000","last_clean":"2024-09-15T22:48:21.196040+0000","last_became_active":"2024-09-15T22:48:18.149459+0000","last_became_peered":"2024-09-15T22:48:18.149459+0000","last_unstale":"2024-09-15T22:48:21.196040+0000","last_undegraded":"2024-09-15T22:48:21.196040+0000","last_fullsized":"2024-09-15T22:48:21.196040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:31.184810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195924+0000","last_change":"2024-09-15T22:48:19.162964+0000","last_active":"2024-09-15T22:48:21.195924+0000","last_peered":"2024-09-15T22:48:21.195924+0000","last_clean":"2024-09-15T22:48:21.195924+0000","last_became_active":"2024-09-15T22:48:19.162471+0000","last_became_peered":"2024-09-15T22:48:19.162471+0000","last_unstale":"2024-09-15T22:48:21.195924+0000","last_undegraded":"2024-09-15T22:48:21.195924+0000","last_fullsized":"2024-09-15T22:48:21.195924+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:47.588822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195890+0000","last_change":"2024-09-15T22:48:18.147571+0000","last_active":"2024-09-15T22:48:21.195890+0000","last_peered":"2024-09-15T22:48:21.195890+0000","last_clean":"2024-09-15T22:48:21.195890+0000","last_became_active":"2024-09-15T22:48:18.147241+0000","last_became_peered":"2024-09-15T22:48:18.147241+0000","last_unstale":"2024-09-15T22:48:21.195890+0000","last_undegraded":"2024-09-15T22:48:21.195890+0000","last_fullsized":"2024-09-15T22:48:21.195890+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:35.070796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195606+0000","last_change":"2024-09-15T22:48:19.150513+0000","last_active":"2024-09-15T22:48:21.195606+0000","last_peered":"2024-09-15T22:48:21.195606+0000","last_clean":"2024-09-15T22:48:21.195606+0000","last_became_active":"2024-09-15T22:48:19.150204+0000","last_became_peered":"2024-09-15T22:48:19.150204+0000","last_unstale":"2024-09-15T22:48:21.195606+0000","last_undegraded":"2024-09-15T22:48:21.195606+0000","last_fullsized":"2024-09-15T22:48:21.195606+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.614436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137007+0000","last_change":"2024-09-15T22:48:18.145979+0000","last_active":"2024-09-15T22:48:20.137007+0000","last_peered":"2024-09-15T22:48:20.137007+0000","last_clean":"2024-09-15T22:48:20.137007+0000","last_became_active":"2024-09-15T22:48:18.145721+0000","last_became_peered":"2024-09-15T22:48:18.145721+0000","last_unstale":"2024-09-15T22:48:20.137007+0000","last_undegraded":"2024-09-15T22:48:20.137007+0000","last_fullsized":"2024-09-15T22:48:20.137007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:16.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140703+0000","last_change":"2024-09-15T22:48:19.151804+0000","last_active":"2024-09-15T22:48:21.140703+0000","last_peered":"2024-09-15T22:48:21.140703+0000","last_clean":"2024-09-15T22:48:21.140703+0000","last_became_active":"2024-09-15T22:48:19.151543+0000","last_became_peered":"2024-09-15T22:48:19.151543+0000","last_unstale":"2024-09-15T22:48:21.140703+0000","last_undegraded":"2024-09-15T22:48:21.140703+0000","last_fullsized":"2024-09-15T22:48:21.140703+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:08.068271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195651+0000","last_change":"2024-09-15T22:48:18.144122+0000","last_active":"2024-09-15T22:48:21.195651+0000","last_peered":"2024-09-15T22:48:21.195651+0000","last_clean":"2024-09-15T22:48:21.195651+0000","last_became_active":"2024-09-15T22:48:18.143624+0000","last_became_peered":"2024-09-15T22:48:18.143624+0000","last_unstale":"2024-09-15T22:48:21.195651+0000","last_undegraded":"2024-09-15T22:48:21.195651+0000","last_fullsized":"2024-09-15T22:48:21.195651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:48.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136829+0000","last_change":"2024-09-15T22:48:19.144377+0000","last_active":"2024-09-15T22:48:20.136829+0000","last_peered":"2024-09-15T22:48:20.136829+0000","last_clean":"2024-09-15T22:48:20.136829+0000","last_became_active":"2024-09-15T22:48:19.144097+0000","last_became_peered":"2024-09-15T22:48:19.144097+0000","last_unstale":"2024-09-15T22:48:20.136829+0000","last_undegraded":"2024-09-15T22:48:20.136829+0000","last_fullsized":"2024-09-15T22:48:20.136829+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:55.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136312+0000","last_change":"2024-09-15T22:48:18.150066+0000","last_active":"2024-09-15T22:48:20.136312+0000","last_peered":"2024-09-15T22:48:20.136312+0000","last_clean":"2024-09-15T22:48:20.136312+0000","last_became_active":"2024-09-15T22:48:18.149578+0000","last_became_peered":"2024-09-15T22:48:18.149578+0000","last_unstale":"2024-09-15T22:48:20.136312+0000","last_undegraded":"2024-09-15T22:48:20.136312+0000","last_fullsized":"2024-09-15T22:48:20.136312+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:54.644493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041713+0000","last_change":"2024-09-15T22:48:19.143146+0000","last_active":"2024-09-15T22:48:21.041713+0000","last_peered":"2024-09-15T22:48:21.041713+0000","last_clean":"2024-09-15T22:48:21.041713+0000","last_became_active":"2024-09-15T22:48:19.142862+0000","last_became_peered":"2024-09-15T22:48:19.142862+0000","last_unstale":"2024-09-15T22:48:21.041713+0000","last_undegraded":"2024-09-15T22:48:21.041713+0000","last_fullsized":"2024-09-15T22:48:21.041713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:17.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"157'3","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196094+0000","last_change":"2024-09-15T22:48:18.150324+0000","last_active":"2024-09-15T22:48:21.196094+0000","last_peered":"2024-09-15T22:48:21.196094+0000","last_clean":"2024-09-15T22:48:21.196094+0000","last_became_active":"2024-09-15T22:48:18.149946+0000","last_became_peered":"2024-09-15T22:48:18.149946+0000","last_unstale":"2024-09-15T22:48:21.196094+0000","last_undegraded":"2024-09-15T22:48:21.196094+0000","last_fullsized":"2024-09-15T22:48:21.196094+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:02.823147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136617+0000","last_change":"2024-09-15T22:48:19.149036+0000","last_active":"2024-09-15T22:48:20.136617+0000","last_peered":"2024-09-15T22:48:20.136617+0000","last_clean":"2024-09-15T22:48:20.136617+0000","last_became_active":"2024-09-15T22:48:19.148720+0000","last_became_peered":"2024-09-15T22:48:19.148720+0000","last_unstale":"2024-09-15T22:48:20.136617+0000","last_undegraded":"2024-09-15T22:48:20.136617+0000","last_fullsized":"2024-09-15T22:48:20.136617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:01.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"157'6","reported_seq":20,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195988+0000","last_change":"2024-09-15T22:48:18.150351+0000","last_active":"2024-09-15T22:48:21.195988+0000","last_peered":"2024-09-15T22:48:21.195988+0000","last_clean":"2024-09-15T22:48:21.195988+0000","last_became_active":"2024-09-15T22:48:18.150067+0000","last_became_peered":"2024-09-15T22:48:18.150067+0000","last_unstale":"2024-09-15T22:48:21.195988+0000","last_undegraded":"2024-09-15T22:48:21.195988+0000","last_fullsized":"2024-09-15T22:48:21.195988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:57.914387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136879+0000","last_change":"2024-09-15T22:48:19.147094+0000","last_active":"2024-09-15T22:48:20.136879+0000","last_peered":"2024-09-15T22:48:20.136879+0000","last_clean":"2024-09-15T22:48:20.136879+0000","last_became_active":"2024-09-15T22:48:19.146812+0000","last_became_peered":"2024-09-15T22:48:19.146812+0000","last_unstale":"2024-09-15T22:48:20.136879+0000","last_undegraded":"2024-09-15T22:48:20.136879+0000","last_fullsized":"2024-09-15T22:48:20.136879+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:56.990279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041414+0000","last_change":"2024-09-15T22:48:18.140915+0000","last_active":"2024-09-15T22:48:21.041414+0000","last_peered":"2024-09-15T22:48:21.041414+0000","last_clean":"2024-09-15T22:48:21.041414+0000","last_became_active":"2024-09-15T22:48:18.140647+0000","last_became_peered":"2024-09-15T22:48:18.140647+0000","last_unstale":"2024-09-15T22:48:21.041414+0000","last_undegraded":"2024-09-15T22:48:21.041414+0000","last_fullsized":"2024-09-15T22:48:21.041414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:16.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137325+0000","last_change":"2024-09-15T22:48:19.152738+0000","last_active":"2024-09-15T22:48:20.137325+0000","last_peered":"2024-09-15T22:48:20.137325+0000","last_clean":"2024-09-15T22:48:20.137325+0000","last_became_active":"2024-09-15T22:48:19.152298+0000","last_became_peered":"2024-09-15T22:48:19.152298+0000","last_unstale":"2024-09-15T22:48:20.137325+0000","last_undegraded":"2024-09-15T22:48:20.137325+0000","last_fullsized":"2024-09-15T22:48:20.137325+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:21.369117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136039+0000","last_change":"2024-09-15T22:48:18.146144+0000","last_active":"2024-09-15T22:48:20.136039+0000","last_peered":"2024-09-15T22:48:20.136039+0000","last_clean":"2024-09-15T22:48:20.136039+0000","last_became_active":"2024-09-15T22:48:18.145860+0000","last_became_peered":"2024-09-15T22:48:18.145860+0000","last_unstale":"2024-09-15T22:48:20.136039+0000","last_undegraded":"2024-09-15T22:48:20.136039+0000","last_fullsized":"2024-09-15T22:48:20.136039+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:06.405965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041438+0000","last_change":"2024-09-15T22:48:19.151939+0000","last_active":"2024-09-15T22:48:21.041438+0000","last_peered":"2024-09-15T22:48:21.041438+0000","last_clean":"2024-09-15T22:48:21.041438+0000","last_became_active":"2024-09-15T22:48:19.151680+0000","last_became_peered":"2024-09-15T22:48:19.151680+0000","last_unstale":"2024-09-15T22:48:21.041438+0000","last_undegraded":"2024-09-15T22:48:21.041438+0000","last_fullsized":"2024-09-15T22:48:21.041438+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:08.249882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195837+0000","last_change":"2024-09-15T22:48:18.148661+0000","last_active":"2024-09-15T22:48:21.195837+0000","last_peered":"2024-09-15T22:48:21.195837+0000","last_clean":"2024-09-15T22:48:21.195837+0000","last_became_active":"2024-09-15T22:48:18.148227+0000","last_became_peered":"2024-09-15T22:48:18.148227+0000","last_unstale":"2024-09-15T22:48:21.195837+0000","last_undegraded":"2024-09-15T22:48:21.195837+0000","last_fullsized":"2024-09-15T22:48:21.195837+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:41.590797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195688+0000","last_change":"2024-09-15T22:48:19.157089+0000","last_active":"2024-09-15T22:48:21.195688+0000","last_peered":"2024-09-15T22:48:21.195688+0000","last_clean":"2024-09-15T22:48:21.195688+0000","last_became_active":"2024-09-15T22:48:19.156813+0000","last_became_peered":"2024-09-15T22:48:19.156813+0000","last_unstale":"2024-09-15T22:48:21.195688+0000","last_undegraded":"2024-09-15T22:48:21.195688+0000","last_fullsized":"2024-09-15T22:48:21.195688+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:40.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"157'8","reported_seq":22,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137056+0000","last_change":"2024-09-15T22:48:18.142974+0000","last_active":"2024-09-15T22:48:20.137056+0000","last_peered":"2024-09-15T22:48:20.137056+0000","last_clean":"2024-09-15T22:48:20.137056+0000","last_became_active":"2024-09-15T22:48:18.142660+0000","last_became_peered":"2024-09-15T22:48:18.142660+0000","last_unstale":"2024-09-15T22:48:20.137056+0000","last_undegraded":"2024-09-15T22:48:20.137056+0000","last_fullsized":"2024-09-15T22:48:20.137056+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.102129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136291+0000","last_change":"2024-09-15T22:48:19.143009+0000","last_active":"2024-09-15T22:48:20.136291+0000","last_peered":"2024-09-15T22:48:20.136291+0000","last_clean":"2024-09-15T22:48:20.136291+0000","last_became_active":"2024-09-15T22:48:19.142728+0000","last_became_peered":"2024-09-15T22:48:19.142728+0000","last_unstale":"2024-09-15T22:48:20.136291+0000","last_undegraded":"2024-09-15T22:48:20.136291+0000","last_fullsized":"2024-09-15T22:48:20.136291+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:13.316041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196130+0000","last_change":"2024-09-15T22:48:18.146062+0000","last_active":"2024-09-15T22:48:21.196130+0000","last_peered":"2024-09-15T22:48:21.196130+0000","last_clean":"2024-09-15T22:48:21.196130+0000","last_became_active":"2024-09-15T22:48:18.145791+0000","last_became_peered":"2024-09-15T22:48:18.145791+0000","last_unstale":"2024-09-15T22:48:21.196130+0000","last_undegraded":"2024-09-15T22:48:21.196130+0000","last_fullsized":"2024-09-15T22:48:21.196130+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:01:48.800771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041690+0000","last_change":"2024-09-15T22:48:19.149758+0000","last_active":"2024-09-15T22:48:21.041690+0000","last_peered":"2024-09-15T22:48:21.041690+0000","last_clean":"2024-09-15T22:48:21.041690+0000","last_became_active":"2024-09-15T22:48:19.149502+0000","last_became_peered":"2024-09-15T22:48:19.149502+0000","last_unstale":"2024-09-15T22:48:21.041690+0000","last_undegraded":"2024-09-15T22:48:21.041690+0000","last_fullsized":"2024-09-15T22:48:21.041690+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:49.691509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136809+0000","last_change":"2024-09-15T22:48:18.145248+0000","last_active":"2024-09-15T22:48:20.136809+0000","last_peered":"2024-09-15T22:48:20.136809+0000","last_clean":"2024-09-15T22:48:20.136809+0000","last_became_active":"2024-09-15T22:48:18.144860+0000","last_became_peered":"2024-09-15T22:48:18.144860+0000","last_unstale":"2024-09-15T22:48:20.136809+0000","last_undegraded":"2024-09-15T22:48:20.136809+0000","last_fullsized":"2024-09-15T22:48:20.136809+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:07.066073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091659+0000","last_change":"2024-09-15T22:48:19.162413+0000","last_active":"2024-09-15T22:48:21.091659+0000","last_peered":"2024-09-15T22:48:21.091659+0000","last_clean":"2024-09-15T22:48:21.091659+0000","last_became_active":"2024-09-15T22:48:19.162093+0000","last_became_peered":"2024-09-15T22:48:19.162093+0000","last_unstale":"2024-09-15T22:48:21.091659+0000","last_undegraded":"2024-09-15T22:48:21.091659+0000","last_fullsized":"2024-09-15T22:48:21.091659+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:51.011279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195390+0000","last_change":"2024-09-15T22:48:18.143992+0000","last_active":"2024-09-15T22:48:21.195390+0000","last_peered":"2024-09-15T22:48:21.195390+0000","last_clean":"2024-09-15T22:48:21.195390+0000","last_became_active":"2024-09-15T22:48:18.143694+0000","last_became_peered":"2024-09-15T22:48:18.143694+0000","last_unstale":"2024-09-15T22:48:21.195390+0000","last_undegraded":"2024-09-15T22:48:21.195390+0000","last_fullsized":"2024-09-15T22:48:21.195390+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:50.849545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041701+0000","last_change":"2024-09-15T22:48:19.147735+0000","last_active":"2024-09-15T22:48:21.041701+0000","last_peered":"2024-09-15T22:48:21.041701+0000","last_clean":"2024-09-15T22:48:21.041701+0000","last_became_active":"2024-09-15T22:48:19.146828+0000","last_became_peered":"2024-09-15T22:48:19.146828+0000","last_unstale":"2024-09-15T22:48:21.041701+0000","last_undegraded":"2024-09-15T22:48:21.041701+0000","last_fullsized":"2024-09-15T22:48:21.041701+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:46.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195514+0000","last_change":"2024-09-15T22:48:18.140266+0000","last_active":"2024-09-15T22:48:21.195514+0000","last_peered":"2024-09-15T22:48:21.195514+0000","last_clean":"2024-09-15T22:48:21.195514+0000","last_became_active":"2024-09-15T22:48:18.140001+0000","last_became_peered":"2024-09-15T22:48:18.140001+0000","last_unstale":"2024-09-15T22:48:21.195514+0000","last_undegraded":"2024-09-15T22:48:21.195514+0000","last_fullsized":"2024-09-15T22:48:21.195514+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:04.122586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137071+0000","last_change":"2024-09-15T22:48:19.160430+0000","last_active":"2024-09-15T22:48:20.137071+0000","last_peered":"2024-09-15T22:48:20.137071+0000","last_clean":"2024-09-15T22:48:20.137071+0000","last_became_active":"2024-09-15T22:48:19.160117+0000","last_became_peered":"2024-09-15T22:48:19.160117+0000","last_unstale":"2024-09-15T22:48:20.137071+0000","last_undegraded":"2024-09-15T22:48:20.137071+0000","last_fullsized":"2024-09-15T22:48:20.137071+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:49.116032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196152+0000","last_change":"2024-09-15T22:48:18.149113+0000","last_active":"2024-09-15T22:48:21.196152+0000","last_peered":"2024-09-15T22:48:21.196152+0000","last_clean":"2024-09-15T22:48:21.196152+0000","last_became_active":"2024-09-15T22:48:18.148821+0000","last_became_peered":"2024-09-15T22:48:18.148821+0000","last_unstale":"2024-09-15T22:48:21.196152+0000","last_undegraded":"2024-09-15T22:48:21.196152+0000","last_fullsized":"2024-09-15T22:48:21.196152+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:24.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137373+0000","last_change":"2024-09-15T22:48:19.149448+0000","last_active":"2024-09-15T22:48:20.137373+0000","last_peered":"2024-09-15T22:48:20.137373+0000","last_clean":"2024-09-15T22:48:20.137373+0000","last_became_active":"2024-09-15T22:48:19.149181+0000","last_became_peered":"2024-09-15T22:48:19.149181+0000","last_unstale":"2024-09-15T22:48:20.137373+0000","last_undegraded":"2024-09-15T22:48:20.137373+0000","last_fullsized":"2024-09-15T22:48:20.137373+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:13.047129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137092+0000","last_change":"2024-09-15T22:48:18.144390+0000","last_active":"2024-09-15T22:48:20.137092+0000","last_peered":"2024-09-15T22:48:20.137092+0000","last_clean":"2024-09-15T22:48:20.137092+0000","last_became_active":"2024-09-15T22:48:18.144088+0000","last_became_peered":"2024-09-15T22:48:18.144088+0000","last_unstale":"2024-09-15T22:48:20.137092+0000","last_undegraded":"2024-09-15T22:48:20.137092+0000","last_fullsized":"2024-09-15T22:48:20.137092+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:35.552702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195385+0000","last_change":"2024-09-15T22:48:19.141927+0000","last_active":"2024-09-15T22:48:21.195385+0000","last_peered":"2024-09-15T22:48:21.195385+0000","last_clean":"2024-09-15T22:48:21.195385+0000","last_became_active":"2024-09-15T22:48:19.141574+0000","last_became_peered":"2024-09-15T22:48:19.141574+0000","last_unstale":"2024-09-15T22:48:21.195385+0000","last_undegraded":"2024-09-15T22:48:21.195385+0000","last_fullsized":"2024-09-15T22:48:21.195385+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:57.173168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136033+0000","last_change":"2024-09-15T22:48:18.145126+0000","last_active":"2024-09-15T22:48:20.136033+0000","last_peered":"2024-09-15T22:48:20.136033+0000","last_clean":"2024-09-15T22:48:20.136033+0000","last_became_active":"2024-09-15T22:48:18.144641+0000","last_became_peered":"2024-09-15T22:48:18.144641+0000","last_unstale":"2024-09-15T22:48:20.136033+0000","last_undegraded":"2024-09-15T22:48:20.136033+0000","last_fullsized":"2024-09-15T22:48:20.136033+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:08.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136032+0000","last_change":"2024-09-15T22:48:19.141478+0000","last_active":"2024-09-15T22:48:20.136032+0000","last_peered":"2024-09-15T22:48:20.136032+0000","last_clean":"2024-09-15T22:48:20.136032+0000","last_became_active":"2024-09-15T22:48:19.141185+0000","last_became_peered":"2024-09-15T22:48:19.141185+0000","last_unstale":"2024-09-15T22:48:20.136032+0000","last_undegraded":"2024-09-15T22:48:20.136032+0000","last_fullsized":"2024-09-15T22:48:20.136032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:51.458716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195273+0000","last_change":"2024-09-15T22:48:18.143927+0000","last_active":"2024-09-15T22:48:21.195273+0000","last_peered":"2024-09-15T22:48:21.195273+0000","last_clean":"2024-09-15T22:48:21.195273+0000","last_became_active":"2024-09-15T22:48:18.143606+0000","last_became_peered":"2024-09-15T22:48:18.143606+0000","last_unstale":"2024-09-15T22:48:21.195273+0000","last_undegraded":"2024-09-15T22:48:21.195273+0000","last_fullsized":"2024-09-15T22:48:21.195273+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:34.654761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140748+0000","last_change":"2024-09-15T22:48:19.152496+0000","last_active":"2024-09-15T22:48:21.140748+0000","last_peered":"2024-09-15T22:48:21.140748+0000","last_clean":"2024-09-15T22:48:21.140748+0000","last_became_active":"2024-09-15T22:48:19.152219+0000","last_became_peered":"2024-09-15T22:48:19.152219+0000","last_unstale":"2024-09-15T22:48:21.140748+0000","last_undegraded":"2024-09-15T22:48:21.140748+0000","last_fullsized":"2024-09-15T22:48:21.140748+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:51.263216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195699+0000","last_change":"2024-09-15T22:48:18.141420+0000","last_active":"2024-09-15T22:48:21.195699+0000","last_peered":"2024-09-15T22:48:21.195699+0000","last_clean":"2024-09-15T22:48:21.195699+0000","last_became_active":"2024-09-15T22:48:18.140007+0000","last_became_peered":"2024-09-15T22:48:18.140007+0000","last_unstale":"2024-09-15T22:48:21.195699+0000","last_undegraded":"2024-09-15T22:48:21.195699+0000","last_fullsized":"2024-09-15T22:48:21.195699+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:27.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140752+0000","last_change":"2024-09-15T22:48:19.146784+0000","last_active":"2024-09-15T22:48:21.140752+0000","last_peered":"2024-09-15T22:48:21.140752+0000","last_clean":"2024-09-15T22:48:21.140752+0000","last_became_active":"2024-09-15T22:48:19.146530+0000","last_became_peered":"2024-09-15T22:48:19.146530+0000","last_unstale":"2024-09-15T22:48:21.140752+0000","last_undegraded":"2024-09-15T22:48:21.140752+0000","last_fullsized":"2024-09-15T22:48:21.140752+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:06.237979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"158'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140822+0000","last_change":"2024-09-15T22:48:18.147474+0000","last_active":"2024-09-15T22:48:21.140822+0000","last_peered":"2024-09-15T22:48:21.140822+0000","last_clean":"2024-09-15T22:48:21.140822+0000","last_became_active":"2024-09-15T22:48:18.147161+0000","last_became_peered":"2024-09-15T22:48:18.147161+0000","last_unstale":"2024-09-15T22:48:21.140822+0000","last_undegraded":"2024-09-15T22:48:21.140822+0000","last_fullsized":"2024-09-15T22:48:21.140822+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:00.456408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140457+0000","last_change":"2024-09-15T22:48:19.158389+0000","last_active":"2024-09-15T22:48:21.140457+0000","last_peered":"2024-09-15T22:48:21.140457+0000","last_clean":"2024-09-15T22:48:21.140457+0000","last_became_active":"2024-09-15T22:48:19.157029+0000","last_became_peered":"2024-09-15T22:48:19.157029+0000","last_unstale":"2024-09-15T22:48:21.140457+0000","last_undegraded":"2024-09-15T22:48:21.140457+0000","last_fullsized":"2024-09-15T22:48:21.140457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:36.554899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140697+0000","last_change":"2024-09-15T22:48:18.147546+0000","last_active":"2024-09-15T22:48:21.140697+0000","last_peered":"2024-09-15T22:48:21.140697+0000","last_clean":"2024-09-15T22:48:21.140697+0000","last_became_active":"2024-09-15T22:48:18.147229+0000","last_became_peered":"2024-09-15T22:48:18.147229+0000","last_unstale":"2024-09-15T22:48:21.140697+0000","last_undegraded":"2024-09-15T22:48:21.140697+0000","last_fullsized":"2024-09-15T22:48:21.140697+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:07.247685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195995+0000","last_change":"2024-09-15T22:48:19.158679+0000","last_active":"2024-09-15T22:48:21.195995+0000","last_peered":"2024-09-15T22:48:21.195995+0000","last_clean":"2024-09-15T22:48:21.195995+0000","last_became_active":"2024-09-15T22:48:19.158357+0000","last_became_peered":"2024-09-15T22:48:19.158357+0000","last_unstale":"2024-09-15T22:48:21.195995+0000","last_undegraded":"2024-09-15T22:48:21.195995+0000","last_fullsized":"2024-09-15T22:48:21.195995+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:20.536480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196034+0000","last_change":"2024-09-15T22:48:18.150383+0000","last_active":"2024-09-15T22:48:21.196034+0000","last_peered":"2024-09-15T22:48:21.196034+0000","last_clean":"2024-09-15T22:48:21.196034+0000","last_became_active":"2024-09-15T22:48:18.150103+0000","last_became_peered":"2024-09-15T22:48:18.150103+0000","last_unstale":"2024-09-15T22:48:21.196034+0000","last_undegraded":"2024-09-15T22:48:21.196034+0000","last_fullsized":"2024-09-15T22:48:21.196034+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:14.780642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091310+0000","last_change":"2024-09-15T22:48:19.157758+0000","last_active":"2024-09-15T22:48:21.091310+0000","last_peered":"2024-09-15T22:48:21.091310+0000","last_clean":"2024-09-15T22:48:21.091310+0000","last_became_active":"2024-09-15T22:48:19.157500+0000","last_became_peered":"2024-09-15T22:48:19.157500+0000","last_unstale":"2024-09-15T22:48:21.091310+0000","last_undegraded":"2024-09-15T22:48:21.091310+0000","last_fullsized":"2024-09-15T22:48:21.091310+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:42.592994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091566+0000","last_change":"2024-09-15T22:48:18.147055+0000","last_active":"2024-09-15T22:48:21.091566+0000","last_peered":"2024-09-15T22:48:21.091566+0000","last_clean":"2024-09-15T22:48:21.091566+0000","last_became_active":"2024-09-15T22:48:18.146793+0000","last_became_peered":"2024-09-15T22:48:18.146793+0000","last_unstale":"2024-09-15T22:48:21.091566+0000","last_undegraded":"2024-09-15T22:48:21.091566+0000","last_fullsized":"2024-09-15T22:48:21.091566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:59.554798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195536+0000","last_change":"2024-09-15T22:48:19.149206+0000","last_active":"2024-09-15T22:48:21.195536+0000","last_peered":"2024-09-15T22:48:21.195536+0000","last_clean":"2024-09-15T22:48:21.195536+0000","last_became_active":"2024-09-15T22:48:19.148902+0000","last_became_peered":"2024-09-15T22:48:19.148902+0000","last_unstale":"2024-09-15T22:48:21.195536+0000","last_undegraded":"2024-09-15T22:48:21.195536+0000","last_fullsized":"2024-09-15T22:48:21.195536+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.435204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091375+0000","last_change":"2024-09-15T22:48:18.149987+0000","last_active":"2024-09-15T22:48:21.091375+0000","last_peered":"2024-09-15T22:48:21.091375+0000","last_clean":"2024-09-15T22:48:21.091375+0000","last_became_active":"2024-09-15T22:48:18.149749+0000","last_became_peered":"2024-09-15T22:48:18.149749+0000","last_unstale":"2024-09-15T22:48:21.091375+0000","last_undegraded":"2024-09-15T22:48:21.091375+0000","last_fullsized":"2024-09-15T22:48:21.091375+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:23.985499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091294+0000","last_change":"2024-09-15T22:48:19.151708+0000","last_active":"2024-09-15T22:48:21.091294+0000","last_peered":"2024-09-15T22:48:21.091294+0000","last_clean":"2024-09-15T22:48:21.091294+0000","last_became_active":"2024-09-15T22:48:19.151447+0000","last_became_peered":"2024-09-15T22:48:19.151447+0000","last_unstale":"2024-09-15T22:48:21.091294+0000","last_undegraded":"2024-09-15T22:48:21.091294+0000","last_fullsized":"2024-09-15T22:48:21.091294+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:25.563394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091256+0000","last_change":"2024-09-15T22:48:18.150047+0000","last_active":"2024-09-15T22:48:21.091256+0000","last_peered":"2024-09-15T22:48:21.091256+0000","last_clean":"2024-09-15T22:48:21.091256+0000","last_became_active":"2024-09-15T22:48:18.149739+0000","last_became_peered":"2024-09-15T22:48:18.149739+0000","last_unstale":"2024-09-15T22:48:21.091256+0000","last_undegraded":"2024-09-15T22:48:21.091256+0000","last_fullsized":"2024-09-15T22:48:21.091256+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195728+0000","last_change":"2024-09-15T22:48:19.163551+0000","last_active":"2024-09-15T22:48:21.195728+0000","last_peered":"2024-09-15T22:48:21.195728+0000","last_clean":"2024-09-15T22:48:21.195728+0000","last_became_active":"2024-09-15T22:48:19.163238+0000","last_became_peered":"2024-09-15T22:48:19.163238+0000","last_unstale":"2024-09-15T22:48:21.195728+0000","last_undegraded":"2024-09-15T22:48:21.195728+0000","last_fullsized":"2024-09-15T22:48:21.195728+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:49.638605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136284+0000","last_change":"2024-09-15T22:48:18.145688+0000","last_active":"2024-09-15T22:48:20.136284+0000","last_peered":"2024-09-15T22:48:20.136284+0000","last_clean":"2024-09-15T22:48:20.136284+0000","last_became_active":"2024-09-15T22:48:18.145412+0000","last_became_peered":"2024-09-15T22:48:18.145412+0000","last_unstale":"2024-09-15T22:48:20.136284+0000","last_undegraded":"2024-09-15T22:48:20.136284+0000","last_fullsized":"2024-09-15T22:48:20.136284+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:35.772234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136230+0000","last_change":"2024-09-15T22:48:19.162482+0000","last_active":"2024-09-15T22:48:20.136230+0000","last_peered":"2024-09-15T22:48:20.136230+0000","last_clean":"2024-09-15T22:48:20.136230+0000","last_became_active":"2024-09-15T22:48:19.162200+0000","last_became_peered":"2024-09-15T22:48:19.162200+0000","last_unstale":"2024-09-15T22:48:20.136230+0000","last_undegraded":"2024-09-15T22:48:20.136230+0000","last_fullsized":"2024-09-15T22:48:20.136230+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:26.348681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041352+0000","last_change":"2024-09-15T22:48:18.148670+0000","last_active":"2024-09-15T22:48:21.041352+0000","last_peered":"2024-09-15T22:48:21.041352+0000","last_clean":"2024-09-15T22:48:21.041352+0000","last_became_active":"2024-09-15T22:48:18.148367+0000","last_became_peered":"2024-09-15T22:48:18.148367+0000","last_unstale":"2024-09-15T22:48:21.041352+0000","last_undegraded":"2024-09-15T22:48:21.041352+0000","last_fullsized":"2024-09-15T22:48:21.041352+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:19.534283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":460,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091199+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:21.091199+0000","last_peered":"2024-09-15T22:48:21.091199+0000","last_clean":"2024-09-15T22:48:21.091199+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:21.091199+0000","last_undegraded":"2024-09-15T22:48:21.091199+0000","last_fullsized":"2024-09-15T22:48:21.091199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":875727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1986560,"data_stored":874093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509529,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":2584576,"data_stored":1464975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509529,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1986560,"data_stored":874037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509529,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":1998848,"data_stored":875685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509530,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1986560,"data_stored":874073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509529,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":2576384,"data_stored":1464371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1990656,"data_stored":874619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:25.128 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-09-15T22:48:25.127+0000 7f73ab52b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:48:26.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:26.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.544+0000 7f0097eba640 1 Processor -- start 2024-09-15T22:48:26.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.544+0000 7f0097eba640 1 -- start start 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f00900d02a0 0x7f00900d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f009015ca40 0x7f009015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f009015ce80 0x7f00901594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f00900d0bc0 con 0x7f009015ce80 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f009015d390 con 0x7f00900d02a0 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0097eba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f009015d670 con 0x7f009015ca40 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f009015ce80 0x7f00901594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f009015ce80 0x7f00901594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52932/0 (socket says 172.21.15.134:52932) 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 -- 172.21.15.134:0/132577250 learned_addr learned my addr 172.21.15.134:0/132577250 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0095455640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f009015ca40 0x7f009015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0095c56640 1 --2- 172.21.15.134:0/132577250 >> v2:172.21.15.177:3300/0 conn(0x7f00900d02a0 0x7f00900d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 -- 172.21.15.134:0/132577250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f009015ca40 msgr2=0x7f009015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f009015ca40 0x7f009015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 -- 172.21.15.134:0/132577250 >> v2:172.21.15.177:3300/0 conn(0x7f00900d02a0 msgr2=0x7f00900d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 --2- 172.21.15.134:0/132577250 >> v2:172.21.15.177:3300/0 conn(0x7f00900d02a0 0x7f00900d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.545+0000 7f0096457640 1 -- 172.21.15.134:0/132577250 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009015d950 con 0x7f009015ce80 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.546+0000 7f0096457640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f00901594c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f009006f030 tx=0x7f008802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73532e8ce710d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.546+0000 7f0094c54640 1 -- 172.21.15.134:0/132577250 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088036070 con 0x7f009015ce80 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.546+0000 7f0094c54640 1 -- 172.21.15.134:0/132577250 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088031600 con 0x7f009015ce80 2024-09-15T22:48:26.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.546+0000 7f0094c54640 1 -- 172.21.15.134:0/132577250 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00880319d0 con 0x7f009015ce80 2024-09-15T22:48:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 -- 172.21.15.134:0/132577250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 msgr2=0x7f00901594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f00901594c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f009006f030 tx=0x7f008802a610 comp rx=0 tx=0).stop 2024-09-15T22:48:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 -- 172.21.15.134:0/132577250 shutdown_connections 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f00901594c0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 --2- 172.21.15.134:0/132577250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f009015ca40 0x7f009015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 --2- 172.21.15.134:0/132577250 >> v2:172.21.15.177:3300/0 conn(0x7f00900d02a0 0x7f00900d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 -- 172.21.15.134:0/132577250 >> 172.21.15.134:0/132577250 conn(0x7f0090062cc0 msgr2=0x7f009006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 -- 172.21.15.134:0/132577250 shutdown_connections 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.547+0000 7f0097eba640 1 -- 172.21.15.134:0/132577250 wait complete. 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.548+0000 7f0097eba640 1 Processor -- start 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.548+0000 7f0097eba640 1 -- start start 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00900d02a0 0x7f0090149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009015ca40 0x7f00900b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0090155b90 con 0x7f009015ce80 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f009015df10 con 0x7f009015ca40 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0097eba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0090155d10 con 0x7f00900d02a0 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52934/0 (socket says 172.21.15.134:52934) 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 -- 172.21.15.134:0/1936028612 learned_addr learned my addr 172.21.15.134:0/1936028612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0095c56640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00900d02a0 0x7f0090149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0095455640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009015ca40 0x7f00900b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 -- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00900d02a0 msgr2=0x7f0090149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00900d02a0 0x7f0090149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 -- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009015ca40 msgr2=0x7f00900b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009015ca40 0x7f00900b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.549+0000 7f0096457640 1 -- 172.21.15.134:0/1936028612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00901575b0 con 0x7f009015ce80 2024-09-15T22:48:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f0096457640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0088034040 tx=0x7f0088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088036050 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088042070 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0090157890 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088009510 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.550+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0090157e50 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.551+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00900b4790 con 0x7f009015ce80 2024-09-15T22:48:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.551+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f0088007bd0 con 0x7f009015ce80 2024-09-15T22:48:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.552+0000 7f00867fc640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 0x7f007406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.552+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f00880aab50 con 0x7f009015ce80 2024-09-15T22:48:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.552+0000 7f0095c56640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 0x7f007406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.552+0000 7f0095c56640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 0x7f007406ef50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f008c003610 tx=0x7f008c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.556+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f008807a560 con 0x7f009015ce80 2024-09-15T22:48:26.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.718+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00900b41e0 con 0x7f007406ca90 2024-09-15T22:48:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.724+0000 7f00867fc640 1 -- 172.21.15.134:0/1936028612 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f00900b41e0 con 0x7f007406ca90 2024-09-15T22:48:26.727 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 msgr2=0x7f007406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 0x7f007406ef50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f008c003610 tx=0x7f008c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 msgr2=0x7f0090149e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0088034040 tx=0x7f0088004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 shutdown_connections 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f007406ca90 0x7f007406ef50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f009015ce80 0x7f0090149e00 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009015ca40 0x7f00900b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 --2- 172.21.15.134:0/1936028612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00900d02a0 0x7f0090149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 >> 172.21.15.134:0/1936028612 conn(0x7f0090062cc0 msgr2=0x7f00900cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 shutdown_connections 2024-09-15T22:48:26.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.727+0000 7f0097eba640 1 -- 172.21.15.134:0/1936028612 wait complete. 2024-09-15T22:48:26.739 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-15T22:48:25.225119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266224,"kb_used_data":16712,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708496,"statfs":{"total":773094113280,"available":772821499904,"internally_reserved":0,"allocated":17113088,"data_stored":8177580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.093537"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195670+0000","last_change":"2024-09-15T22:48:19.142050+0000","last_active":"2024-09-15T22:48:21.195670+0000","last_peered":"2024-09-15T22:48:21.195670+0000","last_clean":"2024-09-15T22:48:21.195670+0000","last_became_active":"2024-09-15T22:48:19.141712+0000","last_became_peered":"2024-09-15T22:48:19.141712+0000","last_unstale":"2024-09-15T22:48:21.195670+0000","last_undegraded":"2024-09-15T22:48:21.195670+0000","last_fullsized":"2024-09-15T22:48:21.195670+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:45.349803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091713+0000","last_change":"2024-09-15T22:48:19.152312+0000","last_active":"2024-09-15T22:48:21.091713+0000","last_peered":"2024-09-15T22:48:21.091713+0000","last_clean":"2024-09-15T22:48:21.091713+0000","last_became_active":"2024-09-15T22:48:19.152051+0000","last_became_peered":"2024-09-15T22:48:19.152051+0000","last_unstale":"2024-09-15T22:48:21.091713+0000","last_undegraded":"2024-09-15T22:48:21.091713+0000","last_fullsized":"2024-09-15T22:48:21.091713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:17.440601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140612+0000","last_change":"2024-09-15T22:48:19.150185+0000","last_active":"2024-09-15T22:48:21.140612+0000","last_peered":"2024-09-15T22:48:21.140612+0000","last_clean":"2024-09-15T22:48:21.140612+0000","last_became_active":"2024-09-15T22:48:19.149539+0000","last_became_peered":"2024-09-15T22:48:19.149539+0000","last_unstale":"2024-09-15T22:48:21.140612+0000","last_undegraded":"2024-09-15T22:48:21.140612+0000","last_fullsized":"2024-09-15T22:48:21.140612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:36.774431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091507+0000","last_change":"2024-09-15T22:48:19.154730+0000","last_active":"2024-09-15T22:48:21.091507+0000","last_peered":"2024-09-15T22:48:21.091507+0000","last_clean":"2024-09-15T22:48:21.091507+0000","last_became_active":"2024-09-15T22:48:19.154217+0000","last_became_peered":"2024-09-15T22:48:19.154217+0000","last_unstale":"2024-09-15T22:48:21.091507+0000","last_undegraded":"2024-09-15T22:48:21.091507+0000","last_fullsized":"2024-09-15T22:48:21.091507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:41.594152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196181+0000","last_change":"2024-09-15T22:48:19.163216+0000","last_active":"2024-09-15T22:48:21.196181+0000","last_peered":"2024-09-15T22:48:21.196181+0000","last_clean":"2024-09-15T22:48:21.196181+0000","last_became_active":"2024-09-15T22:48:19.162934+0000","last_became_peered":"2024-09-15T22:48:19.162934+0000","last_unstale":"2024-09-15T22:48:21.196181+0000","last_undegraded":"2024-09-15T22:48:21.196181+0000","last_fullsized":"2024-09-15T22:48:21.196181+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:13.104326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137058+0000","last_change":"2024-09-15T22:48:19.161992+0000","last_active":"2024-09-15T22:48:20.137058+0000","last_peered":"2024-09-15T22:48:20.137058+0000","last_clean":"2024-09-15T22:48:20.137058+0000","last_became_active":"2024-09-15T22:48:19.161716+0000","last_became_peered":"2024-09-15T22:48:19.161716+0000","last_unstale":"2024-09-15T22:48:20.137058+0000","last_undegraded":"2024-09-15T22:48:20.137058+0000","last_fullsized":"2024-09-15T22:48:20.137058+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:05.124783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137258+0000","last_change":"2024-09-15T22:48:19.154426+0000","last_active":"2024-09-15T22:48:20.137258+0000","last_peered":"2024-09-15T22:48:20.137258+0000","last_clean":"2024-09-15T22:48:20.137258+0000","last_became_active":"2024-09-15T22:48:19.154153+0000","last_became_peered":"2024-09-15T22:48:19.154153+0000","last_unstale":"2024-09-15T22:48:20.137258+0000","last_undegraded":"2024-09-15T22:48:20.137258+0000","last_fullsized":"2024-09-15T22:48:20.137258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:10.610300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195488+0000","last_change":"2024-09-15T22:48:19.157496+0000","last_active":"2024-09-15T22:48:21.195488+0000","last_peered":"2024-09-15T22:48:21.195488+0000","last_clean":"2024-09-15T22:48:21.195488+0000","last_became_active":"2024-09-15T22:48:19.157220+0000","last_became_peered":"2024-09-15T22:48:19.157220+0000","last_unstale":"2024-09-15T22:48:21.195488+0000","last_undegraded":"2024-09-15T22:48:21.195488+0000","last_fullsized":"2024-09-15T22:48:21.195488+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:15.497518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091635+0000","last_change":"2024-09-15T22:48:19.157074+0000","last_active":"2024-09-15T22:48:21.091635+0000","last_peered":"2024-09-15T22:48:21.091635+0000","last_clean":"2024-09-15T22:48:21.091635+0000","last_became_active":"2024-09-15T22:48:19.156785+0000","last_became_peered":"2024-09-15T22:48:19.156785+0000","last_unstale":"2024-09-15T22:48:21.091635+0000","last_undegraded":"2024-09-15T22:48:21.091635+0000","last_fullsized":"2024-09-15T22:48:21.091635+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:25.811061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136252+0000","last_change":"2024-09-15T22:48:19.141719+0000","last_active":"2024-09-15T22:48:20.136252+0000","last_peered":"2024-09-15T22:48:20.136252+0000","last_clean":"2024-09-15T22:48:20.136252+0000","last_became_active":"2024-09-15T22:48:19.141446+0000","last_became_peered":"2024-09-15T22:48:19.141446+0000","last_unstale":"2024-09-15T22:48:20.136252+0000","last_undegraded":"2024-09-15T22:48:20.136252+0000","last_fullsized":"2024-09-15T22:48:20.136252+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:00.586748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195541+0000","last_change":"2024-09-15T22:48:19.150580+0000","last_active":"2024-09-15T22:48:21.195541+0000","last_peered":"2024-09-15T22:48:21.195541+0000","last_clean":"2024-09-15T22:48:21.195541+0000","last_became_active":"2024-09-15T22:48:19.150314+0000","last_became_peered":"2024-09-15T22:48:19.150314+0000","last_unstale":"2024-09-15T22:48:21.195541+0000","last_undegraded":"2024-09-15T22:48:21.195541+0000","last_fullsized":"2024-09-15T22:48:21.195541+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:29.759685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041606+0000","last_change":"2024-09-15T22:48:19.143010+0000","last_active":"2024-09-15T22:48:21.041606+0000","last_peered":"2024-09-15T22:48:21.041606+0000","last_clean":"2024-09-15T22:48:21.041606+0000","last_became_active":"2024-09-15T22:48:19.142722+0000","last_became_peered":"2024-09-15T22:48:19.142722+0000","last_unstale":"2024-09-15T22:48:21.041606+0000","last_undegraded":"2024-09-15T22:48:21.041606+0000","last_fullsized":"2024-09-15T22:48:21.041606+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:41.080333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195440+0000","last_change":"2024-09-15T22:48:19.139352+0000","last_active":"2024-09-15T22:48:21.195440+0000","last_peered":"2024-09-15T22:48:21.195440+0000","last_clean":"2024-09-15T22:48:21.195440+0000","last_became_active":"2024-09-15T22:48:19.139086+0000","last_became_peered":"2024-09-15T22:48:19.139086+0000","last_unstale":"2024-09-15T22:48:21.195440+0000","last_undegraded":"2024-09-15T22:48:21.195440+0000","last_fullsized":"2024-09-15T22:48:21.195440+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:53.675502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091327+0000","last_change":"2024-09-15T22:48:19.156463+0000","last_active":"2024-09-15T22:48:21.091327+0000","last_peered":"2024-09-15T22:48:21.091327+0000","last_clean":"2024-09-15T22:48:21.091327+0000","last_became_active":"2024-09-15T22:48:19.155631+0000","last_became_peered":"2024-09-15T22:48:19.155631+0000","last_unstale":"2024-09-15T22:48:21.091327+0000","last_undegraded":"2024-09-15T22:48:21.091327+0000","last_fullsized":"2024-09-15T22:48:21.091327+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:15.782839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195416+0000","last_change":"2024-09-15T22:48:19.151274+0000","last_active":"2024-09-15T22:48:21.195416+0000","last_peered":"2024-09-15T22:48:21.195416+0000","last_clean":"2024-09-15T22:48:21.195416+0000","last_became_active":"2024-09-15T22:48:19.150985+0000","last_became_peered":"2024-09-15T22:48:19.150985+0000","last_unstale":"2024-09-15T22:48:21.195416+0000","last_undegraded":"2024-09-15T22:48:21.195416+0000","last_fullsized":"2024-09-15T22:48:21.195416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:30.690778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140295+0000","last_change":"2024-09-15T22:48:19.149780+0000","last_active":"2024-09-15T22:48:21.140295+0000","last_peered":"2024-09-15T22:48:21.140295+0000","last_clean":"2024-09-15T22:48:21.140295+0000","last_became_active":"2024-09-15T22:48:19.149471+0000","last_became_peered":"2024-09-15T22:48:19.149471+0000","last_unstale":"2024-09-15T22:48:21.140295+0000","last_undegraded":"2024-09-15T22:48:21.140295+0000","last_fullsized":"2024-09-15T22:48:21.140295+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:14.566426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136833+0000","last_change":"2024-09-15T22:48:19.157111+0000","last_active":"2024-09-15T22:48:20.136833+0000","last_peered":"2024-09-15T22:48:20.136833+0000","last_clean":"2024-09-15T22:48:20.136833+0000","last_became_active":"2024-09-15T22:48:19.156736+0000","last_became_peered":"2024-09-15T22:48:19.156736+0000","last_unstale":"2024-09-15T22:48:20.136833+0000","last_undegraded":"2024-09-15T22:48:20.136833+0000","last_fullsized":"2024-09-15T22:48:20.136833+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:51.851742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137373+0000","last_change":"2024-09-15T22:48:19.151859+0000","last_active":"2024-09-15T22:48:20.137373+0000","last_peered":"2024-09-15T22:48:20.137373+0000","last_clean":"2024-09-15T22:48:20.137373+0000","last_became_active":"2024-09-15T22:48:19.151602+0000","last_became_peered":"2024-09-15T22:48:19.151602+0000","last_unstale":"2024-09-15T22:48:20.137373+0000","last_undegraded":"2024-09-15T22:48:20.137373+0000","last_fullsized":"2024-09-15T22:48:20.137373+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.079198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140649+0000","last_change":"2024-09-15T22:48:19.158845+0000","last_active":"2024-09-15T22:48:21.140649+0000","last_peered":"2024-09-15T22:48:21.140649+0000","last_clean":"2024-09-15T22:48:21.140649+0000","last_became_active":"2024-09-15T22:48:19.158592+0000","last_became_peered":"2024-09-15T22:48:19.158592+0000","last_unstale":"2024-09-15T22:48:21.140649+0000","last_undegraded":"2024-09-15T22:48:21.140649+0000","last_fullsized":"2024-09-15T22:48:21.140649+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:09.864139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195965+0000","last_change":"2024-09-15T22:48:19.154295+0000","last_active":"2024-09-15T22:48:21.195965+0000","last_peered":"2024-09-15T22:48:21.195965+0000","last_clean":"2024-09-15T22:48:21.195965+0000","last_became_active":"2024-09-15T22:48:19.153926+0000","last_became_peered":"2024-09-15T22:48:19.153926+0000","last_unstale":"2024-09-15T22:48:21.195965+0000","last_undegraded":"2024-09-15T22:48:21.195965+0000","last_fullsized":"2024-09-15T22:48:21.195965+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:41.426612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140377+0000","last_change":"2024-09-15T22:48:19.144997+0000","last_active":"2024-09-15T22:48:21.140377+0000","last_peered":"2024-09-15T22:48:21.140377+0000","last_clean":"2024-09-15T22:48:21.140377+0000","last_became_active":"2024-09-15T22:48:19.144041+0000","last_became_peered":"2024-09-15T22:48:19.144041+0000","last_unstale":"2024-09-15T22:48:21.140377+0000","last_undegraded":"2024-09-15T22:48:21.140377+0000","last_fullsized":"2024-09-15T22:48:21.140377+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:36.868649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195944+0000","last_change":"2024-09-15T22:48:19.160630+0000","last_active":"2024-09-15T22:48:21.195944+0000","last_peered":"2024-09-15T22:48:21.195944+0000","last_clean":"2024-09-15T22:48:21.195944+0000","last_became_active":"2024-09-15T22:48:19.159980+0000","last_became_peered":"2024-09-15T22:48:19.159980+0000","last_unstale":"2024-09-15T22:48:21.195944+0000","last_undegraded":"2024-09-15T22:48:21.195944+0000","last_fullsized":"2024-09-15T22:48:21.195944+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:59.524351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136016+0000","last_change":"2024-09-15T22:48:19.152905+0000","last_active":"2024-09-15T22:48:20.136016+0000","last_peered":"2024-09-15T22:48:20.136016+0000","last_clean":"2024-09-15T22:48:20.136016+0000","last_became_active":"2024-09-15T22:48:19.152638+0000","last_became_peered":"2024-09-15T22:48:19.152638+0000","last_unstale":"2024-09-15T22:48:20.136016+0000","last_undegraded":"2024-09-15T22:48:20.136016+0000","last_fullsized":"2024-09-15T22:48:20.136016+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195567+0000","last_change":"2024-09-15T22:48:19.152290+0000","last_active":"2024-09-15T22:48:21.195567+0000","last_peered":"2024-09-15T22:48:21.195567+0000","last_clean":"2024-09-15T22:48:21.195567+0000","last_became_active":"2024-09-15T22:48:19.151979+0000","last_became_peered":"2024-09-15T22:48:19.151979+0000","last_unstale":"2024-09-15T22:48:21.195567+0000","last_undegraded":"2024-09-15T22:48:21.195567+0000","last_fullsized":"2024-09-15T22:48:21.195567+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:16.640300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091643+0000","last_change":"2024-09-15T22:48:19.151126+0000","last_active":"2024-09-15T22:48:21.091643+0000","last_peered":"2024-09-15T22:48:21.091643+0000","last_clean":"2024-09-15T22:48:21.091643+0000","last_became_active":"2024-09-15T22:48:19.150859+0000","last_became_peered":"2024-09-15T22:48:19.150859+0000","last_unstale":"2024-09-15T22:48:21.091643+0000","last_undegraded":"2024-09-15T22:48:21.091643+0000","last_fullsized":"2024-09-15T22:48:21.091643+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:05.199213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041533+0000","last_change":"2024-09-15T22:48:19.148420+0000","last_active":"2024-09-15T22:48:21.041533+0000","last_peered":"2024-09-15T22:48:21.041533+0000","last_clean":"2024-09-15T22:48:21.041533+0000","last_became_active":"2024-09-15T22:48:19.148161+0000","last_became_peered":"2024-09-15T22:48:19.148161+0000","last_unstale":"2024-09-15T22:48:21.041533+0000","last_undegraded":"2024-09-15T22:48:21.041533+0000","last_fullsized":"2024-09-15T22:48:21.041533+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:48.532544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140808+0000","last_change":"2024-09-15T22:48:19.145211+0000","last_active":"2024-09-15T22:48:21.140808+0000","last_peered":"2024-09-15T22:48:21.140808+0000","last_clean":"2024-09-15T22:48:21.140808+0000","last_became_active":"2024-09-15T22:48:19.144827+0000","last_became_peered":"2024-09-15T22:48:19.144827+0000","last_unstale":"2024-09-15T22:48:21.140808+0000","last_undegraded":"2024-09-15T22:48:21.140808+0000","last_fullsized":"2024-09-15T22:48:21.140808+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:31.369608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136586+0000","last_change":"2024-09-15T22:48:19.153312+0000","last_active":"2024-09-15T22:48:20.136586+0000","last_peered":"2024-09-15T22:48:20.136586+0000","last_clean":"2024-09-15T22:48:20.136586+0000","last_became_active":"2024-09-15T22:48:19.152499+0000","last_became_peered":"2024-09-15T22:48:19.152499+0000","last_unstale":"2024-09-15T22:48:20.136586+0000","last_undegraded":"2024-09-15T22:48:20.136586+0000","last_fullsized":"2024-09-15T22:48:20.136586+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:47.148511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041468+0000","last_change":"2024-09-15T22:48:19.148700+0000","last_active":"2024-09-15T22:48:21.041468+0000","last_peered":"2024-09-15T22:48:21.041468+0000","last_clean":"2024-09-15T22:48:21.041468+0000","last_became_active":"2024-09-15T22:48:19.148396+0000","last_became_peered":"2024-09-15T22:48:19.148396+0000","last_unstale":"2024-09-15T22:48:21.041468+0000","last_undegraded":"2024-09-15T22:48:21.041468+0000","last_fullsized":"2024-09-15T22:48:21.041468+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:41.765005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041555+0000","last_change":"2024-09-15T22:48:19.142969+0000","last_active":"2024-09-15T22:48:21.041555+0000","last_peered":"2024-09-15T22:48:21.041555+0000","last_clean":"2024-09-15T22:48:21.041555+0000","last_became_active":"2024-09-15T22:48:19.142677+0000","last_became_peered":"2024-09-15T22:48:19.142677+0000","last_unstale":"2024-09-15T22:48:21.041555+0000","last_undegraded":"2024-09-15T22:48:21.041555+0000","last_fullsized":"2024-09-15T22:48:21.041555+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.135887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195536+0000","last_change":"2024-09-15T22:48:19.163196+0000","last_active":"2024-09-15T22:48:21.195536+0000","last_peered":"2024-09-15T22:48:21.195536+0000","last_clean":"2024-09-15T22:48:21.195536+0000","last_became_active":"2024-09-15T22:48:19.162904+0000","last_became_peered":"2024-09-15T22:48:19.162904+0000","last_unstale":"2024-09-15T22:48:21.195536+0000","last_undegraded":"2024-09-15T22:48:21.195536+0000","last_fullsized":"2024-09-15T22:48:21.195536+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:32.929695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195726+0000","last_change":"2024-09-15T22:48:19.158189+0000","last_active":"2024-09-15T22:48:21.195726+0000","last_peered":"2024-09-15T22:48:21.195726+0000","last_clean":"2024-09-15T22:48:21.195726+0000","last_became_active":"2024-09-15T22:48:19.157624+0000","last_became_peered":"2024-09-15T22:48:19.157624+0000","last_unstale":"2024-09-15T22:48:21.195726+0000","last_undegraded":"2024-09-15T22:48:21.195726+0000","last_fullsized":"2024-09-15T22:48:21.195726+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:51.120744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196055+0000","last_change":"2024-09-15T22:48:19.162464+0000","last_active":"2024-09-15T22:48:21.196055+0000","last_peered":"2024-09-15T22:48:21.196055+0000","last_clean":"2024-09-15T22:48:21.196055+0000","last_became_active":"2024-09-15T22:48:19.162146+0000","last_became_peered":"2024-09-15T22:48:19.162146+0000","last_unstale":"2024-09-15T22:48:21.196055+0000","last_undegraded":"2024-09-15T22:48:21.196055+0000","last_fullsized":"2024-09-15T22:48:21.196055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:17.472090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"157'4","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140675+0000","last_change":"2024-09-15T22:48:18.142526+0000","last_active":"2024-09-15T22:48:21.140675+0000","last_peered":"2024-09-15T22:48:21.140675+0000","last_clean":"2024-09-15T22:48:21.140675+0000","last_became_active":"2024-09-15T22:48:18.141924+0000","last_became_peered":"2024-09-15T22:48:18.141924+0000","last_unstale":"2024-09-15T22:48:21.140675+0000","last_undegraded":"2024-09-15T22:48:21.140675+0000","last_fullsized":"2024-09-15T22:48:21.140675+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:33.077001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136676+0000","last_change":"2024-09-15T22:48:19.147529+0000","last_active":"2024-09-15T22:48:20.136676+0000","last_peered":"2024-09-15T22:48:20.136676+0000","last_clean":"2024-09-15T22:48:20.136676+0000","last_became_active":"2024-09-15T22:48:19.147220+0000","last_became_peered":"2024-09-15T22:48:19.147220+0000","last_unstale":"2024-09-15T22:48:20.136676+0000","last_undegraded":"2024-09-15T22:48:20.136676+0000","last_fullsized":"2024-09-15T22:48:20.136676+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.130586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041468+0000","last_change":"2024-09-15T22:48:18.145925+0000","last_active":"2024-09-15T22:48:21.041468+0000","last_peered":"2024-09-15T22:48:21.041468+0000","last_clean":"2024-09-15T22:48:21.041468+0000","last_became_active":"2024-09-15T22:48:18.145655+0000","last_became_peered":"2024-09-15T22:48:18.145655+0000","last_unstale":"2024-09-15T22:48:21.041468+0000","last_undegraded":"2024-09-15T22:48:21.041468+0000","last_fullsized":"2024-09-15T22:48:21.041468+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:58.522154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091593+0000","last_change":"2024-09-15T22:48:19.150942+0000","last_active":"2024-09-15T22:48:21.091593+0000","last_peered":"2024-09-15T22:48:21.091593+0000","last_clean":"2024-09-15T22:48:21.091593+0000","last_became_active":"2024-09-15T22:48:19.150488+0000","last_became_peered":"2024-09-15T22:48:19.150488+0000","last_unstale":"2024-09-15T22:48:21.091593+0000","last_undegraded":"2024-09-15T22:48:21.091593+0000","last_fullsized":"2024-09-15T22:48:21.091593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:58.214743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196053+0000","last_change":"2024-09-15T22:48:18.149208+0000","last_active":"2024-09-15T22:48:21.196053+0000","last_peered":"2024-09-15T22:48:21.196053+0000","last_clean":"2024-09-15T22:48:21.196053+0000","last_became_active":"2024-09-15T22:48:18.148930+0000","last_became_peered":"2024-09-15T22:48:18.148930+0000","last_unstale":"2024-09-15T22:48:21.196053+0000","last_undegraded":"2024-09-15T22:48:21.196053+0000","last_fullsized":"2024-09-15T22:48:21.196053+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:00.920087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091624+0000","last_change":"2024-09-15T22:48:19.153512+0000","last_active":"2024-09-15T22:48:21.091624+0000","last_peered":"2024-09-15T22:48:21.091624+0000","last_clean":"2024-09-15T22:48:21.091624+0000","last_became_active":"2024-09-15T22:48:19.153241+0000","last_became_peered":"2024-09-15T22:48:19.153241+0000","last_unstale":"2024-09-15T22:48:21.091624+0000","last_undegraded":"2024-09-15T22:48:21.091624+0000","last_fullsized":"2024-09-15T22:48:21.091624+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:13.328007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041649+0000","last_change":"2024-09-15T22:48:18.146645+0000","last_active":"2024-09-15T22:48:21.041649+0000","last_peered":"2024-09-15T22:48:21.041649+0000","last_clean":"2024-09-15T22:48:21.041649+0000","last_became_active":"2024-09-15T22:48:18.146379+0000","last_became_peered":"2024-09-15T22:48:18.146379+0000","last_unstale":"2024-09-15T22:48:21.041649+0000","last_undegraded":"2024-09-15T22:48:21.041649+0000","last_fullsized":"2024-09-15T22:48:21.041649+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:40.424415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136884+0000","last_change":"2024-09-15T22:48:19.153393+0000","last_active":"2024-09-15T22:48:20.136884+0000","last_peered":"2024-09-15T22:48:20.136884+0000","last_clean":"2024-09-15T22:48:20.136884+0000","last_became_active":"2024-09-15T22:48:19.152966+0000","last_became_peered":"2024-09-15T22:48:19.152966+0000","last_unstale":"2024-09-15T22:48:20.136884+0000","last_undegraded":"2024-09-15T22:48:20.136884+0000","last_fullsized":"2024-09-15T22:48:20.136884+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.656958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196040+0000","last_change":"2024-09-15T22:48:18.149730+0000","last_active":"2024-09-15T22:48:21.196040+0000","last_peered":"2024-09-15T22:48:21.196040+0000","last_clean":"2024-09-15T22:48:21.196040+0000","last_became_active":"2024-09-15T22:48:18.149459+0000","last_became_peered":"2024-09-15T22:48:18.149459+0000","last_unstale":"2024-09-15T22:48:21.196040+0000","last_undegraded":"2024-09-15T22:48:21.196040+0000","last_fullsized":"2024-09-15T22:48:21.196040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:31.184810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195924+0000","last_change":"2024-09-15T22:48:19.162964+0000","last_active":"2024-09-15T22:48:21.195924+0000","last_peered":"2024-09-15T22:48:21.195924+0000","last_clean":"2024-09-15T22:48:21.195924+0000","last_became_active":"2024-09-15T22:48:19.162471+0000","last_became_peered":"2024-09-15T22:48:19.162471+0000","last_unstale":"2024-09-15T22:48:21.195924+0000","last_undegraded":"2024-09-15T22:48:21.195924+0000","last_fullsized":"2024-09-15T22:48:21.195924+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:47.588822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195890+0000","last_change":"2024-09-15T22:48:18.147571+0000","last_active":"2024-09-15T22:48:21.195890+0000","last_peered":"2024-09-15T22:48:21.195890+0000","last_clean":"2024-09-15T22:48:21.195890+0000","last_became_active":"2024-09-15T22:48:18.147241+0000","last_became_peered":"2024-09-15T22:48:18.147241+0000","last_unstale":"2024-09-15T22:48:21.195890+0000","last_undegraded":"2024-09-15T22:48:21.195890+0000","last_fullsized":"2024-09-15T22:48:21.195890+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:35.070796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195606+0000","last_change":"2024-09-15T22:48:19.150513+0000","last_active":"2024-09-15T22:48:21.195606+0000","last_peered":"2024-09-15T22:48:21.195606+0000","last_clean":"2024-09-15T22:48:21.195606+0000","last_became_active":"2024-09-15T22:48:19.150204+0000","last_became_peered":"2024-09-15T22:48:19.150204+0000","last_unstale":"2024-09-15T22:48:21.195606+0000","last_undegraded":"2024-09-15T22:48:21.195606+0000","last_fullsized":"2024-09-15T22:48:21.195606+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.614436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137007+0000","last_change":"2024-09-15T22:48:18.145979+0000","last_active":"2024-09-15T22:48:20.137007+0000","last_peered":"2024-09-15T22:48:20.137007+0000","last_clean":"2024-09-15T22:48:20.137007+0000","last_became_active":"2024-09-15T22:48:18.145721+0000","last_became_peered":"2024-09-15T22:48:18.145721+0000","last_unstale":"2024-09-15T22:48:20.137007+0000","last_undegraded":"2024-09-15T22:48:20.137007+0000","last_fullsized":"2024-09-15T22:48:20.137007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:16.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140703+0000","last_change":"2024-09-15T22:48:19.151804+0000","last_active":"2024-09-15T22:48:21.140703+0000","last_peered":"2024-09-15T22:48:21.140703+0000","last_clean":"2024-09-15T22:48:21.140703+0000","last_became_active":"2024-09-15T22:48:19.151543+0000","last_became_peered":"2024-09-15T22:48:19.151543+0000","last_unstale":"2024-09-15T22:48:21.140703+0000","last_undegraded":"2024-09-15T22:48:21.140703+0000","last_fullsized":"2024-09-15T22:48:21.140703+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:08.068271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195651+0000","last_change":"2024-09-15T22:48:18.144122+0000","last_active":"2024-09-15T22:48:21.195651+0000","last_peered":"2024-09-15T22:48:21.195651+0000","last_clean":"2024-09-15T22:48:21.195651+0000","last_became_active":"2024-09-15T22:48:18.143624+0000","last_became_peered":"2024-09-15T22:48:18.143624+0000","last_unstale":"2024-09-15T22:48:21.195651+0000","last_undegraded":"2024-09-15T22:48:21.195651+0000","last_fullsized":"2024-09-15T22:48:21.195651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:48.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136829+0000","last_change":"2024-09-15T22:48:19.144377+0000","last_active":"2024-09-15T22:48:20.136829+0000","last_peered":"2024-09-15T22:48:20.136829+0000","last_clean":"2024-09-15T22:48:20.136829+0000","last_became_active":"2024-09-15T22:48:19.144097+0000","last_became_peered":"2024-09-15T22:48:19.144097+0000","last_unstale":"2024-09-15T22:48:20.136829+0000","last_undegraded":"2024-09-15T22:48:20.136829+0000","last_fullsized":"2024-09-15T22:48:20.136829+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:55.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136312+0000","last_change":"2024-09-15T22:48:18.150066+0000","last_active":"2024-09-15T22:48:20.136312+0000","last_peered":"2024-09-15T22:48:20.136312+0000","last_clean":"2024-09-15T22:48:20.136312+0000","last_became_active":"2024-09-15T22:48:18.149578+0000","last_became_peered":"2024-09-15T22:48:18.149578+0000","last_unstale":"2024-09-15T22:48:20.136312+0000","last_undegraded":"2024-09-15T22:48:20.136312+0000","last_fullsized":"2024-09-15T22:48:20.136312+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:54.644493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041713+0000","last_change":"2024-09-15T22:48:19.143146+0000","last_active":"2024-09-15T22:48:21.041713+0000","last_peered":"2024-09-15T22:48:21.041713+0000","last_clean":"2024-09-15T22:48:21.041713+0000","last_became_active":"2024-09-15T22:48:19.142862+0000","last_became_peered":"2024-09-15T22:48:19.142862+0000","last_unstale":"2024-09-15T22:48:21.041713+0000","last_undegraded":"2024-09-15T22:48:21.041713+0000","last_fullsized":"2024-09-15T22:48:21.041713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:17.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"157'3","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196094+0000","last_change":"2024-09-15T22:48:18.150324+0000","last_active":"2024-09-15T22:48:21.196094+0000","last_peered":"2024-09-15T22:48:21.196094+0000","last_clean":"2024-09-15T22:48:21.196094+0000","last_became_active":"2024-09-15T22:48:18.149946+0000","last_became_peered":"2024-09-15T22:48:18.149946+0000","last_unstale":"2024-09-15T22:48:21.196094+0000","last_undegraded":"2024-09-15T22:48:21.196094+0000","last_fullsized":"2024-09-15T22:48:21.196094+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:02.823147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136617+0000","last_change":"2024-09-15T22:48:19.149036+0000","last_active":"2024-09-15T22:48:20.136617+0000","last_peered":"2024-09-15T22:48:20.136617+0000","last_clean":"2024-09-15T22:48:20.136617+0000","last_became_active":"2024-09-15T22:48:19.148720+0000","last_became_peered":"2024-09-15T22:48:19.148720+0000","last_unstale":"2024-09-15T22:48:20.136617+0000","last_undegraded":"2024-09-15T22:48:20.136617+0000","last_fullsized":"2024-09-15T22:48:20.136617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:01.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"157'6","reported_seq":20,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195988+0000","last_change":"2024-09-15T22:48:18.150351+0000","last_active":"2024-09-15T22:48:21.195988+0000","last_peered":"2024-09-15T22:48:21.195988+0000","last_clean":"2024-09-15T22:48:21.195988+0000","last_became_active":"2024-09-15T22:48:18.150067+0000","last_became_peered":"2024-09-15T22:48:18.150067+0000","last_unstale":"2024-09-15T22:48:21.195988+0000","last_undegraded":"2024-09-15T22:48:21.195988+0000","last_fullsized":"2024-09-15T22:48:21.195988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:57.914387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136879+0000","last_change":"2024-09-15T22:48:19.147094+0000","last_active":"2024-09-15T22:48:20.136879+0000","last_peered":"2024-09-15T22:48:20.136879+0000","last_clean":"2024-09-15T22:48:20.136879+0000","last_became_active":"2024-09-15T22:48:19.146812+0000","last_became_peered":"2024-09-15T22:48:19.146812+0000","last_unstale":"2024-09-15T22:48:20.136879+0000","last_undegraded":"2024-09-15T22:48:20.136879+0000","last_fullsized":"2024-09-15T22:48:20.136879+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:56.990279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041414+0000","last_change":"2024-09-15T22:48:18.140915+0000","last_active":"2024-09-15T22:48:21.041414+0000","last_peered":"2024-09-15T22:48:21.041414+0000","last_clean":"2024-09-15T22:48:21.041414+0000","last_became_active":"2024-09-15T22:48:18.140647+0000","last_became_peered":"2024-09-15T22:48:18.140647+0000","last_unstale":"2024-09-15T22:48:21.041414+0000","last_undegraded":"2024-09-15T22:48:21.041414+0000","last_fullsized":"2024-09-15T22:48:21.041414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:16.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137325+0000","last_change":"2024-09-15T22:48:19.152738+0000","last_active":"2024-09-15T22:48:20.137325+0000","last_peered":"2024-09-15T22:48:20.137325+0000","last_clean":"2024-09-15T22:48:20.137325+0000","last_became_active":"2024-09-15T22:48:19.152298+0000","last_became_peered":"2024-09-15T22:48:19.152298+0000","last_unstale":"2024-09-15T22:48:20.137325+0000","last_undegraded":"2024-09-15T22:48:20.137325+0000","last_fullsized":"2024-09-15T22:48:20.137325+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:21.369117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136039+0000","last_change":"2024-09-15T22:48:18.146144+0000","last_active":"2024-09-15T22:48:20.136039+0000","last_peered":"2024-09-15T22:48:20.136039+0000","last_clean":"2024-09-15T22:48:20.136039+0000","last_became_active":"2024-09-15T22:48:18.145860+0000","last_became_peered":"2024-09-15T22:48:18.145860+0000","last_unstale":"2024-09-15T22:48:20.136039+0000","last_undegraded":"2024-09-15T22:48:20.136039+0000","last_fullsized":"2024-09-15T22:48:20.136039+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:06.405965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041438+0000","last_change":"2024-09-15T22:48:19.151939+0000","last_active":"2024-09-15T22:48:21.041438+0000","last_peered":"2024-09-15T22:48:21.041438+0000","last_clean":"2024-09-15T22:48:21.041438+0000","last_became_active":"2024-09-15T22:48:19.151680+0000","last_became_peered":"2024-09-15T22:48:19.151680+0000","last_unstale":"2024-09-15T22:48:21.041438+0000","last_undegraded":"2024-09-15T22:48:21.041438+0000","last_fullsized":"2024-09-15T22:48:21.041438+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:08.249882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195837+0000","last_change":"2024-09-15T22:48:18.148661+0000","last_active":"2024-09-15T22:48:21.195837+0000","last_peered":"2024-09-15T22:48:21.195837+0000","last_clean":"2024-09-15T22:48:21.195837+0000","last_became_active":"2024-09-15T22:48:18.148227+0000","last_became_peered":"2024-09-15T22:48:18.148227+0000","last_unstale":"2024-09-15T22:48:21.195837+0000","last_undegraded":"2024-09-15T22:48:21.195837+0000","last_fullsized":"2024-09-15T22:48:21.195837+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:41.590797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195688+0000","last_change":"2024-09-15T22:48:19.157089+0000","last_active":"2024-09-15T22:48:21.195688+0000","last_peered":"2024-09-15T22:48:21.195688+0000","last_clean":"2024-09-15T22:48:21.195688+0000","last_became_active":"2024-09-15T22:48:19.156813+0000","last_became_peered":"2024-09-15T22:48:19.156813+0000","last_unstale":"2024-09-15T22:48:21.195688+0000","last_undegraded":"2024-09-15T22:48:21.195688+0000","last_fullsized":"2024-09-15T22:48:21.195688+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:40.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"157'8","reported_seq":22,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137056+0000","last_change":"2024-09-15T22:48:18.142974+0000","last_active":"2024-09-15T22:48:20.137056+0000","last_peered":"2024-09-15T22:48:20.137056+0000","last_clean":"2024-09-15T22:48:20.137056+0000","last_became_active":"2024-09-15T22:48:18.142660+0000","last_became_peered":"2024-09-15T22:48:18.142660+0000","last_unstale":"2024-09-15T22:48:20.137056+0000","last_undegraded":"2024-09-15T22:48:20.137056+0000","last_fullsized":"2024-09-15T22:48:20.137056+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.102129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136291+0000","last_change":"2024-09-15T22:48:19.143009+0000","last_active":"2024-09-15T22:48:20.136291+0000","last_peered":"2024-09-15T22:48:20.136291+0000","last_clean":"2024-09-15T22:48:20.136291+0000","last_became_active":"2024-09-15T22:48:19.142728+0000","last_became_peered":"2024-09-15T22:48:19.142728+0000","last_unstale":"2024-09-15T22:48:20.136291+0000","last_undegraded":"2024-09-15T22:48:20.136291+0000","last_fullsized":"2024-09-15T22:48:20.136291+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:13.316041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196130+0000","last_change":"2024-09-15T22:48:18.146062+0000","last_active":"2024-09-15T22:48:21.196130+0000","last_peered":"2024-09-15T22:48:21.196130+0000","last_clean":"2024-09-15T22:48:21.196130+0000","last_became_active":"2024-09-15T22:48:18.145791+0000","last_became_peered":"2024-09-15T22:48:18.145791+0000","last_unstale":"2024-09-15T22:48:21.196130+0000","last_undegraded":"2024-09-15T22:48:21.196130+0000","last_fullsized":"2024-09-15T22:48:21.196130+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:01:48.800771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041690+0000","last_change":"2024-09-15T22:48:19.149758+0000","last_active":"2024-09-15T22:48:21.041690+0000","last_peered":"2024-09-15T22:48:21.041690+0000","last_clean":"2024-09-15T22:48:21.041690+0000","last_became_active":"2024-09-15T22:48:19.149502+0000","last_became_peered":"2024-09-15T22:48:19.149502+0000","last_unstale":"2024-09-15T22:48:21.041690+0000","last_undegraded":"2024-09-15T22:48:21.041690+0000","last_fullsized":"2024-09-15T22:48:21.041690+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:49.691509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136809+0000","last_change":"2024-09-15T22:48:18.145248+0000","last_active":"2024-09-15T22:48:20.136809+0000","last_peered":"2024-09-15T22:48:20.136809+0000","last_clean":"2024-09-15T22:48:20.136809+0000","last_became_active":"2024-09-15T22:48:18.144860+0000","last_became_peered":"2024-09-15T22:48:18.144860+0000","last_unstale":"2024-09-15T22:48:20.136809+0000","last_undegraded":"2024-09-15T22:48:20.136809+0000","last_fullsized":"2024-09-15T22:48:20.136809+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:07.066073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091659+0000","last_change":"2024-09-15T22:48:19.162413+0000","last_active":"2024-09-15T22:48:21.091659+0000","last_peered":"2024-09-15T22:48:21.091659+0000","last_clean":"2024-09-15T22:48:21.091659+0000","last_became_active":"2024-09-15T22:48:19.162093+0000","last_became_peered":"2024-09-15T22:48:19.162093+0000","last_unstale":"2024-09-15T22:48:21.091659+0000","last_undegraded":"2024-09-15T22:48:21.091659+0000","last_fullsized":"2024-09-15T22:48:21.091659+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:51.011279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195390+0000","last_change":"2024-09-15T22:48:18.143992+0000","last_active":"2024-09-15T22:48:21.195390+0000","last_peered":"2024-09-15T22:48:21.195390+0000","last_clean":"2024-09-15T22:48:21.195390+0000","last_became_active":"2024-09-15T22:48:18.143694+0000","last_became_peered":"2024-09-15T22:48:18.143694+0000","last_unstale":"2024-09-15T22:48:21.195390+0000","last_undegraded":"2024-09-15T22:48:21.195390+0000","last_fullsized":"2024-09-15T22:48:21.195390+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:50.849545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041701+0000","last_change":"2024-09-15T22:48:19.147735+0000","last_active":"2024-09-15T22:48:21.041701+0000","last_peered":"2024-09-15T22:48:21.041701+0000","last_clean":"2024-09-15T22:48:21.041701+0000","last_became_active":"2024-09-15T22:48:19.146828+0000","last_became_peered":"2024-09-15T22:48:19.146828+0000","last_unstale":"2024-09-15T22:48:21.041701+0000","last_undegraded":"2024-09-15T22:48:21.041701+0000","last_fullsized":"2024-09-15T22:48:21.041701+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:46.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195514+0000","last_change":"2024-09-15T22:48:18.140266+0000","last_active":"2024-09-15T22:48:21.195514+0000","last_peered":"2024-09-15T22:48:21.195514+0000","last_clean":"2024-09-15T22:48:21.195514+0000","last_became_active":"2024-09-15T22:48:18.140001+0000","last_became_peered":"2024-09-15T22:48:18.140001+0000","last_unstale":"2024-09-15T22:48:21.195514+0000","last_undegraded":"2024-09-15T22:48:21.195514+0000","last_fullsized":"2024-09-15T22:48:21.195514+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:04.122586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137071+0000","last_change":"2024-09-15T22:48:19.160430+0000","last_active":"2024-09-15T22:48:20.137071+0000","last_peered":"2024-09-15T22:48:20.137071+0000","last_clean":"2024-09-15T22:48:20.137071+0000","last_became_active":"2024-09-15T22:48:19.160117+0000","last_became_peered":"2024-09-15T22:48:19.160117+0000","last_unstale":"2024-09-15T22:48:20.137071+0000","last_undegraded":"2024-09-15T22:48:20.137071+0000","last_fullsized":"2024-09-15T22:48:20.137071+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:49.116032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196152+0000","last_change":"2024-09-15T22:48:18.149113+0000","last_active":"2024-09-15T22:48:21.196152+0000","last_peered":"2024-09-15T22:48:21.196152+0000","last_clean":"2024-09-15T22:48:21.196152+0000","last_became_active":"2024-09-15T22:48:18.148821+0000","last_became_peered":"2024-09-15T22:48:18.148821+0000","last_unstale":"2024-09-15T22:48:21.196152+0000","last_undegraded":"2024-09-15T22:48:21.196152+0000","last_fullsized":"2024-09-15T22:48:21.196152+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:24.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137373+0000","last_change":"2024-09-15T22:48:19.149448+0000","last_active":"2024-09-15T22:48:20.137373+0000","last_peered":"2024-09-15T22:48:20.137373+0000","last_clean":"2024-09-15T22:48:20.137373+0000","last_became_active":"2024-09-15T22:48:19.149181+0000","last_became_peered":"2024-09-15T22:48:19.149181+0000","last_unstale":"2024-09-15T22:48:20.137373+0000","last_undegraded":"2024-09-15T22:48:20.137373+0000","last_fullsized":"2024-09-15T22:48:20.137373+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:13.047129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.137092+0000","last_change":"2024-09-15T22:48:18.144390+0000","last_active":"2024-09-15T22:48:20.137092+0000","last_peered":"2024-09-15T22:48:20.137092+0000","last_clean":"2024-09-15T22:48:20.137092+0000","last_became_active":"2024-09-15T22:48:18.144088+0000","last_became_peered":"2024-09-15T22:48:18.144088+0000","last_unstale":"2024-09-15T22:48:20.137092+0000","last_undegraded":"2024-09-15T22:48:20.137092+0000","last_fullsized":"2024-09-15T22:48:20.137092+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:35.552702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195385+0000","last_change":"2024-09-15T22:48:19.141927+0000","last_active":"2024-09-15T22:48:21.195385+0000","last_peered":"2024-09-15T22:48:21.195385+0000","last_clean":"2024-09-15T22:48:21.195385+0000","last_became_active":"2024-09-15T22:48:19.141574+0000","last_became_peered":"2024-09-15T22:48:19.141574+0000","last_unstale":"2024-09-15T22:48:21.195385+0000","last_undegraded":"2024-09-15T22:48:21.195385+0000","last_fullsized":"2024-09-15T22:48:21.195385+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:57.173168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136033+0000","last_change":"2024-09-15T22:48:18.145126+0000","last_active":"2024-09-15T22:48:20.136033+0000","last_peered":"2024-09-15T22:48:20.136033+0000","last_clean":"2024-09-15T22:48:20.136033+0000","last_became_active":"2024-09-15T22:48:18.144641+0000","last_became_peered":"2024-09-15T22:48:18.144641+0000","last_unstale":"2024-09-15T22:48:20.136033+0000","last_undegraded":"2024-09-15T22:48:20.136033+0000","last_fullsized":"2024-09-15T22:48:20.136033+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:08.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136032+0000","last_change":"2024-09-15T22:48:19.141478+0000","last_active":"2024-09-15T22:48:20.136032+0000","last_peered":"2024-09-15T22:48:20.136032+0000","last_clean":"2024-09-15T22:48:20.136032+0000","last_became_active":"2024-09-15T22:48:19.141185+0000","last_became_peered":"2024-09-15T22:48:19.141185+0000","last_unstale":"2024-09-15T22:48:20.136032+0000","last_undegraded":"2024-09-15T22:48:20.136032+0000","last_fullsized":"2024-09-15T22:48:20.136032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:51.458716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195273+0000","last_change":"2024-09-15T22:48:18.143927+0000","last_active":"2024-09-15T22:48:21.195273+0000","last_peered":"2024-09-15T22:48:21.195273+0000","last_clean":"2024-09-15T22:48:21.195273+0000","last_became_active":"2024-09-15T22:48:18.143606+0000","last_became_peered":"2024-09-15T22:48:18.143606+0000","last_unstale":"2024-09-15T22:48:21.195273+0000","last_undegraded":"2024-09-15T22:48:21.195273+0000","last_fullsized":"2024-09-15T22:48:21.195273+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:34.654761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140748+0000","last_change":"2024-09-15T22:48:19.152496+0000","last_active":"2024-09-15T22:48:21.140748+0000","last_peered":"2024-09-15T22:48:21.140748+0000","last_clean":"2024-09-15T22:48:21.140748+0000","last_became_active":"2024-09-15T22:48:19.152219+0000","last_became_peered":"2024-09-15T22:48:19.152219+0000","last_unstale":"2024-09-15T22:48:21.140748+0000","last_undegraded":"2024-09-15T22:48:21.140748+0000","last_fullsized":"2024-09-15T22:48:21.140748+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:51.263216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195699+0000","last_change":"2024-09-15T22:48:18.141420+0000","last_active":"2024-09-15T22:48:21.195699+0000","last_peered":"2024-09-15T22:48:21.195699+0000","last_clean":"2024-09-15T22:48:21.195699+0000","last_became_active":"2024-09-15T22:48:18.140007+0000","last_became_peered":"2024-09-15T22:48:18.140007+0000","last_unstale":"2024-09-15T22:48:21.195699+0000","last_undegraded":"2024-09-15T22:48:21.195699+0000","last_fullsized":"2024-09-15T22:48:21.195699+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:27.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140752+0000","last_change":"2024-09-15T22:48:19.146784+0000","last_active":"2024-09-15T22:48:21.140752+0000","last_peered":"2024-09-15T22:48:21.140752+0000","last_clean":"2024-09-15T22:48:21.140752+0000","last_became_active":"2024-09-15T22:48:19.146530+0000","last_became_peered":"2024-09-15T22:48:19.146530+0000","last_unstale":"2024-09-15T22:48:21.140752+0000","last_undegraded":"2024-09-15T22:48:21.140752+0000","last_fullsized":"2024-09-15T22:48:21.140752+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:06.237979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"158'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140822+0000","last_change":"2024-09-15T22:48:18.147474+0000","last_active":"2024-09-15T22:48:21.140822+0000","last_peered":"2024-09-15T22:48:21.140822+0000","last_clean":"2024-09-15T22:48:21.140822+0000","last_became_active":"2024-09-15T22:48:18.147161+0000","last_became_peered":"2024-09-15T22:48:18.147161+0000","last_unstale":"2024-09-15T22:48:21.140822+0000","last_undegraded":"2024-09-15T22:48:21.140822+0000","last_fullsized":"2024-09-15T22:48:21.140822+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:00.456408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140457+0000","last_change":"2024-09-15T22:48:19.158389+0000","last_active":"2024-09-15T22:48:21.140457+0000","last_peered":"2024-09-15T22:48:21.140457+0000","last_clean":"2024-09-15T22:48:21.140457+0000","last_became_active":"2024-09-15T22:48:19.157029+0000","last_became_peered":"2024-09-15T22:48:19.157029+0000","last_unstale":"2024-09-15T22:48:21.140457+0000","last_undegraded":"2024-09-15T22:48:21.140457+0000","last_fullsized":"2024-09-15T22:48:21.140457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:36.554899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.140697+0000","last_change":"2024-09-15T22:48:18.147546+0000","last_active":"2024-09-15T22:48:21.140697+0000","last_peered":"2024-09-15T22:48:21.140697+0000","last_clean":"2024-09-15T22:48:21.140697+0000","last_became_active":"2024-09-15T22:48:18.147229+0000","last_became_peered":"2024-09-15T22:48:18.147229+0000","last_unstale":"2024-09-15T22:48:21.140697+0000","last_undegraded":"2024-09-15T22:48:21.140697+0000","last_fullsized":"2024-09-15T22:48:21.140697+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:07.247685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195995+0000","last_change":"2024-09-15T22:48:19.158679+0000","last_active":"2024-09-15T22:48:21.195995+0000","last_peered":"2024-09-15T22:48:21.195995+0000","last_clean":"2024-09-15T22:48:21.195995+0000","last_became_active":"2024-09-15T22:48:19.158357+0000","last_became_peered":"2024-09-15T22:48:19.158357+0000","last_unstale":"2024-09-15T22:48:21.195995+0000","last_undegraded":"2024-09-15T22:48:21.195995+0000","last_fullsized":"2024-09-15T22:48:21.195995+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:20.536480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.196034+0000","last_change":"2024-09-15T22:48:18.150383+0000","last_active":"2024-09-15T22:48:21.196034+0000","last_peered":"2024-09-15T22:48:21.196034+0000","last_clean":"2024-09-15T22:48:21.196034+0000","last_became_active":"2024-09-15T22:48:18.150103+0000","last_became_peered":"2024-09-15T22:48:18.150103+0000","last_unstale":"2024-09-15T22:48:21.196034+0000","last_undegraded":"2024-09-15T22:48:21.196034+0000","last_fullsized":"2024-09-15T22:48:21.196034+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:14.780642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091310+0000","last_change":"2024-09-15T22:48:19.157758+0000","last_active":"2024-09-15T22:48:21.091310+0000","last_peered":"2024-09-15T22:48:21.091310+0000","last_clean":"2024-09-15T22:48:21.091310+0000","last_became_active":"2024-09-15T22:48:19.157500+0000","last_became_peered":"2024-09-15T22:48:19.157500+0000","last_unstale":"2024-09-15T22:48:21.091310+0000","last_undegraded":"2024-09-15T22:48:21.091310+0000","last_fullsized":"2024-09-15T22:48:21.091310+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:42.592994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091566+0000","last_change":"2024-09-15T22:48:18.147055+0000","last_active":"2024-09-15T22:48:21.091566+0000","last_peered":"2024-09-15T22:48:21.091566+0000","last_clean":"2024-09-15T22:48:21.091566+0000","last_became_active":"2024-09-15T22:48:18.146793+0000","last_became_peered":"2024-09-15T22:48:18.146793+0000","last_unstale":"2024-09-15T22:48:21.091566+0000","last_undegraded":"2024-09-15T22:48:21.091566+0000","last_fullsized":"2024-09-15T22:48:21.091566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:59.554798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195536+0000","last_change":"2024-09-15T22:48:19.149206+0000","last_active":"2024-09-15T22:48:21.195536+0000","last_peered":"2024-09-15T22:48:21.195536+0000","last_clean":"2024-09-15T22:48:21.195536+0000","last_became_active":"2024-09-15T22:48:19.148902+0000","last_became_peered":"2024-09-15T22:48:19.148902+0000","last_unstale":"2024-09-15T22:48:21.195536+0000","last_undegraded":"2024-09-15T22:48:21.195536+0000","last_fullsized":"2024-09-15T22:48:21.195536+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.435204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091375+0000","last_change":"2024-09-15T22:48:18.149987+0000","last_active":"2024-09-15T22:48:21.091375+0000","last_peered":"2024-09-15T22:48:21.091375+0000","last_clean":"2024-09-15T22:48:21.091375+0000","last_became_active":"2024-09-15T22:48:18.149749+0000","last_became_peered":"2024-09-15T22:48:18.149749+0000","last_unstale":"2024-09-15T22:48:21.091375+0000","last_undegraded":"2024-09-15T22:48:21.091375+0000","last_fullsized":"2024-09-15T22:48:21.091375+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:23.985499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091294+0000","last_change":"2024-09-15T22:48:19.151708+0000","last_active":"2024-09-15T22:48:21.091294+0000","last_peered":"2024-09-15T22:48:21.091294+0000","last_clean":"2024-09-15T22:48:21.091294+0000","last_became_active":"2024-09-15T22:48:19.151447+0000","last_became_peered":"2024-09-15T22:48:19.151447+0000","last_unstale":"2024-09-15T22:48:21.091294+0000","last_undegraded":"2024-09-15T22:48:21.091294+0000","last_fullsized":"2024-09-15T22:48:21.091294+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:25.563394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091256+0000","last_change":"2024-09-15T22:48:18.150047+0000","last_active":"2024-09-15T22:48:21.091256+0000","last_peered":"2024-09-15T22:48:21.091256+0000","last_clean":"2024-09-15T22:48:21.091256+0000","last_became_active":"2024-09-15T22:48:18.149739+0000","last_became_peered":"2024-09-15T22:48:18.149739+0000","last_unstale":"2024-09-15T22:48:21.091256+0000","last_undegraded":"2024-09-15T22:48:21.091256+0000","last_fullsized":"2024-09-15T22:48:21.091256+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.195728+0000","last_change":"2024-09-15T22:48:19.163551+0000","last_active":"2024-09-15T22:48:21.195728+0000","last_peered":"2024-09-15T22:48:21.195728+0000","last_clean":"2024-09-15T22:48:21.195728+0000","last_became_active":"2024-09-15T22:48:19.163238+0000","last_became_peered":"2024-09-15T22:48:19.163238+0000","last_unstale":"2024-09-15T22:48:21.195728+0000","last_undegraded":"2024-09-15T22:48:21.195728+0000","last_fullsized":"2024-09-15T22:48:21.195728+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:49.638605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136284+0000","last_change":"2024-09-15T22:48:18.145688+0000","last_active":"2024-09-15T22:48:20.136284+0000","last_peered":"2024-09-15T22:48:20.136284+0000","last_clean":"2024-09-15T22:48:20.136284+0000","last_became_active":"2024-09-15T22:48:18.145412+0000","last_became_peered":"2024-09-15T22:48:18.145412+0000","last_unstale":"2024-09-15T22:48:20.136284+0000","last_undegraded":"2024-09-15T22:48:20.136284+0000","last_fullsized":"2024-09-15T22:48:20.136284+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:35.772234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:20.136230+0000","last_change":"2024-09-15T22:48:19.162482+0000","last_active":"2024-09-15T22:48:20.136230+0000","last_peered":"2024-09-15T22:48:20.136230+0000","last_clean":"2024-09-15T22:48:20.136230+0000","last_became_active":"2024-09-15T22:48:19.162200+0000","last_became_peered":"2024-09-15T22:48:19.162200+0000","last_unstale":"2024-09-15T22:48:20.136230+0000","last_undegraded":"2024-09-15T22:48:20.136230+0000","last_fullsized":"2024-09-15T22:48:20.136230+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:18.125254+0000","last_clean_scrub_stamp":"2024-09-15T22:48:18.125254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:26.348681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.041352+0000","last_change":"2024-09-15T22:48:18.148670+0000","last_active":"2024-09-15T22:48:21.041352+0000","last_peered":"2024-09-15T22:48:21.041352+0000","last_clean":"2024-09-15T22:48:21.041352+0000","last_became_active":"2024-09-15T22:48:18.148367+0000","last_became_peered":"2024-09-15T22:48:18.148367+0000","last_unstale":"2024-09-15T22:48:21.041352+0000","last_undegraded":"2024-09-15T22:48:21.041352+0000","last_fullsized":"2024-09-15T22:48:21.041352+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:17.123057+0000","last_clean_scrub_stamp":"2024-09-15T22:48:17.123057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:19.534283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":460,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-15T22:48:21.091199+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:21.091199+0000","last_peered":"2024-09-15T22:48:21.091199+0000","last_clean":"2024-09-15T22:48:21.091199+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:21.091199+0000","last_undegraded":"2024-09-15T22:48:21.091199+0000","last_fullsized":"2024-09-15T22:48:21.091199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":875727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1986560,"data_stored":874093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509529,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":2584576,"data_stored":1464975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509529,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1986560,"data_stored":874037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509529,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":1998848,"data_stored":875685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509530,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1986560,"data_stored":874073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509529,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":2576384,"data_stored":1464371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1990656,"data_stored":874619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:26.743 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:48:26.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:48:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.893+0000 7fba036e6640 1 Processor -- start 2024-09-15T22:48:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.893+0000 7fba036e6640 1 -- start start 2024-09-15T22:48:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba036e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc06f130 0x7fb9fc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba036e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba036e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc15c970 con 0x7fb9fc15b370 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba036e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc15fef0 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba036e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc15bbb0 con 0x7fb9fc06f130 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52950/0 (socket says 172.21.15.134:52950) 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 -- 172.21.15.134:0/316354501 learned_addr learned my addr 172.21.15.134:0/316354501 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba00c81640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc06f130 0x7fb9fc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 -- 172.21.15.134:0/316354501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc06f130 msgr2=0x7fb9fc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc06f130 0x7fb9fc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 -- 172.21.15.134:0/316354501 >> v1:172.21.15.177:6789/0 conn(0x7fb9fc15b370 legacy=0x7fb9fc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.894+0000 7fba01c83640 1 -- 172.21.15.134:0/316354501 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc15be90 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.895+0000 7fba01c83640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc160070 tx=0x7fb9f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6803d56e081024 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.895+0000 7fb9f3fff640 1 -- 172.21.15.134:0/316354501 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4036070 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.895+0000 7fb9f3fff640 1 -- 172.21.15.134:0/316354501 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f4031600 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.895+0000 7fb9f3fff640 1 -- 172.21.15.134:0/316354501 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40319d0 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 -- 172.21.15.134:0/316354501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc15f9f0 msgr2=0x7fb9fc0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc160070 tx=0x7fb9f402a680 comp rx=0 tx=0).stop 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 -- 172.21.15.134:0/316354501 shutdown_connections 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc0ce490 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 --2- 172.21.15.134:0/316354501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc06f130 0x7fb9fc072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 -- 172.21.15.134:0/316354501 >> 172.21.15.134:0/316354501 conn(0x7fb9fc06bba0 msgr2=0x7fb9fc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 -- 172.21.15.134:0/316354501 shutdown_connections 2024-09-15T22:48:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.896+0000 7fba036e6640 1 -- 172.21.15.134:0/316354501 wait complete. 2024-09-15T22:48:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.897+0000 7fba036e6640 1 Processor -- start 2024-09-15T22:48:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.897+0000 7fba036e6640 1 -- start start 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc15b370 0x7fb9fc0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc0731b0 con 0x7fb9fc06f130 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc15c450 con 0x7fb9fc15f9f0 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc15b750 con 0x7fb9fc15b370 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52964/0 (socket says 172.21.15.134:52964) 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 -- 172.21.15.134:0/1933483993 learned_addr learned my addr 172.21.15.134:0/1933483993 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba00c81640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc15b370 0x7fb9fc0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01c83640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 -- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc15b370 msgr2=0x7fb9fc0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc15b370 0x7fb9fc0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 -- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9fc15f9f0 msgr2=0x7fb9fc146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 -- 172.21.15.134:0/1933483993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc15d9c0 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba01482640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c430 tx=0x7fb9f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80052d0 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8005490 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc0b36a0 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.898+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8007260 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.899+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc147200 con 0x7fb9fc06f130 2024-09-15T22:48:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.899+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc072560 con 0x7fb9fc06f130 2024-09-15T22:48:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.900+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb9f8007400 con 0x7fb9fc06f130 2024-09-15T22:48:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.900+0000 7fb9f1ffb640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 0x7fb9e006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.900+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fb9f80892e0 con 0x7fb9fc06f130 2024-09-15T22:48:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.901+0000 7fba00c81640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 0x7fb9e006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.901+0000 7fba00c81640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 0x7fb9e006ef50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc072920 tx=0x7fb9ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:26.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:26.905+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9f8058cf0 con 0x7fb9fc06f130 2024-09-15T22:48:27.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.131+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb9fc06c300 con 0x7fb9fc06f130 2024-09-15T22:48:27.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.133+0000 7fb9f1ffb640 1 -- 172.21.15.134:0/1933483993 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7fb9f805cff0 con 0x7fb9fc06f130 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:48:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 msgr2=0x7fb9e006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 0x7fb9e006ef50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc072920 tx=0x7fb9ec008040 comp rx=0 tx=0).stop 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 msgr2=0x7fb9fc1521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c430 tx=0x7fb9f800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 shutdown_connections 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9fc15f9f0 0x7fb9fc146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9fc15b370 0x7fb9fc0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb9e006ca90 0x7fb9e006ef50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 --2- 172.21.15.134:0/1933483993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9fc06f130 0x7fb9fc1521f0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.135+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 >> 172.21.15.134:0/1933483993 conn(0x7fb9fc06bba0 msgr2=0x7fb9fc156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:27.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.136+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 shutdown_connections 2024-09-15T22:48:27.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.136+0000 7fba036e6640 1 -- 172.21.15.134:0/1933483993 wait complete. 2024-09-15T22:48:27.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.246+0000 7fb430d4b640 1 Processor -- start 2024-09-15T22:48:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.246+0000 7fb430d4b640 1 -- start start 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb430d4b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb42c156880 0x7fb42c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb430d4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 0x7fb42c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb430d4b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb42c0b0880 con 0x7fb42c0b65c0 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb430d4b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c0ce150 con 0x7fb42c156880 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb430d4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0ce430 con 0x7fb42c0aff30 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb429d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb42c0b65c0 0x7fb42c160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50858/0 (socket says 172.21.15.134:50858) 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.247+0000 7fb429d9b640 1 -- 172.21.15.134:0/2965234976 learned_addr learned my addr 172.21.15.134:0/2965234976 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42a59c640 1 --2- 172.21.15.134:0/2965234976 >> v2:172.21.15.177:3300/0 conn(0x7fb42c156880 0x7fb42c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42ad9d640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 0x7fb42c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125957767 0 0) 0x7fb420001110 con 0x7fb42c0b65c0 2024-09-15T22:48:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb414003520 con 0x7fb42c0b65c0 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42a59c640 1 -- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 msgr2=0x7fb42c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42a59c640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 0x7fb42c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42a59c640 1 -- 172.21.15.134:0/2965234976 >> v1:172.21.15.134:6789/0 conn(0x7fb42c0b65c0 legacy=0x7fb42c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142429806 0 0) 0x7fb414003520 con 0x7fb42c0b65c0 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42a59c640 1 -- 172.21.15.134:0/2965234976 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c15ff30 con 0x7fb42c156880 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.248+0000 7fb42ad9d640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 0x7fb42c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb42a59c640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c156880 0x7fb42c0cdae0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009d90 tx=0x7fb41c02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa46ee30a484370 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420001840 con 0x7fb42c156880 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c007540 con 0x7fb42c156880 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb42959a640 1 -- 172.21.15.134:0/2965234976 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0078f0 con 0x7fb42c156880 2024-09-15T22:48:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 -- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c156880 msgr2=0x7fb42c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c156880 0x7fb42c0cdae0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009d90 tx=0x7fb41c02a560 comp rx=0 tx=0).stop 2024-09-15T22:48:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 -- 172.21.15.134:0/2965234976 shutdown_connections 2024-09-15T22:48:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c0aff30 0x7fb42c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 --2- 172.21.15.134:0/2965234976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c156880 0x7fb42c0cdae0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.249+0000 7fb430d4b640 1 -- 172.21.15.134:0/2965234976 >> 172.21.15.134:0/2965234976 conn(0x7fb42c06cae0 msgr2=0x7fb42c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.250+0000 7fb430d4b640 1 -- 172.21.15.134:0/2965234976 shutdown_connections 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.250+0000 7fb430d4b640 1 -- 172.21.15.134:0/2965234976 wait complete. 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.251+0000 7fb430d4b640 1 Processor -- start 2024-09-15T22:48:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.251+0000 7fb430d4b640 1 -- start start 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.251+0000 7fb430d4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c0aff30 0x7fb42c1f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.251+0000 7fb430d4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c156880 0x7fb42c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0b6a30 con 0x7fb42c0b65c0 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c156c60 con 0x7fb42c0aff30 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0ce710 con 0x7fb42c156880 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52978/0 (socket says 172.21.15.134:52978) 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 -- 172.21.15.134:0/767076334 learned_addr learned my addr 172.21.15.134:0/767076334 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb42a59c640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c0aff30 0x7fb42c1f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb42ad9d640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c156880 0x7fb42c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 -- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c156880 msgr2=0x7fb42c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c156880 0x7fb42c0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 -- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c0aff30 msgr2=0x7fb42c1f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c0aff30 0x7fb42c1f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 -- 172.21.15.134:0/767076334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c1f77d0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb429d9b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb420001eb0 tx=0x7fb42000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420017070 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420005ce0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200072b0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c0b50f0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.252+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c0b56b0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.253+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0b0340 con 0x7fb42c0b65c0 2024-09-15T22:48:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.254+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fb42001a070 con 0x7fb42c0b65c0 2024-09-15T22:48:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.254+0000 7fb41affd640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 0x7fb40c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.254+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fb4200891b0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.254+0000 7fb42a59c640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 0x7fb40c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.255+0000 7fb42a59c640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 0x7fb40c06ef50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c02f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.258+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb42c0b0880 con 0x7fb42c0b65c0 2024-09-15T22:48:27.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.458+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb42c0d0730 con 0x7fb42c0b65c0 2024-09-15T22:48:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.459+0000 7fb41affd640 1 -- 172.21.15.134:0/767076334 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5236 (secure 0 0 0) 0x7fb420058bc0 con 0x7fb42c0b65c0 2024-09-15T22:48:27.460 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:27.460 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":82,"btime":"2024-09-15T22:48:21:148051+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:27.461 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 82 2024-09-15T22:48:27.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 msgr2=0x7fb40c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 0x7fb40c06ef50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c02f000 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 msgr2=0x7fb42c0b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb420001eb0 tx=0x7fb42000cad0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 shutdown_connections 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb42c156880 0x7fb42c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb40c06ca90 0x7fb40c06ef50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb42c0b65c0 0x7fb42c0b4630 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 --2- 172.21.15.134:0/767076334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb42c0aff30 0x7fb42c1f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 >> 172.21.15.134:0/767076334 conn(0x7fb42c06cae0 msgr2=0x7fb42c073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 shutdown_connections 2024-09-15T22:48:27.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.461+0000 7fb430d4b640 1 -- 172.21.15.134:0/767076334 wait complete. 2024-09-15T22:48:27.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:48:18.472630+0000', 'modified': '2024-09-15T22:48:20.471600+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8670': {'gid': 8670, 'name': 'b', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/1298493121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6833', 'nonce': 1298493121}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 1298493121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8670, 'qdb_cluster': [8670]} 2024-09-15T22:48:27.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:48:27.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T22:48:27.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.978+0000 7f2d7e39f640 1 Processor -- start 2024-09-15T22:48:27.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.978+0000 7f2d7e39f640 1 -- start start 2024-09-15T22:48:27.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7e39f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d7815e4f0 0x7f2d780cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7e39f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d7806e8f0 0x7f2d780b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7e39f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d780d0070 con 0x7f2d780ce740 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7e39f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d780d12a0 con 0x7f2d7815e4f0 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7e39f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2d780d1580 con 0x7f2d7806e8f0 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d7815e4f0 0x7f2d780cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d7815e4f0 0x7f2d780cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52984/0 (socket says 172.21.15.134:52984) 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 -- 172.21.15.134:0/1768419011 learned_addr learned my addr 172.21.15.134:0/1768419011 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/1768419011 >> v2:172.21.15.177:3300/0 conn(0x7f2d7806e8f0 0x7f2d780b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 -- 172.21.15.134:0/1768419011 >> v2:172.21.15.177:3300/0 conn(0x7f2d7806e8f0 msgr2=0x7f2d780b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/1768419011 >> v2:172.21.15.177:3300/0 conn(0x7f2d7806e8f0 0x7f2d780b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 -- 172.21.15.134:0/1768419011 >> v1:172.21.15.177:6789/0 conn(0x7f2d780ce740 legacy=0x7f2d7806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.979+0000 7f2d7d39d640 1 -- 172.21.15.134:0/1768419011 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d780d1860 con 0x7f2d7815e4f0 2024-09-15T22:48:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/1768419011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d780cdb60 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f2d7806c2f0 tx=0x7f2d7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee02383def6fc232 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d6ffff640 1 -- 172.21.15.134:0/1768419011 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037070 con 0x7f2d7815e4f0 2024-09-15T22:48:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d6ffff640 1 -- 172.21.15.134:0/1768419011 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74032440 con 0x7f2d7815e4f0 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d6ffff640 1 -- 172.21.15.134:0/1768419011 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74032810 con 0x7f2d7815e4f0 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 -- 172.21.15.134:0/1768419011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 msgr2=0x7f2d780cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/1768419011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d780cdb60 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f2d7806c2f0 tx=0x7f2d7402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 -- 172.21.15.134:0/1768419011 shutdown_connections 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/1768419011 >> v2:172.21.15.177:3300/0 conn(0x7f2d7806e8f0 0x7f2d780b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/1768419011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d780cdb60 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.980+0000 7f2d7e39f640 1 -- 172.21.15.134:0/1768419011 >> 172.21.15.134:0/1768419011 conn(0x7f2d780b6700 msgr2=0x7f2d780b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.981+0000 7f2d7e39f640 1 -- 172.21.15.134:0/1768419011 shutdown_connections 2024-09-15T22:48:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.981+0000 7f2d7e39f640 1 -- 172.21.15.134:0/1768419011 wait complete. 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 Processor -- start 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 -- start start 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7806e8f0 0x7f2d7814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d780ce740 0x7f2d780b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7815e8d0 con 0x7f2d7815e4f0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d780b4dd0 con 0x7f2d7806e8f0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.982+0000 7f2d7e39f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d780b2260 con 0x7f2d780ce740 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52992/0 (socket says 172.21.15.134:52992) 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 -- 172.21.15.134:0/8595308 learned_addr learned my addr 172.21.15.134:0/8595308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7806e8f0 0x7f2d7814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d780ce740 0x7f2d780b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 -- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d780ce740 msgr2=0x7f2d780b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d780ce740 0x7f2d780b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 -- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7806e8f0 msgr2=0x7f2d7814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7806e8f0 0x7f2d7814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 -- 172.21.15.134:0/8595308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d780b33f0 con 0x7f2d7815e4f0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f2d70007e40 tx=0x7f2d7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d6dffb640 1 -- 172.21.15.134:0/8595308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70014620 con 0x7f2d7815e4f0 2024-09-15T22:48:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d6dffb640 1 -- 172.21.15.134:0/8595308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70019070 con 0x7f2d7815e4f0 2024-09-15T22:48:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d780b1650 con 0x7f2d7815e4f0 2024-09-15T22:48:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d6dffb640 1 -- 172.21.15.134:0/8595308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70014a20 con 0x7f2d7815e4f0 2024-09-15T22:48:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.983+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d780b1c10 con 0x7f2d7815e4f0 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.985+0000 7f2d6dffb640 1 -- 172.21.15.134:0/8595308 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f2d70014bc0 con 0x7f2d7815e4f0 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.985+0000 7f2d6dffb640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 0x7f2d5c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.985+0000 7f2d6dffb640 1 -- 172.21.15.134:0/8595308 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f2d7008a5b0 con 0x7f2d7815e4f0 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.986+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 0x7f2d5c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.986+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 0x7f2d5c06ef50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d74034000 tx=0x7f2d7402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.986+0000 7f2d82474740 1 Processor -- start 2024-09-15T22:48:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.986+0000 7f2d82474740 1 -- start start 2024-09-15T22:48:27.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401b94b0 0x5596401fec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55964011b520 con 0x5596401b6c70 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596400c33e0 con 0x5596401bac40 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5596401174e0 con 0x5596401b94b0 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52994/0 (socket says 172.21.15.134:52994) 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/646426831 learned_addr learned my addr 172.21.15.134:0/646426831 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401b94b0 0x5596401fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401b94b0 msgr2=0x5596401fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401b94b0 0x5596401fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 msgr2=0x5596401b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.987+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/646426831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596400de2f0 con 0x5596401b6c70 2024-09-15T22:48:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2d680015d0 tx=0x7f2d68001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e44f6752a2feae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d62ffd640 1 -- 172.21.15.134:0/646426831 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68019070 con 0x5596401b6c70 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d62ffd640 1 -- 172.21.15.134:0/646426831 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68001ce0 con 0x5596401b6c70 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d62ffd640 1 -- 172.21.15.134:0/646426831 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800e740 con 0x5596401b6c70 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 -- 172.21.15.134:0/646426831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 msgr2=0x5596401b9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2d680015d0 tx=0x7f2d68001a90 comp rx=0 tx=0).stop 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 -- 172.21.15.134:0/646426831 shutdown_connections 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b6c70 0x5596401b9890 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 --2- 172.21.15.134:0/646426831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401b94b0 0x5596401fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 -- 172.21.15.134:0/646426831 >> 172.21.15.134:0/646426831 conn(0x5596401b5c70 msgr2=0x5596401fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 -- 172.21.15.134:0/646426831 shutdown_connections 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.988+0000 7f2d82474740 1 -- 172.21.15.134:0/646426831 wait complete. 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.989+0000 7f2d82474740 1 -- start start 2024-09-15T22:48:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.989+0000 7f2d82474740 1 Processor -- start 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596401b5110 con 0x5596401b94b0 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596400a4450 con 0x5596401bac40 2024-09-15T22:48:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5596401ff480 con 0x5596401deae0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d82474740 10 client.0 _ll_register_callbacks cb 0x55963fe2dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52998/0 (socket says 172.21.15.134:52998) 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 -- 172.21.15.134:0/767115681 learned_addr learned my addr 172.21.15.134:0/767115681 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 -- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 msgr2=0x5596401e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 -- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 msgr2=0x5596401de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 -- 172.21.15.134:0/767115681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963fe2e2d0 con 0x5596401b94b0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c00 tx=0x7f2d7402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a94c0c2cdcdab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.990+0000 7f2d57fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:48:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037040 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f2d7403c850 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d68001ce0 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2d7403ca50 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 10 client.8805 fetch_fsmap learned FSMap version 82 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x55963fef86b0 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68001ce0 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7f2d7403cbf0 con 0x5596401b94b0 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 10 client.8805 fetch_fsmap finished waiting for FSMap version 82 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 10 client.8805 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 20 client.8805 populate_metadata read hostname 'smithi134' 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x5596401e45c0 0x5596401e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 4 client.8805 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 --> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559640128c50 con 0x5596401e45c0 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.991+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x5596401e45c0 0x5596401e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.992+0000 7f2d57fff640 10 client.8805 ms_handle_connect on v2:172.21.15.177:6833/1298493121 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.992+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x5596401e45c0 0x5596401e49a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a28ce84d179cbdf server_cookie=377a22c9091ba54e in_seq=0 out_seq=0 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d57fff640 1 -- 172.21.15.134:0/767115681 <== mds.0 v2:172.21.15.177:6833/1298493121 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559640128c50 con 0x5596401e45c0 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d57fff640 10 client.8805 handle_command_reply: tid=0 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 client.8805 shutdown 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 msgr2=0x5596401e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c00 tx=0x7f2d7402c070 comp rx=0 tx=0).stop 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 shutdown_connections 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x5596401e45c0 0x5596401e49a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401bac40 0x5596401de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d57fff640 0 client.8805 ms_handle_reset on v2:172.21.15.177:6833/1298493121 2024-09-15T22:48:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 --2- 172.21.15.134:0/767115681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401b94b0 0x5596401e0f70 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 >> 172.21.15.134:0/767115681 conn(0x5596401b6c70 msgr2=0x5596401b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 shutdown_connections 2024-09-15T22:48:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 1 -- 172.21.15.134:0/767115681 wait complete. 2024-09-15T22:48:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:27.993+0000 7f2d82474740 20 client.8805 trim_cache size 0 max 16384 2024-09-15T22:48:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 Processor -- start 2024-09-15T22:48:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 -- start start 2024-09-15T22:48:28.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x5596401fe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401bac40 0x559640201310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d781ffb10 con 0x5596401deae0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78156c70 con 0x5596401b94b0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d781572c0 con 0x5596401bac40 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.011+0000 7f2d7db9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53010/0 (socket says 172.21.15.134:53010) 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 -- 172.21.15.134:0/1748593928 learned_addr learned my addr 172.21.15.134:0/1748593928 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 -- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401bac40 msgr2=0x559640201310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401bac40 0x559640201310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 -- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 msgr2=0x5596401fe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x5596401fe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 -- 172.21.15.134:0/1748593928 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596401e28d0 con 0x5596401deae0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2d7008a810 tx=0x7f2d7005a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1760c669c781f246 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d627fc640 1 -- 172.21.15.134:0/1748593928 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70073070 con 0x5596401deae0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d627fc640 1 -- 172.21.15.134:0/1748593928 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70088070 con 0x5596401deae0 2024-09-15T22:48:28.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.012+0000 7f2d627fc640 1 -- 172.21.15.134:0/1748593928 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70062af0 con 0x5596401deae0 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- 172.21.15.134:0/1748593928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 msgr2=0x559640201850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2d7008a810 tx=0x7f2d7005a6d0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- 172.21.15.134:0/1748593928 shutdown_connections 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401deae0 0x559640201850 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401bac40 0x559640201310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 --2- 172.21.15.134:0/1748593928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x5596401fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- 172.21.15.134:0/1748593928 >> 172.21.15.134:0/1748593928 conn(0x5596401b6c70 msgr2=0x5596401ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- 172.21.15.134:0/1748593928 shutdown_connections 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- 172.21.15.134:0/1748593928 wait complete. 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 -- start start 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.013+0000 7f2d82474740 1 Processor -- start 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x559640221870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401fd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596401de750 con 0x5596401bac40 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596401e2420 con 0x5596401b94b0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x55964020e290 con 0x5596401deae0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d82474740 10 client.0 _ll_register_callbacks cb 0x7f2d740096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53022/0 (socket says 172.21.15.134:53022) 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/104327244 learned_addr learned my addr 172.21.15.134:0/104327244 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x559640221870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 msgr2=0x5596401fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 msgr2=0x559640221870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.014+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x559640221870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d7cb9c640 1 -- 172.21.15.134:0/104327244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596401fb950 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d7db9e640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x559640221870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d7cb9c640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2d68013000 tx=0x7f2d68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59e2d7e7103a98d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68019040 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f2d6800e940 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d70088070 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2d68032050 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 10 client.8811 fetch_fsmap learned FSMap version 82 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x559640272c90 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70088070 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7f2d68035020 con 0x5596401bac40 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 10 client.8811 fetch_fsmap finished waiting for FSMap version 82 2024-09-15T22:48:28.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 10 client.8811 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 20 client.8811 populate_metadata read hostname 'smithi134' 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x559640276440 0x55964020c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 4 client.8811 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 --> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] -- command(tid 0: {"prefix": "status"}) -- 0x5596401b4cb0 con 0x559640276440 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.015+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x559640276440 0x55964020c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d57fff640 10 client.8811 ms_handle_connect on v2:172.21.15.177:6833/1298493121 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d7d39d640 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x559640276440 0x55964020c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3545afe80f54e34 server_cookie=9e386ad49afc4e69 in_seq=0 out_seq=0 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d57fff640 1 -- 172.21.15.134:0/104327244 <== mds.0 v2:172.21.15.177:6833/1298493121 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5596401b4cb0 con 0x559640276440 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d57fff640 10 client.8811 handle_command_reply: tid=0 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 client.8811 shutdown 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 msgr2=0x559640272750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2d68013000 tx=0x7f2d68000ed0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 shutdown_connections 2024-09-15T22:48:28.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5596401deae0 0x5596401fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596401bac40 0x559640272750 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:6833/1298493121,v1:172.21.15.177:6835/1298493121] conn(0x559640276440 0x55964020c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 --2- 172.21.15.134:0/104327244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596401b94b0 0x559640221870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d57fff640 0 client.8811 ms_handle_reset on v2:172.21.15.177:6833/1298493121 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 >> 172.21.15.134:0/104327244 conn(0x5596401b6c70 msgr2=0x5596401ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 shutdown_connections 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 1 -- 172.21.15.134:0/104327244 wait complete. 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.016+0000 7f2d82474740 20 client.8811 trim_cache size 0 max 16384 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:48:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 8670, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 8.8848851720000006, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 82, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 158, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 158, 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 13.212031407 2024-09-15T22:48:28.026 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 msgr2=0x7f2d5c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 0x7f2d5c06ef50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d74034000 tx=0x7f2d7402e000 comp rx=0 tx=0).stop 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 msgr2=0x7f2d781608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f2d70007e40 tx=0x7f2d7000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 shutdown_connections 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d5c06ca90 0x7f2d5c06ef50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d7815e4f0 0x7f2d781608f0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d780ce740 0x7f2d780b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 --2- 172.21.15.134:0/8595308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d7806e8f0 0x7f2d7814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 >> 172.21.15.134:0/8595308 conn(0x7f2d780b6700 msgr2=0x7f2d780affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 shutdown_connections 2024-09-15T22:48:28.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.017+0000 7f2d7e39f640 1 -- 172.21.15.134:0/8595308 wait complete. 2024-09-15T22:48:28.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:48:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.125+0000 7f027694b640 1 Processor -- start 2024-09-15T22:48:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f027694b640 1 -- start start 2024-09-15T22:48:28.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f027694b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02700b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f027694b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02700b7170 con 0x7f027015ed20 2024-09-15T22:48:28.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f027694b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02700b7aa0 con 0x7f027015e940 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f027694b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f02700d3660 con 0x7f02700b8f90 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f026f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f027015ed20 0x7f02700b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50872/0 (socket says 172.21.15.134:50872) 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.126+0000 7f026f7fe640 1 -- 172.21.15.134:0/1031000395 learned_addr learned my addr 172.21.15.134:0/1031000395 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314508821 0 0) 0x7f0264001110 con 0x7f027015ed20 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02700b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0258003520 con 0x7f027015ed20 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3526343779 0 0) 0x7f0258003520 con 0x7f027015ed20 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 msgr2=0x7f02700b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02700b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 >> v1:172.21.15.177:6789/0 conn(0x7f027015e940 legacy=0x7f02700d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02700d3940 con 0x7f027015ed20 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f0264001840 con 0x7f027015ed20 2024-09-15T22:48:28.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 >> v1:172.21.15.134:6789/0 conn(0x7f027015ed20 legacy=0x7f02700b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0258003f40 0x7f0258004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02700d3660 con 0x7f0258004d40 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f025800ba70 con 0x7f0258003f40 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f025800bc40 con 0x7f02700b8f90 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026f7fe640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0258003f40 0x7f0258004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f026ffff640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 -- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 msgr2=0x7f02580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02700b8f90 0x7f02580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 -- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0258003f40 msgr2=0x7f0258004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:28.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0258003f40 0x7f0258004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.127+0000 7f0274ee8640 1 -- 172.21.15.134:0/1031000395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0258003520 con 0x7f0258004d40 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.128+0000 7f0274ee8640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02580051c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f026800e170 tx=0x7f0258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833923462b935661 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.128+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268034020 con 0x7f0258004d40 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.128+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02680305f0 con 0x7f0258004d40 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.128+0000 7f026effd640 1 -- 172.21.15.134:0/1031000395 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268009c10 con 0x7f0258004d40 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 -- 172.21.15.134:0/1031000395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 msgr2=0x7f02580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 --2- 172.21.15.134:0/1031000395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02580051c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f026800e170 tx=0x7f0258005830 comp rx=0 tx=0).stop 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f0274ee8640 1 -- 172.21.15.134:0/1031000395 reap_dead start 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 -- 172.21.15.134:0/1031000395 shutdown_connections 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 -- 172.21.15.134:0/1031000395 >> 172.21.15.134:0/1031000395 conn(0x7f02700b6240 msgr2=0x7f02700b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 -- 172.21.15.134:0/1031000395 shutdown_connections 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.129+0000 7f027694b640 1 -- 172.21.15.134:0/1031000395 wait complete. 2024-09-15T22:48:28.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.130+0000 7f027694b640 1 Processor -- start 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.130+0000 7f027694b640 1 -- start start 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 0x7f02700cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02700cc810 0x7f02701e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02700d3310 con 0x7f0258004d40 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02700d3f00 con 0x7f02700cc810 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f027694b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f02700d1ef0 con 0x7f027015b2e0 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53030/0 (socket says 172.21.15.134:53030) 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 -- 172.21.15.134:0/4053016482 learned_addr learned my addr 172.21.15.134:0/4053016482 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026f7fe640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 0x7f02700cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f0274ee8640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02700cc810 0x7f02701e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 -- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 msgr2=0x7f02700cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 0x7f02700cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 -- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02700cc810 msgr2=0x7f02701e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02700cc810 0x7f02701e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 -- 172.21.15.134:0/4053016482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02701e8120 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026f7fe640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 0x7f02700cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.131+0000 7f026ffff640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f026000f7c0 tx=0x7f026000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.132+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02600052e0 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.132+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0260018070 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.132+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02701e8400 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.132+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026000d970 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.132+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701e89c0 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.133+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02700cef90 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.133+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f026000db10 con 0x7f0258004d40 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.134+0000 7f026cff9640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 0x7f025c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.134+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f0260089da0 con 0x7f0258004d40 2024-09-15T22:48:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.134+0000 7f026f7fe640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 0x7f025c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.134+0000 7f026f7fe640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 0x7f025c06ef50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f02700cc200 tx=0x7f0264009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.138+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f026001a310 con 0x7f0258004d40 2024-09-15T22:48:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.337+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02700b98a0 con 0x7f0258004d40 2024-09-15T22:48:28.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.337+0000 7f026cff9640 1 -- 172.21.15.134:0/4053016482 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7f0260059e00 con 0x7f0258004d40 2024-09-15T22:48:28.339 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 msgr2=0x7f025c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 0x7f025c06ef50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f02700cc200 tx=0x7f0264009040 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 msgr2=0x7f02700ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f026000f7c0 tx=0x7f026000fc80 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 shutdown_connections 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02700cc810 0x7f02701e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f027015b2e0 0x7f02700cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f025c06ca90 0x7f025c06ef50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 --2- 172.21.15.134:0/4053016482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0258004d40 0x7f02700ce4c0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 >> 172.21.15.134:0/4053016482 conn(0x7f02700b6240 msgr2=0x7f02701eaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:28.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 shutdown_connections 2024-09-15T22:48:28.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28.339+0000 7f027694b640 1 -- 172.21.15.134:0/4053016482 wait complete. 2024-09-15T22:48:28.351 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:48:28.352 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:28.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.352 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:48:28.368 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:48:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:48:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:48:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:48:28.369 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42385sec preferred_lft 42385sec 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.370 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.371 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:48:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:48:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:28.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.373 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:48:28.433 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:48:28.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.434 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:48:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:48:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:48:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:48:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:48:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:48:28.492 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:48:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:48:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:28.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.616 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:48:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:48:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:48:28.632 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:28.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:48:28.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:28.697 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:28.753 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:28.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:28.753 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:28.808 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:48:28.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:28.891 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:28.891 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:28.891 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:28.900 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:28.900 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:28.900 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:28.900 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:28.900 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:48:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:48:28.919 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:48:28.919 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:48:28.919 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:48:28.919 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:48:28.919 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:48:28.920 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:48:28.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:28.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:28.985 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:48:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:29.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:29.088 INFO:teuthology.orchestra.run.smithi134.stdout:client8820 2024-09-15T22:48:29.088 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:29.088 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:29.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:48:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 Processor -- start 2024-09-15T22:48:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 -- start start 2024-09-15T22:48:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02180b6d50 0x7f02180b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02180b56d0 0x7f02180b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f021815c9c0 con 0x7f021815c5e0 2024-09-15T22:48:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0218074100 con 0x7f02180b56d0 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.242+0000 7f021dbfd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f02180b76d0 con 0x7f02180b6d50 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0217fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02180b56d0 0x7f02180b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f02177fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f021815c5e0 0x7f02180712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50884/0 (socket says 172.21.15.134:50884) 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f02177fe640 1 -- 172.21.15.134:0/1922950768 learned_addr learned my addr 172.21.15.134:0/1922950768 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0216ffd640 1 --2- 172.21.15.134:0/1922950768 >> v2:172.21.15.177:3300/0 conn(0x7f02180b6d50 0x7f02180b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0217fff640 1 -- 172.21.15.134:0/1922950768 >> v2:172.21.15.177:3300/0 conn(0x7f02180b6d50 msgr2=0x7f02180b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0217fff640 1 --2- 172.21.15.134:0/1922950768 >> v2:172.21.15.177:3300/0 conn(0x7f02180b6d50 0x7f02180b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0217fff640 1 -- 172.21.15.134:0/1922950768 >> v1:172.21.15.134:6789/0 conn(0x7f021815c5e0 legacy=0x7f02180712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f0217fff640 1 -- 172.21.15.134:0/1922950768 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180b1dd0 con 0x7f02180b56d0 2024-09-15T22:48:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.243+0000 7f02167fc640 1 -- 172.21.15.134:0/1922950768 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448695292 0 0) 0x7f021815c9c0 con 0x7f021815c5e0 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f0217fff640 1 --2- 172.21.15.134:0/1922950768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02180b56d0 0x7f02180b5b40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f02180cf9c0 tx=0x7f021002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae21d4842589b9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f02167fc640 1 -- 172.21.15.134:0/1922950768 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210007740 con 0x7f02180b56d0 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f02167fc640 1 -- 172.21.15.134:0/1922950768 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02100078e0 con 0x7f02180b56d0 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f02167fc640 1 -- 172.21.15.134:0/1922950768 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210007cb0 con 0x7f02180b56d0 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 -- 172.21.15.134:0/1922950768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02180b56d0 msgr2=0x7f02180b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 --2- 172.21.15.134:0/1922950768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02180b56d0 0x7f02180b5b40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f02180cf9c0 tx=0x7f021002a680 comp rx=0 tx=0).stop 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 -- 172.21.15.134:0/1922950768 shutdown_connections 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 --2- 172.21.15.134:0/1922950768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02180b56d0 0x7f02180b5b40 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 --2- 172.21.15.134:0/1922950768 >> v2:172.21.15.177:3300/0 conn(0x7f02180b6d50 0x7f02180b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 -- 172.21.15.134:0/1922950768 >> 172.21.15.134:0/1922950768 conn(0x7f02180b4220 msgr2=0x7f02180b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 -- 172.21.15.134:0/1922950768 shutdown_connections 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.244+0000 7f021dbfd640 1 -- 172.21.15.134:0/1922950768 wait complete. 2024-09-15T22:48:29.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 Processor -- start 2024-09-15T22:48:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 -- start start 2024-09-15T22:48:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02180b56d0 0x7f02181f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180b6d50 0x7f02180b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0218073ab0 con 0x7f021815c5e0 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02180737d0 con 0x7f02180b6d50 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.246+0000 7f021dbfd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f0218073d90 con 0x7f02180b56d0 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53040/0 (socket says 172.21.15.134:53040) 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 -- 172.21.15.134:0/3858936649 learned_addr learned my addr 172.21.15.134:0/3858936649 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f02177fe640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02180b56d0 0x7f02181f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0216ffd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180b6d50 0x7f02180b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 -- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02180b56d0 msgr2=0x7f02181f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02180b56d0 0x7f02181f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 -- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180b6d50 msgr2=0x7f02180b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180b6d50 0x7f02180b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 -- 172.21.15.134:0/3858936649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180b13b0 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f0217fff640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f021002ac70 tx=0x7f0210004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021003f070 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210031bc0 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02181545e0 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210009450 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.247+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02181f4ed0 con 0x7f021815c5e0 2024-09-15T22:48:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.248+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218069190 con 0x7f021815c5e0 2024-09-15T22:48:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.249+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f021003b410 con 0x7f021815c5e0 2024-09-15T22:48:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.249+0000 7f020ffff640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 0x7f01f806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.249+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f02100ab470 con 0x7f021815c5e0 2024-09-15T22:48:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.249+0000 7f02177fe640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 0x7f01f806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.250+0000 7f02177fe640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 0x7f01f806ef50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0208000f60 tx=0x7f0208007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.253+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02100b4080 con 0x7f021815c5e0 2024-09-15T22:48:29.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.453+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f021815c9c0 con 0x7f021815c5e0 2024-09-15T22:48:29.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.453+0000 7f020ffff640 1 -- 172.21.15.134:0/3858936649 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7f021007ae80 con 0x7f021815c5e0 2024-09-15T22:48:29.455 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:48:29.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 msgr2=0x7f01f806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 0x7f01f806ef50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0208000f60 tx=0x7f0208007d50 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 msgr2=0x7f02181540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f021002ac70 tx=0x7f0210004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 shutdown_connections 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f01f806ca90 0x7f01f806ef50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f021815c5e0 0x7f02181540a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180b6d50 0x7f02180b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 --2- 172.21.15.134:0/3858936649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02180b56d0 0x7f02181f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 >> 172.21.15.134:0/3858936649 conn(0x7f02180b4220 msgr2=0x7f02180708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 shutdown_connections 2024-09-15T22:48:29.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:29.455+0000 7f021dbfd640 1 -- 172.21.15.134:0/3858936649 wait complete. 2024-09-15T22:48:29.467 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:48:29.468 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:29.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.469 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:48:29.488 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:48:29.488 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:48:29.488 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:48:29.488 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:48:29.489 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42373sec preferred_lft 42373sec 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.490 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:29.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.491 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:48:29.556 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:48:29.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.558 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:48:29.616 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:48:29.617 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:48:29.617 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:48:29.617 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:48:29.617 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:48:29.617 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:48:29.617 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:48:29.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:48:29.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:48:29.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:48:29.618 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:48:29.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:48:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:29.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.748 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:48:29.765 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:48:29.765 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:48:29.765 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:29.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.765 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:48:29.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:29.830 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:29.885 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:29.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:29.885 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:29.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:48:29.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:29.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:30.036 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:48:30.037 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:48:30.038 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:48:30.038 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:48:30.038 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:48:30.039 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:48:30.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:30.040 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:30.105 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:48:30.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:30.200 INFO:teuthology.orchestra.run.smithi177.stdout:client8832 2024-09-15T22:48:30.200 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:30.200 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:30.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:48:30.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.323+0000 7fadcece6640 1 Processor -- start 2024-09-15T22:48:30.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.323+0000 7fadcece6640 1 -- start start 2024-09-15T22:48:30.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcece6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcece6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadc8148150 0x7fadc806d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcece6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc80710e0 con 0x7fadc8072090 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcece6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fadc80b5700 con 0x7fadc8148150 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcece6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fadc8071350 con 0x7fadc8147d70 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadc8148150 0x7fadc806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadc8148150 0x7fadc806d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53052/0 (socket says 172.21.15.134:53052) 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 -- 172.21.15.134:0/3648347291 learned_addr learned my addr 172.21.15.134:0/3648347291 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadcca82640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 -- 172.21.15.134:0/3648347291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 msgr2=0x7fadc8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc8071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:30.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 -- 172.21.15.134:0/3648347291 >> v1:172.21.15.177:6789/0 conn(0x7fadc8072090 legacy=0x7fadc80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:30.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.324+0000 7fadbffff640 1 -- 172.21.15.134:0/3648347291 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc8071630 con 0x7fadc8148150 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.325+0000 7fadbffff640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc806d080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646db3ac2aa8a2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.325+0000 7fadbf7fe640 1 -- 172.21.15.134:0/3648347291 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8037070 con 0x7fadc8148150 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.325+0000 7fadbf7fe640 1 -- 172.21.15.134:0/3648347291 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8032440 con 0x7fadc8148150 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.325+0000 7fadbf7fe640 1 -- 172.21.15.134:0/3648347291 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8032810 con 0x7fadc8148150 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 -- 172.21.15.134:0/3648347291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 msgr2=0x7fadc806d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc806d080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a270 comp rx=0 tx=0).stop 2024-09-15T22:48:30.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 -- 172.21.15.134:0/3648347291 shutdown_connections 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc806d080 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 --2- 172.21.15.134:0/3648347291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 -- 172.21.15.134:0/3648347291 >> 172.21.15.134:0/3648347291 conn(0x7fadc806bba0 msgr2=0x7fadc806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 -- 172.21.15.134:0/3648347291 shutdown_connections 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.326+0000 7fadcece6640 1 -- 172.21.15.134:0/3648347291 wait complete. 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.327+0000 7fadcece6640 1 Processor -- start 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.327+0000 7fadcece6640 1 -- start start 2024-09-15T22:48:30.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8072090 0x7fadc81f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc81427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80af170 con 0x7fadc8148150 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80aeff0 con 0x7fadc8072090 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fadc806d5c0 con 0x7fadc8147d70 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53054/0 (socket says 172.21.15.134:53054) 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 -- 172.21.15.134:0/4260120316 learned_addr learned my addr 172.21.15.134:0/4260120316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcca82640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8072090 0x7fadc81f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadbffff640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc81427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 -- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 msgr2=0x7fadc81427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc81427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:30.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 -- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8072090 msgr2=0x7fadc81f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8072090 0x7fadc81f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 -- 172.21.15.134:0/4260120316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc81f3fa0 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcd283640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c730 tx=0x7fadc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003b70 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0003d30 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.328+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc80ccfc0 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.329+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0005310 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.329+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc8143dd0 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.329+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc8071b50 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.330+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fadc00054b0 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.330+0000 7fadbd7fa640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 0x7fadb406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.330+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fadc0089b60 con 0x7fadc8148150 2024-09-15T22:48:30.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.331+0000 7fadcca82640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 0x7fadb406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:30.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.331+0000 7fadcca82640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 0x7fadb406ef50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009b40 tx=0x7fadc4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:30.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.335+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadc0059570 con 0x7fadc8148150 2024-09-15T22:48:30.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:30.533+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fadc80b5220 con 0x7fadc8148150 2024-09-15T22:48:31.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.296+0000 7fadbd7fa640 1 -- 172.21.15.134:0/4260120316 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v83) ==== 136+0+0 (secure 0 0 0) 0x7fadc005d870 con 0x7fadc8148150 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 msgr2=0x7fadb406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 0x7fadb406ef50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009b40 tx=0x7fadc4009190 comp rx=0 tx=0).stop 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 msgr2=0x7fadc80b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c730 tx=0x7fadc000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 shutdown_connections 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fadb406ca90 0x7fadb406ef50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadc8148150 0x7fadc80b0d80 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8147d70 0x7fadc81427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 --2- 172.21.15.134:0/4260120316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8072090 0x7fadc81f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 >> 172.21.15.134:0/4260120316 conn(0x7fadc806bba0 msgr2=0x7fadc80ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 shutdown_connections 2024-09-15T22:48:31.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.299+0000 7fadcece6640 1 -- 172.21.15.134:0/4260120316 wait complete. 2024-09-15T22:48:31.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:48:31.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.417+0000 7f8498f81640 1 Processor -- start 2024-09-15T22:48:31.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.417+0000 7f8498f81640 1 -- start start 2024-09-15T22:48:31.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8498f81640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f849415e940 0x7f84940d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8498f81640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84940cef90 0x7f84940d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8498f81640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84940b7170 con 0x7f849415ed20 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8498f81640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f84940d1ae0 con 0x7f849415e940 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8498f81640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84940b7aa0 con 0x7f84940cef90 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f849259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f849415e940 0x7f84940d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f849259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f849415e940 0x7f84940d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53066/0 (socket says 172.21.15.134:53066) 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f849259c640 1 -- 172.21.15.134:0/3021292726 learned_addr learned my addr 172.21.15.134:0/3021292726 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.418+0000 7f8492d9d640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84940cef90 0x7f84940d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f849259c640 1 -- 172.21.15.134:0/3021292726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84940cef90 msgr2=0x7f84940d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f849259c640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84940cef90 0x7f84940d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f849259c640 1 -- 172.21.15.134:0/3021292726 >> v1:172.21.15.177:6789/0 conn(0x7f849415ed20 legacy=0x7f84940b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:31.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f849259c640 1 -- 172.21.15.134:0/3021292726 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84940d3660 con 0x7f849415e940 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f849259c640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849415e940 0x7f84940d1060 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f8484009870 tx=0x7f848402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332948a36a1b618a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f8491d9b640 1 -- 172.21.15.134:0/3021292726 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484037070 con 0x7f849415e940 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f8491d9b640 1 -- 172.21.15.134:0/3021292726 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8484032440 con 0x7f849415e940 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.419+0000 7f8491d9b640 1 -- 172.21.15.134:0/3021292726 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484032810 con 0x7f849415e940 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 -- 172.21.15.134:0/3021292726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849415e940 msgr2=0x7f84940d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849415e940 0x7f84940d1060 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f8484009870 tx=0x7f848402a2a0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 -- 172.21.15.134:0/3021292726 shutdown_connections 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84940cef90 0x7f84940d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 --2- 172.21.15.134:0/3021292726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849415e940 0x7f84940d1060 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 -- 172.21.15.134:0/3021292726 >> 172.21.15.134:0/3021292726 conn(0x7f84940b6240 msgr2=0x7f84940b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 -- 172.21.15.134:0/3021292726 shutdown_connections 2024-09-15T22:48:31.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.420+0000 7f8498f81640 1 -- 172.21.15.134:0/3021292726 wait complete. 2024-09-15T22:48:31.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.421+0000 7f8498f81640 1 Processor -- start 2024-09-15T22:48:31.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 -- start start 2024-09-15T22:48:31.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f849415e940 0x7f84940b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f849415ed20 0x7f84940b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84940d3f00 con 0x7f84940cef90 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84940d3c20 con 0x7f849415e940 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8498f81640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84940d3310 con 0x7f849415ed20 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f849259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f849259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53082/0 (socket says 172.21.15.134:53082) 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f849259c640 1 -- 172.21.15.134:0/1400844288 learned_addr learned my addr 172.21.15.134:0/1400844288 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8492d9d640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f849415ed20 0x7f84940b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.422+0000 7f8489d9b640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f849415e940 0x7f84940b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 -- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f849415ed20 msgr2=0x7f84940b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f849415ed20 0x7f84940b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 -- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f849415e940 msgr2=0x7f84940b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f849415e940 0x7f84940b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 -- 172.21.15.134:0/1400844288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941e9310 con 0x7f84940cef90 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f849259c640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f8484009870 tx=0x7f84840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484041020 con 0x7f84940cef90 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84840306c0 con 0x7f84940cef90 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941e95f0 con 0x7f84940cef90 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484037040 con 0x7f84940cef90 2024-09-15T22:48:31.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.423+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84941f8420 con 0x7f84940cef90 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.424+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84940d1ef0 con 0x7f84940cef90 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.424+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f8484044020 con 0x7f84940cef90 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.425+0000 7f848b7fe640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 0x7f847406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.425+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f84840aa5b0 con 0x7f84940cef90 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.425+0000 7f8489d9b640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 0x7f847406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.426+0000 7f8489d9b640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 0x7f847406ef80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f84940d1960 tx=0x7f847c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.429+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f848404b030 con 0x7f84940cef90 2024-09-15T22:48:31.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.615+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f84940ba6b0 con 0x7f847406cac0 2024-09-15T22:48:31.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.617+0000 7f848b7fe640 1 -- 172.21.15.134:0/1400844288 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f84940ba6b0 con 0x7f847406cac0 2024-09-15T22:48:31.618 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:48:31.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:31.618 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:48:31.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:31.619 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:48:31.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 msgr2=0x7f847406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 0x7f847406ef80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f84940d1960 tx=0x7f847c007e30 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 msgr2=0x7f84941f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f8484009870 tx=0x7f84840046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 shutdown_connections 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f849415ed20 0x7f84940b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f849415e940 0x7f84940b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f847406cac0 0x7f847406ef80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 --2- 172.21.15.134:0/1400844288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84940cef90 0x7f84941f7ee0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 >> 172.21.15.134:0/1400844288 conn(0x7f84940b6240 msgr2=0x7f84940b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 shutdown_connections 2024-09-15T22:48:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.619+0000 7f8498f81640 1 -- 172.21.15.134:0/1400844288 wait complete. 2024-09-15T22:48:31.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:48:31.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.732+0000 7fdbe472a640 1 Processor -- start 2024-09-15T22:48:31.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.732+0000 7fdbe472a640 1 -- start start 2024-09-15T22:48:31.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe472a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdbdc0729a0 0x7fdbdc0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe472a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc06dc40 con 0x7fdbdc161cc0 2024-09-15T22:48:31.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe472a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc06df20 con 0x7fdbdc0b57d0 2024-09-15T22:48:31.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe472a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc0af300 con 0x7fdbdc0729a0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe24c6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdbdc161cc0 0x7fdbdc0aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50890/0 (socket says 172.21.15.134:50890) 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe24c6640 1 -- 172.21.15.134:0/2283978976 learned_addr learned my addr 172.21.15.134:0/2283978976 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe2cc7640 1 --2- 172.21.15.134:0/2283978976 >> v2:172.21.15.177:3300/0 conn(0x7fdbdc0729a0 0x7fdbdc0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44414462 0 0) 0x7fdbdc06dc40 con 0x7fdbdc161cc0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc8003520 con 0x7fdbdc161cc0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468088731 0 0) 0x7fdbc8003520 con 0x7fdbdc161cc0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 >> v2:172.21.15.177:3300/0 conn(0x7fdbdc0729a0 msgr2=0x7fdbdc0b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 --2- 172.21.15.134:0/2283978976 >> v2:172.21.15.177:3300/0 conn(0x7fdbdc0729a0 0x7fdbdc0b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 >> v1:172.21.15.177:6789/0 conn(0x7fdbdc0b57d0 legacy=0x7fdbdc072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc06e200 con 0x7fdbdc161cc0 2024-09-15T22:48:31.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fdbd8001670 con 0x7fdbdc161cc0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.733+0000 7fdbe2cc7640 1 --2- 172.21.15.134:0/2283978976 >> v2:172.21.15.177:3300/0 conn(0x7fdbdc0729a0 0x7fdbdc0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 >> v1:172.21.15.134:6789/0 conn(0x7fdbdc161cc0 legacy=0x7fdbdc0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbc80039b0 0x7fdbc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 0x7fdbc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc80051c0 0x7fdbc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0af300 con 0x7fdbc8004800 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc800c060 con 0x7fdbc80051c0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc800c260 con 0x7fdbc80039b0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 0x7fdbc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe24c6640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbc80039b0 0x7fdbc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe2cc7640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc80051c0 0x7fdbc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbc80039b0 msgr2=0x7fdbc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:31.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbc80039b0 0x7fdbc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc80051c0 msgr2=0x7fdbc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc80051c0 0x7fdbc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/2283978976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc8003520 con 0x7fdbc8004800 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.734+0000 7fdbe2cc7640 1 -- 172.21.15.134:0/2283978976 reap_dead start 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 0x7fdbc8004c80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001750 tx=0x7fdbc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae164226364b50be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc001370 con 0x7fdbc8004800 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0052d0 con 0x7fdbc8004800 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe14c4640 1 -- 172.21.15.134:0/2283978976 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02abc0 con 0x7fdbc8004800 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 -- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 msgr2=0x7fdbc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 0x7fdbc8004c80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001750 tx=0x7fdbc8005830 comp rx=0 tx=0).stop 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 -- 172.21.15.134:0/2283978976 shutdown_connections 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 --2- 172.21.15.134:0/2283978976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc8004800 0x7fdbc8004c80 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 -- 172.21.15.134:0/2283978976 >> 172.21.15.134:0/2283978976 conn(0x7fdbdc06bba0 msgr2=0x7fdbdc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.735+0000 7fdbe472a640 1 -- 172.21.15.134:0/2283978976 shutdown_connections 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.736+0000 7fdbe472a640 1 -- 172.21.15.134:0/2283978976 wait complete. 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 Processor -- start 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 -- start start 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc8004800 0x7fdbdc14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbdc0b04d0 0x7fdbdc1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0b5c40 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc06e570 con 0x7fdbc8004800 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.737+0000 7fdbe472a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc0b5dc0 con 0x7fdbdc0b04d0 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53106/0 (socket says 172.21.15.134:53106) 2024-09-15T22:48:31.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/1334928418 learned_addr learned my addr 172.21.15.134:0/1334928418 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe24c6640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc8004800 0x7fdbdc14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe2cc7640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbdc0b04d0 0x7fdbdc1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbdc0b04d0 msgr2=0x7fdbdc1f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbdc0b04d0 0x7fdbdc1f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc8004800 msgr2=0x7fdbdc14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc8004800 0x7fdbdc14b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 -- 172.21.15.134:0/1334928418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc0b0a90 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe1cc5640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc000c00 tx=0x7fdbcc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc040030 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02be50 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc001370 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc0b0d70 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.738+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc0b1330 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.739+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbdc072290 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.740+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7fdbcc043070 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.740+0000 7fdbd2ffd640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 0x7fdbc006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.740+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fdbcc0a9500 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.740+0000 7fdbe24c6640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 0x7fdbc006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.741+0000 7fdbe24c6640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 0x7fdbc006ef50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001cd0 tx=0x7fdbd8000ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.744+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbcc04b020 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.910+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdbdc14b640 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.910+0000 7fdbd2ffd640 1 -- 172.21.15.134:0/1334928418 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fdbcc078e80 con 0x7fdbdc0b1b30 2024-09-15T22:48:31.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 msgr2=0x7fdbc006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 0x7fdbc006ef50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001cd0 tx=0x7fdbd8000ed0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 msgr2=0x7fdbdc0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc000c00 tx=0x7fdbcc001120 comp rx=0 tx=0).stop 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 shutdown_connections 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbdc0b04d0 0x7fdbdc1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdbc006ca90 0x7fdbc006ef50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbdc0b1b30 0x7fdbdc0cc790 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 --2- 172.21.15.134:0/1334928418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbc8004800 0x7fdbdc14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 >> 172.21.15.134:0/1334928418 conn(0x7fdbdc06bba0 msgr2=0x7fdbdc15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 shutdown_connections 2024-09-15T22:48:31.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:31.913+0000 7fdbe472a640 1 -- 172.21.15.134:0/1334928418 wait complete. 2024-09-15T22:48:31.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:31.925 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol72190/b47b2a47-cd64-4af0-8c2c-8b053959ffac) 2024-09-15T22:48:31.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:31.959 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:48:32.017 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:48:32.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:32.021 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol72190/b47b2a47-cd64-4af0-8c2c-8b053959ffac) 2024-09-15T22:48:32.087 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:32.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol72190/.meta 2024-09-15T22:48:32.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:32.157 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp7350/subvol16301/3af1c9de-3637-4c3d-9d0d-063e8eb2ea47) 2024-09-15T22:48:32.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:32.229 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:48:32.286 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:48:32.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:32.286 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp7350/subvol16301/3af1c9de-3637-4c3d-9d0d-063e8eb2ea47) 2024-09-15T22:48:32.356 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:32.356 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp7350/subvol16301/.meta 2024-09-15T22:48:32.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol72190 2024-09-15T22:48:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.563+0000 7efda2ca6640 1 Processor -- start 2024-09-15T22:48:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.563+0000 7efda2ca6640 1 -- start start 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd9c158e50 0x7efd9c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c15c370 0x7efd9c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd9c06ef60 0x7efd9c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c06f3d0 con 0x7efd9c06ef60 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c15c800 con 0x7efd9c158e50 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda2ca6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c0b43f0 con 0x7efd9c15c370 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd9c06ef60 0x7efd9c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd9c06ef60 0x7efd9c15ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53122/0 (socket says 172.21.15.134:53122) 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 -- 172.21.15.134:0/2173808687 learned_addr learned my addr 172.21.15.134:0/2173808687 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda0a42640 1 --2- 172.21.15.134:0/2173808687 >> v2:172.21.15.177:3300/0 conn(0x7efd9c158e50 0x7efd9c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efd9bfff640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c15c370 0x7efd9c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 -- 172.21.15.134:0/2173808687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c15c370 msgr2=0x7efd9c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c15c370 0x7efd9c06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 -- 172.21.15.134:0/2173808687 >> v2:172.21.15.177:3300/0 conn(0x7efd9c158e50 msgr2=0x7efd9c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 --2- 172.21.15.134:0/2173808687 >> v2:172.21.15.177:3300/0 conn(0x7efd9c158e50 0x7efd9c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.564+0000 7efda1243640 1 -- 172.21.15.134:0/2173808687 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0b3630 con 0x7efd9c06ef60 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda1243640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c06ef60 0x7efd9c15ee50 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7efd9c069580 tx=0x7efd9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58dcce58ada78da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efd9b7fe640 1 -- 172.21.15.134:0/2173808687 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94036070 con 0x7efd9c06ef60 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efd9b7fe640 1 -- 172.21.15.134:0/2173808687 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94031600 con 0x7efd9c06ef60 2024-09-15T22:48:32.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efd9b7fe640 1 -- 172.21.15.134:0/2173808687 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940319d0 con 0x7efd9c06ef60 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 -- 172.21.15.134:0/2173808687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c06ef60 msgr2=0x7efd9c15ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c06ef60 0x7efd9c15ee50 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7efd9c069580 tx=0x7efd9402a6a0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 -- 172.21.15.134:0/2173808687 shutdown_connections 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c06ef60 0x7efd9c15ee50 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 --2- 172.21.15.134:0/2173808687 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c15c370 0x7efd9c06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 --2- 172.21.15.134:0/2173808687 >> v2:172.21.15.177:3300/0 conn(0x7efd9c158e50 0x7efd9c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.565+0000 7efda2ca6640 1 -- 172.21.15.134:0/2173808687 >> 172.21.15.134:0/2173808687 conn(0x7efd9c06bba0 msgr2=0x7efd9c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.566+0000 7efda2ca6640 1 -- 172.21.15.134:0/2173808687 shutdown_connections 2024-09-15T22:48:32.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.566+0000 7efda2ca6640 1 -- 172.21.15.134:0/2173808687 wait complete. 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.567+0000 7efda2ca6640 1 Processor -- start 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.567+0000 7efda2ca6640 1 -- start start 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd9c06ef60 0x7efd9c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 0x7efd9c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0b3ed0 con 0x7efd9c15c370 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0b3bf0 con 0x7efd9c06ef60 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c159230 con 0x7efd9c158e50 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53126/0 (socket says 172.21.15.134:53126) 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 -- 172.21.15.134:0/1664179395 learned_addr learned my addr 172.21.15.134:0/1664179395 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efd9bfff640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 0x7efd9c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda0a42640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd9c06ef60 0x7efd9c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 -- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 msgr2=0x7efd9c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 0x7efd9c142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 -- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd9c06ef60 msgr2=0x7efd9c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd9c06ef60 0x7efd9c1415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 -- 172.21.15.134:0/1664179395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c142a90 con 0x7efd9c15c370 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efd9bfff640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 0x7efd9c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda1243640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7efd94034040 tx=0x7efd94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94036050 con 0x7efd9c15c370 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94042070 con 0x7efd9c15c370 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c151ae0 con 0x7efd9c15c370 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94009510 con 0x7efd9c15c370 2024-09-15T22:48:32.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.568+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1520a0 con 0x7efd9c15c370 2024-09-15T22:48:32.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.569+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c06ea20 con 0x7efd9c15c370 2024-09-15T22:48:32.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.570+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7efd94007bf0 con 0x7efd9c15c370 2024-09-15T22:48:32.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.570+0000 7efd997fa640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 0x7efd8006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.570+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7efd940aab60 con 0x7efd9c15c370 2024-09-15T22:48:32.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.571+0000 7efda0a42640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 0x7efd8006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.571+0000 7efda0a42640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 0x7efd8006ef50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd9c15ca90 tx=0x7efd90009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.575+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd9c142a90 con 0x7efd9c15c370 2024-09-15T22:48:32.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.766+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol72190", "target": ["mon-mgr", ""]}) -- 0x7efd9c0b5330 con 0x7efd8006ca90 2024-09-15T22:48:32.773 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:32.771+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:32.773 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:32.771+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:32.773 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:32.771+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:32.773 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:32.771+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:32.774 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:32.771+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:32.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.818+0000 7efd997fa640 1 -- 172.21.15.134:0/1664179395 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7efd9c0b5330 con 0x7efd8006ca90 2024-09-15T22:48:32.820 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/_nogroup/subvol72190/b47b2a47-cd64-4af0-8c2c-8b053959ffac 2024-09-15T22:48:32.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 msgr2=0x7efd8006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 0x7efd8006ef50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd9c15ca90 tx=0x7efd90009190 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 msgr2=0x7efd9c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7efd94034040 tx=0x7efd94004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 shutdown_connections 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efd8006ca90 0x7efd8006ef50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd9c15c370 0x7efd9c15a5e0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd9c158e50 0x7efd9c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 --2- 172.21.15.134:0/1664179395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd9c06ef60 0x7efd9c1415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 >> 172.21.15.134:0/1664179395 conn(0x7efd9c06bba0 msgr2=0x7efd9c0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 shutdown_connections 2024-09-15T22:48:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.820+0000 7efda2ca6640 1 -- 172.21.15.134:0/1664179395 wait complete. 2024-09-15T22:48:32.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol16301 subvol_grp7350 2024-09-15T22:48:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.934+0000 7f85bbf4b640 1 Processor -- start 2024-09-15T22:48:32.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.934+0000 7f85bbf4b640 1 -- start start 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85bbf4b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85b40b61e0 0x7f85b40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85bbf4b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85b40d3990 0x7f85b4162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85bbf4b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b40b6b00 con 0x7f85b40b3b00 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85bbf4b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f85b40d24f0 con 0x7f85b40d3990 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85bbf4b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f85b40d20e0 con 0x7f85b40b61e0 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85ba4e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85b40d3990 0x7f85b4162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85ba4e8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85b40d3990 0x7f85b4162ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53128/0 (socket says 172.21.15.134:53128) 2024-09-15T22:48:32.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.935+0000 7f85ba4e8640 1 -- 172.21.15.134:0/488733296 learned_addr learned my addr 172.21.15.134:0/488733296 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.936+0000 7f85ba4e8640 1 -- 172.21.15.134:0/488733296 >> v2:172.21.15.177:3300/0 conn(0x7f85b40b61e0 msgr2=0x7f85b40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.936+0000 7f85ba4e8640 1 --2- 172.21.15.134:0/488733296 >> v2:172.21.15.177:3300/0 conn(0x7f85b40b61e0 0x7f85b40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.936+0000 7f85ba4e8640 1 -- 172.21.15.134:0/488733296 >> v1:172.21.15.177:6789/0 conn(0x7f85b40b3b00 legacy=0x7f85b41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:32.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.936+0000 7f85ba4e8640 1 -- 172.21.15.134:0/488733296 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b40cfa70 con 0x7f85b40d3990 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.936+0000 7f85ba4e8640 1 --2- 172.21.15.134:0/488733296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b4162ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f85b406be00 tx=0x7f85ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82331c25ca605db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85b8ce5640 1 -- 172.21.15.134:0/488733296 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac036070 con 0x7f85b40d3990 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85b8ce5640 1 -- 172.21.15.134:0/488733296 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac031600 con 0x7f85b40d3990 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85b8ce5640 1 -- 172.21.15.134:0/488733296 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0319d0 con 0x7f85b40d3990 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 -- 172.21.15.134:0/488733296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 msgr2=0x7f85b4162ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/488733296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b4162ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f85b406be00 tx=0x7f85ac02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 -- 172.21.15.134:0/488733296 shutdown_connections 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/488733296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b4162ce0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/488733296 >> v2:172.21.15.177:3300/0 conn(0x7f85b40b61e0 0x7f85b40b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 -- 172.21.15.134:0/488733296 >> 172.21.15.134:0/488733296 conn(0x7f85b40d11e0 msgr2=0x7f85b40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:32.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 -- 172.21.15.134:0/488733296 shutdown_connections 2024-09-15T22:48:32.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.937+0000 7f85bbf4b640 1 -- 172.21.15.134:0/488733296 wait complete. 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.938+0000 7f85bbf4b640 1 Processor -- start 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.938+0000 7f85bbf4b640 1 -- start start 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 0x7f85b40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85b40b61e0 0x7f85b4161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85b415edc0 con 0x7f85b40d3990 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40d0030 con 0x7f85b40b3b00 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85bbf4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f85b4160540 con 0x7f85b40b61e0 2024-09-15T22:48:32.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85ba4e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85ba4e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53130/0 (socket says 172.21.15.134:53130) 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85ba4e8640 1 -- 172.21.15.134:0/600999070 learned_addr learned my addr 172.21.15.134:0/600999070 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85b9ce7640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 0x7f85b40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.939+0000 7f85ba4e8640 1 -- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85b40b61e0 msgr2=0x7f85b4161ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85ba4e8640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85b40b61e0 0x7f85b4161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85ba4e8640 1 -- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 msgr2=0x7f85b40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85ba4e8640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 0x7f85b40ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85ba4e8640 1 -- 172.21.15.134:0/600999070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b4160820 con 0x7f85b40d3990 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85b9ce7640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 0x7f85b40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85ba4e8640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02abc0 tx=0x7f85ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac041020 con 0x7f85b40d3990 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac007800 con 0x7f85b40d3990 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b4160b00 con 0x7f85b40d3990 2024-09-15T22:48:32.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac036040 con 0x7f85b40d3990 2024-09-15T22:48:32.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.940+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b40cd010 con 0x7f85b40d3990 2024-09-15T22:48:32.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.941+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4068e90 con 0x7f85b40d3990 2024-09-15T22:48:32.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.941+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 91560+0+0 (secure 0 0 0) 0x7f85ac044020 con 0x7f85b40d3990 2024-09-15T22:48:32.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.942+0000 7f85aa7fc640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 0x7f859806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:32.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.942+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f85ac0aac70 con 0x7f85b40d3990 2024-09-15T22:48:32.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.942+0000 7f85b9ce7640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 0x7f859806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:32.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.943+0000 7f85b9ce7640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 0x7f859806ef50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f85b000a870 tx=0x7f85b0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:32.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:32.946+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85b4068e90 con 0x7f85b40d3990 2024-09-15T22:48:33.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.139+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol16301", "group_name": "subvol_grp7350", "target": ["mon-mgr", ""]}) -- 0x7f85b40d1d00 con 0x7f859806ca90 2024-09-15T22:48:33.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.182+0000 7f85aa7fc640 1 -- 172.21.15.134:0/600999070 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7f85b40d1d00 con 0x7f859806ca90 2024-09-15T22:48:33.183 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp7350/subvol16301/3af1c9de-3637-4c3d-9d0d-063e8eb2ea47 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 msgr2=0x7f859806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 0x7f859806ef50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f85b000a870 tx=0x7f85b0008040 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 msgr2=0x7f85b40cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02abc0 tx=0x7f85ac004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 shutdown_connections 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f859806ca90 0x7f859806ef50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85b40d3990 0x7f85b40cb830 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85b40b61e0 0x7f85b4161ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 --2- 172.21.15.134:0/600999070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b40b3b00 0x7f85b40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 >> 172.21.15.134:0/600999070 conn(0x7f85b40d11e0 msgr2=0x7f85b40cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 shutdown_connections 2024-09-15T22:48:33.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.184+0000 7f85bbf4b640 1 -- 172.21.15.134:0/600999070 wait complete. 2024-09-15T22:48:33.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:33.197 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol72190/.meta) 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout:version = 2 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/_nogroup/subvol72190/b47b2a47-cd64-4af0-8c2c-8b053959ffac 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:48:33.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:33.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:33.224 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp7350/subvol16301/.meta) 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout:version = 2 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/subvol_grp7350/subvol16301/3af1c9de-3637-4c3d-9d0d-063e8eb2ea47 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:48:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:33.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol72190 2024-09-15T22:48:33.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.432+0000 7f27b2d49640 1 Processor -- start 2024-09-15T22:48:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.432+0000 7f27b2d49640 1 -- start start 2024-09-15T22:48:33.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27ac158e50 0x7f27ac0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27ac15c370 0x7f27ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 0x7f27ac15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f27ac15c800 con 0x7f27ac15c370 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f27ac0b43f0 con 0x7f27ac158e50 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b2d49640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac0b3630 con 0x7f27ac06ef60 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27ac15c370 0x7f27ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27ac15c370 0x7f27ac06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53136/0 (socket says 172.21.15.134:53136) 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27abfff640 1 -- 172.21.15.134:0/2089732753 learned_addr learned my addr 172.21.15.134:0/2089732753 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.433+0000 7f27b0ae5640 1 --2- 172.21.15.134:0/2089732753 >> v2:172.21.15.177:3300/0 conn(0x7f27ac158e50 0x7f27ac0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27b12e6640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 0x7f27ac15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 -- 172.21.15.134:0/2089732753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 msgr2=0x7f27ac15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 0x7f27ac15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 -- 172.21.15.134:0/2089732753 >> v2:172.21.15.177:3300/0 conn(0x7f27ac158e50 msgr2=0x7f27ac0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 --2- 172.21.15.134:0/2089732753 >> v2:172.21.15.177:3300/0 conn(0x7f27ac158e50 0x7f27ac0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 -- 172.21.15.134:0/2089732753 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0b3910 con 0x7f27ac15c370 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27b12e6640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 0x7f27ac15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27abfff640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac06ea20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f27ac069580 tx=0x7f27a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdc69ed3feeffbd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27ab7fe640 1 -- 172.21.15.134:0/2089732753 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0004030 con 0x7f27ac15c370 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27ab7fe640 1 -- 172.21.15.134:0/2089732753 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a00041d0 con 0x7f27ac15c370 2024-09-15T22:48:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.434+0000 7f27ab7fe640 1 -- 172.21.15.134:0/2089732753 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0003610 con 0x7f27ac15c370 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 -- 172.21.15.134:0/2089732753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 msgr2=0x7f27ac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac06ea20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f27ac069580 tx=0x7f27a002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 -- 172.21.15.134:0/2089732753 shutdown_connections 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac06ef60 0x7f27ac15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 --2- 172.21.15.134:0/2089732753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac06ea20 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 --2- 172.21.15.134:0/2089732753 >> v2:172.21.15.177:3300/0 conn(0x7f27ac158e50 0x7f27ac0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 -- 172.21.15.134:0/2089732753 >> 172.21.15.134:0/2089732753 conn(0x7f27ac06bba0 msgr2=0x7f27ac06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 -- 172.21.15.134:0/2089732753 shutdown_connections 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.435+0000 7f27b2d49640 1 -- 172.21.15.134:0/2089732753 wait complete. 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.436+0000 7f27b2d49640 1 Processor -- start 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.436+0000 7f27b2d49640 1 -- start start 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac06ef60 0x7f27ac0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac158e50 0x7f27ac0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac159230 con 0x7f27ac15c370 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0b3ed0 con 0x7f27ac06ef60 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b2d49640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac15f390 con 0x7f27ac158e50 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b12e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b12e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53148/0 (socket says 172.21.15.134:53148) 2024-09-15T22:48:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b12e6640 1 -- 172.21.15.134:0/1809988420 learned_addr learned my addr 172.21.15.134:0/1809988420 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27b0ae5640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac06ef60 0x7f27ac0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.437+0000 7f27abfff640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac158e50 0x7f27ac0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 -- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac158e50 msgr2=0x7f27ac0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac158e50 0x7f27ac0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 -- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac06ef60 msgr2=0x7f27ac0acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac06ef60 0x7f27ac0acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 -- 172.21.15.134:0/1809988420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0af480 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b12e6640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f27a400cef0 tx=0x7f27a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a401a070 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a400d840 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac0aa4d0 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a400dc30 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.438+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac0af9e0 con 0x7f27ac15c370 2024-09-15T22:48:33.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.439+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac15ee50 con 0x7f27ac15c370 2024-09-15T22:48:33.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.439+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) ==== 91611+0+0 (secure 0 0 0) 0x7f27a401d070 con 0x7f27ac15c370 2024-09-15T22:48:33.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.440+0000 7f27a97fa640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 0x7f279806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.440+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f27a408a430 con 0x7f27ac15c370 2024-09-15T22:48:33.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.440+0000 7f27b0ae5640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 0x7f279806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.440+0000 7f27b0ae5640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 0x7f279806efe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.444+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27ac0af480 con 0x7f27ac15c370 2024-09-15T22:48:33.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.631+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol72190", "target": ["mon-mgr", ""]}) -- 0x7f27ac0b54a0 con 0x7f279806cb20 2024-09-15T22:48:33.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.645+0000 7f27a97fa640 1 -- 172.21.15.134:0/1809988420 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f27ac0b54a0 con 0x7f279806cb20 2024-09-15T22:48:33.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 msgr2=0x7f279806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 0x7f279806efe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:33.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 msgr2=0x7f27ac1f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f27a400cef0 tx=0x7f27a400a710 comp rx=0 tx=0).stop 2024-09-15T22:48:33.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 shutdown_connections 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f279806cb20 0x7f279806efe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27ac15c370 0x7f27ac1f22d0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27ac158e50 0x7f27ac0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 --2- 172.21.15.134:0/1809988420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac06ef60 0x7f27ac0acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 >> 172.21.15.134:0/1809988420 conn(0x7f27ac06bba0 msgr2=0x7f27ac074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 shutdown_connections 2024-09-15T22:48:33.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.648+0000 7f27b2d49640 1 -- 172.21.15.134:0/1809988420 wait complete. 2024-09-15T22:48:33.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.650+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.650+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.650+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.650+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.650+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol16301 subvol_grp7350 2024-09-15T22:48:33.665 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.663+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.665 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.663+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.665 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.663+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.665 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.663+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.665 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:48:33.663+0000 7f4589c85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:48:33.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.762+0000 7ff5726dd640 1 Processor -- start 2024-09-15T22:48:33.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.762+0000 7ff5726dd640 1 -- start start 2024-09-15T22:48:33.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff5726dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff56c0d1860 0x7ff56c0709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff5726dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 0x7ff56c070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff5726dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56c06ec90 con 0x7ff56c15e5c0 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff5726dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff56c0d1dd0 con 0x7ff56c0d1860 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff5726dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c073d20 con 0x7ff56c0d1fd0 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff56c0d1860 0x7ff56c0709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff56c15e5c0 0x7ff56c0b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50906/0 (socket says 172.21.15.134:50906) 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56bfff640 1 -- 172.21.15.134:0/2658981398 learned_addr learned my addr 172.21.15.134:0/2658981398 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56b7fe640 1 -- 172.21.15.134:0/2658981398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 msgr2=0x7ff56c070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff570c7a640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 0x7ff56c070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56b7fe640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 0x7ff56c070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56b7fe640 1 -- 172.21.15.134:0/2658981398 >> v1:172.21.15.134:6789/0 conn(0x7ff56c15e5c0 legacy=0x7ff56c0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56b7fe640 1 -- 172.21.15.134:0/2658981398 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c074000 con 0x7ff56c0d1860 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff56affd640 1 -- 172.21.15.134:0/2658981398 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055453153 0 0) 0x7ff56c06ec90 con 0x7ff56c15e5c0 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.763+0000 7ff570c7a640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 0x7ff56c070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.764+0000 7ff56b7fe640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c0709d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097a0 tx=0x7ff56002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43972493e1a0fed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.764+0000 7ff56affd640 1 -- 172.21.15.134:0/2658981398 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560037070 con 0x7ff56c0d1860 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.764+0000 7ff56affd640 1 -- 172.21.15.134:0/2658981398 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56002adb0 con 0x7ff56c0d1860 2024-09-15T22:48:33.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.764+0000 7ff56affd640 1 -- 172.21.15.134:0/2658981398 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560032660 con 0x7ff56c0d1860 2024-09-15T22:48:33.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 -- 172.21.15.134:0/2658981398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 msgr2=0x7ff56c0709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c0709d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097a0 tx=0x7ff56002a060 comp rx=0 tx=0).stop 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 -- 172.21.15.134:0/2658981398 shutdown_connections 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c0d1fd0 0x7ff56c070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 --2- 172.21.15.134:0/2658981398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c0709d0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 -- 172.21.15.134:0/2658981398 >> 172.21.15.134:0/2658981398 conn(0x7ff56c0d25b0 msgr2=0x7ff56c0d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 -- 172.21.15.134:0/2658981398 shutdown_connections 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.765+0000 7ff5726dd640 1 -- 172.21.15.134:0/2658981398 wait complete. 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.766+0000 7ff5726dd640 1 Processor -- start 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.766+0000 7ff5726dd640 1 -- start start 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff56c0d1fd0 0x7ff56c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c15e5c0 0x7ff56c14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0b5890 con 0x7ff56c0d1860 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0b5710 con 0x7ff56c0d1fd0 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff5726dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c15e9a0 con 0x7ff56c15e5c0 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53162/0 (socket says 172.21.15.134:53162) 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 -- 172.21.15.134:0/838241593 learned_addr learned my addr 172.21.15.134:0/838241593 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 -- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c15e5c0 msgr2=0x7ff56c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c15e5c0 0x7ff56c14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 -- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff56c0d1fd0 msgr2=0x7ff56c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff56c0d1fd0 0x7ff56c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 -- 172.21.15.134:0/838241593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c157a20 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff56bfff640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c4d0 tx=0x7ff55c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.767+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c018070 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.768+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c007500 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.768+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c0cc9c0 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.768+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004a20 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.768+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c0ccf80 con 0x7ff56c0d1860 2024-09-15T22:48:33.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.768+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c0b6d80 con 0x7ff56c0d1860 2024-09-15T22:48:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.769+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) ==== 91611+0+0 (secure 0 0 0) 0x7ff55c01b070 con 0x7ff56c0d1860 2024-09-15T22:48:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.769+0000 7ff568ff9640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 0x7ff55806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.769+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7ff55c088fd0 con 0x7ff56c0d1860 2024-09-15T22:48:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.770+0000 7ff56b7fe640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 0x7ff55806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.770+0000 7ff56b7fe640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 0x7ff55806efe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff560034000 tx=0x7ff56002c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.774+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff55c0591f0 con 0x7ff56c0d1860 2024-09-15T22:48:33.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:33.964+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol16301", "group_name": "subvol_grp7350", "target": ["mon-mgr", ""]}) -- 0x7ff56c0cd320 con 0x7ff55806cb20 2024-09-15T22:48:34.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.814+0000 7ff568ff9640 1 -- 172.21.15.134:0/838241593 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff56c0cd320 con 0x7ff55806cb20 2024-09-15T22:48:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 msgr2=0x7ff55806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 0x7ff55806efe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff560034000 tx=0x7ff56002c000 comp rx=0 tx=0).stop 2024-09-15T22:48:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 msgr2=0x7ff56c14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c4d0 tx=0x7ff55c00c990 comp rx=0 tx=0).stop 2024-09-15T22:48:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 shutdown_connections 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff56c15e5c0 0x7ff56c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff56c0d1fd0 0x7ff56c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff55806cb20 0x7ff55806efe0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 --2- 172.21.15.134:0/838241593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff56c0d1860 0x7ff56c14d6d0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 >> 172.21.15.134:0/838241593 conn(0x7ff56c0d25b0 msgr2=0x7ff56c158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 shutdown_connections 2024-09-15T22:48:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34.817+0000 7ff5726dd640 1 -- 172.21.15.134:0/838241593 wait complete. 2024-09-15T22:48:34.832 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:48:34.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:34.890 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:48:34.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:34.896 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:48:34.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:34.933 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:34.976 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:48:34.976 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:34.976 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:34.976 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:34.992 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:34.993 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:35.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:48:35.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.194+0000 7ff2f08dd640 1 Processor -- start 2024-09-15T22:48:35.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.194+0000 7ff2f08dd640 1 -- start start 2024-09-15T22:48:35.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2ec15c300 0x7ff2ec0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2ec06f010 0x7ff2ec1622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec15ecf0 con 0x7ff2ec06f010 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec15c6e0 con 0x7ff2ec15c300 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2f08dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec15efb0 con 0x7ff2ec0cd300 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2ec06f010 0x7ff2ec1622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2ec06f010 0x7ff2ec1622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53168/0 (socket says 172.21.15.134:53168) 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 -- 172.21.15.134:0/2474402515 learned_addr learned my addr 172.21.15.134:0/2474402515 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 -- 172.21.15.134:0/2474402515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 msgr2=0x7ff2ec06ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 --2- 172.21.15.134:0/2474402515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 -- 172.21.15.134:0/2474402515 >> v2:172.21.15.177:3300/0 conn(0x7ff2ec15c300 msgr2=0x7ff2ec0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 --2- 172.21.15.134:0/2474402515 >> v2:172.21.15.177:3300/0 conn(0x7ff2ec15c300 0x7ff2ec0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.195+0000 7ff2ead9d640 1 -- 172.21.15.134:0/2474402515 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec15f290 con 0x7ff2ec06f010 2024-09-15T22:48:35.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.196+0000 7ff2ead9d640 1 --2- 172.21.15.134:0/2474402515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec1622e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec069490 tx=0x7ff2dc02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4215b794376b5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.196+0000 7ff2e959a640 1 -- 172.21.15.134:0/2474402515 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc037070 con 0x7ff2ec06f010 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.196+0000 7ff2e959a640 1 -- 172.21.15.134:0/2474402515 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc032440 con 0x7ff2ec06f010 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.196+0000 7ff2e959a640 1 -- 172.21.15.134:0/2474402515 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc032810 con 0x7ff2ec06f010 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 -- 172.21.15.134:0/2474402515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 msgr2=0x7ff2ec1622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/2474402515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec1622e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec069490 tx=0x7ff2dc02a160 comp rx=0 tx=0).stop 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 -- 172.21.15.134:0/2474402515 shutdown_connections 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/2474402515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec1622e0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/2474402515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec06ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/2474402515 >> v2:172.21.15.177:3300/0 conn(0x7ff2ec15c300 0x7ff2ec0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 -- 172.21.15.134:0/2474402515 >> 172.21.15.134:0/2474402515 conn(0x7ff2ec06cae0 msgr2=0x7ff2ec06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 -- 172.21.15.134:0/2474402515 shutdown_connections 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.197+0000 7ff2f08dd640 1 -- 172.21.15.134:0/2474402515 wait complete. 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.198+0000 7ff2f08dd640 1 Processor -- start 2024-09-15T22:48:35.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.198+0000 7ff2f08dd640 1 -- start start 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2ec15c300 0x7ff2ec0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec071880 con 0x7ff2ec06f010 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec15f850 con 0x7ff2ec15c300 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2f08dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec0b0500 con 0x7ff2ec0cd300 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53176/0 (socket says 172.21.15.134:53176) 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 -- 172.21.15.134:0/162274378 learned_addr learned my addr 172.21.15.134:0/162274378 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ead9d640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2ec15c300 0x7ff2ec0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2e9d9b640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 -- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 msgr2=0x7ff2ec0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 -- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2ec15c300 msgr2=0x7ff2ec0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2ec15c300 0x7ff2ec0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 -- 172.21.15.134:0/162274378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1f8040 con 0x7ff2ec06f010 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2e9d9b640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.199+0000 7ff2ea59c640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400ba50 tx=0x7ff2e400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.200+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4019070 con 0x7ff2ec06f010 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.200+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e400cc00 con 0x7ff2ec06f010 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.200+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec1f8320 con 0x7ff2ec06f010 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.200+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4014440 con 0x7ff2ec06f010 2024-09-15T22:48:35.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.200+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1f88e0 con 0x7ff2ec06f010 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.201+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec06ead0 con 0x7ff2ec06f010 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.201+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) ==== 91611+0+0 (secure 0 0 0) 0x7ff2e401c070 con 0x7ff2ec06f010 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.202+0000 7ff2e2ffd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 0x7ff2cc06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.202+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7ff2e4089970 con 0x7ff2ec06f010 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.202+0000 7ff2e9d9b640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 0x7ff2cc06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.202+0000 7ff2e9d9b640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 0x7ff2cc06efe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec15eb30 tx=0x7ff2d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.206+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2e4059540 con 0x7ff2ec06f010 2024-09-15T22:48:35.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.318+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7ff2e4055bb0 con 0x7ff2ec06f010 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.389+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2ec076040 con 0x7ff2ec06f010 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.389+0000 7ff2e2ffd640 1 -- 172.21.15.134:0/162274378 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v158) ==== 80+0+0 (secure 0 0 0) 0x7ff2e405ee20 con 0x7ff2ec06f010 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 msgr2=0x7ff2cc06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 0x7ff2cc06efe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec15eb30 tx=0x7ff2d4008040 comp rx=0 tx=0).stop 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 msgr2=0x7ff2ec14a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400ba50 tx=0x7ff2e400bf10 comp rx=0 tx=0).stop 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 shutdown_connections 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2ec15c300 0x7ff2ec0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2ec0cd300 0x7ff2ec0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff2cc06cb20 0x7ff2cc06efe0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 --2- 172.21.15.134:0/162274378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2ec06f010 0x7ff2ec14a8e0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 >> 172.21.15.134:0/162274378 conn(0x7ff2ec06cae0 msgr2=0x7ff2ec074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 shutdown_connections 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.391+0000 7ff2f08dd640 1 -- 172.21.15.134:0/162274378 wait complete. 2024-09-15T22:48:35.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:48:35.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:35.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:35.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:48:35.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:35.446 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:48:35.502 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:35.502 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:35.502 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:35.520 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:35.520 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:35.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:48:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.676+0000 7f99eb3a6640 1 Processor -- start 2024-09-15T22:48:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.676+0000 7f99eb3a6640 1 -- start start 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99eb3a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99e40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99eb3a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f99e415ca40 0x7f99e415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99eb3a6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e40d0bc0 con 0x7f99e415ce80 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99eb3a6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f99e415d390 con 0x7f99e415ca40 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99eb3a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99e415d670 con 0x7f99e40d02a0 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99e9943640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f99e415ce80 0x7f99e41594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50912/0 (socket says 172.21.15.134:50912) 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99e9943640 1 -- 172.21.15.134:0/2079691784 learned_addr learned my addr 172.21.15.134:0/2079691784 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:35.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99e8941640 1 --2- 172.21.15.134:0/2079691784 >> v2:172.21.15.177:3300/0 conn(0x7f99e415ca40 0x7f99e415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99e9142640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99e40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854084557 0 0) 0x7f99e40d0bc0 con 0x7f99e415ce80 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99d0003520 con 0x7f99e415ce80 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2860641878 0 0) 0x7f99d0003520 con 0x7f99e415ce80 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 msgr2=0x7f99e40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99e40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 >> v2:172.21.15.177:3300/0 conn(0x7f99e415ca40 msgr2=0x7f99e415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 --2- 172.21.15.134:0/2079691784 >> v2:172.21.15.177:3300/0 conn(0x7f99e415ca40 0x7f99e415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e415d950 con 0x7f99e415ce80 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f99dc0019f0 con 0x7f99e415ce80 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.677+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 >> v1:172.21.15.134:6789/0 conn(0x7f99e415ce80 legacy=0x7f99e41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99d0004d40 0x7f99d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99e415d390 con 0x7f99d00039b0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99e415d670 con 0x7f99d0004d40 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99d000b9c0 con 0x7f99e40d02a0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9943640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99d0004d40 0x7f99d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e8941640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 -- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 msgr2=0x7f99d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e40d02a0 0x7f99d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 -- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99d0004d40 msgr2=0x7f99d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99d0004d40 0x7f99d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.678+0000 7f99e9142640 1 -- 172.21.15.134:0/2079691784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d0003520 con 0x7f99d00039b0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99e9142640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009ac0 tx=0x7f99d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3fa884c9a64637 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0036070 con 0x7f99d00039b0 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e0031400 con 0x7f99d00039b0 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99dbfff640 1 -- 172.21.15.134:0/2079691784 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0009690 con 0x7f99d00039b0 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2079691784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 msgr2=0x7f99d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2079691784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009ac0 tx=0x7f99d0005830 comp rx=0 tx=0).stop 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99e9943640 1 -- 172.21.15.134:0/2079691784 reap_dead start 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2079691784 shutdown_connections 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2079691784 >> 172.21.15.134:0/2079691784 conn(0x7f99e4062cc0 msgr2=0x7f99e406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2079691784 shutdown_connections 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.679+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2079691784 wait complete. 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 Processor -- start 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 -- start start 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 0x7f99e40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 0x7f99e40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99e4155b90 con 0x7f99d00039b0 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99e415df10 con 0x7f99e4156c90 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99eb3a6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f99e4155d10 con 0x7f99e4156810 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99e9142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99e9142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53188/0 (socket says 172.21.15.134:53188) 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.681+0000 7f99e9142640 1 -- 172.21.15.134:0/2157088934 learned_addr learned my addr 172.21.15.134:0/2157088934 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9943640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 0x7f99e40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e8941640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 0x7f99e40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 -- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 msgr2=0x7f99e40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 0x7f99e40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 -- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 msgr2=0x7f99e40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 0x7f99e40cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 -- 172.21.15.134:0/2157088934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e41571f0 con 0x7f99d00039b0 2024-09-15T22:48:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9943640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 0x7f99e40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e8941640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 0x7f99e40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99e9142640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034040 tx=0x7f99e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0040020 con 0x7f99d00039b0 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e0003bc0 con 0x7f99d00039b0 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e41574d0 con 0x7f99d00039b0 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0036040 con 0x7f99d00039b0 2024-09-15T22:48:35.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.682+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e415ab80 con 0x7f99d00039b0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.683+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e40b4790 con 0x7f99d00039b0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.684+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f99e0043020 con 0x7f99d00039b0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.684+0000 7f99d9ffb640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 0x7f99c806f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.684+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f99e00aa010 con 0x7f99d00039b0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.684+0000 7f99e8941640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 0x7f99c806f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.685+0000 7f99e8941640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 0x7f99c806f130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cd520 tx=0x7f99d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.688+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99e004a030 con 0x7f99d00039b0 2024-09-15T22:48:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.864+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f99e4154e90 con 0x7f99d00039b0 2024-09-15T22:48:35.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.864+0000 7f99d9ffb640 1 -- 172.21.15.134:0/2157088934 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v158) ==== 80+0+0 (secure 0 0 0) 0x7f99e00044e0 con 0x7f99d00039b0 2024-09-15T22:48:35.866 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:48:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 msgr2=0x7f99c806f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 0x7f99c806f130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cd520 tx=0x7f99d4008040 comp rx=0 tx=0).stop 2024-09-15T22:48:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 msgr2=0x7f99e414cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034040 tx=0x7f99e0004730 comp rx=0 tx=0).stop 2024-09-15T22:48:35.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 shutdown_connections 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99e4156c90 0x7f99e40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f99e4156810 0x7f99e40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f99c806cc70 0x7f99c806f130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 --2- 172.21.15.134:0/2157088934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d00039b0 0x7f99e414cf70 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.866+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 >> 172.21.15.134:0/2157088934 conn(0x7f99e4062cc0 msgr2=0x7f99e40ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.867+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 shutdown_connections 2024-09-15T22:48:35.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:35.867+0000 7f99eb3a6640 1 -- 172.21.15.134:0/2157088934 wait complete. 2024-09-15T22:48:35.879 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:48:35.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:35.880 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:35.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:48:35.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:35.913 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:48:35.973 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:35.973 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:35.973 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:35.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:35.989 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:48:35.990 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:35.990 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:36.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:36.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:36.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.128+0000 7fb44a99f640 1 Processor -- start 2024-09-15T22:48:36.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.128+0000 7fb44a99f640 1 -- start start 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb44a99f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 0x7fb4440cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb44a99f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb444073120 0x7fb444073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb44a99f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4440ce740 con 0x7fb44415c180 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb44a99f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb444072640 con 0x7fb444073120 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb44a99f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb444072920 con 0x7fb4440cf070 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb444073120 0x7fb444073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb444073120 0x7fb444073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53204/0 (socket says 172.21.15.134:53204) 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 -- 172.21.15.134:0/2111460593 learned_addr learned my addr 172.21.15.134:0/2111460593 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:36.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb4437fe640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 0x7fb4440cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 -- 172.21.15.134:0/2111460593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 msgr2=0x7fb4440cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 0x7fb4440cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 -- 172.21.15.134:0/2111460593 >> v1:172.21.15.177:6789/0 conn(0x7fb44415c180 legacy=0x7fb4440cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb448f3c640 1 -- 172.21.15.134:0/2111460593 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444072c00 con 0x7fb444073120 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.129+0000 7fb4437fe640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 0x7fb4440cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:36.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.130+0000 7fb448f3c640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb444073590 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fb44406f430 tx=0x7fb43c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a017a3206194c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.130+0000 7fb442ffd640 1 -- 172.21.15.134:0/2111460593 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c036070 con 0x7fb444073120 2024-09-15T22:48:36.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.130+0000 7fb442ffd640 1 -- 172.21.15.134:0/2111460593 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43c031400 con 0x7fb444073120 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.130+0000 7fb442ffd640 1 -- 172.21.15.134:0/2111460593 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0317d0 con 0x7fb444073120 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 -- 172.21.15.134:0/2111460593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 msgr2=0x7fb444073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb444073590 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fb44406f430 tx=0x7fb43c02a610 comp rx=0 tx=0).stop 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 -- 172.21.15.134:0/2111460593 shutdown_connections 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb444073590 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 --2- 172.21.15.134:0/2111460593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4440cf070 0x7fb4440cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 -- 172.21.15.134:0/2111460593 >> 172.21.15.134:0/2111460593 conn(0x7fb444062cc0 msgr2=0x7fb44406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 -- 172.21.15.134:0/2111460593 shutdown_connections 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.131+0000 7fb44a99f640 1 -- 172.21.15.134:0/2111460593 wait complete. 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.132+0000 7fb44a99f640 1 Processor -- start 2024-09-15T22:48:36.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.132+0000 7fb44a99f640 1 -- start start 2024-09-15T22:48:36.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 0x7fb44415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 0x7fb44414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440722f0 con 0x7fb444073120 2024-09-15T22:48:36.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440ced00 con 0x7fb4440cf070 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb44a99f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb44415c560 con 0x7fb44415c180 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53216/0 (socket says 172.21.15.134:53216) 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 -- 172.21.15.134:0/1805319040 learned_addr learned my addr 172.21.15.134:0/1805319040 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb448f3c640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 0x7fb44414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb4437fe640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 0x7fb44415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 -- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 msgr2=0x7fb44414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 0x7fb44414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 -- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 msgr2=0x7fb44415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 0x7fb44415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 -- 172.21.15.134:0/1805319040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44414e4b0 con 0x7fb444073120 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb4437fe640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 0x7fb44415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:36.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb448f3c640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 0x7fb44414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.133+0000 7fb443fff640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c430 tx=0x7fb43400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.134+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434011790 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.134+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb434017070 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.134+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434011b70 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.134+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4440b1a40 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.134+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4440b2000 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.135+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4440b2200 con 0x7fb444073120 2024-09-15T22:48:36.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.135+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fb434011d10 con 0x7fb444073120 2024-09-15T22:48:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.136+0000 7fb440ff9640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 0x7fb43006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.136+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fb434089a10 con 0x7fb444073120 2024-09-15T22:48:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.136+0000 7fb4437fe640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 0x7fb43006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.137+0000 7fb4437fe640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 0x7fb43006f100 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.140+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4440b2200 con 0x7fb444073120 2024-09-15T22:48:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.342+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4440cf4b0 con 0x7fb444073120 2024-09-15T22:48:36.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.342+0000 7fb440ff9640 1 -- 172.21.15.134:0/1805319040 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5236 (secure 0 0 0) 0x7fb434059d80 con 0x7fb444073120 2024-09-15T22:48:36.344 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:36.344 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":83,"btime":"2024-09-15T22:48:31:291811+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:36.344 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 83 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 msgr2=0x7fb43006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 0x7fb43006f100 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).stop 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 msgr2=0x7fb44415d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c430 tx=0x7fb43400c8f0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 shutdown_connections 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb44415c180 0x7fb44414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4440cf070 0x7fb44415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb43006cc40 0x7fb43006f100 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 --2- 172.21.15.134:0/1805319040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444073120 0x7fb44415d650 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.344+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 >> 172.21.15.134:0/1805319040 conn(0x7fb444062cc0 msgr2=0x7fb4441577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.345+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 shutdown_connections 2024-09-15T22:48:36.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.345+0000 7fb44a99f640 1 -- 172.21.15.134:0/1805319040 wait complete. 2024-09-15T22:48:36.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:36.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 Processor -- start 2024-09-15T22:48:36.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 -- start start 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f904c15c180 0x7f904c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0ce230 0x7f904c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904c0cf5b0 0x7f904c073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f904c0ce740 con 0x7f904c15c180 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f904c072640 con 0x7f904c0cf5b0 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.455+0000 7f90527f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f904c072920 con 0x7f904c0ce230 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f904c15c180 0x7f904c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f904c15c180 0x7f904c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52296/0 (socket says 172.21.15.134:52296) 2024-09-15T22:48:36.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 -- 172.21.15.134:0/4238992559 learned_addr learned my addr 172.21.15.134:0/4238992559 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f9050d93640 1 --2- 172.21.15.134:0/4238992559 >> v2:172.21.15.177:3300/0 conn(0x7f904c0cf5b0 0x7f904c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f9043fff640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0ce230 0x7f904c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 -- 172.21.15.134:0/4238992559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0ce230 msgr2=0x7f904c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0ce230 0x7f904c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 -- 172.21.15.134:0/4238992559 >> v2:172.21.15.177:3300/0 conn(0x7f904c0cf5b0 msgr2=0x7f904c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 --2- 172.21.15.134:0/4238992559 >> v2:172.21.15.177:3300/0 conn(0x7f904c0cf5b0 0x7f904c073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.456+0000 7f904bfff640 1 -- 172.21.15.134:0/4238992559 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c072c00 con 0x7f904c15c180 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f904bfff640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c0cdcf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f904c0afe30 tx=0x7f903c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dfcac10d71b5da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f904b7fe640 1 -- 172.21.15.134:0/4238992559 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c037070 con 0x7f904c15c180 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f904b7fe640 1 -- 172.21.15.134:0/4238992559 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c032440 con 0x7f904c15c180 2024-09-15T22:48:36.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f904b7fe640 1 -- 172.21.15.134:0/4238992559 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c032810 con 0x7f904c15c180 2024-09-15T22:48:36.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 -- 172.21.15.134:0/4238992559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 msgr2=0x7f904c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c0cdcf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f904c0afe30 tx=0x7f903c02a140 comp rx=0 tx=0).stop 2024-09-15T22:48:36.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 -- 172.21.15.134:0/4238992559 shutdown_connections 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 --2- 172.21.15.134:0/4238992559 >> v2:172.21.15.177:3300/0 conn(0x7f904c0cf5b0 0x7f904c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0ce230 0x7f904c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 --2- 172.21.15.134:0/4238992559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c0cdcf0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 -- 172.21.15.134:0/4238992559 >> 172.21.15.134:0/4238992559 conn(0x7f904c062cc0 msgr2=0x7f904c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 -- 172.21.15.134:0/4238992559 shutdown_connections 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.457+0000 7f90527f6640 1 -- 172.21.15.134:0/4238992559 wait complete. 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 Processor -- start 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 -- start start 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0ce230 0x7f904c150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0cf5b0 0x7f904c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f904c15c560 con 0x7f904c15c180 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f904c0722f0 con 0x7f904c0ce230 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.459+0000 7f90527f6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f904c15c6e0 con 0x7f904c0cf5b0 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52304/0 (socket says 172.21.15.134:52304) 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 -- 172.21.15.134:0/2273599854 learned_addr learned my addr 172.21.15.134:0/2273599854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f904bfff640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0ce230 0x7f904c150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9043fff640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0cf5b0 0x7f904c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 -- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0cf5b0 msgr2=0x7f904c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0cf5b0 0x7f904c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 -- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0ce230 msgr2=0x7f904c150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0ce230 0x7f904c150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 -- 172.21.15.134:0/2273599854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c15fc80 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f9050d93640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9044007d40 tx=0x7f904400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044014420 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9044019070 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044014820 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c15ff60 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.460+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c160520 con 0x7f904c15c180 2024-09-15T22:48:36.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.461+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c0cf070 con 0x7f904c15c180 2024-09-15T22:48:36.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.462+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f90440149c0 con 0x7f904c15c180 2024-09-15T22:48:36.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.462+0000 7f90497fa640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 0x7f902c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.462+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f904408a1b0 con 0x7f904c15c180 2024-09-15T22:48:36.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.462+0000 7f904bfff640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 0x7f902c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.463+0000 7f904bfff640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 0x7f902c06f100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f903c034000 tx=0x7f903c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.466+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9044059ed0 con 0x7f904c15c180 2024-09-15T22:48:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.665+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f904c156c80 con 0x7f904c15c180 2024-09-15T22:48:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.666+0000 7f90497fa640 1 -- 172.21.15.134:0/2273599854 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5236 (secure 0 0 0) 0x7f904405e1d0 con 0x7f904c15c180 2024-09-15T22:48:36.668 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:36.668 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":83,"btime":"2024-09-15T22:48:31:291811+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:36.668 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 83 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 msgr2=0x7f902c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 0x7f902c06f100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f903c034000 tx=0x7f903c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 msgr2=0x7f904c15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9044007d40 tx=0x7f904400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 shutdown_connections 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f902c06cc40 0x7f902c06f100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f904c15c180 0x7f904c15a250 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904c0cf5b0 0x7f904c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 --2- 172.21.15.134:0/2273599854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0ce230 0x7f904c150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 >> 172.21.15.134:0/2273599854 conn(0x7f904c062cc0 msgr2=0x7f904c1581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 shutdown_connections 2024-09-15T22:48:36.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.668+0000 7f90527f6640 1 -- 172.21.15.134:0/2273599854 wait complete. 2024-09-15T22:48:36.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:36.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.777+0000 7f16dffff640 1 Processor -- start 2024-09-15T22:48:36.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.777+0000 7f16dffff640 1 -- start start 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16dffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f16e00d0c10 0x7f16e015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16dffff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e00b59c0 con 0x7f16e006e7d0 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16dffff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e00b5ca0 con 0x7f16e0073950 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16dffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f16e00b5f80 con 0x7f16e00d0c10 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16deffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f16e006e7d0 0x7f16e00cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36970/0 (socket says 172.21.15.134:36970) 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16deffd640 1 -- 172.21.15.134:0/1740921814 learned_addr learned my addr 172.21.15.134:0/1740921814 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16df7fe640 1 --2- 172.21.15.134:0/1740921814 >> v2:172.21.15.177:3300/0 conn(0x7f16e00d0c10 0x7f16e015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248456066 0 0) 0x7f16e00b59c0 con 0x7f16e006e7d0 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16cc003520 con 0x7f16e006e7d0 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328869507 0 0) 0x7f16e00b5ca0 con 0x7f16e0073950 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16e00b59c0 con 0x7f16e0073950 2024-09-15T22:48:36.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16df7fe640 1 -- 172.21.15.134:0/1740921814 >> v1:172.21.15.177:6789/0 conn(0x7f16e0073950 legacy=0x7f16e00d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959274865 0 0) 0x7f16cc003520 con 0x7f16e006e7d0 2024-09-15T22:48:36.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16df7fe640 1 -- 172.21.15.134:0/1740921814 >> v1:172.21.15.134:6789/0 conn(0x7f16e006e7d0 legacy=0x7f16e00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.778+0000 7f16df7fe640 1 -- 172.21.15.134:0/1740921814 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00b6260 con 0x7f16e00d0c10 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.779+0000 7f16df7fe640 1 --2- 172.21.15.134:0/1740921814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e015f1b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009d90 tx=0x7f16d802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8222f47d8138b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.779+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0001670 con 0x7f16e00d0c10 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.779+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8007540 con 0x7f16e00d0c10 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.779+0000 7f16de7fc640 1 -- 172.21.15.134:0/1740921814 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8007910 con 0x7f16e00d0c10 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 -- 172.21.15.134:0/1740921814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 msgr2=0x7f16e015f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 --2- 172.21.15.134:0/1740921814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e015f1b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009d90 tx=0x7f16d802a680 comp rx=0 tx=0).stop 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 -- 172.21.15.134:0/1740921814 shutdown_connections 2024-09-15T22:48:36.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 --2- 172.21.15.134:0/1740921814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e015f1b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 -- 172.21.15.134:0/1740921814 >> 172.21.15.134:0/1740921814 conn(0x7f16e00b6700 msgr2=0x7f16e00b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 -- 172.21.15.134:0/1740921814 shutdown_connections 2024-09-15T22:48:36.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.780+0000 7f16dffff640 1 -- 172.21.15.134:0/1740921814 wait complete. 2024-09-15T22:48:36.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.781+0000 7f16dffff640 1 Processor -- start 2024-09-15T22:48:36.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.781+0000 7f16dffff640 1 -- start start 2024-09-15T22:48:36.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16e006e7d0 0x7f16e0159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e00aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00ce9b0 con 0x7f16e0073950 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0073ea0 con 0x7f16e00d0c10 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16dffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f16e014f0a0 con 0x7f16e006e7d0 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52312/0 (socket says 172.21.15.134:52312) 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 -- 172.21.15.134:0/4167046795 learned_addr learned my addr 172.21.15.134:0/4167046795 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 -- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16e006e7d0 msgr2=0x7f16e0159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16e006e7d0 0x7f16e0159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16df7fe640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e00aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 -- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 msgr2=0x7f16e00aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e00aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 -- 172.21.15.134:0/4167046795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00ab6c0 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d67fc640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c490 tx=0x7f16c800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.782+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c80052d0 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.783+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c8005470 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.783+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8012870 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.783+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00ab9a0 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.783+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00ab3d0 con 0x7f16e0073950 2024-09-15T22:48:36.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.783+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e00abec0 con 0x7f16e0073950 2024-09-15T22:48:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.784+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f16c8012a10 con 0x7f16e0073950 2024-09-15T22:48:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.785+0000 7f16d7fff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 0x7f16c006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.785+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f16c80897f0 con 0x7f16e0073950 2024-09-15T22:48:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.785+0000 7f16deffd640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 0x7f16c006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.785+0000 7f16deffd640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 0x7f16c006f100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001340 tx=0x7f16d0000f50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:36.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.789+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16e00abec0 con 0x7f16e0073950 2024-09-15T22:48:36.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.956+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16e00cf090 con 0x7f16e0073950 2024-09-15T22:48:36.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.957+0000 7f16d7fff640 1 -- 172.21.15.134:0/4167046795 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+16808 (secure 0 0 0) 0x7f16c8059b60 con 0x7f16e0073950 2024-09-15T22:48:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:36.959 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":158,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:20.131700+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:16.826530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:17.445065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:36.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 msgr2=0x7f16c006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 0x7f16c006f100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001340 tx=0x7f16d0000f50 comp rx=0 tx=0).stop 2024-09-15T22:48:36.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 msgr2=0x7f16e014eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:36.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c490 tx=0x7f16c800c950 comp rx=0 tx=0).stop 2024-09-15T22:48:36.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 shutdown_connections 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e00d0c10 0x7f16e00aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f16c006cc40 0x7f16c006f100 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0073950 0x7f16e014eb60 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 --2- 172.21.15.134:0/4167046795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16e006e7d0 0x7f16e0159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.959+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 >> 172.21.15.134:0/4167046795 conn(0x7f16e00b6700 msgr2=0x7f16e00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.960+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 shutdown_connections 2024-09-15T22:48:36.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:36.960+0000 7f16dffff640 1 -- 172.21.15.134:0/4167046795 wait complete. 2024-09-15T22:48:36.973 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:48:36.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:37.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.072+0000 7f645ab9f640 1 Processor -- start 2024-09-15T22:48:37.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.072+0000 7f645ab9f640 1 -- start start 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645ab9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64540cf400 0x7f64540d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645ab9f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64540d3840 con 0x7f64540d14c0 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645ab9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64540d3b20 con 0x7f645415e3f0 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645ab9f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f64540d3e00 con 0x7f64540cf400 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645939c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64540cf400 0x7f64540d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645a39e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f64540d14c0 0x7f64540d48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36972/0 (socket says 172.21.15.134:36972) 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645a39e640 1 -- 172.21.15.134:0/569250548 learned_addr learned my addr 172.21.15.134:0/569250548 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645939c640 1 -- 172.21.15.134:0/569250548 >> v1:172.21.15.177:6789/0 conn(0x7f645415e3f0 legacy=0x7f64540b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f645939c640 1 -- 172.21.15.134:0/569250548 >> v1:172.21.15.134:6789/0 conn(0x7f64540d14c0 legacy=0x7f64540d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.074+0000 7f645939c640 1 -- 172.21.15.134:0/569250548 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64540d40e0 con 0x7f64540cf400 2024-09-15T22:48:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.073+0000 7f6458b9b640 1 -- 172.21.15.134:0/569250548 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482834495 0 0) 0x7f64540d3840 con 0x7f64540d14c0 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.074+0000 7f645939c640 1 --2- 172.21.15.134:0/569250548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64540cf400 0x7f64540d3260 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f64440097d0 tx=0x7f644402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccf90bc6b13ae90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.074+0000 7f6458b9b640 1 -- 172.21.15.134:0/569250548 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444037070 con 0x7f64540cf400 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.074+0000 7f6458b9b640 1 -- 172.21.15.134:0/569250548 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444032440 con 0x7f64540cf400 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.074+0000 7f6458b9b640 1 -- 172.21.15.134:0/569250548 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444032810 con 0x7f64540cf400 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 -- 172.21.15.134:0/569250548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64540cf400 msgr2=0x7f64540d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 --2- 172.21.15.134:0/569250548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64540cf400 0x7f64540d3260 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f64440097d0 tx=0x7f644402a210 comp rx=0 tx=0).stop 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 -- 172.21.15.134:0/569250548 shutdown_connections 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 --2- 172.21.15.134:0/569250548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64540cf400 0x7f64540d3260 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 -- 172.21.15.134:0/569250548 >> 172.21.15.134:0/569250548 conn(0x7f6454062a20 msgr2=0x7f6454062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 -- 172.21.15.134:0/569250548 shutdown_connections 2024-09-15T22:48:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.075+0000 7f645ab9f640 1 -- 172.21.15.134:0/569250548 wait complete. 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.076+0000 7f645ab9f640 1 Processor -- start 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.076+0000 7f645ab9f640 1 -- start start 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64540cf400 0x7f64540cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64540d14c0 0x7f64540cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64540cb300 con 0x7f645415e3f0 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f64540b7cb0 con 0x7f64540cf400 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f645415e7d0 con 0x7f64540d14c0 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52344/0 (socket says 172.21.15.134:52344) 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 -- 172.21.15.134:0/2095157864 learned_addr learned my addr 172.21.15.134:0/2095157864 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:37.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f6459b9d640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64540cf400 0x7f64540cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 -- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64540d14c0 msgr2=0x7f64540cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64540d14c0 0x7f64540cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 -- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64540cf400 msgr2=0x7f64540cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64540cf400 0x7f64540cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 -- 172.21.15.134:0/2095157864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6454149e60 con 0x7f645415e3f0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645a39e640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c7d0 tx=0x7f644c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c018070 con 0x7f645415e3f0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644c00a640 con 0x7f645415e3f0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64540ccf20 con 0x7f645415e3f0 2024-09-15T22:48:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.077+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c00aa70 con 0x7f645415e3f0 2024-09-15T22:48:37.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.078+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64540cd4e0 con 0x7f645415e3f0 2024-09-15T22:48:37.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.079+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64540d3260 con 0x7f645415e3f0 2024-09-15T22:48:37.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.079+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f644c01b070 con 0x7f645415e3f0 2024-09-15T22:48:37.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.079+0000 7f644a7fc640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 0x7f643806f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.080+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f644c089150 con 0x7f645415e3f0 2024-09-15T22:48:37.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.080+0000 7f6459b9d640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 0x7f643806f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.080+0000 7f6459b9d640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 0x7f643806f130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f645000a750 tx=0x7f6450008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.084+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6454149e60 con 0x7f645415e3f0 2024-09-15T22:48:37.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.285+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64540d0260 con 0x7f645415e3f0 2024-09-15T22:48:37.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.285+0000 7f644a7fc640 1 -- 172.21.15.134:0/2095157864 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5236 (secure 0 0 0) 0x7f644c0594c0 con 0x7f645415e3f0 2024-09-15T22:48:37.287 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:37.287 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":83,"btime":"2024-09-15T22:48:31:291811+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:37.287 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 83 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 msgr2=0x7f643806f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 0x7f643806f130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f645000a750 tx=0x7f6450008040 comp rx=0 tx=0).stop 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 msgr2=0x7f6454149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c7d0 tx=0x7f644c00cc90 comp rx=0 tx=0).stop 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 shutdown_connections 2024-09-15T22:48:37.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f643806cc70 0x7f643806f130 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645415e3f0 0x7f6454149920 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64540d14c0 0x7f64540cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 --2- 172.21.15.134:0/2095157864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64540cf400 0x7f64540cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 >> 172.21.15.134:0/2095157864 conn(0x7f6454062a20 msgr2=0x7f6454074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 shutdown_connections 2024-09-15T22:48:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.288+0000 7f645ab9f640 1 -- 172.21.15.134:0/2095157864 wait complete. 2024-09-15T22:48:37.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.397+0000 7f538cd4b640 1 Processor -- start 2024-09-15T22:48:37.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.397+0000 7f538cd4b640 1 -- start start 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.398+0000 7f538cd4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.398+0000 7f538cd4b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.398+0000 7f538cd4b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538815c9c0 con 0x7f53881600e0 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.398+0000 7f538cd4b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5388074100 con 0x7f53880b6d50 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.398+0000 7f538cd4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f53880b76d0 con 0x7f538815c5e0 2024-09-15T22:48:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f5385d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f5385d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53192/0 (socket says 172.21.15.134:53192) 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:47130/0 (socket says 172.21.15.134:47130) 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f5385d9b640 1 -- 172.21.15.134:0/1316812215 learned_addr learned my addr 172.21.15.134:0/1316812215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f5386d9d640 1 --1- 172.21.15.134:0/1316812215 >> v1:172.21.15.177:6789/0 conn(0x7f53881600e0 0x7f5388160590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:47986/0 (socket says 172.21.15.134:47986) 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 -- 172.21.15.134:0/1316812215 >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 msgr2=0x7f53880b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 --2- 172.21.15.134:0/1316812215 >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 -- 172.21.15.134:0/1316812215 >> v1:172.21.15.177:6789/0 conn(0x7f53881600e0 legacy=0x7f5388160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f538659c640 1 -- 172.21.15.134:0/1316812215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880b1dd0 con 0x7f538815c5e0 2024-09-15T22:48:37.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.399+0000 7f5385d9b640 1 --2- 172.21.15.134:0/1316812215 >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:37.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.400+0000 7f538659c640 1 --2- 172.21.15.134:0/1316812215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5378009d90 tx=0x7f537802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96c284251e12aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.400+0000 7f538559a640 1 -- 172.21.15.134:0/1316812215 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378007740 con 0x7f538815c5e0 2024-09-15T22:48:37.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.400+0000 7f538559a640 1 -- 172.21.15.134:0/1316812215 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53780078e0 con 0x7f538815c5e0 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.400+0000 7f538559a640 1 -- 172.21.15.134:0/1316812215 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378007cb0 con 0x7f538815c5e0 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 -- 172.21.15.134:0/1316812215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 msgr2=0x7f53880712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 --2- 172.21.15.134:0/1316812215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5378009d90 tx=0x7f537802a660 comp rx=0 tx=0).stop 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 -- 172.21.15.134:0/1316812215 shutdown_connections 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 --2- 172.21.15.134:0/1316812215 >> v2:172.21.15.177:3300/0 conn(0x7f53880b6d50 0x7f53880b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 --2- 172.21.15.134:0/1316812215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f538815c5e0 0x7f53880712b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 -- 172.21.15.134:0/1316812215 >> 172.21.15.134:0/1316812215 conn(0x7f53880b4220 msgr2=0x7f53880b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 -- 172.21.15.134:0/1316812215 shutdown_connections 2024-09-15T22:48:37.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.401+0000 7f538cd4b640 1 -- 172.21.15.134:0/1316812215 wait complete. 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.402+0000 7f538cd4b640 1 Processor -- start 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.402+0000 7f538cd4b640 1 -- start start 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538815c5e0 0x7f53881f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 0x7f53881f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5388073ab0 con 0x7f53880b6d50 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53880737d0 con 0x7f538815c5e0 2024-09-15T22:48:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538cd4b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5388073d90 con 0x7f53881600e0 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52346/0 (socket says 172.21.15.134:52346) 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 -- 172.21.15.134:0/3540077513 learned_addr learned my addr 172.21.15.134:0/3540077513 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f5385d9b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538815c5e0 0x7f53881f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f5386d9d640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 0x7f53881f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 -- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 msgr2=0x7f53881f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 0x7f53881f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 -- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538815c5e0 msgr2=0x7f53881f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538815c5e0 0x7f53881f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 -- 172.21.15.134:0/3540077513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53881f2fc0 con 0x7f53880b6d50 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f5386d9d640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 0x7f53881f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.403+0000 7f538659c640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5378009d90 tx=0x7f5378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.404+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378040070 con 0x7f53880b6d50 2024-09-15T22:48:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.404+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378031c40 con 0x7f53880b6d50 2024-09-15T22:48:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.404+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53881f32a0 con 0x7f53880b6d50 2024-09-15T22:48:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.404+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378009450 con 0x7f53880b6d50 2024-09-15T22:48:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.404+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538814f680 con 0x7f53880b6d50 2024-09-15T22:48:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.405+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5388069190 con 0x7f53880b6d50 2024-09-15T22:48:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.405+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f5378039040 con 0x7f53880b6d50 2024-09-15T22:48:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.406+0000 7f5376ffd640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 0x7f536806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.406+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f53780ab520 con 0x7f53880b6d50 2024-09-15T22:48:37.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.406+0000 7f5385d9b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 0x7f536806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.406+0000 7f5385d9b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 0x7f536806f100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53880d1de0 tx=0x7f537c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.410+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f537807b240 con 0x7f53880b6d50 2024-09-15T22:48:37.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.610+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5388073130 con 0x7f53880b6d50 2024-09-15T22:48:37.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.611+0000 7f5376ffd640 1 -- 172.21.15.134:0/3540077513 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5236 (secure 0 0 0) 0x7f537807f540 con 0x7f53880b6d50 2024-09-15T22:48:37.612 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:37.612 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":83,"btime":"2024-09-15T22:48:31:291811+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:18.472630+0000","modified":"2024-09-15T22:48:20.471600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"b","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1298493121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1298493121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1298493121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8670,"qdb_cluster":[8670]},"id":12}]} 2024-09-15T22:48:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 83 2024-09-15T22:48:37.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 msgr2=0x7f536806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 0x7f536806f100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53880d1de0 tx=0x7f537c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:37.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 msgr2=0x7f538815b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5378009d90 tx=0x7f5378004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 shutdown_connections 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53881600e0 0x7f53881f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538815c5e0 0x7f53881f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f536806cc40 0x7f536806f100 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 --2- 172.21.15.134:0/3540077513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53880b6d50 0x7f538815b400 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 >> 172.21.15.134:0/3540077513 conn(0x7f53880b4220 msgr2=0x7f53880708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 shutdown_connections 2024-09-15T22:48:37.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.613+0000 7f538cd4b640 1 -- 172.21.15.134:0/3540077513 wait complete. 2024-09-15T22:48:37.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:37.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.722+0000 7f59a1d23640 1 Processor -- start 2024-09-15T22:48:37.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.722+0000 7f59a1d23640 1 -- start start 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f599c15c180 0x7f599c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f599c0cf5b0 0x7f599c073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0ce740 con 0x7f599c15c180 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f599c072640 con 0x7f599c0cf5b0 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f59a1d23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f599c072920 con 0x7f599c0ce230 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f599c15c180 0x7f599c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f599c15c180 0x7f599c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52350/0 (socket says 172.21.15.134:52350) 2024-09-15T22:48:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 -- 172.21.15.134:0/1581994538 learned_addr learned my addr 172.21.15.134:0/1581994538 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 -- 172.21.15.134:0/1581994538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 msgr2=0x7f599c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1581994538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 -- 172.21.15.134:0/1581994538 >> v2:172.21.15.177:3300/0 conn(0x7f599c0cf5b0 msgr2=0x7f599c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1581994538 >> v2:172.21.15.177:3300/0 conn(0x7f599c0cf5b0 0x7f599c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.723+0000 7f599b7fe640 1 -- 172.21.15.134:0/1581994538 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c072c00 con 0x7f599c15c180 2024-09-15T22:48:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.724+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1581994538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c0cdcf0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f599c0afe30 tx=0x7f598c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80306febd774ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.724+0000 7f599a7fc640 1 -- 172.21.15.134:0/1581994538 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c037070 con 0x7f599c15c180 2024-09-15T22:48:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.724+0000 7f599a7fc640 1 -- 172.21.15.134:0/1581994538 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c032440 con 0x7f599c15c180 2024-09-15T22:48:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.724+0000 7f599a7fc640 1 -- 172.21.15.134:0/1581994538 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c032810 con 0x7f599c15c180 2024-09-15T22:48:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 -- 172.21.15.134:0/1581994538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 msgr2=0x7f599c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1581994538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c0cdcf0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f599c0afe30 tx=0x7f598c02a160 comp rx=0 tx=0).stop 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 -- 172.21.15.134:0/1581994538 shutdown_connections 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1581994538 >> v2:172.21.15.177:3300/0 conn(0x7f599c0cf5b0 0x7f599c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1581994538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1581994538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c0cdcf0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 -- 172.21.15.134:0/1581994538 >> 172.21.15.134:0/1581994538 conn(0x7f599c062cc0 msgr2=0x7f599c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 -- 172.21.15.134:0/1581994538 shutdown_connections 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.725+0000 7f59a1d23640 1 -- 172.21.15.134:0/1581994538 wait complete. 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.726+0000 7f59a1d23640 1 Processor -- start 2024-09-15T22:48:37.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.726+0000 7f59a1d23640 1 -- start start 2024-09-15T22:48:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599c0cf5b0 0x7f599c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f599c15c560 con 0x7f599c15c180 2024-09-15T22:48:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f599c0722f0 con 0x7f599c0cf5b0 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f59a1d23640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f599c15c6e0 con 0x7f599c0ce230 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52364/0 (socket says 172.21.15.134:52364) 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 -- 172.21.15.134:0/1709020824 learned_addr learned my addr 172.21.15.134:0/1709020824 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599affd640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599c0cf5b0 0x7f599c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 -- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 msgr2=0x7f599c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 -- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599c0cf5b0 msgr2=0x7f599c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.727+0000 7f599bfff640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599c0cf5b0 0x7f599c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f599bfff640 1 -- 172.21.15.134:0/1709020824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0b4380 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f599bfff640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f599400b9e0 tx=0x7f599400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994019070 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599400cac0 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c0b35c0 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994014440 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.728+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c0b3b80 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.729+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c0736f0 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.729+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f599401c070 con 0x7f599c15c180 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.730+0000 7f5983fff640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 0x7f598806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.730+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7f59940897d0 con 0x7f599c15c180 2024-09-15T22:48:37.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.730+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 0x7f598806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.731+0000 7f599b7fe640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 0x7f598806f100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f598c034000 tx=0x7f598c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.734+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59940594f0 con 0x7f599c15c180 2024-09-15T22:48:37.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.900+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f599c156b60 con 0x7f599c15c180 2024-09-15T22:48:37.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.901+0000 7f5983fff640 1 -- 172.21.15.134:0/1709020824 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+16808 (secure 0 0 0) 0x7f599405d7f0 con 0x7f599c15c180 2024-09-15T22:48:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:37.903 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":158,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:20.131700+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:16.826530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:17.445065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 msgr2=0x7f598806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 0x7f598806f100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f598c034000 tx=0x7f598c02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 msgr2=0x7f599c150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f599400b9e0 tx=0x7f599400bea0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 shutdown_connections 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f598806cc40 0x7f598806f100 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599c15c180 0x7f599c150400 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599c0cf5b0 0x7f599c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 --2- 172.21.15.134:0/1709020824 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f599c0ce230 0x7f599c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.903+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 >> 172.21.15.134:0/1709020824 conn(0x7f599c062cc0 msgr2=0x7f599c0cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.904+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 shutdown_connections 2024-09-15T22:48:37.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:37.904+0000 7f59a1d23640 1 -- 172.21.15.134:0/1709020824 wait complete. 2024-09-15T22:48:37.916 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:48:38.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.014+0000 7fc2eef33640 1 Processor -- start 2024-09-15T22:48:38.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.014+0000 7fc2eef33640 1 -- start start 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.014+0000 7fc2eef33640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2e806be10 0x7fc2e80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.014+0000 7fc2eef33640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2e8151c50 0x7fc2e815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2eef33640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e80cd5f0 con 0x7fc2e806c1f0 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2eef33640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e80cd8d0 con 0x7fc2e8151c50 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2eef33640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e80cdbb0 con 0x7fc2e806be10 2024-09-15T22:48:38.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2e8151c50 0x7fc2e815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2e8151c50 0x7fc2e815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52378/0 (socket says 172.21.15.134:52378) 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 -- 172.21.15.134:0/2215816674 learned_addr learned my addr 172.21.15.134:0/2215816674 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ecccf640 1 --2- 172.21.15.134:0/2215816674 >> v2:172.21.15.177:3300/0 conn(0x7fc2e806be10 0x7fc2e80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 -- 172.21.15.134:0/2215816674 >> v2:172.21.15.177:3300/0 conn(0x7fc2e806be10 msgr2=0x7fc2e80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 --2- 172.21.15.134:0/2215816674 >> v2:172.21.15.177:3300/0 conn(0x7fc2e806be10 0x7fc2e80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 -- 172.21.15.134:0/2215816674 >> v1:172.21.15.177:6789/0 conn(0x7fc2e806c1f0 legacy=0x7fc2e8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.015+0000 7fc2ed4d0640 1 -- 172.21.15.134:0/2215816674 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e80cde90 con 0x7fc2e8151c50 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2ed4d0640 1 --2- 172.21.15.134:0/2215816674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8151c50 0x7fc2e815baa0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc2e806f180 tx=0x7fc2e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb098fc4956e493 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2e77fe640 1 -- 172.21.15.134:0/2215816674 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0036070 con 0x7fc2e8151c50 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2e77fe640 1 -- 172.21.15.134:0/2215816674 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e0031600 con 0x7fc2e8151c50 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2e77fe640 1 -- 172.21.15.134:0/2215816674 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00319d0 con 0x7fc2e8151c50 2024-09-15T22:48:38.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 -- 172.21.15.134:0/2215816674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8151c50 msgr2=0x7fc2e815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 --2- 172.21.15.134:0/2215816674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8151c50 0x7fc2e815baa0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc2e806f180 tx=0x7fc2e002a6f0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 -- 172.21.15.134:0/2215816674 shutdown_connections 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 --2- 172.21.15.134:0/2215816674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8151c50 0x7fc2e815baa0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 --2- 172.21.15.134:0/2215816674 >> v2:172.21.15.177:3300/0 conn(0x7fc2e806be10 0x7fc2e80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 -- 172.21.15.134:0/2215816674 >> 172.21.15.134:0/2215816674 conn(0x7fc2e8062cc0 msgr2=0x7fc2e806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 -- 172.21.15.134:0/2215816674 shutdown_connections 2024-09-15T22:48:38.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.016+0000 7fc2eef33640 1 -- 172.21.15.134:0/2215816674 wait complete. 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 Processor -- start 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 -- start start 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2e806c1f0 0x7fc2e8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2e8151c50 0x7fc2e8159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e80d0310 con 0x7fc2e806be10 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e80ce690 con 0x7fc2e8151c50 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.018+0000 7fc2eef33640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e80d0490 con 0x7fc2e806c1f0 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52390/0 (socket says 172.21.15.134:52390) 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 -- 172.21.15.134:0/3374208697 learned_addr learned my addr 172.21.15.134:0/3374208697 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 -- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2e806c1f0 msgr2=0x7fc2e8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2e806c1f0 0x7fc2e8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 -- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2e8151c50 msgr2=0x7fc2e8159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2e8151c50 0x7fc2e8159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 -- 172.21.15.134:0/3374208697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e813ae90 con 0x7fc2e806be10 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2ecccf640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00d800 tx=0x7fc2dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00b6c0 con 0x7fc2e806be10 2024-09-15T22:48:38.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc019070 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e813b170 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00ba80 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.019+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e8153d90 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.020+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e80d07f0 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.021+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fc2dc00bc20 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.021+0000 7fc2e57fa640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 0x7fc2cc06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.021+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5765+0+0 (secure 0 0 0) 0x7fc2dc08a100 con 0x7fc2e806be10 2024-09-15T22:48:38.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.021+0000 7fc2e7fff640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 0x7fc2cc06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.022+0000 7fc2e7fff640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 0x7fc2cc06f100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8159e50 tx=0x7fc2d40079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.025+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2dc05a3f0 con 0x7fc2e806be10 2024-09-15T22:48:38.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.222+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc2e815b630 con 0x7fc2e806be10 2024-09-15T22:48:38.224 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:48:38.223+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:48:38.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.224+0000 7fc2e57fa640 1 -- 172.21.15.134:0/3374208697 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7fc2dc059cf0 con 0x7fc2e806be10 2024-09-15T22:48:38.226 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:48:38.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.226+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 msgr2=0x7fc2cc06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 0x7fc2cc06f100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8159e50 tx=0x7fc2d40079b0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 msgr2=0x7fc2e8165ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00d800 tx=0x7fc2dc00dcc0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 shutdown_connections 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2e8151c50 0x7fc2e8159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2e806c1f0 0x7fc2e8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc2cc06cc40 0x7fc2cc06f100 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 --2- 172.21.15.134:0/3374208697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e806be10 0x7fc2e8165ff0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 >> 172.21.15.134:0/3374208697 conn(0x7fc2e8062cc0 msgr2=0x7fc2e80b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 shutdown_connections 2024-09-15T22:48:38.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.227+0000 7fc2eef33640 1 -- 172.21.15.134:0/3374208697 wait complete. 2024-09-15T22:48:38.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:48:38.269 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:48:38.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.339+0000 7fc67cbf6640 1 Processor -- start 2024-09-15T22:48:38.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.339+0000 7fc67cbf6640 1 -- start start 2024-09-15T22:48:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc67cbf6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc67815d790 0x7fc6780cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc67cbf6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67806d700 con 0x7fc6780cd3b0 2024-09-15T22:48:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc67cbf6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6780cde80 con 0x7fc67815d3b0 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc67cbf6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fc67806da30 con 0x7fc67815d790 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc676d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc6780cd3b0 0x7fc6780cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36984/0 (socket says 172.21.15.134:36984) 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.340+0000 7fc676d9d640 1 -- 172.21.15.134:0/2652312835 learned_addr learned my addr 172.21.15.134:0/2652312835 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc675d9b640 1 --2- 172.21.15.134:0/2652312835 >> v2:172.21.15.177:3300/0 conn(0x7fc67815d790 0x7fc6780cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133453252 0 0) 0x7fc67806d700 con 0x7fc6780cd3b0 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc664003520 con 0x7fc6780cd3b0 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1619200477 0 0) 0x7fc664003520 con 0x7fc6780cd3b0 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 >> v2:172.21.15.177:3300/0 conn(0x7fc67815d790 msgr2=0x7fc6780cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 --2- 172.21.15.134:0/2652312835 >> v2:172.21.15.177:3300/0 conn(0x7fc67815d790 0x7fc6780cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 >> v1:172.21.15.177:6789/0 conn(0x7fc67815d3b0 legacy=0x7fc678071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6780cd8c0 con 0x7fc6780cd3b0 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fc670001670 con 0x7fc6780cd3b0 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 >> v1:172.21.15.134:6789/0 conn(0x7fc6780cd3b0 legacy=0x7fc6780cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 0x7fc664003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc664004800 0x7fc664004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640051c0 0x7fc66400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc67806da30 con 0x7fc6640039b0 2024-09-15T22:48:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc66400c060 con 0x7fc6640051c0 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc66400c260 con 0x7fc664004800 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 0x7fc664003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc676d9d640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640051c0 0x7fc66400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc675d9b640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc664004800 0x7fc664004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 -- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc664004800 msgr2=0x7fc664004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc664004800 0x7fc664004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 -- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640051c0 msgr2=0x7fc66400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640051c0 0x7fc66400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc67659c640 1 -- 172.21.15.134:0/2652312835 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc664003520 con 0x7fc6640039b0 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc676d9d640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640051c0 0x7fc66400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.341+0000 7fc676d9d640 1 -- 172.21.15.134:0/2652312835 reap_dead start 2024-09-15T22:48:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.342+0000 7fc67659c640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 0x7fc664003dd0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fc668001e50 tx=0x7fc664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adc3afb55da192e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.342+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668001a70 con 0x7fc6640039b0 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.342+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66802ae40 con 0x7fc6640039b0 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.342+0000 7fc67559a640 1 -- 172.21.15.134:0/2652312835 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668003bb0 con 0x7fc6640039b0 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 -- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 msgr2=0x7fc664003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 0x7fc664003dd0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fc668001e50 tx=0x7fc664005830 comp rx=0 tx=0).stop 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 -- 172.21.15.134:0/2652312835 shutdown_connections 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/2652312835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6640039b0 0x7fc664003dd0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 -- 172.21.15.134:0/2652312835 >> 172.21.15.134:0/2652312835 conn(0x7fc67806bba0 msgr2=0x7fc67806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:38.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 -- 172.21.15.134:0/2652312835 shutdown_connections 2024-09-15T22:48:38.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.343+0000 7fc67cbf6640 1 -- 172.21.15.134:0/2652312835 wait complete. 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.344+0000 7fc67cbf6640 1 Processor -- start 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.344+0000 7fc67cbf6640 1 -- start start 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640039b0 0x7fc678145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 0x7fc6781f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc67815cd70 con 0x7fc6781e6f10 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc67815cbf0 con 0x7fc6640039b0 2024-09-15T22:48:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67cbf6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fc6780cce70 con 0x7fc6781f2420 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52396/0 (socket says 172.21.15.134:52396) 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 -- 172.21.15.134:0/1902326673 learned_addr learned my addr 172.21.15.134:0/1902326673 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc67659c640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640039b0 0x7fc678145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc676d9d640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 0x7fc6781f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 -- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 msgr2=0x7fc6781f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 0x7fc6781f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 -- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640039b0 msgr2=0x7fc678145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640039b0 0x7fc678145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:38.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 -- 172.21.15.134:0/1902326673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6781e5e70 con 0x7fc6781e6f10 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc676d9d640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 0x7fc6781f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.345+0000 7fc675d9b640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc6600115d0 tx=0x7fc660011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660019070 con 0x7fc6781e6f10 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc660005da0 con 0x7fc6781e6f10 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6781e6150 con 0x7fc6781e6f10 2024-09-15T22:48:38.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660006270 con 0x7fc6781e6f10 2024-09-15T22:48:38.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6781e6710 con 0x7fc6781e6f10 2024-09-15T22:48:38.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.346+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67806c4b0 con 0x7fc6781e6f10 2024-09-15T22:48:38.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.347+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fc66001c070 con 0x7fc6781e6f10 2024-09-15T22:48:38.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.347+0000 7fc66effd640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 0x7fc65806f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:38.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.348+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5851+0+0 (secure 0 0 0) 0x7fc660089f20 con 0x7fc6781e6f10 2024-09-15T22:48:38.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.348+0000 7fc67659c640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 0x7fc65806f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:38.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.348+0000 7fc67659c640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 0x7fc65806f130 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc668032000 tx=0x7fc66802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:38.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.352+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc67806c4b0 con 0x7fc6781e6f10 2024-09-15T22:48:38.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:38.555+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc678071080 con 0x7fc6781e6f10 2024-09-15T22:48:39.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.226+0000 7fc66effd640 1 -- 172.21.15.134:0/1902326673 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) ==== 104+0+0 (secure 0 0 0) 0x7fc660059c40 con 0x7fc6781e6f10 2024-09-15T22:48:39.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 msgr2=0x7fc65806f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 0x7fc65806f130 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc668032000 tx=0x7fc66802e000 comp rx=0 tx=0).stop 2024-09-15T22:48:39.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 msgr2=0x7fc6781e7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc6600115d0 tx=0x7fc660011a90 comp rx=0 tx=0).stop 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 shutdown_connections 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6781f2420 0x7fc6781f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fc65806cc70 0x7fc65806f130 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6781e6f10 0x7fc6781e7390 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 --2- 172.21.15.134:0/1902326673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6640039b0 0x7fc678145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 >> 172.21.15.134:0/1902326673 conn(0x7fc67806bba0 msgr2=0x7fc6781566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 shutdown_connections 2024-09-15T22:48:39.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.229+0000 7fc67cbf6640 1 -- 172.21.15.134:0/1902326673 wait complete. 2024-09-15T22:48:39.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.347+0000 7f3240e27640 1 Processor -- start 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.347+0000 7f3240e27640 1 -- start start 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3240e27640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f323c0cf5d0 0x7f323c0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3240e27640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c0b4240 con 0x7f323c145d90 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3240e27640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c0b4520 con 0x7f323c06d4f0 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3240e27640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f323c06d080 con 0x7f323c0cf5d0 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3239d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f323c0cf5d0 0x7f323c0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f323a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f323c145d90 0x7f323c0ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36988/0 (socket says 172.21.15.134:36988) 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f323a59c640 1 -- 172.21.15.134:0/3986082907 learned_addr learned my addr 172.21.15.134:0/3986082907 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3239d9b640 1 -- 172.21.15.134:0/3986082907 >> v1:172.21.15.177:6789/0 conn(0x7f323c06d4f0 legacy=0x7f323c06d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f3239d9b640 1 -- 172.21.15.134:0/3986082907 >> v1:172.21.15.134:6789/0 conn(0x7f323c145d90 legacy=0x7f323c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.348+0000 7f323959a640 1 -- 172.21.15.134:0/3986082907 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253590284 0 0) 0x7f323c0b4240 con 0x7f323c145d90 2024-09-15T22:48:39.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.349+0000 7f3239d9b640 1 -- 172.21.15.134:0/3986082907 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c0b4800 con 0x7f323c0cf5d0 2024-09-15T22:48:39.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.349+0000 7f3239d9b640 1 --2- 172.21.15.134:0/3986082907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c0cfa40 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f323002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0706b248765902 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.349+0000 7f323959a640 1 -- 172.21.15.134:0/3986082907 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230037070 con 0x7f323c0cf5d0 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.349+0000 7f323959a640 1 -- 172.21.15.134:0/3986082907 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230032440 con 0x7f323c0cf5d0 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.349+0000 7f323959a640 1 -- 172.21.15.134:0/3986082907 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230032810 con 0x7f323c0cf5d0 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 -- 172.21.15.134:0/3986082907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 msgr2=0x7f323c0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 --2- 172.21.15.134:0/3986082907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c0cfa40 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f323002a1e0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 -- 172.21.15.134:0/3986082907 shutdown_connections 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 --2- 172.21.15.134:0/3986082907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c0cfa40 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 -- 172.21.15.134:0/3986082907 >> 172.21.15.134:0/3986082907 conn(0x7f323c06bba0 msgr2=0x7f323c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 -- 172.21.15.134:0/3986082907 shutdown_connections 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.350+0000 7f3240e27640 1 -- 172.21.15.134:0/3986082907 wait complete. 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.351+0000 7f3240e27640 1 Processor -- start 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.351+0000 7f3240e27640 1 -- start start 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 0x7f323c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f323c145d90 0x7f323c15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0cd660 con 0x7f323c0cf5d0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0cff80 con 0x7f323c145d90 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3240e27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f323c0b5610 con 0x7f323c06d4f0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3239d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3239d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52424/0 (socket says 172.21.15.134:52424) 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f3239d9b640 1 -- 172.21.15.134:0/723229525 learned_addr learned my addr 172.21.15.134:0/723229525 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f323a59c640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 0x7f323c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.352+0000 7f323ad9d640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f323c145d90 0x7f323c15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 -- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 msgr2=0x7f323c1f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 0x7f323c1f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 -- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f323c145d90 msgr2=0x7f323c15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f323c145d90 0x7f323c15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 -- 172.21.15.134:0/723229525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c13c550 con 0x7f323c0cf5d0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f323a59c640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 0x7f323c1f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3239d9b640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f32300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230037040 con 0x7f323c0cf5d0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230004250 con 0x7f323c0cf5d0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c13c7f0 con 0x7f323c0cf5d0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230032e20 con 0x7f323c0cf5d0 2024-09-15T22:48:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.353+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c15e290 con 0x7f323c0cf5d0 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.354+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323c13cbe0 con 0x7f323c0cf5d0 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.354+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f3230030770 con 0x7f323c0cf5d0 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.355+0000 7f322affd640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 0x7f321c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.355+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5851+0+0 (secure 0 0 0) 0x7f32300aae30 con 0x7f323c0cf5d0 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.355+0000 7f323a59c640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 0x7f321c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.355+0000 7f323a59c640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 0x7f321c06f100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f322c0012e0 tx=0x7f322c007f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.359+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f323007b1a0 con 0x7f323c0cf5d0 2024-09-15T22:48:39.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:39.522+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f323c146170 con 0x7f323c0cf5d0 2024-09-15T22:48:40.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.329+0000 7f322affd640 1 -- 172.21.15.134:0/723229525 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v160) ==== 181+0+0 (secure 0 0 0) 0x7f323007aaa0 con 0x7f323c0cf5d0 2024-09-15T22:48:40.330 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:48:40.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 msgr2=0x7f321c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 0x7f321c06f100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f322c0012e0 tx=0x7f322c007f90 comp rx=0 tx=0).stop 2024-09-15T22:48:40.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 msgr2=0x7f323c13c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f32300046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 shutdown_connections 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f323c145d90 0x7f323c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f321c06cc40 0x7f321c06f100 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c0cf5d0 0x7f323c13c010 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 --2- 172.21.15.134:0/723229525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f323c06d4f0 0x7f323c1f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 >> 172.21.15.134:0/723229525 conn(0x7f323c06bba0 msgr2=0x7f323c0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 shutdown_connections 2024-09-15T22:48:40.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.332+0000 7f3240e27640 1 -- 172.21.15.134:0/723229525 wait complete. 2024-09-15T22:48:40.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:48:40.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.449+0000 7f040fcaf640 1 Processor -- start 2024-09-15T22:48:40.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.449+0000 7f040fcaf640 1 -- start start 2024-09-15T22:48:40.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040fcaf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f0408072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040fcaf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040815c970 con 0x7f040806f130 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040fcaf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040815bbb0 con 0x7f040815b370 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040fcaf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f040815fef0 con 0x7f040815f9f0 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040d24a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f040806f130 0x7f04080ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36990/0 (socket says 172.21.15.134:36990) 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.450+0000 7f040d24a640 1 -- 172.21.15.134:0/472773270 learned_addr learned my addr 172.21.15.134:0/472773270 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f0408072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089427474 0 0) 0x7f040815c970 con 0x7f040806f130 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f4003520 con 0x7f040806f130 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22334830 0 0) 0x7f03f4003520 con 0x7f040806f130 2024-09-15T22:48:40.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 msgr2=0x7f0408072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f0408072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 >> v1:172.21.15.177:6789/0 conn(0x7f040815b370 legacy=0x7f040806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040815be90 con 0x7f040806f130 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f03f8001670 con 0x7f040806f130 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 >> v1:172.21.15.134:6789/0 conn(0x7f040806f130 legacy=0x7f04080ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f03f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4003f60 0x7f03f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03f4004d40 0x7f03f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f040815fef0 con 0x7f03f4004d40 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03f400bb50 con 0x7f03f4003f60 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f03f400bd50 con 0x7f040815f9f0 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03f4004d40 0x7f03f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040da4b640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f03f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040d24a640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4003f60 0x7f03f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 -- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 msgr2=0x7f03f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f040815f9f0 0x7f03f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 -- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4003f60 msgr2=0x7f03f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4003f60 0x7f03f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.451+0000 7f040e24c640 1 -- 172.21.15.134:0/472773270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f4003520 con 0x7f03f4004d40 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.452+0000 7f040e24c640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03f4004d40 0x7f03f40051c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f04080d0010 tx=0x7f03f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09732b0eaa7fc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.452+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400036070 con 0x7f03f4004d40 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.452+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400031400 con 0x7f03f4004d40 2024-09-15T22:48:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.452+0000 7f040ca49640 1 -- 172.21.15.134:0/472773270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400009690 con 0x7f03f4004d40 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 -- 172.21.15.134:0/472773270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03f4004d40 msgr2=0x7f03f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 --2- 172.21.15.134:0/472773270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03f4004d40 0x7f03f40051c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f04080d0010 tx=0x7f03f4005830 comp rx=0 tx=0).stop 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040e24c640 1 -- 172.21.15.134:0/472773270 reap_dead start 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 -- 172.21.15.134:0/472773270 shutdown_connections 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 -- 172.21.15.134:0/472773270 >> 172.21.15.134:0/472773270 conn(0x7f040806bba0 msgr2=0x7f040806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 -- 172.21.15.134:0/472773270 shutdown_connections 2024-09-15T22:48:40.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.453+0000 7f040fcaf640 1 -- 172.21.15.134:0/472773270 wait complete. 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.454+0000 7f040fcaf640 1 Processor -- start 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.454+0000 7f040fcaf640 1 -- start start 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 0x7f04080b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04080aee20 0x7f0408152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04080731b0 con 0x7f04081f7880 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f040815c450 con 0x7f03f4004d40 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f040815b750 con 0x7f04080aee20 2024-09-15T22:48:40.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52438/0 (socket says 172.21.15.134:52438) 2024-09-15T22:48:40.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 -- 172.21.15.134:0/2631790238 learned_addr learned my addr 172.21.15.134:0/2631790238 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:40.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040e24c640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04080aee20 0x7f0408152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040da4b640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 0x7f04080b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 -- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04080aee20 msgr2=0x7f0408152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04080aee20 0x7f0408152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 -- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 msgr2=0x7f04080b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 0x7f04080b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 -- 172.21.15.134:0/2631790238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040814f6c0 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040da4b640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 0x7f04080b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040d24a640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e820 tx=0x7f03f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f800c870 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8018070 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040814f9a0 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f800cc50 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.455+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04080b29b0 con 0x7f04081f7880 2024-09-15T22:48:40.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.457+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0408072560 con 0x7f04081f7880 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.457+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f03f801d460 con 0x7f04081f7880 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.457+0000 7f03fe7fc640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 0x7f03ec06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.458+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5413+0+0 (secure 0 0 0) 0x7f03f8089980 con 0x7f04081f7880 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.458+0000 7f040da4b640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 0x7f03ec06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.458+0000 7f040da4b640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 0x7f03ec06f100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0404003fc0 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:40.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.462+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03f8059cf0 con 0x7f04081f7880 2024-09-15T22:48:40.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:40.629+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04080af200 con 0x7f04081f7880 2024-09-15T22:48:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.335+0000 7f03fe7fc640 1 -- 172.21.15.134:0/2631790238 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v161) ==== 169+0+0 (secure 0 0 0) 0x7f03f80595f0 con 0x7f04081f7880 2024-09-15T22:48:41.336 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:48:41.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 msgr2=0x7f03ec06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 0x7f03ec06f100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0404003fc0 tx=0x7f0404009040 comp rx=0 tx=0).stop 2024-09-15T22:48:41.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 msgr2=0x7f04080ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e820 tx=0x7f03f800ece0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 shutdown_connections 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04080aee20 0x7f0408152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f03ec06cc40 0x7f03ec06f100 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04081f7880 0x7f04080ae8e0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 --2- 172.21.15.134:0/2631790238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f4004d40 0x7f04080b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 >> 172.21.15.134:0/2631790238 conn(0x7f040806bba0 msgr2=0x7f04080b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.339+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 shutdown_connections 2024-09-15T22:48:41.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.340+0000 7f040fcaf640 1 -- 172.21.15.134:0/2631790238 wait complete. 2024-09-15T22:48:41.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:48:41.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 Processor -- start 2024-09-15T22:48:41.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 -- start start 2024-09-15T22:48:41.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98f4161e30 0x7f98f40d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 0x7f98f40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f40cf9a0 con 0x7f98f40b3d50 2024-09-15T22:48:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f98f40cfcf0 con 0x7f98f4161e30 2024-09-15T22:48:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.465+0000 7f98fa598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98f4162210 con 0x7f98f406dfd0 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98f4161e30 0x7f98f40d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98f4161e30 0x7f98f40d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52448/0 (socket says 172.21.15.134:52448) 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f37fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f98f40b3d50 0x7f98f406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36998/0 (socket says 172.21.15.134:36998) 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 -- 172.21.15.134:0/1701299713 learned_addr learned my addr 172.21.15.134:0/1701299713 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f8b35640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 0x7f98f40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 -- 172.21.15.134:0/1701299713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 msgr2=0x7f98f40b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 0x7f98f40b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 -- 172.21.15.134:0/1701299713 >> v1:172.21.15.134:6789/0 conn(0x7f98f40b3d50 legacy=0x7f98f406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f3fff640 1 -- 172.21.15.134:0/1701299713 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f40d5210 con 0x7f98f4161e30 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f2ffd640 1 -- 172.21.15.134:0/1701299713 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033561431 0 0) 0x7f98f40cf9a0 con 0x7f98f40b3d50 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.466+0000 7f98f8b35640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 0x7f98f40b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:41.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98f3fff640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f4161e30 0x7f98f40d34a0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf65dc711342f0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98f2ffd640 1 -- 172.21.15.134:0/1701299713 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4037070 con 0x7f98f4161e30 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98f2ffd640 1 -- 172.21.15.134:0/1701299713 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e4032440 con 0x7f98f4161e30 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98f2ffd640 1 -- 172.21.15.134:0/1701299713 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4032810 con 0x7f98f4161e30 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 -- 172.21.15.134:0/1701299713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f4161e30 msgr2=0x7f98f40d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f4161e30 0x7f98f40d34a0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e402a270 comp rx=0 tx=0).stop 2024-09-15T22:48:41.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 -- 172.21.15.134:0/1701299713 shutdown_connections 2024-09-15T22:48:41.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f406dfd0 0x7f98f40b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 --2- 172.21.15.134:0/1701299713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f4161e30 0x7f98f40d34a0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 -- 172.21.15.134:0/1701299713 >> 172.21.15.134:0/1701299713 conn(0x7f98f40d1870 msgr2=0x7f98f40d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 -- 172.21.15.134:0/1701299713 shutdown_connections 2024-09-15T22:48:41.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.467+0000 7f98fa598640 1 -- 172.21.15.134:0/1701299713 wait complete. 2024-09-15T22:48:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 Processor -- start 2024-09-15T22:48:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 -- start start 2024-09-15T22:48:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 0x7f98f4152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 0x7f98f40b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98f40d39e0 con 0x7f98f406dfd0 2024-09-15T22:48:41.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98f40b3950 con 0x7f98f40b3d50 2024-09-15T22:48:41.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.469+0000 7f98fa598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f98f40cb930 con 0x7f98f4161e30 2024-09-15T22:48:41.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52456/0 (socket says 172.21.15.134:52456) 2024-09-15T22:48:41.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 -- 172.21.15.134:0/1388101300 learned_addr learned my addr 172.21.15.134:0/1388101300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:41.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f8b35640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 0x7f98f40b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f37fe640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 0x7f98f4152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 -- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 msgr2=0x7f98f40b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 0x7f98f40b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 -- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 msgr2=0x7f98f4152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 0x7f98f4152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 -- 172.21.15.134:0/1388101300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f40cbba0 con 0x7f98f406dfd0 2024-09-15T22:48:41.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f8b35640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 0x7f98f40b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f37fe640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 0x7f98f4152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f3fff640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4041020 con 0x7f98f406dfd0 2024-09-15T22:48:41.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e40306c0 con 0x7f98f406dfd0 2024-09-15T22:48:41.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4037040 con 0x7f98f406dfd0 2024-09-15T22:48:41.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f40cbe80 con 0x7f98f406dfd0 2024-09-15T22:48:41.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.470+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f40cc440 con 0x7f98f406dfd0 2024-09-15T22:48:41.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.471+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f40b3290 con 0x7f98f406dfd0 2024-09-15T22:48:41.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.472+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f98e4044020 con 0x7f98f406dfd0 2024-09-15T22:48:41.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.472+0000 7f98f0ff9640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 0x7f98e006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.472+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7f98e40aa420 con 0x7f98f406dfd0 2024-09-15T22:48:41.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.472+0000 7f98f37fe640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 0x7f98e006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.473+0000 7f98f37fe640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 0x7f98e006f100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98e8007fd0 tx=0x7f98e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.476+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98e404b030 con 0x7f98f406dfd0 2024-09-15T22:48:41.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.640+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f98f4069190 con 0x7f98f406dfd0 2024-09-15T22:48:41.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.644+0000 7f98f0ff9640 1 -- 172.21.15.134:0/1388101300 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f98e407a790 con 0x7f98f406dfd0 2024-09-15T22:48:41.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 msgr2=0x7f98e006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 0x7f98e006f100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98e8007fd0 tx=0x7f98e8009040 comp rx=0 tx=0).stop 2024-09-15T22:48:41.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 msgr2=0x7f98f40cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e40046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 shutdown_connections 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98f4161e30 0x7f98f40b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98f40b3d50 0x7f98f4152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f98e006cc40 0x7f98e006f100 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 --2- 172.21.15.134:0/1388101300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f406dfd0 0x7f98f40cc960 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 >> 172.21.15.134:0/1388101300 conn(0x7f98f40d1870 msgr2=0x7f98f40b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 shutdown_connections 2024-09-15T22:48:41.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.646+0000 7f98fa598640 1 -- 172.21.15.134:0/1388101300 wait complete. 2024-09-15T22:48:41.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-15T22:48:41.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.773+0000 7f1785d68640 1 Processor -- start 2024-09-15T22:48:41.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.773+0000 7f1785d68640 1 -- start start 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f1785d68640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f178015baa0 0x7f178006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f1785d68640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1780151540 0x7f1780151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f1785d68640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1780151ec0 con 0x7f17800cd010 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f1785d68640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f17800d0a20 con 0x7f178015baa0 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f1785d68640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f17800cd5f0 con 0x7f1780151540 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f178015baa0 0x7f178006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f178015baa0 0x7f178006be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52458/0 (socket says 172.21.15.134:52458) 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 -- 172.21.15.134:0/1677629815 learned_addr learned my addr 172.21.15.134:0/1677629815 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177ffff640 1 --2- 172.21.15.134:0/1677629815 >> v2:172.21.15.177:3300/0 conn(0x7f1780151540 0x7f1780151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 -- 172.21.15.134:0/1677629815 >> v2:172.21.15.177:3300/0 conn(0x7f1780151540 msgr2=0x7f1780151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 --2- 172.21.15.134:0/1677629815 >> v2:172.21.15.177:3300/0 conn(0x7f1780151540 0x7f1780151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 -- 172.21.15.134:0/1677629815 >> v1:172.21.15.177:6789/0 conn(0x7f17800cd010 legacy=0x7f17800d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.774+0000 7f177effd640 1 -- 172.21.15.134:0/1677629815 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17800cd8d0 con 0x7f178015baa0 2024-09-15T22:48:41.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.775+0000 7f177effd640 1 --2- 172.21.15.134:0/1677629815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178006be10 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f17800b5980 tx=0x7f177402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95347ab17bf6b066 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.775+0000 7f177e7fc640 1 -- 172.21.15.134:0/1677629815 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774037070 con 0x7f178015baa0 2024-09-15T22:48:41.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.775+0000 7f177e7fc640 1 -- 172.21.15.134:0/1677629815 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774032440 con 0x7f178015baa0 2024-09-15T22:48:41.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.775+0000 7f177e7fc640 1 -- 172.21.15.134:0/1677629815 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774032810 con 0x7f178015baa0 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 -- 172.21.15.134:0/1677629815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 msgr2=0x7f178006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 --2- 172.21.15.134:0/1677629815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178006be10 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f17800b5980 tx=0x7f177402a270 comp rx=0 tx=0).stop 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 -- 172.21.15.134:0/1677629815 shutdown_connections 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 --2- 172.21.15.134:0/1677629815 >> v2:172.21.15.177:3300/0 conn(0x7f1780151540 0x7f1780151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 --2- 172.21.15.134:0/1677629815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178006be10 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 -- 172.21.15.134:0/1677629815 >> 172.21.15.134:0/1677629815 conn(0x7f1780062cc0 msgr2=0x7f178006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 -- 172.21.15.134:0/1677629815 shutdown_connections 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.776+0000 7f1785d68640 1 -- 172.21.15.134:0/1677629815 wait complete. 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.777+0000 7f1785d68640 1 Processor -- start 2024-09-15T22:48:41.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.777+0000 7f1785d68640 1 -- start start 2024-09-15T22:48:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17800cd010 0x7f1780144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1780151540 0x7f1780149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17800ce170 con 0x7f178015baa0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f17800cde90 con 0x7f17800cd010 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f1785d68640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f178015bf10 con 0x7f1780151540 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52470/0 (socket says 172.21.15.134:52470) 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 -- 172.21.15.134:0/2906483943 learned_addr learned my addr 172.21.15.134:0/2906483943 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177f7fe640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17800cd010 0x7f1780144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177effd640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1780151540 0x7f1780149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 -- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1780151540 msgr2=0x7f1780149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1780151540 0x7f1780149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 -- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17800cd010 msgr2=0x7f1780144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17800cd010 0x7f1780144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.778+0000 7f177ffff640 1 -- 172.21.15.134:0/2906483943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780073c70 con 0x7f178015baa0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f177ffff640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f177800cda0 tx=0x7f177800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778003b90 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1778003d30 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778004240 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1780148c90 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.779+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1780071f80 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.780+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17800ce690 con 0x7f178015baa0 2024-09-15T22:48:41.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.780+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f17780043e0 con 0x7f178015baa0 2024-09-15T22:48:41.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.781+0000 7f1767fff640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 0x7f176c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.781+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7f177808a4e0 con 0x7f178015baa0 2024-09-15T22:48:41.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.781+0000 7f177f7fe640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 0x7f176c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.781+0000 7f177f7fe640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 0x7f176c06f130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1780151c30 tx=0x7f1770009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:41.785+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1778090030 con 0x7f178015baa0 2024-09-15T22:48:42.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.015+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7f17800afd90 con 0x7f178015baa0 2024-09-15T22:48:42.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.336+0000 7f1767fff640 1 -- 172.21.15.134:0/2906483943 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v404) ==== 145+0+0 (secure 0 0 0) 0x7f177805a200 con 0x7f178015baa0 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.338+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 msgr2=0x7f176c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.338+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 0x7f176c06f130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1780151c30 tx=0x7f1770009040 comp rx=0 tx=0).stop 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.338+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 msgr2=0x7f178014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.338+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f177800cda0 tx=0x7f177800a660 comp rx=0 tx=0).stop 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 shutdown_connections 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f176c06cc70 0x7f176c06f130 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f178015baa0 0x7f178014a140 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1780151540 0x7f1780149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 --2- 172.21.15.134:0/2906483943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17800cd010 0x7f1780144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 >> 172.21.15.134:0/2906483943 conn(0x7f1780062cc0 msgr2=0x7f178006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:42.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 shutdown_connections 2024-09-15T22:48:42.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.339+0000 7f1785d68640 1 -- 172.21.15.134:0/2906483943 wait complete. 2024-09-15T22:48:42.351 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-15T22:48:42.352 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-15T22:48:42.352 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-15T22:48:42.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.449+0000 7fd2a71fd640 1 Processor -- start 2024-09-15T22:48:42.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.449+0000 7fd2a71fd640 1 -- start start 2024-09-15T22:48:42.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a71fd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd2a00b8f90 0x7fd2a00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a71fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a00b7170 con 0x7fd2a015e940 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a71fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a00b7aa0 con 0x7fd2a015ed20 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a71fd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a00d3660 con 0x7fd2a00b8f90 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a4f99640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd2a015e940 0x7fd2a00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37000/0 (socket says 172.21.15.134:37000) 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.450+0000 7fd2a4f99640 1 -- 172.21.15.134:0/3228554512 learned_addr learned my addr 172.21.15.134:0/3228554512 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd2a579a640 1 --2- 172.21.15.134:0/3228554512 >> v2:172.21.15.177:3300/0 conn(0x7fd2a00b8f90 0x7fd2a00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281127759 0 0) 0x7fd290001110 con 0x7fd2a015e940 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd288003520 con 0x7fd2a015e940 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 586482744 0 0) 0x7fd288003520 con 0x7fd2a015e940 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 >> v2:172.21.15.177:3300/0 conn(0x7fd2a00b8f90 msgr2=0x7fd2a00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:42.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 --2- 172.21.15.134:0/3228554512 >> v2:172.21.15.177:3300/0 conn(0x7fd2a00b8f90 0x7fd2a00b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 >> v1:172.21.15.177:6789/0 conn(0x7fd2a015ed20 legacy=0x7fd2a00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a00d3940 con 0x7fd2a015e940 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fd290001840 con 0x7fd2a015e940 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 >> v1:172.21.15.134:6789/0 conn(0x7fd2a015e940 legacy=0x7fd2a00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2880039b0 0x7fd288003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd288004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2880051c0 0x7fd28800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00d3660 con 0x7fd288004800 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd28800c070 con 0x7fd2880039b0 2024-09-15T22:48:42.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd28800c270 con 0x7fd2880051c0 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd288004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd2a4f99640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2880039b0 0x7fd288003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd2a579a640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2880051c0 0x7fd28800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 -- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2880051c0 msgr2=0x7fd28800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2880051c0 0x7fd28800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 -- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2880039b0 msgr2=0x7fd288003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2880039b0 0x7fd288003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd29ffff640 1 -- 172.21.15.134:0/3228554512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd288003520 con 0x7fd288004800 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.451+0000 7fd2a579a640 1 -- 172.21.15.134:0/3228554512 reap_dead start 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.452+0000 7fd29ffff640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd288004c80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd294001720 tx=0x7fd288005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494d60bfc8e49d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.452+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294001370 con 0x7fd288004800 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.452+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2940052d0 con 0x7fd288004800 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.452+0000 7fd29f7fe640 1 -- 172.21.15.134:0/3228554512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29402abc0 con 0x7fd288004800 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 -- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 msgr2=0x7fd288004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd288004c80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd294001720 tx=0x7fd288005830 comp rx=0 tx=0).stop 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 -- 172.21.15.134:0/3228554512 shutdown_connections 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/3228554512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd288004c80 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 -- 172.21.15.134:0/3228554512 >> 172.21.15.134:0/3228554512 conn(0x7fd2a00b6240 msgr2=0x7fd2a00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 -- 172.21.15.134:0/3228554512 shutdown_connections 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.453+0000 7fd2a71fd640 1 -- 172.21.15.134:0/3228554512 wait complete. 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.454+0000 7fd2a71fd640 1 Processor -- start 2024-09-15T22:48:42.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.454+0000 7fd2a71fd640 1 -- start start 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a01f5e30 0x7fd2a00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a00ae380 0x7fd2a01f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00d1ef0 con 0x7fd288004800 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00d3f00 con 0x7fd2a00ae380 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a71fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00d2070 con 0x7fd2a01f5e30 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52474/0 (socket says 172.21.15.134:52474) 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 -- 172.21.15.134:0/2618095452 learned_addr learned my addr 172.21.15.134:0/2618095452 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 -- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a01f5e30 msgr2=0x7fd2a00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a01f5e30 0x7fd2a00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 -- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a00ae380 msgr2=0x7fd2a01f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a00ae380 0x7fd2a01f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 -- 172.21.15.134:0/2618095452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a01f63f0 con 0x7fd288004800 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd2a4f99640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd290007290 tx=0x7fd290007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.455+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290001230 con 0x7fd288004800 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.456+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290018070 con 0x7fd288004800 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.456+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a01f66d0 con 0x7fd288004800 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.456+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29000fb80 con 0x7fd288004800 2024-09-15T22:48:42.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.456+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a01f6c90 con 0x7fd288004800 2024-09-15T22:48:42.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.457+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a00ae7a0 con 0x7fd288004800 2024-09-15T22:48:42.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.457+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fd29000fd20 con 0x7fd288004800 2024-09-15T22:48:42.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.458+0000 7fd29d7fa640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 0x7fd28c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.458+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7fd290089b00 con 0x7fd288004800 2024-09-15T22:48:42.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.458+0000 7fd29ffff640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 0x7fd28c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.458+0000 7fd29ffff640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 0x7fd28c06f130 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd294032000 tx=0x7fd29402c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.462+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2a00b7170 con 0x7fd288004800 2024-09-15T22:48:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.627+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2a00cf020 con 0x7fd288004800 2024-09-15T22:48:42.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.628+0000 7fd29d7fa640 1 -- 172.21.15.134:0/2618095452 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+13169 (secure 0 0 0) 0x7fd290059e70 con 0x7fd288004800 2024-09-15T22:48:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:42.630 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":161,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:41.330293+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1298493121":"2024-09-16T22:48:38.224137+0000","172.21.15.177:6833/1298493121":"2024-09-16T22:48:38.224137+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 msgr2=0x7fd28c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 0x7fd28c06f130 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd294032000 tx=0x7fd29402c000 comp rx=0 tx=0).stop 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 msgr2=0x7fd2a00ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd290007290 tx=0x7fd290007750 comp rx=0 tx=0).stop 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 shutdown_connections 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a00ae380 0x7fd2a01f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a01f5e30 0x7fd2a00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd28c06cc70 0x7fd28c06f130 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 --2- 172.21.15.134:0/2618095452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd288004800 0x7fd2a00ab4e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 >> 172.21.15.134:0/2618095452 conn(0x7fd2a00b6240 msgr2=0x7fd2a00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:42.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 shutdown_connections 2024-09-15T22:48:42.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.630+0000 7fd2a71fd640 1 -- 172.21.15.134:0/2618095452 wait complete. 2024-09-15T22:48:42.643 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:41:16.977182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:48:42.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:48:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.744+0000 7f05b8bcf640 1 Processor -- start 2024-09-15T22:48:42.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.744+0000 7f05b8bcf640 1 -- start start 2024-09-15T22:48:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.745+0000 7f05b8bcf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05b4155bb0 0x7f05b415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.745+0000 7f05b8bcf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b415c190 0x7f05b4070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.745+0000 7f05b8bcf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b415c7b0 con 0x7f05b406fda0 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.745+0000 7f05b8bcf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f05b4070740 con 0x7f05b4155bb0 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.745+0000 7f05b8bcf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f05b40cf770 con 0x7f05b415c190 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05b4155bb0 0x7f05b415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05b4155bb0 0x7f05b415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:53338/0 (socket says 172.21.15.134:53338) 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b2d9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b415c190 0x7f05b4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 -- 172.21.15.134:0/3892633748 learned_addr learned my addr 172.21.15.134:0/3892633748 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b1d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f05b406fda0 0x7f05b415ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48060/0 (socket says 172.21.15.134:48060) 2024-09-15T22:48:42.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 -- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b415c190 msgr2=0x7f05b4070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 --2- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b415c190 0x7f05b4070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 -- 172.21.15.134:0/3892633748 >> v1:172.21.15.177:6789/0 conn(0x7f05b406fda0 legacy=0x7f05b415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.746+0000 7f05b259c640 1 -- 172.21.15.134:0/3892633748 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b40cfa50 con 0x7f05b4155bb0 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.747+0000 7f05b259c640 1 --2- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b4155bb0 0x7f05b415ca90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e50 tx=0x7f05a402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592deac0c66800dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.747+0000 7f05b159a640 1 -- 172.21.15.134:0/3892633748 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4036070 con 0x7f05b4155bb0 2024-09-15T22:48:42.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.747+0000 7f05b159a640 1 -- 172.21.15.134:0/3892633748 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a4031600 con 0x7f05b4155bb0 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.747+0000 7f05b159a640 1 -- 172.21.15.134:0/3892633748 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40319d0 con 0x7f05b4155bb0 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b4155bb0 msgr2=0x7f05b415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b4155bb0 0x7f05b415ca90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e50 tx=0x7f05a402a710 comp rx=0 tx=0).stop 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3892633748 shutdown_connections 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b415c190 0x7f05b4070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3892633748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b4155bb0 0x7f05b415ca90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3892633748 >> 172.21.15.134:0/3892633748 conn(0x7f05b40b3380 msgr2=0x7f05b40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3892633748 shutdown_connections 2024-09-15T22:48:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.748+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3892633748 wait complete. 2024-09-15T22:48:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.749+0000 7f05b8bcf640 1 Processor -- start 2024-09-15T22:48:42.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.749+0000 7f05b8bcf640 1 -- start start 2024-09-15T22:48:42.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b406fda0 0x7f05b4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b4155bb0 0x7f05b41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05b415e030 con 0x7f05b415c190 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05b40cf480 con 0x7f05b406fda0 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b8bcf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f05b415e1b0 con 0x7f05b4155bb0 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52476/0 (socket says 172.21.15.134:52476) 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 -- 172.21.15.134:0/3395249779 learned_addr learned my addr 172.21.15.134:0/3395249779 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b259c640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b406fda0 0x7f05b4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b1d9b640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b4155bb0 0x7f05b41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 -- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b4155bb0 msgr2=0x7f05b41564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b4155bb0 0x7f05b41564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 -- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b406fda0 msgr2=0x7f05b4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b406fda0 0x7f05b4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 -- 172.21.15.134:0/3395249779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b4150e80 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.750+0000 7f05b2d9d640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e7f0 tx=0x7f05ac00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.751+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac017070 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.751+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac00ee40 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.751+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00cb80 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.751+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b4151160 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.751+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b414f6d0 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.752+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b4070200 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.752+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f05ac01a070 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.753+0000 7f05aaffd640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 0x7f059406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.753+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7f05ac089d40 con 0x7f05b415c190 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.753+0000 7f05b259c640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 0x7f059406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:42.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.753+0000 7f05b259c640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 0x7f059406f100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f05a4033000 tx=0x7f05a4009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:42.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.757+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05ac059a60 con 0x7f05b415c190 2024-09-15T22:48:42.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.922+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05b415f240 con 0x7f05b415c190 2024-09-15T22:48:42.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.922+0000 7f05aaffd640 1 -- 172.21.15.134:0/3395249779 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) ==== 93+0+10 (secure 0 0 0) 0x7f05ac05dd60 con 0x7f05b415c190 2024-09-15T22:48:42.925 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-09-15T22:48:42.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 msgr2=0x7f059406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 0x7f059406f100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f05a4033000 tx=0x7f05a4009000 comp rx=0 tx=0).stop 2024-09-15T22:48:42.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 msgr2=0x7f05b414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:42.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e7f0 tx=0x7f05ac00ebf0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 shutdown_connections 2024-09-15T22:48:42.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f059406cc40 0x7f059406f100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b415c190 0x7f05b414ff00 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b4155bb0 0x7f05b41564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 --2- 172.21.15.134:0/3395249779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b406fda0 0x7f05b4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 >> 172.21.15.134:0/3395249779 conn(0x7f05b40b3380 msgr2=0x7f05b415e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:42.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 shutdown_connections 2024-09-15T22:48:42.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:42.924+0000 7f05b8bcf640 1 -- 172.21.15.134:0/3395249779 wait complete. 2024-09-15T22:48:42.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:48:43.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.034+0000 7f737b11a640 1 Processor -- start 2024-09-15T22:48:43.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.034+0000 7f737b11a640 1 -- start start 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f737b11a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73740d02a0 0x7f73740d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f737b11a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73740d0bc0 con 0x7f737415ceb0 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f737b11a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f737415d390 con 0x7f737415ca40 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f737b11a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f737415d670 con 0x7f73740d02a0 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f7378eb6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73740d02a0 0x7f73740d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f73796b7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f737415ceb0 0x7f73741594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37002/0 (socket says 172.21.15.134:37002) 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f7378eb6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73740d02a0 0x7f73740d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52484/0 (socket says 172.21.15.134:52484) 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.035+0000 7f73796b7640 1 -- 172.21.15.134:0/1454430305 learned_addr learned my addr 172.21.15.134:0/1454430305 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f7378eb6640 1 -- 172.21.15.134:0/1454430305 >> v1:172.21.15.177:6789/0 conn(0x7f737415ca40 legacy=0x7f737415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f7378eb6640 1 -- 172.21.15.134:0/1454430305 >> v1:172.21.15.134:6789/0 conn(0x7f737415ceb0 legacy=0x7f73741594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f7378eb6640 1 -- 172.21.15.134:0/1454430305 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737415d950 con 0x7f73740d02a0 2024-09-15T22:48:43.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f736b7fe640 1 -- 172.21.15.134:0/1454430305 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789734327 0 0) 0x7f73740d0bc0 con 0x7f737415ceb0 2024-09-15T22:48:43.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f7378eb6640 1 --2- 172.21.15.134:0/1454430305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f73740d0680 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f73700097a0 tx=0x7f737002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1c2d05c9317413 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f736b7fe640 1 -- 172.21.15.134:0/1454430305 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370037070 con 0x7f73740d02a0 2024-09-15T22:48:43.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f736b7fe640 1 -- 172.21.15.134:0/1454430305 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737002ae50 con 0x7f73740d02a0 2024-09-15T22:48:43.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.036+0000 7f736b7fe640 1 -- 172.21.15.134:0/1454430305 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370032660 con 0x7f73740d02a0 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 -- 172.21.15.134:0/1454430305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 msgr2=0x7f73740d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 --2- 172.21.15.134:0/1454430305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f73740d0680 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f73700097a0 tx=0x7f737002a140 comp rx=0 tx=0).stop 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 -- 172.21.15.134:0/1454430305 shutdown_connections 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 --2- 172.21.15.134:0/1454430305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f73740d0680 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 -- 172.21.15.134:0/1454430305 >> 172.21.15.134:0/1454430305 conn(0x7f7374062cc0 msgr2=0x7f737406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 -- 172.21.15.134:0/1454430305 shutdown_connections 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.037+0000 7f737b11a640 1 -- 172.21.15.134:0/1454430305 wait complete. 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.038+0000 7f737b11a640 1 Processor -- start 2024-09-15T22:48:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.038+0000 7f737b11a640 1 -- start start 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 0x7f7374158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737415ceb0 0x7f737406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f737415eb40 con 0x7f73740d02a0 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f737415df10 con 0x7f737415ca40 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f737b11a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7374155b90 con 0x7f737415ceb0 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f7378eb6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f7378eb6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52496/0 (socket says 172.21.15.134:52496) 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f7378eb6640 1 -- 172.21.15.134:0/1950101774 learned_addr learned my addr 172.21.15.134:0/1950101774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f73796b7640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737415ceb0 0x7f737406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f736bfff640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 0x7f7374158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f7378eb6640 1 -- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737415ceb0 msgr2=0x7f737406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.039+0000 7f7378eb6640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737415ceb0 0x7f737406bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f7378eb6640 1 -- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 msgr2=0x7f7374158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f7378eb6640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 0x7f7374158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f7378eb6640 1 -- 172.21.15.134:0/1950101774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73740aebe0 con 0x7f73740d02a0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f736bfff640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 0x7f7374158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f7378eb6640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f73700097a0 tx=0x7f73700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370042070 con 0x7f73740d02a0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737003e670 con 0x7f73740d02a0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73740aeec0 con 0x7f73740d02a0 2024-09-15T22:48:43.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370037040 con 0x7f73740d02a0 2024-09-15T22:48:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.040+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73740af480 con 0x7f73740d02a0 2024-09-15T22:48:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.041+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73740b4790 con 0x7f73740d02a0 2024-09-15T22:48:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.041+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f7370045070 con 0x7f73740d02a0 2024-09-15T22:48:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.042+0000 7f73697fa640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 0x7f736006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.042+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7f73700aa5f0 con 0x7f73740d02a0 2024-09-15T22:48:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.042+0000 7f736bfff640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 0x7f736006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.043+0000 7f736bfff640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 0x7f736006f100 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7364007fd0 tx=0x7f7364009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.046+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f737007aa80 con 0x7f73740d02a0 2024-09-15T22:48:43.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.275+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f73740b5550 con 0x7f73740d02a0 2024-09-15T22:48:43.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.342+0000 7f73697fa640 1 -- 172.21.15.134:0/1950101774 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v405) ==== 166+0+0 (secure 0 0 0) 0x7f737007a380 con 0x7f73740d02a0 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 msgr2=0x7f736006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 0x7f736006f100 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7364007fd0 tx=0x7f7364009040 comp rx=0 tx=0).stop 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 msgr2=0x7f7374144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f73700097a0 tx=0x7f73700046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 shutdown_connections 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737415ceb0 0x7f737406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737415ca40 0x7f7374158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f736006cc40 0x7f736006f100 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.344+0000 7f737b11a640 1 --2- 172.21.15.134:0/1950101774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73740d02a0 0x7f7374144df0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.345+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 >> 172.21.15.134:0/1950101774 conn(0x7f7374062cc0 msgr2=0x7f737415b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.345+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 shutdown_connections 2024-09-15T22:48:43.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.345+0000 7f737b11a640 1 -- 172.21.15.134:0/1950101774 wait complete. 2024-09-15T22:48:43.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:48:43.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.457+0000 7fadaaf9f640 1 Processor -- start 2024-09-15T22:48:43.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.457+0000 7fadaaf9f640 1 -- start start 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fadaaf9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 0x7fada40b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fadaaf9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fada40b7190 0x7fada406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fadaaf9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada406d130 con 0x7fada415e860 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fadaaf9f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fada406d410 con 0x7fada40b7190 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fadaaf9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fada406d6f0 con 0x7fada4073150 2024-09-15T22:48:43.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fada40b7190 0x7fada406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fada40b7190 0x7fada406e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52510/0 (socket says 172.21.15.134:52510) 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 -- 172.21.15.134:0/1414009954 learned_addr learned my addr 172.21.15.134:0/1414009954 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada3fff640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 0x7fada40b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 -- 172.21.15.134:0/1414009954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 msgr2=0x7fada40b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 0x7fada40b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 -- 172.21.15.134:0/1414009954 >> v1:172.21.15.177:6789/0 conn(0x7fada415e860 legacy=0x7fada415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada953c640 1 -- 172.21.15.134:0/1414009954 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada406d9d0 con 0x7fada40b7190 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.458+0000 7fada3fff640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 0x7fada40b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fada953c640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40b7190 0x7fada406e1d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009870 tx=0x7fad8c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fb210fb485e4db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fada37fe640 1 -- 172.21.15.134:0/1414009954 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c037070 con 0x7fada40b7190 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fada37fe640 1 -- 172.21.15.134:0/1414009954 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c032440 con 0x7fada40b7190 2024-09-15T22:48:43.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fada37fe640 1 -- 172.21.15.134:0/1414009954 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c032810 con 0x7fada40b7190 2024-09-15T22:48:43.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1414009954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40b7190 msgr2=0x7fada406e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.459+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40b7190 0x7fada406e1d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009870 tx=0x7fad8c02a210 comp rx=0 tx=0).stop 2024-09-15T22:48:43.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1414009954 shutdown_connections 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40b7190 0x7fada406e1d0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1414009954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada4073150 0x7fada40b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1414009954 >> 172.21.15.134:0/1414009954 conn(0x7fada40b4290 msgr2=0x7fada40b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1414009954 shutdown_connections 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.460+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1414009954 wait complete. 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.461+0000 7fadaaf9f640 1 Processor -- start 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.461+0000 7fadaaf9f640 1 -- start start 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 0x7fada40d1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 0x7fada40d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fada406cd50 con 0x7fada4073150 2024-09-15T22:48:43.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fada40b7620 con 0x7fada415e860 2024-09-15T22:48:43.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fada406ced0 con 0x7fada40b7190 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52524/0 (socket says 172.21.15.134:52524) 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 -- 172.21.15.134:0/1877716585 learned_addr learned my addr 172.21.15.134:0/1877716585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada953c640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 0x7fada40d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada3fff640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 0x7fada40d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 -- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 msgr2=0x7fada40d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 0x7fada40d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 -- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 msgr2=0x7fada40d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 0x7fada40d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 -- 172.21.15.134:0/1877716585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada40cf900 con 0x7fada4073150 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada953c640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 0x7fada40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada3fff640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 0x7fada40d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:43.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada8d3b640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c430 tx=0x7fad9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011790 con 0x7fada4073150 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad9c017070 con 0x7fada4073150 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011b70 con 0x7fada4073150 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada40cfbe0 con 0x7fada4073150 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.462+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada40d01a0 con 0x7fada4073150 2024-09-15T22:48:43.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.463+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada40b6c50 con 0x7fada4073150 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.464+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fad9c011d10 con 0x7fada4073150 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.464+0000 7fada17fa640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 0x7fad8406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.465+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7fad9c089ad0 con 0x7fada4073150 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.465+0000 7fada3fff640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 0x7fad8406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.465+0000 7fada3fff640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 0x7fad8406f100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fada4161cd0 tx=0x7fad94007a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.469+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad9c059db0 con 0x7fada4073150 2024-09-15T22:48:43.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.633+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fada40b1b00 con 0x7fada4073150 2024-09-15T22:48:43.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.636+0000 7fada17fa640 1 -- 172.21.15.134:0/1877716585 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fad9c0596b0 con 0x7fada4073150 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 msgr2=0x7fad8406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 0x7fad8406f100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fada4161cd0 tx=0x7fad94007a10 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 msgr2=0x7fada414ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c430 tx=0x7fad9c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 shutdown_connections 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fada415e860 0x7fada40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fada40b7190 0x7fada40d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fad8406cc40 0x7fad8406f100 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 --2- 172.21.15.134:0/1877716585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada4073150 0x7fada414ecb0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 >> 172.21.15.134:0/1877716585 conn(0x7fada40b4290 msgr2=0x7fada415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 shutdown_connections 2024-09-15T22:48:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.638+0000 7fadaaf9f640 1 -- 172.21.15.134:0/1877716585 wait complete. 2024-09-15T22:48:43.651 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:48:43.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:43.691 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:48:43.741 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:48:43.742 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:43.742 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:43.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:43.758 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:43.758 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:43.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:43.776 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:43.777 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:43.813 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:48:43.813 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:43.813 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:43.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:48:43.835 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:48:43.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:43.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 Processor -- start 2024-09-15T22:48:43.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 -- start start 2024-09-15T22:48:43.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5cc015e940 0x7f5cc00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015ed20 0x7f5cc00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc00b7170 con 0x7f5cc00cef90 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00d1ae0 con 0x7f5cc015e940 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.950+0000 7f5cc4ab7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc00b7aa0 con 0x7f5cc015ed20 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbe59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5cc015e940 0x7f5cc00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbed9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5cc00cef90 0x7f5cc00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37016/0 (socket says 172.21.15.134:37016) 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbed9d640 1 -- 172.21.15.134:0/1706977214 learned_addr learned my addr 172.21.15.134:0/1706977214 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbe59c640 1 -- 172.21.15.134:0/1706977214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015ed20 msgr2=0x7f5cc00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbe59c640 1 --2- 172.21.15.134:0/1706977214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015ed20 0x7f5cc00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbe59c640 1 -- 172.21.15.134:0/1706977214 >> v1:172.21.15.134:6789/0 conn(0x7f5cc00cef90 legacy=0x7f5cc00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbdd9b640 1 -- 172.21.15.134:0/1706977214 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266455822 0 0) 0x7f5cb8001490 con 0x7f5cc00cef90 2024-09-15T22:48:43.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.951+0000 7f5cbe59c640 1 -- 172.21.15.134:0/1706977214 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc00d3660 con 0x7f5cc015e940 2024-09-15T22:48:43.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cbe59c640 1 --2- 172.21.15.134:0/1706977214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015e940 0x7f5cc00d1060 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097a0 tx=0x7f5cb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5ca5b29b92dd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cbdd9b640 1 -- 172.21.15.134:0/1706977214 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0037070 con 0x7f5cc015e940 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cbdd9b640 1 -- 172.21.15.134:0/1706977214 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb0032440 con 0x7f5cc015e940 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cbdd9b640 1 -- 172.21.15.134:0/1706977214 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0032810 con 0x7f5cc015e940 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/1706977214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015e940 msgr2=0x7f5cc00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/1706977214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015e940 0x7f5cc00d1060 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097a0 tx=0x7f5cb002a210 comp rx=0 tx=0).stop 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/1706977214 shutdown_connections 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/1706977214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015ed20 0x7f5cc00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/1706977214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015e940 0x7f5cc00d1060 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/1706977214 >> 172.21.15.134:0/1706977214 conn(0x7f5cc00b6240 msgr2=0x7f5cc00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/1706977214 shutdown_connections 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.952+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/1706977214 wait complete. 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 Processor -- start 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 -- start start 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc00cef90 0x7f5cc01f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015e940 0x7f5cc00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc00d3f00 con 0x7f5cc015ed20 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc00d3c20 con 0x7f5cc00cef90 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cc4ab7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc00d3310 con 0x7f5cc015e940 2024-09-15T22:48:43.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cbed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.954+0000 7f5cbed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52540/0 (socket says 172.21.15.134:52540) 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 -- 172.21.15.134:0/2117469499 learned_addr learned my addr 172.21.15.134:0/2117469499 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cb7fff640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015e940 0x7f5cc00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbe59c640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc00cef90 0x7f5cc01f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 -- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015e940 msgr2=0x7f5cc00ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015e940 0x7f5cc00ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 -- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc00cef90 msgr2=0x7f5cc01f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc00cef90 0x7f5cc01f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 -- 172.21.15.134:0/2117469499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc00cab40 con 0x7f5cc015ed20 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cbed9d640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800c780 tx=0x7f5cb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8018070 con 0x7f5cc015ed20 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb800a640 con 0x7f5cc015ed20 2024-09-15T22:48:43.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800aa30 con 0x7f5cc015ed20 2024-09-15T22:48:43.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc00cae20 con 0x7f5cc015ed20 2024-09-15T22:48:43.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.955+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc00cb3e0 con 0x7f5cc015ed20 2024-09-15T22:48:43.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.956+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc00d1ef0 con 0x7f5cc015ed20 2024-09-15T22:48:43.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.957+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f5cb801b070 con 0x7f5cc015ed20 2024-09-15T22:48:43.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.957+0000 7f5cb6ffd640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 0x7f5ca006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:43.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.957+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4999+0+0 (secure 0 0 0) 0x7f5cb8089190 con 0x7f5cc015ed20 2024-09-15T22:48:43.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.957+0000 7f5cbe59c640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 0x7f5ca006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:43.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.958+0000 7f5cbe59c640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 0x7f5ca006f130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0034000 tx=0x7f5cb002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:43.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:43.961+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cc00b7170 con 0x7f5cc015ed20 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.160+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cc00ba6b0 con 0x7f5cc015ed20 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.161+0000 7f5cb6ffd640 1 -- 172.21.15.134:0/2117469499 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+3920 (secure 0 0 0) 0x7f5cb8059500 con 0x7f5cc015ed20 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"btime":"2024-09-15T22:48:39:225839+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2089025346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2089025346},{"type":"v1","addr":"172.21.15.177:6834","nonce":2089025346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1543838325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1543838325},{"type":"v1","addr":"172.21.15.177:6835","nonce":1543838325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/175628305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":175628305},{"type":"v1","addr":"172.21.15.134:6834","nonce":175628305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3373251755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":3373251755},{"type":"v1","addr":"172.21.15.134:6835","nonce":3373251755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 85 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 msgr2=0x7f5ca006f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 0x7f5ca006f130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0034000 tx=0x7f5cb002e000 comp rx=0 tx=0).stop 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 msgr2=0x7f5cc00b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800c780 tx=0x7f5cb800cc40 comp rx=0 tx=0).stop 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 shutdown_connections 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5ca006cc70 0x7f5ca006f130 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc015ed20 0x7f5cc00b5460 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc015e940 0x7f5cc00ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 --2- 172.21.15.134:0/2117469499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc00cef90 0x7f5cc01f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 >> 172.21.15.134:0/2117469499 conn(0x7f5cc00b6240 msgr2=0x7f5cc015f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 shutdown_connections 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.163+0000 7f5cc4ab7640 1 -- 172.21.15.134:0/2117469499 wait complete. 2024-09-15T22:48:44.175 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:48:44.175 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:48:44.175 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:48:44.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:44.176 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:48:44.176 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:48:44.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:48:44.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:44.177 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:48:44.177 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:48:44.177 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:48:44.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:44.178 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:48:44.178 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:48:44.178 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:48:44.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:48:44.185 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:48:44.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:48:44.187 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:48:44.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:48:44.189 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:48:44.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:48:44.190 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:48:44.190 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:48:44.229 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:48:44.230 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:44.231 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:48:44.231 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:44.232 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:48:44.232 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:44.233 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:48:44.233 DEBUG:teuthology.parallel:result is None 2024-09-15T22:48:44.233 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:48:44.303 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2024-09-15T22:48:44.305 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:48:44.314 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-09-15T22:48:44.315 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-09-15T22:48:44.315 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-09-15T22:48:44.314+0000 7f48d997e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-15T22:48:44.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.337+0000 7fb6ea552640 1 Processor -- start 2024-09-15T22:48:44.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.337+0000 7fb6ea552640 1 -- start start 2024-09-15T22:48:44.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6ea552640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6e415e940 0x7fb6e40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6ea552640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 0x7fb6e40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6ea552640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e40b7170 con 0x7fb6e415ed20 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6ea552640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e40d1ae0 con 0x7fb6e415e940 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6ea552640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e40b7aa0 con 0x7fb6e40cef90 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6e3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6e415e940 0x7fb6e40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6e3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6e415e940 0x7fb6e40d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52588/0 (socket says 172.21.15.134:52588) 2024-09-15T22:48:44.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6dbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb6e415ed20 0x7fb6e40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37048/0 (socket says 172.21.15.134:37048) 2024-09-15T22:48:44.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.338+0000 7fb6e3fff640 1 -- 172.21.15.134:0/1001751747 learned_addr learned my addr 172.21.15.134:0/1001751747 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:44.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e8aef640 1 --2- 172.21.15.134:0/1001751747 >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 0x7fb6e40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e3fff640 1 -- 172.21.15.134:0/1001751747 >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 msgr2=0x7fb6e40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e3fff640 1 --2- 172.21.15.134:0/1001751747 >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 0x7fb6e40d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e3fff640 1 -- 172.21.15.134:0/1001751747 >> v1:172.21.15.134:6789/0 conn(0x7fb6e415ed20 legacy=0x7fb6e40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e37fe640 1 -- 172.21.15.134:0/1001751747 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823378761 0 0) 0x7fb6cc001110 con 0x7fb6e415ed20 2024-09-15T22:48:44.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e3fff640 1 -- 172.21.15.134:0/1001751747 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e40d3660 con 0x7fb6e415e940 2024-09-15T22:48:44.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e8aef640 1 --2- 172.21.15.134:0/1001751747 >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 0x7fb6e40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:44.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.339+0000 7fb6e3fff640 1 --2- 172.21.15.134:0/1001751747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415e940 0x7fb6e40d1060 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb6e406d070 tx=0x7fb6d402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58b1701a6fe38ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6e37fe640 1 -- 172.21.15.134:0/1001751747 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4037070 con 0x7fb6e415e940 2024-09-15T22:48:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6e37fe640 1 -- 172.21.15.134:0/1001751747 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d402ae50 con 0x7fb6e415e940 2024-09-15T22:48:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6e37fe640 1 -- 172.21.15.134:0/1001751747 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4032860 con 0x7fb6e415e940 2024-09-15T22:48:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 -- 172.21.15.134:0/1001751747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415e940 msgr2=0x7fb6e40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1001751747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415e940 0x7fb6e40d1060 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb6e406d070 tx=0x7fb6d402a300 comp rx=0 tx=0).stop 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 -- 172.21.15.134:0/1001751747 shutdown_connections 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1001751747 >> v2:172.21.15.177:3300/0 conn(0x7fb6e40cef90 0x7fb6e40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1001751747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415e940 0x7fb6e40d1060 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 -- 172.21.15.134:0/1001751747 >> 172.21.15.134:0/1001751747 conn(0x7fb6e40b6240 msgr2=0x7fb6e40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 -- 172.21.15.134:0/1001751747 shutdown_connections 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.340+0000 7fb6ea552640 1 -- 172.21.15.134:0/1001751747 wait complete. 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.341+0000 7fb6ea552640 1 Processor -- start 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.341+0000 7fb6ea552640 1 -- start start 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6e40cef90 0x7fb6e41f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6e415e940 0x7fb6e4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40d3f00 con 0x7fb6e415ed20 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40d3c20 con 0x7fb6e40cef90 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6ea552640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e40d3310 con 0x7fb6e415e940 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6e8aef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6e8aef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52598/0 (socket says 172.21.15.134:52598) 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6e8aef640 1 -- 172.21.15.134:0/1660747459 learned_addr learned my addr 172.21.15.134:0/1660747459 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6e3fff640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6e40cef90 0x7fb6e41f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.342+0000 7fb6dbfff640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6e415e940 0x7fb6e4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 -- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6e415e940 msgr2=0x7fb6e4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6e415e940 0x7fb6e4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 -- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6e40cef90 msgr2=0x7fb6e41f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6e40cef90 0x7fb6e41f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 -- 172.21.15.134:0/1660747459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e4156e00 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e8aef640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc007df0 tx=0x7fb6dc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc01a070 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc003990 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e415bac0 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc003d80 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.343+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e4157070 con 0x7fb6e415ed20 2024-09-15T22:48:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.344+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e40d1ef0 con 0x7fb6e415ed20 2024-09-15T22:48:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.348+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fb6dc005d10 con 0x7fb6e415ed20 2024-09-15T22:48:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.348+0000 7fb6e17fa640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 0x7fb6c406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.348+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4999+0+0 (secure 0 0 0) 0x7fb6dc08a2c0 con 0x7fb6e415ed20 2024-09-15T22:48:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.348+0000 7fb6e3fff640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 0x7fb6c406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.349+0000 7fb6e3fff640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 0x7fb6c406f100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4034000 tx=0x7fb6d402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.351+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6dc024080 con 0x7fb6e415ed20 2024-09-15T22:48:44.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:44.535+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb6e40ba6b0 con 0x7fb6e415ed20 2024-09-15T22:48:45.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.362+0000 7fb6e17fa640 1 -- 172.21.15.134:0/1660747459 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v166) ==== 97+0+0 (secure 0 0 0) 0x7fb6dc010070 con 0x7fb6e415ed20 2024-09-15T22:48:45.364 INFO:teuthology.orchestra.run.smithi134.stderr: removed all blocklist entries 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 msgr2=0x7fb6c406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 0x7fb6c406f100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4034000 tx=0x7fb6d402e000 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 msgr2=0x7fb6e4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc007df0 tx=0x7fb6dc00d4a0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 shutdown_connections 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb6c406cc40 0x7fb6c406f100 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6e415ed20 0x7fb6e4159310 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6e415e940 0x7fb6e4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 --2- 172.21.15.134:0/1660747459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6e40cef90 0x7fb6e41f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 >> 172.21.15.134:0/1660747459 conn(0x7fb6e40b6240 msgr2=0x7fb6e4160f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 shutdown_connections 2024-09-15T22:48:45.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.365+0000 7fb6ea552640 1 -- 172.21.15.134:0/1660747459 wait complete. 2024-09-15T22:48:45.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:48:45.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.481+0000 7fb0dc591640 1 Processor -- start 2024-09-15T22:48:45.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 -- start start 2024-09-15T22:48:45.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0d415ed20 0x7fb0d40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d40b7170 con 0x7fb0d415e940 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d40b7aa0 con 0x7fb0d415ed20 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.482+0000 7fb0dc591640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d40d3660 con 0x7fb0d40cef90 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0d415ed20 0x7fb0d40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0d415ed20 0x7fb0d40b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52604/0 (socket says 172.21.15.134:52604) 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/3724146163 learned_addr learned my addr 172.21.15.134:0/3724146163 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0dab2e640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/3724146163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 msgr2=0x7fb0d40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/3724146163 >> v1:172.21.15.177:6789/0 conn(0x7fb0d415e940 legacy=0x7fb0d40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/3724146163 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40d3940 con 0x7fb0d415ed20 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.483+0000 7fb0dab2e640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0d9b2c640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415ed20 0x7fb0d40b3220 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009870 tx=0x7fb0d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951d5eafa1f391ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0d932b640 1 -- 172.21.15.134:0/3724146163 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0037070 con 0x7fb0d415ed20 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0d932b640 1 -- 172.21.15.134:0/3724146163 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0032440 con 0x7fb0d415ed20 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0d932b640 1 -- 172.21.15.134:0/3724146163 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0032810 con 0x7fb0d415ed20 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 -- 172.21.15.134:0/3724146163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415ed20 msgr2=0x7fb0d40b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415ed20 0x7fb0d40b3220 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009870 tx=0x7fb0d002a2a0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 -- 172.21.15.134:0/3724146163 shutdown_connections 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 --2- 172.21.15.134:0/3724146163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415ed20 0x7fb0d40b3220 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.484+0000 7fb0dc591640 1 -- 172.21.15.134:0/3724146163 >> 172.21.15.134:0/3724146163 conn(0x7fb0d40b6240 msgr2=0x7fb0d40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.485+0000 7fb0dc591640 1 -- 172.21.15.134:0/3724146163 shutdown_connections 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.485+0000 7fb0dc591640 1 -- 172.21.15.134:0/3724146163 wait complete. 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 Processor -- start 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 -- start start 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0d415ed20 0x7fb0d41f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d40d3310 con 0x7fb0d415e940 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d40d3f00 con 0x7fb0d415ed20 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0dc591640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d40d1ef0 con 0x7fb0d40cef90 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0d9b2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0d9b2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52608/0 (socket says 172.21.15.134:52608) 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.486+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/2803167477 learned_addr learned my addr 172.21.15.134:0/2803167477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0da32d640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0dab2e640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0d415ed20 0x7fb0d41f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 msgr2=0x7fb0d40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0d415ed20 msgr2=0x7fb0d41f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0d415ed20 0x7fb0d41f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 -- 172.21.15.134:0/2803167477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40ce190 con 0x7fb0d415e940 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0da32d640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0d9b2c640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0000c00 tx=0x7fb0d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0037040 con 0x7fb0d415e940 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0042070 con 0x7fb0d415e940 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d40cdbd0 con 0x7fb0d415e940 2024-09-15T22:48:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0030bb0 con 0x7fb0d415e940 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.487+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d4149010 con 0x7fb0d415e940 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.488+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40d1060 con 0x7fb0d415e940 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.489+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fb0d0047460 con 0x7fb0d415e940 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.489+0000 7fb0c6ffd640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 0x7fb0b806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.489+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4913+0+0 (secure 0 0 0) 0x7fb0d00aa7e0 con 0x7fb0d415e940 2024-09-15T22:48:45.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.489+0000 7fb0da32d640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 0x7fb0b806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.490+0000 7fb0da32d640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 0x7fb0b806f100 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8003eb0 tx=0x7fb0c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.493+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0d40b7170 con 0x7fb0d415e940 2024-09-15T22:48:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.721+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb0d40ba6b0 con 0x7fb0d415e940 2024-09-15T22:48:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.721+0000 7fb0c6ffd640 1 -- 172.21.15.134:0/2803167477 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7fb0d0045360 con 0x7fb0d415e940 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_dump": [ 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.a", 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudm9IFpNxAAZXwIa/loC+XWPt47cxhU6g==", 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.b", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm9w1sBxAAkgQ2KQaiUUkFegA0c9eA1w==", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.c", 2024-09-15T22:48:45.724 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm6PLHAhAAhuE+4rRbDZmc9EANOHXATg==", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mds.d", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmCVZ4DhAApCqUr31gVX1F7bQ6fdBbVA==", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:45.725 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.0", 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBaYudmtxgVMBAAoW9X/nV3G4jbsom1+y+Gtw==", 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.1", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBeYudmo+t8BRAAw0E5wMCEVBFlataVbJPwDg==", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.2", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBiYudmCDiQBhAAaaE/4j8MVqSo3RiWVNrKcA==", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.727 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.3", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBmYudm9ZihCBAAmDb5PPUSvYJR43g58dMHzg==", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.4", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBsYudmE0SOKhAAJ1Cb5sTGJTO+sqPW+G7VCg==", 2024-09-15T22:48:45.728 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.5", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBwYudmU3bWHRAAVyDI0kD7WjmTx9+SjoPeKw==", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.6", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB0YudmKvCfHxAAlWRMtgVEr+8BK+1RjXWNMQ==", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "osd.7", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQB4YudmRRGxIBAAENpJe3bFt+5OFl/pcq+4vg==", 2024-09-15T22:48:45.730 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow profile osd", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile osd", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.0", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg==", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow r", 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.1", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmn85cGxAAwYdVn7FCesxQJmXsE1tiog==", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.2", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudm5nIhGBAAfh8cIPDT0Q9deogChUunqg==", 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.732 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.3", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBXYudmaf7wIBAAoGpmVvDKJvNUQ8gPtNdwAQ==", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow r", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow rw", 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow rwx" 2024-09-15T22:48:45.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "client.admin", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAYnyGxAAU1DlOcPGcHFMAGz1At3M5g==", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": "allow *", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow *", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.x", 2024-09-15T22:48:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmNdQyNBAARHbOWQGvhuaYtQpuSx4wYw==", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "entity": "mgr.y", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "AQBWYudmAt6DMBAAUP3unH2rFp9qtspXrDG4bw==", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": { 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": "allow *", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": "allow profile mgr", 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": "allow *" 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:45.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-15T22:48:45.736 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 msgr2=0x7fb0b806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 0x7fb0b806f100 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8003eb0 tx=0x7fb0c8009040 comp rx=0 tx=0).stop 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 msgr2=0x7fb0d41f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0000c00 tx=0x7fb0d00046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 shutdown_connections 2024-09-15T22:48:45.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0d415ed20 0x7fb0d41f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb0b806cc40 0x7fb0b806f100 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d415e940 0x7fb0d41f8040 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 --2- 172.21.15.134:0/2803167477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0d40cef90 0x7fb0d40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 >> 172.21.15.134:0/2803167477 conn(0x7fb0d40b6240 msgr2=0x7fb0d4160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 shutdown_connections 2024-09-15T22:48:45.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.723+0000 7fb0dc591640 1 -- 172.21.15.134:0/2803167477 wait complete. 2024-09-15T22:48:45.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:48:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.835+0000 7f1875682640 1 Processor -- start 2024-09-15T22:48:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.835+0000 7f1875682640 1 -- start start 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f187015c250 0x7f187015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f187006e570 0x7f18700712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18700b6a20 0x7f18700b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f18700b7870 con 0x7f187015c250 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f18700708a0 con 0x7f187006e570 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f1875682640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1870070e60 con 0x7f18700b6a20 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f186effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f187015c250 0x7f187015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f186effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f187015c250 0x7f187015f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52614/0 (socket says 172.21.15.134:52614) 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.836+0000 7f186effd640 1 -- 172.21.15.134:0/1136185191 learned_addr learned my addr 172.21.15.134:0/1136185191 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186e7fc640 1 --2- 172.21.15.134:0/1136185191 >> v2:172.21.15.177:3300/0 conn(0x7f187006e570 0x7f18700712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186f7fe640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18700b6a20 0x7f18700b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 -- 172.21.15.134:0/1136185191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18700b6a20 msgr2=0x7f18700b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18700b6a20 0x7f18700b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 -- 172.21.15.134:0/1136185191 >> v2:172.21.15.177:3300/0 conn(0x7f187006e570 msgr2=0x7f18700712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 --2- 172.21.15.134:0/1136185191 >> v2:172.21.15.177:3300/0 conn(0x7f187006e570 0x7f18700712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 -- 172.21.15.134:0/1136185191 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187015fbf0 con 0x7f187015c250 2024-09-15T22:48:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186effd640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f187015f6b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f18700b5260 tx=0x7f186002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b6dfbf875d6acb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186dffb640 1 -- 172.21.15.134:0/1136185191 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860036070 con 0x7f187015c250 2024-09-15T22:48:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186dffb640 1 -- 172.21.15.134:0/1136185191 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1860031600 con 0x7f187015c250 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.837+0000 7f186dffb640 1 -- 172.21.15.134:0/1136185191 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18600319d0 con 0x7f187015c250 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 -- 172.21.15.134:0/1136185191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 msgr2=0x7f187015f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f187015f6b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f18700b5260 tx=0x7f186002a6a0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 -- 172.21.15.134:0/1136185191 shutdown_connections 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18700b6a20 0x7f18700b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 --2- 172.21.15.134:0/1136185191 >> v2:172.21.15.177:3300/0 conn(0x7f187006e570 0x7f18700712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 --2- 172.21.15.134:0/1136185191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f187015f6b0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 -- 172.21.15.134:0/1136185191 >> 172.21.15.134:0/1136185191 conn(0x7f18700b4220 msgr2=0x7f18700b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 -- 172.21.15.134:0/1136185191 shutdown_connections 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.838+0000 7f1875682640 1 -- 172.21.15.134:0/1136185191 wait complete. 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.839+0000 7f1875682640 1 Processor -- start 2024-09-15T22:48:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.839+0000 7f1875682640 1 -- start start 2024-09-15T22:48:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187006e570 0x7f18700d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 0x7f1870150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f187006ecf0 con 0x7f187015c250 2024-09-15T22:48:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187006ea10 con 0x7f18700b6a20 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f1875682640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1870070af0 con 0x7f187006e570 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f186f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f186f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52616/0 (socket says 172.21.15.134:52616) 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f186f7fe640 1 -- 172.21.15.134:0/3785427724 learned_addr learned my addr 172.21.15.134:0/3785427724 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f186effd640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187006e570 0x7f18700d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.840+0000 7f186e7fc640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 0x7f1870150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 -- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187006e570 msgr2=0x7f18700d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187006e570 0x7f18700d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 -- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 msgr2=0x7f1870150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 0x7f1870150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 -- 172.21.15.134:0/3785427724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18700ce090 con 0x7f187015c250 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186e7fc640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 0x7f1870150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f186f7fe640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f186800d800 tx=0x7f186800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800b6c0 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868019070 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18700ce370 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800bac0 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.841+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18700ce930 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.842+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18700ceb30 con 0x7f187015c250 2024-09-15T22:48:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.842+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f186800bc60 con 0x7f187015c250 2024-09-15T22:48:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.843+0000 7f18577fe640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 0x7f185c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.843+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4913+0+0 (secure 0 0 0) 0x7f186808a050 con 0x7f187015c250 2024-09-15T22:48:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.843+0000 7f186effd640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 0x7f185c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.843+0000 7f186effd640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 0x7f185c06f100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1860033000 tx=0x7f1860009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:45.847+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18700ceb30 con 0x7f187015c250 2024-09-15T22:48:46.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.012+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f187015c630 con 0x7f187015c250 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.013+0000 7f18577fe640 1 -- 172.21.15.134:0/3785427724 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v166) ==== 84+0+65 (secure 0 0 0) 0x7f186805a340 con 0x7f187015c250 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:48:46.014 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 msgr2=0x7f185c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 0x7f185c06f100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1860033000 tx=0x7f1860009000 comp rx=0 tx=0).stop 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 msgr2=0x7f18700cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f186800d800 tx=0x7f186800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 shutdown_connections 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f185c06cc40 0x7f185c06f100 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187015c250 0x7f18700cd300 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18700b6a20 0x7f1870150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 --2- 172.21.15.134:0/3785427724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f187006e570 0x7f18700d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.014+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 >> 172.21.15.134:0/3785427724 conn(0x7f18700b4220 msgr2=0x7f187006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.015+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 shutdown_connections 2024-09-15T22:48:46.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.015+0000 7f1875682640 1 -- 172.21.15.134:0/3785427724 wait complete. 2024-09-15T22:48:46.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:48:46.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:48:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.129+0000 7f98318dd640 1 Processor -- start 2024-09-15T22:48:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.129+0000 7f98318dd640 1 -- start start 2024-09-15T22:48:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f98318dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f982c0d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f98318dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0cffc0 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f98318dd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0d43f0 con 0x7f982c0b6e60 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f98318dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0cf290 con 0x7f982c161e20 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f982c06c780 0x7f982c0b79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:37058/0 (socket says 172.21.15.134:37058) 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982b7fe640 1 -- 172.21.15.134:0/3294829689 learned_addr learned my addr 172.21.15.134:0/3294829689 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982affd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f982c0d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881148508 0 0) 0x7f982c0cffc0 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9818003520 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2288245799 0 0) 0x7f9818003520 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 msgr2=0x7f982c0d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f982c0d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 >> v1:172.21.15.177:6789/0 conn(0x7f982c0b6e60 legacy=0x7f982c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0cf4e0 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f98240019f0 con 0x7f982c06c780 2024-09-15T22:48:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 >> v1:172.21.15.134:6789/0 conn(0x7f982c06c780 legacy=0x7f982c0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98180039e0 0x7f9818003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f9818004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9818004d40 0x7f98180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cf290 con 0x7f98180039e0 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f981800b9c0 con 0x7f9818004d40 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f981800bbc0 con 0x7f982c161e20 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.130+0000 7f982affd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98180039e0 0x7f9818003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f98227fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f9818004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982b7fe640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9818004d40 0x7f98180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 -- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 msgr2=0x7f9818004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f9818004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 -- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9818004d40 msgr2=0x7f98180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9818004d40 0x7f98180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 -- 172.21.15.134:0/3294829689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9818003520 con 0x7f98180039e0 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f98227fc640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f982c161e20 0x7f9818004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982affd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98180039e0 0x7f9818003dc0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f981c009ac0 tx=0x7f9818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf568cbd3930b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c036070 con 0x7f98180039e0 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c031400 con 0x7f98180039e0 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.131+0000 7f982a7fc640 1 -- 172.21.15.134:0/3294829689 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c009690 con 0x7f98180039e0 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 -- 172.21.15.134:0/3294829689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98180039e0 msgr2=0x7f9818003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 --2- 172.21.15.134:0/3294829689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98180039e0 0x7f9818003dc0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f981c009ac0 tx=0x7f9818005830 comp rx=0 tx=0).stop 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f982b7fe640 1 -- 172.21.15.134:0/3294829689 reap_dead start 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 -- 172.21.15.134:0/3294829689 shutdown_connections 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 -- 172.21.15.134:0/3294829689 >> 172.21.15.134:0/3294829689 conn(0x7f982c0d4dc0 msgr2=0x7f982c0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 -- 172.21.15.134:0/3294829689 shutdown_connections 2024-09-15T22:48:46.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.132+0000 7f98318dd640 1 -- 172.21.15.134:0/3294829689 wait complete. 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.133+0000 7f98318dd640 1 Processor -- start 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.133+0000 7f98318dd640 1 -- start start 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98180039e0 0x7f982c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f982c1f32c0 0x7f982c1f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f982c162200 con 0x7f982c0ad1a0 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cfb30 con 0x7f982c1f32c0 2024-09-15T22:48:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98318dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f982c06ccc0 con 0x7f98180039e0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98227fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98227fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52634/0 (socket says 172.21.15.134:52634) 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f98227fc640 1 -- 172.21.15.134:0/344924784 learned_addr learned my addr 172.21.15.134:0/344924784 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f982b7fe640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f982c1f32c0 0x7f982c1f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.134+0000 7f982affd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98180039e0 0x7f982c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 -- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98180039e0 msgr2=0x7f982c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98180039e0 0x7f982c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 -- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f982c1f32c0 msgr2=0x7f982c1f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f982c1f32c0 0x7f982c1f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 -- 172.21.15.134:0/344924784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0ad620 con 0x7f982c0ad1a0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98227fc640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f981400e800 tx=0x7f981400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98140050d0 con 0x7f982c0ad1a0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9814018070 con 0x7f982c0ad1a0 2024-09-15T22:48:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c0af630 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814005470 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.135+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c0adb80 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.136+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c0d3da0 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.137+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f981400c6c0 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.137+0000 7f9828ff9640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 0x7f980c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.137+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4913+0+0 (secure 0 0 0) 0x7f9814089a30 con 0x7f982c0ad1a0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.137+0000 7f982affd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 0x7f980c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.138+0000 7f982affd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 0x7f980c06f100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.141+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f982c0ad620 con 0x7f982c0ad1a0 2024-09-15T22:48:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.306+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f982c0b8bf0 con 0x7f982c0ad1a0 2024-09-15T22:48:46.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.638+0000 7f9828ff9640 1 -- 172.21.15.134:0/344924784 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v167) ==== 138+0+0 (secure 0 0 0) 0x7f9814059da0 con 0x7f982c0ad1a0 2024-09-15T22:48:46.640 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-09-15T22:48:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 msgr2=0x7f980c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 0x7f980c06f100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c008030 comp rx=0 tx=0).stop 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 msgr2=0x7f982c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f981400e800 tx=0x7f981400ecc0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 shutdown_connections 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f982c1f32c0 0x7f982c1f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f980c06cc40 0x7f980c06f100 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f982c0ad1a0 0x7f982c0b1f20 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 --2- 172.21.15.134:0/344924784 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98180039e0 0x7f982c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 >> 172.21.15.134:0/344924784 conn(0x7f982c0d4dc0 msgr2=0x7f982c0b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 shutdown_connections 2024-09-15T22:48:46.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.641+0000 7f98318dd640 1 -- 172.21.15.134:0/344924784 wait complete. 2024-09-15T22:48:46.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:48:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.761+0000 7fad1139f640 1 Processor -- start 2024-09-15T22:48:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.761+0000 7fad1139f640 1 -- start start 2024-09-15T22:48:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad1139f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad0c15e5b0 0x7fad0c0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad1139f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 0x7fad0c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad1139f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c0d0590 con 0x7fad0c0ce980 2024-09-15T22:48:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad1139f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fad0c0cb8c0 con 0x7fad0c15e5b0 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad1139f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c0d1440 con 0x7fad0c06fa30 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad0bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad0c15e5b0 0x7fad0c0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad10b9e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 0x7fad0c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad0bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad0c15e5b0 0x7fad0c0d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:34308/0 (socket says 172.21.15.134:34308) 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad0bfff640 1 -- 172.21.15.134:0/2644614447 learned_addr learned my addr 172.21.15.134:0/2644614447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad10b9e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 0x7fad0c06fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:58578/0 (socket says 172.21.15.134:58578) 2024-09-15T22:48:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.762+0000 7fad0b7fe640 1 --1- 172.21.15.134:0/2644614447 >> v1:172.21.15.177:6789/0 conn(0x7fad0c0ce980 0x7fad0c0d18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:42052/0 (socket says 172.21.15.134:42052) 2024-09-15T22:48:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0bfff640 1 -- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 msgr2=0x7fad0c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0bfff640 1 --2- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 0x7fad0c06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0bfff640 1 -- 172.21.15.134:0/2644614447 >> v1:172.21.15.177:6789/0 conn(0x7fad0c0ce980 legacy=0x7fad0c0d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0bfff640 1 -- 172.21.15.134:0/2644614447 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0d1fe0 con 0x7fad0c15e5b0 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0bfff640 1 --2- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c15e5b0 0x7fad0c0d0050 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cba40 tx=0x7facfc02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=846631c01101f4da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.763+0000 7fad0affd640 1 -- 172.21.15.134:0/2644614447 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc037070 con 0x7fad0c15e5b0 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad0affd640 1 -- 172.21.15.134:0/2644614447 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc02add0 con 0x7fad0c15e5b0 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad0affd640 1 -- 172.21.15.134:0/2644614447 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc032660 con 0x7fad0c15e5b0 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 -- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c15e5b0 msgr2=0x7fad0c0d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 --2- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c15e5b0 0x7fad0c0d0050 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cba40 tx=0x7facfc02a140 comp rx=0 tx=0).stop 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 -- 172.21.15.134:0/2644614447 shutdown_connections 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 --2- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c06fa30 0x7fad0c06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 --2- 172.21.15.134:0/2644614447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c15e5b0 0x7fad0c0d0050 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 -- 172.21.15.134:0/2644614447 >> 172.21.15.134:0/2644614447 conn(0x7fad0c06e190 msgr2=0x7fad0c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 -- 172.21.15.134:0/2644614447 shutdown_connections 2024-09-15T22:48:46.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.764+0000 7fad1139f640 1 -- 172.21.15.134:0/2644614447 wait complete. 2024-09-15T22:48:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.765+0000 7fad1139f640 1 Processor -- start 2024-09-15T22:48:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.765+0000 7fad1139f640 1 -- start start 2024-09-15T22:48:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c06fa30 0x7fad0c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c15e5b0 0x7fad0c1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0df0 con 0x7fad0c0ce980 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0b10 con 0x7fad0c06fa30 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad1139f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c0d10d0 con 0x7fad0c15e5b0 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52482/0 (socket says 172.21.15.134:52482) 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad0b7fe640 1 -- 172.21.15.134:0/1660955545 learned_addr learned my addr 172.21.15.134:0/1660955545 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad0bfff640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c06fa30 0x7fad0c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.766+0000 7fad10b9e640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c15e5b0 0x7fad0c1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 -- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c15e5b0 msgr2=0x7fad0c1f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c15e5b0 0x7fad0c1f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 -- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c06fa30 msgr2=0x7fad0c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c06fa30 0x7fad0c147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 -- 172.21.15.134:0/1660955545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c154eb0 con 0x7fad0c0ce980 2024-09-15T22:48:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad0b7fe640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c780 tx=0x7fad0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00018070 con 0x7fad0c0ce980 2024-09-15T22:48:46.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad000072d0 con 0x7fad0c0ce980 2024-09-15T22:48:46.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c155190 con 0x7fad0c0ce980 2024-09-15T22:48:46.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000047e0 con 0x7fad0c0ce980 2024-09-15T22:48:46.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.767+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c15bbd0 con 0x7fad0c0ce980 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.768+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c15e990 con 0x7fad0c0ce980 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.769+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fad00004980 con 0x7fad0c0ce980 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.769+0000 7fad08ff9640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 0x7facf806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.769+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5283+0+0 (secure 0 0 0) 0x7fad000895d0 con 0x7fad0c0ce980 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.769+0000 7fad0bfff640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 0x7facf806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.770+0000 7fad0bfff640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 0x7facf806f100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7facfc034000 tx=0x7facfc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.773+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad00021020 con 0x7fad0c0ce980 2024-09-15T22:48:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:46.940+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fad0c0ccfc0 con 0x7fad0c0ce980 2024-09-15T22:48:47.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.647+0000 7fad08ff9640 1 -- 172.21.15.134:0/1660955545 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v168) ==== 170+0+0 (secure 0 0 0) 0x7fad00004c70 con 0x7fad0c0ce980 2024-09-15T22:48:47.649 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 msgr2=0x7facf806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 0x7facf806f100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7facfc034000 tx=0x7facfc02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 msgr2=0x7fad0c154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c780 tx=0x7fad0000cc40 comp rx=0 tx=0).stop 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 shutdown_connections 2024-09-15T22:48:47.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad0c15e5b0 0x7fad0c1f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7facf806cc40 0x7facf806f100 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c0ce980 0x7fad0c154460 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 --2- 172.21.15.134:0/1660955545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0c06fa30 0x7fad0c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.650+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 >> 172.21.15.134:0/1660955545 conn(0x7fad0c06e190 msgr2=0x7fad0c06f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.651+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 shutdown_connections 2024-09-15T22:48:47.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.651+0000 7fad1139f640 1 -- 172.21.15.134:0/1660955545 wait complete. 2024-09-15T22:48:47.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:48:47.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.778+0000 7ff448d9f640 1 Processor -- start 2024-09-15T22:48:47.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.778+0000 7ff448d9f640 1 -- start start 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff448d9f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4440b6d90 0x7ff4440b7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff448d9f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4440d1d40 con 0x7ff44406d5f0 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff448d9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4440d2020 con 0x7ff44415e6d0 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff448d9f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff44406d160 con 0x7ff4440b6d90 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff443fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff44406d5f0 0x7ff44406da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56294/0 (socket says 172.21.15.134:56294) 2024-09-15T22:48:47.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.779+0000 7ff443fff640 1 -- 172.21.15.134:0/606116087 learned_addr learned my addr 172.21.15.134:0/606116087 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff442ffd640 1 --2- 172.21.15.134:0/606116087 >> v2:172.21.15.177:3300/0 conn(0x7ff4440b6d90 0x7ff4440b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679283934 0 0) 0x7ff4440d1d40 con 0x7ff44406d5f0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c003520 con 0x7ff44406d5f0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563763423 0 0) 0x7ff4440d2020 con 0x7ff44415e6d0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4440d1d40 con 0x7ff44415e6d0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 647018461 0 0) 0x7ff42c003520 con 0x7ff44406d5f0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 >> v2:172.21.15.177:3300/0 conn(0x7ff4440b6d90 msgr2=0x7ff4440b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 --2- 172.21.15.134:0/606116087 >> v2:172.21.15.177:3300/0 conn(0x7ff4440b6d90 0x7ff4440b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 >> v1:172.21.15.177:6789/0 conn(0x7ff44415e6d0 legacy=0x7ff44406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44406cdf0 con 0x7ff44406d5f0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7ff43c001670 con 0x7ff44406d5f0 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 >> v1:172.21.15.134:6789/0 conn(0x7ff44406d5f0 legacy=0x7ff44406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 0x7ff42c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c004800 0x7ff42c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42c0051c0 0x7ff42c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff44406d160 con 0x7ff42c003b90 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c00c090 con 0x7ff42c004800 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c00c290 con 0x7ff42c0051c0 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 0x7ff42c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff443fff640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42c0051c0 0x7ff42c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff442ffd640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c004800 0x7ff42c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 -- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42c0051c0 msgr2=0x7ff42c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42c0051c0 0x7ff42c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 -- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c004800 msgr2=0x7ff42c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c004800 0x7ff42c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff4437fe640 1 -- 172.21.15.134:0/606116087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c003520 con 0x7ff42c003b90 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.780+0000 7ff443fff640 1 -- 172.21.15.134:0/606116087 reap_dead start 2024-09-15T22:48:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.781+0000 7ff4437fe640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 0x7ff42c003f90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff434001fd0 tx=0x7ff42c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d317697bffc6f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.781+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434001bf0 con 0x7ff42c003b90 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.781+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff434003b70 con 0x7ff42c003b90 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.781+0000 7ff4427fc640 1 -- 172.21.15.134:0/606116087 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4340050d0 con 0x7ff42c003b90 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 -- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 msgr2=0x7ff42c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 0x7ff42c003f90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff434001fd0 tx=0x7ff42c005830 comp rx=0 tx=0).stop 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 -- 172.21.15.134:0/606116087 shutdown_connections 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 --2- 172.21.15.134:0/606116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c003b90 0x7ff42c003f90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 -- 172.21.15.134:0/606116087 >> 172.21.15.134:0/606116087 conn(0x7ff4440b4220 msgr2=0x7ff4440b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 -- 172.21.15.134:0/606116087 shutdown_connections 2024-09-15T22:48:47.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.782+0000 7ff448d9f640 1 -- 172.21.15.134:0/606116087 wait complete. 2024-09-15T22:48:47.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.783+0000 7ff448d9f640 1 Processor -- start 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.783+0000 7ff448d9f640 1 -- start start 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c003b90 0x7ff4441558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4441f3fc0 0x7ff444157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4440b7380 con 0x7ff44415cff0 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4440b7200 con 0x7ff42c003b90 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff448d9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff4440b7500 con 0x7ff4441f3fc0 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52512/0 (socket says 172.21.15.134:52512) 2024-09-15T22:48:47.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 -- 172.21.15.134:0/3637874127 learned_addr learned my addr 172.21.15.134:0/3637874127 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff4437fe640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c003b90 0x7ff4441558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff442ffd640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4441f3fc0 0x7ff444157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 -- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4441f3fc0 msgr2=0x7ff444157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4441f3fc0 0x7ff444157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 -- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c003b90 msgr2=0x7ff4441558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c003b90 0x7ff4441558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 -- 172.21.15.134:0/3637874127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4441f4530 con 0x7ff44415cff0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.784+0000 7ff443fff640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff4440b1660 tx=0x7ff43c00e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.785+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c019070 con 0x7ff44415cff0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.785+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c010510 con 0x7ff44415cff0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.785+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c010900 con 0x7ff44415cff0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.785+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441f4810 con 0x7ff44415cff0 2024-09-15T22:48:47.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.785+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441f4dd0 con 0x7ff44415cff0 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.786+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44406fc00 con 0x7ff44415cff0 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.786+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7ff43c01c070 con 0x7ff44415cff0 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.787+0000 7ff42bfff640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 0x7ff43006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.787+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5665+0+0 (secure 0 0 0) 0x7ff43c089090 con 0x7ff44415cff0 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.787+0000 7ff4437fe640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 0x7ff43006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:47.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.787+0000 7ff4437fe640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 0x7ff43006f130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff434032000 tx=0x7ff43402f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:47.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.791+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff43c058db0 con 0x7ff44415cff0 2024-09-15T22:48:47.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:47.993+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff4440b3210 con 0x7ff44415cff0 2024-09-15T22:48:48.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.649+0000 7ff42bfff640 1 -- 172.21.15.134:0/3637874127 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v87) ==== 174+0+0 (secure 0 0 0) 0x7ff43c05d0b0 con 0x7ff44415cff0 2024-09-15T22:48:48.650 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 26 and data pool 27 2024-09-15T22:48:48.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.653+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 msgr2=0x7ff43006f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.653+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 0x7ff43006f130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff434032000 tx=0x7ff43402f000 comp rx=0 tx=0).stop 2024-09-15T22:48:48.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.653+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 msgr2=0x7ff444148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.653+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff4440b1660 tx=0x7ff43c00e960 comp rx=0 tx=0).stop 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 shutdown_connections 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff43006cc70 0x7ff43006f130 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44415cff0 0x7ff444148b20 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4441f3fc0 0x7ff444157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 --2- 172.21.15.134:0/3637874127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff42c003b90 0x7ff4441558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 >> 172.21.15.134:0/3637874127 conn(0x7ff4440b4220 msgr2=0x7ff4440b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 shutdown_connections 2024-09-15T22:48:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.654+0000 7ff448d9f640 1 -- 172.21.15.134:0/3637874127 wait complete. 2024-09-15T22:48:48.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.784+0000 7fe6303cf640 1 Processor -- start 2024-09-15T22:48:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.784+0000 7fe6303cf640 1 -- start start 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe6303cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe628169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe6303cf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62815ecf0 con 0x7fe6280cd300 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe6303cf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62815c6e0 con 0x7fe62815c300 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe6303cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe62815efb0 con 0x7fe62806f1e0 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d96a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe6280cd300 0x7fe62806ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56306/0 (socket says 172.21.15.134:56306) 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d96a640 1 -- 172.21.15.134:0/784271562 learned_addr learned my addr 172.21.15.134:0/784271562 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62e96c640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe628169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861704972 0 0) 0x7fe62815ecf0 con 0x7fe6280cd300 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe614003520 con 0x7fe6280cd300 2024-09-15T22:48:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2370329600 0 0) 0x7fe614003520 con 0x7fe6280cd300 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 msgr2=0x7fe628169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe628169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 >> v1:172.21.15.177:6789/0 conn(0x7fe62815c300 legacy=0x7fe6280affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62815f290 con 0x7fe6280cd300 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.785+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fe618001670 con 0x7fe6280cd300 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 >> v1:172.21.15.134:6789/0 conn(0x7fe6280cd300 legacy=0x7fe62806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe614003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe614004390 0x7fe614004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe614005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe62815efb0 con 0x7fe6140039e0 2024-09-15T22:48:48.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe61400baa0 con 0x7fe614004390 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe61400bca0 con 0x7fe62806f1e0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe614003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62d96a640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe614004390 0x7fe614004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e96c640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe614005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 -- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 msgr2=0x7fe614005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe62806f1e0 0x7fe614005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 -- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe614004390 msgr2=0x7fe614004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe614004390 0x7fe614004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.786+0000 7fe62e16b640 1 -- 172.21.15.134:0/784271562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe614003520 con 0x7fe6140039e0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe62e16b640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe614003dc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe624001860 tx=0x7fe614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec1b18ea1d9f1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:48.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624037070 con 0x7fe6140039e0 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62402ac30 con 0x7fe6140039e0 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe62d169640 1 -- 172.21.15.134:0/784271562 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624001430 con 0x7fe6140039e0 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 -- 172.21.15.134:0/784271562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 msgr2=0x7fe614003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 --2- 172.21.15.134:0/784271562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe614003dc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe624001860 tx=0x7fe614005830 comp rx=0 tx=0).stop 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe62e96c640 1 -- 172.21.15.134:0/784271562 reap_dead start 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 -- 172.21.15.134:0/784271562 shutdown_connections 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 -- 172.21.15.134:0/784271562 >> 172.21.15.134:0/784271562 conn(0x7fe62806cae0 msgr2=0x7fe62806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 -- 172.21.15.134:0/784271562 shutdown_connections 2024-09-15T22:48:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.787+0000 7fe6303cf640 1 -- 172.21.15.134:0/784271562 wait complete. 2024-09-15T22:48:48.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.788+0000 7fe6303cf640 1 Processor -- start 2024-09-15T22:48:48.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 -- start start 2024-09-15T22:48:48.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6281612c0 0x7fe628161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe628158080 0x7fe628158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe628071880 con 0x7fe6140039e0 2024-09-15T22:48:48.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe62815f850 con 0x7fe6281612c0 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe6303cf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe628167450 con 0x7fe628158080 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe62e16b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe62e16b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52530/0 (socket says 172.21.15.134:52530) 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe62e16b640 1 -- 172.21.15.134:0/2204598153 learned_addr learned my addr 172.21.15.134:0/2204598153 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.789+0000 7fe62d96a640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6281612c0 0x7fe628161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e96c640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe628158080 0x7fe628158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 -- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe628158080 msgr2=0x7fe628158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe628158080 0x7fe628158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 -- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6281612c0 msgr2=0x7fe628161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6281612c0 0x7fe628161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 -- 172.21.15.134:0/2204598153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe628161df0 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe62e16b640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe624000c00 tx=0x7fe624001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624040020 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe624005270 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe628151d40 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624037040 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.790+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe628152300 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.791+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62806ead0 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.792+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fe624043020 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.792+0000 7fe61effd640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 0x7fe60c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.792+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5765+0+0 (secure 0 0 0) 0x7fe6240a9a90 con 0x7fe6140039e0 2024-09-15T22:48:48.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.792+0000 7fe62d96a640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 0x7fe60c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:48.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.793+0000 7fe62d96a640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 0x7fe60c06f100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe618001200 tx=0x7fe618009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:48.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.796+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe62404a030 con 0x7fe6140039e0 2024-09-15T22:48:48.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.963+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6281538d0 con 0x7fe6140039e0 2024-09-15T22:48:48.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.964+0000 7fe61effd640 1 -- 172.21.15.134:0/2204598153 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+16813 (secure 0 0 0) 0x7fe624079e00 con 0x7fe6140039e0 2024-09-15T22:48:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:48.966 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":169,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:47.994583+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:46.326071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:46.958921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 msgr2=0x7fe60c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 0x7fe60c06f100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe618001200 tx=0x7fe618009040 comp rx=0 tx=0).stop 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 msgr2=0x7fe628148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe624000c00 tx=0x7fe624001230 comp rx=0 tx=0).stop 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 shutdown_connections 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe628158080 0x7fe628158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6281612c0 0x7fe628161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe60c06cc40 0x7fe60c06f100 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 --2- 172.21.15.134:0/2204598153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6140039e0 0x7fe628148f10 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:48.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 >> 172.21.15.134:0/2204598153 conn(0x7fe62806cae0 msgr2=0x7fe628156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:48.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 shutdown_connections 2024-09-15T22:48:48.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:48.966+0000 7fe6303cf640 1 -- 172.21.15.134:0/2204598153 wait complete. 2024-09-15T22:48:48.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:49.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.076+0000 7f8724b9f640 1 Processor -- start 2024-09-15T22:48:49.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.076+0000 7f8724b9f640 1 -- start start 2024-09-15T22:48:49.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f8724b9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f8724b9f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872006bee0 con 0x7f872015e640 2024-09-15T22:48:49.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f8724b9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872006c1c0 con 0x7f87200b5fd0 2024-09-15T22:48:49.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f8724b9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f872015ea20 con 0x7f87200b6410 2024-09-15T22:48:49.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f871f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f872015e640 0x7f87200d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56314/0 (socket says 172.21.15.134:56314) 2024-09-15T22:48:49.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.077+0000 7f871f7fe640 1 -- 172.21.15.134:0/4006995152 learned_addr learned my addr 172.21.15.134:0/4006995152 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:49.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871ffff640 1 --2- 172.21.15.134:0/4006995152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084997116 0 0) 0x7f872006bee0 con 0x7f872015e640 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8708003520 con 0x7f872015e640 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455895759 0 0) 0x7f872006c1c0 con 0x7f87200b5fd0 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f872006bee0 con 0x7f87200b5fd0 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871ffff640 1 -- 172.21.15.134:0/4006995152 >> v1:172.21.15.177:6789/0 conn(0x7f87200b5fd0 legacy=0x7f87200b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2674937752 0 0) 0x7f8708003520 con 0x7f872015e640 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871ffff640 1 -- 172.21.15.134:0/4006995152 >> v1:172.21.15.134:6789/0 conn(0x7f872015e640 legacy=0x7f87200d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.078+0000 7f871ffff640 1 -- 172.21.15.134:0/4006995152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872006c4a0 con 0x7f87200b6410 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f871ffff640 1 --2- 172.21.15.134:0/4006995152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200b7e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f87180097d0 tx=0x7f871802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ceb2fe6358138a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718037070 con 0x7f87200b6410 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871802ac30 con 0x7f87200b6410 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f871e7fc640 1 -- 172.21.15.134:0/4006995152 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87100019f0 con 0x7f87200b6410 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 -- 172.21.15.134:0/4006995152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 msgr2=0x7f87200b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 --2- 172.21.15.134:0/4006995152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200b7e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f87180097d0 tx=0x7f871802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 -- 172.21.15.134:0/4006995152 shutdown_connections 2024-09-15T22:48:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 --2- 172.21.15.134:0/4006995152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200b7e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 -- 172.21.15.134:0/4006995152 >> 172.21.15.134:0/4006995152 conn(0x7f87200d0fd0 msgr2=0x7f87200d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 -- 172.21.15.134:0/4006995152 shutdown_connections 2024-09-15T22:48:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.079+0000 7f8724b9f640 1 -- 172.21.15.134:0/4006995152 wait complete. 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.080+0000 7f8724b9f640 1 Processor -- start 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 -- start start 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872015e640 0x7f8720157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87200b68a0 con 0x7f87200b5fd0 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f872006caf0 con 0x7f872015e640 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.081+0000 7f8724b9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f87200d4130 con 0x7f87200b6410 2024-09-15T22:48:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52536/0 (socket says 172.21.15.134:52536) 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 -- 172.21.15.134:0/3424281828 learned_addr learned my addr 172.21.15.134:0/3424281828 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871ffff640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872015e640 0x7f8720157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871effd640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 -- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 msgr2=0x7f87200cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 -- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872015e640 msgr2=0x7f8720157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872015e640 0x7f8720157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 -- 172.21.15.134:0/3424281828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8720158900 con 0x7f87200b5fd0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f871f7fe640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f871000cbf0 tx=0x7f871000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710017070 con 0x7f87200b5fd0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871000ad50 con 0x7f87200b5fd0 2024-09-15T22:48:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710012640 con 0x7f87200b5fd0 2024-09-15T22:48:49.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8720158be0 con 0x7f87200b5fd0 2024-09-15T22:48:49.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.082+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201591a0 con 0x7f87200b5fd0 2024-09-15T22:48:49.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.083+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87200d3a20 con 0x7f87200b5fd0 2024-09-15T22:48:49.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.084+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f871001a070 con 0x7f87200b5fd0 2024-09-15T22:48:49.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.084+0000 7f8707fff640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 0x7f870c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.084+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5765+0+0 (secure 0 0 0) 0x7f8710089a00 con 0x7f87200b5fd0 2024-09-15T22:48:49.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.084+0000 7f871effd640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 0x7f870c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.085+0000 7f871effd640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 0x7f870c06f130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f872015cbb0 tx=0x7f8714009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.088+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8710059720 con 0x7f87200b5fd0 2024-09-15T22:48:49.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.255+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87200caca0 con 0x7f87200b5fd0 2024-09-15T22:48:49.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.256+0000 7f8707fff640 1 -- 172.21.15.134:0/3424281828 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+16813 (secure 0 0 0) 0x7f871005da20 con 0x7f87200b5fd0 2024-09-15T22:48:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:49.258 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":169,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:47.994583+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:46.326071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:46.958921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 msgr2=0x7f870c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 0x7f870c06f130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f872015cbb0 tx=0x7f8714009040 comp rx=0 tx=0).stop 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 msgr2=0x7f87200ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f871000cbf0 tx=0x7f871000a430 comp rx=0 tx=0).stop 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 shutdown_connections 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f872015e640 0x7f8720157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87200b6410 0x7f87200cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f870c06cc70 0x7f870c06f130 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 --2- 172.21.15.134:0/3424281828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87200b5fd0 0x7f87200ca700 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 >> 172.21.15.134:0/3424281828 conn(0x7f87200d0fd0 msgr2=0x7f87200b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:49.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 shutdown_connections 2024-09-15T22:48:49.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.258+0000 7f8724b9f640 1 -- 172.21.15.134:0/3424281828 wait complete. 2024-09-15T22:48:49.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:48:49.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.370+0000 7f2565eba640 1 Processor -- start 2024-09-15T22:48:49.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.371+0000 7f2565eba640 1 -- start start 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.371+0000 7f2565eba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f256006dfd0 0x7f25600b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.371+0000 7f2565eba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25600cf9a0 con 0x7f25600b3d50 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.371+0000 7f2565eba640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2560162210 con 0x7f2560161e30 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.371+0000 7f2565eba640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f25600cfcf0 con 0x7f256006dfd0 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f25600b3d50 0x7f256006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56328/0 (socket says 172.21.15.134:56328) 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255effd640 1 -- 172.21.15.134:0/3712579328 learned_addr learned my addr 172.21.15.134:0/3712579328 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255ffff640 1 --2- 172.21.15.134:0/3712579328 >> v2:172.21.15.177:3300/0 conn(0x7f256006dfd0 0x7f25600b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778525413 0 0) 0x7f25600cf9a0 con 0x7f25600b3d50 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2548003520 con 0x7f25600b3d50 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653562633 0 0) 0x7f2560162210 con 0x7f2560161e30 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25600cf9a0 con 0x7f2560161e30 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255ffff640 1 -- 172.21.15.134:0/3712579328 >> v1:172.21.15.177:6789/0 conn(0x7f2560161e30 legacy=0x7f25600d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255ffff640 1 -- 172.21.15.134:0/3712579328 >> v1:172.21.15.134:6789/0 conn(0x7f25600b3d50 legacy=0x7f256006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.372+0000 7f255ffff640 1 -- 172.21.15.134:0/3712579328 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25600d5210 con 0x7f256006dfd0 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f255ffff640 1 --2- 172.21.15.134:0/3712579328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f25600b78b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25580097a0 tx=0x7f255802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f990d6114173529 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037070 con 0x7f256006dfd0 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558032440 con 0x7f256006dfd0 2024-09-15T22:48:49.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f255e7fc640 1 -- 172.21.15.134:0/3712579328 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558032810 con 0x7f256006dfd0 2024-09-15T22:48:49.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f2565eba640 1 -- 172.21.15.134:0/3712579328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 msgr2=0x7f25600b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f2565eba640 1 --2- 172.21.15.134:0/3712579328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f25600b78b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25580097a0 tx=0x7f255802a230 comp rx=0 tx=0).stop 2024-09-15T22:48:49.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f2565eba640 1 -- 172.21.15.134:0/3712579328 shutdown_connections 2024-09-15T22:48:49.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.373+0000 7f2565eba640 1 --2- 172.21.15.134:0/3712579328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f25600b78b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.374+0000 7f2565eba640 1 -- 172.21.15.134:0/3712579328 >> 172.21.15.134:0/3712579328 conn(0x7f25600d1870 msgr2=0x7f25600d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:49.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.374+0000 7f2565eba640 1 -- 172.21.15.134:0/3712579328 shutdown_connections 2024-09-15T22:48:49.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.374+0000 7f2565eba640 1 -- 172.21.15.134:0/3712579328 wait complete. 2024-09-15T22:48:49.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.375+0000 7f2565eba640 1 Processor -- start 2024-09-15T22:48:49.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.375+0000 7f2565eba640 1 -- start start 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.375+0000 7f2565eba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f2560155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25600b3d50 0x7f25601f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25600b3290 con 0x7f2560161e30 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f25600b3950 con 0x7f256006dfd0 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f25600b3410 con 0x7f25600b3d50 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52538/0 (socket says 172.21.15.134:52538) 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 -- 172.21.15.134:0/2616439944 learned_addr learned my addr 172.21.15.134:0/2616439944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255f7fe640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f2560155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255effd640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25600b3d50 0x7f25601f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 -- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25600b3d50 msgr2=0x7f25601f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25600b3d50 0x7f25601f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 -- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 msgr2=0x7f2560155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f2560155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 -- 172.21.15.134:0/2616439944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2560159ef0 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f255ffff640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f2558035040 tx=0x7f25580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558041020 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255803d640 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037040 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256015c2b0 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.376+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256015a470 con 0x7f2560161e30 2024-09-15T22:48:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.377+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256006d8c0 con 0x7f2560161e30 2024-09-15T22:48:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.378+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f2558044020 con 0x7f2560161e30 2024-09-15T22:48:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.378+0000 7f2547fff640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 0x7f254c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.378+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5765+0+0 (secure 0 0 0) 0x7f25580aa270 con 0x7f2560161e30 2024-09-15T22:48:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.378+0000 7f255f7fe640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 0x7f254c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.379+0000 7f255f7fe640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 0x7f254c06f100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2550001e00 tx=0x7f2550009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.382+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f255804b030 con 0x7f2560161e30 2024-09-15T22:48:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.583+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2560069190 con 0x7f2560161e30 2024-09-15T22:48:49.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.667+0000 7f2547fff640 1 -- 172.21.15.134:0/2616439944 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) ==== 118+0+0 (secure 0 0 0) 0x7f2558079f10 con 0x7f2560161e30 2024-09-15T22:48:49.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 msgr2=0x7f254c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 0x7f254c06f100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2550001e00 tx=0x7f2550009040 comp rx=0 tx=0).stop 2024-09-15T22:48:49.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 msgr2=0x7f25600cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f2558035040 tx=0x7f25580046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 shutdown_connections 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f254c06cc40 0x7f254c06f100 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2560161e30 0x7f25600cbad0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25600b3d50 0x7f25601f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 --2- 172.21.15.134:0/2616439944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256006dfd0 0x7f2560155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 >> 172.21.15.134:0/2616439944 conn(0x7f25600d1870 msgr2=0x7f25600b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 shutdown_connections 2024-09-15T22:48:49.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.670+0000 7f2565eba640 1 -- 172.21.15.134:0/2616439944 wait complete. 2024-09-15T22:48:49.682 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:48:49.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:48:49.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 Processor -- start 2024-09-15T22:48:49.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 -- start start 2024-09-15T22:48:49.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 0x7f14c806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c80cf9a0 con 0x7f14c8161e30 2024-09-15T22:48:49.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f14c80cfcf0 con 0x7f14c80b3290 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.783+0000 7f14cd95f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14c8162210 con 0x7f14c80b3d50 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 0x7f14c806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:58674/0 (socket says 172.21.15.134:58674) 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 -- 172.21.15.134:0/182388347 learned_addr learned my addr 172.21.15.134:0/182388347 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c6ffd640 1 --1- 172.21.15.134:0/182388347 >> v1:172.21.15.177:6789/0 conn(0x7f14c8161e30 0x7f14c80d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:42092/0 (socket says 172.21.15.134:42092) 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 -- 172.21.15.134:0/182388347 >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 msgr2=0x7f14c806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 --2- 172.21.15.134:0/182388347 >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 0x7f14c806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 -- 172.21.15.134:0/182388347 >> v1:172.21.15.177:6789/0 conn(0x7f14c8161e30 legacy=0x7f14c80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c67fc640 1 -- 172.21.15.134:0/182388347 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c80d5210 con 0x7f14c80b3d50 2024-09-15T22:48:49.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.784+0000 7f14c77fe640 1 --2- 172.21.15.134:0/182388347 >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 0x7f14c806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.785+0000 7f14c67fc640 1 --2- 172.21.15.134:0/182388347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009870 tx=0x7f14bc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a28449ecac19fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.785+0000 7f14c5ffb640 1 -- 172.21.15.134:0/182388347 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc037070 con 0x7f14c80b3d50 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.785+0000 7f14c5ffb640 1 -- 172.21.15.134:0/182388347 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc032440 con 0x7f14c80b3d50 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.785+0000 7f14c5ffb640 1 -- 172.21.15.134:0/182388347 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc032810 con 0x7f14c80b3d50 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 -- 172.21.15.134:0/182388347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 msgr2=0x7f14c806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 --2- 172.21.15.134:0/182388347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009870 tx=0x7f14bc02a270 comp rx=0 tx=0).stop 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 -- 172.21.15.134:0/182388347 shutdown_connections 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 --2- 172.21.15.134:0/182388347 >> v2:172.21.15.177:3300/0 conn(0x7f14c80b3290 0x7f14c806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 --2- 172.21.15.134:0/182388347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80b3d50 0x7f14c806d8c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 -- 172.21.15.134:0/182388347 >> 172.21.15.134:0/182388347 conn(0x7f14c80d1870 msgr2=0x7f14c80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 -- 172.21.15.134:0/182388347 shutdown_connections 2024-09-15T22:48:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.786+0000 7f14cd95f640 1 -- 172.21.15.134:0/182388347 wait complete. 2024-09-15T22:48:49.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.787+0000 7f14cd95f640 1 Processor -- start 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.787+0000 7f14cd95f640 1 -- start start 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 0x7f14c80cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 0x7f14c8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14c80b78b0 con 0x7f14c80b3d50 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f14c80b3950 con 0x7f14c80b3290 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f14c80b7a30 con 0x7f14c8161e30 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52546/0 (socket says 172.21.15.134:52546) 2024-09-15T22:48:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 -- 172.21.15.134:0/260017345 learned_addr learned my addr 172.21.15.134:0/260017345 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c6ffd640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 0x7f14c80cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c77fe640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 0x7f14c8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 -- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 msgr2=0x7f14c8156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 0x7f14c8156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 -- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 msgr2=0x7f14c80cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 0x7f14c80cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 -- 172.21.15.134:0/260017345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c80c8540 con 0x7f14c80b3d50 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c6ffd640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 0x7f14c80cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c77fe640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 0x7f14c8156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14c67fc640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000c00 tx=0x7f14bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc037040 con 0x7f14c80b3d50 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc042070 con 0x7f14c80b3d50 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c80c8820 con 0x7f14c80b3d50 2024-09-15T22:48:49.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.788+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc030860 con 0x7f14c80b3d50 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.789+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c80c8de0 con 0x7f14c80b3d50 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.789+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c8068e90 con 0x7f14c80b3d50 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.790+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f14bc030a00 con 0x7f14c80b3d50 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.790+0000 7f14affff640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 0x7f14b406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.791+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f14bc0aa440 con 0x7f14c80b3d50 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.791+0000 7f14c6ffd640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 0x7f14b406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:49.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.791+0000 7f14c6ffd640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 0x7f14b406f100 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000f60 tx=0x7f14b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:49.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.795+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14c8068e90 con 0x7f14c80b3d50 2024-09-15T22:48:49.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:49.996+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f14c80d34a0 con 0x7f14c80b3d50 2024-09-15T22:48:50.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.668+0000 7f14affff640 1 -- 172.21.15.134:0/260017345 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) ==== 122+0+0 (secure 0 0 0) 0x7f14bc045360 con 0x7f14c80b3d50 2024-09-15T22:48:50.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 msgr2=0x7f14b406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 0x7f14b406f100 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000f60 tx=0x7f14b8009040 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 msgr2=0x7f14c8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000c00 tx=0x7f14bc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 shutdown_connections 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c8161e30 0x7f14c8156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f14b406cc40 0x7f14b406f100 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c80b3d50 0x7f14c8154c60 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 --2- 172.21.15.134:0/260017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80b3290 0x7f14c80cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 >> 172.21.15.134:0/260017345 conn(0x7f14c80d1870 msgr2=0x7f14c80d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 shutdown_connections 2024-09-15T22:48:50.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.671+0000 7f14cd95f640 1 -- 172.21.15.134:0/260017345 wait complete. 2024-09-15T22:48:50.686 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:48:50.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:50.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.789+0000 7fb43b986640 1 Processor -- start 2024-09-15T22:48:50.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.790+0000 7fb43b986640 1 -- start start 2024-09-15T22:48:50.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb43b986640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb43415e940 0x7fb4340d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb43b986640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4340cef90 0x7fb4340d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb43b986640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340b7170 con 0x7fb43415ed20 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb43b986640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb4340d1ae0 con 0x7fb4340cef90 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb43b986640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb4340b7aa0 con 0x7fb43415e940 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4340cef90 0x7fb4340d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4340cef90 0x7fb4340d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52558/0 (socket says 172.21.15.134:52558) 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 -- 172.21.15.134:0/3651938723 learned_addr learned my addr 172.21.15.134:0/3651938723 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 -- 172.21.15.134:0/3651938723 >> v2:172.21.15.177:3300/0 conn(0x7fb43415e940 msgr2=0x7fb4340d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 --2- 172.21.15.134:0/3651938723 >> v2:172.21.15.177:3300/0 conn(0x7fb43415e940 0x7fb4340d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 -- 172.21.15.134:0/3651938723 >> v1:172.21.15.177:6789/0 conn(0x7fb43415ed20 legacy=0x7fb4340b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:50.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.791+0000 7fb439f23640 1 -- 172.21.15.134:0/3651938723 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340d3660 con 0x7fb4340cef90 2024-09-15T22:48:50.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.792+0000 7fb439f23640 1 --2- 172.21.15.134:0/3651938723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4340cef90 0x7fb4340d15a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb4340509d0 tx=0x7fb42c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205f3f88990bdb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.792+0000 7fb427fff640 1 -- 172.21.15.134:0/3651938723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c036070 con 0x7fb4340cef90 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.792+0000 7fb427fff640 1 -- 172.21.15.134:0/3651938723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c031600 con 0x7fb4340cef90 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.792+0000 7fb427fff640 1 -- 172.21.15.134:0/3651938723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0319d0 con 0x7fb4340cef90 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 -- 172.21.15.134:0/3651938723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4340cef90 msgr2=0x7fb4340d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 --2- 172.21.15.134:0/3651938723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4340cef90 0x7fb4340d15a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb4340509d0 tx=0x7fb42c02a780 comp rx=0 tx=0).stop 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 -- 172.21.15.134:0/3651938723 shutdown_connections 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 --2- 172.21.15.134:0/3651938723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4340cef90 0x7fb4340d15a0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 --2- 172.21.15.134:0/3651938723 >> v2:172.21.15.177:3300/0 conn(0x7fb43415e940 0x7fb4340d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 -- 172.21.15.134:0/3651938723 >> 172.21.15.134:0/3651938723 conn(0x7fb4340b6240 msgr2=0x7fb4340b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 -- 172.21.15.134:0/3651938723 shutdown_connections 2024-09-15T22:48:50.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.793+0000 7fb43b986640 1 -- 172.21.15.134:0/3651938723 wait complete. 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.794+0000 7fb43b986640 1 Processor -- start 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.794+0000 7fb43b986640 1 -- start start 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4340cef90 0x7fb4340c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb43415e940 0x7fb4340b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d3f00 con 0x7fb43415ed20 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d3c20 con 0x7fb43415e940 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340d3310 con 0x7fb4340cef90 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52562/0 (socket says 172.21.15.134:52562) 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 -- 172.21.15.134:0/2924162644 learned_addr learned my addr 172.21.15.134:0/2924162644 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb438f21640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb43415e940 0x7fb4340b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439722640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4340cef90 0x7fb4340c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 -- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4340cef90 msgr2=0x7fb4340c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4340cef90 0x7fb4340c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 -- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb43415e940 msgr2=0x7fb4340b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb43415e940 0x7fb4340b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 -- 172.21.15.134:0/2924162644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340c8c00 con 0x7fb43415ed20 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb439f23640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009f40 tx=0x7fb42c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c041020 con 0x7fb43415ed20 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c007780 con 0x7fb43415ed20 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb434159530 con 0x7fb43415ed20 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.795+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c036040 con 0x7fb43415ed20 2024-09-15T22:48:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.796+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb434159af0 con 0x7fb43415ed20 2024-09-15T22:48:50.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.797+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4340d1ef0 con 0x7fb43415ed20 2024-09-15T22:48:50.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.797+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fb42c044020 con 0x7fb43415ed20 2024-09-15T22:48:50.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.798+0000 7fb425ffb640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 0x7fb41806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:50.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.798+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fb42c0aaa00 con 0x7fb43415ed20 2024-09-15T22:48:50.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.798+0000 7fb439722640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 0x7fb41806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:50.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.798+0000 7fb439722640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 0x7fb41806f100 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb428009890 tx=0x7fb428008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:50.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.802+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb42c04b030 con 0x7fb43415ed20 2024-09-15T22:48:50.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.998+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4340ce8c0 con 0x7fb43415ed20 2024-09-15T22:48:51.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:50.999+0000 7fb425ffb640 1 -- 172.21.15.134:0/2924162644 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5230 (secure 0 0 0) 0x7fb4340b7170 con 0x7fb43415ed20 2024-09-15T22:48:51.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:51.001 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":89,"btime":"2024-09-15T22:48:50:667986+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:48:51.001 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 89 2024-09-15T22:48:51.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 msgr2=0x7fb41806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 0x7fb41806f100 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb428009890 tx=0x7fb428008040 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 msgr2=0x7fb4340b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009f40 tx=0x7fb42c004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 shutdown_connections 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb41806cc40 0x7fb41806f100 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb43415ed20 0x7fb4340b5a20 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb43415e940 0x7fb4340b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 --2- 172.21.15.134:0/2924162644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4340cef90 0x7fb4340c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 >> 172.21.15.134:0/2924162644 conn(0x7fb4340b6240 msgr2=0x7fb4340b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 shutdown_connections 2024-09-15T22:48:51.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.001+0000 7fb43b986640 1 -- 172.21.15.134:0/2924162644 wait complete. 2024-09-15T22:48:51.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:48:51.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.110+0000 7f35c7111640 1 Processor -- start 2024-09-15T22:48:51.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.110+0000 7f35c7111640 1 -- start start 2024-09-15T22:48:51.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35c7111640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35c006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35c7111640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c0160570 con 0x7f35c015ff90 2024-09-15T22:48:51.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35c7111640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c0160850 con 0x7f35c015c430 2024-09-15T22:48:51.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35c7111640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f35c0160b30 con 0x7f35c00d0940 2024-09-15T22:48:51.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35b7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f35c015ff90 0x7f35c00d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56340/0 (socket says 172.21.15.134:56340) 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35b7fff640 1 -- 172.21.15.134:0/2560964463 learned_addr learned my addr 172.21.15.134:0/2560964463 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35c56ae640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35c006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675077990 0 0) 0x7f35c0160570 con 0x7f35c015ff90 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.111+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a8003520 con 0x7f35c015ff90 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965224028 0 0) 0x7f35a8003520 con 0x7f35c015ff90 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 msgr2=0x7f35c006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35c006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 >> v1:172.21.15.177:6789/0 conn(0x7f35c015c430 legacy=0x7f35c015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c006e230 con 0x7f35c015ff90 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f35b0001690 con 0x7f35c015ff90 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 >> v1:172.21.15.134:6789/0 conn(0x7f35c015ff90 legacy=0x7f35c00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80039e0 0x7f35a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a8004d40 0x7f35a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0160b30 con 0x7f35a8004d40 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f35a800b9f0 con 0x7f35a80039e0 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f35a800bbf0 con 0x7f35c00d0940 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a8004d40 0x7f35a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35b7fff640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c4ead640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80039e0 0x7f35a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 -- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 msgr2=0x7f35a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35c00d0940 0x7f35a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 -- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80039e0 msgr2=0x7f35a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80039e0 0x7f35a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.112+0000 7f35c56ae640 1 -- 172.21.15.134:0/2560964463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a8003520 con 0x7f35a8004d40 2024-09-15T22:48:51.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c56ae640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a8004d40 0x7f35a80051c0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009f90 tx=0x7f35a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3aa77900ab2ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009c10 con 0x7f35a8004d40 2024-09-15T22:48:51.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8036070 con 0x7f35a8004d40 2024-09-15T22:48:51.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35b77fe640 1 -- 172.21.15.134:0/2560964463 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8031850 con 0x7f35a8004d40 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c7111640 1 -- 172.21.15.134:0/2560964463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a8004d40 msgr2=0x7f35a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c7111640 1 --2- 172.21.15.134:0/2560964463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a8004d40 0x7f35a80051c0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009f90 tx=0x7f35a8005830 comp rx=0 tx=0).stop 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c56ae640 1 -- 172.21.15.134:0/2560964463 reap_dead start 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c7111640 1 -- 172.21.15.134:0/2560964463 shutdown_connections 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.113+0000 7f35c7111640 1 -- 172.21.15.134:0/2560964463 >> 172.21.15.134:0/2560964463 conn(0x7f35c00702d0 msgr2=0x7f35c00d1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.114+0000 7f35c7111640 1 -- 172.21.15.134:0/2560964463 shutdown_connections 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.114+0000 7f35c7111640 1 -- 172.21.15.134:0/2560964463 wait complete. 2024-09-15T22:48:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.115+0000 7f35c7111640 1 Processor -- start 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.115+0000 7f35c7111640 1 -- start start 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a8004d40 0x7f35c0150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 0x7f35c00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015d0a0 con 0x7f35c00ca470 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015cf20 con 0x7f35c00cb9b0 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f35c006c5b0 con 0x7f35a8004d40 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52578/0 (socket says 172.21.15.134:52578) 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 -- 172.21.15.134:0/1849123916 learned_addr learned my addr 172.21.15.134:0/1849123916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c4ead640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a8004d40 0x7f35c0150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35b7fff640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 0x7f35c00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 -- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a8004d40 msgr2=0x7f35c0150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a8004d40 0x7f35c0150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 -- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 msgr2=0x7f35c00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 0x7f35c00cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 -- 172.21.15.134:0/1849123916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c01506b0 con 0x7f35c00ca470 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35b7fff640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 0x7f35c00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c56ae640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009f90 tx=0x7f35b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009c10 con 0x7f35c00ca470 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8003990 con 0x7f35c00ca470 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c00aa720 con 0x7f35c00ca470 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8003d80 con 0x7f35c00ca470 2024-09-15T22:48:51.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.116+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c00aace0 con 0x7f35c00ca470 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.117+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c006c940 con 0x7f35c00ca470 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.118+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f35b8005d10 con 0x7f35c00ca470 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.118+0000 7f35b57fa640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 0x7f35ac06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.118+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f35b80ab0a0 con 0x7f35c00ca470 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.118+0000 7f35c4ead640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 0x7f35ac06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.119+0000 7f35c4ead640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 0x7f35ac06f130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b3660 tx=0x7f35bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.123+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35b804a060 con 0x7f35c00ca470 2024-09-15T22:48:51.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.289+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35c00d04f0 con 0x7f35c00ca470 2024-09-15T22:48:51.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.290+0000 7f35b57fa640 1 -- 172.21.15.134:0/1849123916 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16800 (secure 0 0 0) 0x7f35b802e050 con 0x7f35c00ca470 2024-09-15T22:48:51.292 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:51.292 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":170,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:49.663680+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:46.326071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:46.958921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 msgr2=0x7f35ac06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 0x7f35ac06f130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b3660 tx=0x7f35bc009040 comp rx=0 tx=0).stop 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 msgr2=0x7f35c00ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009f90 tx=0x7f35b8009750 comp rx=0 tx=0).stop 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 shutdown_connections 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f35ac06cc70 0x7f35ac06f130 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00ca470 0x7f35c00ca8f0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35c00cb9b0 0x7f35c00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 --2- 172.21.15.134:0/1849123916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a8004d40 0x7f35c0150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 >> 172.21.15.134:0/1849123916 conn(0x7f35c00702d0 msgr2=0x7f35c006e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 shutdown_connections 2024-09-15T22:48:51.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.292+0000 7f35c7111640 1 -- 172.21.15.134:0/1849123916 wait complete. 2024-09-15T22:48:51.306 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:48:51.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:51.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.404+0000 7f6d8756d640 1 Processor -- start 2024-09-15T22:48:51.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.404+0000 7f6d8756d640 1 -- start start 2024-09-15T22:48:51.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d8756d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d800d02a0 0x7f6d800d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d8756d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d800d0bc0 con 0x7f6d8015ca40 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d8756d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8015d390 con 0x7f6d8015ceb0 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d8756d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8015d670 con 0x7f6d800d02a0 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d84b08640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6d8015ca40 0x7f6d8015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56344/0 (socket says 172.21.15.134:56344) 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d84b08640 1 -- 172.21.15.134:0/3307205438 learned_addr learned my addr 172.21.15.134:0/3307205438 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d85309640 1 --2- 172.21.15.134:0/3307205438 >> v2:172.21.15.177:3300/0 conn(0x7f6d800d02a0 0x7f6d800d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465528950 0 0) 0x7f6d800d0bc0 con 0x7f6d8015ca40 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d6c003520 con 0x7f6d8015ca40 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 239307911 0 0) 0x7f6d6c003520 con 0x7f6d8015ca40 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 >> v2:172.21.15.177:3300/0 conn(0x7f6d800d02a0 msgr2=0x7f6d800d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 --2- 172.21.15.134:0/3307205438 >> v2:172.21.15.177:3300/0 conn(0x7f6d800d02a0 0x7f6d800d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 >> v1:172.21.15.177:6789/0 conn(0x7f6d8015ceb0 legacy=0x7f6d801594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8015d950 con 0x7f6d8015ca40 2024-09-15T22:48:51.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6d70001670 con 0x7f6d8015ca40 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d85309640 1 --2- 172.21.15.134:0/3307205438 >> v2:172.21.15.177:3300/0 conn(0x7f6d800d02a0 0x7f6d800d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 >> v1:172.21.15.134:6789/0 conn(0x7f6d8015ca40 legacy=0x7f6d8015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d6c0039b0 0x7f6d6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 0x7f6d6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c0051c0 0x7f6d6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8015d670 con 0x7f6d6c004800 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c00c160 con 0x7f6d6c0051c0 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.405+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6c00c360 con 0x7f6d6c0039b0 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 0x7f6d6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d85b0a640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c0051c0 0x7f6d6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d85309640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d6c0039b0 0x7f6d6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 -- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d6c0039b0 msgr2=0x7f6d6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d6c0039b0 0x7f6d6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 -- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c0051c0 msgr2=0x7f6d6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c0051c0 0x7f6d6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d85b0a640 1 -- 172.21.15.134:0/3307205438 reap_dead start 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 -- 172.21.15.134:0/3307205438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c003520 con 0x7f6d6c004800 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.406+0000 7f6d84b08640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 0x7f6d6c004c80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c210 tx=0x7f6d6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2597cf5f0d003852 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70007d30 con 0x7f6d6c004800 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d70005ad0 con 0x7f6d6c004800 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d77fff640 1 -- 172.21.15.134:0/3307205438 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70007070 con 0x7f6d6c004800 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 -- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 msgr2=0x7f6d6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 0x7f6d6c004c80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c210 tx=0x7f6d6c005830 comp rx=0 tx=0).stop 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 -- 172.21.15.134:0/3307205438 shutdown_connections 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 --2- 172.21.15.134:0/3307205438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d6c004800 0x7f6d6c004c80 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 -- 172.21.15.134:0/3307205438 >> 172.21.15.134:0/3307205438 conn(0x7f6d80062cc0 msgr2=0x7f6d8006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 -- 172.21.15.134:0/3307205438 shutdown_connections 2024-09-15T22:48:51.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.407+0000 7f6d8756d640 1 -- 172.21.15.134:0/3307205438 wait complete. 2024-09-15T22:48:51.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.408+0000 7f6d8756d640 1 Processor -- start 2024-09-15T22:48:51.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.408+0000 7f6d8756d640 1 -- start start 2024-09-15T22:48:51.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 0x7f6d80152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d80158100 0x7f6d80158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d80155b90 con 0x7f6d80148b00 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8015df10 con 0x7f6d6c004800 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d8756d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6d80155d10 con 0x7f6d80158100 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d84b08640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d84b08640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52596/0 (socket says 172.21.15.134:52596) 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d84b08640 1 -- 172.21.15.134:0/2697064943 learned_addr learned my addr 172.21.15.134:0/2697064943 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d85b0a640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d80158100 0x7f6d80158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.409+0000 7f6d85309640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 0x7f6d80152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 -- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d80158100 msgr2=0x7f6d80158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d80158100 0x7f6d80158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 -- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 msgr2=0x7f6d80152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 0x7f6d80152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 -- 172.21.15.134:0/2697064943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d800724e0 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d85309640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 0x7f6d80152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d84b08640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c330 tx=0x7f6d70001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70000ed0 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d70040070 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d800727c0 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70007270 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.410+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d80072d80 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.411+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d800b4790 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.412+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f6d70007410 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.412+0000 7f6d75ffb640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 0x7f6d6406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.412+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f6d700ac060 con 0x7f6d80148b00 2024-09-15T22:48:51.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.412+0000 7f6d85309640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 0x7f6d6406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.413+0000 7f6d85309640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 0x7f6d6406f2d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009dd0 tx=0x7f6d7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.416+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d7007c3d0 con 0x7f6d80148b00 2024-09-15T22:48:51.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.578+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d800cce10 con 0x7f6d6406ce10 2024-09-15T22:48:51.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.584+0000 7f6d75ffb640 1 -- 172.21.15.134:0/2697064943 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7f6d800cce10 con 0x7f6d6406ce10 2024-09-15T22:48:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:51.589 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 msgr2=0x7f6d6406f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 0x7f6d6406f2d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009dd0 tx=0x7f6d7c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 msgr2=0x7f6d80073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c330 tx=0x7f6d70001a40 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 shutdown_connections 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d80158100 0x7f6d80158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6d6406ce10 0x7f6d6406f2d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d80148b00 0x7f6d80073580 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 --2- 172.21.15.134:0/2697064943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d6c004800 0x7f6d80152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.587+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 >> 172.21.15.134:0/2697064943 conn(0x7f6d80062cc0 msgr2=0x7f6d800b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.588+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 shutdown_connections 2024-09-15T22:48:51.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.588+0000 7f6d8756d640 1 -- 172.21.15.134:0/2697064943 wait complete. 2024-09-15T22:48:51.600 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-15T22:48:51.230957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267088,"kb_used_data":17528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707632,"statfs":{"total":773094113280,"available":772820615168,"internally_reserved":0,"allocated":17948672,"data_stored":8546620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589951"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.650118+0000","last_change":"2024-09-15T22:48:46.650118+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.650118+0000","last_undegraded":"2024-09-15T22:48:46.650118+0000","last_fullsized":"2024-09-15T22:48:46.650118+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649585+0000","last_change":"2024-09-15T22:48:46.649585+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649585+0000","last_undegraded":"2024-09-15T22:48:46.649585+0000","last_fullsized":"2024-09-15T22:48:46.649585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643779+0000","last_change":"2024-09-15T22:48:46.643779+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643779+0000","last_undegraded":"2024-09-15T22:48:46.643779+0000","last_fullsized":"2024-09-15T22:48:46.643779+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643636+0000","last_change":"2024-09-15T22:48:46.643636+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643636+0000","last_undegraded":"2024-09-15T22:48:46.643636+0000","last_fullsized":"2024-09-15T22:48:46.643636+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645969+0000","last_change":"2024-09-15T22:48:46.645969+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645969+0000","last_undegraded":"2024-09-15T22:48:46.645969+0000","last_fullsized":"2024-09-15T22:48:46.645969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.644477+0000","last_change":"2024-09-15T22:48:46.644477+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.644477+0000","last_undegraded":"2024-09-15T22:48:46.644477+0000","last_fullsized":"2024-09-15T22:48:46.644477+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643654+0000","last_change":"2024-09-15T22:48:46.643654+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643654+0000","last_undegraded":"2024-09-15T22:48:46.643654+0000","last_fullsized":"2024-09-15T22:48:46.643654+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645314+0000","last_change":"2024-09-15T22:48:46.645314+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645314+0000","last_undegraded":"2024-09-15T22:48:46.645314+0000","last_fullsized":"2024-09-15T22:48:46.645314+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642730+0000","last_change":"2024-09-15T22:48:46.642730+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642730+0000","last_undegraded":"2024-09-15T22:48:46.642730+0000","last_fullsized":"2024-09-15T22:48:46.642730+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646914+0000","last_change":"2024-09-15T22:48:46.646914+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646914+0000","last_undegraded":"2024-09-15T22:48:46.646914+0000","last_fullsized":"2024-09-15T22:48:46.646914+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646764+0000","last_change":"2024-09-15T22:48:46.646764+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646764+0000","last_undegraded":"2024-09-15T22:48:46.646764+0000","last_fullsized":"2024-09-15T22:48:46.646764+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649121+0000","last_change":"2024-09-15T22:48:46.649121+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649121+0000","last_undegraded":"2024-09-15T22:48:46.649121+0000","last_fullsized":"2024-09-15T22:48:46.649121+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643069+0000","last_change":"2024-09-15T22:48:46.643069+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643069+0000","last_undegraded":"2024-09-15T22:48:46.643069+0000","last_fullsized":"2024-09-15T22:48:46.643069+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643831+0000","last_change":"2024-09-15T22:48:46.643831+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643831+0000","last_undegraded":"2024-09-15T22:48:46.643831+0000","last_fullsized":"2024-09-15T22:48:46.643831+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646787+0000","last_change":"2024-09-15T22:48:46.646787+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646787+0000","last_undegraded":"2024-09-15T22:48:46.646787+0000","last_fullsized":"2024-09-15T22:48:46.646787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643484+0000","last_change":"2024-09-15T22:48:46.643484+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643484+0000","last_undegraded":"2024-09-15T22:48:46.643484+0000","last_fullsized":"2024-09-15T22:48:46.643484+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649879+0000","last_change":"2024-09-15T22:48:46.649879+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649879+0000","last_undegraded":"2024-09-15T22:48:46.649879+0000","last_fullsized":"2024-09-15T22:48:46.649879+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643466+0000","last_change":"2024-09-15T22:48:46.643466+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643466+0000","last_undegraded":"2024-09-15T22:48:46.643466+0000","last_fullsized":"2024-09-15T22:48:46.643466+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642820+0000","last_change":"2024-09-15T22:48:46.642820+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642820+0000","last_undegraded":"2024-09-15T22:48:46.642820+0000","last_fullsized":"2024-09-15T22:48:46.642820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645416+0000","last_change":"2024-09-15T22:48:46.645416+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645416+0000","last_undegraded":"2024-09-15T22:48:46.645416+0000","last_fullsized":"2024-09-15T22:48:46.645416+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643265+0000","last_change":"2024-09-15T22:48:46.643265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643265+0000","last_undegraded":"2024-09-15T22:48:46.643265+0000","last_fullsized":"2024-09-15T22:48:46.643265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649159+0000","last_change":"2024-09-15T22:48:46.649159+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649159+0000","last_undegraded":"2024-09-15T22:48:46.649159+0000","last_fullsized":"2024-09-15T22:48:46.649159+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646289+0000","last_change":"2024-09-15T22:48:46.646289+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646289+0000","last_undegraded":"2024-09-15T22:48:46.646289+0000","last_fullsized":"2024-09-15T22:48:46.646289+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642703+0000","last_change":"2024-09-15T22:48:46.642703+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642703+0000","last_undegraded":"2024-09-15T22:48:46.642703+0000","last_fullsized":"2024-09-15T22:48:46.642703+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645458+0000","last_change":"2024-09-15T22:48:46.645458+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645458+0000","last_undegraded":"2024-09-15T22:48:46.645458+0000","last_fullsized":"2024-09-15T22:48:46.645458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649265+0000","last_change":"2024-09-15T22:48:46.649265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649265+0000","last_undegraded":"2024-09-15T22:48:46.649265+0000","last_fullsized":"2024-09-15T22:48:46.649265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642706+0000","last_change":"2024-09-15T22:48:46.642706+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642706+0000","last_undegraded":"2024-09-15T22:48:46.642706+0000","last_fullsized":"2024-09-15T22:48:46.642706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649133+0000","last_change":"2024-09-15T22:48:46.649133+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649133+0000","last_undegraded":"2024-09-15T22:48:46.649133+0000","last_fullsized":"2024-09-15T22:48:46.649133+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":476,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T22:48:46.641079+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:46.641079+0000","last_peered":"2024-09-15T22:48:46.641079+0000","last_clean":"2024-09-15T22:48:46.641079+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:46.641079+0000","last_undegraded":"2024-09-15T22:48:46.641079+0000","last_fullsized":"2024-09-15T22:48:46.641079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2695168,"data_stored":1514040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2682880,"data_stored":1508167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:51.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:51.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.737+0000 7fb63c7fd640 1 Processor -- start 2024-09-15T22:48:51.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.737+0000 7fb63c7fd640 1 -- start start 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63c7fd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb63415ceb0 0x7fb6341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63c7fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63415d390 con 0x7fb6340d02a0 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63c7fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63415d670 con 0x7fb63415ca40 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63c7fd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb63415d950 con 0x7fb63415ceb0 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63ad9a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb63415ceb0 0x7fb6341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63a599640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb6340d02a0 0x7fb6340d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56356/0 (socket says 172.21.15.134:56356) 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.738+0000 7fb63a599640 1 -- 172.21.15.134:0/3672298543 learned_addr learned my addr 172.21.15.134:0/3672298543 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb63ad9a640 1 -- 172.21.15.134:0/3672298543 >> v1:172.21.15.177:6789/0 conn(0x7fb63415ca40 legacy=0x7fb63415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb63ad9a640 1 -- 172.21.15.134:0/3672298543 >> v1:172.21.15.134:6789/0 conn(0x7fb6340d02a0 legacy=0x7fb6340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb639597640 1 -- 172.21.15.134:0/3672298543 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755448088 0 0) 0x7fb63415d390 con 0x7fb6340d02a0 2024-09-15T22:48:51.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb63ad9a640 1 -- 172.21.15.134:0/3672298543 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63415dc30 con 0x7fb63415ceb0 2024-09-15T22:48:51.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb63ad9a640 1 --2- 172.21.15.134:0/3672298543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb6341594c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009d90 tx=0x7fb62c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e7f59b15beb6a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb639597640 1 -- 172.21.15.134:0/3672298543 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c031600 con 0x7fb63415ceb0 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb639597640 1 -- 172.21.15.134:0/3672298543 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c0317a0 con 0x7fb63415ceb0 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.739+0000 7fb639597640 1 -- 172.21.15.134:0/3672298543 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c031b70 con 0x7fb63415ceb0 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 -- 172.21.15.134:0/3672298543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 msgr2=0x7fb6341594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/3672298543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb6341594c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009d90 tx=0x7fb62c02a610 comp rx=0 tx=0).stop 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 -- 172.21.15.134:0/3672298543 shutdown_connections 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/3672298543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb6341594c0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 -- 172.21.15.134:0/3672298543 >> 172.21.15.134:0/3672298543 conn(0x7fb634062cc0 msgr2=0x7fb63406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 -- 172.21.15.134:0/3672298543 shutdown_connections 2024-09-15T22:48:51.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.740+0000 7fb63c7fd640 1 -- 172.21.15.134:0/3672298543 wait complete. 2024-09-15T22:48:51.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.741+0000 7fb63c7fd640 1 Processor -- start 2024-09-15T22:48:51.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.741+0000 7fb63c7fd640 1 -- start start 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6340d02a0 0x7fb634145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63415ca40 0x7fb63415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb634155b90 con 0x7fb63415ceb0 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb63415eb40 con 0x7fb6340d02a0 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63c7fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb634155d10 con 0x7fb63415ca40 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52612/0 (socket says 172.21.15.134:52612) 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 -- 172.21.15.134:0/1530301612 learned_addr learned my addr 172.21.15.134:0/1530301612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63a599640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6340d02a0 0x7fb634145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb639d98640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63415ca40 0x7fb63415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 -- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63415ca40 msgr2=0x7fb63415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63415ca40 0x7fb63415a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 -- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6340d02a0 msgr2=0x7fb634145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6340d02a0 0x7fb634145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.742+0000 7fb63ad9a640 1 -- 172.21.15.134:0/1530301612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63414b320 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb63ad9a640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02ac00 tx=0x7fb62c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c040070 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c030b60 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c045460 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6341463b0 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.743+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63414b870 con 0x7fb63415ceb0 2024-09-15T22:48:51.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.744+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6340b4790 con 0x7fb63415ceb0 2024-09-15T22:48:51.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.744+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fb62c039040 con 0x7fb63415ceb0 2024-09-15T22:48:51.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.745+0000 7fb62affd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 0x7fb61806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:51.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.745+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fb62c0ab350 con 0x7fb63415ceb0 2024-09-15T22:48:51.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.745+0000 7fb63a599640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 0x7fb61806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:51.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.745+0000 7fb63a599640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 0x7fb61806f100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb630007fd0 tx=0x7fb630009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.749+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6341463b0 con 0x7fb63415ceb0 2024-09-15T22:48:51.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.910+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb63415c4e0 con 0x7fb61806cc40 2024-09-15T22:48:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.917+0000 7fb62affd640 1 -- 172.21.15.134:0/1530301612 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7fb63415c4e0 con 0x7fb61806cc40 2024-09-15T22:48:51.920 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 msgr2=0x7fb61806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 0x7fb61806f100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb630007fd0 tx=0x7fb630009040 comp rx=0 tx=0).stop 2024-09-15T22:48:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 msgr2=0x7fb63415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02ac00 tx=0x7fb62c004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 shutdown_connections 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb61806cc40 0x7fb61806f100 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63415ceb0 0x7fb63415a9f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb63415ca40 0x7fb63415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 --2- 172.21.15.134:0/1530301612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6340d02a0 0x7fb634145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 >> 172.21.15.134:0/1530301612 conn(0x7fb634062cc0 msgr2=0x7fb634154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 shutdown_connections 2024-09-15T22:48:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:51.919+0000 7fb63c7fd640 1 -- 172.21.15.134:0/1530301612 wait complete. 2024-09-15T22:48:51.931 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-15T22:48:51.230957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267088,"kb_used_data":17528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707632,"statfs":{"total":773094113280,"available":772820615168,"internally_reserved":0,"allocated":17948672,"data_stored":8546620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589951"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.650118+0000","last_change":"2024-09-15T22:48:46.650118+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.650118+0000","last_undegraded":"2024-09-15T22:48:46.650118+0000","last_fullsized":"2024-09-15T22:48:46.650118+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649585+0000","last_change":"2024-09-15T22:48:46.649585+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649585+0000","last_undegraded":"2024-09-15T22:48:46.649585+0000","last_fullsized":"2024-09-15T22:48:46.649585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643779+0000","last_change":"2024-09-15T22:48:46.643779+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643779+0000","last_undegraded":"2024-09-15T22:48:46.643779+0000","last_fullsized":"2024-09-15T22:48:46.643779+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643636+0000","last_change":"2024-09-15T22:48:46.643636+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643636+0000","last_undegraded":"2024-09-15T22:48:46.643636+0000","last_fullsized":"2024-09-15T22:48:46.643636+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645969+0000","last_change":"2024-09-15T22:48:46.645969+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645969+0000","last_undegraded":"2024-09-15T22:48:46.645969+0000","last_fullsized":"2024-09-15T22:48:46.645969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.644477+0000","last_change":"2024-09-15T22:48:46.644477+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.644477+0000","last_undegraded":"2024-09-15T22:48:46.644477+0000","last_fullsized":"2024-09-15T22:48:46.644477+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643654+0000","last_change":"2024-09-15T22:48:46.643654+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643654+0000","last_undegraded":"2024-09-15T22:48:46.643654+0000","last_fullsized":"2024-09-15T22:48:46.643654+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645314+0000","last_change":"2024-09-15T22:48:46.645314+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645314+0000","last_undegraded":"2024-09-15T22:48:46.645314+0000","last_fullsized":"2024-09-15T22:48:46.645314+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642730+0000","last_change":"2024-09-15T22:48:46.642730+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642730+0000","last_undegraded":"2024-09-15T22:48:46.642730+0000","last_fullsized":"2024-09-15T22:48:46.642730+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646914+0000","last_change":"2024-09-15T22:48:46.646914+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646914+0000","last_undegraded":"2024-09-15T22:48:46.646914+0000","last_fullsized":"2024-09-15T22:48:46.646914+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646764+0000","last_change":"2024-09-15T22:48:46.646764+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646764+0000","last_undegraded":"2024-09-15T22:48:46.646764+0000","last_fullsized":"2024-09-15T22:48:46.646764+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649121+0000","last_change":"2024-09-15T22:48:46.649121+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649121+0000","last_undegraded":"2024-09-15T22:48:46.649121+0000","last_fullsized":"2024-09-15T22:48:46.649121+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643069+0000","last_change":"2024-09-15T22:48:46.643069+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643069+0000","last_undegraded":"2024-09-15T22:48:46.643069+0000","last_fullsized":"2024-09-15T22:48:46.643069+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643831+0000","last_change":"2024-09-15T22:48:46.643831+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643831+0000","last_undegraded":"2024-09-15T22:48:46.643831+0000","last_fullsized":"2024-09-15T22:48:46.643831+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646787+0000","last_change":"2024-09-15T22:48:46.646787+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646787+0000","last_undegraded":"2024-09-15T22:48:46.646787+0000","last_fullsized":"2024-09-15T22:48:46.646787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643484+0000","last_change":"2024-09-15T22:48:46.643484+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643484+0000","last_undegraded":"2024-09-15T22:48:46.643484+0000","last_fullsized":"2024-09-15T22:48:46.643484+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649879+0000","last_change":"2024-09-15T22:48:46.649879+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649879+0000","last_undegraded":"2024-09-15T22:48:46.649879+0000","last_fullsized":"2024-09-15T22:48:46.649879+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643466+0000","last_change":"2024-09-15T22:48:46.643466+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643466+0000","last_undegraded":"2024-09-15T22:48:46.643466+0000","last_fullsized":"2024-09-15T22:48:46.643466+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642820+0000","last_change":"2024-09-15T22:48:46.642820+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642820+0000","last_undegraded":"2024-09-15T22:48:46.642820+0000","last_fullsized":"2024-09-15T22:48:46.642820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645416+0000","last_change":"2024-09-15T22:48:46.645416+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645416+0000","last_undegraded":"2024-09-15T22:48:46.645416+0000","last_fullsized":"2024-09-15T22:48:46.645416+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643265+0000","last_change":"2024-09-15T22:48:46.643265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643265+0000","last_undegraded":"2024-09-15T22:48:46.643265+0000","last_fullsized":"2024-09-15T22:48:46.643265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649159+0000","last_change":"2024-09-15T22:48:46.649159+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649159+0000","last_undegraded":"2024-09-15T22:48:46.649159+0000","last_fullsized":"2024-09-15T22:48:46.649159+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646289+0000","last_change":"2024-09-15T22:48:46.646289+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646289+0000","last_undegraded":"2024-09-15T22:48:46.646289+0000","last_fullsized":"2024-09-15T22:48:46.646289+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642703+0000","last_change":"2024-09-15T22:48:46.642703+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642703+0000","last_undegraded":"2024-09-15T22:48:46.642703+0000","last_fullsized":"2024-09-15T22:48:46.642703+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645458+0000","last_change":"2024-09-15T22:48:46.645458+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645458+0000","last_undegraded":"2024-09-15T22:48:46.645458+0000","last_fullsized":"2024-09-15T22:48:46.645458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649265+0000","last_change":"2024-09-15T22:48:46.649265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649265+0000","last_undegraded":"2024-09-15T22:48:46.649265+0000","last_fullsized":"2024-09-15T22:48:46.649265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642706+0000","last_change":"2024-09-15T22:48:46.642706+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642706+0000","last_undegraded":"2024-09-15T22:48:46.642706+0000","last_fullsized":"2024-09-15T22:48:46.642706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649133+0000","last_change":"2024-09-15T22:48:46.649133+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649133+0000","last_undegraded":"2024-09-15T22:48:46.649133+0000","last_fullsized":"2024-09-15T22:48:46.649133+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":476,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T22:48:46.641079+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:46.641079+0000","last_peered":"2024-09-15T22:48:46.641079+0000","last_clean":"2024-09-15T22:48:46.641079+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:46.641079+0000","last_undegraded":"2024-09-15T22:48:46.641079+0000","last_fullsized":"2024-09-15T22:48:46.641079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2695168,"data_stored":1514040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2682880,"data_stored":1508167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:51.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.069+0000 7f96f7bb7640 1 Processor -- start 2024-09-15T22:48:52.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.070+0000 7f96f7bb7640 1 -- start start 2024-09-15T22:48:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.070+0000 7f96f7bb7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96f015e7b0 0x7f96f0071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.070+0000 7f96f7bb7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f0071880 con 0x7f96f00b5600 2024-09-15T22:48:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.070+0000 7f96f7bb7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f00741c0 con 0x7f96f006ccb0 2024-09-15T22:48:52.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.070+0000 7f96f7bb7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f96f006e680 con 0x7f96f015e7b0 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5953640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96f015e7b0 0x7f96f0071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5152640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f96f00b5600 0x7f96f0073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56358/0 (socket says 172.21.15.134:56358) 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5152640 1 -- 172.21.15.134:0/3713255592 learned_addr learned my addr 172.21.15.134:0/3713255592 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f4951640 1 -- 172.21.15.134:0/3713255592 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859460455 0 0) 0x7f96e0001110 con 0x7f96f00b5600 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f4951640 1 -- 172.21.15.134:0/3713255592 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96dc003520 con 0x7f96f00b5600 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5953640 1 -- 172.21.15.134:0/3713255592 >> v1:172.21.15.177:6789/0 conn(0x7f96f006ccb0 legacy=0x7f96f006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5953640 1 -- 172.21.15.134:0/3713255592 >> v1:172.21.15.134:6789/0 conn(0x7f96f00b5600 legacy=0x7f96f0073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.071+0000 7f96f5953640 1 -- 172.21.15.134:0/3713255592 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f006e8d0 con 0x7f96f015e7b0 2024-09-15T22:48:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f5953640 1 --2- 172.21.15.134:0/3713255592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0071340 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097a0 tx=0x7f96ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8e56db0197de55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f4951640 1 -- 172.21.15.134:0/3713255592 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec037070 con 0x7f96f015e7b0 2024-09-15T22:48:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f4951640 1 -- 172.21.15.134:0/3713255592 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec02ae50 con 0x7f96f015e7b0 2024-09-15T22:48:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f4951640 1 -- 172.21.15.134:0/3713255592 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec032640 con 0x7f96f015e7b0 2024-09-15T22:48:52.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 -- 172.21.15.134:0/3713255592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 msgr2=0x7f96f0071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/3713255592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0071340 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097a0 tx=0x7f96ec02a140 comp rx=0 tx=0).stop 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 -- 172.21.15.134:0/3713255592 shutdown_connections 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/3713255592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0071340 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 -- 172.21.15.134:0/3713255592 >> 172.21.15.134:0/3713255592 conn(0x7f96f00b4300 msgr2=0x7f96f00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 -- 172.21.15.134:0/3713255592 shutdown_connections 2024-09-15T22:48:52.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.072+0000 7f96f7bb7640 1 -- 172.21.15.134:0/3713255592 wait complete. 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 Processor -- start 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 -- start start 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 0x7f96f00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 0x7f96f015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0073590 con 0x7f96f015e7b0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00732b0 con 0x7f96f00b5600 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f7bb7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f96f00b6ce0 con 0x7f96f006ccb0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f6154640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f6154640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52628/0 (socket says 172.21.15.134:52628) 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.074+0000 7f96f6154640 1 -- 172.21.15.134:0/970741882 learned_addr learned my addr 172.21.15.134:0/970741882 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f5152640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 0x7f96f015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f5953640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 0x7f96f00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 -- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 msgr2=0x7f96f00d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 0x7f96f00d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 -- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 msgr2=0x7f96f015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 0x7f96f015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 -- 172.21.15.134:0/970741882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f015c640 con 0x7f96f015e7b0 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f5953640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 0x7f96f00d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:52.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f5152640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 0x7f96f015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f6154640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c780 tx=0x7f96e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8004b60 con 0x7f96f015e7b0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e8004d00 con 0x7f96f015e7b0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f015c8e0 con 0x7f96f015e7b0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e800aa90 con 0x7f96f015e7b0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.075+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f00d1540 con 0x7f96f015e7b0 2024-09-15T22:48:52.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.076+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f0071340 con 0x7f96f015e7b0 2024-09-15T22:48:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.077+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f96e800ac30 con 0x7f96f015e7b0 2024-09-15T22:48:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.077+0000 7f96e67fc640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 0x7f96d406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.077+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f96e808a160 con 0x7f96f015e7b0 2024-09-15T22:48:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.077+0000 7f96f5953640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 0x7f96d406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.078+0000 7f96f5953640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 0x7f96d406f100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f96ec034000 tx=0x7f96ec02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.081+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96e805a4d0 con 0x7f96f015e7b0 2024-09-15T22:48:52.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.244+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96f00762b0 con 0x7f96d406cc40 2024-09-15T22:48:52.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.250+0000 7f96e67fc640 1 -- 172.21.15.134:0/970741882 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7f96f00762b0 con 0x7f96d406cc40 2024-09-15T22:48:52.254 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:52.255 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 msgr2=0x7f96d406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 0x7f96d406f100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f96ec034000 tx=0x7f96ec02e000 comp rx=0 tx=0).stop 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 msgr2=0x7f96f0148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c780 tx=0x7f96e800cc40 comp rx=0 tx=0).stop 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 shutdown_connections 2024-09-15T22:48:52.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f96d406cc40 0x7f96d406f100 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96f015e7b0 0x7f96f0148ea0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96f00b5600 0x7f96f015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 --2- 172.21.15.134:0/970741882 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96f006ccb0 0x7f96f00d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 >> 172.21.15.134:0/970741882 conn(0x7f96f00b4300 msgr2=0x7f96f015fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 shutdown_connections 2024-09-15T22:48:52.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.253+0000 7f96f7bb7640 1 -- 172.21.15.134:0/970741882 wait complete. 2024-09-15T22:48:52.265 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-15T22:48:51.230957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267088,"kb_used_data":17528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707632,"statfs":{"total":773094113280,"available":772820615168,"internally_reserved":0,"allocated":17948672,"data_stored":8546620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589951"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.650118+0000","last_change":"2024-09-15T22:48:46.650118+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.650118+0000","last_undegraded":"2024-09-15T22:48:46.650118+0000","last_fullsized":"2024-09-15T22:48:46.650118+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649585+0000","last_change":"2024-09-15T22:48:46.649585+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649585+0000","last_undegraded":"2024-09-15T22:48:46.649585+0000","last_fullsized":"2024-09-15T22:48:46.649585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643779+0000","last_change":"2024-09-15T22:48:46.643779+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643779+0000","last_undegraded":"2024-09-15T22:48:46.643779+0000","last_fullsized":"2024-09-15T22:48:46.643779+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643636+0000","last_change":"2024-09-15T22:48:46.643636+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643636+0000","last_undegraded":"2024-09-15T22:48:46.643636+0000","last_fullsized":"2024-09-15T22:48:46.643636+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645969+0000","last_change":"2024-09-15T22:48:46.645969+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645969+0000","last_undegraded":"2024-09-15T22:48:46.645969+0000","last_fullsized":"2024-09-15T22:48:46.645969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.644477+0000","last_change":"2024-09-15T22:48:46.644477+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.644477+0000","last_undegraded":"2024-09-15T22:48:46.644477+0000","last_fullsized":"2024-09-15T22:48:46.644477+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643654+0000","last_change":"2024-09-15T22:48:46.643654+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643654+0000","last_undegraded":"2024-09-15T22:48:46.643654+0000","last_fullsized":"2024-09-15T22:48:46.643654+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645314+0000","last_change":"2024-09-15T22:48:46.645314+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645314+0000","last_undegraded":"2024-09-15T22:48:46.645314+0000","last_fullsized":"2024-09-15T22:48:46.645314+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642730+0000","last_change":"2024-09-15T22:48:46.642730+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642730+0000","last_undegraded":"2024-09-15T22:48:46.642730+0000","last_fullsized":"2024-09-15T22:48:46.642730+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646914+0000","last_change":"2024-09-15T22:48:46.646914+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646914+0000","last_undegraded":"2024-09-15T22:48:46.646914+0000","last_fullsized":"2024-09-15T22:48:46.646914+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646764+0000","last_change":"2024-09-15T22:48:46.646764+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646764+0000","last_undegraded":"2024-09-15T22:48:46.646764+0000","last_fullsized":"2024-09-15T22:48:46.646764+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649121+0000","last_change":"2024-09-15T22:48:46.649121+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649121+0000","last_undegraded":"2024-09-15T22:48:46.649121+0000","last_fullsized":"2024-09-15T22:48:46.649121+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643069+0000","last_change":"2024-09-15T22:48:46.643069+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643069+0000","last_undegraded":"2024-09-15T22:48:46.643069+0000","last_fullsized":"2024-09-15T22:48:46.643069+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643831+0000","last_change":"2024-09-15T22:48:46.643831+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643831+0000","last_undegraded":"2024-09-15T22:48:46.643831+0000","last_fullsized":"2024-09-15T22:48:46.643831+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646787+0000","last_change":"2024-09-15T22:48:46.646787+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646787+0000","last_undegraded":"2024-09-15T22:48:46.646787+0000","last_fullsized":"2024-09-15T22:48:46.646787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643484+0000","last_change":"2024-09-15T22:48:46.643484+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643484+0000","last_undegraded":"2024-09-15T22:48:46.643484+0000","last_fullsized":"2024-09-15T22:48:46.643484+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649879+0000","last_change":"2024-09-15T22:48:46.649879+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649879+0000","last_undegraded":"2024-09-15T22:48:46.649879+0000","last_fullsized":"2024-09-15T22:48:46.649879+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643466+0000","last_change":"2024-09-15T22:48:46.643466+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643466+0000","last_undegraded":"2024-09-15T22:48:46.643466+0000","last_fullsized":"2024-09-15T22:48:46.643466+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642820+0000","last_change":"2024-09-15T22:48:46.642820+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642820+0000","last_undegraded":"2024-09-15T22:48:46.642820+0000","last_fullsized":"2024-09-15T22:48:46.642820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645416+0000","last_change":"2024-09-15T22:48:46.645416+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645416+0000","last_undegraded":"2024-09-15T22:48:46.645416+0000","last_fullsized":"2024-09-15T22:48:46.645416+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643265+0000","last_change":"2024-09-15T22:48:46.643265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643265+0000","last_undegraded":"2024-09-15T22:48:46.643265+0000","last_fullsized":"2024-09-15T22:48:46.643265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649159+0000","last_change":"2024-09-15T22:48:46.649159+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649159+0000","last_undegraded":"2024-09-15T22:48:46.649159+0000","last_fullsized":"2024-09-15T22:48:46.649159+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646289+0000","last_change":"2024-09-15T22:48:46.646289+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646289+0000","last_undegraded":"2024-09-15T22:48:46.646289+0000","last_fullsized":"2024-09-15T22:48:46.646289+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642703+0000","last_change":"2024-09-15T22:48:46.642703+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642703+0000","last_undegraded":"2024-09-15T22:48:46.642703+0000","last_fullsized":"2024-09-15T22:48:46.642703+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645458+0000","last_change":"2024-09-15T22:48:46.645458+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645458+0000","last_undegraded":"2024-09-15T22:48:46.645458+0000","last_fullsized":"2024-09-15T22:48:46.645458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649265+0000","last_change":"2024-09-15T22:48:46.649265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649265+0000","last_undegraded":"2024-09-15T22:48:46.649265+0000","last_fullsized":"2024-09-15T22:48:46.649265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642706+0000","last_change":"2024-09-15T22:48:46.642706+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642706+0000","last_undegraded":"2024-09-15T22:48:46.642706+0000","last_fullsized":"2024-09-15T22:48:46.642706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649133+0000","last_change":"2024-09-15T22:48:46.649133+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649133+0000","last_undegraded":"2024-09-15T22:48:46.649133+0000","last_fullsized":"2024-09-15T22:48:46.649133+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":476,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T22:48:46.641079+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:46.641079+0000","last_peered":"2024-09-15T22:48:46.641079+0000","last_clean":"2024-09-15T22:48:46.641079+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:46.641079+0000","last_undegraded":"2024-09-15T22:48:46.641079+0000","last_fullsized":"2024-09-15T22:48:46.641079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2695168,"data_stored":1514040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2682880,"data_stored":1508167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3f is not active+clean 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3e is not active+clean 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3d is not active+clean 2024-09-15T22:48:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3c is not active+clean 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3b is not active+clean 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3a is not active+clean 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.39 is not active+clean 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.38 is not active+clean 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 27.37 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.36 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.35 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.34 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.33 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.32 is not active+clean 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 27.31 is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:PG 27.30 is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2f is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2e is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2d is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2c is not active+clean 2024-09-15T22:48:52.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2b is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2a is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.29 is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.28 is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.27 is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:PG 27.26 is not active+clean 2024-09-15T22:48:52.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.25 is not active+clean 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.24 is not active+clean 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.23 is not active+clean 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.22 is not active+clean 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.21 is not active+clean 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.274 INFO:tasks.ceph.ceph_manager.ceph:PG 27.20 is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1e is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1f is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.650118+0000', 'last_change': '2024-09-15T22:48:46.650118+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.650118+0000', 'last_undegraded': '2024-09-15T22:48:46.650118+0000', 'last_fullsized': '2024-09-15T22:48:46.650118+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1f is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1e is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649585+0000', 'last_change': '2024-09-15T22:48:46.649585+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649585+0000', 'last_undegraded': '2024-09-15T22:48:46.649585+0000', 'last_fullsized': '2024-09-15T22:48:46.649585+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1c is not active+clean 2024-09-15T22:48:52.275 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1d is not active+clean 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643779+0000', 'last_change': '2024-09-15T22:48:46.643779+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643779+0000', 'last_undegraded': '2024-09-15T22:48:46.643779+0000', 'last_fullsized': '2024-09-15T22:48:46.643779+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1d is not active+clean 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1c is not active+clean 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643636+0000', 'last_change': '2024-09-15T22:48:46.643636+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643636+0000', 'last_undegraded': '2024-09-15T22:48:46.643636+0000', 'last_fullsized': '2024-09-15T22:48:46.643636+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1b is not active+clean 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1a is not active+clean 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645969+0000', 'last_change': '2024-09-15T22:48:46.645969+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645969+0000', 'last_undegraded': '2024-09-15T22:48:46.645969+0000', 'last_fullsized': '2024-09-15T22:48:46.645969+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:52.276 INFO:tasks.ceph.ceph_manager.ceph:PG 27.18 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:PG 26.19 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.644477+0000', 'last_change': '2024-09-15T22:48:46.644477+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.644477+0000', 'last_undegraded': '2024-09-15T22:48:46.644477+0000', 'last_fullsized': '2024-09-15T22:48:46.644477+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:PG 27.19 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:PG 26.18 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643654+0000', 'last_change': '2024-09-15T22:48:46.643654+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643654+0000', 'last_undegraded': '2024-09-15T22:48:46.643654+0000', 'last_fullsized': '2024-09-15T22:48:46.643654+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:PG 27.16 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:PG 26.17 is not active+clean 2024-09-15T22:48:52.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645314+0000', 'last_change': '2024-09-15T22:48:46.645314+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645314+0000', 'last_undegraded': '2024-09-15T22:48:46.645314+0000', 'last_fullsized': '2024-09-15T22:48:46.645314+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:PG 27.17 is not active+clean 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:PG 26.16 is not active+clean 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642730+0000', 'last_change': '2024-09-15T22:48:46.642730+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642730+0000', 'last_undegraded': '2024-09-15T22:48:46.642730+0000', 'last_fullsized': '2024-09-15T22:48:46.642730+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:PG 27.14 is not active+clean 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.278 INFO:tasks.ceph.ceph_manager.ceph:PG 26.15 is not active+clean 2024-09-15T22:48:52.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642806+0000', 'last_change': '2024-09-15T22:48:46.642806+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642806+0000', 'last_undegraded': '2024-09-15T22:48:46.642806+0000', 'last_fullsized': '2024-09-15T22:48:46.642806+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 27.15 is not active+clean 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 26.14 is not active+clean 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.646914+0000', 'last_change': '2024-09-15T22:48:46.646914+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.646914+0000', 'last_undegraded': '2024-09-15T22:48:46.646914+0000', 'last_fullsized': '2024-09-15T22:48:46.646914+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 27.12 is not active+clean 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 26.13 is not active+clean 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.646764+0000', 'last_change': '2024-09-15T22:48:46.646764+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.646764+0000', 'last_undegraded': '2024-09-15T22:48:46.646764+0000', 'last_fullsized': '2024-09-15T22:48:46.646764+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 27.13 is not active+clean 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.280 INFO:tasks.ceph.ceph_manager.ceph:PG 26.12 is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649121+0000', 'last_change': '2024-09-15T22:48:46.649121+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649121+0000', 'last_undegraded': '2024-09-15T22:48:46.649121+0000', 'last_fullsized': '2024-09-15T22:48:46.649121+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:PG 27.10 is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:PG 26.11 is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643069+0000', 'last_change': '2024-09-15T22:48:46.643069+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643069+0000', 'last_undegraded': '2024-09-15T22:48:46.643069+0000', 'last_fullsized': '2024-09-15T22:48:46.643069+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:PG 27.11 is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:PG 26.10 is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643831+0000', 'last_change': '2024-09-15T22:48:46.643831+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643831+0000', 'last_undegraded': '2024-09-15T22:48:46.643831+0000', 'last_fullsized': '2024-09-15T22:48:46.643831+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:PG 27.e is not active+clean 2024-09-15T22:48:52.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 26.f is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645975+0000', 'last_change': '2024-09-15T22:48:46.645975+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645975+0000', 'last_undegraded': '2024-09-15T22:48:46.645975+0000', 'last_fullsized': '2024-09-15T22:48:46.645975+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 27.f is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 26.e is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.646787+0000', 'last_change': '2024-09-15T22:48:46.646787+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.646787+0000', 'last_undegraded': '2024-09-15T22:48:46.646787+0000', 'last_fullsized': '2024-09-15T22:48:46.646787+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 27.c is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 26.d is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643484+0000', 'last_change': '2024-09-15T22:48:46.643484+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643484+0000', 'last_undegraded': '2024-09-15T22:48:46.643484+0000', 'last_fullsized': '2024-09-15T22:48:46.643484+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:PG 27.d is not active+clean 2024-09-15T22:48:52.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:PG 26.c is not active+clean 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649879+0000', 'last_change': '2024-09-15T22:48:46.649879+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649879+0000', 'last_undegraded': '2024-09-15T22:48:46.649879+0000', 'last_fullsized': '2024-09-15T22:48:46.649879+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:PG 27.a is not active+clean 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:PG 26.b is not active+clean 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643466+0000', 'last_change': '2024-09-15T22:48:46.643466+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643466+0000', 'last_undegraded': '2024-09-15T22:48:46.643466+0000', 'last_fullsized': '2024-09-15T22:48:46.643466+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:PG 27.b is not active+clean 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:PG 26.a is not active+clean 2024-09-15T22:48:52.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642820+0000', 'last_change': '2024-09-15T22:48:46.642820+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642820+0000', 'last_undegraded': '2024-09-15T22:48:46.642820+0000', 'last_fullsized': '2024-09-15T22:48:46.642820+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 27.8 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 26.9 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645416+0000', 'last_change': '2024-09-15T22:48:46.645416+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645416+0000', 'last_undegraded': '2024-09-15T22:48:46.645416+0000', 'last_fullsized': '2024-09-15T22:48:46.645416+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 27.9 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 26.8 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642806+0000', 'last_change': '2024-09-15T22:48:46.642806+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642806+0000', 'last_undegraded': '2024-09-15T22:48:46.642806+0000', 'last_fullsized': '2024-09-15T22:48:46.642806+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 27.6 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:PG 26.7 is not active+clean 2024-09-15T22:48:52.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.643265+0000', 'last_change': '2024-09-15T22:48:46.643265+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.643265+0000', 'last_undegraded': '2024-09-15T22:48:46.643265+0000', 'last_fullsized': '2024-09-15T22:48:46.643265+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:PG 27.7 is not active+clean 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:PG 26.6 is not active+clean 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649159+0000', 'last_change': '2024-09-15T22:48:46.649159+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649159+0000', 'last_undegraded': '2024-09-15T22:48:46.649159+0000', 'last_fullsized': '2024-09-15T22:48:46.649159+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:PG 27.4 is not active+clean 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:PG 26.5 is not active+clean 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.646289+0000', 'last_change': '2024-09-15T22:48:46.646289+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.646289+0000', 'last_undegraded': '2024-09-15T22:48:46.646289+0000', 'last_fullsized': '2024-09-15T22:48:46.646289+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:PG 27.5 is not active+clean 2024-09-15T22:48:52.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:PG 26.4 is not active+clean 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645975+0000', 'last_change': '2024-09-15T22:48:46.645975+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645975+0000', 'last_undegraded': '2024-09-15T22:48:46.645975+0000', 'last_fullsized': '2024-09-15T22:48:46.645975+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2 is not active+clean 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3 is not active+clean 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642703+0000', 'last_change': '2024-09-15T22:48:46.642703+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642703+0000', 'last_undegraded': '2024-09-15T22:48:46.642703+0000', 'last_fullsized': '2024-09-15T22:48:46.642703+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3 is not active+clean 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2 is not active+clean 2024-09-15T22:48:52.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.645458+0000', 'last_change': '2024-09-15T22:48:46.645458+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.645458+0000', 'last_undegraded': '2024-09-15T22:48:46.645458+0000', 'last_fullsized': '2024-09-15T22:48:46.645458+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 27.0 is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1 is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649265+0000', 'last_change': '2024-09-15T22:48:46.649265+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649265+0000', 'last_undegraded': '2024-09-15T22:48:46.649265+0000', 'last_fullsized': '2024-09-15T22:48:46.649265+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1 is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 26.0 is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.642706+0000', 'last_change': '2024-09-15T22:48:46.642706+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.642706+0000', 'last_undegraded': '2024-09-15T22:48:46.642706+0000', 'last_fullsized': '2024-09-15T22:48:46.642706+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1a is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T22:48:47.640038+0000', 'last_change': '2024-09-15T22:48:47.640038+0000', 'last_active': '2024-09-15T22:48:47.640038+0000', 'last_peered': '2024-09-15T22:48:47.640038+0000', 'last_clean': '2024-09-15T22:48:47.640038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:47.640038+0000', 'last_undegraded': '2024-09-15T22:48:47.640038+0000', 'last_fullsized': '2024-09-15T22:48:47.640038+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:47.640038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1b is not active+clean 2024-09-15T22:48:52.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 167, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:48:46.649133+0000', 'last_change': '2024-09-15T22:48:46.649133+0000', 'last_active': '2024-09-15T22:48:46.638092+0000', 'last_peered': '2024-09-15T22:48:46.638092+0000', 'last_clean': '2024-09-15T22:48:46.638092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:48:46.649133+0000', 'last_undegraded': '2024-09-15T22:48:46.649133+0000', 'last_fullsized': '2024-09-15T22:48:46.649133+0000', 'mapping_epoch': 167, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 167, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'last_clean_scrub_stamp': '2024-09-15T22:48:46.638092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:48:52.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:48:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.402+0000 7efe4e542640 1 Processor -- start 2024-09-15T22:48:52.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.402+0000 7efe4e542640 1 -- start start 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4e542640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe4815ed20 0x7efe480b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4e542640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe480b7170 con 0x7efe480cef90 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4e542640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe480b7aa0 con 0x7efe4815e940 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4e542640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efe480d3660 con 0x7efe4815ed20 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe477fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe4815ed20 0x7efe480b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4cadf640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7efe480cef90 0x7efe480b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56374/0 (socket says 172.21.15.134:56374) 2024-09-15T22:48:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.403+0000 7efe4cadf640 1 -- 172.21.15.134:0/1031897740 learned_addr learned my addr 172.21.15.134:0/1031897740 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe477fe640 1 -- 172.21.15.134:0/1031897740 >> v1:172.21.15.177:6789/0 conn(0x7efe4815e940 legacy=0x7efe480d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe477fe640 1 -- 172.21.15.134:0/1031897740 >> v1:172.21.15.134:6789/0 conn(0x7efe480cef90 legacy=0x7efe480b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe46ffd640 1 -- 172.21.15.134:0/1031897740 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382065500 0 0) 0x7efe40001490 con 0x7efe480cef90 2024-09-15T22:48:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe477fe640 1 -- 172.21.15.134:0/1031897740 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe480d3940 con 0x7efe4815ed20 2024-09-15T22:48:52.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe477fe640 1 --2- 172.21.15.134:0/1031897740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815ed20 0x7efe480b3220 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0097a0 tx=0x7efe3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a08453ac1d39d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe46ffd640 1 -- 172.21.15.134:0/1031897740 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c037070 con 0x7efe4815ed20 2024-09-15T22:48:52.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe46ffd640 1 -- 172.21.15.134:0/1031897740 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c032440 con 0x7efe4815ed20 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.404+0000 7efe46ffd640 1 -- 172.21.15.134:0/1031897740 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c032810 con 0x7efe4815ed20 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 -- 172.21.15.134:0/1031897740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815ed20 msgr2=0x7efe480b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 --2- 172.21.15.134:0/1031897740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815ed20 0x7efe480b3220 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0097a0 tx=0x7efe3c02a270 comp rx=0 tx=0).stop 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 -- 172.21.15.134:0/1031897740 shutdown_connections 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 --2- 172.21.15.134:0/1031897740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815ed20 0x7efe480b3220 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 -- 172.21.15.134:0/1031897740 >> 172.21.15.134:0/1031897740 conn(0x7efe480b6240 msgr2=0x7efe480b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 -- 172.21.15.134:0/1031897740 shutdown_connections 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.405+0000 7efe4e542640 1 -- 172.21.15.134:0/1031897740 wait complete. 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.406+0000 7efe4e542640 1 Processor -- start 2024-09-15T22:48:52.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.406+0000 7efe4e542640 1 -- start start 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 0x7efe481591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 0x7efe480ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe480d3310 con 0x7efe4815e940 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe480d3f00 con 0x7efe4815ed20 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4e542640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efe480d1ef0 con 0x7efe480cef90 2024-09-15T22:48:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52640/0 (socket says 172.21.15.134:52640) 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe477fe640 1 -- 172.21.15.134:0/3807315735 learned_addr learned my addr 172.21.15.134:0/3807315735 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.407+0000 7efe4cadf640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 0x7efe480ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 -- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 msgr2=0x7efe481591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe47fff640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 0x7efe481591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 0x7efe481591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 -- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 msgr2=0x7efe480ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 0x7efe480ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 -- 172.21.15.134:0/3807315735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4814ef80 con 0x7efe4815e940 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe4cadf640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 0x7efe480ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe47fff640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 0x7efe481591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe477fe640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0097a0 tx=0x7efe3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c041070 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c03c870 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe480cb2c0 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c037040 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.408+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe48158710 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.409+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe480d1060 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.410+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7efe3c044070 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.410+0000 7efe44ff9640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 0x7efe3406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.410+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7efe3c0aa810 con 0x7efe4815e940 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.410+0000 7efe47fff640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 0x7efe3406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.411+0000 7efe47fff640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 0x7efe3406f100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efe38007fd0 tx=0x7efe38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.414+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe3c07aca0 con 0x7efe4815e940 2024-09-15T22:48:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.644+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efe480ba6b0 con 0x7efe4815e940 2024-09-15T22:48:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.644+0000 7efe44ff9640 1 -- 172.21.15.134:0/3807315735 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1574 (secure 0 0 0) 0x7efe3c07a5a0 con 0x7efe4815e940 2024-09-15T22:48:52.646 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:52.646 INFO:teuthology.orchestra.run.smithi134.stdout:{"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":469,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":170,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440075,"num_in_osds":8,"osd_in_since":1726440065,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":273498112,"bytes_avail":772820615168,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":89,"btime":"2024-09-15T22:48:50:667986+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"a","status":"up:active","gid":9036}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-15T22:48:39.228449+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.646+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 msgr2=0x7efe3406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.646+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 0x7efe3406f100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efe38007fd0 tx=0x7efe38009040 comp rx=0 tx=0).stop 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.646+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 msgr2=0x7efe4814ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.646+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0097a0 tx=0x7efe3c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 shutdown_connections 2024-09-15T22:48:52.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe4815ed20 0x7efe480ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3406cc40 0x7efe3406f100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4815e940 0x7efe4814ea40 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 --2- 172.21.15.134:0/3807315735 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe480cef90 0x7efe481591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 >> 172.21.15.134:0/3807315735 conn(0x7efe480b6240 msgr2=0x7efe480b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 shutdown_connections 2024-09-15T22:48:52.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.647+0000 7efe4e542640 1 -- 172.21.15.134:0/3807315735 wait complete. 2024-09-15T22:48:52.659 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:48:52.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:52.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:48:52.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:48:52.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.758+0000 7ff68131f640 1 Processor -- start 2024-09-15T22:48:52.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.758+0000 7ff68131f640 1 -- start start 2024-09-15T22:48:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff68131f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff67c15e940 0x7ff67c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff68131f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff67c15ed20 0x7ff67c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff68131f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c0b7170 con 0x7ff67c0cef90 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff68131f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0d1ae0 con 0x7ff67c15ed20 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff68131f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0b7aa0 con 0x7ff67c15e940 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff67c15ed20 0x7ff67c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff67c15ed20 0x7ff67c0d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52646/0 (socket says 172.21.15.134:52646) 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 -- 172.21.15.134:0/4059208787 learned_addr learned my addr 172.21.15.134:0/4059208787 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff67c0cef90 0x7ff67c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:56386/0 (socket says 172.21.15.134:56386) 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67affd640 1 --2- 172.21.15.134:0/4059208787 >> v2:172.21.15.177:3300/0 conn(0x7ff67c15e940 0x7ff67c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 -- 172.21.15.134:0/4059208787 >> v2:172.21.15.177:3300/0 conn(0x7ff67c15e940 msgr2=0x7ff67c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 --2- 172.21.15.134:0/4059208787 >> v2:172.21.15.177:3300/0 conn(0x7ff67c15e940 0x7ff67c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 -- 172.21.15.134:0/4059208787 >> v1:172.21.15.134:6789/0 conn(0x7ff67c0cef90 legacy=0x7ff67c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff679ffb640 1 -- 172.21.15.134:0/4059208787 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196798564 0 0) 0x7ff674001490 con 0x7ff67c0cef90 2024-09-15T22:48:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.759+0000 7ff67a7fc640 1 -- 172.21.15.134:0/4059208787 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0d3660 con 0x7ff67c15ed20 2024-09-15T22:48:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.760+0000 7ff67a7fc640 1 --2- 172.21.15.134:0/4059208787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c15ed20 0x7ff67c0d15a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0509d0 tx=0x7ff67002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c3b314c735d6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.760+0000 7ff679ffb640 1 -- 172.21.15.134:0/4059208787 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670037070 con 0x7ff67c15ed20 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.760+0000 7ff679ffb640 1 -- 172.21.15.134:0/4059208787 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67002ae50 con 0x7ff67c15ed20 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.760+0000 7ff679ffb640 1 -- 172.21.15.134:0/4059208787 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670032860 con 0x7ff67c15ed20 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 -- 172.21.15.134:0/4059208787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c15ed20 msgr2=0x7ff67c0d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 --2- 172.21.15.134:0/4059208787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c15ed20 0x7ff67c0d15a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0509d0 tx=0x7ff67002a300 comp rx=0 tx=0).stop 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 -- 172.21.15.134:0/4059208787 shutdown_connections 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 --2- 172.21.15.134:0/4059208787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c15ed20 0x7ff67c0d15a0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 --2- 172.21.15.134:0/4059208787 >> v2:172.21.15.177:3300/0 conn(0x7ff67c15e940 0x7ff67c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 -- 172.21.15.134:0/4059208787 >> 172.21.15.134:0/4059208787 conn(0x7ff67c0b6240 msgr2=0x7ff67c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 -- 172.21.15.134:0/4059208787 shutdown_connections 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.761+0000 7ff68131f640 1 -- 172.21.15.134:0/4059208787 wait complete. 2024-09-15T22:48:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.762+0000 7ff68131f640 1 Processor -- start 2024-09-15T22:48:52.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.762+0000 7ff68131f640 1 -- start start 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15e940 0x7ff67c0ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c15ed20 0x7ff67c0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c0d3f00 con 0x7ff67c0cef90 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c0d3c20 con 0x7ff67c15e940 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff68131f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c0d3310 con 0x7ff67c15ed20 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52662/0 (socket says 172.21.15.134:52662) 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 -- 172.21.15.134:0/2295247172 learned_addr learned my addr 172.21.15.134:0/2295247172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 -- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c15ed20 msgr2=0x7ff67c0ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c15ed20 0x7ff67c0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 -- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15e940 msgr2=0x7ff67c0ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67a7fc640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15e940 0x7ff67c0ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15e940 0x7ff67c0ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 -- 172.21.15.134:0/2295247172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0cd960 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff67affd640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00d800 tx=0x7ff66c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.763+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00b6c0 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.764+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c019070 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.764+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c0cdc40 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.764+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00ba80 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.764+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c0ccac0 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.765+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c0d1ef0 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.765+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7ff66c00bc20 con 0x7ff67c0cef90 2024-09-15T22:48:52.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.766+0000 7ff6637fe640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 0x7ff66806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:52.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.766+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7ff66c08a090 con 0x7ff67c0cef90 2024-09-15T22:48:52.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.766+0000 7ff67a7fc640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 0x7ff66806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:52.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.767+0000 7ff67a7fc640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 0x7ff66806f100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff670034000 tx=0x7ff67002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:52.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.770+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff66c05a400 con 0x7ff67c0cef90 2024-09-15T22:48:52.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.932+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff67c0ba6b0 con 0x7ff66806cc40 2024-09-15T22:48:52.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.939+0000 7ff6637fe640 1 -- 172.21.15.134:0/2295247172 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240257 (secure 0 0 0) 0x7ff67c0ba6b0 con 0x7ff66806cc40 2024-09-15T22:48:52.942 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:52.943 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 msgr2=0x7ff66806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 0x7ff66806f100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff670034000 tx=0x7ff67002e000 comp rx=0 tx=0).stop 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 msgr2=0x7ff67c159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00d800 tx=0x7ff66c00dcc0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 shutdown_connections 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c15ed20 0x7ff67c0ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15e940 0x7ff67c0ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff66806cc40 0x7ff66806f100 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 --2- 172.21.15.134:0/2295247172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c0cef90 0x7ff67c159140 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 >> 172.21.15.134:0/2295247172 conn(0x7ff67c0b6240 msgr2=0x7ff67c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 shutdown_connections 2024-09-15T22:48:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:52.942+0000 7ff68131f640 1 -- 172.21.15.134:0/2295247172 wait complete. 2024-09-15T22:48:52.954 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-15T22:48:51.230957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267088,"kb_used_data":17528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707632,"statfs":{"total":773094113280,"available":772820615168,"internally_reserved":0,"allocated":17948672,"data_stored":8546620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589951"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.650118+0000","last_change":"2024-09-15T22:48:46.650118+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.650118+0000","last_undegraded":"2024-09-15T22:48:46.650118+0000","last_fullsized":"2024-09-15T22:48:46.650118+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649585+0000","last_change":"2024-09-15T22:48:46.649585+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649585+0000","last_undegraded":"2024-09-15T22:48:46.649585+0000","last_fullsized":"2024-09-15T22:48:46.649585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643779+0000","last_change":"2024-09-15T22:48:46.643779+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643779+0000","last_undegraded":"2024-09-15T22:48:46.643779+0000","last_fullsized":"2024-09-15T22:48:46.643779+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643636+0000","last_change":"2024-09-15T22:48:46.643636+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643636+0000","last_undegraded":"2024-09-15T22:48:46.643636+0000","last_fullsized":"2024-09-15T22:48:46.643636+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645969+0000","last_change":"2024-09-15T22:48:46.645969+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645969+0000","last_undegraded":"2024-09-15T22:48:46.645969+0000","last_fullsized":"2024-09-15T22:48:46.645969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.644477+0000","last_change":"2024-09-15T22:48:46.644477+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.644477+0000","last_undegraded":"2024-09-15T22:48:46.644477+0000","last_fullsized":"2024-09-15T22:48:46.644477+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643654+0000","last_change":"2024-09-15T22:48:46.643654+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643654+0000","last_undegraded":"2024-09-15T22:48:46.643654+0000","last_fullsized":"2024-09-15T22:48:46.643654+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645314+0000","last_change":"2024-09-15T22:48:46.645314+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645314+0000","last_undegraded":"2024-09-15T22:48:46.645314+0000","last_fullsized":"2024-09-15T22:48:46.645314+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642730+0000","last_change":"2024-09-15T22:48:46.642730+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642730+0000","last_undegraded":"2024-09-15T22:48:46.642730+0000","last_fullsized":"2024-09-15T22:48:46.642730+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646914+0000","last_change":"2024-09-15T22:48:46.646914+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646914+0000","last_undegraded":"2024-09-15T22:48:46.646914+0000","last_fullsized":"2024-09-15T22:48:46.646914+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646764+0000","last_change":"2024-09-15T22:48:46.646764+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646764+0000","last_undegraded":"2024-09-15T22:48:46.646764+0000","last_fullsized":"2024-09-15T22:48:46.646764+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649121+0000","last_change":"2024-09-15T22:48:46.649121+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649121+0000","last_undegraded":"2024-09-15T22:48:46.649121+0000","last_fullsized":"2024-09-15T22:48:46.649121+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643069+0000","last_change":"2024-09-15T22:48:46.643069+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643069+0000","last_undegraded":"2024-09-15T22:48:46.643069+0000","last_fullsized":"2024-09-15T22:48:46.643069+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643831+0000","last_change":"2024-09-15T22:48:46.643831+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643831+0000","last_undegraded":"2024-09-15T22:48:46.643831+0000","last_fullsized":"2024-09-15T22:48:46.643831+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646787+0000","last_change":"2024-09-15T22:48:46.646787+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646787+0000","last_undegraded":"2024-09-15T22:48:46.646787+0000","last_fullsized":"2024-09-15T22:48:46.646787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643484+0000","last_change":"2024-09-15T22:48:46.643484+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643484+0000","last_undegraded":"2024-09-15T22:48:46.643484+0000","last_fullsized":"2024-09-15T22:48:46.643484+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649879+0000","last_change":"2024-09-15T22:48:46.649879+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649879+0000","last_undegraded":"2024-09-15T22:48:46.649879+0000","last_fullsized":"2024-09-15T22:48:46.649879+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643466+0000","last_change":"2024-09-15T22:48:46.643466+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643466+0000","last_undegraded":"2024-09-15T22:48:46.643466+0000","last_fullsized":"2024-09-15T22:48:46.643466+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642820+0000","last_change":"2024-09-15T22:48:46.642820+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642820+0000","last_undegraded":"2024-09-15T22:48:46.642820+0000","last_fullsized":"2024-09-15T22:48:46.642820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645416+0000","last_change":"2024-09-15T22:48:46.645416+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645416+0000","last_undegraded":"2024-09-15T22:48:46.645416+0000","last_fullsized":"2024-09-15T22:48:46.645416+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642806+0000","last_change":"2024-09-15T22:48:46.642806+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642806+0000","last_undegraded":"2024-09-15T22:48:46.642806+0000","last_fullsized":"2024-09-15T22:48:46.642806+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.643265+0000","last_change":"2024-09-15T22:48:46.643265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.643265+0000","last_undegraded":"2024-09-15T22:48:46.643265+0000","last_fullsized":"2024-09-15T22:48:46.643265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649159+0000","last_change":"2024-09-15T22:48:46.649159+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649159+0000","last_undegraded":"2024-09-15T22:48:46.649159+0000","last_fullsized":"2024-09-15T22:48:46.649159+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.646289+0000","last_change":"2024-09-15T22:48:46.646289+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.646289+0000","last_undegraded":"2024-09-15T22:48:46.646289+0000","last_fullsized":"2024-09-15T22:48:46.646289+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645975+0000","last_change":"2024-09-15T22:48:46.645975+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645975+0000","last_undegraded":"2024-09-15T22:48:46.645975+0000","last_fullsized":"2024-09-15T22:48:46.645975+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642703+0000","last_change":"2024-09-15T22:48:46.642703+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642703+0000","last_undegraded":"2024-09-15T22:48:46.642703+0000","last_fullsized":"2024-09-15T22:48:46.642703+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.645458+0000","last_change":"2024-09-15T22:48:46.645458+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.645458+0000","last_undegraded":"2024-09-15T22:48:46.645458+0000","last_fullsized":"2024-09-15T22:48:46.645458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649265+0000","last_change":"2024-09-15T22:48:46.649265+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649265+0000","last_undegraded":"2024-09-15T22:48:46.649265+0000","last_fullsized":"2024-09-15T22:48:46.649265+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.642706+0000","last_change":"2024-09-15T22:48:46.642706+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.642706+0000","last_undegraded":"2024-09-15T22:48:46.642706+0000","last_fullsized":"2024-09-15T22:48:46.642706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:48:47.640038+0000","last_change":"2024-09-15T22:48:47.640038+0000","last_active":"2024-09-15T22:48:47.640038+0000","last_peered":"2024-09-15T22:48:47.640038+0000","last_clean":"2024-09-15T22:48:47.640038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:47.640038+0000","last_undegraded":"2024-09-15T22:48:47.640038+0000","last_fullsized":"2024-09-15T22:48:47.640038+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2024-09-15T22:48:46.649133+0000","last_change":"2024-09-15T22:48:46.649133+0000","last_active":"2024-09-15T22:48:46.638092+0000","last_peered":"2024-09-15T22:48:46.638092+0000","last_clean":"2024-09-15T22:48:46.638092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:48:46.649133+0000","last_undegraded":"2024-09-15T22:48:46.649133+0000","last_fullsized":"2024-09-15T22:48:46.649133+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":476,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T22:48:46.641079+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:46.641079+0000","last_peered":"2024-09-15T22:48:46.641079+0000","last_clean":"2024-09-15T22:48:46.641079+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:46.641079+0000","last_undegraded":"2024-09-15T22:48:46.641079+0000","last_fullsized":"2024-09-15T22:48:46.641079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2695168,"data_stored":1514040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2088960,"data_stored":917799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2682880,"data_stored":1508167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2101248,"data_stored":923672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:54.643 INFO:tasks.ceph.mds.a.smithi134.stderr:2024-09-15T22:48:54.642+0000 7f18bde9d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:48:55.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:48:56.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.066+0000 7fa657ca5640 1 Processor -- start 2024-09-15T22:48:56.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.066+0000 7fa657ca5640 1 -- start start 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa657ca5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa65015f8e0 0x7fa6500cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa657ca5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6500b3550 0x7fa6500b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa657ca5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa650160bb0 con 0x7fa65015ffa0 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa657ca5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa650160e90 con 0x7fa6500b3550 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa657ca5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa6500b3f20 con 0x7fa65015f8e0 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa656242640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6500b3550 0x7fa6500b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa656242640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6500b3550 0x7fa6500b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52668/0 (socket says 172.21.15.134:52668) 2024-09-15T22:48:56.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.067+0000 7fa656242640 1 -- 172.21.15.134:0/2614441146 learned_addr learned my addr 172.21.15.134:0/2614441146 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:56.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa655a41640 1 --2- 172.21.15.134:0/2614441146 >> v2:172.21.15.177:3300/0 conn(0x7fa65015f8e0 0x7fa6500cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa656242640 1 -- 172.21.15.134:0/2614441146 >> v2:172.21.15.177:3300/0 conn(0x7fa65015f8e0 msgr2=0x7fa6500cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:56.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa656242640 1 --2- 172.21.15.134:0/2614441146 >> v2:172.21.15.177:3300/0 conn(0x7fa65015f8e0 0x7fa6500cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa656242640 1 -- 172.21.15.134:0/2614441146 >> v1:172.21.15.177:6789/0 conn(0x7fa65015ffa0 legacy=0x7fa650160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:56.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa656242640 1 -- 172.21.15.134:0/2614441146 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500ce170 con 0x7fa6500b3550 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.068+0000 7fa656242640 1 --2- 172.21.15.134:0/2614441146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6500b3550 0x7fa6500b39e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fa65006dc60 tx=0x7fa64802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19896d64b4dcece server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa654a3f640 1 -- 172.21.15.134:0/2614441146 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648036070 con 0x7fa6500b3550 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa654a3f640 1 -- 172.21.15.134:0/2614441146 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648031600 con 0x7fa6500b3550 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa654a3f640 1 -- 172.21.15.134:0/2614441146 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480319d0 con 0x7fa6500b3550 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 -- 172.21.15.134:0/2614441146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6500b3550 msgr2=0x7fa6500b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 --2- 172.21.15.134:0/2614441146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6500b3550 0x7fa6500b39e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fa65006dc60 tx=0x7fa64802a660 comp rx=0 tx=0).stop 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 -- 172.21.15.134:0/2614441146 shutdown_connections 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 --2- 172.21.15.134:0/2614441146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6500b3550 0x7fa6500b39e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 --2- 172.21.15.134:0/2614441146 >> v2:172.21.15.177:3300/0 conn(0x7fa65015f8e0 0x7fa6500cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 -- 172.21.15.134:0/2614441146 >> 172.21.15.134:0/2614441146 conn(0x7fa65006ce90 msgr2=0x7fa65006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 -- 172.21.15.134:0/2614441146 shutdown_connections 2024-09-15T22:48:56.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.069+0000 7fa657ca5640 1 -- 172.21.15.134:0/2614441146 wait complete. 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.070+0000 7fa657ca5640 1 Processor -- start 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 -- start start 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6500b3550 0x7fa6500aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 0x7fa650158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa65015fcc0 con 0x7fa65015f8e0 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6500ce730 con 0x7fa6500b3550 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa657ca5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa6500b59e0 con 0x7fa65015ffa0 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa655240640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa655240640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52674/0 (socket says 172.21.15.134:52674) 2024-09-15T22:48:56.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa655240640 1 -- 172.21.15.134:0/845242599 learned_addr learned my addr 172.21.15.134:0/845242599 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.071+0000 7fa655a41640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6500b3550 0x7fa6500aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa656242640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 0x7fa650158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 -- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 msgr2=0x7fa650158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 0x7fa650158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 -- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6500b3550 msgr2=0x7fa6500aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6500b3550 0x7fa6500aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 -- 172.21.15.134:0/845242599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500b00d0 con 0x7fa65015f8e0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa656242640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 0x7fa650158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa655240640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fa64000b410 tx=0x7fa64000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640015020 con 0x7fa65015f8e0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640011830 con 0x7fa65015f8e0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6500ad4b0 con 0x7fa65015f8e0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640011c20 con 0x7fa65015f8e0 2024-09-15T22:48:56.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.072+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6500ada70 con 0x7fa65015f8e0 2024-09-15T22:48:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.073+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6500b39e0 con 0x7fa65015f8e0 2024-09-15T22:48:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.073+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fa640018020 con 0x7fa65015f8e0 2024-09-15T22:48:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.074+0000 7fa6467fc640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 0x7fa63406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.074+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fa640089ad0 con 0x7fa65015f8e0 2024-09-15T22:48:56.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.074+0000 7fa655a41640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 0x7fa63406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.075+0000 7fa655a41640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 0x7fa63406f100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa65006fd40 tx=0x7fa64c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.078+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa64001f020 con 0x7fa65015f8e0 2024-09-15T22:48:56.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.239+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa650063400 con 0x7fa63406cc40 2024-09-15T22:48:56.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.246+0000 7fa6467fc640 1 -- 172.21.15.134:0/845242599 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252485 (secure 0 0 0) 0x7fa650063400 con 0x7fa63406cc40 2024-09-15T22:48:56.251 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:56.252 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:48:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 msgr2=0x7fa63406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 0x7fa63406f100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa65006fd40 tx=0x7fa64c008040 comp rx=0 tx=0).stop 2024-09-15T22:48:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 msgr2=0x7fa6500afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fa64000b410 tx=0x7fa64000b8d0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 shutdown_connections 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa65015ffa0 0x7fa650158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa63406cc40 0x7fa63406f100 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65015f8e0 0x7fa6500afb90 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 --2- 172.21.15.134:0/845242599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6500b3550 0x7fa6500aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 >> 172.21.15.134:0/845242599 conn(0x7fa65006ce90 msgr2=0x7fa65006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 shutdown_connections 2024-09-15T22:48:56.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.249+0000 7fa657ca5640 1 -- 172.21.15.134:0/845242599 wait complete. 2024-09-15T22:48:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-09-15T22:48:55.231978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267448,"kb_used_data":17928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707272,"statfs":{"total":773094113280,"available":772820246528,"internally_reserved":0,"allocated":18358272,"data_stored":8731076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.579343"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905232+0000","last_change":"2024-09-15T22:48:48.678427+0000","last_active":"2024-09-15T22:48:49.905232+0000","last_peered":"2024-09-15T22:48:49.905232+0000","last_clean":"2024-09-15T22:48:49.905232+0000","last_became_active":"2024-09-15T22:48:48.678023+0000","last_became_peered":"2024-09-15T22:48:48.678023+0000","last_unstale":"2024-09-15T22:48:49.905232+0000","last_undegraded":"2024-09-15T22:48:49.905232+0000","last_fullsized":"2024-09-15T22:48:49.905232+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:57.718700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905768+0000","last_change":"2024-09-15T22:48:48.669882+0000","last_active":"2024-09-15T22:48:49.905768+0000","last_peered":"2024-09-15T22:48:49.905768+0000","last_clean":"2024-09-15T22:48:49.905768+0000","last_became_active":"2024-09-15T22:48:48.669622+0000","last_became_peered":"2024-09-15T22:48:48.669622+0000","last_unstale":"2024-09-15T22:48:49.905768+0000","last_undegraded":"2024-09-15T22:48:49.905768+0000","last_fullsized":"2024-09-15T22:48:49.905768+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:18.716508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780919+0000","last_change":"2024-09-15T22:48:48.671226+0000","last_active":"2024-09-15T22:48:49.780919+0000","last_peered":"2024-09-15T22:48:49.780919+0000","last_clean":"2024-09-15T22:48:49.780919+0000","last_became_active":"2024-09-15T22:48:48.670930+0000","last_became_peered":"2024-09-15T22:48:48.670930+0000","last_unstale":"2024-09-15T22:48:49.780919+0000","last_undegraded":"2024-09-15T22:48:49.780919+0000","last_fullsized":"2024-09-15T22:48:49.780919+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:18.630816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670422+0000","last_change":"2024-09-15T22:48:48.670549+0000","last_active":"2024-09-15T22:48:49.670422+0000","last_peered":"2024-09-15T22:48:49.670422+0000","last_clean":"2024-09-15T22:48:49.670422+0000","last_became_active":"2024-09-15T22:48:48.670297+0000","last_became_peered":"2024-09-15T22:48:48.670297+0000","last_unstale":"2024-09-15T22:48:49.670422+0000","last_undegraded":"2024-09-15T22:48:49.670422+0000","last_fullsized":"2024-09-15T22:48:49.670422+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:39.378923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780936+0000","last_change":"2024-09-15T22:48:48.672502+0000","last_active":"2024-09-15T22:48:49.780936+0000","last_peered":"2024-09-15T22:48:49.780936+0000","last_clean":"2024-09-15T22:48:49.780936+0000","last_became_active":"2024-09-15T22:48:48.672207+0000","last_became_peered":"2024-09-15T22:48:48.672207+0000","last_unstale":"2024-09-15T22:48:49.780936+0000","last_undegraded":"2024-09-15T22:48:49.780936+0000","last_fullsized":"2024-09-15T22:48:49.780936+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:37.883430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905230+0000","last_change":"2024-09-15T22:48:48.672144+0000","last_active":"2024-09-15T22:48:49.905230+0000","last_peered":"2024-09-15T22:48:49.905230+0000","last_clean":"2024-09-15T22:48:49.905230+0000","last_became_active":"2024-09-15T22:48:48.671886+0000","last_became_peered":"2024-09-15T22:48:48.671886+0000","last_unstale":"2024-09-15T22:48:49.905230+0000","last_undegraded":"2024-09-15T22:48:49.905230+0000","last_fullsized":"2024-09-15T22:48:49.905230+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:10.782653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904991+0000","last_change":"2024-09-15T22:48:48.672578+0000","last_active":"2024-09-15T22:48:49.904991+0000","last_peered":"2024-09-15T22:48:49.904991+0000","last_clean":"2024-09-15T22:48:49.904991+0000","last_became_active":"2024-09-15T22:48:48.672278+0000","last_became_peered":"2024-09-15T22:48:48.672278+0000","last_unstale":"2024-09-15T22:48:49.904991+0000","last_undegraded":"2024-09-15T22:48:49.904991+0000","last_fullsized":"2024-09-15T22:48:49.904991+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:26.727903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672419+0000","last_change":"2024-09-15T22:48:48.675949+0000","last_active":"2024-09-15T22:48:49.672419+0000","last_peered":"2024-09-15T22:48:49.672419+0000","last_clean":"2024-09-15T22:48:49.672419+0000","last_became_active":"2024-09-15T22:48:48.675678+0000","last_became_peered":"2024-09-15T22:48:48.675678+0000","last_unstale":"2024-09-15T22:48:49.672419+0000","last_undegraded":"2024-09-15T22:48:49.672419+0000","last_fullsized":"2024-09-15T22:48:49.672419+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.704539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905935+0000","last_change":"2024-09-15T22:48:48.675638+0000","last_active":"2024-09-15T22:48:49.905935+0000","last_peered":"2024-09-15T22:48:49.905935+0000","last_clean":"2024-09-15T22:48:49.905935+0000","last_became_active":"2024-09-15T22:48:48.675380+0000","last_became_peered":"2024-09-15T22:48:48.675380+0000","last_unstale":"2024-09-15T22:48:49.905935+0000","last_undegraded":"2024-09-15T22:48:49.905935+0000","last_fullsized":"2024-09-15T22:48:49.905935+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:38.163969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781099+0000","last_change":"2024-09-15T22:48:48.676845+0000","last_active":"2024-09-15T22:48:49.781099+0000","last_peered":"2024-09-15T22:48:49.781099+0000","last_clean":"2024-09-15T22:48:49.781099+0000","last_became_active":"2024-09-15T22:48:48.676553+0000","last_became_peered":"2024-09-15T22:48:48.676553+0000","last_unstale":"2024-09-15T22:48:49.781099+0000","last_undegraded":"2024-09-15T22:48:49.781099+0000","last_fullsized":"2024-09-15T22:48:49.781099+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:21.216761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905293+0000","last_change":"2024-09-15T22:48:48.682674+0000","last_active":"2024-09-15T22:48:49.905293+0000","last_peered":"2024-09-15T22:48:49.905293+0000","last_clean":"2024-09-15T22:48:49.905293+0000","last_became_active":"2024-09-15T22:48:48.682013+0000","last_became_peered":"2024-09-15T22:48:48.682013+0000","last_unstale":"2024-09-15T22:48:49.905293+0000","last_undegraded":"2024-09-15T22:48:49.905293+0000","last_fullsized":"2024-09-15T22:48:49.905293+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:23.631353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905096+0000","last_change":"2024-09-15T22:48:48.683137+0000","last_active":"2024-09-15T22:48:49.905096+0000","last_peered":"2024-09-15T22:48:49.905096+0000","last_clean":"2024-09-15T22:48:49.905096+0000","last_became_active":"2024-09-15T22:48:48.682864+0000","last_became_peered":"2024-09-15T22:48:48.682864+0000","last_unstale":"2024-09-15T22:48:49.905096+0000","last_undegraded":"2024-09-15T22:48:49.905096+0000","last_fullsized":"2024-09-15T22:48:49.905096+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:13.552691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670140+0000","last_change":"2024-09-15T22:48:48.673208+0000","last_active":"2024-09-15T22:48:49.670140+0000","last_peered":"2024-09-15T22:48:49.670140+0000","last_clean":"2024-09-15T22:48:49.670140+0000","last_became_active":"2024-09-15T22:48:48.672913+0000","last_became_peered":"2024-09-15T22:48:48.672913+0000","last_unstale":"2024-09-15T22:48:49.670140+0000","last_undegraded":"2024-09-15T22:48:49.670140+0000","last_fullsized":"2024-09-15T22:48:49.670140+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:07.554657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672139+0000","last_change":"2024-09-15T22:48:48.670910+0000","last_active":"2024-09-15T22:48:49.672139+0000","last_peered":"2024-09-15T22:48:49.672139+0000","last_clean":"2024-09-15T22:48:49.672139+0000","last_became_active":"2024-09-15T22:48:48.670054+0000","last_became_peered":"2024-09-15T22:48:48.670054+0000","last_unstale":"2024-09-15T22:48:49.672139+0000","last_undegraded":"2024-09-15T22:48:49.672139+0000","last_fullsized":"2024-09-15T22:48:49.672139+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:33.836425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904886+0000","last_change":"2024-09-15T22:48:48.682132+0000","last_active":"2024-09-15T22:48:49.904886+0000","last_peered":"2024-09-15T22:48:49.904886+0000","last_clean":"2024-09-15T22:48:49.904886+0000","last_became_active":"2024-09-15T22:48:48.681778+0000","last_became_peered":"2024-09-15T22:48:48.681778+0000","last_unstale":"2024-09-15T22:48:49.904886+0000","last_undegraded":"2024-09-15T22:48:49.904886+0000","last_fullsized":"2024-09-15T22:48:49.904886+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:44.704989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904766+0000","last_change":"2024-09-15T22:48:48.679304+0000","last_active":"2024-09-15T22:48:49.904766+0000","last_peered":"2024-09-15T22:48:49.904766+0000","last_clean":"2024-09-15T22:48:49.904766+0000","last_became_active":"2024-09-15T22:48:48.678831+0000","last_became_peered":"2024-09-15T22:48:48.678831+0000","last_unstale":"2024-09-15T22:48:49.904766+0000","last_undegraded":"2024-09-15T22:48:49.904766+0000","last_fullsized":"2024-09-15T22:48:49.904766+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:53.001434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905290+0000","last_change":"2024-09-15T22:48:48.680387+0000","last_active":"2024-09-15T22:48:49.905290+0000","last_peered":"2024-09-15T22:48:49.905290+0000","last_clean":"2024-09-15T22:48:49.905290+0000","last_became_active":"2024-09-15T22:48:48.680097+0000","last_became_peered":"2024-09-15T22:48:48.680097+0000","last_unstale":"2024-09-15T22:48:49.905290+0000","last_undegraded":"2024-09-15T22:48:49.905290+0000","last_fullsized":"2024-09-15T22:48:49.905290+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:21.947911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781199+0000","last_change":"2024-09-15T22:48:48.674991+0000","last_active":"2024-09-15T22:48:49.781199+0000","last_peered":"2024-09-15T22:48:49.781199+0000","last_clean":"2024-09-15T22:48:49.781199+0000","last_became_active":"2024-09-15T22:48:48.674728+0000","last_became_peered":"2024-09-15T22:48:48.674728+0000","last_unstale":"2024-09-15T22:48:49.781199+0000","last_undegraded":"2024-09-15T22:48:49.781199+0000","last_fullsized":"2024-09-15T22:48:49.781199+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:26.687952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781052+0000","last_change":"2024-09-15T22:48:48.671915+0000","last_active":"2024-09-15T22:48:49.781052+0000","last_peered":"2024-09-15T22:48:49.781052+0000","last_clean":"2024-09-15T22:48:49.781052+0000","last_became_active":"2024-09-15T22:48:48.671624+0000","last_became_peered":"2024-09-15T22:48:48.671624+0000","last_unstale":"2024-09-15T22:48:49.781052+0000","last_undegraded":"2024-09-15T22:48:49.781052+0000","last_fullsized":"2024-09-15T22:48:49.781052+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:13.610732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781171+0000","last_change":"2024-09-15T22:48:48.678783+0000","last_active":"2024-09-15T22:48:49.781171+0000","last_peered":"2024-09-15T22:48:49.781171+0000","last_clean":"2024-09-15T22:48:49.781171+0000","last_became_active":"2024-09-15T22:48:48.678499+0000","last_became_peered":"2024-09-15T22:48:48.678499+0000","last_unstale":"2024-09-15T22:48:49.781171+0000","last_undegraded":"2024-09-15T22:48:49.781171+0000","last_fullsized":"2024-09-15T22:48:49.781171+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:37.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904904+0000","last_change":"2024-09-15T22:48:48.672727+0000","last_active":"2024-09-15T22:48:49.904904+0000","last_peered":"2024-09-15T22:48:49.904904+0000","last_clean":"2024-09-15T22:48:49.904904+0000","last_became_active":"2024-09-15T22:48:48.672465+0000","last_became_peered":"2024-09-15T22:48:48.672465+0000","last_unstale":"2024-09-15T22:48:49.904904+0000","last_undegraded":"2024-09-15T22:48:49.904904+0000","last_fullsized":"2024-09-15T22:48:49.904904+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:37.883430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904961+0000","last_change":"2024-09-15T22:48:48.665750+0000","last_active":"2024-09-15T22:48:49.904961+0000","last_peered":"2024-09-15T22:48:49.904961+0000","last_clean":"2024-09-15T22:48:49.904961+0000","last_became_active":"2024-09-15T22:48:48.665484+0000","last_became_peered":"2024-09-15T22:48:48.665484+0000","last_unstale":"2024-09-15T22:48:49.904961+0000","last_undegraded":"2024-09-15T22:48:49.904961+0000","last_fullsized":"2024-09-15T22:48:49.904961+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:39.668614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670167+0000","last_change":"2024-09-15T22:48:48.667566+0000","last_active":"2024-09-15T22:48:49.670167+0000","last_peered":"2024-09-15T22:48:49.670167+0000","last_clean":"2024-09-15T22:48:49.670167+0000","last_became_active":"2024-09-15T22:48:48.667280+0000","last_became_peered":"2024-09-15T22:48:48.667280+0000","last_unstale":"2024-09-15T22:48:49.670167+0000","last_undegraded":"2024-09-15T22:48:49.670167+0000","last_fullsized":"2024-09-15T22:48:49.670167+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:44.081209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905463+0000","last_change":"2024-09-15T22:48:48.681660+0000","last_active":"2024-09-15T22:48:49.905463+0000","last_peered":"2024-09-15T22:48:49.905463+0000","last_clean":"2024-09-15T22:48:49.905463+0000","last_became_active":"2024-09-15T22:48:48.681390+0000","last_became_peered":"2024-09-15T22:48:48.681390+0000","last_unstale":"2024-09-15T22:48:49.905463+0000","last_undegraded":"2024-09-15T22:48:49.905463+0000","last_fullsized":"2024-09-15T22:48:49.905463+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:35.752763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670107+0000","last_change":"2024-09-15T22:48:48.674146+0000","last_active":"2024-09-15T22:48:49.670107+0000","last_peered":"2024-09-15T22:48:49.670107+0000","last_clean":"2024-09-15T22:48:49.670107+0000","last_became_active":"2024-09-15T22:48:48.673698+0000","last_became_peered":"2024-09-15T22:48:48.673698+0000","last_unstale":"2024-09-15T22:48:49.670107+0000","last_undegraded":"2024-09-15T22:48:49.670107+0000","last_fullsized":"2024-09-15T22:48:49.670107+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:51:51.578972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672965+0000","last_change":"2024-09-15T22:48:48.674659+0000","last_active":"2024-09-15T22:48:49.672965+0000","last_peered":"2024-09-15T22:48:49.672965+0000","last_clean":"2024-09-15T22:48:49.672965+0000","last_became_active":"2024-09-15T22:48:48.674388+0000","last_became_peered":"2024-09-15T22:48:48.674388+0000","last_unstale":"2024-09-15T22:48:49.672965+0000","last_undegraded":"2024-09-15T22:48:49.672965+0000","last_fullsized":"2024-09-15T22:48:49.672965+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:10.782653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905167+0000","last_change":"2024-09-15T22:48:48.678923+0000","last_active":"2024-09-15T22:48:49.905167+0000","last_peered":"2024-09-15T22:48:49.905167+0000","last_clean":"2024-09-15T22:48:49.905167+0000","last_became_active":"2024-09-15T22:48:48.678648+0000","last_became_peered":"2024-09-15T22:48:48.678648+0000","last_unstale":"2024-09-15T22:48:49.905167+0000","last_undegraded":"2024-09-15T22:48:49.905167+0000","last_fullsized":"2024-09-15T22:48:49.905167+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:13.610732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.673012+0000","last_change":"2024-09-15T22:48:48.675393+0000","last_active":"2024-09-15T22:48:49.673012+0000","last_peered":"2024-09-15T22:48:49.673012+0000","last_clean":"2024-09-15T22:48:49.673012+0000","last_became_active":"2024-09-15T22:48:48.675091+0000","last_became_peered":"2024-09-15T22:48:48.675091+0000","last_unstale":"2024-09-15T22:48:49.673012+0000","last_undegraded":"2024-09-15T22:48:49.673012+0000","last_fullsized":"2024-09-15T22:48:49.673012+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:21.947911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904924+0000","last_change":"2024-09-15T22:48:48.675565+0000","last_active":"2024-09-15T22:48:49.904924+0000","last_peered":"2024-09-15T22:48:49.904924+0000","last_clean":"2024-09-15T22:48:49.904924+0000","last_became_active":"2024-09-15T22:48:48.675293+0000","last_became_peered":"2024-09-15T22:48:48.675293+0000","last_unstale":"2024-09-15T22:48:49.904924+0000","last_undegraded":"2024-09-15T22:48:49.904924+0000","last_fullsized":"2024-09-15T22:48:49.904924+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:55.524634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669990+0000","last_change":"2024-09-15T22:48:48.673349+0000","last_active":"2024-09-15T22:48:49.669990+0000","last_peered":"2024-09-15T22:48:49.669990+0000","last_clean":"2024-09-15T22:48:49.669990+0000","last_became_active":"2024-09-15T22:48:48.672984+0000","last_became_peered":"2024-09-15T22:48:48.672984+0000","last_unstale":"2024-09-15T22:48:49.669990+0000","last_undegraded":"2024-09-15T22:48:49.669990+0000","last_fullsized":"2024-09-15T22:48:49.669990+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:19.206292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780663+0000","last_change":"2024-09-15T22:48:48.678602+0000","last_active":"2024-09-15T22:48:49.780663+0000","last_peered":"2024-09-15T22:48:49.780663+0000","last_clean":"2024-09-15T22:48:49.780663+0000","last_became_active":"2024-09-15T22:48:48.678331+0000","last_became_peered":"2024-09-15T22:48:48.678331+0000","last_unstale":"2024-09-15T22:48:49.780663+0000","last_undegraded":"2024-09-15T22:48:49.780663+0000","last_fullsized":"2024-09-15T22:48:49.780663+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:21.366526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672171+0000","last_change":"2024-09-15T22:48:48.670525+0000","last_active":"2024-09-15T22:48:49.672171+0000","last_peered":"2024-09-15T22:48:49.672171+0000","last_clean":"2024-09-15T22:48:49.672171+0000","last_became_active":"2024-09-15T22:48:48.670087+0000","last_became_peered":"2024-09-15T22:48:48.670087+0000","last_unstale":"2024-09-15T22:48:49.672171+0000","last_undegraded":"2024-09-15T22:48:49.672171+0000","last_fullsized":"2024-09-15T22:48:49.672171+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:27.476223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905475+0000","last_change":"2024-09-15T22:48:48.680458+0000","last_active":"2024-09-15T22:48:49.905475+0000","last_peered":"2024-09-15T22:48:49.905475+0000","last_clean":"2024-09-15T22:48:49.905475+0000","last_became_active":"2024-09-15T22:48:48.680022+0000","last_became_peered":"2024-09-15T22:48:48.680022+0000","last_unstale":"2024-09-15T22:48:49.905475+0000","last_undegraded":"2024-09-15T22:48:49.905475+0000","last_fullsized":"2024-09-15T22:48:49.905475+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:03.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"169'4","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905358+0000","last_change":"2024-09-15T22:48:47.670725+0000","last_active":"2024-09-15T22:48:49.905358+0000","last_peered":"2024-09-15T22:48:49.905358+0000","last_clean":"2024-09-15T22:48:49.905358+0000","last_became_active":"2024-09-15T22:48:47.670438+0000","last_became_peered":"2024-09-15T22:48:47.670438+0000","last_unstale":"2024-09-15T22:48:49.905358+0000","last_undegraded":"2024-09-15T22:48:49.905358+0000","last_fullsized":"2024-09-15T22:48:49.905358+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:37.162023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670289+0000","last_change":"2024-09-15T22:48:48.664534+0000","last_active":"2024-09-15T22:48:49.670289+0000","last_peered":"2024-09-15T22:48:49.670289+0000","last_clean":"2024-09-15T22:48:49.670289+0000","last_became_active":"2024-09-15T22:48:48.664245+0000","last_became_peered":"2024-09-15T22:48:48.664245+0000","last_unstale":"2024-09-15T22:48:49.670289+0000","last_undegraded":"2024-09-15T22:48:49.670289+0000","last_fullsized":"2024-09-15T22:48:49.670289+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"169'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905492+0000","last_change":"2024-09-15T22:48:47.666852+0000","last_active":"2024-09-15T22:48:49.905492+0000","last_peered":"2024-09-15T22:48:49.905492+0000","last_clean":"2024-09-15T22:48:49.905492+0000","last_became_active":"2024-09-15T22:48:47.666319+0000","last_became_peered":"2024-09-15T22:48:47.666319+0000","last_unstale":"2024-09-15T22:48:49.905492+0000","last_undegraded":"2024-09-15T22:48:49.905492+0000","last_fullsized":"2024-09-15T22:48:49.905492+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:25.725956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781012+0000","last_change":"2024-09-15T22:48:48.676039+0000","last_active":"2024-09-15T22:48:49.781012+0000","last_peered":"2024-09-15T22:48:49.781012+0000","last_clean":"2024-09-15T22:48:49.781012+0000","last_became_active":"2024-09-15T22:48:48.675443+0000","last_became_peered":"2024-09-15T22:48:48.675443+0000","last_unstale":"2024-09-15T22:48:49.781012+0000","last_undegraded":"2024-09-15T22:48:49.781012+0000","last_fullsized":"2024-09-15T22:48:49.781012+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:13.552691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.673069+0000","last_change":"2024-09-15T22:48:47.663153+0000","last_active":"2024-09-15T22:48:49.673069+0000","last_peered":"2024-09-15T22:48:49.673069+0000","last_clean":"2024-09-15T22:48:49.673069+0000","last_became_active":"2024-09-15T22:48:47.662893+0000","last_became_peered":"2024-09-15T22:48:47.662893+0000","last_unstale":"2024-09-15T22:48:49.673069+0000","last_undegraded":"2024-09-15T22:48:49.673069+0000","last_fullsized":"2024-09-15T22:48:49.673069+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:01.475557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781139+0000","last_change":"2024-09-15T22:48:48.672572+0000","last_active":"2024-09-15T22:48:49.781139+0000","last_peered":"2024-09-15T22:48:49.781139+0000","last_clean":"2024-09-15T22:48:49.781139+0000","last_became_active":"2024-09-15T22:48:48.672294+0000","last_became_peered":"2024-09-15T22:48:48.672294+0000","last_unstale":"2024-09-15T22:48:49.781139+0000","last_undegraded":"2024-09-15T22:48:49.781139+0000","last_fullsized":"2024-09-15T22:48:49.781139+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:03.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670378+0000","last_change":"2024-09-15T22:48:47.673695+0000","last_active":"2024-09-15T22:48:49.670378+0000","last_peered":"2024-09-15T22:48:49.670378+0000","last_clean":"2024-09-15T22:48:49.670378+0000","last_became_active":"2024-09-15T22:48:47.673446+0000","last_became_peered":"2024-09-15T22:48:47.673446+0000","last_unstale":"2024-09-15T22:48:49.670378+0000","last_undegraded":"2024-09-15T22:48:49.670378+0000","last_fullsized":"2024-09-15T22:48:49.670378+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.984928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670277+0000","last_change":"2024-09-15T22:48:48.665798+0000","last_active":"2024-09-15T22:48:49.670277+0000","last_peered":"2024-09-15T22:48:49.670277+0000","last_clean":"2024-09-15T22:48:49.670277+0000","last_became_active":"2024-09-15T22:48:48.665520+0000","last_became_peered":"2024-09-15T22:48:48.665520+0000","last_unstale":"2024-09-15T22:48:49.670277+0000","last_undegraded":"2024-09-15T22:48:49.670277+0000","last_fullsized":"2024-09-15T22:48:49.670277+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:06.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"169'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905288+0000","last_change":"2024-09-15T22:48:47.666690+0000","last_active":"2024-09-15T22:48:49.905288+0000","last_peered":"2024-09-15T22:48:49.905288+0000","last_clean":"2024-09-15T22:48:49.905288+0000","last_became_active":"2024-09-15T22:48:47.666240+0000","last_became_peered":"2024-09-15T22:48:47.666240+0000","last_unstale":"2024-09-15T22:48:49.905288+0000","last_undegraded":"2024-09-15T22:48:49.905288+0000","last_fullsized":"2024-09-15T22:48:49.905288+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:50.622085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904924+0000","last_change":"2024-09-15T22:48:48.672421+0000","last_active":"2024-09-15T22:48:49.904924+0000","last_peered":"2024-09-15T22:48:49.904924+0000","last_clean":"2024-09-15T22:48:49.904924+0000","last_became_active":"2024-09-15T22:48:48.672162+0000","last_became_peered":"2024-09-15T22:48:48.672162+0000","last_unstale":"2024-09-15T22:48:49.904924+0000","last_undegraded":"2024-09-15T22:48:49.904924+0000","last_fullsized":"2024-09-15T22:48:49.904924+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:43.234219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672706+0000","last_change":"2024-09-15T22:48:47.668376+0000","last_active":"2024-09-15T22:48:49.672706+0000","last_peered":"2024-09-15T22:48:49.672706+0000","last_clean":"2024-09-15T22:48:49.672706+0000","last_became_active":"2024-09-15T22:48:47.668082+0000","last_became_peered":"2024-09-15T22:48:47.668082+0000","last_unstale":"2024-09-15T22:48:49.672706+0000","last_undegraded":"2024-09-15T22:48:49.672706+0000","last_fullsized":"2024-09-15T22:48:49.672706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:13.362831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905833+0000","last_change":"2024-09-15T22:48:48.664993+0000","last_active":"2024-09-15T22:48:49.905833+0000","last_peered":"2024-09-15T22:48:49.905833+0000","last_clean":"2024-09-15T22:48:49.905833+0000","last_became_active":"2024-09-15T22:48:48.664716+0000","last_became_peered":"2024-09-15T22:48:48.664716+0000","last_unstale":"2024-09-15T22:48:49.905833+0000","last_undegraded":"2024-09-15T22:48:49.905833+0000","last_fullsized":"2024-09-15T22:48:49.905833+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:00.884392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669762+0000","last_change":"2024-09-15T22:48:47.671469+0000","last_active":"2024-09-15T22:48:49.669762+0000","last_peered":"2024-09-15T22:48:49.669762+0000","last_clean":"2024-09-15T22:48:49.669762+0000","last_became_active":"2024-09-15T22:48:47.671190+0000","last_became_peered":"2024-09-15T22:48:47.671190+0000","last_unstale":"2024-09-15T22:48:49.669762+0000","last_undegraded":"2024-09-15T22:48:49.669762+0000","last_fullsized":"2024-09-15T22:48:49.669762+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:41.617164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670014+0000","last_change":"2024-09-15T22:48:48.672387+0000","last_active":"2024-09-15T22:48:49.670014+0000","last_peered":"2024-09-15T22:48:49.670014+0000","last_clean":"2024-09-15T22:48:49.670014+0000","last_became_active":"2024-09-15T22:48:48.672123+0000","last_became_peered":"2024-09-15T22:48:48.672123+0000","last_unstale":"2024-09-15T22:48:49.670014+0000","last_undegraded":"2024-09-15T22:48:49.670014+0000","last_fullsized":"2024-09-15T22:48:49.670014+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:15.902053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781083+0000","last_change":"2024-09-15T22:48:47.671716+0000","last_active":"2024-09-15T22:48:49.781083+0000","last_peered":"2024-09-15T22:48:49.781083+0000","last_clean":"2024-09-15T22:48:49.781083+0000","last_became_active":"2024-09-15T22:48:47.671382+0000","last_became_peered":"2024-09-15T22:48:47.671382+0000","last_unstale":"2024-09-15T22:48:49.781083+0000","last_undegraded":"2024-09-15T22:48:49.781083+0000","last_fullsized":"2024-09-15T22:48:49.781083+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:09.648725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672725+0000","last_change":"2024-09-15T22:48:48.666738+0000","last_active":"2024-09-15T22:48:49.672725+0000","last_peered":"2024-09-15T22:48:49.672725+0000","last_clean":"2024-09-15T22:48:49.672725+0000","last_became_active":"2024-09-15T22:48:48.666482+0000","last_became_peered":"2024-09-15T22:48:48.666482+0000","last_unstale":"2024-09-15T22:48:49.672725+0000","last_undegraded":"2024-09-15T22:48:49.672725+0000","last_fullsized":"2024-09-15T22:48:49.672725+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670009+0000","last_change":"2024-09-15T22:48:47.672092+0000","last_active":"2024-09-15T22:48:49.670009+0000","last_peered":"2024-09-15T22:48:49.670009+0000","last_clean":"2024-09-15T22:48:49.670009+0000","last_became_active":"2024-09-15T22:48:47.671799+0000","last_became_peered":"2024-09-15T22:48:47.671799+0000","last_unstale":"2024-09-15T22:48:49.670009+0000","last_undegraded":"2024-09-15T22:48:49.670009+0000","last_fullsized":"2024-09-15T22:48:49.670009+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:09.939450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905747+0000","last_change":"2024-09-15T22:48:48.678099+0000","last_active":"2024-09-15T22:48:49.905747+0000","last_peered":"2024-09-15T22:48:49.905747+0000","last_clean":"2024-09-15T22:48:49.905747+0000","last_became_active":"2024-09-15T22:48:48.677809+0000","last_became_peered":"2024-09-15T22:48:48.677809+0000","last_unstale":"2024-09-15T22:48:49.905747+0000","last_undegraded":"2024-09-15T22:48:49.905747+0000","last_fullsized":"2024-09-15T22:48:49.905747+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:20.778000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"169'3","reported_seq":17,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.673105+0000","last_change":"2024-09-15T22:48:47.669220+0000","last_active":"2024-09-15T22:48:49.673105+0000","last_peered":"2024-09-15T22:48:49.673105+0000","last_clean":"2024-09-15T22:48:49.673105+0000","last_became_active":"2024-09-15T22:48:47.668962+0000","last_became_peered":"2024-09-15T22:48:47.668962+0000","last_unstale":"2024-09-15T22:48:49.673105+0000","last_undegraded":"2024-09-15T22:48:49.673105+0000","last_fullsized":"2024-09-15T22:48:49.673105+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:09.747475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672926+0000","last_change":"2024-09-15T22:48:48.674761+0000","last_active":"2024-09-15T22:48:49.672926+0000","last_peered":"2024-09-15T22:48:49.672926+0000","last_clean":"2024-09-15T22:48:49.672926+0000","last_became_active":"2024-09-15T22:48:48.674452+0000","last_became_peered":"2024-09-15T22:48:48.674452+0000","last_unstale":"2024-09-15T22:48:49.672926+0000","last_undegraded":"2024-09-15T22:48:49.672926+0000","last_fullsized":"2024-09-15T22:48:49.672926+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:57.718700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"169'6","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905800+0000","last_change":"2024-09-15T22:48:47.666054+0000","last_active":"2024-09-15T22:48:49.905800+0000","last_peered":"2024-09-15T22:48:49.905800+0000","last_clean":"2024-09-15T22:48:49.905800+0000","last_became_active":"2024-09-15T22:48:47.665785+0000","last_became_peered":"2024-09-15T22:48:47.665785+0000","last_unstale":"2024-09-15T22:48:49.905800+0000","last_undegraded":"2024-09-15T22:48:49.905800+0000","last_fullsized":"2024-09-15T22:48:49.905800+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:43.079263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672133+0000","last_change":"2024-09-15T22:48:48.677310+0000","last_active":"2024-09-15T22:48:49.672133+0000","last_peered":"2024-09-15T22:48:49.672133+0000","last_clean":"2024-09-15T22:48:49.672133+0000","last_became_active":"2024-09-15T22:48:48.677025+0000","last_became_peered":"2024-09-15T22:48:48.677025+0000","last_unstale":"2024-09-15T22:48:49.672133+0000","last_undegraded":"2024-09-15T22:48:49.672133+0000","last_fullsized":"2024-09-15T22:48:49.672133+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:26.358776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905464+0000","last_change":"2024-09-15T22:48:47.669242+0000","last_active":"2024-09-15T22:48:49.905464+0000","last_peered":"2024-09-15T22:48:49.905464+0000","last_clean":"2024-09-15T22:48:49.905464+0000","last_became_active":"2024-09-15T22:48:47.668895+0000","last_became_peered":"2024-09-15T22:48:47.668895+0000","last_unstale":"2024-09-15T22:48:49.905464+0000","last_undegraded":"2024-09-15T22:48:49.905464+0000","last_fullsized":"2024-09-15T22:48:49.905464+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:06.552711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780931+0000","last_change":"2024-09-15T22:48:48.673865+0000","last_active":"2024-09-15T22:48:49.780931+0000","last_peered":"2024-09-15T22:48:49.780931+0000","last_clean":"2024-09-15T22:48:49.780931+0000","last_became_active":"2024-09-15T22:48:48.673583+0000","last_became_peered":"2024-09-15T22:48:48.673583+0000","last_unstale":"2024-09-15T22:48:49.780931+0000","last_undegraded":"2024-09-15T22:48:49.780931+0000","last_fullsized":"2024-09-15T22:48:49.780931+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:57.656808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905013+0000","last_change":"2024-09-15T22:48:47.670218+0000","last_active":"2024-09-15T22:48:49.905013+0000","last_peered":"2024-09-15T22:48:49.905013+0000","last_clean":"2024-09-15T22:48:49.905013+0000","last_became_active":"2024-09-15T22:48:47.669940+0000","last_became_peered":"2024-09-15T22:48:47.669940+0000","last_unstale":"2024-09-15T22:48:49.905013+0000","last_undegraded":"2024-09-15T22:48:49.905013+0000","last_fullsized":"2024-09-15T22:48:49.905013+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:43.703043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780630+0000","last_change":"2024-09-15T22:48:48.675221+0000","last_active":"2024-09-15T22:48:49.780630+0000","last_peered":"2024-09-15T22:48:49.780630+0000","last_clean":"2024-09-15T22:48:49.780630+0000","last_became_active":"2024-09-15T22:48:48.674402+0000","last_became_peered":"2024-09-15T22:48:48.674402+0000","last_unstale":"2024-09-15T22:48:49.780630+0000","last_undegraded":"2024-09-15T22:48:49.780630+0000","last_fullsized":"2024-09-15T22:48:49.780630+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:55.863464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672799+0000","last_change":"2024-09-15T22:48:47.662191+0000","last_active":"2024-09-15T22:48:49.672799+0000","last_peered":"2024-09-15T22:48:49.672799+0000","last_clean":"2024-09-15T22:48:49.672799+0000","last_became_active":"2024-09-15T22:48:47.661298+0000","last_became_peered":"2024-09-15T22:48:47.661298+0000","last_unstale":"2024-09-15T22:48:49.672799+0000","last_undegraded":"2024-09-15T22:48:49.672799+0000","last_fullsized":"2024-09-15T22:48:49.672799+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:36.609514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905112+0000","last_change":"2024-09-15T22:48:48.676583+0000","last_active":"2024-09-15T22:48:49.905112+0000","last_peered":"2024-09-15T22:48:49.905112+0000","last_clean":"2024-09-15T22:48:49.905112+0000","last_became_active":"2024-09-15T22:48:48.676285+0000","last_became_peered":"2024-09-15T22:48:48.676285+0000","last_unstale":"2024-09-15T22:48:49.905112+0000","last_undegraded":"2024-09-15T22:48:49.905112+0000","last_fullsized":"2024-09-15T22:48:49.905112+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:00.765903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"169'8","reported_seq":22,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672706+0000","last_change":"2024-09-15T22:48:47.660924+0000","last_active":"2024-09-15T22:48:49.672706+0000","last_peered":"2024-09-15T22:48:49.672706+0000","last_clean":"2024-09-15T22:48:49.672706+0000","last_became_active":"2024-09-15T22:48:47.660641+0000","last_became_peered":"2024-09-15T22:48:47.660641+0000","last_unstale":"2024-09-15T22:48:49.672706+0000","last_undegraded":"2024-09-15T22:48:49.672706+0000","last_fullsized":"2024-09-15T22:48:49.672706+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:44.870649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905539+0000","last_change":"2024-09-15T22:48:48.671079+0000","last_active":"2024-09-15T22:48:49.905539+0000","last_peered":"2024-09-15T22:48:49.905539+0000","last_clean":"2024-09-15T22:48:49.905539+0000","last_became_active":"2024-09-15T22:48:48.670798+0000","last_became_peered":"2024-09-15T22:48:48.670798+0000","last_unstale":"2024-09-15T22:48:49.905539+0000","last_undegraded":"2024-09-15T22:48:49.905539+0000","last_fullsized":"2024-09-15T22:48:49.905539+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:37.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"169'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905475+0000","last_change":"2024-09-15T22:48:47.669267+0000","last_active":"2024-09-15T22:48:49.905475+0000","last_peered":"2024-09-15T22:48:49.905475+0000","last_clean":"2024-09-15T22:48:49.905475+0000","last_became_active":"2024-09-15T22:48:47.668967+0000","last_became_peered":"2024-09-15T22:48:47.668967+0000","last_unstale":"2024-09-15T22:48:49.905475+0000","last_undegraded":"2024-09-15T22:48:49.905475+0000","last_fullsized":"2024-09-15T22:48:49.905475+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:25.686006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670304+0000","last_change":"2024-09-15T22:48:48.663550+0000","last_active":"2024-09-15T22:48:49.670304+0000","last_peered":"2024-09-15T22:48:49.670304+0000","last_clean":"2024-09-15T22:48:49.670304+0000","last_became_active":"2024-09-15T22:48:48.663256+0000","last_became_peered":"2024-09-15T22:48:48.663256+0000","last_unstale":"2024-09-15T22:48:49.670304+0000","last_undegraded":"2024-09-15T22:48:49.670304+0000","last_fullsized":"2024-09-15T22:48:49.670304+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:06.289215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.906008+0000","last_change":"2024-09-15T22:48:47.664755+0000","last_active":"2024-09-15T22:48:49.906008+0000","last_peered":"2024-09-15T22:48:49.906008+0000","last_clean":"2024-09-15T22:48:49.906008+0000","last_became_active":"2024-09-15T22:48:47.664453+0000","last_became_peered":"2024-09-15T22:48:47.664453+0000","last_unstale":"2024-09-15T22:48:49.906008+0000","last_undegraded":"2024-09-15T22:48:49.906008+0000","last_fullsized":"2024-09-15T22:48:49.906008+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:05.381487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.781188+0000","last_change":"2024-09-15T22:48:48.665770+0000","last_active":"2024-09-15T22:48:49.781188+0000","last_peered":"2024-09-15T22:48:49.781188+0000","last_clean":"2024-09-15T22:48:49.781188+0000","last_became_active":"2024-09-15T22:48:48.665498+0000","last_became_peered":"2024-09-15T22:48:48.665498+0000","last_unstale":"2024-09-15T22:48:49.781188+0000","last_undegraded":"2024-09-15T22:48:49.781188+0000","last_fullsized":"2024-09-15T22:48:49.781188+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:51.624031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"169'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672714+0000","last_change":"2024-09-15T22:48:47.657180+0000","last_active":"2024-09-15T22:48:49.672714+0000","last_peered":"2024-09-15T22:48:49.672714+0000","last_clean":"2024-09-15T22:48:49.672714+0000","last_became_active":"2024-09-15T22:48:47.656855+0000","last_became_peered":"2024-09-15T22:48:47.656855+0000","last_unstale":"2024-09-15T22:48:49.672714+0000","last_undegraded":"2024-09-15T22:48:49.672714+0000","last_fullsized":"2024-09-15T22:48:49.672714+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:24.761500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905355+0000","last_change":"2024-09-15T22:48:48.678585+0000","last_active":"2024-09-15T22:48:49.905355+0000","last_peered":"2024-09-15T22:48:49.905355+0000","last_clean":"2024-09-15T22:48:49.905355+0000","last_became_active":"2024-09-15T22:48:48.677554+0000","last_became_peered":"2024-09-15T22:48:48.677554+0000","last_unstale":"2024-09-15T22:48:49.905355+0000","last_undegraded":"2024-09-15T22:48:49.905355+0000","last_fullsized":"2024-09-15T22:48:49.905355+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:55.524634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904847+0000","last_change":"2024-09-15T22:48:47.668173+0000","last_active":"2024-09-15T22:48:49.904847+0000","last_peered":"2024-09-15T22:48:49.904847+0000","last_clean":"2024-09-15T22:48:49.904847+0000","last_became_active":"2024-09-15T22:48:47.667880+0000","last_became_peered":"2024-09-15T22:48:47.667880+0000","last_unstale":"2024-09-15T22:48:49.904847+0000","last_undegraded":"2024-09-15T22:48:49.904847+0000","last_fullsized":"2024-09-15T22:48:49.904847+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.675373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780732+0000","last_change":"2024-09-15T22:48:48.677603+0000","last_active":"2024-09-15T22:48:49.780732+0000","last_peered":"2024-09-15T22:48:49.780732+0000","last_clean":"2024-09-15T22:48:49.780732+0000","last_became_active":"2024-09-15T22:48:48.677336+0000","last_became_peered":"2024-09-15T22:48:48.677336+0000","last_unstale":"2024-09-15T22:48:49.780732+0000","last_undegraded":"2024-09-15T22:48:49.780732+0000","last_fullsized":"2024-09-15T22:48:49.780732+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.639567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672088+0000","last_change":"2024-09-15T22:48:47.663481+0000","last_active":"2024-09-15T22:48:49.672088+0000","last_peered":"2024-09-15T22:48:49.672088+0000","last_clean":"2024-09-15T22:48:49.672088+0000","last_became_active":"2024-09-15T22:48:47.662988+0000","last_became_peered":"2024-09-15T22:48:47.662988+0000","last_unstale":"2024-09-15T22:48:49.672088+0000","last_undegraded":"2024-09-15T22:48:49.672088+0000","last_fullsized":"2024-09-15T22:48:49.672088+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:26.788661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905112+0000","last_change":"2024-09-15T22:48:48.677864+0000","last_active":"2024-09-15T22:48:49.905112+0000","last_peered":"2024-09-15T22:48:49.905112+0000","last_clean":"2024-09-15T22:48:49.905112+0000","last_became_active":"2024-09-15T22:48:48.677592+0000","last_became_peered":"2024-09-15T22:48:48.677592+0000","last_unstale":"2024-09-15T22:48:49.905112+0000","last_undegraded":"2024-09-15T22:48:49.905112+0000","last_fullsized":"2024-09-15T22:48:49.905112+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.704539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672591+0000","last_change":"2024-09-15T22:48:47.660752+0000","last_active":"2024-09-15T22:48:49.672591+0000","last_peered":"2024-09-15T22:48:49.672591+0000","last_clean":"2024-09-15T22:48:49.672591+0000","last_became_active":"2024-09-15T22:48:47.660466+0000","last_became_peered":"2024-09-15T22:48:47.660466+0000","last_unstale":"2024-09-15T22:48:49.672591+0000","last_undegraded":"2024-09-15T22:48:49.672591+0000","last_fullsized":"2024-09-15T22:48:49.672591+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:35.479637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669821+0000","last_change":"2024-09-15T22:48:48.665173+0000","last_active":"2024-09-15T22:48:49.669821+0000","last_peered":"2024-09-15T22:48:49.669821+0000","last_clean":"2024-09-15T22:48:49.669821+0000","last_became_active":"2024-09-15T22:48:48.664871+0000","last_became_peered":"2024-09-15T22:48:48.664871+0000","last_unstale":"2024-09-15T22:48:49.669821+0000","last_undegraded":"2024-09-15T22:48:49.669821+0000","last_fullsized":"2024-09-15T22:48:49.669821+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:10.650671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780531+0000","last_change":"2024-09-15T22:48:47.670618+0000","last_active":"2024-09-15T22:48:49.780531+0000","last_peered":"2024-09-15T22:48:49.780531+0000","last_clean":"2024-09-15T22:48:49.780531+0000","last_became_active":"2024-09-15T22:48:47.670310+0000","last_became_peered":"2024-09-15T22:48:47.670310+0000","last_unstale":"2024-09-15T22:48:49.780531+0000","last_undegraded":"2024-09-15T22:48:49.780531+0000","last_fullsized":"2024-09-15T22:48:49.780531+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:09.593170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669920+0000","last_change":"2024-09-15T22:48:48.665452+0000","last_active":"2024-09-15T22:48:49.669920+0000","last_peered":"2024-09-15T22:48:49.669920+0000","last_clean":"2024-09-15T22:48:49.669920+0000","last_became_active":"2024-09-15T22:48:48.664976+0000","last_became_peered":"2024-09-15T22:48:48.664976+0000","last_unstale":"2024-09-15T22:48:49.669920+0000","last_undegraded":"2024-09-15T22:48:49.669920+0000","last_fullsized":"2024-09-15T22:48:49.669920+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:10.595116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672849+0000","last_change":"2024-09-15T22:48:47.664927+0000","last_active":"2024-09-15T22:48:49.672849+0000","last_peered":"2024-09-15T22:48:49.672849+0000","last_clean":"2024-09-15T22:48:49.672849+0000","last_became_active":"2024-09-15T22:48:47.664617+0000","last_became_peered":"2024-09-15T22:48:47.664617+0000","last_unstale":"2024-09-15T22:48:49.672849+0000","last_undegraded":"2024-09-15T22:48:49.672849+0000","last_fullsized":"2024-09-15T22:48:49.672849+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:32.292286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905601+0000","last_change":"2024-09-15T22:48:48.674618+0000","last_active":"2024-09-15T22:48:49.905601+0000","last_peered":"2024-09-15T22:48:49.905601+0000","last_clean":"2024-09-15T22:48:49.905601+0000","last_became_active":"2024-09-15T22:48:48.674344+0000","last_became_peered":"2024-09-15T22:48:48.674344+0000","last_unstale":"2024-09-15T22:48:49.905601+0000","last_undegraded":"2024-09-15T22:48:49.905601+0000","last_fullsized":"2024-09-15T22:48:49.905601+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:51.624031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"169'2","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.672550+0000","last_change":"2024-09-15T22:48:47.668537+0000","last_active":"2024-09-15T22:48:49.672550+0000","last_peered":"2024-09-15T22:48:49.672550+0000","last_clean":"2024-09-15T22:48:49.672550+0000","last_became_active":"2024-09-15T22:48:47.668223+0000","last_became_peered":"2024-09-15T22:48:47.668223+0000","last_unstale":"2024-09-15T22:48:49.672550+0000","last_undegraded":"2024-09-15T22:48:49.672550+0000","last_fullsized":"2024-09-15T22:48:49.672550+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:22.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905418+0000","last_change":"2024-09-15T22:48:48.679779+0000","last_active":"2024-09-15T22:48:49.905418+0000","last_peered":"2024-09-15T22:48:49.905418+0000","last_clean":"2024-09-15T22:48:49.905418+0000","last_became_active":"2024-09-15T22:48:48.679508+0000","last_became_peered":"2024-09-15T22:48:48.679508+0000","last_unstale":"2024-09-15T22:48:49.905418+0000","last_undegraded":"2024-09-15T22:48:49.905418+0000","last_fullsized":"2024-09-15T22:48:49.905418+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:39.668614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"170'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905632+0000","last_change":"2024-09-15T22:48:47.667212+0000","last_active":"2024-09-15T22:48:49.905632+0000","last_peered":"2024-09-15T22:48:49.905632+0000","last_clean":"2024-09-15T22:48:49.905632+0000","last_became_active":"2024-09-15T22:48:47.666682+0000","last_became_peered":"2024-09-15T22:48:47.666682+0000","last_unstale":"2024-09-15T22:48:49.905632+0000","last_undegraded":"2024-09-15T22:48:49.905632+0000","last_fullsized":"2024-09-15T22:48:49.905632+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:59.763957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905341+0000","last_change":"2024-09-15T22:48:48.676361+0000","last_active":"2024-09-15T22:48:49.905341+0000","last_peered":"2024-09-15T22:48:49.905341+0000","last_clean":"2024-09-15T22:48:49.905341+0000","last_became_active":"2024-09-15T22:48:48.676085+0000","last_became_peered":"2024-09-15T22:48:48.676085+0000","last_unstale":"2024-09-15T22:48:49.905341+0000","last_undegraded":"2024-09-15T22:48:49.905341+0000","last_fullsized":"2024-09-15T22:48:49.905341+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:59.508607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905428+0000","last_change":"2024-09-15T22:48:47.668615+0000","last_active":"2024-09-15T22:48:49.905428+0000","last_peered":"2024-09-15T22:48:49.905428+0000","last_clean":"2024-09-15T22:48:49.905428+0000","last_became_active":"2024-09-15T22:48:47.668304+0000","last_became_peered":"2024-09-15T22:48:47.668304+0000","last_unstale":"2024-09-15T22:48:49.905428+0000","last_undegraded":"2024-09-15T22:48:49.905428+0000","last_fullsized":"2024-09-15T22:48:49.905428+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:59.203615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905216+0000","last_change":"2024-09-15T22:48:48.675759+0000","last_active":"2024-09-15T22:48:49.905216+0000","last_peered":"2024-09-15T22:48:49.905216+0000","last_clean":"2024-09-15T22:48:49.905216+0000","last_became_active":"2024-09-15T22:48:48.675421+0000","last_became_peered":"2024-09-15T22:48:48.675421+0000","last_unstale":"2024-09-15T22:48:49.905216+0000","last_undegraded":"2024-09-15T22:48:49.905216+0000","last_fullsized":"2024-09-15T22:48:49.905216+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:21.216761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904891+0000","last_change":"2024-09-15T22:48:47.672447+0000","last_active":"2024-09-15T22:48:49.904891+0000","last_peered":"2024-09-15T22:48:49.904891+0000","last_clean":"2024-09-15T22:48:49.904891+0000","last_became_active":"2024-09-15T22:48:47.672214+0000","last_became_peered":"2024-09-15T22:48:47.672214+0000","last_unstale":"2024-09-15T22:48:49.904891+0000","last_undegraded":"2024-09-15T22:48:49.904891+0000","last_fullsized":"2024-09-15T22:48:49.904891+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:36.248537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905359+0000","last_change":"2024-09-15T22:48:48.675208+0000","last_active":"2024-09-15T22:48:49.905359+0000","last_peered":"2024-09-15T22:48:49.905359+0000","last_clean":"2024-09-15T22:48:49.905359+0000","last_became_active":"2024-09-15T22:48:48.674649+0000","last_became_peered":"2024-09-15T22:48:48.674649+0000","last_unstale":"2024-09-15T22:48:49.905359+0000","last_undegraded":"2024-09-15T22:48:49.905359+0000","last_fullsized":"2024-09-15T22:48:49.905359+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:36.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670233+0000","last_change":"2024-09-15T22:48:47.670729+0000","last_active":"2024-09-15T22:48:49.670233+0000","last_peered":"2024-09-15T22:48:49.670233+0000","last_clean":"2024-09-15T22:48:49.670233+0000","last_became_active":"2024-09-15T22:48:47.670310+0000","last_became_peered":"2024-09-15T22:48:47.670310+0000","last_unstale":"2024-09-15T22:48:49.670233+0000","last_undegraded":"2024-09-15T22:48:49.670233+0000","last_fullsized":"2024-09-15T22:48:49.670233+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:28.037188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905073+0000","last_change":"2024-09-15T22:48:48.665062+0000","last_active":"2024-09-15T22:48:49.905073+0000","last_peered":"2024-09-15T22:48:49.905073+0000","last_clean":"2024-09-15T22:48:49.905073+0000","last_became_active":"2024-09-15T22:48:48.664757+0000","last_became_peered":"2024-09-15T22:48:48.664757+0000","last_unstale":"2024-09-15T22:48:49.905073+0000","last_undegraded":"2024-09-15T22:48:49.905073+0000","last_fullsized":"2024-09-15T22:48:49.905073+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:26.363812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780802+0000","last_change":"2024-09-15T22:48:47.671586+0000","last_active":"2024-09-15T22:48:49.780802+0000","last_peered":"2024-09-15T22:48:49.780802+0000","last_clean":"2024-09-15T22:48:49.780802+0000","last_became_active":"2024-09-15T22:48:47.671275+0000","last_became_peered":"2024-09-15T22:48:47.671275+0000","last_unstale":"2024-09-15T22:48:49.780802+0000","last_undegraded":"2024-09-15T22:48:49.780802+0000","last_fullsized":"2024-09-15T22:48:49.780802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:18.204346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.673095+0000","last_change":"2024-09-15T22:48:48.681309+0000","last_active":"2024-09-15T22:48:49.673095+0000","last_peered":"2024-09-15T22:48:49.673095+0000","last_clean":"2024-09-15T22:48:49.673095+0000","last_became_active":"2024-09-15T22:48:48.680849+0000","last_became_peered":"2024-09-15T22:48:48.680849+0000","last_unstale":"2024-09-15T22:48:49.673095+0000","last_undegraded":"2024-09-15T22:48:49.673095+0000","last_fullsized":"2024-09-15T22:48:49.673095+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:23.631353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.904991+0000","last_change":"2024-09-15T22:48:47.667326+0000","last_active":"2024-09-15T22:48:49.904991+0000","last_peered":"2024-09-15T22:48:49.904991+0000","last_clean":"2024-09-15T22:48:49.904991+0000","last_became_active":"2024-09-15T22:48:47.667056+0000","last_became_peered":"2024-09-15T22:48:47.667056+0000","last_unstale":"2024-09-15T22:48:49.904991+0000","last_undegraded":"2024-09-15T22:48:49.904991+0000","last_fullsized":"2024-09-15T22:48:49.904991+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:59.882446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.670072+0000","last_change":"2024-09-15T22:48:48.665233+0000","last_active":"2024-09-15T22:48:49.670072+0000","last_peered":"2024-09-15T22:48:49.670072+0000","last_clean":"2024-09-15T22:48:49.670072+0000","last_became_active":"2024-09-15T22:48:48.664603+0000","last_became_peered":"2024-09-15T22:48:48.664603+0000","last_unstale":"2024-09-15T22:48:49.670072+0000","last_undegraded":"2024-09-15T22:48:49.670072+0000","last_fullsized":"2024-09-15T22:48:49.670072+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:46.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669867+0000","last_change":"2024-09-15T22:48:47.671636+0000","last_active":"2024-09-15T22:48:49.669867+0000","last_peered":"2024-09-15T22:48:49.669867+0000","last_clean":"2024-09-15T22:48:49.669867+0000","last_became_active":"2024-09-15T22:48:47.671375+0000","last_became_peered":"2024-09-15T22:48:47.671375+0000","last_unstale":"2024-09-15T22:48:49.669867+0000","last_undegraded":"2024-09-15T22:48:49.669867+0000","last_fullsized":"2024-09-15T22:48:49.669867+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:49.049318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.780714+0000","last_change":"2024-09-15T22:48:48.673282+0000","last_active":"2024-09-15T22:48:49.780714+0000","last_peered":"2024-09-15T22:48:49.780714+0000","last_clean":"2024-09-15T22:48:49.780714+0000","last_became_active":"2024-09-15T22:48:48.672914+0000","last_became_peered":"2024-09-15T22:48:48.672914+0000","last_unstale":"2024-09-15T22:48:49.780714+0000","last_undegraded":"2024-09-15T22:48:49.780714+0000","last_fullsized":"2024-09-15T22:48:49.780714+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:47.640038+0000","last_clean_scrub_stamp":"2024-09-15T22:48:47.640038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:05.171742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"169'1","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.905122+0000","last_change":"2024-09-15T22:48:47.667031+0000","last_active":"2024-09-15T22:48:49.905122+0000","last_peered":"2024-09-15T22:48:49.905122+0000","last_clean":"2024-09-15T22:48:49.905122+0000","last_became_active":"2024-09-15T22:48:47.666734+0000","last_became_peered":"2024-09-15T22:48:47.666734+0000","last_unstale":"2024-09-15T22:48:49.905122+0000","last_undegraded":"2024-09-15T22:48:49.905122+0000","last_fullsized":"2024-09-15T22:48:49.905122+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:48:46.638092+0000","last_clean_scrub_stamp":"2024-09-15T22:48:46.638092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:30.702593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":482,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-15T22:48:49.669872+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:48:49.669872+0000","last_peered":"2024-09-15T22:48:49.669872+0000","last_clean":"2024-09-15T22:48:49.669872+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:48:49.669872+0000","last_undegraded":"2024-09-15T22:48:49.669872+0000","last_fullsized":"2024-09-15T22:48:49.669872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2142208,"data_stored":943212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2142208,"data_stored":943260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509535,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33872,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337968,"statfs":{"total":96636764160,"available":96602079232,"internally_reserved":0,"allocated":2748416,"data_stored":1534286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509535,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2142208,"data_stored":943280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509535,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2150400,"data_stored":944802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509536,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2158592,"data_stored":944906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33856,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337984,"statfs":{"total":96636764160,"available":96602095616,"internally_reserved":0,"allocated":2732032,"data_stored":1533558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509536,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2142208,"data_stored":943772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:48:56.266 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:48:56.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:48:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.404+0000 7eff18f42640 1 Processor -- start 2024-09-15T22:48:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.404+0000 7eff18f42640 1 -- start start 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.405+0000 7eff18f42640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff140b4e20 0x7eff1415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.405+0000 7eff18f42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff14072d10 0x7eff1406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.405+0000 7eff18f42640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff140b3570 con 0x7eff140ccb80 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.405+0000 7eff18f42640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7eff140b3850 con 0x7eff14072d10 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.405+0000 7eff18f42640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7eff140b3b30 con 0x7eff140b4e20 2024-09-15T22:48:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff14072d10 0x7eff1406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff14072d10 0x7eff1406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36814/0 (socket says 172.21.15.134:36814) 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff1259c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7eff140ccb80 0x7eff140b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40654/0 (socket says 172.21.15.134:40654) 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 -- 172.21.15.134:0/583230562 learned_addr learned my addr 172.21.15.134:0/583230562 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff11d9b640 1 --2- 172.21.15.134:0/583230562 >> v2:172.21.15.177:3300/0 conn(0x7eff140b4e20 0x7eff1415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 -- 172.21.15.134:0/583230562 >> v2:172.21.15.177:3300/0 conn(0x7eff140b4e20 msgr2=0x7eff1415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 --2- 172.21.15.134:0/583230562 >> v2:172.21.15.177:3300/0 conn(0x7eff140b4e20 0x7eff1415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 -- 172.21.15.134:0/583230562 >> v1:172.21.15.134:6789/0 conn(0x7eff140ccb80 legacy=0x7eff140b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.406+0000 7eff12d9d640 1 -- 172.21.15.134:0/583230562 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff140b3e10 con 0x7eff14072d10 2024-09-15T22:48:56.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff12d9d640 1 --2- 172.21.15.134:0/583230562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff14072d10 0x7eff1406db10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7eff140b5c30 tx=0x7eff0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ccca3300ac50ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff1159a640 1 -- 172.21.15.134:0/583230562 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c036070 con 0x7eff14072d10 2024-09-15T22:48:56.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff1159a640 1 -- 172.21.15.134:0/583230562 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c031600 con 0x7eff14072d10 2024-09-15T22:48:56.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff1159a640 1 -- 172.21.15.134:0/583230562 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0319d0 con 0x7eff14072d10 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 -- 172.21.15.134:0/583230562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff14072d10 msgr2=0x7eff1406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 --2- 172.21.15.134:0/583230562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff14072d10 0x7eff1406db10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7eff140b5c30 tx=0x7eff0c02a730 comp rx=0 tx=0).stop 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 -- 172.21.15.134:0/583230562 shutdown_connections 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 --2- 172.21.15.134:0/583230562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff14072d10 0x7eff1406db10 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 --2- 172.21.15.134:0/583230562 >> v2:172.21.15.177:3300/0 conn(0x7eff140b4e20 0x7eff1415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 -- 172.21.15.134:0/583230562 >> 172.21.15.134:0/583230562 conn(0x7eff1406bba0 msgr2=0x7eff1406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 -- 172.21.15.134:0/583230562 shutdown_connections 2024-09-15T22:48:56.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.407+0000 7eff18f42640 1 -- 172.21.15.134:0/583230562 wait complete. 2024-09-15T22:48:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 Processor -- start 2024-09-15T22:48:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 -- start start 2024-09-15T22:48:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 0x7eff1415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 0x7eff1414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff140ccf60 con 0x7eff140ccb80 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff140b43d0 con 0x7eff14072d10 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.409+0000 7eff18f42640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7eff1406e050 con 0x7eff140b4e20 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36830/0 (socket says 172.21.15.134:36830) 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 -- 172.21.15.134:0/815873010 learned_addr learned my addr 172.21.15.134:0/815873010 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff1259c640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 0x7eff1415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 -- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 msgr2=0x7eff1414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff11d9b640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 0x7eff1414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 0x7eff1414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 -- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 msgr2=0x7eff1415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 0x7eff1415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 -- 172.21.15.134:0/815873010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff141f2040 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff1259c640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 0x7eff1415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff11d9b640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 0x7eff1414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff12d9d640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009f40 tx=0x7eff0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c009510 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c0079b0 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c007da0 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff141f2320 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.410+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff14155bd0 con 0x7eff140ccb80 2024-09-15T22:48:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.411+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1406db10 con 0x7eff140ccb80 2024-09-15T22:48:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.412+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7eff0c039400 con 0x7eff140ccb80 2024-09-15T22:48:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.412+0000 7eff02ffd640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 0x7efef406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.412+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7eff0c0ac8a0 con 0x7eff140ccb80 2024-09-15T22:48:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.413+0000 7eff1259c640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 0x7efef406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.413+0000 7eff1259c640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 0x7efef406f100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.417+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff0c07cc10 con 0x7eff140ccb80 2024-09-15T22:48:56.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.644+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7eff1415b160 con 0x7eff140ccb80 2024-09-15T22:48:56.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.646+0000 7eff02ffd640 1 -- 172.21.15.134:0/815873010 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7eff0c07c510 con 0x7eff140ccb80 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXYudmhsmPEhAAJ6PvoC91k7uPz24dYv1lcg== 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: caps mds = "allow" 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: caps mon = "allow r" 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:48:56.649 INFO:teuthology.orchestra.run.smithi134.stderr:updated caps for client.0 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 msgr2=0x7efef406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 0x7efef406f100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04009040 comp rx=0 tx=0).stop 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 msgr2=0x7eff1415b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009f40 tx=0x7eff0c004a40 comp rx=0 tx=0).stop 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 shutdown_connections 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efef406cc40 0x7efef406f100 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff140ccb80 0x7eff1415b910 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.648+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff140b4e20 0x7eff1414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.649+0000 7eff18f42640 1 --2- 172.21.15.134:0/815873010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff14072d10 0x7eff1415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.649+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 >> 172.21.15.134:0/815873010 conn(0x7eff1406bba0 msgr2=0x7eff141541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.649+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 shutdown_connections 2024-09-15T22:48:56.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.649+0000 7eff18f42640 1 -- 172.21.15.134:0/815873010 wait complete. 2024-09-15T22:48:56.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:48:56.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.760+0000 7f5da33bd640 1 Processor -- start 2024-09-15T22:48:56.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.760+0000 7f5da33bd640 1 -- start start 2024-09-15T22:48:56.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da33bd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 0x7f5d9c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da33bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 0x7f5d9c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da33bd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9c0cd5f0 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da33bd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9c0cd8d0 con 0x7f5d9c06be10 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da33bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cdbb0 con 0x7f5d9c151c50 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da195a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 0x7f5d9c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da1159640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 0x7f5d9c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da0958640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5d9c06c1f0 0x7f5d9c151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:54070/0 (socket says 172.21.15.134:54070) 2024-09-15T22:48:56.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.761+0000 7f5da0958640 1 -- 172.21.15.134:0/3034785583 learned_addr learned my addr 172.21.15.134:0/3034785583 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:56.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da195a640 1 -- 172.21.15.134:0/3034785583 >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 msgr2=0x7f5d9c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da195a640 1 --2- 172.21.15.134:0/3034785583 >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 0x7f5d9c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da195a640 1 -- 172.21.15.134:0/3034785583 >> v1:172.21.15.177:6789/0 conn(0x7f5d9c06c1f0 legacy=0x7f5d9c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da195a640 1 -- 172.21.15.134:0/3034785583 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c0cde90 con 0x7f5d9c151c50 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da1159640 1 --2- 172.21.15.134:0/3034785583 >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 0x7f5d9c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.762+0000 7f5da195a640 1 --2- 172.21.15.134:0/3034785583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 0x7f5d9c15baa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d940097a0 tx=0x7f5d9402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29b37b90e648adf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5d93fff640 1 -- 172.21.15.134:0/3034785583 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94037070 con 0x7f5d9c151c50 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5d93fff640 1 -- 172.21.15.134:0/3034785583 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94032440 con 0x7f5d9c151c50 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5d93fff640 1 -- 172.21.15.134:0/3034785583 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94032810 con 0x7f5d9c151c50 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 -- 172.21.15.134:0/3034785583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 msgr2=0x7f5d9c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 --2- 172.21.15.134:0/3034785583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 0x7f5d9c15baa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d940097a0 tx=0x7f5d9402a180 comp rx=0 tx=0).stop 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 -- 172.21.15.134:0/3034785583 shutdown_connections 2024-09-15T22:48:56.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 --2- 172.21.15.134:0/3034785583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c151c50 0x7f5d9c15baa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 --2- 172.21.15.134:0/3034785583 >> v2:172.21.15.177:3300/0 conn(0x7f5d9c06be10 0x7f5d9c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 -- 172.21.15.134:0/3034785583 >> 172.21.15.134:0/3034785583 conn(0x7f5d9c062cc0 msgr2=0x7f5d9c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 -- 172.21.15.134:0/3034785583 shutdown_connections 2024-09-15T22:48:56.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.763+0000 7f5da33bd640 1 -- 172.21.15.134:0/3034785583 wait complete. 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.764+0000 7f5da33bd640 1 Processor -- start 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.764+0000 7f5da33bd640 1 -- start start 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c06be10 0x7f5d9c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d9c151c50 0x7f5d9c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0d0310 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0ce690 con 0x7f5d9c151c50 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da33bd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c0d0490 con 0x7f5d9c06be10 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da0958640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da0958640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36842/0 (socket says 172.21.15.134:36842) 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da0958640 1 -- 172.21.15.134:0/4083390596 learned_addr learned my addr 172.21.15.134:0/4083390596 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da1159640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c06be10 0x7f5d9c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.765+0000 7f5da195a640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d9c151c50 0x7f5d9c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 -- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c06be10 msgr2=0x7f5d9c14d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c06be10 0x7f5d9c14d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 -- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d9c151c50 msgr2=0x7f5d9c0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d9c151c50 0x7f5d9c0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 -- 172.21.15.134:0/4083390596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c0ad7e0 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da0958640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c400 tx=0x7f5d8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c017070 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c005ce0 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c0ada80 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0072f0 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.766+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c0ae320 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.767+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c0ade70 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.768+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f5d8c01a070 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.768+0000 7f5d91ffb640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 0x7f5d8006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.768+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f5d8c088f20 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.769+0000 7f5da1159640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 0x7f5d8006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.769+0000 7f5da1159640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 0x7f5d8006f100 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009bd0 tx=0x7f5d9800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:56.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.773+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d8c058c40 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.969+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d9c0d08c0 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.970+0000 7f5d91ffb640 1 -- 172.21.15.134:0/4083390596 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5230 (secure 0 0 0) 0x7f5d8c05cf40 con 0x7f5d9c06c1f0 2024-09-15T22:48:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:48:56.973 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":89,"btime":"2024-09-15T22:48:50:667986+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:48:56.973 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 89 2024-09-15T22:48:56.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 msgr2=0x7f5d8006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 0x7f5d8006f100 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009bd0 tx=0x7f5d9800b040 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 msgr2=0x7f5d9c0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c400 tx=0x7f5d8c00c8c0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 shutdown_connections 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d9c151c50 0x7f5d9c0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5d8006cc40 0x7f5d8006f100 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d9c06c1f0 0x7f5d9c0aa4d0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.972+0000 7f5da33bd640 1 --2- 172.21.15.134:0/4083390596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d9c06be10 0x7f5d9c14d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.973+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 >> 172.21.15.134:0/4083390596 conn(0x7f5d9c062cc0 msgr2=0x7f5d9c0b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.973+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 shutdown_connections 2024-09-15T22:48:56.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:56.973+0000 7f5da33bd640 1 -- 172.21.15.134:0/4083390596 wait complete. 2024-09-15T22:48:57.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:48:47.994889+0000', 'modified': '2024-09-15T22:48:49.998225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9036}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9036': {'gid': 9036, 'name': 'a', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/23140858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 23140858}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 23140858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9036, 'qdb_cluster': [9036]} 2024-09-15T22:48:57.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:48:57.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:48:57.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.489+0000 7f6b9e1fd640 1 Processor -- start 2024-09-15T22:48:57.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.489+0000 7f6b9e1fd640 1 -- start start 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b9e1fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b980d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b9e1fd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b980d0bc0 con 0x7f6b9815ca40 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b9e1fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9815d390 con 0x7f6b9815ce80 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b9e1fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9815d670 con 0x7f6b980d02a0 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b96ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6b9815ca40 0x7f6b9815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40668/0 (socket says 172.21.15.134:40668) 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.490+0000 7f6b96ffd640 1 -- 172.21.15.134:0/2761041990 learned_addr learned my addr 172.21.15.134:0/2761041990 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b977fe640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b980d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433488594 0 0) 0x7f6b980d0bc0 con 0x7f6b9815ca40 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b80003520 con 0x7f6b9815ca40 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2149724880 0 0) 0x7f6b80003520 con 0x7f6b9815ca40 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 msgr2=0x7f6b980d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b980d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 >> v1:172.21.15.177:6789/0 conn(0x7f6b9815ce80 legacy=0x7f6b981594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9815d950 con 0x7f6b9815ca40 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f6b8c001670 con 0x7f6b9815ca40 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 >> v1:172.21.15.134:6789/0 conn(0x7f6b9815ca40 legacy=0x7f6b9815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b800039e0 0x7f6b80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9815d670 con 0x7f6b80004d40 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8000ba70 con 0x7f6b800039e0 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8000bc70 con 0x7f6b980d02a0 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b977fe640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b800039e0 0x7f6b80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 -- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 msgr2=0x7f6b80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b980d02a0 0x7f6b80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 -- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b800039e0 msgr2=0x7f6b80003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b800039e0 0x7f6b80003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.491+0000 7f6b97fff640 1 -- 172.21.15.134:0/2761041990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b80003520 con 0x7f6b80004d40 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.492+0000 7f6b97fff640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b800051c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6b90002010 tx=0x7f6b80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d3c34004239838 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.492+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90036070 con 0x7f6b80004d40 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.492+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b90031600 con 0x7f6b80004d40 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.492+0000 7f6b967fc640 1 -- 172.21.15.134:0/2761041990 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90001be0 con 0x7f6b80004d40 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/2761041990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 msgr2=0x7f6b800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/2761041990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b800051c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6b90002010 tx=0x7f6b80005830 comp rx=0 tx=0).stop 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b97fff640 1 -- 172.21.15.134:0/2761041990 reap_dead start 2024-09-15T22:48:57.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/2761041990 shutdown_connections 2024-09-15T22:48:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/2761041990 >> 172.21.15.134:0/2761041990 conn(0x7f6b98062cc0 msgr2=0x7f6b9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/2761041990 shutdown_connections 2024-09-15T22:48:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.493+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/2761041990 wait complete. 2024-09-15T22:48:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.494+0000 7f6b9e1fd640 1 Processor -- start 2024-09-15T22:48:57.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.494+0000 7f6b9e1fd640 1 -- start start 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b9806bba0 0x7f6b9806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 0x7f6b9815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9815eb40 con 0x7f6b80004d40 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9815df10 con 0x7f6b9815a550 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b9e1fd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6b98155b90 con 0x7f6b9806bba0 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36850/0 (socket says 172.21.15.134:36850) 2024-09-15T22:48:57.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 -- 172.21.15.134:0/1963516843 learned_addr learned my addr 172.21.15.134:0/1963516843 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b97fff640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 0x7f6b9815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b9806bba0 0x7f6b9806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 -- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b9806bba0 msgr2=0x7f6b9806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b9806bba0 0x7f6b9806bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 -- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 msgr2=0x7f6b9815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 0x7f6b9815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 -- 172.21.15.134:0/1963516843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b980711e0 con 0x7f6b80004d40 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b97fff640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 0x7f6b9815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.495+0000 7f6b977fe640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f6b88011a00 tx=0x7f6b88011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.496+0000 7f6b7ffff640 1 -- 172.21.15.134:0/1963516843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800fa90 con 0x7f6b80004d40 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.496+0000 7f6b7ffff640 1 -- 172.21.15.134:0/1963516843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8800fc30 con 0x7f6b80004d40 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.496+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b98071480 con 0x7f6b80004d40 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.496+0000 7f6b7ffff640 1 -- 172.21.15.134:0/1963516843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88014440 con 0x7f6b80004d40 2024-09-15T22:48:57.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.496+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b98071a40 con 0x7f6b80004d40 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.497+0000 7f6b7ffff640 1 -- 172.21.15.134:0/1963516843 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f6b88012040 con 0x7f6b80004d40 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.498+0000 7f6b7ffff640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 0x7f6b8406f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.498+0000 7f6b7ffff640 1 -- 172.21.15.134:0/1963516843 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f6b8808a120 con 0x7f6b80004d40 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.498+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 0x7f6b8406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.498+0000 7f6ba107a740 1 Processor -- start 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.498+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 0x7f6b8406f130 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b9815c260 tx=0x7f6b8c000f80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 -- start start 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ef5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec8a80 0x5619e6f117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5619e6e2d520 con 0x5619e6f0fae0 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619e6dd53e0 con 0x5619e6ef5120 2024-09-15T22:48:57.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5619e6e294e0 con 0x5619e6ec8a80 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.499+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36852/0 (socket says 172.21.15.134:36852) 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 -- 172.21.15.134:0/3385045867 learned_addr learned my addr 172.21.15.134:0/3385045867 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b977fe640 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ef5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b97fff640 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec8a80 0x5619e6f117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 -- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec8a80 msgr2=0x5619e6f117d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec8a80 0x5619e6f117d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 -- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 msgr2=0x5619e6ef5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ef5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 -- 172.21.15.134:0/3385045867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e6df02f0 con 0x5619e6f0fae0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0078b0 tx=0x7f6b8c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68fd853e14a4cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b7d7fa640 1 -- 172.21.15.134:0/3385045867 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c028070 con 0x5619e6f0fae0 2024-09-15T22:48:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b7d7fa640 1 -- 172.21.15.134:0/3385045867 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0159c0 con 0x5619e6f0fae0 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.500+0000 7f6b7d7fa640 1 -- 172.21.15.134:0/3385045867 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c015d70 con 0x5619e6f0fae0 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- 172.21.15.134:0/3385045867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 msgr2=0x5619e6f11290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0078b0 tx=0x7f6b8c00c000 comp rx=0 tx=0).stop 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- 172.21.15.134:0/3385045867 shutdown_connections 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec8a80 0x5619e6f117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6f11290 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 --2- 172.21.15.134:0/3385045867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ef5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- 172.21.15.134:0/3385045867 >> 172.21.15.134:0/3385045867 conn(0x5619e6ec7a80 msgr2=0x5619e6f0ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- 172.21.15.134:0/3385045867 shutdown_connections 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- 172.21.15.134:0/3385045867 wait complete. 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.501+0000 7f6ba107a740 1 -- start start 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 Processor -- start 2024-09-15T22:48:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ec5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5619e6ef5ee0 con 0x5619e6f0fae0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619e6db6450 con 0x5619e6ef5120 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5619e6f10770 con 0x5619e6ec64f0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6ba107a740 10 client.0 _ll_register_callbacks cb 0x5619e6b3fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36866/0 (socket says 172.21.15.134:36866) 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4106497117 learned_addr learned my addr 172.21.15.134:0/4106497117 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ec5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.502+0000 7f6b97fff640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 msgr2=0x5619e6ef1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 msgr2=0x5619e6ec5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ec5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4106497117 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e6b402d0 con 0x5619e6f0fae0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b97fff640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ec5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c022000 tx=0x7f6b8c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a532d468c7401c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c028040 con 0x5619e6f0fae0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f6b8c0247f0 con 0x5619e6f0fae0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b8c0159c0 con 0x5619e6f0fae0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c03a050 con 0x5619e6f0fae0 2024-09-15T22:48:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 10 client.9192 fetch_fsmap learned FSMap version 89 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5619e6c0a6b0 con 0x5619e6f0fae0 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0159c0 con 0x5619e6f0fae0 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8c03d020 con 0x5619e6f0fae0 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 10 client.9192 fetch_fsmap finished waiting for FSMap version 89 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 10 client.9192 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 20 client.9192 populate_metadata read hostname 'smithi134' 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f27c70 0x5619e6f32010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 4 client.9192 mds_command: new command op to 9036 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.503+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 --> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619e6e3ac50 con 0x5619e6f27c70 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f27c70 0x5619e6f32010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f27c70 0x5619e6f32010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc1e41827c7fbed server_cookie=9c3996d120d538da in_seq=0 out_seq=0 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6b767fc640 10 client.9192 ms_handle_connect on v2:172.21.15.134:6834/23140858 2024-09-15T22:48:57.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6b767fc640 1 -- 172.21.15.134:0/4106497117 <== mds.0 v2:172.21.15.134:6834/23140858 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619e6e3ac50 con 0x5619e6f27c70 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6b767fc640 10 client.9192 handle_command_reply: tid=0 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.504+0000 7f6ba107a740 1 client.9192 shutdown 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 msgr2=0x5619e6ef1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c022000 tx=0x7f6b8c0019c0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 shutdown_connections 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f27c70 0x5619e6f32010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6f0fae0 0x5619e6ef1420 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6b767fc640 0 client.9192 ms_handle_reset on v2:172.21.15.134:6834/23140858 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4106497117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6ef5120 0x5619e6ec5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 >> 172.21.15.134:0/4106497117 conn(0x5619e6ec8a80 msgr2=0x5619e6f198d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 shutdown_connections 2024-09-15T22:48:57.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 1 -- 172.21.15.134:0/4106497117 wait complete. 2024-09-15T22:48:57.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.505+0000 7f6ba107a740 20 client.9192 trim_cache size 0 max 16384 2024-09-15T22:48:57.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 Processor -- start 2024-09-15T22:48:57.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 -- start start 2024-09-15T22:48:57.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ecb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98158b00 con 0x5619e6ef5120 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98073aa0 con 0x5619e6f0fae0 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6b981584b0 con 0x5619e6ec64f0 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36868/0 (socket says 172.21.15.134:36868) 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.523+0000 7f6b96ffd640 1 -- 172.21.15.134:0/202024323 learned_addr learned my addr 172.21.15.134:0/202024323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b97fff640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ecb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b977fe640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 -- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 msgr2=0x5619e6ef17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 -- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 msgr2=0x5619e6ecb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ecb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 -- 172.21.15.134:0/202024323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e6ef5870 con 0x5619e6ef5120 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b977fe640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b97fff640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ecb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c015f90 tx=0x7f6b8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dead22aef6d73d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b7cff9640 1 -- 172.21.15.134:0/202024323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c028070 con 0x5619e6ef5120 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b7cff9640 1 -- 172.21.15.134:0/202024323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c032070 con 0x5619e6ef5120 2024-09-15T22:48:57.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.524+0000 7f6b7cff9640 1 -- 172.21.15.134:0/202024323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c024650 con 0x5619e6ef5120 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- 172.21.15.134:0/202024323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 msgr2=0x5619e6ecb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c015f90 tx=0x7f6b8c02c000 comp rx=0 tx=0).stop 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- 172.21.15.134:0/202024323 shutdown_connections 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ecb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6ecb390 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 --2- 172.21.15.134:0/202024323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6ef17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- 172.21.15.134:0/202024323 >> 172.21.15.134:0/202024323 conn(0x5619e6ec8a80 msgr2=0x5619e6f09cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- 172.21.15.134:0/202024323 shutdown_connections 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- 172.21.15.134:0/202024323 wait complete. 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.525+0000 7f6ba107a740 1 -- start start 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 Processor -- start 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6f23f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ef17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5619e6ecae40 con 0x5619e6ef5120 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619e6f0b4a0 con 0x5619e6f0fae0 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x5619e6f28060 con 0x5619e6ec64f0 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6ba107a740 10 client.0 _ll_register_callbacks cb 0x7f6b8c026070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36882/0 (socket says 172.21.15.134:36882) 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4066521970 learned_addr learned my addr 172.21.15.134:0/4066521970 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6b97fff640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ef17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.526+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6f23f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 msgr2=0x5619e6f23f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6f23f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 msgr2=0x5619e6ef17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ef17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 -- 172.21.15.134:0/4066521970 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e6ec4970 con 0x5619e6ef5120 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b96ffd640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x5619e6ecc570 tx=0x7f6b8c006030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd837dd05167837a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c028040 con 0x5619e6ef5120 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f6b8c025dc0 con 0x5619e6ef5120 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b8c032070 con 0x5619e6ef5120 2024-09-15T22:48:57.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c056050 con 0x5619e6ef5120 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 10 client.9198 fetch_fsmap learned FSMap version 89 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5619e6ef0390 con 0x5619e6ef5120 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c032070 con 0x5619e6ef5120 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8c059020 con 0x5619e6ef5120 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 10 client.9198 fetch_fsmap finished waiting for FSMap version 89 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 10 client.9198 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 20 client.9198 populate_metadata read hostname 'smithi134' 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f23220 0x5619e6f23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 4 client.9198 mds_command: new command op to 9036 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.527+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 --> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] -- command(tid 0: {"prefix": "status"}) -- 0x5619e6e34fa0 con 0x5619e6f23220 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f23220 0x5619e6f23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b767fc640 10 client.9198 ms_handle_connect on v2:172.21.15.134:6834/23140858 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b977fe640 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f23220 0x5619e6f23600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1182c966fcde4063 server_cookie=467654f6ebb04346 in_seq=0 out_seq=0 2024-09-15T22:48:57.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b767fc640 1 -- 172.21.15.134:0/4066521970 <== mds.0 v2:172.21.15.134:6834/23140858 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5619e6e34fa0 con 0x5619e6f23220 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b767fc640 10 client.9198 handle_command_reply: tid=0 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 client.9198 shutdown 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 msgr2=0x5619e6f91d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x5619e6ecc570 tx=0x7f6b8c006030 comp rx=0 tx=0).stop 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 shutdown_connections 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619e6f0fae0 0x5619e6ef17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5619e6ef5120 0x5619e6f91d90 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.134:6834/23140858,v1:172.21.15.134:6835/23140858] conn(0x5619e6f23220 0x5619e6f23600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 --2- 172.21.15.134:0/4066521970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5619e6ec64f0 0x5619e6f23f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6b767fc640 0 client.9198 ms_handle_reset on v2:172.21.15.134:6834/23140858 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 >> 172.21.15.134:0/4066521970 conn(0x5619e6ec8a80 msgr2=0x5619e6ef8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 shutdown_connections 2024-09-15T22:48:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 1 -- 172.21.15.134:0/4066521970 wait complete. 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.528+0000 7f6ba107a740 20 client.9198 trim_cache size 0 max 16384 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "5af37fce-f477-417d-bd72-01ffdf727d70", 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 9036, 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 8.8796530659999995, 2024-09-15T22:48:57.538 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 89, 2024-09-15T22:48:57.539 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 170, 2024-09-15T22:48:57.539 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 170, 2024-09-15T22:48:57.539 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 13.223195959 2024-09-15T22:48:57.539 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 msgr2=0x7f6b8406f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 0x7f6b8406f130 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b9815c260 tx=0x7f6b8c000f80 comp rx=0 tx=0).stop 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 msgr2=0x7f6b98141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f6b88011a00 tx=0x7f6b88011ec0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 shutdown_connections 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b9815a550 0x7f6b9815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b9806bba0 0x7f6b9806bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6b8406cc70 0x7f6b8406f130 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 --2- 172.21.15.134:0/1963516843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b80004d40 0x7f6b98141520 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 >> 172.21.15.134:0/1963516843 conn(0x7f6b98062cc0 msgr2=0x7f6b980b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 shutdown_connections 2024-09-15T22:48:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.529+0000 7f6b9e1fd640 1 -- 172.21.15.134:0/1963516843 wait complete. 2024-09-15T22:48:57.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:48:57.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.638+0000 7fe6f18b7640 1 Processor -- start 2024-09-15T22:48:57.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.638+0000 7fe6f18b7640 1 -- start start 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6f18b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe6ec15ed20 0x7fe6ec0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6f18b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6ec0cef90 0x7fe6ec0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6f18b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0b7170 con 0x7fe6ec15e940 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6f18b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0b7aa0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6f18b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0d3660 con 0x7fe6ec15ed20 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eb7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6ec0cef90 0x7fe6ec0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eaffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe6ec15e940 0x7fe6ec0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40674/0 (socket says 172.21.15.134:40674) 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eaffd640 1 -- 172.21.15.134:0/880272665 learned_addr learned my addr 172.21.15.134:0/880272665 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6e27fc640 1 --2- 172.21.15.134:0/880272665 >> v2:172.21.15.177:3300/0 conn(0x7fe6ec15ed20 0x7fe6ec0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eb7fe640 1 -- 172.21.15.134:0/880272665 >> v2:172.21.15.177:3300/0 conn(0x7fe6ec15ed20 msgr2=0x7fe6ec0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:57.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eb7fe640 1 --2- 172.21.15.134:0/880272665 >> v2:172.21.15.177:3300/0 conn(0x7fe6ec15ed20 0x7fe6ec0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eb7fe640 1 -- 172.21.15.134:0/880272665 >> v1:172.21.15.134:6789/0 conn(0x7fe6ec15e940 legacy=0x7fe6ec0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6eb7fe640 1 -- 172.21.15.134:0/880272665 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0d3940 con 0x7fe6ec0cef90 2024-09-15T22:48:57.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.639+0000 7fe6ea7fc640 1 -- 172.21.15.134:0/880272665 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240819461 0 0) 0x7fe6dc001110 con 0x7fe6ec15e940 2024-09-15T22:48:57.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.640+0000 7fe6eb7fe640 1 --2- 172.21.15.134:0/880272665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec0b3760 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06e900 tx=0x7fe6e402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c15018e7ddf0f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.640+0000 7fe6ea7fc640 1 -- 172.21.15.134:0/880272665 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4007740 con 0x7fe6ec0cef90 2024-09-15T22:48:57.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.640+0000 7fe6ea7fc640 1 -- 172.21.15.134:0/880272665 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40078e0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.640+0000 7fe6ea7fc640 1 -- 172.21.15.134:0/880272665 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4007cb0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 -- 172.21.15.134:0/880272665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 msgr2=0x7fe6ec0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/880272665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec0b3760 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06e900 tx=0x7fe6e402a710 comp rx=0 tx=0).stop 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 -- 172.21.15.134:0/880272665 shutdown_connections 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/880272665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec0b3760 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/880272665 >> v2:172.21.15.177:3300/0 conn(0x7fe6ec15ed20 0x7fe6ec0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 -- 172.21.15.134:0/880272665 >> 172.21.15.134:0/880272665 conn(0x7fe6ec0b6240 msgr2=0x7fe6ec0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 -- 172.21.15.134:0/880272665 shutdown_connections 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.641+0000 7fe6f18b7640 1 -- 172.21.15.134:0/880272665 wait complete. 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.642+0000 7fe6f18b7640 1 Processor -- start 2024-09-15T22:48:57.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.642+0000 7fe6f18b7640 1 -- start start 2024-09-15T22:48:57.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6ec15e940 0x7fe6ec0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6ec15ed20 0x7fe6ec158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d3310 con 0x7fe6ec0cef90 2024-09-15T22:48:57.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d3f00 con 0x7fe6ec15e940 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d1ef0 con 0x7fe6ec15ed20 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36892/0 (socket says 172.21.15.134:36892) 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 -- 172.21.15.134:0/2315698281 learned_addr learned my addr 172.21.15.134:0/2315698281 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 -- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6ec15ed20 msgr2=0x7fe6ec158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6ec15ed20 0x7fe6ec158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 -- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6ec15e940 msgr2=0x7fe6ec0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6ec15e940 0x7fe6ec0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 -- 172.21.15.134:0/2315698281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1e73c0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6eaffd640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c780 tx=0x7fe6dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc018070 con 0x7fe6ec0cef90 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0072d0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0047e0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.643+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec15b830 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.644+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1e7940 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.644+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0cd6a0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.645+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fe6dc01b070 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.645+0000 7fe6e8ff9640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 0x7fe6cc06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.646+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fe6dc088ed0 con 0x7fe6ec0cef90 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.646+0000 7fe6e27fc640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 0x7fe6cc06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:57.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.646+0000 7fe6e27fc640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 0x7fe6cc06f130 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4006fd0 tx=0x7fe6d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:57.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.650+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6ec0b7170 con 0x7fe6ec0cef90 2024-09-15T22:48:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.850+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe6ec0d1060 con 0x7fe6ec0cef90 2024-09-15T22:48:57.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.851+0000 7fe6e8ff9640 1 -- 172.21.15.134:0/2315698281 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7fe6dc059240 con 0x7fe6ec0cef90 2024-09-15T22:48:57.853 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:48:57.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 msgr2=0x7fe6cc06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 0x7fe6cc06f130 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4006fd0 tx=0x7fe6d4008040 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 msgr2=0x7fe6ec15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c780 tx=0x7fe6dc00cc40 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 shutdown_connections 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6ec15ed20 0x7fe6ec158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6ec15e940 0x7fe6ec0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe6cc06cc70 0x7fe6cc06f130 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 --2- 172.21.15.134:0/2315698281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6ec0cef90 0x7fe6ec15b2f0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 >> 172.21.15.134:0/2315698281 conn(0x7fe6ec0b6240 msgr2=0x7fe6ec0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 shutdown_connections 2024-09-15T22:48:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:57.853+0000 7fe6f18b7640 1 -- 172.21.15.134:0/2315698281 wait complete. 2024-09-15T22:48:57.866 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:48:57.866 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:48:57.866 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-15T22:48:57.866 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:48:57.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:57.867 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:48:57.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:48:57.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:48:57.867 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:57.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:57.867 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-15T22:48:57.883 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42355sec preferred_lft 42355sec 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8f:5eff:fe7a:803e/64 scope link 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 66:fe:ba:a4:7a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::64fe:baff:fea4:7a79/64 scope link 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 82:ff:1e:0b:be:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::80ff:1eff:fe0b:beef/64 scope link 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:57.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:57.886 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:48:57.946 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-15T22:48:57.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:57.949 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-15T22:48:58.004 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-15T22:48:58.005 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:48:58.005 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:48:58.005 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:48:58.005 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:48:58.005 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-15T22:48:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:48:58.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:58.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.131 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:48:58.146 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:48:58.146 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:48:58.147 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:58.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-15T22:48:58.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:58.212 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:58.267 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:48:58.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:58.267 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:58.322 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:48:58.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:58.406 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:58.407 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:58.407 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:58.416 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:58.416 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:58.416 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:58.416 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:58.416 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:48:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:48:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-09-15T22:48:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:48:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:48:58.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:48:58.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:48:58.489 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:48:58.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:58.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:58.591 INFO:teuthology.orchestra.run.smithi134.stdout:client8026 2024-09-15T22:48:58.591 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:48:58.591 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:58.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:48:58.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.745+0000 7f5ab7b66640 1 Processor -- start 2024-09-15T22:48:58.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.745+0000 7f5ab7b66640 1 -- start start 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab7b66640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ab00cdae0 0x7f5ab00b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab7b66640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ab00aff30 0x7f5ab00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab7b66640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab00b0880 con 0x7f5ab0156880 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab7b66640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab00b6b00 con 0x7f5ab00cdae0 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab7b66640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab00ce150 con 0x7f5ab00aff30 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ab00cdae0 0x7f5ab00b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ab00cdae0 0x7f5ab00b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36900/0 (socket says 172.21.15.134:36900) 2024-09-15T22:48:58.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 -- 172.21.15.134:0/2711588827 learned_addr learned my addr 172.21.15.134:0/2711588827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab6103640 1 --2- 172.21.15.134:0/2711588827 >> v2:172.21.15.177:3300/0 conn(0x7f5ab00aff30 0x7f5ab00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 -- 172.21.15.134:0/2711588827 >> v2:172.21.15.177:3300/0 conn(0x7f5ab00aff30 msgr2=0x7f5ab00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 --2- 172.21.15.134:0/2711588827 >> v2:172.21.15.177:3300/0 conn(0x7f5ab00aff30 0x7f5ab00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.746+0000 7f5ab5101640 1 -- 172.21.15.134:0/2711588827 >> v1:172.21.15.177:6789/0 conn(0x7f5ab0156880 legacy=0x7f5ab0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:58.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.747+0000 7f5ab5101640 1 -- 172.21.15.134:0/2711588827 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab00ce430 con 0x7f5ab00cdae0 2024-09-15T22:48:58.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.747+0000 7f5ab5101640 1 --2- 172.21.15.134:0/2711588827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00cdae0 0x7f5ab00b65c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0062e40 tx=0x7f5aa002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dd9bece6dcd0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:58.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.747+0000 7f5ab4900640 1 -- 172.21.15.134:0/2711588827 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0037070 con 0x7f5ab00cdae0 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.747+0000 7f5ab4900640 1 -- 172.21.15.134:0/2711588827 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa0032440 con 0x7f5ab00cdae0 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.747+0000 7f5ab4900640 1 -- 172.21.15.134:0/2711588827 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0032810 con 0x7f5ab00cdae0 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2711588827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00cdae0 msgr2=0x7f5ab00b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2711588827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00cdae0 0x7f5ab00b65c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0062e40 tx=0x7f5aa002a230 comp rx=0 tx=0).stop 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2711588827 shutdown_connections 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2711588827 >> v2:172.21.15.177:3300/0 conn(0x7f5ab00aff30 0x7f5ab00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2711588827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00cdae0 0x7f5ab00b65c0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2711588827 >> 172.21.15.134:0/2711588827 conn(0x7f5ab006cae0 msgr2=0x7f5ab006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2711588827 shutdown_connections 2024-09-15T22:48:58.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.748+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2711588827 wait complete. 2024-09-15T22:48:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.749+0000 7f5ab7b66640 1 Processor -- start 2024-09-15T22:48:58.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.749+0000 7f5ab7b66640 1 -- start start 2024-09-15T22:48:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ab00cdae0 0x7f5ab0155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ab0156880 0x7f5ab00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0156c60 con 0x7f5ab00aff30 2024-09-15T22:48:58.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0160210 con 0x7f5ab00cdae0 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab7b66640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab00ce710 con 0x7f5ab0156880 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36906/0 (socket says 172.21.15.134:36906) 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 -- 172.21.15.134:0/2188224105 learned_addr learned my addr 172.21.15.134:0/2188224105 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab6103640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ab0156880 0x7f5ab00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 -- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ab0156880 msgr2=0x7f5ab00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ab0156880 0x7f5ab00ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5101640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ab00cdae0 0x7f5ab0155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 -- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ab00cdae0 msgr2=0x7f5ab0155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ab00cdae0 0x7f5ab0155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 -- 172.21.15.134:0/2188224105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab00b4b90 con 0x7f5ab00aff30 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.750+0000 7f5ab5902640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b3f0 tx=0x7f5aac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.751+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac015020 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.751+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac011830 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.751+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab00b4e70 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.751+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac011c20 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.751+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab00b5430 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.752+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab00b0340 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.752+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f5aac018020 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.753+0000 7f5aa67fc640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 0x7f5a9406f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.753+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f5aac089860 con 0x7f5ab00aff30 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.753+0000 7f5ab5101640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 0x7f5a9406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.754+0000 7f5ab5101640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 0x7f5a9406f130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0034000 tx=0x7f5aa002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:58.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.757+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aac01f030 con 0x7f5ab00aff30 2024-09-15T22:48:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.954+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5ab00761a0 con 0x7f5ab00aff30 2024-09-15T22:48:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.954+0000 7f5aa67fc640 1 -- 172.21.15.134:0/2188224105 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7f5aac0172c0 con 0x7f5ab00aff30 2024-09-15T22:48:58.955 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:48:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 msgr2=0x7f5a9406f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 0x7f5a9406f130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0034000 tx=0x7f5aa002e000 comp rx=0 tx=0).stop 2024-09-15T22:48:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 msgr2=0x7f5ab00b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b3f0 tx=0x7f5aac00b8b0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 shutdown_connections 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ab0156880 0x7f5ab00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ab00cdae0 0x7f5ab0155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f5a9406cc70 0x7f5a9406f130 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 --2- 172.21.15.134:0/2188224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab00aff30 0x7f5ab00b5c30 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 >> 172.21.15.134:0/2188224105 conn(0x7f5ab006cae0 msgr2=0x7f5ab00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 shutdown_connections 2024-09-15T22:48:58.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:58.956+0000 7f5ab7b66640 1 -- 172.21.15.134:0/2188224105 wait complete. 2024-09-15T22:48:58.968 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:48:58.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:48:58.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-09-15T22:48:58.968 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:48:58.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:58.969 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:48:58.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:48:58.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:48:58.969 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:58.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.969 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.989 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42344sec preferred_lft 42344sec 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link noprefixroute 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.990 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::24ab:58ff:fe83:6c0c/64 scope link 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 8e:1a:6f:44:29:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1a:6fff:fe44:29a4/64 scope link 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:f0:cb:7f:62:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e0f0:cbff:fe7f:621e/64 scope link 2024-09-15T22:48:58.991 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:48:58.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:58.992 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:48:59.057 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-15T22:48:59.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:59.059 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-09-15T22:48:59.117 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-09-15T22:48:59.117 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:48:59.118 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:48:59.118 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:48:59.118 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:48:59.118 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-09-15T22:48:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:48:59.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:59.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:59.250 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:48:59.267 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:48:59.267 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:48:59.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:59.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:59.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-09-15T22:48:59.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:59.332 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:59.388 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:48:59.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:48:59.389 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:59.444 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:48:59.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:59.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:59.527 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:59.528 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:59.528 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:59.536 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:59.536 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:59.536 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:59.536 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:59.537 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-09-15T22:48:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-09-15T22:48:59.542 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5af37fce-f477-417d-bd72-01ffdf727d70" will pass to kernel 2024-09-15T22:48:59.542 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T22:48:59.542 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:48:59.542 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:48:59.542 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:48:59.543 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:48:59.544 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:48:59.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:48:59.544 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:48:59.609 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:48:59.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:48:59.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-15T22:48:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:48:59.706 INFO:teuthology.orchestra.run.smithi177.stdout:client9216 2024-09-15T22:48:59.706 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:48:59.706 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:48:59.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T22:48:59.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.833+0000 7f1e47ae6640 1 Processor -- start 2024-09-15T22:48:59.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.834+0000 7f1e47ae6640 1 -- start start 2024-09-15T22:48:59.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e47ae6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e40072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:59.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e47ae6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4015c970 con 0x7f1e4015b370 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e47ae6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4015bbb0 con 0x7f1e4006f130 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e47ae6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4015fef0 con 0x7f1e4015f9f0 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e45882640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1e4015b370 0x7f1e4006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40676/0 (socket says 172.21.15.134:40676) 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e45882640 1 -- 172.21.15.134:0/4033808362 learned_addr learned my addr 172.21.15.134:0/4033808362 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e46083640 1 --2- 172.21.15.134:0/4033808362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e40072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574674001 0 0) 0x7f1e4015c970 con 0x7f1e4015b370 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e2c003520 con 0x7f1e4015b370 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7129084 0 0) 0x7f1e4015bbb0 con 0x7f1e4006f130 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4015c970 con 0x7f1e4006f130 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e46083640 1 -- 172.21.15.134:0/4033808362 >> v1:172.21.15.177:6789/0 conn(0x7f1e4006f130 legacy=0x7f1e400ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e46083640 1 -- 172.21.15.134:0/4033808362 >> v1:172.21.15.134:6789/0 conn(0x7f1e4015b370 legacy=0x7f1e4006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 112443554 0 0) 0x7f1e2c003520 con 0x7f1e4015b370 2024-09-15T22:48:59.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.835+0000 7f1e46083640 1 -- 172.21.15.134:0/4033808362 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4015be90 con 0x7f1e4015f9f0 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.836+0000 7f1e46083640 1 --2- 172.21.15.134:0/4033808362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e40072560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009dc0 tx=0x7f1e3802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfe573eaa2a83915 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.836+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c001670 con 0x7f1e4015f9f0 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.836+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e38007540 con 0x7f1e4015f9f0 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.836+0000 7f1e44880640 1 -- 172.21.15.134:0/4033808362 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380078f0 con 0x7f1e4015f9f0 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 -- 172.21.15.134:0/4033808362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 msgr2=0x7f1e40072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/4033808362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e40072560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009dc0 tx=0x7f1e3802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 -- 172.21.15.134:0/4033808362 shutdown_connections 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/4033808362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e40072560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 -- 172.21.15.134:0/4033808362 >> 172.21.15.134:0/4033808362 conn(0x7f1e4006bba0 msgr2=0x7f1e4006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 -- 172.21.15.134:0/4033808362 shutdown_connections 2024-09-15T22:48:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.837+0000 7f1e47ae6640 1 -- 172.21.15.134:0/4033808362 wait complete. 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.838+0000 7f1e47ae6640 1 Processor -- start 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.838+0000 7f1e47ae6640 1 -- start start 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 0x7f1e401529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e400aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400731b0 con 0x7f1e4006f130 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4015c450 con 0x7f1e4015b370 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e47ae6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4015b750 con 0x7f1e4015f9f0 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36922/0 (socket says 172.21.15.134:36922) 2024-09-15T22:48:59.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 -- 172.21.15.134:0/2141442037 learned_addr learned my addr 172.21.15.134:0/2141442037 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e46083640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e400aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45081640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 0x7f1e401529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 -- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 msgr2=0x7f1e400aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e400aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 -- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 msgr2=0x7f1e401529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:59.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 0x7f1e401529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 -- 172.21.15.134:0/2141442037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400ada00 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45081640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 0x7f1e401529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.839+0000 7f1e45882640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c5c0 tx=0x7f1e3c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.840+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c017070 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.840+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c005ce0 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.840+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e400adce0 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.840+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0072b0 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.840+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e40152f30 con 0x7f1e4006f130 2024-09-15T22:48:59.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.841+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e40072560 con 0x7f1e4006f130 2024-09-15T22:48:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.841+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7f1e3c01a070 con 0x7f1e4006f130 2024-09-15T22:48:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.842+0000 7f1e367fc640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 0x7f1e2406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.842+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f1e3c089180 con 0x7f1e4006f130 2024-09-15T22:48:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.842+0000 7f1e45081640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 0x7f1e2406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:59.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.843+0000 7f1e45081640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 0x7f1e2406f100 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e4015f290 tx=0x7f1e30009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:59.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:48:59.846+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e3c059460 con 0x7f1e4006f130 2024-09-15T22:49:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.046+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f1e400ae3a0 con 0x7f1e4006f130 2024-09-15T22:49:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.700+0000 7f1e367fc640 1 -- 172.21.15.134:0/2141442037 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v90) ==== 136+0+0 (secure 0 0 0) 0x7f1e3c058d60 con 0x7f1e4006f130 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 msgr2=0x7f1e2406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 0x7f1e2406f100 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e4015f290 tx=0x7f1e30009040 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 msgr2=0x7f1e400b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c5c0 tx=0x7f1e3c00ca80 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 shutdown_connections 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e4015f9f0 0x7f1e400aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e4015b370 0x7f1e401529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f1e2406cc40 0x7f1e2406f100 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.703+0000 7f1e47ae6640 1 --2- 172.21.15.134:0/2141442037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4006f130 0x7f1e400b54e0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.704+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 >> 172.21.15.134:0/2141442037 conn(0x7f1e4006bba0 msgr2=0x7f1e4006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:00.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.704+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 shutdown_connections 2024-09-15T22:49:00.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.704+0000 7f1e47ae6640 1 -- 172.21.15.134:0/2141442037 wait complete. 2024-09-15T22:49:00.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-15T22:49:00.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.823+0000 7fd6005c4640 1 Processor -- start 2024-09-15T22:49:00.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.823+0000 7fd6005c4640 1 -- start start 2024-09-15T22:49:00.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd6005c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 0x7fd5f8071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd6005c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5f806ccb0 0x7fd5f806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd6005c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f8071880 con 0x7fd5f80b5600 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd6005c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f806e680 con 0x7fd5f806ccb0 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd6005c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80741c0 con 0x7fd5f815e7b0 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5f806ccb0 0x7fd5f806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5f806ccb0 0x7fd5f806d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36938/0 (socket says 172.21.15.134:36938) 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 -- 172.21.15.134:0/515748883 learned_addr learned my addr 172.21.15.134:0/515748883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5fe360640 1 --2- 172.21.15.134:0/515748883 >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 0x7fd5f8071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 -- 172.21.15.134:0/515748883 >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 msgr2=0x7fd5f8071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 --2- 172.21.15.134:0/515748883 >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 0x7fd5f8071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 -- 172.21.15.134:0/515748883 >> v1:172.21.15.177:6789/0 conn(0x7fd5f80b5600 legacy=0x7fd5f8073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:00.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5feb61640 1 -- 172.21.15.134:0/515748883 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f806e8d0 con 0x7fd5f806ccb0 2024-09-15T22:49:00.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.824+0000 7fd5fe360640 1 --2- 172.21.15.134:0/515748883 >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 0x7fd5f8071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.825+0000 7fd5feb61640 1 --2- 172.21.15.134:0/515748883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f806ccb0 0x7fd5f806d0d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8050260 tx=0x7fd5f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d461a2e55dafa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.825+0000 7fd5fd35e640 1 -- 172.21.15.134:0/515748883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0037070 con 0x7fd5f806ccb0 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.825+0000 7fd5fd35e640 1 -- 172.21.15.134:0/515748883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0032440 con 0x7fd5f806ccb0 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.825+0000 7fd5fd35e640 1 -- 172.21.15.134:0/515748883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0032810 con 0x7fd5f806ccb0 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 -- 172.21.15.134:0/515748883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f806ccb0 msgr2=0x7fd5f806d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 --2- 172.21.15.134:0/515748883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f806ccb0 0x7fd5f806d0d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8050260 tx=0x7fd5f002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 -- 172.21.15.134:0/515748883 shutdown_connections 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 --2- 172.21.15.134:0/515748883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f806ccb0 0x7fd5f806d0d0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 --2- 172.21.15.134:0/515748883 >> v2:172.21.15.177:3300/0 conn(0x7fd5f815e7b0 0x7fd5f8071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 -- 172.21.15.134:0/515748883 >> 172.21.15.134:0/515748883 conn(0x7fd5f80b4300 msgr2=0x7fd5f80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 -- 172.21.15.134:0/515748883 shutdown_connections 2024-09-15T22:49:00.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.826+0000 7fd6005c4640 1 -- 172.21.15.134:0/515748883 wait complete. 2024-09-15T22:49:00.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.827+0000 7fd6005c4640 1 Processor -- start 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.827+0000 7fd6005c4640 1 -- start start 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5f806ccb0 0x7fd5f8161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5f815e7b0 0x7fd5f8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f8073590 con 0x7fd5f80b5600 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80732b0 con 0x7fd5f815e7b0 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd6005c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f806d610 con 0x7fd5f806ccb0 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36952/0 (socket says 172.21.15.134:36952) 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 -- 172.21.15.134:0/3987557173 learned_addr learned my addr 172.21.15.134:0/3987557173 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5feb61640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5f815e7b0 0x7fd5f8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fe360640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5f806ccb0 0x7fd5f8161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 -- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5f806ccb0 msgr2=0x7fd5f8161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:00.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5f806ccb0 0x7fd5f8161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 -- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5f815e7b0 msgr2=0x7fd5f8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5f815e7b0 0x7fd5f8157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 -- 172.21.15.134:0/3987557173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f8161730 con 0x7fd5f80b5600 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.828+0000 7fd5fdb5f640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c400 tx=0x7fd5e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.829+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011790 con 0x7fd5f80b5600 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.829+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8017070 con 0x7fd5f80b5600 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.829+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f8161a10 con 0x7fd5f80b5600 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.829+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011bb0 con 0x7fd5f80b5600 2024-09-15T22:49:00.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.829+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f8161cf0 con 0x7fd5f80b5600 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.830+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f806d0d0 con 0x7fd5f80b5600 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.830+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fd5e801c460 con 0x7fd5f80b5600 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.831+0000 7fd5eeffd640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 0x7fd5dc06f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.831+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fd5e8089950 con 0x7fd5f80b5600 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.831+0000 7fd5fe360640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 0x7fd5dc06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:00.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.831+0000 7fd5fe360640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 0x7fd5dc06f100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400f500 tx=0x7fd5f4007770 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:00.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:00.835+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5e8059670 con 0x7fd5f80b5600 2024-09-15T22:49:01.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.021+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd5f81511f0 con 0x7fd5dc06cc40 2024-09-15T22:49:01.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.023+0000 7fd5eeffd640 1 -- 172.21.15.134:0/3987557173 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd5f4007cd0 con 0x7fd5dc06cc40 2024-09-15T22:49:01.024 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-09-15T22:49:01.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-15T22:49:01.024 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "cephfs" 2024-09-15T22:49:01.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-15T22:49:01.025 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 msgr2=0x7fd5dc06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 0x7fd5dc06f100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400f500 tx=0x7fd5f4007770 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 msgr2=0x7fd5f8150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c400 tx=0x7fd5e800c8c0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 shutdown_connections 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5f815e7b0 0x7fd5f8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd5dc06cc40 0x7fd5dc06f100 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5f80b5600 0x7fd5f8150cb0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 --2- 172.21.15.134:0/3987557173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5f806ccb0 0x7fd5f8161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 >> 172.21.15.134:0/3987557173 conn(0x7fd5f80b4300 msgr2=0x7fd5f80d2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 shutdown_connections 2024-09-15T22:49:01.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.025+0000 7fd6005c4640 1 -- 172.21.15.134:0/3987557173 wait complete. 2024-09-15T22:49:01.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:49:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.137+0000 7fd46a1d6640 1 Processor -- start 2024-09-15T22:49:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.137+0000 7fd46a1d6640 1 -- start start 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd46a1d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd464158e50 0x7fd4640b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd46a1d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4640ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd46a1d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46415c800 con 0x7fd46415c370 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd46a1d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd4640b43f0 con 0x7fd464158e50 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd46a1d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4640b3630 con 0x7fd46406f130 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd4637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd464158e50 0x7fd4640b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd462ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd46415c370 0x7fd46406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40678/0 (socket says 172.21.15.134:40678) 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.138+0000 7fd462ffd640 1 -- 172.21.15.134:0/323992930 learned_addr learned my addr 172.21.15.134:0/323992930 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd463fff640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4640ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4637fe640 1 -- 172.21.15.134:0/323992930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 msgr2=0x7fd4640ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4637fe640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4640ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4637fe640 1 -- 172.21.15.134:0/323992930 >> v1:172.21.15.134:6789/0 conn(0x7fd46415c370 legacy=0x7fd46406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4627fc640 1 -- 172.21.15.134:0/323992930 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237153961 0 0) 0x7fd46415c800 con 0x7fd46415c370 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4637fe640 1 -- 172.21.15.134:0/323992930 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640b3910 con 0x7fd464158e50 2024-09-15T22:49:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd463fff640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4640ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4637fe640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd4640b5050 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fd4540097a0 tx=0x7fd45402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2558b497b00e63e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4627fc640 1 -- 172.21.15.134:0/323992930 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd464158e50 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4627fc640 1 -- 172.21.15.134:0/323992930 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454032440 con 0x7fd464158e50 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.139+0000 7fd4627fc640 1 -- 172.21.15.134:0/323992930 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454032810 con 0x7fd464158e50 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 -- 172.21.15.134:0/323992930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 msgr2=0x7fd4640b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd4640b5050 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fd4540097a0 tx=0x7fd45402a180 comp rx=0 tx=0).stop 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 -- 172.21.15.134:0/323992930 shutdown_connections 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4640ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/323992930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd4640b5050 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 -- 172.21.15.134:0/323992930 >> 172.21.15.134:0/323992930 conn(0x7fd46406bba0 msgr2=0x7fd46406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 -- 172.21.15.134:0/323992930 shutdown_connections 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.140+0000 7fd46a1d6640 1 -- 172.21.15.134:0/323992930 wait complete. 2024-09-15T22:49:01.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.141+0000 7fd46a1d6640 1 Processor -- start 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 -- start start 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4641526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46415c370 0x7fd46406e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd464159230 con 0x7fd464158e50 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640b3ed0 con 0x7fd46415c370 2024-09-15T22:49:01.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd46a1d6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd4640ce740 con 0x7fd46406f130 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd462ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd462ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36958/0 (socket says 172.21.15.134:36958) 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd462ffd640 1 -- 172.21.15.134:0/1086535512 learned_addr learned my addr 172.21.15.134:0/1086535512 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd4637fe640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4641526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.142+0000 7fd463fff640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46415c370 0x7fd46406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 -- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 msgr2=0x7fd4641526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4641526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 -- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46415c370 msgr2=0x7fd46406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46415c370 0x7fd46406e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 -- 172.21.15.134:0/1086535512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd464143ea0 con 0x7fd464158e50 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd462ffd640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fd458001eb0 tx=0x7fd45800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458017070 con 0x7fd464158e50 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4580074e0 con 0x7fd464158e50 2024-09-15T22:49:01.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580059e0 con 0x7fd464158e50 2024-09-15T22:49:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd464144180 con 0x7fd464158e50 2024-09-15T22:49:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.143+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd464144740 con 0x7fd464158e50 2024-09-15T22:49:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.144+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4640ce200 con 0x7fd464158e50 2024-09-15T22:49:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.145+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fd45801a070 con 0x7fd464158e50 2024-09-15T22:49:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.145+0000 7fd44bfff640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 0x7fd45006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.145+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fd458088e80 con 0x7fd464158e50 2024-09-15T22:49:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.145+0000 7fd4637fe640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 0x7fd45006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.146+0000 7fd4637fe640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 0x7fd45006f100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd45402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.149+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd458058c60 con 0x7fd464158e50 2024-09-15T22:49:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.314+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd46415bb20 con 0x7fd464158e50 2024-09-15T22:49:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.315+0000 7fd44bfff640 1 -- 172.21.15.134:0/1086535512 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fd45805cf60 con 0x7fd464158e50 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 msgr2=0x7fd45006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 0x7fd45006f100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd45402e000 comp rx=0 tx=0).stop 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 msgr2=0x7fd464143680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fd458001eb0 tx=0x7fd45800c890 comp rx=0 tx=0).stop 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 shutdown_connections 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd46415c370 0x7fd46406e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd45006cc40 0x7fd45006f100 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd464158e50 0x7fd464143680 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 --2- 172.21.15.134:0/1086535512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd46406f130 0x7fd4641526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 >> 172.21.15.134:0/1086535512 conn(0x7fd46406bba0 msgr2=0x7fd4640cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:01.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 shutdown_connections 2024-09-15T22:49:01.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.317+0000 7fd46a1d6640 1 -- 172.21.15.134:0/1086535512 wait complete. 2024-09-15T22:49:01.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:01.329 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp2240/subvol14890) 2024-09-15T22:49:01.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:01.360 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-15T22:49:01.417 INFO:teuthology.orchestra.run.smithi134.stdout:cephfs_data 2024-09-15T22:49:01.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:01.417 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp2240/subvol14890) 2024-09-15T22:49:01.486 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:01.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp2240/subvol14890/.meta 2024-09-15T22:49:01.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol14890 subvol_grp2240 2024-09-15T22:49:01.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.696+0000 7ff35c986640 1 Processor -- start 2024-09-15T22:49:01.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.696+0000 7ff35c986640 1 -- start start 2024-09-15T22:49:01.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff35c986640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3580b5630 0x7ff35815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff35c986640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3580ae8e0 0x7ff358072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff35c986640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3580af050 con 0x7ff3581554d0 2024-09-15T22:49:01.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff35c986640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff3580af330 con 0x7ff3580b5630 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff35c986640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff3580af610 con 0x7ff3580ae8e0 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3580b5630 0x7ff35815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3580b5630 0x7ff35815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36964/0 (socket says 172.21.15.134:36964) 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 -- 172.21.15.134:0/1251025858 learned_addr learned my addr 172.21.15.134:0/1251025858 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 -- 172.21.15.134:0/1251025858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3580ae8e0 msgr2=0x7ff358072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 --2- 172.21.15.134:0/1251025858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3580ae8e0 0x7ff358072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 -- 172.21.15.134:0/1251025858 >> v1:172.21.15.177:6789/0 conn(0x7ff3581554d0 legacy=0x7ff3580b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:01.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.697+0000 7ff355d9b640 1 -- 172.21.15.134:0/1251025858 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3580af8f0 con 0x7ff3580b5630 2024-09-15T22:49:01.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff355d9b640 1 --2- 172.21.15.134:0/1251025858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff35815f640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564b250f65b10418 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff35559a640 1 -- 172.21.15.134:0/1251025858 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c037070 con 0x7ff3580b5630 2024-09-15T22:49:01.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff35559a640 1 -- 172.21.15.134:0/1251025858 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c032440 con 0x7ff3580b5630 2024-09-15T22:49:01.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff35559a640 1 -- 172.21.15.134:0/1251025858 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c032810 con 0x7ff3580b5630 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff35c986640 1 -- 172.21.15.134:0/1251025858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 msgr2=0x7ff35815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.698+0000 7ff35c986640 1 --2- 172.21.15.134:0/1251025858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff35815f640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c02a210 comp rx=0 tx=0).stop 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 -- 172.21.15.134:0/1251025858 shutdown_connections 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 --2- 172.21.15.134:0/1251025858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3580ae8e0 0x7ff358072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 --2- 172.21.15.134:0/1251025858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff35815f640 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 -- 172.21.15.134:0/1251025858 >> 172.21.15.134:0/1251025858 conn(0x7ff35806c9f0 msgr2=0x7ff35806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 -- 172.21.15.134:0/1251025858 shutdown_connections 2024-09-15T22:49:01.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.699+0000 7ff35c986640 1 -- 172.21.15.134:0/1251025858 wait complete. 2024-09-15T22:49:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.700+0000 7ff35c986640 1 Processor -- start 2024-09-15T22:49:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.700+0000 7ff35c986640 1 -- start start 2024-09-15T22:49:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3580ae8e0 0x7ff35815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3581554d0 0x7ff3580ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581558b0 con 0x7ff3580b5630 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3580aed50 con 0x7ff3580ae8e0 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff358155a30 con 0x7ff3581554d0 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36974/0 (socket says 172.21.15.134:36974) 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 -- 172.21.15.134:0/470665348 learned_addr learned my addr 172.21.15.134:0/470665348 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff356d9d640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3581554d0 0x7ff3580ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35659c640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3580ae8e0 0x7ff35815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 -- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3581554d0 msgr2=0x7ff3580ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3581554d0 0x7ff3580ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 -- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3580ae8e0 msgr2=0x7ff35815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3580ae8e0 0x7ff35815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 -- 172.21.15.134:0/470665348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3580cf030 con 0x7ff3580b5630 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff355d9b640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c041070 con 0x7ff3580b5630 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c03c870 con 0x7ff3580b5630 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3580cf310 con 0x7ff3580b5630 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c037040 con 0x7ff3580b5630 2024-09-15T22:49:01.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.701+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3580cf8d0 con 0x7ff3580b5630 2024-09-15T22:49:01.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.702+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35815f640 con 0x7ff3580b5630 2024-09-15T22:49:01.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.703+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7ff34c044070 con 0x7ff3580b5630 2024-09-15T22:49:01.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.703+0000 7ff346ffd640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 0x7ff33806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:01.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.703+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7ff34c0aa980 con 0x7ff3580b5630 2024-09-15T22:49:01.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.704+0000 7ff35659c640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 0x7ff33806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:01.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.704+0000 7ff35659c640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 0x7ff33806f100 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:01.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.708+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff34c07ad80 con 0x7ff3580b5630 2024-09-15T22:49:01.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.901+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol14890", "group_name": "subvol_grp2240", "target": ["mon-mgr", ""]}) -- 0x7ff358161920 con 0x7ff33806cc40 2024-09-15T22:49:01.909 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:01.908+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:01.909 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:01.908+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:01.909 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:01.908+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:01.909 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:01.908+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:01.909 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:01.908+0000 7f4588482640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.941+0000 7ff346ffd640 1 -- 172.21.15.134:0/470665348 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff358161920 con 0x7ff33806cc40 2024-09-15T22:49:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp2240/subvol14890 2024-09-15T22:49:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 msgr2=0x7ff33806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 0x7ff33806f100 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348008040 comp rx=0 tx=0).stop 2024-09-15T22:49:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 msgr2=0x7ff3580ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 shutdown_connections 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3581554d0 0x7ff3580ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff33806cc40 0x7ff33806f100 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3580b5630 0x7ff3580ce2c0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 --2- 172.21.15.134:0/470665348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3580ae8e0 0x7ff35815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 >> 172.21.15.134:0/470665348 conn(0x7ff35806c9f0 msgr2=0x7ff35815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 shutdown_connections 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:01.944+0000 7ff35c986640 1 -- 172.21.15.134:0/470665348 wait complete. 2024-09-15T22:49:01.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol14890 subvol_grp2240 2024-09-15T22:49:02.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.057+0000 7fa1dc3c6640 1 Processor -- start 2024-09-15T22:49:02.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.058+0000 7fa1dc3c6640 1 -- start start 2024-09-15T22:49:02.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.058+0000 7fa1dc3c6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa1d40b61e0 0x7fa1d40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1dc3c6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d41633f0 con 0x7fa1d40b3b00 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1dc3c6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d40b6b00 con 0x7fa1d40d3990 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1dc3c6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d40d24f0 con 0x7fa1d40b61e0 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9961640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa1d40b3b00 0x7fa1d41625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:40692/0 (socket says 172.21.15.134:40692) 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9961640 1 -- 172.21.15.134:0/44323469 learned_addr learned my addr 172.21.15.134:0/44323469 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1da162640 1 --2- 172.21.15.134:0/44323469 >> v2:172.21.15.177:3300/0 conn(0x7fa1d40b61e0 0x7fa1d40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301505107 0 0) 0x7fa1d41633f0 con 0x7fa1d40b3b00 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1bc003520 con 0x7fa1d40b3b00 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 574961594 0 0) 0x7fa1bc003520 con 0x7fa1d40b3b00 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 >> v2:172.21.15.177:3300/0 conn(0x7fa1d40b61e0 msgr2=0x7fa1d40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 --2- 172.21.15.134:0/44323469 >> v2:172.21.15.177:3300/0 conn(0x7fa1d40b61e0 0x7fa1d40b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 >> v1:172.21.15.177:6789/0 conn(0x7fa1d40d3990 legacy=0x7fa1d4162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d40d20e0 con 0x7fa1d40b3b00 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa1c8001670 con 0x7fa1d40b3b00 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 >> v1:172.21.15.134:6789/0 conn(0x7fa1d40b3b00 legacy=0x7fa1d41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 0x7fa1bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1bc004800 0x7fa1bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0051c0 0x7fa1bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d40d24f0 con 0x7fa1bc0039b0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc00c110 con 0x7fa1bc004800 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc00c310 con 0x7fa1bc0051c0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1da162640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 0x7fa1bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.059+0000 7fa1d9961640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1bc004800 0x7fa1bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da963640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0051c0 0x7fa1bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 -- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0051c0 msgr2=0x7fa1bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0051c0 0x7fa1bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 -- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1bc004800 msgr2=0x7fa1bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1bc004800 0x7fa1bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 -- 172.21.15.134:0/44323469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc003520 con 0x7fa1bc0039b0 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1d9961640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1bc004800 0x7fa1bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da963640 1 -- 172.21.15.134:0/44323469 reap_dead start 2024-09-15T22:49:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1da162640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 0x7fa1bc003d90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009ac0 tx=0x7fa1bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6224b50129a953 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc036070 con 0x7fa1bc0039b0 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc031400 con 0x7fa1bc0039b0 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.060+0000 7fa1d9160640 1 -- 172.21.15.134:0/44323469 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc009690 con 0x7fa1bc0039b0 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 msgr2=0x7fa1bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 0x7fa1bc003d90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009ac0 tx=0x7fa1bc005830 comp rx=0 tx=0).stop 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/44323469 shutdown_connections 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/44323469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc0039b0 0x7fa1bc003d90 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/44323469 >> 172.21.15.134:0/44323469 conn(0x7fa1d40d11e0 msgr2=0x7fa1d40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/44323469 shutdown_connections 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.061+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/44323469 wait complete. 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.062+0000 7fa1dc3c6640 1 Processor -- start 2024-09-15T22:49:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.062+0000 7fa1dc3c6640 1 -- start start 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 0x7fa1d40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d414ca50 0x7fa1d40cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d40d0030 con 0x7fa1d40ccb80 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d40cfd50 con 0x7fa1d414ca50 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1dc3c6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d415edc0 con 0x7fa1bc0039b0 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36994/0 (socket says 172.21.15.134:36994) 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 -- 172.21.15.134:0/1065306631 learned_addr learned my addr 172.21.15.134:0/1065306631 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1d9961640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d414ca50 0x7fa1d40cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da162640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 0x7fa1d40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 -- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 msgr2=0x7fa1d40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 0x7fa1d40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 -- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d414ca50 msgr2=0x7fa1d40cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d414ca50 0x7fa1d40cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 -- 172.21.15.134:0/1065306631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d4159930 con 0x7fa1d40ccb80 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da162640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 0x7fa1d40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.063+0000 7fa1da963640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa1d408d930 tx=0x7fa1c400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.064+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4003b80 con 0x7fa1d40ccb80 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.064+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c4018070 con 0x7fa1d40ccb80 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.064+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d4159c10 con 0x7fa1d40ccb80 2024-09-15T22:49:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.064+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40050d0 con 0x7fa1d40ccb80 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.064+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d40cd6a0 con 0x7fa1d40ccb80 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.065+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d40cd8a0 con 0x7fa1d40ccb80 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.065+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 91713+0+0 (secure 0 0 0) 0x7fa1c4005270 con 0x7fa1d40ccb80 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.065+0000 7fa1d2ffd640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 0x7fa1c006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.066+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fa1c40898c0 con 0x7fa1d40ccb80 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.066+0000 7fa1da162640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 0x7fa1c006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.066+0000 7fa1da162640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 0x7fa1c006f100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc033000 tx=0x7fa1cc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:02.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.070+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1d40cd8a0 con 0x7fa1d40ccb80 2024-09-15T22:49:02.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.260+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol14890", "group_name": "subvol_grp2240", "target": ["mon-mgr", ""]}) -- 0x7fa1d40d1d00 con 0x7fa1c006cc40 2024-09-15T22:49:02.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.265+0000 7fa1d2ffd640 1 -- 172.21.15.134:0/1065306631 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa1d40d1d00 con 0x7fa1c006cc40 2024-09-15T22:49:02.266 INFO:teuthology.orchestra.run.smithi134.stdout:/volumes/subvol_grp2240/subvol14890 2024-09-15T22:49:02.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 msgr2=0x7fa1c006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 0x7fa1c006f100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc033000 tx=0x7fa1cc008030 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 msgr2=0x7fa1d4160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa1d408d930 tx=0x7fa1c400ead0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 shutdown_connections 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa1c006cc40 0x7fa1c006f100 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1d40ccb80 0x7fa1d4160920 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d414ca50 0x7fa1d40cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 --2- 172.21.15.134:0/1065306631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1bc0039b0 0x7fa1d40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 >> 172.21.15.134:0/1065306631 conn(0x7fa1d40d11e0 msgr2=0x7fa1d415d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 shutdown_connections 2024-09-15T22:49:02.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:02.267+0000 7fa1dc3c6640 1 -- 172.21.15.134:0/1065306631 wait complete. 2024-09-15T22:49:02.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:02.280 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/a46ec8bb0bef91c89d3c9bcf5bc7421f.meta) 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout:[GLOBAL] 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout:version = 1 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout:type = subvolume 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout:path = /volumes/subvol_grp2240/subvol14890 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout:state = complete 2024-09-15T22:49:04.313 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:04.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol14890 subvol_grp2240 2024-09-15T22:49:04.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.427+0000 7f864bfff640 1 Processor -- start 2024-09-15T22:49:04.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.427+0000 7f864bfff640 1 -- start start 2024-09-15T22:49:04.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f864c156910 0x7f864c142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c13fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864bfff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864c15cc70 con 0x7f864c15c790 2024-09-15T22:49:04.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f864c1428a0 con 0x7f864c156910 2024-09-15T22:49:04.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f864c15cf50 con 0x7f864c070e20 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f864c156910 0x7f864c142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864b7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c13fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864a7fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f864c15c790 0x7f864c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:54128/0 (socket says 172.21.15.134:54128) 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864a7fc640 1 -- 172.21.15.134:0/242888225 learned_addr learned my addr 172.21.15.134:0/242888225 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864affd640 1 -- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 msgr2=0x7f864c13fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864affd640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c13fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864affd640 1 -- 172.21.15.134:0/242888225 >> v1:172.21.15.177:6789/0 conn(0x7f864c15c790 legacy=0x7f864c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f8649ffb640 1 -- 172.21.15.134:0/242888225 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937561768 0 0) 0x7f864c15cc70 con 0x7f864c15c790 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864affd640 1 -- 172.21.15.134:0/242888225 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c15d230 con 0x7f864c156910 2024-09-15T22:49:04.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.428+0000 7f864b7fe640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c13fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.429+0000 7f864affd640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c142360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30055ad49f2ff65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.429+0000 7f8649ffb640 1 -- 172.21.15.134:0/242888225 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c037070 con 0x7f864c156910 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f8649ffb640 1 -- 172.21.15.134:0/242888225 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c032440 con 0x7f864c156910 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f8649ffb640 1 -- 172.21.15.134:0/242888225 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c032810 con 0x7f864c156910 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 -- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 msgr2=0x7f864c142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c142360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a180 comp rx=0 tx=0).stop 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 -- 172.21.15.134:0/242888225 shutdown_connections 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c13fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 --2- 172.21.15.134:0/242888225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c142360 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 -- 172.21.15.134:0/242888225 >> 172.21.15.134:0/242888225 conn(0x7f864c0b40d0 msgr2=0x7f864c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 -- 172.21.15.134:0/242888225 shutdown_connections 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.430+0000 7f864bfff640 1 -- 172.21.15.134:0/242888225 wait complete. 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.431+0000 7f864bfff640 1 Processor -- start 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 -- start start 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f864c1401e0 con 0x7f864c15c790 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f864c0d1470 con 0x7f864c156910 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f864c140360 con 0x7f864c070e20 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36996/0 (socket says 172.21.15.134:36996) 2024-09-15T22:49:04.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.432+0000 7f864b7fe640 1 -- 172.21.15.134:0/3764322816 learned_addr learned my addr 172.21.15.134:0/3764322816 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864affd640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864a7fc640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 -- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 msgr2=0x7f864c157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 -- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 msgr2=0x7f864c158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 -- 172.21.15.134:0/3764322816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c156f00 con 0x7f864c15c790 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864b7fe640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f864400efb0 tx=0x7f864400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644018020 con 0x7f864c15c790 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644014480 con 0x7f864c15c790 2024-09-15T22:49:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c1571e0 con 0x7f864c15c790 2024-09-15T22:49:04.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644014850 con 0x7f864c15c790 2024-09-15T22:49:04.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.433+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c1577a0 con 0x7f864c15c790 2024-09-15T22:49:04.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.434+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c13fca0 con 0x7f864c15c790 2024-09-15T22:49:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.435+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) ==== 91764+0+0 (secure 0 0 0) 0x7f8644005d10 con 0x7f864c15c790 2024-09-15T22:49:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.435+0000 7f86337fe640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 0x7f863806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.435+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f864408ae50 con 0x7f864c15c790 2024-09-15T22:49:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.435+0000 7f864affd640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 0x7f863806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.436+0000 7f864affd640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 0x7f863806f190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f863c034000 tx=0x7f863c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.440+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8644022030 con 0x7f864c15c790 2024-09-15T22:49:04.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.628+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol14890", "group_name": "subvol_grp2240", "target": ["mon-mgr", ""]}) -- 0x7f864c141c40 con 0x7f863806ccd0 2024-09-15T22:49:04.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.643+0000 7f86337fe640 1 -- 172.21.15.134:0/3764322816 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f864c141c40 con 0x7f863806ccd0 2024-09-15T22:49:04.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 msgr2=0x7f863806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 0x7f863806f190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f863c034000 tx=0x7f863c02e000 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 msgr2=0x7f864c15b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f864400efb0 tx=0x7f864400c490 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 shutdown_connections 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f863806ccd0 0x7f863806f190 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f864c15c790 0x7f864c15b8d0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f864c156910 0x7f864c158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 --2- 172.21.15.134:0/3764322816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f864c070e20 0x7f864c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 >> 172.21.15.134:0/3764322816 conn(0x7f864c0b40d0 msgr2=0x7f864c072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 shutdown_connections 2024-09-15T22:49:04.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.645+0000 7f864bfff640 1 -- 172.21.15.134:0/3764322816 wait complete. 2024-09-15T22:49:04.649 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.648+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.649 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.648+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.649 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.648+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.649 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.648+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.650 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.648+0000 7f458ac87640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.657 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-15T22:49:04.662 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.661+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.662 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.661+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.662 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.661+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.662 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.661+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.662 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-15T22:49:04.661+0000 7f458a486640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:49:04.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:49:04.710 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-15T22:49:04.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:49:04.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp2240 2024-09-15T22:49:04.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.819+0000 7f06ed615640 1 Processor -- start 2024-09-15T22:49:04.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.819+0000 7f06ed615640 1 -- start start 2024-09-15T22:49:04.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06ed615640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06ed615640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f06e80b57d0 0x7f06e80b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06ed615640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e806dc40 con 0x7f06e8072290 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06ed615640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f06e806e570 con 0x7f06e80b57d0 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06ed615640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f06e806df20 con 0x7f06e8161cc0 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06e6ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06e6ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:44652/0 (socket says 172.21.15.134:44652) 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06e67fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f06e80b57d0 0x7f06e80b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.820+0000 7f06e6ffd640 1 -- 172.21.15.134:0/2307398226 learned_addr learned my addr 172.21.15.134:0/2307398226 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.821+0000 7f06e6ffd640 1 -- 172.21.15.134:0/2307398226 >> v2:172.21.15.177:3300/0 conn(0x7f06e80b57d0 msgr2=0x7f06e80b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.821+0000 7f06e6ffd640 1 --2- 172.21.15.134:0/2307398226 >> v2:172.21.15.177:3300/0 conn(0x7f06e80b57d0 0x7f06e80b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.821+0000 7f06e6ffd640 1 -- 172.21.15.134:0/2307398226 >> v1:172.21.15.177:6789/0 conn(0x7f06e8072290 legacy=0x7f06e806ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.821+0000 7f06e6ffd640 1 -- 172.21.15.134:0/2307398226 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e806e200 con 0x7f06e8161cc0 2024-09-15T22:49:04.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.821+0000 7f06e6ffd640 1 --2- 172.21.15.134:0/2307398226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7044e873b7124a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06e5ffb640 1 -- 172.21.15.134:0/2307398226 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8036070 con 0x7f06e8161cc0 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06e5ffb640 1 -- 172.21.15.134:0/2307398226 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8031600 con 0x7f06e8161cc0 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06e5ffb640 1 -- 172.21.15.134:0/2307398226 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d80319d0 con 0x7f06e8161cc0 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 -- 172.21.15.134:0/2307398226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 msgr2=0x7f06e80aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 --2- 172.21.15.134:0/2307398226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802a710 comp rx=0 tx=0).stop 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 -- 172.21.15.134:0/2307398226 shutdown_connections 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 --2- 172.21.15.134:0/2307398226 >> v2:172.21.15.177:3300/0 conn(0x7f06e80b57d0 0x7f06e80b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 --2- 172.21.15.134:0/2307398226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e80aebf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 -- 172.21.15.134:0/2307398226 >> 172.21.15.134:0/2307398226 conn(0x7f06e806bba0 msgr2=0x7f06e806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 -- 172.21.15.134:0/2307398226 shutdown_connections 2024-09-15T22:49:04.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.822+0000 7f06ed615640 1 -- 172.21.15.134:0/2307398226 wait complete. 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 Processor -- start 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 -- start start 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06e8072290 0x7f06e8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e81507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80b4be0 con 0x7f06e80b57d0 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80b4a60 con 0x7f06e8072290 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06ed615640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f06e806f110 con 0x7f06e8161cc0 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06e67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06e67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37010/0 (socket says 172.21.15.134:37010) 2024-09-15T22:49:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06e67fc640 1 -- 172.21.15.134:0/1602859095 learned_addr learned my addr 172.21.15.134:0/1602859095 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.824+0000 7f06e6ffd640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06e8072290 0x7f06e8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e77fe640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e81507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 -- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 msgr2=0x7f06e81507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e81507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 -- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06e8072290 msgr2=0x7f06e8150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06e8072290 0x7f06e8150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 -- 172.21.15.134:0/1602859095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81515d0 con 0x7f06e80b57d0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06e67fc640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00e980 tx=0x7f06dc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc017070 con 0x7f06e80b57d0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc00ca00 con 0x7f06e80b57d0 2024-09-15T22:49:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81518b0 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00cdd0 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.825+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e8151e70 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.826+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8161340 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.827+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) ==== 91764+0+0 (secure 0 0 0) 0x7f06dc01a070 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.827+0000 7f06cf7fe640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 0x7f06d406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.827+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f06dc08a240 con 0x7f06e80b57d0 2024-09-15T22:49:04.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.827+0000 7f06e6ffd640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 0x7f06d406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:04.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.828+0000 7f06e6ffd640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 0x7f06d406f190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f06d8033000 tx=0x7f06d8009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:04.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:04.831+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06dc059bf0 con 0x7f06e80b57d0 2024-09-15T22:49:05.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.019+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp2240", "target": ["mon-mgr", ""]}) -- 0x7f06e8161060 con 0x7f06d406ccd0 2024-09-15T22:49:05.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.023+0000 7f06cf7fe640 1 -- 172.21.15.134:0/1602859095 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f06e8161060 con 0x7f06d406ccd0 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 msgr2=0x7f06d406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 0x7f06d406f190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f06d8033000 tx=0x7f06d8009000 comp rx=0 tx=0).stop 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 msgr2=0x7f06e80cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00e980 tx=0x7f06dc00ee40 comp rx=0 tx=0).stop 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 shutdown_connections 2024-09-15T22:49:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06e8161cc0 0x7f06e81507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06d406ccd0 0x7f06d406f190 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e80b57d0 0x7f06e80cf550 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 --2- 172.21.15.134:0/1602859095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06e8072290 0x7f06e8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 >> 172.21.15.134:0/1602859095 conn(0x7f06e806bba0 msgr2=0x7f06e8160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 shutdown_connections 2024-09-15T22:49:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.025+0000 7f06ed615640 1 -- 172.21.15.134:0/1602859095 wait complete. 2024-09-15T22:49:05.038 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:49:05.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:49:05.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:49:05.119 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:49:05.119 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:49:05.119 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:05.119 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:05.135 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:05.135 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:05.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:49:05.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.328+0000 7fe5a7a9b640 1 Processor -- start 2024-09-15T22:49:05.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.328+0000 7fe5a7a9b640 1 -- start start 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a7a9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a0156880 0x7fe5a00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a7a9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5a00b65c0 0x7fe5a0160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a7a9b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a00ce150 con 0x7fe5a00aff30 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a7a9b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a00ce430 con 0x7fe5a00b65c0 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a7a9b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a015ff30 con 0x7fe5a0156880 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a5036640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5a00b65c0 0x7fe5a0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a5036640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5a00b65c0 0x7fe5a0160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37026/0 (socket says 172.21.15.134:37026) 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.329+0000 7fe5a5036640 1 -- 172.21.15.134:0/3018975975 learned_addr learned my addr 172.21.15.134:0/3018975975 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5036640 1 -- 172.21.15.134:0/3018975975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a0156880 msgr2=0x7fe5a00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5837640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a0156880 0x7fe5a00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5036640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a0156880 0x7fe5a00cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5036640 1 -- 172.21.15.134:0/3018975975 >> v1:172.21.15.177:6789/0 conn(0x7fe5a00aff30 legacy=0x7fe5a015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:05.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5036640 1 -- 172.21.15.134:0/3018975975 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0160210 con 0x7fe5a00b65c0 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a5036640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0160730 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fe594009e50 tx=0x7fe59402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c8abd62ff1e08f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a4835640 1 -- 172.21.15.134:0/3018975975 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594036070 con 0x7fe5a00b65c0 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a4835640 1 -- 172.21.15.134:0/3018975975 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe594031600 con 0x7fe5a00b65c0 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.330+0000 7fe5a4835640 1 -- 172.21.15.134:0/3018975975 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940319d0 con 0x7fe5a00b65c0 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/3018975975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a00b65c0 msgr2=0x7fe5a0160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0160730 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fe594009e50 tx=0x7fe59402a630 comp rx=0 tx=0).stop 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/3018975975 shutdown_connections 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0160730 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/3018975975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a0156880 0x7fe5a00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/3018975975 >> 172.21.15.134:0/3018975975 conn(0x7fe5a006cae0 msgr2=0x7fe5a006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:05.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/3018975975 shutdown_connections 2024-09-15T22:49:05.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.331+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/3018975975 wait complete. 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.332+0000 7fe5a7a9b640 1 Processor -- start 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.332+0000 7fe5a7a9b640 1 -- start start 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a00aff30 0x7fe5a00aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0160c70 con 0x7fe5a0156880 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a00b6a00 con 0x7fe5a00b65c0 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a7a9b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a00ce710 con 0x7fe5a00aff30 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37034/0 (socket says 172.21.15.134:37034) 2024-09-15T22:49:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 -- 172.21.15.134:0/4294328051 learned_addr learned my addr 172.21.15.134:0/4294328051 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 -- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a00aff30 msgr2=0x7fe5a00aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a00aff30 0x7fe5a00aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 -- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5a00b65c0 msgr2=0x7fe5a0152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.333+0000 7fe5a6038640 1 -- 172.21.15.134:0/4294328051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0153360 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe5a6038640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe59800c410 tx=0x7fe59800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598011790 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe598017070 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598011b70 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a00aca30 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.334+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a00acff0 con 0x7fe5a0156880 2024-09-15T22:49:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.335+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a0160730 con 0x7fe5a0156880 2024-09-15T22:49:05.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.335+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) ==== 91764+0+0 (secure 0 0 0) 0x7fe598011d10 con 0x7fe5a0156880 2024-09-15T22:49:05.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.336+0000 7fe59e7fc640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 0x7fe58c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.336+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fe598089bb0 con 0x7fe5a0156880 2024-09-15T22:49:05.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.336+0000 7fe5a5837640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 0x7fe58c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.337+0000 7fe5a5837640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 0x7fe58c06f190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a810 tx=0x7fe590008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.340+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe598021020 con 0x7fe5a0156880 2024-09-15T22:49:05.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.515+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5a00aa780 con 0x7fe5a0156880 2024-09-15T22:49:05.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.515+0000 7fe59e7fc640 1 -- 172.21.15.134:0/4294328051 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v170) ==== 80+0+0 (secure 0 0 0) 0x7fe598059b10 con 0x7fe5a0156880 2024-09-15T22:49:05.517 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 msgr2=0x7fe58c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 0x7fe58c06f190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a810 tx=0x7fe590008040 comp rx=0 tx=0).stop 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 msgr2=0x7fe5a006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe59800c410 tx=0x7fe59800c8d0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 shutdown_connections 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fe58c06ccd0 0x7fe58c06f190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5a0156880 0x7fe5a006dac0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5a00b65c0 0x7fe5a0152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 --2- 172.21.15.134:0/4294328051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5a00aff30 0x7fe5a00aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 >> 172.21.15.134:0/4294328051 conn(0x7fe5a006cae0 msgr2=0x7fe5a006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:05.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 shutdown_connections 2024-09-15T22:49:05.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.517+0000 7fe5a7a9b640 1 -- 172.21.15.134:0/4294328051 wait complete. 2024-09-15T22:49:05.530 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:49:05.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:05.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:49:05.586 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:05.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:05.586 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:49:05.606 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:49:05.608 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:49:05.608 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:05.627 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:49:05.627 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:05.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:49:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 Processor -- start 2024-09-15T22:49:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 -- start start 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae7815e860 0x7fae780cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 0x7fae780b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780d34d0 con 0x7fae780b61f0 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fae780b6b80 con 0x7fae7815e860 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae7d3c0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fae780d3790 con 0x7fae780b8ab0 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.786+0000 7fae76ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae7815e860 0x7fae780cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae7815e860 0x7fae780cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37048/0 (socket says 172.21.15.134:37048) 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 -- 172.21.15.134:0/2391316926 learned_addr learned my addr 172.21.15.134:0/2391316926 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae777fe640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 0x7fae780b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 -- 172.21.15.134:0/2391316926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 msgr2=0x7fae780b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 0x7fae780b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 -- 172.21.15.134:0/2391316926 >> v1:172.21.15.177:6789/0 conn(0x7fae780b61f0 legacy=0x7fae7806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 -- 172.21.15.134:0/2391316926 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780d3a70 con 0x7fae7815e860 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae777fe640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 0x7fae780b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.787+0000 7fae76ffd640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae7815e860 0x7fae780cf720 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b0d570e05849b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae75ffb640 1 -- 172.21.15.134:0/2391316926 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68036070 con 0x7fae7815e860 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae75ffb640 1 -- 172.21.15.134:0/2391316926 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68031600 con 0x7fae7815e860 2024-09-15T22:49:05.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae75ffb640 1 -- 172.21.15.134:0/2391316926 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae680319d0 con 0x7fae7815e860 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2391316926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae7815e860 msgr2=0x7fae780cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae7815e860 0x7fae780cf720 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6802a7a0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2391316926 shutdown_connections 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae780b8ab0 0x7fae780b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2391316926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae7815e860 0x7fae780cf720 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2391316926 >> 172.21.15.134:0/2391316926 conn(0x7fae78062c60 msgr2=0x7fae780d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:05.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2391316926 shutdown_connections 2024-09-15T22:49:05.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.788+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2391316926 wait complete. 2024-09-15T22:49:05.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 Processor -- start 2024-09-15T22:49:05.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 -- start start 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae780b8ab0 0x7fae780b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae7815e860 0x7fae780b9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d4310 con 0x7fae780b61f0 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d4030 con 0x7fae780b8ab0 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae7d3c0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fae7815ec40 con 0x7fae7815e860 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae76ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.790+0000 7fae76ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37062/0 (socket says 172.21.15.134:37062) 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 -- 172.21.15.134:0/2830909893 learned_addr learned my addr 172.21.15.134:0/2830909893 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae767fc640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae780b8ab0 0x7fae780b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae777fe640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae7815e860 0x7fae780b9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 -- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae7815e860 msgr2=0x7fae780b9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae7815e860 0x7fae780b9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 -- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae780b8ab0 msgr2=0x7fae780b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae780b8ab0 0x7fae780b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 -- 172.21.15.134:0/2830909893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae781525e0 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae76ffd640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fae68009f70 tx=0x7fae68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68036050 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68042070 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae780c9490 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68009510 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.791+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae780c9a50 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.792+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae780b3ad0 con 0x7fae780b61f0 2024-09-15T22:49:05.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.793+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fae68007c50 con 0x7fae780b61f0 2024-09-15T22:49:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.793+0000 7fae5f7fe640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 0x7fae6406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.794+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fae680aa450 con 0x7fae780b61f0 2024-09-15T22:49:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.794+0000 7fae767fc640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 0x7fae6406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:05.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.794+0000 7fae767fc640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 0x7fae6406f2e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fae780c7df0 tx=0x7fae6c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:05.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.798+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae6804b020 con 0x7fae780b61f0 2024-09-15T22:49:05.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.978+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae780d2700 con 0x7fae780b61f0 2024-09-15T22:49:05.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.979+0000 7fae5f7fe640 1 -- 172.21.15.134:0/2830909893 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v170) ==== 80+0+0 (secure 0 0 0) 0x7fae6807a020 con 0x7fae780b61f0 2024-09-15T22:49:05.980 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 msgr2=0x7fae6406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 0x7fae6406f2e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fae780c7df0 tx=0x7fae6c009040 comp rx=0 tx=0).stop 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 msgr2=0x7fae781520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fae68009f70 tx=0x7fae68004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 shutdown_connections 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae7815e860 0x7fae780b9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae780b8ab0 0x7fae780b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fae6406ce20 0x7fae6406f2e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 --2- 172.21.15.134:0/2830909893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae780b61f0 0x7fae781520a0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 >> 172.21.15.134:0/2830909893 conn(0x7fae78062c60 msgr2=0x7fae78074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 shutdown_connections 2024-09-15T22:49:05.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:05.981+0000 7fae7d3c0640 1 -- 172.21.15.134:0/2830909893 wait complete. 2024-09-15T22:49:05.993 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:49:05.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:05.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-15T22:49:06.026 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:06.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:06.026 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:49:06.085 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:49:06.085 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:06.085 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:06.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:49:06.101 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:49:06.102 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:49:06.102 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:06.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:49:06.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:49:06.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 Processor -- start 2024-09-15T22:49:06.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 -- start start 2024-09-15T22:49:06.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcba415e940 0x7fcba40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcba415ed20 0x7fcba40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba40b7170 con 0x7fcba40cef90 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcba40d1ae0 con 0x7fcba415ed20 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.243+0000 7fcbaaced640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fcba40b7aa0 con 0x7fcba415e940 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcba415ed20 0x7fcba40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcba415ed20 0x7fcba40d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48478/0 (socket says 172.21.15.134:48478) 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 -- 172.21.15.134:0/495842579 learned_addr learned my addr 172.21.15.134:0/495842579 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba8a89640 1 --2- 172.21.15.134:0/495842579 >> v2:172.21.15.177:3300/0 conn(0x7fcba415e940 0x7fcba40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 -- 172.21.15.134:0/495842579 >> v2:172.21.15.177:3300/0 conn(0x7fcba415e940 msgr2=0x7fcba40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 --2- 172.21.15.134:0/495842579 >> v2:172.21.15.177:3300/0 conn(0x7fcba415e940 0x7fcba40d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 -- 172.21.15.134:0/495842579 >> v1:172.21.15.177:6789/0 conn(0x7fcba40cef90 legacy=0x7fcba40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.244+0000 7fcba3fff640 1 -- 172.21.15.134:0/495842579 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40d3660 con 0x7fcba415ed20 2024-09-15T22:49:06.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcba3fff640 1 --2- 172.21.15.134:0/495842579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415ed20 0x7fcba40d15a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fcba40509d0 tx=0x7fcb9802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38127691a803b905 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcba37fe640 1 -- 172.21.15.134:0/495842579 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98036070 con 0x7fcba415ed20 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcba37fe640 1 -- 172.21.15.134:0/495842579 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98031600 con 0x7fcba415ed20 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcba37fe640 1 -- 172.21.15.134:0/495842579 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb980319f0 con 0x7fcba415ed20 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 -- 172.21.15.134:0/495842579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415ed20 msgr2=0x7fcba40d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 --2- 172.21.15.134:0/495842579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415ed20 0x7fcba40d15a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fcba40509d0 tx=0x7fcb9802a7c0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 -- 172.21.15.134:0/495842579 shutdown_connections 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 --2- 172.21.15.134:0/495842579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415ed20 0x7fcba40d15a0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 --2- 172.21.15.134:0/495842579 >> v2:172.21.15.177:3300/0 conn(0x7fcba415e940 0x7fcba40d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 -- 172.21.15.134:0/495842579 >> 172.21.15.134:0/495842579 conn(0x7fcba40b6240 msgr2=0x7fcba40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:06.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 -- 172.21.15.134:0/495842579 shutdown_connections 2024-09-15T22:49:06.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.245+0000 7fcbaaced640 1 -- 172.21.15.134:0/495842579 wait complete. 2024-09-15T22:49:06.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 Processor -- start 2024-09-15T22:49:06.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 -- start start 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcba40cef90 0x7fcba414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 0x7fcba41f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40d3f00 con 0x7fcba415e940 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40d3c20 con 0x7fcba40cef90 2024-09-15T22:49:06.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.247+0000 7fcbaaced640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fcba40d3310 con 0x7fcba415ed20 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48494/0 (socket says 172.21.15.134:48494) 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 -- 172.21.15.134:0/1901134223 learned_addr learned my addr 172.21.15.134:0/1901134223 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba8a89640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcba40cef90 0x7fcba414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba928a640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 0x7fcba41f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 -- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 msgr2=0x7fcba41f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 0x7fcba41f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 -- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcba40cef90 msgr2=0x7fcba414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcba40cef90 0x7fcba414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 -- 172.21.15.134:0/1901134223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40cce10 con 0x7fcba415e940 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba928a640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 0x7fcba41f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba3fff640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fcb9802a800 tx=0x7fcb98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98036050 con 0x7fcba415e940 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98042070 con 0x7fcba415e940 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba40cd0f0 con 0x7fcba415e940 2024-09-15T22:49:06.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98009510 con 0x7fcba415e940 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.248+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba40cdaa0 con 0x7fcba415e940 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.249+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba40cd2c0 con 0x7fcba415e940 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.250+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fcb98004490 con 0x7fcba415e940 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.250+0000 7fcba17fa640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 0x7fcb9006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.250+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fcb980aabb0 con 0x7fcba415e940 2024-09-15T22:49:06.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.250+0000 7fcba8a89640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 0x7fcb9006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.251+0000 7fcba8a89640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 0x7fcb9006f2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009b40 tx=0x7fcb94009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.254+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb9807add0 con 0x7fcba415e940 2024-09-15T22:49:06.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.456+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcba40d1ef0 con 0x7fcba415e940 2024-09-15T22:49:06.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.456+0000 7fcba17fa640 1 -- 172.21.15.134:0/1901134223 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fcb9807a6d0 con 0x7fcba415e940 2024-09-15T22:49:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:06.458 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":90,"btime":"2024-09-15T22:49:00:700098+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:49:06.458 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 90 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 msgr2=0x7fcb9006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 0x7fcb9006f2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009b40 tx=0x7fcb94009190 comp rx=0 tx=0).stop 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 msgr2=0x7fcba415b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fcb9802a800 tx=0x7fcb98004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 shutdown_connections 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcba415ed20 0x7fcba41f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fcb9006cdf0 0x7fcb9006f2b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba415e940 0x7fcba415b3a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 --2- 172.21.15.134:0/1901134223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcba40cef90 0x7fcba414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.458+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 >> 172.21.15.134:0/1901134223 conn(0x7fcba40b6240 msgr2=0x7fcba40b9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:06.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.459+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 shutdown_connections 2024-09-15T22:49:06.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.459+0000 7fcbaaced640 1 -- 172.21.15.134:0/1901134223 wait complete. 2024-09-15T22:49:06.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:49:06.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 Processor -- start 2024-09-15T22:49:06.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 -- start start 2024-09-15T22:49:06.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd9480d02a0 0x7fd9480d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9480d0bc0 con 0x7fd94815ceb0 2024-09-15T22:49:06.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94815d390 con 0x7fd94815ca40 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.567+0000 7fd94e69b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd94815d670 con 0x7fd9480d02a0 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd94cc38640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd94815ceb0 0x7fd9481594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57792/0 (socket says 172.21.15.134:57792) 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd94cc38640 1 -- 172.21.15.134:0/2255928595 learned_addr learned my addr 172.21.15.134:0/2255928595 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd947fff640 1 --2- 172.21.15.134:0/2255928595 >> v2:172.21.15.177:3300/0 conn(0x7fd9480d02a0 0x7fd9480d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707145571 0 0) 0x7fd9480d0bc0 con 0x7fd94815ceb0 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd934003520 con 0x7fd94815ceb0 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 924666622 0 0) 0x7fd934003520 con 0x7fd94815ceb0 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd947fff640 1 -- 172.21.15.134:0/2255928595 >> v1:172.21.15.177:6789/0 conn(0x7fd94815ca40 legacy=0x7fd94815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd947fff640 1 -- 172.21.15.134:0/2255928595 >> v1:172.21.15.134:6789/0 conn(0x7fd94815ceb0 legacy=0x7fd9481594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.568+0000 7fd947fff640 1 -- 172.21.15.134:0/2255928595 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94815d950 con 0x7fd9480d02a0 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.569+0000 7fd947fff640 1 --2- 172.21.15.134:0/2255928595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9480d02a0 0x7fd9480d0680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097a0 tx=0x7fd93802a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39ccaa8a70993a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.569+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938037070 con 0x7fd9480d02a0 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.569+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93802aad0 con 0x7fd9480d02a0 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.569+0000 7fd946ffd640 1 -- 172.21.15.134:0/2255928595 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400019f0 con 0x7fd9480d02a0 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 -- 172.21.15.134:0/2255928595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9480d02a0 msgr2=0x7fd9480d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2255928595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9480d02a0 0x7fd9480d0680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097a0 tx=0x7fd93802a040 comp rx=0 tx=0).stop 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 -- 172.21.15.134:0/2255928595 shutdown_connections 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2255928595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9480d02a0 0x7fd9480d0680 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 -- 172.21.15.134:0/2255928595 >> 172.21.15.134:0/2255928595 conn(0x7fd948062cc0 msgr2=0x7fd94806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 -- 172.21.15.134:0/2255928595 shutdown_connections 2024-09-15T22:49:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.570+0000 7fd94e69b640 1 -- 172.21.15.134:0/2255928595 wait complete. 2024-09-15T22:49:06.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.571+0000 7fd94e69b640 1 Processor -- start 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.571+0000 7fd94e69b640 1 -- start start 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 0x7fd948071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94815ceb0 0x7fd948146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd94815eb40 con 0x7fd94815ca40 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd94815df10 con 0x7fd94815ceb0 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94e69b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd948155b90 con 0x7fd9480d02a0 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48504/0 (socket says 172.21.15.134:48504) 2024-09-15T22:49:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 -- 172.21.15.134:0/2830191040 learned_addr learned my addr 172.21.15.134:0/2830191040 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd94cc38640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94815ceb0 0x7fd948146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd947fff640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 0x7fd948071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 -- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 msgr2=0x7fd948071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 0x7fd948071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 -- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94815ceb0 msgr2=0x7fd948146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94815ceb0 0x7fd948146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 -- 172.21.15.134:0/2830191040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd948147330 con 0x7fd94815ca40 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd947fff640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 0x7fd948071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd9477fe640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fd93000c750 tx=0x7fd93000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930017070 con 0x7fd94815ca40 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.572+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd930005270 con 0x7fd94815ca40 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.573+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9480721b0 con 0x7fd94815ca40 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.573+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93000a640 con 0x7fd94815ca40 2024-09-15T22:49:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.573+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd948155f80 con 0x7fd94815ca40 2024-09-15T22:49:06.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.574+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9481578e0 con 0x7fd94815ca40 2024-09-15T22:49:06.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.574+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fd93001a070 con 0x7fd94815ca40 2024-09-15T22:49:06.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.575+0000 7fd944ff9640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 0x7fd92806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.575+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fd930089410 con 0x7fd94815ca40 2024-09-15T22:49:06.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.575+0000 7fd947fff640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 0x7fd92806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.575+0000 7fd947fff640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 0x7fd92806f2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd938034000 tx=0x7fd93802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.579+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd930058d90 con 0x7fd94815ca40 2024-09-15T22:49:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.782+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9480b4790 con 0x7fd94815ca40 2024-09-15T22:49:06.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.783+0000 7fd944ff9640 1 -- 172.21.15.134:0/2830191040 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fd93005d090 con 0x7fd94815ca40 2024-09-15T22:49:06.784 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:06.784 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":90,"btime":"2024-09-15T22:49:00:700098+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:49:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 90 2024-09-15T22:49:06.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 msgr2=0x7fd92806f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 0x7fd92806f2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd938034000 tx=0x7fd93802e000 comp rx=0 tx=0).stop 2024-09-15T22:49:06.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 msgr2=0x7fd948158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fd93000c750 tx=0x7fd93000cc10 comp rx=0 tx=0).stop 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 shutdown_connections 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94815ceb0 0x7fd948146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd92806ce20 0x7fd92806f2e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd94815ca40 0x7fd948158b50 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 --2- 172.21.15.134:0/2830191040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9480d02a0 0x7fd948071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 >> 172.21.15.134:0/2830191040 conn(0x7fd948062cc0 msgr2=0x7fd94815a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 shutdown_connections 2024-09-15T22:49:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.785+0000 7fd94e69b640 1 -- 172.21.15.134:0/2830191040 wait complete. 2024-09-15T22:49:06.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:49:06.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.895+0000 7fdf64e5e640 1 Processor -- start 2024-09-15T22:49:06.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.895+0000 7fdf64e5e640 1 -- start start 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf64e5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 0x7fdf600b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf64e5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf600b56d0 0x7fdf600b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf64e5e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf6015c9c0 con 0x7fdf6015c5e0 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf64e5e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdf60074100 con 0x7fdf600b56d0 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf64e5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf600b76d0 con 0x7fdf600b6d50 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf600b56d0 0x7fdf600b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5e59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdf6015c5e0 0x7fdf600712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57804/0 (socket says 172.21.15.134:57804) 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5e59c640 1 -- 172.21.15.134:0/4167023396 learned_addr learned my addr 172.21.15.134:0/4167023396 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf55d9b640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 0x7fdf600b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5ed9d640 1 -- 172.21.15.134:0/4167023396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 msgr2=0x7fdf600b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5ed9d640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 0x7fdf600b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5dd9b640 1 -- 172.21.15.134:0/4167023396 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679481588 0 0) 0x7fdf6015c9c0 con 0x7fdf6015c5e0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5ed9d640 1 -- 172.21.15.134:0/4167023396 >> v1:172.21.15.134:6789/0 conn(0x7fdf6015c5e0 legacy=0x7fdf600712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf5ed9d640 1 -- 172.21.15.134:0/4167023396 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600b1dd0 con 0x7fdf600b56d0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.896+0000 7fdf55d9b640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 0x7fdf600b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.897+0000 7fdf5ed9d640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b56d0 0x7fdf600b5b80 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdf580097a0 tx=0x7fdf5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c6ea7de9800587 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.897+0000 7fdf5dd9b640 1 -- 172.21.15.134:0/4167023396 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58037070 con 0x7fdf600b56d0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.897+0000 7fdf5dd9b640 1 -- 172.21.15.134:0/4167023396 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf58032440 con 0x7fdf600b56d0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.897+0000 7fdf5dd9b640 1 -- 172.21.15.134:0/4167023396 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58032810 con 0x7fdf600b56d0 2024-09-15T22:49:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 -- 172.21.15.134:0/4167023396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b56d0 msgr2=0x7fdf600b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b56d0 0x7fdf600b5b80 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdf580097a0 tx=0x7fdf5802a180 comp rx=0 tx=0).stop 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 -- 172.21.15.134:0/4167023396 shutdown_connections 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b56d0 0x7fdf600b5b80 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/4167023396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b6d50 0x7fdf600b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 -- 172.21.15.134:0/4167023396 >> 172.21.15.134:0/4167023396 conn(0x7fdf600b4220 msgr2=0x7fdf600b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 -- 172.21.15.134:0/4167023396 shutdown_connections 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.898+0000 7fdf64e5e640 1 -- 172.21.15.134:0/4167023396 wait complete. 2024-09-15T22:49:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.899+0000 7fdf64e5e640 1 Processor -- start 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.899+0000 7fdf64e5e640 1 -- start start 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b56d0 0x7fdf601492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6015c5e0 0x7fdf6015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60073ab0 con 0x7fdf600b6d50 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf600737d0 con 0x7fdf6015c5e0 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf64e5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf60073d90 con 0x7fdf600b56d0 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf55d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf55d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48530/0 (socket says 172.21.15.134:48530) 2024-09-15T22:49:06.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf55d9b640 1 -- 172.21.15.134:0/944000052 learned_addr learned my addr 172.21.15.134:0/944000052 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf5e59c640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b56d0 0x7fdf601492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.900+0000 7fdf5ed9d640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6015c5e0 0x7fdf6015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 -- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b56d0 msgr2=0x7fdf601492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b56d0 0x7fdf601492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 -- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6015c5e0 msgr2=0x7fdf6015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6015c5e0 0x7fdf6015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 -- 172.21.15.134:0/944000052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601534d0 con 0x7fdf600b6d50 2024-09-15T22:49:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf55d9b640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c7f0 tx=0x7fdf4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48004230 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf480043d0 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf601537b0 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48007a10 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.901+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf60158ad0 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.902+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60073130 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.902+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fdf48007bb0 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.903+0000 7fdf577fe640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 0x7fdf4006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.903+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fdf48089f00 con 0x7fdf600b6d50 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.903+0000 7fdf5e59c640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 0x7fdf4006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.904+0000 7fdf5e59c640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 0x7fdf4006f2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf500012e0 tx=0x7fdf50001700 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:06.907+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf48015020 con 0x7fdf600b6d50 2024-09-15T22:49:07.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.074+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf60071a60 con 0x7fdf600b6d50 2024-09-15T22:49:07.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.075+0000 7fdf577fe640 1 -- 172.21.15.134:0/944000052 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16800 (secure 0 0 0) 0x7fdf48059880 con 0x7fdf600b6d50 2024-09-15T22:49:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:07.077 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":170,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:49.663680+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:46.326071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:46.958921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 msgr2=0x7fdf4006f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 0x7fdf4006f2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf500012e0 tx=0x7fdf50001700 comp rx=0 tx=0).stop 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 msgr2=0x7fdf60152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c7f0 tx=0x7fdf4800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 shutdown_connections 2024-09-15T22:49:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6015c5e0 0x7fdf6015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf4006ce20 0x7fdf4006f2e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf600b6d50 0x7fdf60152a80 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 --2- 172.21.15.134:0/944000052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf600b56d0 0x7fdf601492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 >> 172.21.15.134:0/944000052 conn(0x7fdf600b4220 msgr2=0x7fdf60071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 shutdown_connections 2024-09-15T22:49:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.077+0000 7fdf64e5e640 1 -- 172.21.15.134:0/944000052 wait complete. 2024-09-15T22:49:07.090 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:49:07.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:49:07.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.192+0000 7fa617a53640 1 Processor -- start 2024-09-15T22:49:07.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.192+0000 7fa617a53640 1 -- start start 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa617a53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa610162860 0x7fa610162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa617a53640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61015f520 con 0x7fa61015f020 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa617a53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61015f800 con 0x7fa61015ebb0 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa617a53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa61015fae0 con 0x7fa610162860 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa615ff0640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa61015f020 0x7fa61006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57820/0 (socket says 172.21.15.134:57820) 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa615ff0640 1 -- 172.21.15.134:0/3607905570 learned_addr learned my addr 172.21.15.134:0/3607905570 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa6157ef640 1 --2- 172.21.15.134:0/3607905570 >> v2:172.21.15.177:3300/0 conn(0x7fa610162860 0x7fa610162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987068115 0 0) 0x7fa61015f520 con 0x7fa61015f020 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.193+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5fc003520 con 0x7fa61015f020 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1413194193 0 0) 0x7fa5fc003520 con 0x7fa61015f020 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 >> v2:172.21.15.177:3300/0 conn(0x7fa610162860 msgr2=0x7fa610162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 --2- 172.21.15.134:0/3607905570 >> v2:172.21.15.177:3300/0 conn(0x7fa610162860 0x7fa610162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 >> v1:172.21.15.177:6789/0 conn(0x7fa61015ebb0 legacy=0x7fa6100b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6100b2b00 con 0x7fa61015f020 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fa6080019f0 con 0x7fa61015f020 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 >> v1:172.21.15.134:6789/0 conn(0x7fa61015f020 legacy=0x7fa61006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa5fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5fc004800 0x7fa5fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5fc0051c0 0x7fa5fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa61015fae0 con 0x7fa5fc0039b0 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc00c160 con 0x7fa5fc004800 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc00c360 con 0x7fa5fc0051c0 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa5fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa614fee640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5fc004800 0x7fa5fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa615ff0640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5fc0051c0 0x7fa5fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 -- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5fc0051c0 msgr2=0x7fa5fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5fc0051c0 0x7fa5fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 -- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5fc004800 msgr2=0x7fa5fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5fc004800 0x7fa5fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa6157ef640 1 -- 172.21.15.134:0/3607905570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc003520 con 0x7fa5fc0039b0 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa615ff0640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5fc0051c0 0x7fa5fc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.194+0000 7fa615ff0640 1 -- 172.21.15.134:0/3607905570 reap_dead start 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa6157ef640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa5fc003dd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009ac0 tx=0x7fa5fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444a40093c3c6a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c036070 con 0x7fa5fc0039b0 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60c031400 con 0x7fa5fc0039b0 2024-09-15T22:49:07.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa607fff640 1 -- 172.21.15.134:0/3607905570 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c009690 con 0x7fa5fc0039b0 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa617a53640 1 -- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 msgr2=0x7fa5fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.195+0000 7fa617a53640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa5fc003dd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009ac0 tx=0x7fa5fc005830 comp rx=0 tx=0).stop 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.196+0000 7fa617a53640 1 -- 172.21.15.134:0/3607905570 shutdown_connections 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.196+0000 7fa617a53640 1 --2- 172.21.15.134:0/3607905570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa5fc003dd0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.196+0000 7fa617a53640 1 -- 172.21.15.134:0/3607905570 >> 172.21.15.134:0/3607905570 conn(0x7fa61006ce90 msgr2=0x7fa61006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.196+0000 7fa617a53640 1 -- 172.21.15.134:0/3607905570 shutdown_connections 2024-09-15T22:49:07.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.196+0000 7fa617a53640 1 -- 172.21.15.134:0/3607905570 wait complete. 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 Processor -- start 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 -- start start 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa61015dd90 0x7fa610157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa610157260 0x7fa610153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa610162dc0 con 0x7fa5fc0039b0 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa610162c40 con 0x7fa610157260 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.197+0000 7fa617a53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa610162f40 con 0x7fa61015dd90 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48538/0 (socket says 172.21.15.134:48538) 2024-09-15T22:49:07.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 -- 172.21.15.134:0/194627513 learned_addr learned my addr 172.21.15.134:0/194627513 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa614fee640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa61015dd90 0x7fa610157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa615ff0640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa610157260 0x7fa610153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 -- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa61015dd90 msgr2=0x7fa610157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa61015dd90 0x7fa610157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 -- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa610157260 msgr2=0x7fa610153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa610157260 0x7fa610153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 -- 172.21.15.134:0/194627513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa610157f80 con 0x7fa5fc0039b0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa6157ef640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009be0 tx=0x7fa60c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c03f020 con 0x7fa5fc0039b0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60c037040 con 0x7fa5fc0039b0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa610156780 con 0x7fa5fc0039b0 2024-09-15T22:49:07.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c036070 con 0x7fa5fc0039b0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.198+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa610156d40 con 0x7fa5fc0039b0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.199+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6100b3300 con 0x7fa5fc0039b0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.200+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fa60c042020 con 0x7fa5fc0039b0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.200+0000 7fa605ffb640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 0x7fa5f406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.201+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fa60c0a9d70 con 0x7fa5fc0039b0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.201+0000 7fa614fee640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 0x7fa5f406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.201+0000 7fa614fee640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 0x7fa5f406f2e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa600007fd0 tx=0x7fa600009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.205+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa60c049030 con 0x7fa5fc0039b0 2024-09-15T22:49:07.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.405+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6100b16c0 con 0x7fa5fc0039b0 2024-09-15T22:49:07.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.406+0000 7fa605ffb640 1 -- 172.21.15.134:0/194627513 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fa60c07a050 con 0x7fa5fc0039b0 2024-09-15T22:49:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:07.407 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":90,"btime":"2024-09-15T22:49:00:700098+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:49:07.408 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 90 2024-09-15T22:49:07.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 msgr2=0x7fa5f406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 0x7fa5f406f2e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa600007fd0 tx=0x7fa600009040 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 msgr2=0x7fa61014ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009be0 tx=0x7fa60c004730 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 shutdown_connections 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa610157260 0x7fa610153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa61015dd90 0x7fa610157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa5f406ce20 0x7fa5f406f2e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 --2- 172.21.15.134:0/194627513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5fc0039b0 0x7fa61014ad70 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 >> 172.21.15.134:0/194627513 conn(0x7fa61006ce90 msgr2=0x7fa6101610d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 shutdown_connections 2024-09-15T22:49:07.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.408+0000 7fa617a53640 1 -- 172.21.15.134:0/194627513 wait complete. 2024-09-15T22:49:07.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:49:07.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.518+0000 7fa28241e640 1 Processor -- start 2024-09-15T22:49:07.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.518+0000 7fa28241e640 1 -- start start 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa28241e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa27c0cf070 0x7fa27c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa28241e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c073120 0x7fa27c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa28241e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa27c0ce740 con 0x7fa27c15c180 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa28241e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa27c072640 con 0x7fa27c0cf070 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa28241e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c072920 con 0x7fa27c073120 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa27c0cf070 0x7fa27c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa27c0cf070 0x7fa27c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48540/0 (socket says 172.21.15.134:48540) 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1082421788 learned_addr learned my addr 172.21.15.134:0/1082421788 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa2809bb640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c073120 0x7fa27c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1082421788 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c073120 msgr2=0x7fa27c0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c073120 0x7fa27c0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.519+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1082421788 >> v1:172.21.15.177:6789/0 conn(0x7fa27c15c180 legacy=0x7fa27c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.520+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1082421788 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c072c00 con 0x7fa27c0cf070 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.520+0000 7fa27b7fe640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0cf4e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa270009870 tx=0x7fa27002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f65d3a8cec0645d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.520+0000 7fa27affd640 1 -- 172.21.15.134:0/1082421788 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270037070 con 0x7fa27c0cf070 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.520+0000 7fa27affd640 1 -- 172.21.15.134:0/1082421788 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa270032440 con 0x7fa27c0cf070 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.520+0000 7fa27affd640 1 -- 172.21.15.134:0/1082421788 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270032810 con 0x7fa27c0cf070 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 -- 172.21.15.134:0/1082421788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 msgr2=0x7fa27c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0cf4e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa270009870 tx=0x7fa27002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 -- 172.21.15.134:0/1082421788 shutdown_connections 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c073120 0x7fa27c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 --2- 172.21.15.134:0/1082421788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0cf4e0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 -- 172.21.15.134:0/1082421788 >> 172.21.15.134:0/1082421788 conn(0x7fa27c062cc0 msgr2=0x7fa27c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 -- 172.21.15.134:0/1082421788 shutdown_connections 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.521+0000 7fa28241e640 1 -- 172.21.15.134:0/1082421788 wait complete. 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.522+0000 7fa28241e640 1 Processor -- start 2024-09-15T22:49:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.522+0000 7fa28241e640 1 -- start start 2024-09-15T22:49:07.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 0x7fa27c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c15c180 0x7fa27c1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0722f0 con 0x7fa27c0cf070 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0ced00 con 0x7fa27c073120 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa28241e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c15c560 con 0x7fa27c15c180 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48546/0 (socket says 172.21.15.134:48546) 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 -- 172.21.15.134:0/631767021 learned_addr learned my addr 172.21.15.134:0/631767021 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27bfff640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 0x7fa27c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa2809bb640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c15c180 0x7fa27c1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 -- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c15c180 msgr2=0x7fa27c1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c15c180 0x7fa27c1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 -- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 msgr2=0x7fa27c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 0x7fa27c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 -- 172.21.15.134:0/631767021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c0b0e90 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27bfff640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 0x7fa27c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.523+0000 7fa27b7fe640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c00 tx=0x7fa2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.524+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270041020 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.524+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2700306c0 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.524+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c0b1170 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.524+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270037040 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.524+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c0b1730 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.525+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c0cf4e0 con 0x7fa27c0cf070 2024-09-15T22:49:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.525+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fa270044020 con 0x7fa27c0cf070 2024-09-15T22:49:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.526+0000 7fa278ff9640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 0x7fa26806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.526+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7fa2700aa5c0 con 0x7fa27c0cf070 2024-09-15T22:49:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.526+0000 7fa27bfff640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 0x7fa26806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.526+0000 7fa27bfff640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 0x7fa26806f2b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007fd0 tx=0x7fa26c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.530+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa27004b030 con 0x7fa27c0cf070 2024-09-15T22:49:07.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.728+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa27c1575e0 con 0x7fa27c0cf070 2024-09-15T22:49:07.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.729+0000 7fa278ff9640 1 -- 172.21.15.134:0/631767021 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fa27007a7e0 con 0x7fa27c0cf070 2024-09-15T22:49:07.732 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:07.732 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":90,"btime":"2024-09-15T22:49:00:700098+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:48:47.994889+0000","modified":"2024-09-15T22:48:49.998225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/23140858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":23140858},{"type":"v1","addr":"172.21.15.134:6835","nonce":23140858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9036,"qdb_cluster":[9036]},"id":13}]} 2024-09-15T22:49:07.733 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 90 2024-09-15T22:49:07.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 msgr2=0x7fa26806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 0x7fa26806f2b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007fd0 tx=0x7fa26c009040 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 msgr2=0x7fa27c0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c00 tx=0x7fa2700046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 shutdown_connections 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa27c15c180 0x7fa27c1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa26806cdf0 0x7fa26806f2b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa27c0cf070 0x7fa27c0aa4d0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 --2- 172.21.15.134:0/631767021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa27c073120 0x7fa27c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 >> 172.21.15.134:0/631767021 conn(0x7fa27c062cc0 msgr2=0x7fa27c159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 shutdown_connections 2024-09-15T22:49:07.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.731+0000 7fa28241e640 1 -- 172.21.15.134:0/631767021 wait complete. 2024-09-15T22:49:07.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:49:07.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.842+0000 7f193b8b7640 1 Processor -- start 2024-09-15T22:49:07.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.842+0000 7f193b8b7640 1 -- start start 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 0x7f19340cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193406c1f0 0x7f193415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1934151540 0x7f19341519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1934151f10 con 0x7f193406c1f0 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f19340cd5f0 con 0x7f1934151540 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f193b8b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19340cd8d0 con 0x7f193406be10 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f1938e52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193406c1f0 0x7f193415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f1938e52640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f193406c1f0 0x7f193415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48562/0 (socket says 172.21.15.134:48562) 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f1938e52640 1 -- 172.21.15.134:0/2948113367 learned_addr learned my addr 172.21.15.134:0/2948113367 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f1939e54640 1 --2- 172.21.15.134:0/2948113367 >> v2:172.21.15.177:3300/0 conn(0x7f1934151540 0x7f19341519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.843+0000 7f1939653640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 0x7f19340cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 -- 172.21.15.134:0/2948113367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 msgr2=0x7f19340cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 0x7f19340cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 -- 172.21.15.134:0/2948113367 >> v2:172.21.15.177:3300/0 conn(0x7f1934151540 msgr2=0x7f19341519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 --2- 172.21.15.134:0/2948113367 >> v2:172.21.15.177:3300/0 conn(0x7f1934151540 0x7f19341519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 -- 172.21.15.134:0/2948113367 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340cdbb0 con 0x7f193406c1f0 2024-09-15T22:49:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1939653640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 0x7f19340cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f1938e52640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f193415baa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f19340cf9a0 tx=0x7f192402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe4646257653767 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f192bfff640 1 -- 172.21.15.134:0/2948113367 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924037070 con 0x7f193406c1f0 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f192bfff640 1 -- 172.21.15.134:0/2948113367 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1924032440 con 0x7f193406c1f0 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.844+0000 7f192bfff640 1 -- 172.21.15.134:0/2948113367 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924032810 con 0x7f193406c1f0 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 -- 172.21.15.134:0/2948113367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 msgr2=0x7f193415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f193415baa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f19340cf9a0 tx=0x7f192402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 -- 172.21.15.134:0/2948113367 shutdown_connections 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 --2- 172.21.15.134:0/2948113367 >> v2:172.21.15.177:3300/0 conn(0x7f1934151540 0x7f19341519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f193415baa0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 --2- 172.21.15.134:0/2948113367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f193406be10 0x7f19340cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 -- 172.21.15.134:0/2948113367 >> 172.21.15.134:0/2948113367 conn(0x7f1934062cc0 msgr2=0x7f193406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 -- 172.21.15.134:0/2948113367 shutdown_connections 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.845+0000 7f193b8b7640 1 -- 172.21.15.134:0/2948113367 wait complete. 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.846+0000 7f193b8b7640 1 Processor -- start 2024-09-15T22:49:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.846+0000 7f193b8b7640 1 -- start start 2024-09-15T22:49:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 0x7f19340aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 0x7f1934071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19340ce690 con 0x7f193406c1f0 2024-09-15T22:49:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19340ce170 con 0x7f193406be10 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f193b8b7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f19340d0310 con 0x7f1934151540 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48570/0 (socket says 172.21.15.134:48570) 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 -- 172.21.15.134:0/537476470 learned_addr learned my addr 172.21.15.134:0/537476470 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1939e54640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 0x7f1934071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1939653640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 0x7f19340aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 -- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 msgr2=0x7f1934071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 0x7f1934071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 -- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 msgr2=0x7f19340aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 0x7f19340aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1938e52640 1 -- 172.21.15.134:0/537476470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341556f0 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1939e54640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 0x7f1934071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.847+0000 7f1939653640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 0x7f19340aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f1938e52640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f192402a220 tx=0x7f19240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924041020 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19240306c0 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341559d0 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924037040 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.848+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19340715c0 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.849+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19340d06e0 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.849+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f1924044020 con 0x7f193406c1f0 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.850+0000 7f1929ffb640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 0x7f191806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:07.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.850+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f19240aa580 con 0x7f193406c1f0 2024-09-15T22:49:07.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.850+0000 7f1939653640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 0x7f191806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.851+0000 7f1939653640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 0x7f191806f2e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f192c006b10 tx=0x7f192c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:07.854+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f192404b030 con 0x7f193406c1f0 2024-09-15T22:49:08.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.019+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f193415b600 con 0x7f193406c1f0 2024-09-15T22:49:08.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.020+0000 7f1929ffb640 1 -- 172.21.15.134:0/537476470 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16800 (secure 0 0 0) 0x7f192407a7a0 con 0x7f193406c1f0 2024-09-15T22:49:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:08.022 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":170,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:48:49.663680+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:48:46.326071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T22:48:46.958921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 msgr2=0x7f191806f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 0x7f191806f2e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f192c006b10 tx=0x7f192c008040 comp rx=0 tx=0).stop 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 msgr2=0x7f1934072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f192402a220 tx=0x7f19240046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 shutdown_connections 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1934151540 0x7f1934071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f191806ce20 0x7f191806f2e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f193406c1f0 0x7f1934072c90 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 --2- 172.21.15.134:0/537476470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f193406be10 0x7f19340aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.022+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 >> 172.21.15.134:0/537476470 conn(0x7f1934062cc0 msgr2=0x7f19340b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.023+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 shutdown_connections 2024-09-15T22:49:08.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.023+0000 7f193b8b7640 1 -- 172.21.15.134:0/537476470 wait complete. 2024-09-15T22:49:08.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:49:08.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.133+0000 7f6ab8111640 1 Processor -- start 2024-09-15T22:49:08.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 -- start start 2024-09-15T22:49:08.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 0x7f6ab00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 0x7f6ab00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab00b7170 con 0x7f6ab015ed20 2024-09-15T22:49:08.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab00d1ae0 con 0x7f6ab015e940 2024-09-15T22:49:08.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.134+0000 7f6ab8111640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab00b7aa0 con 0x7f6ab00cef90 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab56ac640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6ab015ed20 0x7f6ab00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57822/0 (socket says 172.21.15.134:57822) 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab56ac640 1 -- 172.21.15.134:0/2906449692 learned_addr learned my addr 172.21.15.134:0/2906449692 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab5ead640 1 --2- 172.21.15.134:0/2906449692 >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 0x7f6ab00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab66ae640 1 --2- 172.21.15.134:0/2906449692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 0x7f6ab00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab4eab640 1 -- 172.21.15.134:0/2906449692 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698756703 0 0) 0x7f6aa0001110 con 0x7f6ab015ed20 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab4eab640 1 -- 172.21.15.134:0/2906449692 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a9c003520 con 0x7f6ab015ed20 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab66ae640 1 -- 172.21.15.134:0/2906449692 >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 msgr2=0x7f6ab00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab66ae640 1 --2- 172.21.15.134:0/2906449692 >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 0x7f6ab00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab66ae640 1 -- 172.21.15.134:0/2906449692 >> v1:172.21.15.134:6789/0 conn(0x7f6ab015ed20 legacy=0x7f6ab00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab66ae640 1 -- 172.21.15.134:0/2906449692 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab00d3660 con 0x7f6ab00cef90 2024-09-15T22:49:08.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.135+0000 7f6ab5ead640 1 --2- 172.21.15.134:0/2906449692 >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 0x7f6ab00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab66ae640 1 --2- 172.21.15.134:0/2906449692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 0x7f6ab00d15a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009d90 tx=0x7f6aa802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611a98c72ddfaa5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab4eab640 1 -- 172.21.15.134:0/2906449692 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8007740 con 0x7f6ab00cef90 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab4eab640 1 -- 172.21.15.134:0/2906449692 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa80078e0 con 0x7f6ab00cef90 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab4eab640 1 -- 172.21.15.134:0/2906449692 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8007c90 con 0x7f6ab00cef90 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab8111640 1 -- 172.21.15.134:0/2906449692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 msgr2=0x7f6ab00d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.136+0000 7f6ab8111640 1 --2- 172.21.15.134:0/2906449692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 0x7f6ab00d15a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009d90 tx=0x7f6aa802a6f0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 -- 172.21.15.134:0/2906449692 shutdown_connections 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 --2- 172.21.15.134:0/2906449692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab00cef90 0x7f6ab00d15a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 --2- 172.21.15.134:0/2906449692 >> v2:172.21.15.177:3300/0 conn(0x7f6ab015e940 0x7f6ab00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 -- 172.21.15.134:0/2906449692 >> 172.21.15.134:0/2906449692 conn(0x7f6ab00b6240 msgr2=0x7f6ab00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:08.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 -- 172.21.15.134:0/2906449692 shutdown_connections 2024-09-15T22:49:08.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.137+0000 7f6ab8111640 1 -- 172.21.15.134:0/2906449692 wait complete. 2024-09-15T22:49:08.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.138+0000 7f6ab8111640 1 Processor -- start 2024-09-15T22:49:08.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.138+0000 7f6ab8111640 1 -- start start 2024-09-15T22:49:08.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab00cef90 0x7f6ab01f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab015ed20 0x7f6ab01f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00d3f00 con 0x7f6ab015e940 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00d3c20 con 0x7f6ab00cef90 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab00d3310 con 0x7f6ab015ed20 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48572/0 (socket says 172.21.15.134:48572) 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 -- 172.21.15.134:0/1456161061 learned_addr learned my addr 172.21.15.134:0/1456161061 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab5ead640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab00cef90 0x7f6ab01f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab66ae640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab015ed20 0x7f6ab01f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 -- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab015ed20 msgr2=0x7f6ab01f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab015ed20 0x7f6ab01f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 -- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab00cef90 msgr2=0x7f6ab01f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab00cef90 0x7f6ab01f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 -- 172.21.15.134:0/1456161061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab0159e00 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab56ac640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c730 tx=0x7f6aa000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0017070 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005ab0 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab015a0e0 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0007070 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.139+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab015a6a0 con 0x7f6ab015e940 2024-09-15T22:49:08.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.140+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab00d1ef0 con 0x7f6ab015e940 2024-09-15T22:49:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.141+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f6aa001a070 con 0x7f6ab015e940 2024-09-15T22:49:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.141+0000 7f6aa67fc640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 0x7f6a9406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.141+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5765+0+0 (secure 0 0 0) 0x7f6aa0089300 con 0x7f6ab015e940 2024-09-15T22:49:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.142+0000 7f6ab5ead640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 0x7f6a9406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.142+0000 7f6ab5ead640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 0x7f6a9406f2b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009560 tx=0x7f6aac009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.146+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab00b7170 con 0x7f6ab015e940 2024-09-15T22:49:08.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.345+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ab00b9dc0 con 0x7f6ab015e940 2024-09-15T22:49:08.347 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-15T22:49:08.346+0000 7f58aa495640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:49:08.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.347+0000 7f6aa67fc640 1 -- 172.21.15.134:0/1456161061 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) ==== 161+0+0 (secure 0 0 0) 0x7f6aa0058c80 con 0x7f6ab015e940 2024-09-15T22:49:08.348 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 msgr2=0x7f6a9406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 0x7f6a9406f2b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009560 tx=0x7f6aac009190 comp rx=0 tx=0).stop 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 msgr2=0x7f6ab0159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c730 tx=0x7f6aa000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 shutdown_connections 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab015ed20 0x7f6ab01f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f6a9406cdf0 0x7f6a9406f2b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab015e940 0x7f6ab0159540 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.349+0000 7f6ab8111640 1 --2- 172.21.15.134:0/1456161061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab00cef90 0x7f6ab01f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.350+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 >> 172.21.15.134:0/1456161061 conn(0x7f6ab00b6240 msgr2=0x7f6ab015f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:08.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.350+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 shutdown_connections 2024-09-15T22:49:08.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.350+0000 7f6ab8111640 1 -- 172.21.15.134:0/1456161061 wait complete. 2024-09-15T22:49:08.364 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:49:08.389 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-09-15T22:49:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.463+0000 7f95bc598640 1 Processor -- start 2024-09-15T22:49:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.463+0000 7f95bc598640 1 -- start start 2024-09-15T22:49:08.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bc598640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95b4161cc0 0x7f95b40aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bc598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 0x7f95b40b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bc598640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b406dc40 con 0x7f95b4072290 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bc598640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f95b406e570 con 0x7f95b4161cc0 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bc598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f95b406df20 con 0x7f95b40b57d0 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95b4161cc0 0x7f95b40aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bab35640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f95b4072290 0x7f95b406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57846/0 (socket says 172.21.15.134:57846) 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95b4161cc0 0x7f95b40aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48598/0 (socket says 172.21.15.134:48598) 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95bab35640 1 -- 172.21.15.134:0/3126394612 learned_addr learned my addr 172.21.15.134:0/3126394612 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95b9b33640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 0x7f95b40b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 -- 172.21.15.134:0/3126394612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 msgr2=0x7f95b40b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:08.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 0x7f95b40b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 -- 172.21.15.134:0/3126394612 >> v1:172.21.15.134:6789/0 conn(0x7f95b4072290 legacy=0x7f95b406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95b9332640 1 -- 172.21.15.134:0/3126394612 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250591575 0 0) 0x7f95b406dc40 con 0x7f95b4072290 2024-09-15T22:49:08.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95ba334640 1 -- 172.21.15.134:0/3126394612 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b406e200 con 0x7f95b4161cc0 2024-09-15T22:49:08.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.464+0000 7f95b9b33640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 0x7f95b40b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:08.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95ba334640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b4161cc0 0x7f95b40aebf0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097a0 tx=0x7f95b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3215996987c00bab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95b9332640 1 -- 172.21.15.134:0/3126394612 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0037070 con 0x7f95b4161cc0 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95b9332640 1 -- 172.21.15.134:0/3126394612 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b0032440 con 0x7f95b4161cc0 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95b9332640 1 -- 172.21.15.134:0/3126394612 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0032810 con 0x7f95b4161cc0 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95bc598640 1 -- 172.21.15.134:0/3126394612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b4161cc0 msgr2=0x7f95b40aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.465+0000 7f95bc598640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b4161cc0 0x7f95b40aebf0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097a0 tx=0x7f95b002a180 comp rx=0 tx=0).stop 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 -- 172.21.15.134:0/3126394612 shutdown_connections 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b40b57d0 0x7f95b40b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 --2- 172.21.15.134:0/3126394612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b4161cc0 0x7f95b40aebf0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 -- 172.21.15.134:0/3126394612 >> 172.21.15.134:0/3126394612 conn(0x7f95b406bba0 msgr2=0x7f95b406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 -- 172.21.15.134:0/3126394612 shutdown_connections 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.466+0000 7f95bc598640 1 -- 172.21.15.134:0/3126394612 wait complete. 2024-09-15T22:49:08.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.467+0000 7f95bc598640 1 Processor -- start 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.467+0000 7f95bc598640 1 -- start start 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.467+0000 7f95bc598640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95b4072290 0x7f95b40cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 0x7f95b40af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40b4be0 con 0x7f95b40b57d0 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40b4a60 con 0x7f95b4072290 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f95b406f110 con 0x7f95b4161cc0 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48614/0 (socket says 172.21.15.134:48614) 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 -- 172.21.15.134:0/1760590073 learned_addr learned my addr 172.21.15.134:0/1760590073 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95ba334640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95b4072290 0x7f95b40cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bab35640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 0x7f95b40af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 -- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 msgr2=0x7f95b40af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 0x7f95b40af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 -- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95b4072290 msgr2=0x7f95b40cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95b4072290 0x7f95b40cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 -- 172.21.15.134:0/1760590073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b4148610 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bab35640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 0x7f95b40af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95b9b33640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e7e0 tx=0x7f95a400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4017070 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a400c670 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b40cfec0 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a400f040 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.468+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b40ceea0 con 0x7f95b40b57d0 2024-09-15T22:49:08.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.469+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b406c630 con 0x7f95b40b57d0 2024-09-15T22:49:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.470+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f95a401a070 con 0x7f95b40b57d0 2024-09-15T22:49:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.470+0000 7f95aaffd640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 0x7f959806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.470+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5851+0+0 (secure 0 0 0) 0x7f95a4089d80 con 0x7f95b40b57d0 2024-09-15T22:49:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.470+0000 7f95ba334640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 0x7f959806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:08.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.471+0000 7f95ba334640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 0x7f959806f2e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f95b0034000 tx=0x7f95b002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:08.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.474+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95b4148610 con 0x7f95b40b57d0 2024-09-15T22:49:08.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:08.675+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f95b4075840 con 0x7f95b40b57d0 2024-09-15T22:49:09.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.348+0000 7f95aaffd640 1 -- 172.21.15.134:0/1760590073 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) ==== 104+0+0 (secure 0 0 0) 0x7f95a4059700 con 0x7f95b40b57d0 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 msgr2=0x7f959806f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 0x7f959806f2e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f95b0034000 tx=0x7f95b002e000 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 msgr2=0x7f95b4144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e7e0 tx=0x7f95a400eca0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 shutdown_connections 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95b4161cc0 0x7f95b40af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f959806ce20 0x7f959806f2e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b40b57d0 0x7f95b4144e40 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 --2- 172.21.15.134:0/1760590073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95b4072290 0x7f95b40cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 >> 172.21.15.134:0/1760590073 conn(0x7f95b406bba0 msgr2=0x7f95b415fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 shutdown_connections 2024-09-15T22:49:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.351+0000 7f95bc598640 1 -- 172.21.15.134:0/1760590073 wait complete. 2024-09-15T22:49:09.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:49:09.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.510+0000 7f5127a5e640 1 Processor -- start 2024-09-15T22:49:09.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.510+0000 7f5127a5e640 1 -- start start 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5127a5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f512015f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5127a5e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51200af050 con 0x7f51200ae8e0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5127a5e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51200af330 con 0x7f51201554d0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5127a5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f51200af610 con 0x7f51200b5630 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5125ffb640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f51200ae8e0 0x7f5120072a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57862/0 (socket says 172.21.15.134:57862) 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5125ffb640 1 -- 172.21.15.134:0/3816856158 learned_addr learned my addr 172.21.15.134:0/3816856158 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292077656 0 0) 0x7f51200af050 con 0x7f51200ae8e0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5124ff9640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f512015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f510c003520 con 0x7f51200ae8e0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3193498048 0 0) 0x7f510c003520 con 0x7f51200ae8e0 2024-09-15T22:49:09.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 msgr2=0x7f512015f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f512015f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 >> v1:172.21.15.177:6789/0 conn(0x7f51201554d0 legacy=0x7f51200b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51200af8f0 con 0x7f51200ae8e0 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f51180019f0 con 0x7f51200ae8e0 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 >> v1:172.21.15.134:6789/0 conn(0x7f51200ae8e0 legacy=0x7f5120072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f510c0039e0 0x7f510c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f510c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.511+0000 7f5117fff640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51200af610 con 0x7f510c0039e0 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00baa0 con 0x7f510c004d40 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f510c00bca0 con 0x7f51200b5630 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f510c0039e0 0x7f510c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f5124ff9640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f510c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f5125ffb640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 -- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 msgr2=0x7f510c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51200b5630 0x7f510c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 -- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c004d40 msgr2=0x7f510c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.512+0000 7f51257fa640 1 -- 172.21.15.134:0/3816856158 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c003520 con 0x7f510c0039e0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f51257fa640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f510c0039e0 0x7f510c003e00 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f511c001750 tx=0x7f510c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba0ce16c5f1b5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c001370 con 0x7f510c0039e0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c0052d0 con 0x7f510c0039e0 2024-09-15T22:49:09.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5117fff640 1 -- 172.21.15.134:0/3816856158 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c02abe0 con 0x7f510c0039e0 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 -- 172.21.15.134:0/3816856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f510c0039e0 msgr2=0x7f510c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3816856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f510c0039e0 0x7f510c003e00 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f511c001750 tx=0x7f510c005830 comp rx=0 tx=0).stop 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5125ffb640 1 -- 172.21.15.134:0/3816856158 reap_dead start 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 -- 172.21.15.134:0/3816856158 shutdown_connections 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 -- 172.21.15.134:0/3816856158 >> 172.21.15.134:0/3816856158 conn(0x7f512006c9f0 msgr2=0x7f512006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 -- 172.21.15.134:0/3816856158 shutdown_connections 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.513+0000 7f5127a5e640 1 -- 172.21.15.134:0/3816856158 wait complete. 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 Processor -- start 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 -- start start 2024-09-15T22:49:09.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f510c0039e0 0x7f5120153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5120072b30 0x7f5120072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51201558b0 con 0x7f51201e77d0 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51200aed50 con 0x7f5120072b30 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5127a5e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f5120155a30 con 0x7f510c0039e0 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5124ff9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5124ff9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48636/0 (socket says 172.21.15.134:48636) 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.515+0000 7f5124ff9640 1 -- 172.21.15.134:0/3754766487 learned_addr learned my addr 172.21.15.134:0/3754766487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5125ffb640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5120072b30 0x7f5120072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f51257fa640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f510c0039e0 0x7f5120153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 -- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f510c0039e0 msgr2=0x7f5120153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f510c0039e0 0x7f5120153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 -- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5120072b30 msgr2=0x7f5120072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5120072b30 0x7f5120072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 -- 172.21.15.134:0/3754766487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512015aa60 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5124ff9640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f51100119a0 tx=0x7f5110011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511000faf0 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511000fc90 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110014440 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512015ad40 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.516+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512015b300 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.517+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5120068cd0 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.518+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f5110012040 con 0x7f51201e77d0 2024-09-15T22:49:09.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.518+0000 7f5115ffb640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 0x7f510406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:09.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.518+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5851+0+0 (secure 0 0 0) 0x7f511008a5c0 con 0x7f51201e77d0 2024-09-15T22:49:09.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.518+0000 7f51257fa640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 0x7f510406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:09.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.519+0000 7f51257fa640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 0x7f510406f2e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f511c032000 tx=0x7f511c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:09.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.522+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5120068cd0 con 0x7f51201e77d0 2024-09-15T22:49:09.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:09.687+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5120062ca0 con 0x7f51201e77d0 2024-09-15T22:49:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.350+0000 7f5115ffb640 1 -- 172.21.15.134:0/3754766487 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v172) ==== 181+0+0 (secure 0 0 0) 0x7f5110019030 con 0x7f51201e77d0 2024-09-15T22:49:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 msgr2=0x7f510406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 0x7f510406f2e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f511c032000 tx=0x7f511c02e000 comp rx=0 tx=0).stop 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 msgr2=0x7f51201e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f51100119a0 tx=0x7f5110011e60 comp rx=0 tx=0).stop 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 shutdown_connections 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5120072b30 0x7f5120072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f510406ce20 0x7f510406f2e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51201e77d0 0x7f51201e7c50 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 --2- 172.21.15.134:0/3754766487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f510c0039e0 0x7f5120153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 >> 172.21.15.134:0/3754766487 conn(0x7f512006c9f0 msgr2=0x7f51200b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:10.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 shutdown_connections 2024-09-15T22:49:10.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.353+0000 7f5127a5e640 1 -- 172.21.15.134:0/3754766487 wait complete. 2024-09-15T22:49:10.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:49:10.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.471+0000 7f2d9d6a5640 1 Processor -- start 2024-09-15T22:49:10.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 -- start start 2024-09-15T22:49:10.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 0x7f2d980b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d981625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d980b3540 0x7f2d98162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980d24f0 con 0x7f2d980b3540 2024-09-15T22:49:10.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980b6b00 con 0x7f2d980b61e0 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.472+0000 7f2d9d6a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d980d20e0 con 0x7f2d980b3b00 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d980b3540 0x7f2d98162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d980b3540 0x7f2d98162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48652/0 (socket says 172.21.15.134:48652) 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 -- 172.21.15.134:0/4199145405 learned_addr learned my addr 172.21.15.134:0/4199145405 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 -- 172.21.15.134:0/4199145405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 msgr2=0x7f2d981625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d96ffd640 1 --2- 172.21.15.134:0/4199145405 >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 0x7f2d980b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d967fc640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d981625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d981625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 -- 172.21.15.134:0/4199145405 >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 msgr2=0x7f2d980b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 --2- 172.21.15.134:0/4199145405 >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 0x7f2d980b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d977fe640 1 -- 172.21.15.134:0/4199145405 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980cfa70 con 0x7f2d980b3540 2024-09-15T22:49:10.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d967fc640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d981625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:10.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.473+0000 7f2d96ffd640 1 --2- 172.21.15.134:0/4199145405 >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 0x7f2d980b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:10.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d977fe640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b3540 0x7f2d98162b10 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f2d9806be00 tx=0x7f2d9002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe6ed1c5c18dd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:10.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d95ffb640 1 -- 172.21.15.134:0/4199145405 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90037070 con 0x7f2d980b3540 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d95ffb640 1 -- 172.21.15.134:0/4199145405 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9002ae00 con 0x7f2d980b3540 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d95ffb640 1 -- 172.21.15.134:0/4199145405 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90032660 con 0x7f2d980b3540 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/4199145405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b3540 msgr2=0x7f2d98162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b3540 0x7f2d98162b10 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f2d9806be00 tx=0x7f2d9002a0b0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/4199145405 shutdown_connections 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b3540 0x7f2d98162b10 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/4199145405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d981625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/4199145405 >> v2:172.21.15.177:3300/0 conn(0x7f2d980b61e0 0x7f2d980b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/4199145405 >> 172.21.15.134:0/4199145405 conn(0x7f2d980d11e0 msgr2=0x7f2d980d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/4199145405 shutdown_connections 2024-09-15T22:49:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.474+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/4199145405 wait complete. 2024-09-15T22:49:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 Processor -- start 2024-09-15T22:49:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 -- start start 2024-09-15T22:49:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d980b3540 0x7f2d98157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d98148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9815edc0 con 0x7f2d980b61e0 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d0030 con 0x7f2d980b3540 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.476+0000 7f2d9d6a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f2d9815fdc0 con 0x7f2d980b3b00 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48664/0 (socket says 172.21.15.134:48664) 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 -- 172.21.15.134:0/2984097492 learned_addr learned my addr 172.21.15.134:0/2984097492 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d96ffd640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d980b3540 0x7f2d98157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d967fc640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d98148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 -- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 msgr2=0x7f2d98148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d98148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 -- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d980b3540 msgr2=0x7f2d98157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d980b3540 0x7f2d98157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 -- 172.21.15.134:0/2984097492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d981600a0 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d977fe640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097c0 tx=0x7f2d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90042070 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9003e670 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d98160380 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90037040 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.477+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d98157ec0 con 0x7f2d980b61e0 2024-09-15T22:49:10.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.478+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d980d1d00 con 0x7f2d980b61e0 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.479+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f2d9003a040 con 0x7f2d980b61e0 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.479+0000 7f2d8f7fe640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 0x7f2d7806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.479+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5413+0+0 (secure 0 0 0) 0x7f2d900aa270 con 0x7f2d980b61e0 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.480+0000 7f2d96ffd640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 0x7f2d7806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.480+0000 7f2d96ffd640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 0x7f2d7806f2b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2d9815e7b0 tx=0x7f2d88007770 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:10.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.484+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d90079bf0 con 0x7f2d980b61e0 2024-09-15T22:49:10.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:10.647+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2d980ba6e0 con 0x7f2d980b61e0 2024-09-15T22:49:11.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.351+0000 7f2d8f7fe640 1 -- 172.21.15.134:0/2984097492 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) ==== 169+0+0 (secure 0 0 0) 0x7f2d9007def0 con 0x7f2d980b61e0 2024-09-15T22:49:11.355 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-09-15T22:49:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 msgr2=0x7f2d7806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 0x7f2d7806f2b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2d9815e7b0 tx=0x7f2d88007770 comp rx=0 tx=0).stop 2024-09-15T22:49:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 msgr2=0x7f2d98149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097c0 tx=0x7f2d900046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 shutdown_connections 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f2d7806cdf0 0x7f2d7806f2b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d980b61e0 0x7f2d98149330 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d980b3b00 0x7f2d98148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 --2- 172.21.15.134:0/2984097492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d980b3540 0x7f2d98157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 >> 172.21.15.134:0/2984097492 conn(0x7f2d980d11e0 msgr2=0x7f2d980d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 shutdown_connections 2024-09-15T22:49:11.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.355+0000 7f2d9d6a5640 1 -- 172.21.15.134:0/2984097492 wait complete. 2024-09-15T22:49:11.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:49:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.471+0000 7f3420e53640 1 Processor -- start 2024-09-15T22:49:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.471+0000 7f3420e53640 1 -- start start 2024-09-15T22:49:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f3420e53640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f341c0cf320 0x7f341c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f3420e53640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341c06d700 con 0x7f341c15d3b0 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f3420e53640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341c0cde80 con 0x7f341c15d790 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f3420e53640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f341c06da30 con 0x7f341c0cf320 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f341a59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f341c15d3b0 0x7f341c071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57866/0 (socket says 172.21.15.134:57866) 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f341a59c640 1 -- 172.21.15.134:0/4047353284 learned_addr learned my addr 172.21.15.134:0/4047353284 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597456757 0 0) 0x7f341c06d700 con 0x7f341c15d3b0 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3404003520 con 0x7f341c15d3b0 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.472+0000 7f341ad9d640 1 --2- 172.21.15.134:0/4047353284 >> v2:172.21.15.177:3300/0 conn(0x7f341c0cf320 0x7f341c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227785957 0 0) 0x7f3404003520 con 0x7f341c15d3b0 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 >> v2:172.21.15.177:3300/0 conn(0x7f341c0cf320 msgr2=0x7f341c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 --2- 172.21.15.134:0/4047353284 >> v2:172.21.15.177:3300/0 conn(0x7f341c0cf320 0x7f341c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 >> v1:172.21.15.177:6789/0 conn(0x7f341c15d790 legacy=0x7f341c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c0cd8c0 con 0x7f341c15d3b0 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7f340c001670 con 0x7f341c15d3b0 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 >> v1:172.21.15.134:6789/0 conn(0x7f341c15d3b0 legacy=0x7f341c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 0x7f3404003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3404004800 0x7f3404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040051c0 0x7f340400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f341c06da30 con 0x7f34040039b0 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f340400c060 con 0x7f34040051c0 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f340400c260 con 0x7f3404004800 2024-09-15T22:49:11.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 0x7f3404003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341ad9d640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040051c0 0x7f340400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f3419d9b640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3404004800 0x7f3404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 -- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3404004800 msgr2=0x7f3404004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3404004800 0x7f3404004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 -- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040051c0 msgr2=0x7f340400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040051c0 0x7f340400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341a59c640 1 -- 172.21.15.134:0/4047353284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3404003520 con 0x7f34040039b0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f341ad9d640 1 -- 172.21.15.134:0/4047353284 reap_dead start 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.473+0000 7f3419d9b640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3404004800 0x7f3404004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f341a59c640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 0x7f3404003dd0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c240 tx=0x7f3404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f2318dd15eb8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007d10 con 0x7f34040039b0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340c005ad0 con 0x7f34040039b0 2024-09-15T22:49:11.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f341959a640 1 -- 172.21.15.134:0/4047353284 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007070 con 0x7f34040039b0 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f3420e53640 1 -- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 msgr2=0x7f3404003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.474+0000 7f3420e53640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 0x7f3404003dd0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c240 tx=0x7f3404005830 comp rx=0 tx=0).stop 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.475+0000 7f3420e53640 1 -- 172.21.15.134:0/4047353284 shutdown_connections 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.475+0000 7f3420e53640 1 --2- 172.21.15.134:0/4047353284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34040039b0 0x7f3404003dd0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.475+0000 7f3420e53640 1 -- 172.21.15.134:0/4047353284 >> 172.21.15.134:0/4047353284 conn(0x7f341c06bba0 msgr2=0x7f341c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.475+0000 7f3420e53640 1 -- 172.21.15.134:0/4047353284 shutdown_connections 2024-09-15T22:49:11.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.475+0000 7f3420e53640 1 -- 172.21.15.134:0/4047353284 wait complete. 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.476+0000 7f3420e53640 1 Processor -- start 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.476+0000 7f3420e53640 1 -- start start 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040039b0 0x7f341c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f341c0cf730 0x7f341c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f341c15cd70 con 0x7f341c0c5400 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f341c15cbf0 con 0x7f34040039b0 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f341c071080 con 0x7f341c0cf730 2024-09-15T22:49:11.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48684/0 (socket says 172.21.15.134:48684) 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 -- 172.21.15.134:0/1990996207 learned_addr learned my addr 172.21.15.134:0/1990996207 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f341a59c640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040039b0 0x7f341c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f341ad9d640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f341c0cf730 0x7f341c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 -- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f341c0cf730 msgr2=0x7f341c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f341c0cf730 0x7f341c0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 -- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040039b0 msgr2=0x7f341c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040039b0 0x7f341c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 -- 172.21.15.134:0/1990996207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c0b55d0 con 0x7f341c0c5400 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3419d9b640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f3410001f00 tx=0x7f341000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410019070 con 0x7f341c0c5400 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34100052e0 con 0x7f341c0c5400 2024-09-15T22:49:11.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c0b4630 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410003640 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.477+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1f44a0 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.478+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c071bd0 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.479+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f341001c070 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.479+0000 7f340affd640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 0x7f33fc06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.480+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f3410089550 con 0x7f341c0c5400 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.480+0000 7f341a59c640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 0x7f33fc06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.480+0000 7f341a59c640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 0x7f33fc06f2b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f340c032000 tx=0x7f340c02d000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.484+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3410058ed0 con 0x7f341c0c5400 2024-09-15T22:49:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.654+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f341c072790 con 0x7f341c0c5400 2024-09-15T22:49:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.657+0000 7f340affd640 1 -- 172.21.15.134:0/1990996207 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f341005d1d0 con 0x7f341c0c5400 2024-09-15T22:49:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 msgr2=0x7f33fc06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 0x7f33fc06f2b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f340c032000 tx=0x7f340c02d000 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 msgr2=0x7f341c14dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f3410001f00 tx=0x7f341000e8a0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 shutdown_connections 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f341c0cf730 0x7f341c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f33fc06cdf0 0x7f33fc06f2b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f341c0c5400 0x7f341c14dda0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 --2- 172.21.15.134:0/1990996207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34040039b0 0x7f341c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 >> 172.21.15.134:0/1990996207 conn(0x7f341c06bba0 msgr2=0x7f341c15f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 shutdown_connections 2024-09-15T22:49:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.659+0000 7f3420e53640 1 -- 172.21.15.134:0/1990996207 wait complete. 2024-09-15T22:49:11.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-15T22:49:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.812+0000 7f4f2cb9f640 1 Processor -- start 2024-09-15T22:49:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.812+0000 7f4f2cb9f640 1 -- start start 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f2cb9f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f2815b150 0x7f4f280ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f2cb9f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f280b4510 0x7f4f280b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f2cb9f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f280b31d0 con 0x7f4f280cd030 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f2cb9f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2815c0a0 con 0x7f4f280b4510 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f2cb9f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2815c380 con 0x7f4f2815b150 2024-09-15T22:49:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f26ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f280b4510 0x7f4f280b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f26ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f280b4510 0x7f4f280b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48698/0 (socket says 172.21.15.134:48698) 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.813+0000 7f4f26ffd640 1 -- 172.21.15.134:0/3579795131 learned_addr learned my addr 172.21.15.134:0/3579795131 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f277fe640 1 --2- 172.21.15.134:0/3579795131 >> v2:172.21.15.177:3300/0 conn(0x7f4f2815b150 0x7f4f280ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f26ffd640 1 -- 172.21.15.134:0/3579795131 >> v2:172.21.15.177:3300/0 conn(0x7f4f2815b150 msgr2=0x7f4f280ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f26ffd640 1 --2- 172.21.15.134:0/3579795131 >> v2:172.21.15.177:3300/0 conn(0x7f4f2815b150 0x7f4f280ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f26ffd640 1 -- 172.21.15.134:0/3579795131 >> v1:172.21.15.177:6789/0 conn(0x7f4f280cd030 legacy=0x7f4f2815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f26ffd640 1 -- 172.21.15.134:0/3579795131 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280b3440 con 0x7f4f280b4510 2024-09-15T22:49:11.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f26ffd640 1 --2- 172.21.15.134:0/3579795131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f280b3960 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009e50 tx=0x7f4f1c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87195f1b0902a4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.814+0000 7f4f267fc640 1 -- 172.21.15.134:0/3579795131 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c036070 con 0x7f4f280b4510 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f267fc640 1 -- 172.21.15.134:0/3579795131 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c031600 con 0x7f4f280b4510 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f267fc640 1 -- 172.21.15.134:0/3579795131 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0319d0 con 0x7f4f280b4510 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3579795131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 msgr2=0x7f4f280b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3579795131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f280b3960 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009e50 tx=0x7f4f1c02a710 comp rx=0 tx=0).stop 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3579795131 shutdown_connections 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3579795131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f280b3960 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3579795131 >> v2:172.21.15.177:3300/0 conn(0x7f4f2815b150 0x7f4f280ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3579795131 >> 172.21.15.134:0/3579795131 conn(0x7f4f2806e910 msgr2=0x7f4f2806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3579795131 shutdown_connections 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.815+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3579795131 wait complete. 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.816+0000 7f4f2cb9f640 1 Processor -- start 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.816+0000 7f4f2cb9f640 1 -- start start 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f280cd030 0x7f4f28152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2815b150 0x7f4f281e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2815bdc0 con 0x7f4f280b4510 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2815bc40 con 0x7f4f2815b150 2024-09-15T22:49:11.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f2cb9f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4f280b3ea0 con 0x7f4f280cd030 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f277fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f277fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48706/0 (socket says 172.21.15.134:48706) 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f277fe640 1 -- 172.21.15.134:0/3120070104 learned_addr learned my addr 172.21.15.134:0/3120070104 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f26ffd640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f280cd030 0x7f4f28152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.817+0000 7f4f27fff640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2815b150 0x7f4f281e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 -- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f280cd030 msgr2=0x7f4f28152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f280cd030 0x7f4f28152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 -- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2815b150 msgr2=0x7f4f281e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2815b150 0x7f4f281e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 -- 172.21.15.134:0/3120070104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f28151a70 con 0x7f4f280b4510 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f277fe640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d5f0 tx=0x7f4f1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011920 con 0x7f4f280b4510 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f18011ac0 con 0x7f4f280b4510 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f28150130 con 0x7f4f280b4510 2024-09-15T22:49:11.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18010440 con 0x7f4f280b4510 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.818+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f28151ff0 con 0x7f4f280b4510 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.819+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f280b4200 con 0x7f4f280b4510 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.819+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f4f18019020 con 0x7f4f280b4510 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.820+0000 7f4f0ffff640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 0x7f4f1406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.820+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f4f1808bba0 con 0x7f4f280b4510 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.820+0000 7f4f26ffd640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 0x7f4f1406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.821+0000 7f4f26ffd640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 0x7f4f1406f2b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c033000 tx=0x7f4f1c009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:11.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:11.824+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f1805b6f0 con 0x7f4f280b4510 2024-09-15T22:49:12.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.051+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f4f2806d6e0 con 0x7f4f280b4510 2024-09-15T22:49:12.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.352+0000 7f4f0ffff640 1 -- 172.21.15.134:0/3120070104 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v432) ==== 163+0+0 (secure 0 0 0) 0x7f4f1805f9f0 con 0x7f4f280b4510 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.354+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 msgr2=0x7f4f1406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.354+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 0x7f4f1406f2b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c033000 tx=0x7f4f1c009000 comp rx=0 tx=0).stop 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.354+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 msgr2=0x7f4f28072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.354+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d5f0 tx=0x7f4f1800dab0 comp rx=0 tx=0).stop 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 shutdown_connections 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2815b150 0x7f4f281e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:12.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f280cd030 0x7f4f28152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:12.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4f1406cdf0 0x7f4f1406f2b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:12.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 --2- 172.21.15.134:0/3120070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f280b4510 0x7f4f28072080 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:12.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 >> 172.21.15.134:0/3120070104 conn(0x7f4f2806e910 msgr2=0x7f4f280cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:12.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 shutdown_connections 2024-09-15T22:49:12.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:12.355+0000 7f4f2cb9f640 1 -- 172.21.15.134:0/3120070104 wait complete. 2024-09-15T22:49:12.368 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-15T22:49:12.369 INFO:tasks.cephfs_test_runner: 2024-09-15T22:49:12.369 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T22:49:12.369 INFO:tasks.cephfs_test_runner:Ran 11 tests in 443.637s 2024-09-15T22:49:12.369 INFO:tasks.cephfs_test_runner: 2024-09-15T22:49:12.369 INFO:tasks.cephfs_test_runner:OK 2024-09-15T22:49:12.369 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T22:49:13.101 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:49:13.480 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:49:13.480 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:13.481 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:13.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:49:13.502 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-15T22:49:13.502 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:13.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18543 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:49:13.563 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:49:13.563 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:13.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:49:13.583 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-15T22:49:13.583 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:49:13.644 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19795 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:49:13.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.644 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:49:13.663 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:49:13.663 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:49:13.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:49:13.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:49:13.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-15T22:49:13.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.889 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-15T22:49:13.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-15T22:49:13.975 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-15T22:49:13.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:13.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.977 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:49:13.997 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:49:13.997 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:49:13.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:13.998 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:49:14.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:14.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:49:14.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:14.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-09-15T22:49:14.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:14.236 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-09-15T22:49:14.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:49:14.252 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-09-15T22:49:14.321 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-09-15T22:49:14.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:14.323 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T22:49:14.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:49:14.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:49:14.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.454+0000 7f4d73277640 1 Processor -- start 2024-09-15T22:49:14.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.454+0000 7f4d73277640 1 -- start start 2024-09-15T22:49:14.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d73277640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d73277640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d6c073120 0x7f4d6c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d73277640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c0ce740 con 0x7f4d6c0ce230 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d73277640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c072640 con 0x7f4d6c073120 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d73277640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c072920 con 0x7f4d6c15c180 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71814640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d6c073120 0x7f4d6c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d70812640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4d6c0ce230 0x7f4d6c0cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57880/0 (socket says 172.21.15.134:57880) 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d70812640 1 -- 172.21.15.134:0/196319679 learned_addr learned my addr 172.21.15.134:0/196319679 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71013640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71814640 1 -- 172.21.15.134:0/196319679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 msgr2=0x7f4d6c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71814640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71814640 1 -- 172.21.15.134:0/196319679 >> v1:172.21.15.134:6789/0 conn(0x7f4d6c0ce230 legacy=0x7f4d6c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d63fff640 1 -- 172.21.15.134:0/196319679 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339545530 0 0) 0x7f4d6c0ce740 con 0x7f4d6c0ce230 2024-09-15T22:49:14.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.455+0000 7f4d71814640 1 -- 172.21.15.134:0/196319679 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c072c00 con 0x7f4d6c073120 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.456+0000 7f4d71814640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c0735d0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a52051a14532ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.456+0000 7f4d63fff640 1 -- 172.21.15.134:0/196319679 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64031600 con 0x7f4d6c073120 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.456+0000 7f4d63fff640 1 -- 172.21.15.134:0/196319679 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d640317a0 con 0x7f4d6c073120 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.456+0000 7f4d63fff640 1 -- 172.21.15.134:0/196319679 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64031b70 con 0x7f4d6c073120 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 -- 172.21.15.134:0/196319679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 msgr2=0x7f4d6c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c0735d0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 -- 172.21.15.134:0/196319679 shutdown_connections 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c0735d0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 --2- 172.21.15.134:0/196319679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 -- 172.21.15.134:0/196319679 >> 172.21.15.134:0/196319679 conn(0x7f4d6c062cc0 msgr2=0x7f4d6c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 -- 172.21.15.134:0/196319679 shutdown_connections 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.457+0000 7f4d73277640 1 -- 172.21.15.134:0/196319679 wait complete. 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.458+0000 7f4d73277640 1 Processor -- start 2024-09-15T22:49:14.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.458+0000 7f4d73277640 1 -- start start 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0ce230 0x7f4d6c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0cf780 con 0x7f4d6c073120 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0722f0 con 0x7f4d6c0ce230 2024-09-15T22:49:14.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c15c560 con 0x7f4d6c15c180 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48724/0 (socket says 172.21.15.134:48724) 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 -- 172.21.15.134:0/1129563275 learned_addr learned my addr 172.21.15.134:0/1129563275 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d70812640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0ce230 0x7f4d6c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71814640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 -- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 msgr2=0x7f4d6c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c06bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 -- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0ce230 msgr2=0x7f4d6c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0ce230 0x7f4d6c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 -- 172.21.15.134:0/1129563275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c14e280 con 0x7f4d6c073120 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71814640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d71013640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e9b0 tx=0x7f4d6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68017070 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6800c9a0 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c14e560 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.459+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800cd90 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.460+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c14eb20 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.461+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c0cdcf0 con 0x7f4d6c073120 2024-09-15T22:49:14.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.461+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f4d6801a070 con 0x7f4d6c073120 2024-09-15T22:49:14.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.462+0000 7f4d61ffb640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 0x7f4d5006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.462+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f4d6808a280 con 0x7f4d6c073120 2024-09-15T22:49:14.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.462+0000 7f4d70812640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 0x7f4d5006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.462+0000 7f4d70812640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 0x7f4d5006f2b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c153440 tx=0x7f4d5c007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.466+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d68059c00 con 0x7f4d6c073120 2024-09-15T22:49:14.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.629+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d6c0cfb10 con 0x7f4d5006cdf0 2024-09-15T22:49:14.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.631+0000 7f4d61ffb640 1 -- 172.21.15.134:0/1129563275 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f4d6c0cfb10 con 0x7f4d5006cdf0 2024-09-15T22:49:14.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:14.632 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:49:14.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 msgr2=0x7f4d5006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 0x7f4d5006f2b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c153440 tx=0x7f4d5c007de0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 msgr2=0x7f4d6c14d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e9b0 tx=0x7f4d6800ee70 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 shutdown_connections 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d6c15c180 0x7f4d6c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c0ce230 0x7f4d6c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f4d5006cdf0 0x7f4d5006f2b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 --2- 172.21.15.134:0/1129563275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d6c073120 0x7f4d6c14d360 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 >> 172.21.15.134:0/1129563275 conn(0x7f4d6c062cc0 msgr2=0x7f4d6c15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 shutdown_connections 2024-09-15T22:49:14.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.633+0000 7f4d73277640 1 -- 172.21.15.134:0/1129563275 wait complete. 2024-09-15T22:49:14.645 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-15T22:49:13.236010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267664,"kb_used_data":18152,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707056,"statfs":{"total":773094113280,"available":772820025344,"internally_reserved":0,"allocated":18587648,"data_stored":8846308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55929,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-80,"num_write_kb":-85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"1.0","version":"76'128","reported_seq":488,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-15T22:49:11.509232+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:49:11.509232+0000","last_peered":"2024-09-15T22:49:11.509232+0000","last_clean":"2024-09-15T22:49:11.509232+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:49:11.509232+0000","last_undegraded":"2024-09-15T22:49:11.509232+0000","last_fullsized":"2024-09-15T22:49:11.509232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33320,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33900,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337940,"statfs":{"total":96636764160,"available":96602050560,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33904,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337936,"statfs":{"total":96636764160,"available":96602046464,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:49:14.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:49:14.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.743+0000 7fdef058d640 1 Processor -- start 2024-09-15T22:49:14.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.743+0000 7fdef058d640 1 -- start start 2024-09-15T22:49:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 0x7fdee80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdee80cef90 0x7fdee80b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdee80d1ae0 con 0x7fdee80cef90 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdee80b7170 con 0x7fdee815ed20 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdef058d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80b7aa0 con 0x7fdee815e940 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdeeeb2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdee80cef90 0x7fdee80b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdeeeb2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdee80cef90 0x7fdee80b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48728/0 (socket says 172.21.15.134:48728) 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdeeeb2a640 1 -- 172.21.15.134:0/1044371669 learned_addr learned my addr 172.21.15.134:0/1044371669 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdeedb28640 1 --2- 172.21.15.134:0/1044371669 >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 0x7fdee80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.744+0000 7fdeee329640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 -- 172.21.15.134:0/1044371669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 msgr2=0x7fdee80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 -- 172.21.15.134:0/1044371669 >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 msgr2=0x7fdee80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:14.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 --2- 172.21.15.134:0/1044371669 >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 0x7fdee80d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 -- 172.21.15.134:0/1044371669 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee80d3660 con 0x7fdee80cef90 2024-09-15T22:49:14.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeedb28640 1 --2- 172.21.15.134:0/1044371669 >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 0x7fdee80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeeeb2a640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b3220 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdee80d5830 tx=0x7fdee002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daaee374b510bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.745+0000 7fdeed327640 1 -- 172.21.15.134:0/1044371669 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0036070 con 0x7fdee80cef90 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdeed327640 1 -- 172.21.15.134:0/1044371669 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0031600 con 0x7fdee80cef90 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdeed327640 1 -- 172.21.15.134:0/1044371669 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00319d0 con 0x7fdee80cef90 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 -- 172.21.15.134:0/1044371669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 msgr2=0x7fdee80b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b3220 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdee80d5830 tx=0x7fdee002a730 comp rx=0 tx=0).stop 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 -- 172.21.15.134:0/1044371669 shutdown_connections 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b3220 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 --2- 172.21.15.134:0/1044371669 >> v2:172.21.15.177:3300/0 conn(0x7fdee815ed20 0x7fdee80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 --2- 172.21.15.134:0/1044371669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 -- 172.21.15.134:0/1044371669 >> 172.21.15.134:0/1044371669 conn(0x7fdee80b6240 msgr2=0x7fdee80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:14.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 -- 172.21.15.134:0/1044371669 shutdown_connections 2024-09-15T22:49:14.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.746+0000 7fdef058d640 1 -- 172.21.15.134:0/1044371669 wait complete. 2024-09-15T22:49:14.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.747+0000 7fdef058d640 1 Processor -- start 2024-09-15T22:49:14.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.747+0000 7fdef058d640 1 -- start start 2024-09-15T22:49:14.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdee815ed20 0x7fdee815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80d3f00 con 0x7fdee80cef90 2024-09-15T22:49:14.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80d3c20 con 0x7fdee815ed20 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdef058d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80d1ef0 con 0x7fdee815e940 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48740/0 (socket says 172.21.15.134:48740) 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 -- 172.21.15.134:0/2484364446 learned_addr learned my addr 172.21.15.134:0/2484364446 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeeeb2a640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdee815ed20 0x7fdee815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeedb28640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 -- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 msgr2=0x7fdee80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 -- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdee815ed20 msgr2=0x7fdee815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdee815ed20 0x7fdee815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.748+0000 7fdeee329640 1 -- 172.21.15.134:0/2484364446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee80cdc90 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdeee329640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fdee400e890 tx=0x7fdee400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4017070 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee400c940 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee80cdf70 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee400cd10 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.749+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee81487a0 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.750+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee80d1060 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.750+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fdee401a070 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.751+0000 7fdedeffd640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 0x7fdecc06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.751+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7fdee408a240 con 0x7fdee80cef90 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.751+0000 7fdeedb28640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 0x7fdecc06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:14.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.751+0000 7fdeedb28640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 0x7fdecc06f2e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fded8009560 tx=0x7fded8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:14.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.755+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdee408ee20 con 0x7fdee80cef90 2024-09-15T22:49:14.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.917+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdee80ba6b0 con 0x7fdecc06ce20 2024-09-15T22:49:14.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.918+0000 7fdedeffd640 1 -- 172.21.15.134:0/2484364446 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7fdee80ba6b0 con 0x7fdecc06ce20 2024-09-15T22:49:14.920 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 msgr2=0x7fdecc06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 0x7fdecc06f2e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fded8009560 tx=0x7fded8009190 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 msgr2=0x7fdee80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fdee400e890 tx=0x7fdee400ed50 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 shutdown_connections 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdee815ed20 0x7fdee815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee815e940 0x7fdee80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdecc06ce20 0x7fdecc06f2e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 --2- 172.21.15.134:0/2484364446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdee80cef90 0x7fdee80b4dd0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.920+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 >> 172.21.15.134:0/2484364446 conn(0x7fdee80b6240 msgr2=0x7fdee80cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:14.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.921+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 shutdown_connections 2024-09-15T22:49:14.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:14.921+0000 7fdef058d640 1 -- 172.21.15.134:0/2484364446 wait complete. 2024-09-15T22:49:14.932 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-15T22:49:13.236010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267664,"kb_used_data":18152,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707056,"statfs":{"total":773094113280,"available":772820025344,"internally_reserved":0,"allocated":18587648,"data_stored":8846308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55929,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-80,"num_write_kb":-85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"1.0","version":"76'128","reported_seq":488,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-15T22:49:11.509232+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:49:11.509232+0000","last_peered":"2024-09-15T22:49:11.509232+0000","last_clean":"2024-09-15T22:49:11.509232+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:49:11.509232+0000","last_undegraded":"2024-09-15T22:49:11.509232+0000","last_fullsized":"2024-09-15T22:49:11.509232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33320,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33900,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337940,"statfs":{"total":96636764160,"available":96602050560,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33904,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337936,"statfs":{"total":96636764160,"available":96602046464,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:49:14.933 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:49:14.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:49:15.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.030+0000 7f8bdd67b640 1 Processor -- start 2024-09-15T22:49:15.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.030+0000 7f8bdd67b640 1 -- start start 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bdd67b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8bd8148330 0x7f8bd806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bdd67b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8bd815f5d0 0x7f8bd80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bdd67b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd815fbf0 con 0x7f8bd806c0e0 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bdd67b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd806c520 con 0x7f8bd8148330 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bdd67b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd80b4f80 con 0x7f8bd815f5d0 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bd6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8bd8148330 0x7f8bd806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bd6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8bd8148330 0x7f8bd806bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48746/0 (socket says 172.21.15.134:48746) 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.031+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1952961681 learned_addr learned my addr 172.21.15.134:0/1952961681 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/1952961681 >> v2:172.21.15.177:3300/0 conn(0x7f8bd815f5d0 0x7f8bd80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1952961681 >> v2:172.21.15.177:3300/0 conn(0x7f8bd815f5d0 msgr2=0x7f8bd80b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd6ffd640 1 --2- 172.21.15.134:0/1952961681 >> v2:172.21.15.177:3300/0 conn(0x7f8bd815f5d0 0x7f8bd80b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1952961681 >> v1:172.21.15.134:6789/0 conn(0x7f8bd806c0e0 legacy=0x7f8bd815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1952961681 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd80b5260 con 0x7f8bd8148330 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1952961681 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493210997 0 0) 0x7f8bd815fbf0 con 0x7f8bd806c0e0 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd6ffd640 1 --2- 172.21.15.134:0/1952961681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd8148330 0x7f8bd806bba0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f8bd815c860 tx=0x7f8bc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33934303440fe9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1952961681 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8036070 con 0x7f8bd8148330 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1952961681 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc8031600 con 0x7f8bd8148330 2024-09-15T22:49:15.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.032+0000 7f8bd5ffb640 1 -- 172.21.15.134:0/1952961681 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80319d0 con 0x7f8bd8148330 2024-09-15T22:49:15.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1952961681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd8148330 msgr2=0x7f8bd806bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1952961681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd8148330 0x7f8bd806bba0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f8bd815c860 tx=0x7f8bc802a6a0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1952961681 shutdown_connections 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1952961681 >> v2:172.21.15.177:3300/0 conn(0x7f8bd815f5d0 0x7f8bd80b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1952961681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd8148330 0x7f8bd806bba0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1952961681 >> 172.21.15.134:0/1952961681 conn(0x7f8bd8062a80 msgr2=0x7f8bd806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1952961681 shutdown_connections 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.033+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1952961681 wait complete. 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.034+0000 7f8bdd67b640 1 Processor -- start 2024-09-15T22:49:15.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.034+0000 7f8bdd67b640 1 -- start start 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd8148330 0x7f8bd80cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815f5d0 0x7f8bd8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd815fe50 con 0x7f8bd806c0e0 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80b5820 con 0x7f8bd815f5d0 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bdd67b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd815ffd0 con 0x7f8bd8148330 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48756/0 (socket says 172.21.15.134:48756) 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1396949885 learned_addr learned my addr 172.21.15.134:0/1396949885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd77fe640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815f5d0 0x7f8bd8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd67fc640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd8148330 0x7f8bd80cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd8148330 msgr2=0x7f8bd80cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.035+0000 7f8bd6ffd640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd8148330 0x7f8bd80cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815f5d0 msgr2=0x7f8bd8156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bd6ffd640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815f5d0 0x7f8bd8156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bd6ffd640 1 -- 172.21.15.134:0/1396949885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd813d6a0 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bd6ffd640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009f40 tx=0x7f8bc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc803f020 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc8037040 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd80cd5a0 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8036070 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.036+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd80cdb60 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.037+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd806bba0 con 0x7f8bd806c0e0 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.037+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f8bc8042020 con 0x7f8bd806c0e0 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.038+0000 7f8bbf7fe640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 0x7f8bc406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.038+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f8bc80aa390 con 0x7f8bd806c0e0 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.038+0000 7f8bd67fc640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 0x7f8bc406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.038+0000 7f8bd67fc640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 0x7f8bc406f2b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8144190 tx=0x7f8bcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.042+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bc8049030 con 0x7f8bd806c0e0 2024-09-15T22:49:15.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.205+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bd8144530 con 0x7f8bc406cdf0 2024-09-15T22:49:15.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.206+0000 7f8bbf7fe640 1 -- 172.21.15.134:0/1396949885 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f8bcc001cf0 con 0x7f8bc406cdf0 2024-09-15T22:49:15.208 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:15.208 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 msgr2=0x7f8bc406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 0x7f8bc406f2b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8144190 tx=0x7f8bcc009040 comp rx=0 tx=0).stop 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 msgr2=0x7f8bd813d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009f40 tx=0x7f8bc8004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 shutdown_connections 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815f5d0 0x7f8bd8156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8bd8148330 0x7f8bd80cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8bc406cdf0 0x7f8bc406f2b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 --2- 172.21.15.134:0/1396949885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd806c0e0 0x7f8bd813d160 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 >> 172.21.15.134:0/1396949885 conn(0x7f8bd8062a80 msgr2=0x7f8bd8147660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 shutdown_connections 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.208+0000 7f8bdd67b640 1 -- 172.21.15.134:0/1396949885 wait complete. 2024-09-15T22:49:15.220 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-15T22:49:13.236010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267664,"kb_used_data":18152,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707056,"statfs":{"total":773094113280,"available":772820025344,"internally_reserved":0,"allocated":18587648,"data_stored":8846308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55929,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-80,"num_write_kb":-85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"1.0","version":"76'128","reported_seq":488,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-15T22:49:11.509232+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:49:11.509232+0000","last_peered":"2024-09-15T22:49:11.509232+0000","last_clean":"2024-09-15T22:49:11.509232+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:49:11.509232+0000","last_undegraded":"2024-09-15T22:49:11.509232+0000","last_fullsized":"2024-09-15T22:49:11.509232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33320,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33900,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337940,"statfs":{"total":96636764160,"available":96602050560,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33904,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337936,"statfs":{"total":96636764160,"available":96602046464,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":955386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:49:15.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:49:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.321+0000 7fdf6e045640 1 Processor -- start 2024-09-15T22:49:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 -- start start 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 0x7fdf680b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf680cef90 0x7fdf680b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf680b7170 con 0x7fdf6815e940 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdf680b7aa0 con 0x7fdf680cef90 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.322+0000 7fdf6e045640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fdf680d3660 con 0x7fdf6815ed20 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf680cef90 0x7fdf680b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf677fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdf6815e940 0x7fdf680d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57902/0 (socket says 172.21.15.134:57902) 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf677fe640 1 -- 172.21.15.134:0/4183056728 learned_addr learned my addr 172.21.15.134:0/4183056728 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf680cef90 0x7fdf680b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48768/0 (socket says 172.21.15.134:48768) 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 -- 172.21.15.134:0/4183056728 >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 msgr2=0x7fdf680b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf66ffd640 1 --2- 172.21.15.134:0/4183056728 >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 0x7fdf680b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 --2- 172.21.15.134:0/4183056728 >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 0x7fdf680b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 -- 172.21.15.134:0/4183056728 >> v1:172.21.15.134:6789/0 conn(0x7fdf6815e940 legacy=0x7fdf680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf67fff640 1 -- 172.21.15.134:0/4183056728 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf680d3940 con 0x7fdf680cef90 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.323+0000 7fdf66ffd640 1 --2- 172.21.15.134:0/4183056728 >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 0x7fdf680b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf67fff640 1 --2- 172.21.15.134:0/4183056728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf680cef90 0x7fdf680b3760 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806e900 tx=0x7fdf6002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f4e5efac755102 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf667fc640 1 -- 172.21.15.134:0/4183056728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60037070 con 0x7fdf680cef90 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf667fc640 1 -- 172.21.15.134:0/4183056728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf60032440 con 0x7fdf680cef90 2024-09-15T22:49:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf667fc640 1 -- 172.21.15.134:0/4183056728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60032810 con 0x7fdf680cef90 2024-09-15T22:49:15.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 -- 172.21.15.134:0/4183056728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf680cef90 msgr2=0x7fdf680b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 --2- 172.21.15.134:0/4183056728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf680cef90 0x7fdf680b3760 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806e900 tx=0x7fdf6002a250 comp rx=0 tx=0).stop 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 -- 172.21.15.134:0/4183056728 shutdown_connections 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 --2- 172.21.15.134:0/4183056728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf680cef90 0x7fdf680b3760 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 --2- 172.21.15.134:0/4183056728 >> v2:172.21.15.177:3300/0 conn(0x7fdf6815ed20 0x7fdf680b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 -- 172.21.15.134:0/4183056728 >> 172.21.15.134:0/4183056728 conn(0x7fdf680b6240 msgr2=0x7fdf680b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 -- 172.21.15.134:0/4183056728 shutdown_connections 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.324+0000 7fdf6e045640 1 -- 172.21.15.134:0/4183056728 wait complete. 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.325+0000 7fdf6e045640 1 Processor -- start 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 -- start start 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf680cef90 0x7fdf68148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6815ed20 0x7fdf6815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680d3310 con 0x7fdf6815e940 2024-09-15T22:49:15.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680d3f00 con 0x7fdf6815ed20 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf6e045640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fdf680d1ef0 con 0x7fdf680cef90 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf66ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.326+0000 7fdf66ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48780/0 (socket says 172.21.15.134:48780) 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 -- 172.21.15.134:0/398523810 learned_addr learned my addr 172.21.15.134:0/398523810 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf67fff640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6815ed20 0x7fdf6815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf677fe640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf680cef90 0x7fdf68148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 -- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf680cef90 msgr2=0x7fdf68148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf680cef90 0x7fdf68148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 -- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6815ed20 msgr2=0x7fdf6815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6815ed20 0x7fdf6815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 -- 172.21.15.134:0/398523810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf680abb40 con 0x7fdf6815e940 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf66ffd640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00c7c0 tx=0x7fdf5c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c015070 con 0x7fdf6815e940 2024-09-15T22:49:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf5c007820 con 0x7fdf6815e940 2024-09-15T22:49:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf680cdf60 con 0x7fdf6815e940 2024-09-15T22:49:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c007bf0 con 0x7fdf6815e940 2024-09-15T22:49:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.327+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf681492f0 con 0x7fdf6815e940 2024-09-15T22:49:15.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.328+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf680d1060 con 0x7fdf6815e940 2024-09-15T22:49:15.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.329+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fdf5c018070 con 0x7fdf6815e940 2024-09-15T22:49:15.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.329+0000 7fdf4ffff640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 0x7fdf5406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:15.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.329+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7fdf5c089eb0 con 0x7fdf6815e940 2024-09-15T22:49:15.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.329+0000 7fdf677fe640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 0x7fdf5406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:15.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.330+0000 7fdf677fe640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 0x7fdf5406f2b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf580012e0 tx=0x7fdf58009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:15.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.333+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf680abb40 con 0x7fdf6815e940 2024-09-15T22:49:15.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.501+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf681623d0 con 0x7fdf6815e940 2024-09-15T22:49:15.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.501+0000 7fdf4ffff640 1 -- 172.21.15.134:0/398523810 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) ==== 74+0+13165 (secure 0 0 0) 0x7fdf5c059e80 con 0x7fdf6815e940 2024-09-15T22:49:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:15.503 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":173,"fsid":"5af37fce-f477-417d-bd72-01ffdf727d70","created":"2024-09-15T22:41:02.918700+0000","modified":"2024-09-15T22:49:11.350894+0000","last_up_change":"2024-09-15T22:41:15.577245+0000","last_in_change":"2024-09-15T22:41:05.025443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:41:16.977182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea3ff215-e49e-4025-89fb-7bc1e8254e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6827","nonce":3150812732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6829","nonce":3150812732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6833","nonce":3150812732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3150812732},{"type":"v1","addr":"172.21.15.134:6831","nonce":3150812732}]},"public_addr":"172.21.15.134:6827/3150812732","cluster_addr":"172.21.15.134:6829/3150812732","heartbeat_back_addr":"172.21.15.134:6833/3150812732","heartbeat_front_addr":"172.21.15.134:6831/3150812732","state":["exists","up"]},{"osd":1,"uuid":"2a624764-e23a-4f07-bcee-f74a5323bc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6801","nonce":1167728120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6803","nonce":1167728120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6807","nonce":1167728120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1167728120},{"type":"v1","addr":"172.21.15.134:6805","nonce":1167728120}]},"public_addr":"172.21.15.134:6801/1167728120","cluster_addr":"172.21.15.134:6803/1167728120","heartbeat_back_addr":"172.21.15.134:6807/1167728120","heartbeat_front_addr":"172.21.15.134:6805/1167728120","state":["exists","up"]},{"osd":2,"uuid":"06741699-5cc6-457a-b545-3bb993eedf42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6817","nonce":802177628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6819","nonce":802177628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6823","nonce":802177628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":802177628},{"type":"v1","addr":"172.21.15.134:6821","nonce":802177628}]},"public_addr":"172.21.15.134:6817/802177628","cluster_addr":"172.21.15.134:6819/802177628","heartbeat_back_addr":"172.21.15.134:6823/802177628","heartbeat_front_addr":"172.21.15.134:6821/802177628","state":["exists","up"]},{"osd":3,"uuid":"2eb21386-8584-4c34-8254-bdadf09b6bb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6809","nonce":1380536575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6811","nonce":1380536575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6815","nonce":1380536575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1380536575},{"type":"v1","addr":"172.21.15.134:6813","nonce":1380536575}]},"public_addr":"172.21.15.134:6809/1380536575","cluster_addr":"172.21.15.134:6811/1380536575","heartbeat_back_addr":"172.21.15.134:6815/1380536575","heartbeat_front_addr":"172.21.15.134:6813/1380536575","state":["exists","up"]},{"osd":4,"uuid":"72fccc24-877e-4aa3-93a4-8648ebfb0cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6810","nonce":324643051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6813","nonce":324643051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6820","nonce":324643051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":324643051},{"type":"v1","addr":"172.21.15.177:6817","nonce":324643051}]},"public_addr":"172.21.15.177:6810/324643051","cluster_addr":"172.21.15.177:6813/324643051","heartbeat_back_addr":"172.21.15.177:6820/324643051","heartbeat_front_addr":"172.21.15.177:6817/324643051","state":["exists","up"]},{"osd":5,"uuid":"eda966ae-16e2-43fe-af94-3c8f51d1242b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6801","nonce":3233781875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6803","nonce":3233781875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6807","nonce":3233781875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3233781875},{"type":"v1","addr":"172.21.15.177:6805","nonce":3233781875}]},"public_addr":"172.21.15.177:6801/3233781875","cluster_addr":"172.21.15.177:6803/3233781875","heartbeat_back_addr":"172.21.15.177:6807/3233781875","heartbeat_front_addr":"172.21.15.177:6805/3233781875","state":["exists","up"]},{"osd":6,"uuid":"d86be5c2-49aa-4bbd-9066-f3655ac9576b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6825","nonce":410834460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6827","nonce":410834460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6831","nonce":410834460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":410834460},{"type":"v1","addr":"172.21.15.177:6829","nonce":410834460}]},"public_addr":"172.21.15.177:6825/410834460","cluster_addr":"172.21.15.177:6827/410834460","heartbeat_back_addr":"172.21.15.177:6831/410834460","heartbeat_front_addr":"172.21.15.177:6829/410834460","state":["exists","up"]},{"osd":7,"uuid":"242b6098-c5c2-4425-a912-70362fe7ff09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6811","nonce":1620102708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6816","nonce":1620102708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6823","nonce":1620102708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6819","nonce":1620102708},{"type":"v1","addr":"172.21.15.177:6821","nonce":1620102708}]},"public_addr":"172.21.15.177:6811/1620102708","cluster_addr":"172.21.15.177:6816/1620102708","heartbeat_back_addr":"172.21.15.177:6823/1620102708","heartbeat_front_addr":"172.21.15.177:6821/1620102708","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.269228+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.138766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.151645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.358662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.379454+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.072923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:11.844125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:12.039968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/23140858":"2024-09-16T22:49:08.346682+0000","172.21.15.134:6834/23140858":"2024-09-16T22:49:08.346682+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 msgr2=0x7fdf5406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 0x7fdf5406f2b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf580012e0 tx=0x7fdf58009040 comp rx=0 tx=0).stop 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 msgr2=0x7fdf68148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00c7c0 tx=0x7fdf5c00cc80 comp rx=0 tx=0).stop 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 shutdown_connections 2024-09-15T22:49:15.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6815ed20 0x7fdf6815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fdf5406cdf0 0x7fdf5406f2b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6815e940 0x7fdf68148760 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 --2- 172.21.15.134:0/398523810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf680cef90 0x7fdf68148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.503+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 >> 172.21.15.134:0/398523810 conn(0x7fdf680b6240 msgr2=0x7fdf6815ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.504+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 shutdown_connections 2024-09-15T22:49:15.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:15.504+0000 7fdf6e045640 1 -- 172.21.15.134:0/398523810 wait complete. 2024-09-15T22:49:16.517 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T22:49:16.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.629+0000 7f2207f11640 1 Processor -- start 2024-09-15T22:49:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.629+0000 7f2207f11640 1 -- start start 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f2207f11640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22000d1fd0 0x7f22000710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f2207f11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220006ec90 con 0x7f220015e5c0 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f2207f11640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2200073d20 con 0x7f22000d1860 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f2207f11640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f22000d1dd0 con 0x7f22000d1fd0 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f22064ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22000d1fd0 0x7f22000710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f22064ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22000d1fd0 0x7f22000710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57358/0 (socket says 172.21.15.134:57358) 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f22064ae640 1 -- 172.21.15.134:0/1920859181 learned_addr learned my addr 172.21.15.134:0/1920859181 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.630+0000 7f2205cad640 1 --1- 172.21.15.134:0/1920859181 >> v1:172.21.15.134:6789/0 conn(0x7f220015e5c0 0x7f22000b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48156/0 (socket says 172.21.15.134:48156) 2024-09-15T22:49:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.631+0000 7f22064ae640 1 -- 172.21.15.134:0/1920859181 >> v1:172.21.15.177:6789/0 conn(0x7f22000d1860 legacy=0x7f22000709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.631+0000 7f22064ae640 1 -- 172.21.15.134:0/1920859181 >> v1:172.21.15.134:6789/0 conn(0x7f220015e5c0 legacy=0x7f22000b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.631+0000 7f22064ae640 1 -- 172.21.15.134:0/1920859181 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2200074000 con 0x7f22000d1fd0 2024-09-15T22:49:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.631+0000 7f2204cab640 1 -- 172.21.15.134:0/1920859181 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136136928 0 0) 0x7f220006ec90 con 0x7f220015e5c0 2024-09-15T22:49:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.631+0000 7f22064ae640 1 --2- 172.21.15.134:0/1920859181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f22000710e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009e50 tx=0x7f21f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b92c43112d5ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2204cab640 1 -- 172.21.15.134:0/1920859181 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8036070 con 0x7f22000d1fd0 2024-09-15T22:49:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2204cab640 1 -- 172.21.15.134:0/1920859181 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f8031600 con 0x7f22000d1fd0 2024-09-15T22:49:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2204cab640 1 -- 172.21.15.134:0/1920859181 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80319d0 con 0x7f22000d1fd0 2024-09-15T22:49:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 -- 172.21.15.134:0/1920859181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 msgr2=0x7f22000710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 --2- 172.21.15.134:0/1920859181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f22000710e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009e50 tx=0x7f21f802a6a0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 -- 172.21.15.134:0/1920859181 shutdown_connections 2024-09-15T22:49:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 --2- 172.21.15.134:0/1920859181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f22000710e0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 -- 172.21.15.134:0/1920859181 >> 172.21.15.134:0/1920859181 conn(0x7f22000d25b0 msgr2=0x7f22000d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 -- 172.21.15.134:0/1920859181 shutdown_connections 2024-09-15T22:49:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.632+0000 7f2207f11640 1 -- 172.21.15.134:0/1920859181 wait complete. 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.633+0000 7f2207f11640 1 Processor -- start 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.633+0000 7f2207f11640 1 -- start start 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22000d1860 0x7f220014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f220015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220015e5c0 0x7f220015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22000b5890 con 0x7f22000d1fd0 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22000b5710 con 0x7f220015e5c0 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2207f11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f220015e9a0 con 0x7f22000d1860 2024-09-15T22:49:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f22054ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f220015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f22054ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f220015a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57374/0 (socket says 172.21.15.134:57374) 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f22054ac640 1 -- 172.21.15.134:0/180338561 learned_addr learned my addr 172.21.15.134:0/180338561 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f2205cad640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22000d1860 0x7f220014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.634+0000 7f22064ae640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220015e5c0 0x7f220015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 -- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22000d1860 msgr2=0x7f220014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22000d1860 0x7f220014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 -- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220015e5c0 msgr2=0x7f220015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f220015e5c0 0x7f220015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22001f5480 con 0x7f22000d1fd0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f22054ac640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f220015a1d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c400 tx=0x7f21f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0017070 con 0x7f22000d1fd0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f00052d0 con 0x7f22000d1fd0 2024-09-15T22:49:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22001f51a0 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0003830 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.635+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22001f5a70 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.636+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22000d1080 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.636+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f21f001a070 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f21f67fc640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f21e406cdf0 0x7f21e406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f21f00892b0 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f2205cad640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f21e406cdf0 0x7f21e406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f21f67fc640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f21e4072cb0 0x7f21e40750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21e40757c0 con 0x7f21e4072cb0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7f21f00902a0 con 0x7f22000d1fd0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.637+0000 7f22064ae640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f21e4072cb0 0x7f21e40750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.638+0000 7f22064ae640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f21e4072cb0 0x7f21e40750f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.638+0000 7f2205cad640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f21e406cdf0 0x7f21e406f2b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007f70 tx=0x7f21fc007f00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.638+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== osd.0 v2:172.21.15.134:6826/3150812732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21e40757c0 con 0x7f21e4072cb0 2024-09-15T22:49:16.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.650+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 --> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22000b6d80 con 0x7f21e4072cb0 2024-09-15T22:49:16.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f21f67fc640 1 -- 172.21.15.134:0/180338561 <== osd.0 v2:172.21.15.134:6826/3150812732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22000b6d80 con 0x7f21e4072cb0 2024-09-15T22:49:16.652 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:16.652 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:16.652 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f21e4072cb0 msgr2=0x7f21e40750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:6826/3150812732,v1:172.21.15.134:6827/3150812732] conn(0x7f21e4072cb0 0x7f21e40750f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f21e406cdf0 msgr2=0x7f21e406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f21e406cdf0 0x7f21e406f2b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007f70 tx=0x7f21fc007f00 comp rx=0 tx=0).stop 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 msgr2=0x7f220015a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 --2- 172.21.15.134:0/180338561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22000d1fd0 0x7f220015a1d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c400 tx=0x7f21f000c8c0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f22064ae640 1 -- 172.21.15.134:0/180338561 reap_dead start 2024-09-15T22:49:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 shutdown_connections 2024-09-15T22:49:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 >> 172.21.15.134:0/180338561 conn(0x7f22000d25b0 msgr2=0x7f2200070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 shutdown_connections 2024-09-15T22:49:16.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.651+0000 7f2207f11640 1 -- 172.21.15.134:0/180338561 wait complete. 2024-09-15T22:49:16.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T22:49:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.763+0000 7f474fd11640 1 Processor -- start 2024-09-15T22:49:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.763+0000 7f474fd11640 1 -- start start 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474fd11640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4748140a40 0x7f474815c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474fd11640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f474813eaf0 0x7f47480b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474fd11640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47480b4ee0 con 0x7f47480720c0 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474fd11640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f474813ef60 con 0x7f4748140a40 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474fd11640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f47480b5780 con 0x7f474813eaf0 2024-09-15T22:49:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474daad640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4748140a40 0x7f474815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474e2ae640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f47480720c0 0x7f47480724d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48166/0 (socket says 172.21.15.134:48166) 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.764+0000 7f474e2ae640 1 -- 172.21.15.134:0/1396625102 learned_addr learned my addr 172.21.15.134:0/1396625102 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474d2ac640 1 --2- 172.21.15.134:0/1396625102 >> v2:172.21.15.177:3300/0 conn(0x7f474813eaf0 0x7f47480b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474daad640 1 -- 172.21.15.134:0/1396625102 >> v2:172.21.15.177:3300/0 conn(0x7f474813eaf0 msgr2=0x7f47480b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474daad640 1 --2- 172.21.15.134:0/1396625102 >> v2:172.21.15.177:3300/0 conn(0x7f474813eaf0 0x7f47480b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474daad640 1 -- 172.21.15.134:0/1396625102 >> v1:172.21.15.134:6789/0 conn(0x7f47480720c0 legacy=0x7f47480724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474daad640 1 -- 172.21.15.134:0/1396625102 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47480b51c0 con 0x7f4748140a40 2024-09-15T22:49:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474caab640 1 -- 172.21.15.134:0/1396625102 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 875514274 0 0) 0x7f47480b4ee0 con 0x7f47480720c0 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.765+0000 7f474daad640 1 --2- 172.21.15.134:0/1396625102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4748140a40 0x7f474815c480 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4748072ec0 tx=0x7f474402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee129cc0d79bd921 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474caab640 1 -- 172.21.15.134:0/1396625102 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744037070 con 0x7f4748140a40 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474caab640 1 -- 172.21.15.134:0/1396625102 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4744032440 con 0x7f4748140a40 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474caab640 1 -- 172.21.15.134:0/1396625102 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474402ae60 con 0x7f4748140a40 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 -- 172.21.15.134:0/1396625102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4748140a40 msgr2=0x7f474815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 --2- 172.21.15.134:0/1396625102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4748140a40 0x7f474815c480 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4748072ec0 tx=0x7f474402a110 comp rx=0 tx=0).stop 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 -- 172.21.15.134:0/1396625102 shutdown_connections 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 --2- 172.21.15.134:0/1396625102 >> v2:172.21.15.177:3300/0 conn(0x7f474813eaf0 0x7f47480b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 --2- 172.21.15.134:0/1396625102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4748140a40 0x7f474815c480 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 -- 172.21.15.134:0/1396625102 >> 172.21.15.134:0/1396625102 conn(0x7f4748062a80 msgr2=0x7f474806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:16.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 -- 172.21.15.134:0/1396625102 shutdown_connections 2024-09-15T22:49:16.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.766+0000 7f474fd11640 1 -- 172.21.15.134:0/1396625102 wait complete. 2024-09-15T22:49:16.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 Processor -- start 2024-09-15T22:49:16.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 -- start start 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480720c0 0x7f4748155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4748140a40 0x7f47481f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4748140e20 con 0x7f474813eaf0 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47480b5ad0 con 0x7f47480720c0 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474fd11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f47480b5ff0 con 0x7f4748140a40 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474d2ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474d2ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57398/0 (socket says 172.21.15.134:57398) 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474d2ac640 1 -- 172.21.15.134:0/3212004174 learned_addr learned my addr 172.21.15.134:0/3212004174 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474daad640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480720c0 0x7f4748155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.768+0000 7f474e2ae640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4748140a40 0x7f47481f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 -- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4748140a40 msgr2=0x7f47481f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4748140a40 0x7f47481f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 -- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480720c0 msgr2=0x7f4748155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480720c0 0x7f4748155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 -- 172.21.15.134:0/3212004174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4748157c90 con 0x7f474813eaf0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474d2ac640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f473800d800 tx=0x7f473800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473800b6c0 con 0x7f474813eaf0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738019070 con 0x7f474813eaf0 2024-09-15T22:49:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47481579b0 con 0x7f474813eaf0 2024-09-15T22:49:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473800ba80 con 0x7f474813eaf0 2024-09-15T22:49:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.769+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4748141ff0 con 0x7f474813eaf0 2024-09-15T22:49:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.770+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f474815c480 con 0x7f474813eaf0 2024-09-15T22:49:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.771+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f473800bc20 con 0x7f474813eaf0 2024-09-15T22:49:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.771+0000 7f473e7fc640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 0x7f472c06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:16.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.771+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f473808a0d0 con 0x7f474813eaf0 2024-09-15T22:49:16.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.771+0000 7f474daad640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 0x7f472c06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:16.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.772+0000 7f474daad640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 0x7f472c06f2b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4744034000 tx=0x7f474402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:16.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.776+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4738059ca0 con 0x7f474813eaf0 2024-09-15T22:49:16.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.950+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4748155d80 con 0x7f472c06cdf0 2024-09-15T22:49:16.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.951+0000 7f473e7fc640 1 -- 172.21.15.134:0/3212004174 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4748155d80 con 0x7f472c06cdf0 2024-09-15T22:49:16.952 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T22:49:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 msgr2=0x7f472c06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 0x7f472c06f2b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4744034000 tx=0x7f474402e000 comp rx=0 tx=0).stop 2024-09-15T22:49:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 msgr2=0x7f47481f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f473800d800 tx=0x7f473800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 shutdown_connections 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4748140a40 0x7f47481f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f472c06cdf0 0x7f472c06f2b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f474813eaf0 0x7f47481f46f0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 --2- 172.21.15.134:0/3212004174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480720c0 0x7f4748155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 >> 172.21.15.134:0/3212004174 conn(0x7f4748062a80 msgr2=0x7f474813f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 shutdown_connections 2024-09-15T22:49:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:16.953+0000 7f474fd11640 1 -- 172.21.15.134:0/3212004174 wait complete. 2024-09-15T22:49:16.965 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T22:49:16.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:17.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.070+0000 7fa8f8198640 1 Processor -- start 2024-09-15T22:49:17.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 -- start start 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8f015b3a0 0x7fa8f015f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8f00cf310 0x7fa8f0072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f00b48d0 con 0x7fa8f00729c0 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f015feb0 con 0x7fa8f00cf310 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f8198640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f00b4bb0 con 0x7fa8f015b3a0 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f5733640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8f00cf310 0x7fa8f0072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f6735640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa8f00729c0 0x7fa8f006fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48178/0 (socket says 172.21.15.134:48178) 2024-09-15T22:49:17.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.071+0000 7fa8f6735640 1 -- 172.21.15.134:0/2387464010 learned_addr learned my addr 172.21.15.134:0/2387464010 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f5f34640 1 --2- 172.21.15.134:0/2387464010 >> v2:172.21.15.177:3300/0 conn(0x7fa8f015b3a0 0x7fa8f015f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f5733640 1 -- 172.21.15.134:0/2387464010 >> v2:172.21.15.177:3300/0 conn(0x7fa8f015b3a0 msgr2=0x7fa8f015f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f5733640 1 --2- 172.21.15.134:0/2387464010 >> v2:172.21.15.177:3300/0 conn(0x7fa8f015b3a0 0x7fa8f015f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f5733640 1 -- 172.21.15.134:0/2387464010 >> v1:172.21.15.134:6789/0 conn(0x7fa8f00729c0 legacy=0x7fa8f006fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f4f32640 1 -- 172.21.15.134:0/2387464010 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631841044 0 0) 0x7fa8f00b48d0 con 0x7fa8f00729c0 2024-09-15T22:49:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.072+0000 7fa8f5733640 1 -- 172.21.15.134:0/2387464010 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00b4e90 con 0x7fa8f00cf310 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.073+0000 7fa8f5733640 1 --2- 172.21.15.134:0/2387464010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f00cf310 0x7fa8f0072480 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0072450 tx=0x7fa8ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c9a5f6c637b76d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.073+0000 7fa8f4f32640 1 -- 172.21.15.134:0/2387464010 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec037070 con 0x7fa8f00cf310 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.073+0000 7fa8f4f32640 1 -- 172.21.15.134:0/2387464010 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ec032440 con 0x7fa8f00cf310 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.073+0000 7fa8f4f32640 1 -- 172.21.15.134:0/2387464010 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec02ae60 con 0x7fa8f00cf310 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 -- 172.21.15.134:0/2387464010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f00cf310 msgr2=0x7fa8f0072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 --2- 172.21.15.134:0/2387464010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f00cf310 0x7fa8f0072480 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0072450 tx=0x7fa8ec02a110 comp rx=0 tx=0).stop 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 -- 172.21.15.134:0/2387464010 shutdown_connections 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 --2- 172.21.15.134:0/2387464010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f00cf310 0x7fa8f0072480 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 --2- 172.21.15.134:0/2387464010 >> v2:172.21.15.177:3300/0 conn(0x7fa8f015b3a0 0x7fa8f015f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 -- 172.21.15.134:0/2387464010 >> 172.21.15.134:0/2387464010 conn(0x7fa8f006ce90 msgr2=0x7fa8f006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 -- 172.21.15.134:0/2387464010 shutdown_connections 2024-09-15T22:49:17.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.074+0000 7fa8f8198640 1 -- 172.21.15.134:0/2387464010 wait complete. 2024-09-15T22:49:17.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.075+0000 7fa8f8198640 1 Processor -- start 2024-09-15T22:49:17.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.075+0000 7fa8f8198640 1 -- start start 2024-09-15T22:49:17.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8f00729c0 0x7fa8f0143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa8f00cf310 0x7fa8f015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 0x7fa8f015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f015b900 con 0x7fa8f015b3a0 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f015b780 con 0x7fa8f00729c0 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f006f8e0 con 0x7fa8f00cf310 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 0x7fa8f015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 0x7fa8f015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57410/0 (socket says 172.21.15.134:57410) 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 -- 172.21.15.134:0/361292526 learned_addr learned my addr 172.21.15.134:0/361292526 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f5f34640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8f00729c0 0x7fa8f0143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f5733640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa8f00cf310 0x7fa8f015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 -- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa8f00cf310 msgr2=0x7fa8f015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa8f00cf310 0x7fa8f015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 -- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8f00729c0 msgr2=0x7fa8f0143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8f00729c0 0x7fa8f0143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f0144320 con 0x7fa8f015b3a0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f5f34640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8f00729c0 0x7fa8f0143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f6735640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 0x7fa8f015db90 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c7a0 tx=0x7fa8e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8018070 con 0x7fa8f015b3a0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e800a640 con 0x7fa8f015b3a0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f015c3d0 con 0x7fa8f015b3a0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800aab0 con 0x7fa8f015b3a0 2024-09-15T22:49:17.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.076+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f015d390 con 0x7fa8f015b3a0 2024-09-15T22:49:17.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.077+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8f015d770 con 0x7fa8f015b3a0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.078+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fa8e801b070 con 0x7fa8f015b3a0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.078+0000 7fa8e67fc640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa8d406cdf0 0x7fa8d406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7fa8e8089560 con 0x7fa8f015b3a0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8f5f34640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa8d406cdf0 0x7fa8d406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8e67fc640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7fa8d4072cb0 0x7fa8d40750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8d40757c0 con 0x7fa8d4072cb0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7fa8e8091320 con 0x7fa8f015b3a0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8f5733640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7fa8d4072cb0 0x7fa8d40750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8f5f34640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa8d406cdf0 0x7fa8d406f2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009e90 tx=0x7fa8e0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.079+0000 7fa8f5733640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7fa8d4072cb0 0x7fa8d40750f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.080+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== osd.1 v2:172.21.15.134:6800/1167728120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8d40757c0 con 0x7fa8d4072cb0 2024-09-15T22:49:17.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.092+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 --> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8f00b4510 con 0x7fa8d4072cb0 2024-09-15T22:49:17.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8e67fc640 1 -- 172.21.15.134:0/361292526 <== osd.1 v2:172.21.15.134:6800/1167728120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8f00b4510 con 0x7fa8d4072cb0 2024-09-15T22:49:17.094 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:17.094 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:17.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7fa8d4072cb0 msgr2=0x7fa8d40750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:6800/1167728120,v1:172.21.15.134:6801/1167728120] conn(0x7fa8d4072cb0 0x7fa8d40750f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa8d406cdf0 msgr2=0x7fa8d406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fa8d406cdf0 0x7fa8d406f2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009e90 tx=0x7fa8e0009190 comp rx=0 tx=0).stop 2024-09-15T22:49:17.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 msgr2=0x7fa8f015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 --2- 172.21.15.134:0/361292526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8f015b3a0 0x7fa8f015db90 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c7a0 tx=0x7fa8e800cc60 comp rx=0 tx=0).stop 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f6735640 1 -- 172.21.15.134:0/361292526 reap_dead start 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 shutdown_connections 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 >> 172.21.15.134:0/361292526 conn(0x7fa8f006ce90 msgr2=0x7fa8f0070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 shutdown_connections 2024-09-15T22:49:17.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.093+0000 7fa8f8198640 1 -- 172.21.15.134:0/361292526 wait complete. 2024-09-15T22:49:17.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.208+0000 7fd56bb13640 1 Processor -- start 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.208+0000 7fd56bb13640 1 -- start start 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56bb13640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd56415e940 0x7fd5640d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56bb13640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 0x7fd5640d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56bb13640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5640b7170 con 0x7fd5640cef90 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56bb13640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fd5640d1ae0 con 0x7fd56415e940 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56bb13640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5640b7aa0 con 0x7fd56415ed20 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5690ae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 0x7fd5640d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5698af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd56415e940 0x7fd5640d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56a0b0640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd5640cef90 0x7fd5640b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48604/0 (socket says 172.21.15.134:48604) 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd56a0b0640 1 -- 172.21.15.134:0/1224088632 learned_addr learned my addr 172.21.15.134:0/1224088632 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5698af640 1 -- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 msgr2=0x7fd5640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5698af640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 0x7fd5640d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5698af640 1 -- 172.21.15.134:0/1224088632 >> v1:172.21.15.177:6789/0 conn(0x7fd5640cef90 legacy=0x7fd5640b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5698af640 1 -- 172.21.15.134:0/1224088632 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5640d3660 con 0x7fd56415e940 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.209+0000 7fd5688ad640 1 -- 172.21.15.134:0/1224088632 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545849925 0 0) 0x7fd55c001490 con 0x7fd5640cef90 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5690ae640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 0x7fd5640d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5698af640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415e940 0x7fd5640d1060 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd55402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52eb5ab06771e42c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5688ad640 1 -- 172.21.15.134:0/1224088632 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554037070 con 0x7fd56415e940 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5688ad640 1 -- 172.21.15.134:0/1224088632 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd554032440 con 0x7fd56415e940 2024-09-15T22:49:17.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.210+0000 7fd5688ad640 1 -- 172.21.15.134:0/1224088632 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554032810 con 0x7fd56415e940 2024-09-15T22:49:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 -- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415e940 msgr2=0x7fd5640d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415e940 0x7fd5640d1060 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd55402a210 comp rx=0 tx=0).stop 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 -- 172.21.15.134:0/1224088632 shutdown_connections 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415ed20 0x7fd5640d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 --2- 172.21.15.134:0/1224088632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415e940 0x7fd5640d1060 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 -- 172.21.15.134:0/1224088632 >> 172.21.15.134:0/1224088632 conn(0x7fd5640b6240 msgr2=0x7fd5640b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 -- 172.21.15.134:0/1224088632 shutdown_connections 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.211+0000 7fd56bb13640 1 -- 172.21.15.134:0/1224088632 wait complete. 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.213+0000 7fd56bb13640 1 Processor -- start 2024-09-15T22:49:17.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.213+0000 7fd56bb13640 1 -- start start 2024-09-15T22:49:17.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415e940 0x7fd56414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415ed20 0x7fd56414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5640d3f00 con 0x7fd5640cef90 2024-09-15T22:49:17.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5640d3c20 con 0x7fd56415ed20 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd56bb13640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fd5640d3310 con 0x7fd56415e940 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd5698af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd5698af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57412/0 (socket says 172.21.15.134:57412) 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.214+0000 7fd5698af640 1 -- 172.21.15.134:0/3530474996 learned_addr learned my addr 172.21.15.134:0/3530474996 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd56a0b0640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415ed20 0x7fd56414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5690ae640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415e940 0x7fd56414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 -- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415e940 msgr2=0x7fd56414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415e940 0x7fd56414c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 -- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415ed20 msgr2=0x7fd56414ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415ed20 0x7fd56414ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 -- 172.21.15.134:0/3530474996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5641f8d70 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd5698af640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd5540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554037050 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd554038040 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5641f7fb0 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554004490 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.215+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5641f8570 con 0x7fd5640cef90 2024-09-15T22:49:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.216+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5640d1ef0 con 0x7fd5640cef90 2024-09-15T22:49:17.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.217+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fd55403c6d0 con 0x7fd5640cef90 2024-09-15T22:49:17.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.217+0000 7fd55a7fc640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 0x7fd54806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.217+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7fd5540aa870 con 0x7fd5640cef90 2024-09-15T22:49:17.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.217+0000 7fd5690ae640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 0x7fd54806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.218+0000 7fd5690ae640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 0x7fd54806f2b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd560009560 tx=0x7fd560009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.222+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd55407a1f0 con 0x7fd5640cef90 2024-09-15T22:49:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.395+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd5640ce5e0 con 0x7fd54806cdf0 2024-09-15T22:49:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.395+0000 7fd55a7fc640 1 -- 172.21.15.134:0/3530474996 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd560011a30 con 0x7fd54806cdf0 2024-09-15T22:49:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T22:49:17.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 msgr2=0x7fd54806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 0x7fd54806f2b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd560009560 tx=0x7fd560009190 comp rx=0 tx=0).stop 2024-09-15T22:49:17.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 msgr2=0x7fd564157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd5540046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 shutdown_connections 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd56415ed20 0x7fd56414ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd56415e940 0x7fd56414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fd54806cdf0 0x7fd54806f2b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 --2- 172.21.15.134:0/3530474996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5640cef90 0x7fd564157c80 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 >> 172.21.15.134:0/3530474996 conn(0x7fd5640b6240 msgr2=0x7fd5640b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 shutdown_connections 2024-09-15T22:49:17.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.398+0000 7fd56bb13640 1 -- 172.21.15.134:0/3530474996 wait complete. 2024-09-15T22:49:17.411 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T22:49:17.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:17.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 Processor -- start 2024-09-15T22:49:17.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 -- start start 2024-09-15T22:49:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12600b3b00 0x7f12600d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b3540 0x7f12600d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12600d20e0 con 0x7f12600b61e0 2024-09-15T22:49:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f12600d24f0 con 0x7f12600b3b00 2024-09-15T22:49:17.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f126725e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f12600cfa70 con 0x7f12600b3540 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.516+0000 7f125ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12600b3b00 0x7f12600d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12600b3b00 0x7f12600d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57414/0 (socket says 172.21.15.134:57414) 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 -- 172.21.15.134:0/4171645942 learned_addr learned my addr 172.21.15.134:0/4171645942 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f12657fb640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b3540 0x7f12600d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 -- 172.21.15.134:0/4171645942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b3540 msgr2=0x7f12600d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b3540 0x7f12600d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 -- 172.21.15.134:0/4171645942 >> v1:172.21.15.177:6789/0 conn(0x7f12600b61e0 legacy=0x7f12600b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.517+0000 7f125ffff640 1 -- 172.21.15.134:0/4171645942 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12600cfd50 con 0x7f12600b3b00 2024-09-15T22:49:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.518+0000 7f125ffff640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12600d2980 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f1250009e50 tx=0x7f125002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6996c4c8ae2cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.518+0000 7f125f7fe640 1 -- 172.21.15.134:0/4171645942 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250036070 con 0x7f12600b3b00 2024-09-15T22:49:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.518+0000 7f125f7fe640 1 -- 172.21.15.134:0/4171645942 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1250031600 con 0x7f12600b3b00 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.518+0000 7f125f7fe640 1 -- 172.21.15.134:0/4171645942 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12500319d0 con 0x7f12600b3b00 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.518+0000 7f126725e640 1 -- 172.21.15.134:0/4171645942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 msgr2=0x7f12600d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12600d2980 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f1250009e50 tx=0x7f125002a5f0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 -- 172.21.15.134:0/4171645942 shutdown_connections 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b3540 0x7f12600d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 --2- 172.21.15.134:0/4171645942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12600d2980 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 -- 172.21.15.134:0/4171645942 >> 172.21.15.134:0/4171645942 conn(0x7f12600d11e0 msgr2=0x7f12600d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 -- 172.21.15.134:0/4171645942 shutdown_connections 2024-09-15T22:49:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.519+0000 7f126725e640 1 -- 172.21.15.134:0/4171645942 wait complete. 2024-09-15T22:49:17.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.520+0000 7f126725e640 1 Processor -- start 2024-09-15T22:49:17.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.520+0000 7f126725e640 1 -- start start 2024-09-15T22:49:17.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12600b3540 0x7f126015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12601f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b61e0 0x7f12601f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f126015edc0 con 0x7f12600b3b00 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12600d1d00 con 0x7f12600b3540 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f126015c4d0 con 0x7f12600b61e0 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12601f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12601f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57428/0 (socket says 172.21.15.134:57428) 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 -- 172.21.15.134:0/1668282017 learned_addr learned my addr 172.21.15.134:0/1668282017 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f1264ffa640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12600b3540 0x7f126015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f12657fb640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b61e0 0x7f12601f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 -- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b61e0 msgr2=0x7f12601f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12600b61e0 0x7f12601f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 -- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12600b3540 msgr2=0x7f126015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12600b3540 0x7f126015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12600ac620 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125ffff640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12601f5350 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1250034040 tx=0x7f1250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250036050 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1250042070 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250009510 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.521+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12600cc2e0 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.522+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12600cc8a0 con 0x7f12600b3b00 2024-09-15T22:49:17.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.522+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12600b65c0 con 0x7f12600b3b00 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.523+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f1250007c50 con 0x7f12600b3b00 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.523+0000 7f125d7fa640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f124006cdf0 0x7f124006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f12500ab480 con 0x7f12600b3b00 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f1264ffa640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f124006cdf0 0x7f124006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f125d7fa640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f1240072cb0 0x7f12400750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1250052ea0 con 0x7f1240072cb0 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7f12500ae180 con 0x7f12600b3b00 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f12657fb640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f1240072cb0 0x7f12400750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f1264ffa640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f124006cdf0 0x7f124006f2b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1260162c00 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.524+0000 7f12657fb640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f1240072cb0 0x7f12400750f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.525+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== osd.2 v2:172.21.15.134:6816/802177628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1250052ea0 con 0x7f1240072cb0 2024-09-15T22:49:17.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.537+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 --> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12600ba6e0 con 0x7f1240072cb0 2024-09-15T22:49:17.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f125d7fa640 1 -- 172.21.15.134:0/1668282017 <== osd.2 v2:172.21.15.134:6816/802177628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f12600ba6e0 con 0x7f1240072cb0 2024-09-15T22:49:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f1240072cb0 msgr2=0x7f12400750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:6816/802177628,v1:172.21.15.134:6817/802177628] conn(0x7f1240072cb0 0x7f12400750f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f124006cdf0 msgr2=0x7f124006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f124006cdf0 0x7f124006f2b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1260162c00 tx=0x7f1258009040 comp rx=0 tx=0).stop 2024-09-15T22:49:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 msgr2=0x7f12601f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 --2- 172.21.15.134:0/1668282017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12600b3b00 0x7f12601f5350 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1250034040 tx=0x7f1250004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f12657fb640 1 -- 172.21.15.134:0/1668282017 reap_dead start 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 shutdown_connections 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 >> 172.21.15.134:0/1668282017 conn(0x7f12600d11e0 msgr2=0x7f126015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 shutdown_connections 2024-09-15T22:49:17.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.538+0000 7f126725e640 1 -- 172.21.15.134:0/1668282017 wait complete. 2024-09-15T22:49:17.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T22:49:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.648+0000 7f11d5f3a640 1 Processor -- start 2024-09-15T22:49:17.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.648+0000 7f11d5f3a640 1 -- start start 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11d5f3a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 0x7f11d00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11d5f3a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11d015ed20 0x7f11d00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11d5f3a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d00b7170 con 0x7f11d00cef90 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11d5f3a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f11d00d1ae0 con 0x7f11d015ed20 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11d5f3a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f11d00b7aa0 con 0x7f11d015e940 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11c7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11d015ed20 0x7f11d00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11c7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11d015ed20 0x7f11d00d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57434/0 (socket says 172.21.15.134:57434) 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.649+0000 7f11c7fff640 1 -- 172.21.15.134:0/2480570191 learned_addr learned my addr 172.21.15.134:0/2480570191 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11cf7fe640 1 --2- 172.21.15.134:0/2480570191 >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 0x7f11d00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11c7fff640 1 -- 172.21.15.134:0/2480570191 >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 msgr2=0x7f11d00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11c7fff640 1 --2- 172.21.15.134:0/2480570191 >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 0x7f11d00d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11c7fff640 1 -- 172.21.15.134:0/2480570191 >> v1:172.21.15.177:6789/0 conn(0x7f11d00cef90 legacy=0x7f11d00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11c7fff640 1 -- 172.21.15.134:0/2480570191 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d00d3660 con 0x7f11d015ed20 2024-09-15T22:49:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11cf7fe640 1 --2- 172.21.15.134:0/2480570191 >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 0x7f11d00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:17.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.650+0000 7f11c7fff640 1 --2- 172.21.15.134:0/2480570191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015ed20 0x7f11d00d15a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f11d00509d0 tx=0x7f11b802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337a332ee98490b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11ceffd640 1 -- 172.21.15.134:0/2480570191 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8037070 con 0x7f11d015ed20 2024-09-15T22:49:17.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11ceffd640 1 -- 172.21.15.134:0/2480570191 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8032440 con 0x7f11d015ed20 2024-09-15T22:49:17.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11ceffd640 1 -- 172.21.15.134:0/2480570191 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8032810 con 0x7f11d015ed20 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 -- 172.21.15.134:0/2480570191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015ed20 msgr2=0x7f11d00d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/2480570191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015ed20 0x7f11d00d15a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f11d00509d0 tx=0x7f11b802a2c0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 -- 172.21.15.134:0/2480570191 shutdown_connections 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/2480570191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015ed20 0x7f11d00d15a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/2480570191 >> v2:172.21.15.177:3300/0 conn(0x7f11d015e940 0x7f11d00d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 -- 172.21.15.134:0/2480570191 >> 172.21.15.134:0/2480570191 conn(0x7f11d00b6240 msgr2=0x7f11d00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 -- 172.21.15.134:0/2480570191 shutdown_connections 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.651+0000 7f11d5f3a640 1 -- 172.21.15.134:0/2480570191 wait complete. 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.652+0000 7f11d5f3a640 1 Processor -- start 2024-09-15T22:49:17.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.652+0000 7f11d5f3a640 1 -- start start 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11d00cef90 0x7f11d00ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11d015ed20 0x7f11d00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00d3f00 con 0x7f11d015e940 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00d3c20 con 0x7f11d015ed20 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11d5f3a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f11d00d3310 con 0x7f11d00cef90 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57450/0 (socket says 172.21.15.134:57450) 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11c7fff640 1 -- 172.21.15.134:0/4003592808 learned_addr learned my addr 172.21.15.134:0/4003592808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11cf7fe640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11d00cef90 0x7f11d00ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.653+0000 7f11cffff640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11d015ed20 0x7f11d00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 -- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11d00cef90 msgr2=0x7f11d00ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11d00cef90 0x7f11d00ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 -- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11d015ed20 msgr2=0x7f11d00ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11d015ed20 0x7f11d00ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 -- 172.21.15.134:0/4003592808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d0159a80 con 0x7f11d015e940 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11c7fff640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f11b8000c00 tx=0x7f11b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8041020 con 0x7f11d015e940 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8030970 con 0x7f11d015e940 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8037040 con 0x7f11d015e940 2024-09-15T22:49:17.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d0159d60 con 0x7f11d015e940 2024-09-15T22:49:17.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.654+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d015a320 con 0x7f11d015e940 2024-09-15T22:49:17.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.655+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d00d1ef0 con 0x7f11d015e940 2024-09-15T22:49:17.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.656+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f11b8044020 con 0x7f11d015e940 2024-09-15T22:49:17.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.656+0000 7f11ccff9640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 0x7f11b006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.656+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f11b80aa600 con 0x7f11d015e940 2024-09-15T22:49:17.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.656+0000 7f11cf7fe640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 0x7f11b006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.657+0000 7f11cf7fe640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 0x7f11b006f2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ab60 tx=0x7f11c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.660+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b804b030 con 0x7f11d015e940 2024-09-15T22:49:17.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.832+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f11d00ba6b0 con 0x7f11b006ce20 2024-09-15T22:49:17.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.832+0000 7f11ccff9640 1 -- 172.21.15.134:0/4003592808 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11d00ba6b0 con 0x7f11b006ce20 2024-09-15T22:49:17.834 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T22:49:17.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 msgr2=0x7f11b006f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 0x7f11b006f2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ab60 tx=0x7f11c0008040 comp rx=0 tx=0).stop 2024-09-15T22:49:17.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 msgr2=0x7f11d014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f11b8000c00 tx=0x7f11b80046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 shutdown_connections 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11d015ed20 0x7f11d00ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f11b006ce20 0x7f11b006f2e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d015e940 0x7f11d014a340 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 --2- 172.21.15.134:0/4003592808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11d00cef90 0x7f11d00ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 >> 172.21.15.134:0/4003592808 conn(0x7f11d00b6240 msgr2=0x7f11d00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 shutdown_connections 2024-09-15T22:49:17.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.835+0000 7f11d5f3a640 1 -- 172.21.15.134:0/4003592808 wait complete. 2024-09-15T22:49:17.847 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T22:49:17.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:17.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.950+0000 7efe556e6640 1 Processor -- start 2024-09-15T22:49:17.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.950+0000 7efe556e6640 1 -- start start 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe556e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe500ccb80 0x7efe5015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe556e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe50072d10 0x7efe500b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe556e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe500b3570 con 0x7efe500b4c50 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe556e6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efe500b50a0 con 0x7efe500ccb80 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe556e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7efe500b3850 con 0x7efe50072d10 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe4effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe500ccb80 0x7efe5015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe4effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe500ccb80 0x7efe5015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57466/0 (socket says 172.21.15.134:57466) 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.951+0000 7efe4effd640 1 -- 172.21.15.134:0/2331948945 learned_addr learned my addr 172.21.15.134:0/2331948945 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4effd640 1 -- 172.21.15.134:0/2331948945 >> v2:172.21.15.177:3300/0 conn(0x7efe50072d10 msgr2=0x7efe500b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4e7fc640 1 --2- 172.21.15.134:0/2331948945 >> v2:172.21.15.177:3300/0 conn(0x7efe50072d10 0x7efe500b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4effd640 1 --2- 172.21.15.134:0/2331948945 >> v2:172.21.15.177:3300/0 conn(0x7efe50072d10 0x7efe500b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4effd640 1 -- 172.21.15.134:0/2331948945 >> v1:172.21.15.177:6789/0 conn(0x7efe500b4c50 legacy=0x7efe5015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4effd640 1 -- 172.21.15.134:0/2331948945 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe500b3b30 con 0x7efe500ccb80 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.952+0000 7efe4effd640 1 --2- 172.21.15.134:0/2331948945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe5015bbd0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efe50158c90 tx=0x7efe4002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67442597b9266d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe4dffb640 1 -- 172.21.15.134:0/2331948945 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe400325a0 con 0x7efe500ccb80 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe4dffb640 1 -- 172.21.15.134:0/2331948945 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40038070 con 0x7efe500ccb80 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe4dffb640 1 -- 172.21.15.134:0/2331948945 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40032960 con 0x7efe500ccb80 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 -- 172.21.15.134:0/2331948945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 msgr2=0x7efe5015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 --2- 172.21.15.134:0/2331948945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe5015bbd0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efe50158c90 tx=0x7efe4002c8e0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 -- 172.21.15.134:0/2331948945 shutdown_connections 2024-09-15T22:49:17.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 --2- 172.21.15.134:0/2331948945 >> v2:172.21.15.177:3300/0 conn(0x7efe50072d10 0x7efe500b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 --2- 172.21.15.134:0/2331948945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe5015bbd0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 -- 172.21.15.134:0/2331948945 >> 172.21.15.134:0/2331948945 conn(0x7efe5006bba0 msgr2=0x7efe5006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 -- 172.21.15.134:0/2331948945 shutdown_connections 2024-09-15T22:49:17.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.953+0000 7efe556e6640 1 -- 172.21.15.134:0/2331948945 wait complete. 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 Processor -- start 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 -- start start 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 0x7efe50147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe500b4c50 0x7efe5015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe500cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe500b43d0 con 0x7efe500ccb80 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe500b40f0 con 0x7efe50072d10 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.955+0000 7efe556e6640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7efe500ccf60 con 0x7efe500b4c50 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe500cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 0x7efe50147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe500cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57480/0 (socket says 172.21.15.134:57480) 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4f7fe640 1 -- 172.21.15.134:0/3044878789 learned_addr learned my addr 172.21.15.134:0/3044878789 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 0x7efe50147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37660/0 (socket says 172.21.15.134:37660) 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4e7fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe500b4c50 0x7efe5015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 -- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe500b4c50 msgr2=0x7efe5015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe500b4c50 0x7efe5015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 -- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 msgr2=0x7efe500cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe500cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe50148460 con 0x7efe50072d10 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4e7fc640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe500b4c50 0x7efe5015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4f7fe640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe500ccb80 0x7efe500cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe4effd640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 0x7efe50147f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe40034000 tx=0x7efe40004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40043070 con 0x7efe50072d10 2024-09-15T22:49:17.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40033c90 con 0x7efe50072d10 2024-09-15T22:49:17.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5015cca0 con 0x7efe50072d10 2024-09-15T22:49:17.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4003c660 con 0x7efe50072d10 2024-09-15T22:49:17.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.956+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5015d260 con 0x7efe50072d10 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.957+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe500b4710 con 0x7efe50072d10 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7efe40046070 con 0x7efe50072d10 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3c06cdf0 0x7efe3c06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7efe40030020 con 0x7efe50072d10 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7efe3c072cb0 0x7efe3c0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe40004490 con 0x7efe3c072cb0 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7efe400ad870 con 0x7efe50072d10 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.958+0000 7efe4e7fc640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3c06cdf0 0x7efe3c06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.959+0000 7efe4f7fe640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7efe3c072cb0 0x7efe3c0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:17.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.959+0000 7efe4e7fc640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3c06cdf0 0x7efe3c06f2b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efe5006df80 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.959+0000 7efe4f7fe640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7efe3c072cb0 0x7efe3c0750f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:17.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.960+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== osd.3 v2:172.21.15.134:6808/1380536575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe40004490 con 0x7efe3c072cb0 2024-09-15T22:49:17.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 --> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efe5015f0f0 con 0x7efe3c072cb0 2024-09-15T22:49:17.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe377fe640 1 -- 172.21.15.134:0/3044878789 <== osd.3 v2:172.21.15.134:6808/1380536575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efe5015f0f0 con 0x7efe3c072cb0 2024-09-15T22:49:17.974 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:17.974 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:17.974 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7efe3c072cb0 msgr2=0x7efe3c0750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.134:6808/1380536575,v1:172.21.15.134:6809/1380536575] conn(0x7efe3c072cb0 0x7efe3c0750f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3c06cdf0 msgr2=0x7efe3c06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7efe3c06cdf0 0x7efe3c06f2b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efe5006df80 tx=0x7efe44008040 comp rx=0 tx=0).stop 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 msgr2=0x7efe50147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 --2- 172.21.15.134:0/3044878789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe50072d10 0x7efe50147f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe40034000 tx=0x7efe40004730 comp rx=0 tx=0).stop 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe4f7fe640 1 -- 172.21.15.134:0/3044878789 reap_dead start 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 shutdown_connections 2024-09-15T22:49:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.972+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 >> 172.21.15.134:0/3044878789 conn(0x7efe5006bba0 msgr2=0x7efe5006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.973+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 shutdown_connections 2024-09-15T22:49:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:17.973+0000 7efe556e6640 1 -- 172.21.15.134:0/3044878789 wait complete. 2024-09-15T22:49:17.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T22:49:18.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.083+0000 7f2a0155f640 1 Processor -- start 2024-09-15T22:49:18.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.083+0000 7f2a0155f640 1 -- start start 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f2a0155f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 0x7f29fc0d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f2a0155f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29fc074200 con 0x7f29fc0b4b70 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f2a0155f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29fc0b6e80 con 0x7f29fc15e500 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f2a0155f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc0b7160 con 0x7f29fc15e8e0 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29f3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f29fc0b4b70 0x7f29fc0d2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48180/0 (socket says 172.21.15.134:48180) 2024-09-15T22:49:18.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29f3fff640 1 -- 172.21.15.134:0/1672223636 learned_addr learned my addr 172.21.15.134:0/1672223636 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fb7fe640 1 --2- 172.21.15.134:0/1672223636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 0x7f29fc0d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847208209 0 0) 0x7f29fc074200 con 0x7f29fc0b4b70 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e8003520 con 0x7f29fc0b4b70 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803754817 0 0) 0x7f29fc0b6e80 con 0x7f29fc15e500 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29fc074200 con 0x7f29fc15e500 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1672223636 >> v1:172.21.15.177:6789/0 conn(0x7f29fc15e500 legacy=0x7f29fc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1672223636 >> v1:172.21.15.134:6789/0 conn(0x7f29fc0b4b70 legacy=0x7f29fc0d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.084+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1672223636 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc0b7440 con 0x7f29fc15e8e0 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.085+0000 7f29fb7fe640 1 --2- 172.21.15.134:0/1672223636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 0x7f29fc0d2b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009dc0 tx=0x7f29f402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4b6939e4a89bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.085+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f402ae60 con 0x7f29fc15e8e0 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.085+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f4007740 con 0x7f29fc15e8e0 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.085+0000 7f29fa7fc640 1 -- 172.21.15.134:0/1672223636 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007af0 con 0x7f29fc15e8e0 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 -- 172.21.15.134:0/1672223636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 msgr2=0x7f29fc0d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1672223636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 0x7f29fc0d2b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009dc0 tx=0x7f29f402a640 comp rx=0 tx=0).stop 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 -- 172.21.15.134:0/1672223636 shutdown_connections 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1672223636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e8e0 0x7f29fc0d2b70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 -- 172.21.15.134:0/1672223636 >> 172.21.15.134:0/1672223636 conn(0x7f29fc062810 msgr2=0x7f29fc062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 -- 172.21.15.134:0/1672223636 shutdown_connections 2024-09-15T22:49:18.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.086+0000 7f2a0155f640 1 -- 172.21.15.134:0/1672223636 wait complete. 2024-09-15T22:49:18.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.087+0000 7f2a0155f640 1 Processor -- start 2024-09-15T22:49:18.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.087+0000 7f2a0155f640 1 -- start start 2024-09-15T22:49:18.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29fc0b4b70 0x7f29fc153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e500 0x7f29fc0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc06ce30 con 0x7f29fc15e8e0 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc06ccb0 con 0x7f29fc0b4b70 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f2a0155f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc073cb0 con 0x7f29fc15e500 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57494/0 (socket says 172.21.15.134:57494) 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1515858771 learned_addr learned my addr 172.21.15.134:0/1515858771 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29f3fff640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e500 0x7f29fc0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29faffd640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29fc0b4b70 0x7f29fc153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e500 msgr2=0x7f29fc0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e500 0x7f29fc0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29fc0b4b70 msgr2=0x7f29fc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29fc0b4b70 0x7f29fc153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 -- 172.21.15.134:0/1515858771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc157430 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.088+0000 7f29fb7fe640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f29f402ac30 tx=0x7f29f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.089+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f403f070 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.089+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f4031a40 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.089+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29fc157770 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.089+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4009450 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.089+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29fc157fb0 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.090+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29fc1581b0 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.090+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f29f4031c30 con 0x7f29fc15e8e0 2024-09-15T22:49:18.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.090+0000 7f29f37fe640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 0x7f29dc06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.091+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f29f40ab4d0 con 0x7f29fc15e8e0 2024-09-15T22:49:18.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.091+0000 7f29faffd640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 0x7f29dc06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.091+0000 7f29faffd640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 0x7f29dc06f2b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001650 tx=0x7f29ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.095+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29fc1581b0 con 0x7f29fc15e8e0 2024-09-15T22:49:18.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.261+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f29fc0d1cf0 con 0x7f29dc06cdf0 2024-09-15T22:49:18.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.261+0000 7f29f37fe640 1 -- 172.21.15.134:0/1515858771 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f29fc0d1cf0 con 0x7f29dc06cdf0 2024-09-15T22:49:18.263 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T22:49:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 msgr2=0x7f29dc06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 0x7f29dc06f2b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001650 tx=0x7f29ec009040 comp rx=0 tx=0).stop 2024-09-15T22:49:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 msgr2=0x7f29fc1f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f29f402ac30 tx=0x7f29f4004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:18.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 shutdown_connections 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f29dc06cdf0 0x7f29dc06f2b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29fc15e8e0 0x7f29fc1f6b90 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29fc15e500 0x7f29fc0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 --2- 172.21.15.134:0/1515858771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29fc0b4b70 0x7f29fc153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.263+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 >> 172.21.15.134:0/1515858771 conn(0x7f29fc062810 msgr2=0x7f29fc15c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.264+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 shutdown_connections 2024-09-15T22:49:18.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.264+0000 7f2a0155f640 1 -- 172.21.15.134:0/1515858771 wait complete. 2024-09-15T22:49:18.276 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T22:49:18.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:18.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.377+0000 7f3787a2e640 1 Processor -- start 2024-09-15T22:49:18.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.377+0000 7f3787a2e640 1 -- start start 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3787a2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 0x7f3780070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3787a2e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 0x7f378006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3787a2e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3780162260 con 0x7f37800d1990 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3787a2e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f37800d2320 con 0x7f37800b5590 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3787a2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3780162540 con 0x7f37800b7540 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f37857ca640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f37800d1990 0x7f37800b6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48190/0 (socket says 172.21.15.134:48190) 2024-09-15T22:49:18.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f37857ca640 1 -- 172.21.15.134:0/2038508786 learned_addr learned my addr 172.21.15.134:0/2038508786 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3784fc9640 1 --2- 172.21.15.134:0/2038508786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 0x7f3780070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3785fcb640 1 --2- 172.21.15.134:0/2038508786 >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 0x7f378006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710558718 0 0) 0x7f3780162260 con 0x7f37800d1990 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.378+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f376c003520 con 0x7f37800d1990 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3784fc9640 1 -- 172.21.15.134:0/2038508786 >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 msgr2=0x7f378006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4254813352 0 0) 0x7f376c003520 con 0x7f37800d1990 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3784fc9640 1 --2- 172.21.15.134:0/2038508786 >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 0x7f378006cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3784fc9640 1 -- 172.21.15.134:0/2038508786 >> v1:172.21.15.134:6789/0 conn(0x7f37800d1990 legacy=0x7f37800b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3784fc9640 1 -- 172.21.15.134:0/2038508786 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780162820 con 0x7f37800b7540 2024-09-15T22:49:18.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3785fcb640 1 --2- 172.21.15.134:0/2038508786 >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 0x7f378006cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:18.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.379+0000 7f3784fc9640 1 --2- 172.21.15.134:0/2038508786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 0x7f3780070c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f37700097a0 tx=0x7f377002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdadf1f1571ade0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770037070 con 0x7f37800b7540 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377002ab10 con 0x7f37800b7540 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3777fff640 1 -- 172.21.15.134:0/2038508786 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c001670 con 0x7f37800b7540 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 -- 172.21.15.134:0/2038508786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 msgr2=0x7f3780070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 --2- 172.21.15.134:0/2038508786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 0x7f3780070c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f37700097a0 tx=0x7f377002a080 comp rx=0 tx=0).stop 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 -- 172.21.15.134:0/2038508786 shutdown_connections 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 --2- 172.21.15.134:0/2038508786 >> v2:172.21.15.177:3300/0 conn(0x7f37800b5590 0x7f378006cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 --2- 172.21.15.134:0/2038508786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b7540 0x7f3780070c00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 -- 172.21.15.134:0/2038508786 >> 172.21.15.134:0/2038508786 conn(0x7f378006f390 msgr2=0x7f378006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 -- 172.21.15.134:0/2038508786 shutdown_connections 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.380+0000 7f3787a2e640 1 -- 172.21.15.134:0/2038508786 wait complete. 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.381+0000 7f3787a2e640 1 Processor -- start 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.381+0000 7f3787a2e640 1 -- start start 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b5590 0x7f3780150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37800b7540 0x7f37800ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 0x7f378015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37800d1d70 con 0x7f37800d1990 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3780162de0 con 0x7f37800b7540 2024-09-15T22:49:18.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3787a2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f378006d2f0 con 0x7f37800b5590 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3785fcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 0x7f378015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3785fcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 0x7f378015ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57502/0 (socket says 172.21.15.134:57502) 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3785fcb640 1 -- 172.21.15.134:0/997423548 learned_addr learned my addr 172.21.15.134:0/997423548 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f37857ca640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b5590 0x7f3780150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.382+0000 7f3784fc9640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37800b7540 0x7f37800ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 -- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b5590 msgr2=0x7f3780150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b5590 0x7f3780150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 -- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37800b7540 msgr2=0x7f37800ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37800b7540 0x7f37800ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780150590 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f37857ca640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37800b5590 0x7f3780150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3785fcb640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 0x7f378015ea50 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3778009f00 tx=0x7f377800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778018030 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377800ce50 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37801f4f70 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778003bb0 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.383+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37800aa850 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.384+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f378006cdb0 con 0x7f37800d1990 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.384+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f3778005d10 con 0x7f37800d1990 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3775ffb640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f376406cdf0 0x7f376406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f377808a630 con 0x7f37800d1990 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3775ffb640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f3764072cb0 0x7f37640750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f377800be50 con 0x7f3764072cb0 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7f37780912a0 con 0x7f37800d1990 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f37857ca640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f376406cdf0 0x7f376406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f3784fc9640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f3764072cb0 0x7f37640750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.385+0000 7f37857ca640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f376406cdf0 0x7f376406f2b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f377c005880 tx=0x7f377c0057f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.386+0000 7f3784fc9640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f3764072cb0 0x7f37640750f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.386+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== osd.4 v2:172.21.15.177:6809/324643051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f377800be50 con 0x7f3764072cb0 2024-09-15T22:49:18.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.398+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 --> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37800abac0 con 0x7f3764072cb0 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.399+0000 7f3775ffb640 1 -- 172.21.15.134:0/997423548 <== osd.4 v2:172.21.15.177:6809/324643051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37800abac0 con 0x7f3764072cb0 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:18.401 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:18.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.399+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f3764072cb0 msgr2=0x7f37640750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.399+0000 7f3787a2e640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6809/324643051,v1:172.21.15.177:6810/324643051] conn(0x7f3764072cb0 0x7f37640750f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f376406cdf0 msgr2=0x7f376406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f376406cdf0 0x7f376406f2b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f377c005880 tx=0x7f377c0057f0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 msgr2=0x7f378015ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 --2- 172.21.15.134:0/997423548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37800d1990 0x7f378015ea50 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3778009f00 tx=0x7f377800c490 comp rx=0 tx=0).stop 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3785fcb640 1 -- 172.21.15.134:0/997423548 reap_dead start 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 shutdown_connections 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 >> 172.21.15.134:0/997423548 conn(0x7f378006f390 msgr2=0x7f37800b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 shutdown_connections 2024-09-15T22:49:18.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.400+0000 7f3787a2e640 1 -- 172.21.15.134:0/997423548 wait complete. 2024-09-15T22:49:18.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T22:49:18.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.509+0000 7fb47dad0640 1 Processor -- start 2024-09-15T22:49:18.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.509+0000 7fb47dad0640 1 -- start start 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb47dad0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb47815ca40 0x7fb47815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb47dad0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47815d390 con 0x7fb4780d02a0 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb47dad0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47815d670 con 0x7fb47815ceb0 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb47dad0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7fb47815d950 con 0x7fb47815ca40 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb4777fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb4780d02a0 0x7fb4780d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48194/0 (socket says 172.21.15.134:48194) 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb4777fe640 1 -- 172.21.15.134:0/535697244 learned_addr learned my addr 172.21.15.134:0/535697244 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb476ffd640 1 --2- 172.21.15.134:0/535697244 >> v2:172.21.15.177:3300/0 conn(0x7fb47815ca40 0x7fb47815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282280046 0 0) 0x7fb47815d390 con 0x7fb4780d02a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.510+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb460005730 con 0x7fb4780d02a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4266693865 0 0) 0x7fb460005730 con 0x7fb4780d02a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 >> v2:172.21.15.177:3300/0 conn(0x7fb47815ca40 msgr2=0x7fb47815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 --2- 172.21.15.134:0/535697244 >> v2:172.21.15.177:3300/0 conn(0x7fb47815ca40 0x7fb47815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 >> v1:172.21.15.177:6789/0 conn(0x7fb47815ceb0 legacy=0x7fb4781594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47815dc30 con 0x7fb4780d02a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3959073202 0 0) 0x7fb468001670 con 0x7fb4780d02a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 >> v1:172.21.15.134:6789/0 conn(0x7fb4780d02a0 legacy=0x7fb4780d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 0x7fb460005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb460006a10 0x7fb460006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4600073d0 0x7fb46000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb47815d950 con 0x7fb460005bc0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb46000e370 con 0x7fb460006a10 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb46000e570 con 0x7fb4600073d0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 0x7fb460005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb476ffd640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb460006a10 0x7fb460006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb477fff640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4600073d0 0x7fb46000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 -- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4600073d0 msgr2=0x7fb46000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4600073d0 0x7fb46000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 -- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb460006a10 msgr2=0x7fb460006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb460006a10 0x7fb460006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb4777fe640 1 -- 172.21.15.134:0/535697244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb460005730 con 0x7fb460005bc0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb477fff640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4600073d0 0x7fb46000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.511+0000 7fb477fff640 1 -- 172.21.15.134:0/535697244 reap_dead start 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb4777fe640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 0x7fb460005fe0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c210 tx=0x7fb460007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba9d7e6889512cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468007d30 con 0x7fb460005bc0 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb468005ad0 con 0x7fb460005bc0 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb4767fc640 1 -- 172.21.15.134:0/535697244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468007070 con 0x7fb460005bc0 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb47dad0640 1 -- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 msgr2=0x7fb460005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.512+0000 7fb47dad0640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 0x7fb460005fe0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c210 tx=0x7fb460007a40 comp rx=0 tx=0).stop 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.513+0000 7fb47dad0640 1 -- 172.21.15.134:0/535697244 shutdown_connections 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.513+0000 7fb47dad0640 1 --2- 172.21.15.134:0/535697244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb460005bc0 0x7fb460005fe0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.513+0000 7fb47dad0640 1 -- 172.21.15.134:0/535697244 >> 172.21.15.134:0/535697244 conn(0x7fb478062cc0 msgr2=0x7fb47806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.513+0000 7fb47dad0640 1 -- 172.21.15.134:0/535697244 shutdown_connections 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.513+0000 7fb47dad0640 1 -- 172.21.15.134:0/535697244 wait complete. 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.514+0000 7fb47dad0640 1 Processor -- start 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.514+0000 7fb47dad0640 1 -- start start 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb460005bc0 0x7fb47814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb478071a80 0x7fb47815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb478155d10 con 0x7fb478071f00 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb478155b90 con 0x7fb478071a80 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7fb4780b4790 con 0x7fb460005bc0 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57516/0 (socket says 172.21.15.134:57516) 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 -- 172.21.15.134:0/1876008910 learned_addr learned my addr 172.21.15.134:0/1876008910 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb4777fe640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb460005bc0 0x7fb47814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb476ffd640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb478071a80 0x7fb47815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 -- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb460005bc0 msgr2=0x7fb47814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb460005bc0 0x7fb47814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 -- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb478071a80 msgr2=0x7fb47815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb478071a80 0x7fb47815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 -- 172.21.15.134:0/1876008910 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb478072960 con 0x7fb478071f00 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb477fff640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb47815d2c0 tx=0x7fb47000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470019070 con 0x7fb478071f00 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb470003b80 con 0x7fb478071f00 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb478072c20 con 0x7fb478071f00 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4700050d0 con 0x7fb478071f00 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.515+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4780731e0 con 0x7fb478071f00 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.516+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4780d0680 con 0x7fb478071f00 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.517+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7fb470005270 con 0x7fb478071f00 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.517+0000 7fb45ffff640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 0x7fb46406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.517+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7fb470089130 con 0x7fb478071f00 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.517+0000 7fb4777fe640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 0x7fb46406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.518+0000 7fb4777fe640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 0x7fb46406f2e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb468033000 tx=0x7fb46802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.521+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb470058ab0 con 0x7fb478071f00 2024-09-15T22:49:18.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.688+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb4780cd990 con 0x7fb46406ce20 2024-09-15T22:49:18.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.689+0000 7fb45ffff640 1 -- 172.21.15.134:0/1876008910 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb4780cd990 con 0x7fb46406ce20 2024-09-15T22:49:18.690 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 msgr2=0x7fb46406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 0x7fb46406f2e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb468033000 tx=0x7fb46802e000 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 msgr2=0x7fb47815bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb47815d2c0 tx=0x7fb47000ead0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 shutdown_connections 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7fb46406ce20 0x7fb46406f2e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb478071f00 0x7fb47815bdc0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb478071a80 0x7fb47815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 --2- 172.21.15.134:0/1876008910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb460005bc0 0x7fb47814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 >> 172.21.15.134:0/1876008910 conn(0x7fb478062cc0 msgr2=0x7fb4780cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 shutdown_connections 2024-09-15T22:49:18.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.691+0000 7fb47dad0640 1 -- 172.21.15.134:0/1876008910 wait complete. 2024-09-15T22:49:18.703 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T22:49:18.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:18.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.805+0000 7ff4508dd640 1 Processor -- start 2024-09-15T22:49:18.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.805+0000 7ff4508dd640 1 -- start start 2024-09-15T22:49:18.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff4508dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff44c0b4f70 0x7ff44c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff4508dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff4508dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff44c15fcd0 con 0x7ff44c06fa40 2024-09-15T22:49:18.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff4508dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff44c06e9a0 con 0x7ff44c0b4f70 2024-09-15T22:49:18.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff4508dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff44c06ec80 con 0x7ff44c15fed0 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff44c0b4f70 0x7ff44c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff449d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff44c06fa40 0x7ff44c0b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48204/0 (socket says 172.21.15.134:48204) 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff449d9b640 1 -- 172.21.15.134:0/1134038340 learned_addr learned my addr 172.21.15.134:0/1134038340 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44ad9d640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44a59c640 1 -- 172.21.15.134:0/1134038340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 msgr2=0x7ff44c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44a59c640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44a59c640 1 -- 172.21.15.134:0/1134038340 >> v1:172.21.15.134:6789/0 conn(0x7ff44c06fa40 legacy=0x7ff44c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44a59c640 1 -- 172.21.15.134:0/1134038340 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44c06ef60 con 0x7ff44c0b4f70 2024-09-15T22:49:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.806+0000 7ff44959a640 1 -- 172.21.15.134:0/1134038340 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099175756 0 0) 0x7ff440001110 con 0x7ff44c06fa40 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.807+0000 7ff44a59c640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0b4f70 0x7ff44c15f790 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009d90 tx=0x7ff43c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781914aa0cd4ba93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.807+0000 7ff44959a640 1 -- 172.21.15.134:0/1134038340 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c007740 con 0x7ff44c0b4f70 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.807+0000 7ff44959a640 1 -- 172.21.15.134:0/1134038340 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c0078e0 con 0x7ff44c0b4f70 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.807+0000 7ff44959a640 1 -- 172.21.15.134:0/1134038340 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c007cb0 con 0x7ff44c0b4f70 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 -- 172.21.15.134:0/1134038340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0b4f70 msgr2=0x7ff44c15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0b4f70 0x7ff44c15f790 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009d90 tx=0x7ff43c02a6f0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 -- 172.21.15.134:0/1134038340 shutdown_connections 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1134038340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0b4f70 0x7ff44c15f790 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 -- 172.21.15.134:0/1134038340 >> 172.21.15.134:0/1134038340 conn(0x7ff44c062810 msgr2=0x7ff44c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 -- 172.21.15.134:0/1134038340 shutdown_connections 2024-09-15T22:49:18.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.808+0000 7ff4508dd640 1 -- 172.21.15.134:0/1134038340 wait complete. 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.809+0000 7ff4508dd640 1 Processor -- start 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.809+0000 7ff4508dd640 1 -- start start 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 0x7ff44c146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff44c0b4f70 0x7ff44c147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c06e620 con 0x7ff44c06fa40 2024-09-15T22:49:18.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c06f520 con 0x7ff44c0b4f70 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff4508dd640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7ff44c06fe90 con 0x7ff44c15fed0 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 0x7ff44c146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 0x7ff44c146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57532/0 (socket says 172.21.15.134:57532) 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 -- 172.21.15.134:0/1072011015 learned_addr learned my addr 172.21.15.134:0/1072011015 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff449d9b640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff44c0b4f70 0x7ff44c147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44ad9d640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 -- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 msgr2=0x7ff44c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff44c15fed0 0x7ff44c15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 -- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff44c0b4f70 msgr2=0x7ff44c147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff44c0b4f70 0x7ff44c147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.810+0000 7ff44a59c640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44c15d970 con 0x7ff44c06fa40 2024-09-15T22:49:18.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff44a59c640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 0x7ff44c146e10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009d90 tx=0x7ff43c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c040030 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c031a40 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44c15dc50 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c009450 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.811+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff44c15e210 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.812+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff44c06bd50 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.812+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7ff43c03b410 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff43affd640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff42c06ce20 0x7ff42c06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7ff43c0aae20 con 0x7ff44c06fa40 2024-09-15T22:49:18.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff43affd640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7ff42c072ce0 0x7ff42c075120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff43c047e50 con 0x7ff42c072ce0 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7ff43c0b4050 con 0x7ff44c06fa40 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff449d9b640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff42c06ce20 0x7ff42c06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff44ad9d640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7ff42c072ce0 0x7ff42c075120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.813+0000 7ff449d9b640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff42c06ce20 0x7ff42c06f2e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff44c1e9c10 tx=0x7ff440007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.814+0000 7ff44ad9d640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7ff42c072ce0 0x7ff42c075120 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.814+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== osd.5 v2:172.21.15.177:6800/3233781875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff43c047e50 con 0x7ff42c072ce0 2024-09-15T22:49:18.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 --> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff44c13fe20 con 0x7ff42c072ce0 2024-09-15T22:49:18.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff43affd640 1 -- 172.21.15.134:0/1072011015 <== osd.5 v2:172.21.15.177:6800/3233781875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff44c13fe20 con 0x7ff42c072ce0 2024-09-15T22:49:18.829 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:18.829 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:18.829 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7ff42c072ce0 msgr2=0x7ff42c075120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6800/3233781875,v1:172.21.15.177:6801/3233781875] conn(0x7ff42c072ce0 0x7ff42c075120 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff42c06ce20 msgr2=0x7ff42c06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7ff42c06ce20 0x7ff42c06f2e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff44c1e9c10 tx=0x7ff440007de0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 msgr2=0x7ff44c146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 --2- 172.21.15.134:0/1072011015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c06fa40 0x7ff44c146e10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009d90 tx=0x7ff43c004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:18.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff44ad9d640 1 -- 172.21.15.134:0/1072011015 reap_dead start 2024-09-15T22:49:18.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 shutdown_connections 2024-09-15T22:49:18.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 >> 172.21.15.134:0/1072011015 conn(0x7ff44c062810 msgr2=0x7ff44c160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 shutdown_connections 2024-09-15T22:49:18.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.827+0000 7ff4508dd640 1 -- 172.21.15.134:0/1072011015 wait complete. 2024-09-15T22:49:18.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T22:49:18.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.936+0000 7f8af9d5f640 1 Processor -- start 2024-09-15T22:49:18.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.936+0000 7f8af9d5f640 1 -- start start 2024-09-15T22:49:18.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af9d5f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 0x7f8af40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af9d5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8af415ce80 0x7f8af41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af9d5f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af40d0bc0 con 0x7f8af415ca40 2024-09-15T22:49:18.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af9d5f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f8af415d390 con 0x7f8af415ce80 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af9d5f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8af415d670 con 0x7f8af40d02a0 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af2ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8af415ca40 0x7f8af415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48220/0 (socket says 172.21.15.134:48220) 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.937+0000 7f8af2ffd640 1 -- 172.21.15.134:0/2792091184 learned_addr learned my addr 172.21.15.134:0/2792091184 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af3fff640 1 --2- 172.21.15.134:0/2792091184 >> v2:172.21.15.177:3300/0 conn(0x7f8af415ce80 0x7f8af41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af37fe640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 0x7f8af40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930784864 0 0) 0x7f8af40d0bc0 con 0x7f8af415ca40 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003520 con 0x7f8af415ca40 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4153747085 0 0) 0x7f8adc003520 con 0x7f8af415ca40 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af3fff640 1 -- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 msgr2=0x7f8af40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af3fff640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 0x7f8af40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af3fff640 1 -- 172.21.15.134:0/2792091184 >> v1:172.21.15.134:6789/0 conn(0x7f8af415ca40 legacy=0x7f8af415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af3fff640 1 -- 172.21.15.134:0/2792091184 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af415d950 con 0x7f8af415ce80 2024-09-15T22:49:18.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.938+0000 7f8af37fe640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 0x7f8af40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:18.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af3fff640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ce80 0x7f8af41594c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d07349393fd4e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8001670 con 0x7f8af415ce80 2024-09-15T22:49:18.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec007540 con 0x7f8af415ce80 2024-09-15T22:49:18.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af27fc640 1 -- 172.21.15.134:0/2792091184 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0078f0 con 0x7f8af415ce80 2024-09-15T22:49:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ce80 msgr2=0x7f8af41594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ce80 0x7f8af41594c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec02a560 comp rx=0 tx=0).stop 2024-09-15T22:49:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2792091184 shutdown_connections 2024-09-15T22:49:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ce80 0x7f8af41594c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2792091184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af40d02a0 0x7f8af40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2792091184 >> 172.21.15.134:0/2792091184 conn(0x7f8af4062cc0 msgr2=0x7f8af406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2792091184 shutdown_connections 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.939+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2792091184 wait complete. 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 Processor -- start 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 -- start start 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ca40 0x7f8af414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af415ce80 0x7f8af4151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8af415eb40 con 0x7f8af40d02a0 2024-09-15T22:49:18.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8af415df10 con 0x7f8af415ca40 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.941+0000 7f8af9d5f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f8af4155b90 con 0x7f8af415ce80 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57536/0 (socket says 172.21.15.134:57536) 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 -- 172.21.15.134:0/2470894415 learned_addr learned my addr 172.21.15.134:0/2470894415 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af2ffd640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ca40 0x7f8af414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af3fff640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af415ce80 0x7f8af4151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 -- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af415ce80 msgr2=0x7f8af4151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af415ce80 0x7f8af4151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 -- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ca40 msgr2=0x7f8af414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ca40 0x7f8af414aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 -- 172.21.15.134:0/2470894415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af41f41e0 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af37fe640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400ec10 tx=0x7f8ae400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4017070 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae400cc30 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4013470 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af41581c0 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.942+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af414b400 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.943+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af40b4790 con 0x7f8af40d02a0 2024-09-15T22:49:18.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.944+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f8ae401a070 con 0x7f8af40d02a0 2024-09-15T22:49:18.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.944+0000 7f8adbfff640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 0x7f8ae006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.944+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f8ae408a2d0 con 0x7f8af40d02a0 2024-09-15T22:49:18.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.944+0000 7f8af2ffd640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 0x7f8ae006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.945+0000 7f8af2ffd640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 0x7f8ae006f2b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8af4072280 tx=0x7f8ae8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:18.948+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ae408ee20 con 0x7f8af40d02a0 2024-09-15T22:49:19.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.115+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f8af406d030 con 0x7f8ae006cdf0 2024-09-15T22:49:19.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.115+0000 7f8adbfff640 1 -- 172.21.15.134:0/2470894415 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8af406d030 con 0x7f8ae006cdf0 2024-09-15T22:49:19.117 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 msgr2=0x7f8ae006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 0x7f8ae006f2b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8af4072280 tx=0x7f8ae8009040 comp rx=0 tx=0).stop 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 msgr2=0x7f8af41f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400ec10 tx=0x7f8ae400c520 comp rx=0 tx=0).stop 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 shutdown_connections 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8af415ce80 0x7f8af4151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8af415ca40 0x7f8af414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f8ae006cdf0 0x7f8ae006f2b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 --2- 172.21.15.134:0/2470894415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af40d02a0 0x7f8af41f4c80 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.117+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 >> 172.21.15.134:0/2470894415 conn(0x7f8af4062cc0 msgr2=0x7f8af40d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.118+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 shutdown_connections 2024-09-15T22:49:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.118+0000 7f8af9d5f640 1 -- 172.21.15.134:0/2470894415 wait complete. 2024-09-15T22:49:19.129 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T22:49:19.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:19.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.231+0000 7f064bfb7640 1 Processor -- start 2024-09-15T22:49:19.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.231+0000 7f064bfb7640 1 -- start start 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064bfb7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f0644072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064bfb7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064415c970 con 0x7f064415f9f0 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064bfb7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064415bbb0 con 0x7f064415b370 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064bfb7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f064415fef0 con 0x7f064406f130 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064a554640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f064415f9f0 0x7f06440ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48222/0 (socket says 172.21.15.134:48222) 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f064a554640 1 -- 172.21.15.134:0/3840624182 learned_addr learned my addr 172.21.15.134:0/3840624182 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0649552640 1 --2- 172.21.15.134:0/3840624182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f0644072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543420606 0 0) 0x7f064415c970 con 0x7f064415f9f0 2024-09-15T22:49:19.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0630003520 con 0x7f064415f9f0 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174483035 0 0) 0x7f064415bbb0 con 0x7f064415b370 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f064415c970 con 0x7f064415b370 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3010040414 0 0) 0x7f0630003520 con 0x7f064415f9f0 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0649552640 1 -- 172.21.15.134:0/3840624182 >> v1:172.21.15.177:6789/0 conn(0x7f064415b370 legacy=0x7f064406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0649552640 1 -- 172.21.15.134:0/3840624182 >> v1:172.21.15.134:6789/0 conn(0x7f064415f9f0 legacy=0x7f06440ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.232+0000 7f0649552640 1 -- 172.21.15.134:0/3840624182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064415be90 con 0x7f064406f130 2024-09-15T22:49:19.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.233+0000 7f0649552640 1 --2- 172.21.15.134:0/3840624182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f0644072560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06340097d0 tx=0x7f063402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f4cd67a7e053bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.233+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634037070 con 0x7f064406f130 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.233+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063402ab90 con 0x7f064406f130 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.233+0000 7f0648d51640 1 -- 172.21.15.134:0/3840624182 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c001670 con 0x7f064406f130 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 -- 172.21.15.134:0/3840624182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 msgr2=0x7f0644072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 --2- 172.21.15.134:0/3840624182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f0644072560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06340097d0 tx=0x7f063402a100 comp rx=0 tx=0).stop 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 -- 172.21.15.134:0/3840624182 shutdown_connections 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 --2- 172.21.15.134:0/3840624182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f0644072560 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 -- 172.21.15.134:0/3840624182 >> 172.21.15.134:0/3840624182 conn(0x7f064406bba0 msgr2=0x7f064406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 -- 172.21.15.134:0/3840624182 shutdown_connections 2024-09-15T22:49:19.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.234+0000 7f064bfb7640 1 -- 172.21.15.134:0/3840624182 wait complete. 2024-09-15T22:49:19.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.235+0000 7f064bfb7640 1 Processor -- start 2024-09-15T22:49:19.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.235+0000 7f064bfb7640 1 -- start start 2024-09-15T22:49:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f064414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 0x7f06441f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f064415f9f0 0x7f06441f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06440731b0 con 0x7f064415b370 2024-09-15T22:49:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f064415c450 con 0x7f064415f9f0 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064bfb7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f064415b750 con 0x7f064406f130 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 0x7f06441f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 0x7f06441f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57550/0 (socket says 172.21.15.134:57550) 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 -- 172.21.15.134:0/539970295 learned_addr learned my addr 172.21.15.134:0/539970295 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649d53640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f064414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f064a554640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f064415f9f0 0x7f06441f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 -- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 msgr2=0x7f064414c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f064406f130 0x7f064414c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 -- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f064415f9f0 msgr2=0x7f06441f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f064415f9f0 0x7f06441f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.236+0000 7f0649552640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064406d9b0 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f0649552640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 0x7f06441f3f60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f06340098f0 tx=0x7f06340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634037050 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0634043070 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06440cf060 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634003ce0 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06440cf620 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.237+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06440cee10 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.238+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f0634048460 con 0x7f064415b370 2024-09-15T22:49:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f063a7fc640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f062806cdf0 0x7f062806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f06340aa4a0 con 0x7f064415b370 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f063a7fc640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7f0628072cb0 0x7f06280750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06280757c0 con 0x7f0628072cb0 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7f06340b22f0 con 0x7f064415b370 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f0649d53640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f062806cdf0 0x7f062806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f064a554640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7f0628072cb0 0x7f06280750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f0649d53640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f062806cdf0 0x7f062806f2b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0640001560 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.239+0000 7f064a554640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7f0628072cb0 0x7f06280750f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.240+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== osd.6 v2:172.21.15.177:6824/410834460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06280757c0 con 0x7f0628072cb0 2024-09-15T22:49:19.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.252+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 --> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0644072560 con 0x7f0628072cb0 2024-09-15T22:49:19.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f063a7fc640 1 -- 172.21.15.134:0/539970295 <== osd.6 v2:172.21.15.177:6824/410834460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0644072560 con 0x7f0628072cb0 2024-09-15T22:49:19.255 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:19.255 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:19.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7f0628072cb0 msgr2=0x7f06280750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6824/410834460,v1:172.21.15.177:6825/410834460] conn(0x7f0628072cb0 0x7f06280750f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f062806cdf0 msgr2=0x7f062806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f062806cdf0 0x7f062806f2b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0640001560 tx=0x7f0640009040 comp rx=0 tx=0).stop 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 msgr2=0x7f06441f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 --2- 172.21.15.134:0/539970295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f064415b370 0x7f06441f3f60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f06340098f0 tx=0x7f06340046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064a554640 1 -- 172.21.15.134:0/539970295 reap_dead start 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 shutdown_connections 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 >> 172.21.15.134:0/539970295 conn(0x7f064406bba0 msgr2=0x7f064406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 shutdown_connections 2024-09-15T22:49:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.253+0000 7f064bfb7640 1 -- 172.21.15.134:0/539970295 wait complete. 2024-09-15T22:49:19.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T22:49:19.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.362+0000 7f84a9b42640 1 Processor -- start 2024-09-15T22:49:19.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.362+0000 7f84a9b42640 1 -- start start 2024-09-15T22:49:19.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.363+0000 7f84a9b42640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84a415e940 0x7f84a40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.363+0000 7f84a9b42640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415ed20 0x7f84a40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.363+0000 7f84a9b42640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a40b7170 con 0x7f84a40cef90 2024-09-15T22:49:19.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.363+0000 7f84a9b42640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f84a40d1ae0 con 0x7f84a415e940 2024-09-15T22:49:19.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.363+0000 7f84a9b42640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84a40b7aa0 con 0x7f84a415ed20 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84a415e940 0x7f84a40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a2ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415ed20 0x7f84a40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84a415e940 0x7f84a40d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.134:37770/0 (socket says 172.21.15.134:37770) 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 -- 172.21.15.134:0/1435413641 learned_addr learned my addr 172.21.15.134:0/1435413641 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a3fff640 1 --1- 172.21.15.134:0/1435413641 >> v1:172.21.15.177:6789/0 conn(0x7f84a40cef90 0x7f84a40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.134:48676/0 (socket says 172.21.15.134:48676) 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 -- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415ed20 msgr2=0x7f84a40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 --2- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415ed20 0x7f84a40d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 -- 172.21.15.134:0/1435413641 >> v1:172.21.15.177:6789/0 conn(0x7f84a40cef90 legacy=0x7f84a40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.364+0000 7f84a37fe640 1 -- 172.21.15.134:0/1435413641 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a40d3660 con 0x7f84a415e940 2024-09-15T22:49:19.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a37fe640 1 --2- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a415e940 0x7f84a40d1060 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8494009e50 tx=0x7f849402a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e28035211464910 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a27fc640 1 -- 172.21.15.134:0/1435413641 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494036070 con 0x7f84a415e940 2024-09-15T22:49:19.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a27fc640 1 -- 172.21.15.134:0/1435413641 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494031600 con 0x7f84a415e940 2024-09-15T22:49:19.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a27fc640 1 -- 172.21.15.134:0/1435413641 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940319d0 con 0x7f84a415e940 2024-09-15T22:49:19.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 -- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a415e940 msgr2=0x7f84a40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 --2- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a415e940 0x7f84a40d1060 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8494009e50 tx=0x7f849402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 -- 172.21.15.134:0/1435413641 shutdown_connections 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 --2- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415ed20 0x7f84a40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 --2- 172.21.15.134:0/1435413641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a415e940 0x7f84a40d1060 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.365+0000 7f84a9b42640 1 -- 172.21.15.134:0/1435413641 >> 172.21.15.134:0/1435413641 conn(0x7f84a40b6240 msgr2=0x7f84a40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.366+0000 7f84a9b42640 1 -- 172.21.15.134:0/1435413641 shutdown_connections 2024-09-15T22:49:19.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.366+0000 7f84a9b42640 1 -- 172.21.15.134:0/1435413641 wait complete. 2024-09-15T22:49:19.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.367+0000 7f84a9b42640 1 Processor -- start 2024-09-15T22:49:19.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.367+0000 7f84a9b42640 1 -- start start 2024-09-15T22:49:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a40cef90 0x7f84a40ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415e940 0x7f84a414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84a40d3f00 con 0x7f84a415ed20 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84a40d3c20 con 0x7f84a40cef90 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f84a40d3310 con 0x7f84a415e940 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57564/0 (socket says 172.21.15.134:57564) 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a40cef90 0x7f84a40ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a2ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415e940 0x7f84a414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 -- 172.21.15.134:0/4000138872 learned_addr learned my addr 172.21.15.134:0/4000138872 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 -- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415e940 msgr2=0x7f84a414f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415e940 0x7f84a414f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 -- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a40cef90 msgr2=0x7f84a40ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a40cef90 0x7f84a40ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 -- 172.21.15.134:0/4000138872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a414f540 con 0x7f84a415ed20 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a3fff640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f849c00c3c0 tx=0x7f849c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0074e0 con 0x7f84a415ed20 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f849c007680 con 0x7f84a415ed20 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a415a100 con 0x7f84a415ed20 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c004a20 con 0x7f84a415ed20 2024-09-15T22:49:19.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.368+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a415a6c0 con 0x7f84a415ed20 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.369+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a40d1ef0 con 0x7f84a415ed20 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.370+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f849c01a020 con 0x7f84a415ed20 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.370+0000 7f848bfff640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 0x7f849006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.370+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f849c0892e0 con 0x7f84a415ed20 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.371+0000 7f84a37fe640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 0x7f849006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.371+0000 7f84a37fe640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 0x7f849006f2e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8494033000 tx=0x7f8494009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.375+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84a40b7170 con 0x7f84a415ed20 2024-09-15T22:49:19.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.538+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f84a40ba6b0 con 0x7f849006ce20 2024-09-15T22:49:19.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.538+0000 7f848bfff640 1 -- 172.21.15.134:0/4000138872 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f84a40ba6b0 con 0x7f849006ce20 2024-09-15T22:49:19.540 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 msgr2=0x7f849006f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 0x7f849006f2e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8494033000 tx=0x7f8494009000 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 msgr2=0x7f84a4159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f849c00c3c0 tx=0x7f849c00c880 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 shutdown_connections 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f849006ce20 0x7f849006f2e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a415ed20 0x7f84a4159800 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a415e940 0x7f84a414f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 --2- 172.21.15.134:0/4000138872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a40cef90 0x7f84a40ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 >> 172.21.15.134:0/4000138872 conn(0x7f84a40b6240 msgr2=0x7f84a40b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 shutdown_connections 2024-09-15T22:49:19.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.540+0000 7f84a9b42640 1 -- 172.21.15.134:0/4000138872 wait complete. 2024-09-15T22:49:19.552 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T22:49:19.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:49:19.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.654+0000 7f7617253640 1 Processor -- start 2024-09-15T22:49:19.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.654+0000 7f7617253640 1 -- start start 2024-09-15T22:49:19.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.655+0000 7f7617253640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.655+0000 7f7617253640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f76100b73d0 0x7f761015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.655+0000 7f7617253640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761015fef0 con 0x7f761015fab0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.655+0000 7f7617253640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7610073530 con 0x7f76100b73d0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.655+0000 7f7617253640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f76100b5600 con 0x7f76100b6ff0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.134:48544/0 (socket says 172.21.15.134:48544) 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f760ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f76100b73d0 0x7f761015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 -- 172.21.15.134:0/3032399842 learned_addr learned my addr 172.21.15.134:0/3032399842 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 -- 172.21.15.134:0/3032399842 >> v2:172.21.15.177:3300/0 conn(0x7f76100b73d0 msgr2=0x7f761015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 --2- 172.21.15.134:0/3032399842 >> v2:172.21.15.177:3300/0 conn(0x7f76100b73d0 0x7f761015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 -- 172.21.15.134:0/3032399842 >> v1:172.21.15.177:6789/0 conn(0x7f761015fab0 legacy=0x7f7610160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.656+0000 7f7614fef640 1 -- 172.21.15.134:0/3032399842 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76100b58e0 con 0x7f76100b6ff0 2024-09-15T22:49:19.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f7614fef640 1 --2- 172.21.15.134:0/3032399842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7600009e50 tx=0x7f760002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2e89052992e3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f760f7fe640 1 -- 172.21.15.134:0/3032399842 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600036070 con 0x7f76100b6ff0 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f760f7fe640 1 -- 172.21.15.134:0/3032399842 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7600031600 con 0x7f76100b6ff0 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f760f7fe640 1 -- 172.21.15.134:0/3032399842 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76000319d0 con 0x7f76100b6ff0 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f7617253640 1 -- 172.21.15.134:0/3032399842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 msgr2=0x7f7610073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.657+0000 7f7617253640 1 --2- 172.21.15.134:0/3032399842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7600009e50 tx=0x7f760002a710 comp rx=0 tx=0).stop 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 -- 172.21.15.134:0/3032399842 shutdown_connections 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 --2- 172.21.15.134:0/3032399842 >> v2:172.21.15.177:3300/0 conn(0x7f76100b73d0 0x7f761015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 --2- 172.21.15.134:0/3032399842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b6ff0 0x7f7610073b70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 -- 172.21.15.134:0/3032399842 >> 172.21.15.134:0/3032399842 conn(0x7f7610062630 msgr2=0x7f7610062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 -- 172.21.15.134:0/3032399842 shutdown_connections 2024-09-15T22:49:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.658+0000 7f7617253640 1 -- 172.21.15.134:0/3032399842 wait complete. 2024-09-15T22:49:19.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.659+0000 7f7617253640 1 Processor -- start 2024-09-15T22:49:19.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.659+0000 7f7617253640 1 -- start start 2024-09-15T22:49:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76100b6ff0 0x7f76101f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b73d0 0x7f7610144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 0x7f7610152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76100b6180 con 0x7f761015fab0 2024-09-15T22:49:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76100b5ea0 con 0x7f76100b6ff0 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f76100b6460 con 0x7f76100b73d0 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 0x7f7610152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 0x7f7610152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57574/0 (socket says 172.21.15.134:57574) 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 -- 172.21.15.134:0/621268176 learned_addr learned my addr 172.21.15.134:0/621268176 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7614fef640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76100b6ff0 0x7f76101f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f760ffff640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b73d0 0x7f7610144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 -- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b73d0 msgr2=0x7f7610144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b73d0 0x7f7610144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 -- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76100b6ff0 msgr2=0x7f76101f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76100b6ff0 0x7f76101f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76101539c0 con 0x7f761015fab0 2024-09-15T22:49:19.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f760ffff640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76100b73d0 0x7f7610144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:19.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f76157f0640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 0x7f7610152ef0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7608001eb0 tx=0x7f760800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608017070 con 0x7f761015fab0 2024-09-15T22:49:19.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76080052d0 con 0x7f761015fab0 2024-09-15T22:49:19.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608003810 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761015c510 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.660+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761015ca90 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.661+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f761015f570 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f760801a070 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75f006cdf0 0x7f75f006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f76080892e0 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7f75f0072cb0 0x7f75f00750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f760801fe50 con 0x7f75f0072cb0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=173) ==== 24+0+0 (secure 0 0 0) 0x7f76080902a0 con 0x7f761015fab0 2024-09-15T22:49:19.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.662+0000 7f7614fef640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75f006cdf0 0x7f75f006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.663+0000 7f760ffff640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7f75f0072cb0 0x7f75f00750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.663+0000 7f7614fef640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75f006cdf0 0x7f75f006f2b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7600033000 tx=0x7f7600009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.663+0000 7f760ffff640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7f75f0072cb0 0x7f75f00750f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.664+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== osd.7 v2:172.21.15.177:6808/1620102708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f760801fe50 con 0x7f75f0072cb0 2024-09-15T22:49:19.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.676+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 --> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7610073950 con 0x7f75f0072cb0 2024-09-15T22:49:19.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.676+0000 7f760d7fa640 1 -- 172.21.15.134:0/621268176 <== osd.7 v2:172.21.15.177:6808/1620102708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7610073950 con 0x7f75f0072cb0 2024-09-15T22:49:19.678 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-15T22:49:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:49:19.678 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.676+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7f75f0072cb0 msgr2=0x7f75f00750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6808/1620102708,v1:172.21.15.177:6811/1620102708] conn(0x7f75f0072cb0 0x7f75f00750f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75f006cdf0 msgr2=0x7f75f006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f75f006cdf0 0x7f75f006f2b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7600033000 tx=0x7f7600009000 comp rx=0 tx=0).stop 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 msgr2=0x7f7610152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 --2- 172.21.15.134:0/621268176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f761015fab0 0x7f7610152ef0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7608001eb0 tx=0x7f760800c890 comp rx=0 tx=0).stop 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f76157f0640 1 -- 172.21.15.134:0/621268176 reap_dead start 2024-09-15T22:49:19.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 shutdown_connections 2024-09-15T22:49:19.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 >> 172.21.15.134:0/621268176 conn(0x7f7610062630 msgr2=0x7f76100d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 shutdown_connections 2024-09-15T22:49:19.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.677+0000 7f7617253640 1 -- 172.21.15.134:0/621268176 wait complete. 2024-09-15T22:49:19.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T22:49:19.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.786+0000 7f706e598640 1 Processor -- start 2024-09-15T22:49:19.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.786+0000 7f706e598640 1 -- start start 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f706e598640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f706806be10 0x7f70680cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f706e598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f706e598640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70680cd5f0 con 0x7f706806c1f0 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f706e598640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f70680cd8d0 con 0x7f706806be10 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f706e598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70680cdbb0 con 0x7f7068151c50 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f7067fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f706806be10 0x7f70680cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f7067fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f706806be10 0x7f70680cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57590/0 (socket says 172.21.15.134:57590) 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.787+0000 7f7067fff640 1 -- 172.21.15.134:0/3051397272 learned_addr learned my addr 172.21.15.134:0/3051397272 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f706cb35640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7067fff640 1 -- 172.21.15.134:0/3051397272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 msgr2=0x7f706815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7067fff640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7067fff640 1 -- 172.21.15.134:0/3051397272 >> v1:172.21.15.177:6789/0 conn(0x7f706806c1f0 legacy=0x7f7068151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7067fff640 1 -- 172.21.15.134:0/3051397272 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70680cde90 con 0x7f706806be10 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f706cb35640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7067fff640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f70680cd010 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3a26e43eb8fbde server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.788+0000 7f7066ffd640 1 -- 172.21.15.134:0/3051397272 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058037070 con 0x7f706806be10 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f7066ffd640 1 -- 172.21.15.134:0/3051397272 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058032440 con 0x7f706806be10 2024-09-15T22:49:19.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f7066ffd640 1 -- 172.21.15.134:0/3051397272 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058032810 con 0x7f706806be10 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 -- 172.21.15.134:0/3051397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 msgr2=0x7f70680cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f70680cd010 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705802a210 comp rx=0 tx=0).stop 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 -- 172.21.15.134:0/3051397272 shutdown_connections 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 --2- 172.21.15.134:0/3051397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f70680cd010 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 -- 172.21.15.134:0/3051397272 >> 172.21.15.134:0/3051397272 conn(0x7f7068062cc0 msgr2=0x7f706806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 -- 172.21.15.134:0/3051397272 shutdown_connections 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.789+0000 7f706e598640 1 -- 172.21.15.134:0/3051397272 wait complete. 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.790+0000 7f706e598640 1 Processor -- start 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.790+0000 7f706e598640 1 -- start start 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706806c1f0 0x7f706815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7068164750 con 0x7f706806be10 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70680ce690 con 0x7f706806c1f0 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706e598640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f70681648d0 con 0x7f7068151c50 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57594/0 (socket says 172.21.15.134:57594) 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 -- 172.21.15.134:0/1214118936 learned_addr learned my addr 172.21.15.134:0/1214118936 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f70677fe640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706806c1f0 0x7f706815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f706cb35640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 -- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 msgr2=0x7f706815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 -- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706806c1f0 msgr2=0x7f706815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.791+0000 7f7067fff640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706806c1f0 0x7f706815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f7067fff640 1 -- 172.21.15.134:0/1214118936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706814be00 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f7067fff640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f70580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058041020 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058030970 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058037040 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706815e620 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.792+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706815eba0 con 0x7f706806be10 2024-09-15T22:49:19.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.793+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706814bfd0 con 0x7f706806be10 2024-09-15T22:49:19.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.793+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f7058044020 con 0x7f706806be10 2024-09-15T22:49:19.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.794+0000 7f7064ff9640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 0x7f705406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:19.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.794+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f70580aa6f0 con 0x7f706806be10 2024-09-15T22:49:19.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.794+0000 7f70677fe640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 0x7f705406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:19.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.795+0000 7f70677fe640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 0x7f705406f2b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f70681538c0 tx=0x7f705c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:19.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.798+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f705804b030 con 0x7f706806be10 2024-09-15T22:49:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.962+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f70680cc3d0 con 0x7f705406cdf0 2024-09-15T22:49:19.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.963+0000 7f7064ff9640 1 -- 172.21.15.134:0/1214118936 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f70680cc3d0 con 0x7f705406cdf0 2024-09-15T22:49:19.964 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 msgr2=0x7f705406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 0x7f705406f2b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f70681538c0 tx=0x7f705c009040 comp rx=0 tx=0).stop 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 msgr2=0x7f706813d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f70580046c0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 shutdown_connections 2024-09-15T22:49:19.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7068151c50 0x7f706815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f706806c1f0 0x7f706815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f705406cdf0 0x7f705406f2b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 --2- 172.21.15.134:0/1214118936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f706806be10 0x7f706813d8a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 >> 172.21.15.134:0/1214118936 conn(0x7f7068062cc0 msgr2=0x7f70680b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 shutdown_connections 2024-09-15T22:49:19.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:19.965+0000 7f706e598640 1 -- 172.21.15.134:0/1214118936 wait complete. 2024-09-15T22:49:19.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:49:20.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.075+0000 7f06ba45e640 1 Processor -- start 2024-09-15T22:49:20.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.075+0000 7f06ba45e640 1 -- start start 2024-09-15T22:49:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06ba45e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06b415fd30 0x7f06b40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06ba45e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b4162870 con 0x7f06b40d0a50 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06ba45e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b4162b50 con 0x7f06b40b4930 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06ba45e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f06b4160180 con 0x7f06b415fd30 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b89fb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06b415fd30 0x7f06b40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f06b40d0a50 0x7f06b41620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:48236/0 (socket says 172.21.15.134:48236) 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b3fff640 1 -- 172.21.15.134:0/4195798301 learned_addr learned my addr 172.21.15.134:0/4195798301 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b89fb640 1 -- 172.21.15.134:0/4195798301 >> v1:172.21.15.177:6789/0 conn(0x7f06b40b4930 legacy=0x7f06b415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b89fb640 1 -- 172.21.15.134:0/4195798301 >> v1:172.21.15.134:6789/0 conn(0x7f06b40d0a50 legacy=0x7f06b41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b89fb640 1 -- 172.21.15.134:0/4195798301 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b4162e30 con 0x7f06b415fd30 2024-09-15T22:49:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.076+0000 7f06b2ffd640 1 -- 172.21.15.134:0/4195798301 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943763440 0 0) 0x7f06b4162870 con 0x7f06b40d0a50 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.077+0000 7f06b89fb640 1 --2- 172.21.15.134:0/4195798301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b415fd30 0x7f06b40b4d90 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009d90 tx=0x7f06ac02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a37b0965376ce05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.077+0000 7f06b2ffd640 1 -- 172.21.15.134:0/4195798301 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac031600 con 0x7f06b415fd30 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.077+0000 7f06b2ffd640 1 -- 172.21.15.134:0/4195798301 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0317a0 con 0x7f06b415fd30 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.077+0000 7f06b2ffd640 1 -- 172.21.15.134:0/4195798301 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac031b70 con 0x7f06b415fd30 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 -- 172.21.15.134:0/4195798301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b415fd30 msgr2=0x7f06b40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 --2- 172.21.15.134:0/4195798301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b415fd30 0x7f06b40b4d90 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009d90 tx=0x7f06ac02a610 comp rx=0 tx=0).stop 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 -- 172.21.15.134:0/4195798301 shutdown_connections 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 --2- 172.21.15.134:0/4195798301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b415fd30 0x7f06b40b4d90 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 -- 172.21.15.134:0/4195798301 >> 172.21.15.134:0/4195798301 conn(0x7f06b4062cc0 msgr2=0x7f06b406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 -- 172.21.15.134:0/4195798301 shutdown_connections 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.078+0000 7f06ba45e640 1 -- 172.21.15.134:0/4195798301 wait complete. 2024-09-15T22:49:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.079+0000 7f06ba45e640 1 Processor -- start 2024-09-15T22:49:20.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.079+0000 7f06ba45e640 1 -- start start 2024-09-15T22:49:20.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06b40b4930 0x7f06b40ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 0x7f06b40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40b3620 con 0x7f06b40b1830 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40b52d0 con 0x7f06b40b4930 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f06b40b3b40 con 0x7f06b415fd30 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57620/0 (socket says 172.21.15.134:57620) 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 -- 172.21.15.134:0/1067103481 learned_addr learned my addr 172.21.15.134:0/1067103481 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b3fff640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06b40b4930 0x7f06b40ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b37fe640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 0x7f06b40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 -- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 msgr2=0x7f06b40afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 0x7f06b40afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 -- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06b40b4930 msgr2=0x7f06b40ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06b40b4930 0x7f06b40ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 -- 172.21.15.134:0/1067103481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b40b00b0 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b37fe640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 0x7f06b40afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b89fb640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009eb0 tx=0x7f06ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac040070 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac030be0 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b40b0bd0 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.080+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac009450 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.081+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b40b0610 con 0x7f06b40b1830 2024-09-15T22:49:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.081+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b40b4d70 con 0x7f06b40b1830 2024-09-15T22:49:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.082+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f06ac039040 con 0x7f06b40b1830 2024-09-15T22:49:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.083+0000 7f06b0ff9640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 0x7f06a006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.083+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f06ac0aaca0 con 0x7f06b40b1830 2024-09-15T22:49:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.083+0000 7f06b3fff640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 0x7f06a006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.083+0000 7f06b3fff640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 0x7f06a006f2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a4007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:20.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.087+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06b40b00b0 con 0x7f06b40b1830 2024-09-15T22:49:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.251+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06b41f4660 con 0x7f06a006cdf0 2024-09-15T22:49:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.252+0000 7f06b0ff9640 1 -- 172.21.15.134:0/1067103481 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13373 (secure 0 0 0) 0x7f06b41f4660 con 0x7f06a006cdf0 2024-09-15T22:49:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:49:20.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 msgr2=0x7f06a006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 0x7f06a006f2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a4007d50 comp rx=0 tx=0).stop 2024-09-15T22:49:20.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 msgr2=0x7f06b41f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:20.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009eb0 tx=0x7f06ac004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 shutdown_connections 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f06a006cdf0 0x7f06a006f2b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b40b1830 0x7f06b41f4120 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f06b415fd30 0x7f06b40afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 --2- 172.21.15.134:0/1067103481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06b40b4930 0x7f06b40ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 >> 172.21.15.134:0/1067103481 conn(0x7f06b4062cc0 msgr2=0x7f06b41616f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 shutdown_connections 2024-09-15T22:49:20.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:20.254+0000 7f06ba45e640 1 -- 172.21.15.134:0/1067103481 wait complete. 2024-09-15T22:49:20.266 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-15T22:49:19.237058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267744,"kb_used_data":18216,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754706976,"statfs":{"total":773094113280,"available":772819943424,"internally_reserved":0,"allocated":18653184,"data_stored":8868792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-4,"num_write_kb":-2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.882449"},"pg_stats":[{"pgid":"1.0","version":"76'128","reported_seq":488,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-15T22:49:11.509232+0000","last_change":"2024-09-15T22:41:19.050384+0000","last_active":"2024-09-15T22:49:11.509232+0000","last_peered":"2024-09-15T22:49:11.509232+0000","last_clean":"2024-09-15T22:49:11.509232+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:49:11.509232+0000","last_undegraded":"2024-09-15T22:49:11.509232+0000","last_fullsized":"2024-09-15T22:49:11.509232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:41:17.636030+0000","last_clean_scrub_stamp":"2024-09-15T22:41:17.636030+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.516904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33320,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33900,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337940,"statfs":{"total":96636764160,"available":96602050560,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33904,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337936,"statfs":{"total":96636764160,"available":96602046464,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:49:20.269 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T22:41:17.636030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=41, tm_sec=17, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=49, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:49:20.269 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T22:49:22.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:22.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:40.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.382+0000 7f38268f8640 1 Processor -- start 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.382+0000 7f38268f8640 1 -- start start 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f38268f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f382015b150 0x7f38200b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f38268f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 0x7f38200711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f38268f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38200cda80 con 0x7f38200ceb20 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f38268f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f38200ce690 con 0x7f382015b150 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f38268f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f38200cdd60 con 0x7f38200d0820 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f381ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f382015b150 0x7f38200b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f381ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f382015b150 0x7f38200b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45128/0 (socket says 172.21.15.134:45128) 2024-09-15T22:49:40.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.383+0000 7f381ffff640 1 -- 172.21.15.134:0/3687764516 learned_addr learned my addr 172.21.15.134:0/3687764516 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f3824e95640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 0x7f38200711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f381ffff640 1 -- 172.21.15.134:0/3687764516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 msgr2=0x7f38200711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f381ffff640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 0x7f38200711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f381ffff640 1 -- 172.21.15.134:0/3687764516 >> v1:172.21.15.177:6789/0 conn(0x7f38200ceb20 legacy=0x7f38200d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f381ffff640 1 -- 172.21.15.134:0/3687764516 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200ce040 con 0x7f382015b150 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f3824e95640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 0x7f38200711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.384+0000 7f381ffff640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f382015b150 0x7f38200b4660 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f381000bb10 tx=0x7f381002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d2edaaa098b0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f381f7fe640 1 -- 172.21.15.134:0/3687764516 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810036020 con 0x7f382015b150 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f381f7fe640 1 -- 172.21.15.134:0/3687764516 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3810032820 con 0x7f382015b150 2024-09-15T22:49:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f381f7fe640 1 -- 172.21.15.134:0/3687764516 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810032bf0 con 0x7f382015b150 2024-09-15T22:49:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 -- 172.21.15.134:0/3687764516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f382015b150 msgr2=0x7f38200b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f382015b150 0x7f38200b4660 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f381000bb10 tx=0x7f381002c920 comp rx=0 tx=0).stop 2024-09-15T22:49:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 -- 172.21.15.134:0/3687764516 shutdown_connections 2024-09-15T22:49:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38200d0820 0x7f38200711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 --2- 172.21.15.134:0/3687764516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f382015b150 0x7f38200b4660 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 -- 172.21.15.134:0/3687764516 >> 172.21.15.134:0/3687764516 conn(0x7f3820062cc0 msgr2=0x7f382006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 -- 172.21.15.134:0/3687764516 shutdown_connections 2024-09-15T22:49:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.385+0000 7f38268f8640 1 -- 172.21.15.134:0/3687764516 wait complete. 2024-09-15T22:49:40.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.386+0000 7f38268f8640 1 Processor -- start 2024-09-15T22:49:40.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 -- start start 2024-09-15T22:49:40.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38200ceb20 0x7f3820152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f382015b150 0x7f38201f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3820073c00 con 0x7f38200d0820 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f38200cef80 con 0x7f38200ceb20 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f38268f8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f3820073d80 con 0x7f382015b150 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f3817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f3817fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45134/0 (socket says 172.21.15.134:45134) 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f3817fff640 1 -- 172.21.15.134:0/3058954656 learned_addr learned my addr 172.21.15.134:0/3058954656 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f381ffff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38200ceb20 0x7f3820152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.387+0000 7f3824e95640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f382015b150 0x7f38201f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 -- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f382015b150 msgr2=0x7f38201f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f382015b150 0x7f38201f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 -- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38200ceb20 msgr2=0x7f3820152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38200ceb20 0x7f3820152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 -- 172.21.15.134:0/3058954656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201f89f0 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f3817fff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3f0 tx=0x7f380800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38080052d0 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808005490 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38201f8cd0 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808007260 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.388+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38201f86e0 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.389+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38200b1dc0 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.389+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f3808007400 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.390+0000 7f381d7fa640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 0x7f380006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.390+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f3808089360 con 0x7f38200d0820 2024-09-15T22:49:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.390+0000 7f381ffff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 0x7f380006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.391+0000 7f381ffff640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 0x7f380006f2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3810037000 tx=0x7f3810008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.394+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38200b1dc0 con 0x7f38200d0820 2024-09-15T22:49:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.561+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 --> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38200cd6a0 con 0x7f380006cdf0 2024-09-15T22:49:40.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.563+0000 7f381d7fa640 1 -- 172.21.15.134:0/3058954656 <== mgr.4111 v2:172.21.15.177:6836/3873344621 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f38200cd6a0 con 0x7f380006cdf0 2024-09-15T22:49:40.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:40.565 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 msgr2=0x7f380006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 0x7f380006f2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3810037000 tx=0x7f3810008040 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 msgr2=0x7f382014c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3f0 tx=0x7f380800c8b0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 shutdown_connections 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f382015b150 0x7f38201f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f380006cdf0 0x7f380006f2b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38200d0820 0x7f382014c060 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 --2- 172.21.15.134:0/3058954656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38200ceb20 0x7f3820152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 >> 172.21.15.134:0/3058954656 conn(0x7f3820062cc0 msgr2=0x7f382015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 shutdown_connections 2024-09-15T22:49:40.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.565+0000 7f38268f8640 1 -- 172.21.15.134:0/3058954656 wait complete. 2024-09-15T22:49:40.578 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-15T22:49:39.241263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267732,"kb_used_data":18216,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754706988,"statfs":{"total":773094113280,"available":772819955712,"internally_reserved":0,"allocated":18653184,"data_stored":8868792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"1.0","version":"173'130","reported_seq":500,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-15T22:49:17.419890+0000","last_change":"2024-09-15T22:49:17.419890+0000","last_active":"2024-09-15T22:49:17.419890+0000","last_peered":"2024-09-15T22:49:17.419890+0000","last_clean":"2024-09-15T22:49:17.419890+0000","last_became_active":"2024-09-15T22:41:19.047601+0000","last_became_peered":"2024-09-15T22:41:19.047601+0000","last_unstale":"2024-09-15T22:49:17.419890+0000","last_undegraded":"2024-09-15T22:49:17.419890+0000","last_fullsized":"2024-09-15T22:49:17.419890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"173'130","last_scrub_stamp":"2024-09-15T22:49:17.419730+0000","last_deep_scrub":"173'130","last_deep_scrub_stamp":"2024-09-15T22:49:17.419730+0000","last_clean_scrub_stamp":"2024-09-15T22:49:17.419730+0000","objects_scrubbed":2,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:51.146218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33320,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":2712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":2777088,"data_stored":1551375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33324,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2183168,"data_stored":961007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:49:40.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T22:49:40.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.675+0000 7f283247b640 1 Processor -- start 2024-09-15T22:49:40.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.675+0000 7f283247b640 1 -- start start 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f282c158e50 0x7f282c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f282c15c370 0x7f282c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c06ef60 0x7f282c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f282c15c800 con 0x7f282c158e50 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f282c0b43f0 con 0x7f282c15c370 2024-09-15T22:49:40.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f283247b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f282c0b3630 con 0x7f282c06ef60 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f282bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f282c158e50 0x7f282c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f282bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f282c158e50 0x7f282c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45140/0 (socket says 172.21.15.134:45140) 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.676+0000 7f282bfff640 1 -- 172.21.15.134:0/3317206826 learned_addr learned my addr 172.21.15.134:0/3317206826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 -- 172.21.15.134:0/3317206826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c06ef60 msgr2=0x7f282c15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 --2- 172.21.15.134:0/3317206826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c06ef60 0x7f282c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 -- 172.21.15.134:0/3317206826 >> v2:172.21.15.177:3300/0 conn(0x7f282c15c370 msgr2=0x7f282c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282b7fe640 1 --2- 172.21.15.134:0/3317206826 >> v2:172.21.15.177:3300/0 conn(0x7f282c15c370 0x7f282c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 --2- 172.21.15.134:0/3317206826 >> v2:172.21.15.177:3300/0 conn(0x7f282c15c370 0x7f282c06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 -- 172.21.15.134:0/3317206826 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0b3910 con 0x7f282c158e50 2024-09-15T22:49:40.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282bfff640 1 --2- 172.21.15.134:0/3317206826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c158e50 0x7f282c0b5050 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f282c0cdd40 tx=0x7f281c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6365d7d1de15c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.677+0000 7f282affd640 1 -- 172.21.15.134:0/3317206826 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c037070 con 0x7f282c158e50 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f282affd640 1 -- 172.21.15.134:0/3317206826 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c032440 con 0x7f282c158e50 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f282affd640 1 -- 172.21.15.134:0/3317206826 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c032810 con 0x7f282c158e50 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 -- 172.21.15.134:0/3317206826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c158e50 msgr2=0x7f282c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 --2- 172.21.15.134:0/3317206826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c158e50 0x7f282c0b5050 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f282c0cdd40 tx=0x7f281c02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 -- 172.21.15.134:0/3317206826 shutdown_connections 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 --2- 172.21.15.134:0/3317206826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c06ef60 0x7f282c15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 --2- 172.21.15.134:0/3317206826 >> v2:172.21.15.177:3300/0 conn(0x7f282c15c370 0x7f282c06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 --2- 172.21.15.134:0/3317206826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c158e50 0x7f282c0b5050 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 -- 172.21.15.134:0/3317206826 >> 172.21.15.134:0/3317206826 conn(0x7f282c06bba0 msgr2=0x7f282c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 -- 172.21.15.134:0/3317206826 shutdown_connections 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.678+0000 7f283247b640 1 -- 172.21.15.134:0/3317206826 wait complete. 2024-09-15T22:49:40.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.679+0000 7f283247b640 1 Processor -- start 2024-09-15T22:49:40.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.679+0000 7f283247b640 1 -- start start 2024-09-15T22:49:40.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f282c06ef60 0x7f282c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c158e50 0x7f282c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f282c159230 con 0x7f282c15c370 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0b3ed0 con 0x7f282c06ef60 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f283247b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f282c15f390 con 0x7f282c158e50 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45150/0 (socket says 172.21.15.134:45150) 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 -- 172.21.15.134:0/457872919 learned_addr learned my addr 172.21.15.134:0/457872919 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 -- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c158e50 msgr2=0x7f282c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c158e50 0x7f282c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 -- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f282c06ef60 msgr2=0x7f282c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f282c06ef60 0x7f282c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.680+0000 7f2830a18640 1 -- 172.21.15.134:0/457872919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0af050 con 0x7f282c15c370 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f2830a18640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f282400b970 tx=0x7f282400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824019070 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282400cb60 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824014440 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c0af330 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.681+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c0af8f0 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.682+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c15ee50 con 0x7f282c15c370 2024-09-15T22:49:40.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.682+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f282401c070 con 0x7f282c15c370 2024-09-15T22:49:40.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.683+0000 7f2828ff9640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 0x7f281806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.683+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f2824089bb0 con 0x7f282c15c370 2024-09-15T22:49:40.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.683+0000 7f282bfff640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 0x7f281806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.684+0000 7f282bfff640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 0x7f281806f2b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.687+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2824059cd0 con 0x7f282c15c370 2024-09-15T22:49:40.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.855+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f282c0731b0 con 0x7f282c15c370 2024-09-15T22:49:40.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.858+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7f28240595d0 con 0x7f282c15c370 2024-09-15T22:49:40.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.860+0000 7f2828ff9640 1 -- 172.21.15.134:0/457872919 <== mon.0 v2:172.21.15.134:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f282405d980 con 0x7f282c15c370 2024-09-15T22:49:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 msgr2=0x7f281806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 0x7f281806f2b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02c000 comp rx=0 tx=0).stop 2024-09-15T22:49:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 msgr2=0x7f282c0c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f282400b970 tx=0x7f282400be30 comp rx=0 tx=0).stop 2024-09-15T22:49:40.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 shutdown_connections 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f281806cdf0 0x7f281806f2b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f282c15c370 0x7f282c0c61c0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f282c158e50 0x7f282c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 --2- 172.21.15.134:0/457872919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f282c06ef60 0x7f282c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 >> 172.21.15.134:0/457872919 conn(0x7f282c06bba0 msgr2=0x7f282c0ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 shutdown_connections 2024-09-15T22:49:40.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.861+0000 7f283247b640 1 -- 172.21.15.134:0/457872919 wait complete. 2024-09-15T22:49:40.874 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:49:40.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:49:40.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.970+0000 7f7a61b0a640 1 Processor -- start 2024-09-15T22:49:40.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.970+0000 7f7a61b0a640 1 -- start start 2024-09-15T22:49:40.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a61b0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a5c0d02a0 0x7f7a5c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a61b0a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 0x7f7a5c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a61b0a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5c0d0bc0 con 0x7f7a5c15ca40 2024-09-15T22:49:40.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a61b0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7a5c15d390 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a61b0a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 -- 0x7f7a5c15d670 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a5c0d02a0 0x7f7a5c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7a5c15ca40 0x7f7a5c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57456/0 (socket says 172.21.15.134:57456) 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5affd640 1 -- 172.21.15.134:0/3869150780 learned_addr learned my addr 172.21.15.134:0/3869150780 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5bfff640 1 --2- 172.21.15.134:0/3869150780 >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 0x7f7a5c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 -- 172.21.15.134:0/3869150780 >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 msgr2=0x7f7a5c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5a7fc640 1 -- 172.21.15.134:0/3869150780 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905321530 0 0) 0x7f7a5c0d0bc0 con 0x7f7a5c15ca40 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3869150780 >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 0x7f7a5c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 -- 172.21.15.134:0/3869150780 >> v1:172.21.15.134:6789/0 conn(0x7f7a5c15ca40 legacy=0x7f7a5c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 -- 172.21.15.134:0/3869150780 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c15d950 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5bfff640 1 --2- 172.21.15.134:0/3869150780 >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 0x7f7a5c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3869150780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c0d0680 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0b52b0 tx=0x7f7a4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6512224f7f03a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5a7fc640 1 -- 172.21.15.134:0/3869150780 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c037070 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5a7fc640 1 -- 172.21.15.134:0/3869150780 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7a4c032440 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.972+0000 7f7a5a7fc640 1 -- 172.21.15.134:0/3869150780 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c02ae60 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3869150780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c0d02a0 msgr2=0x7f7a5c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3869150780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c0d0680 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0b52b0 tx=0x7f7a4c02a110 comp rx=0 tx=0).stop 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3869150780 shutdown_connections 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3869150780 >> v2:172.21.15.177:3300/0 conn(0x7f7a5c15ceb0 0x7f7a5c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3869150780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c0d0680 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3869150780 >> 172.21.15.134:0/3869150780 conn(0x7f7a5c062cc0 msgr2=0x7f7a5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3869150780 shutdown_connections 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.973+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3869150780 wait complete. 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.974+0000 7f7a61b0a640 1 Processor -- start 2024-09-15T22:49:40.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.974+0000 7f7a61b0a640 1 -- start start 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a5c15ca40 0x7f7a5c071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c15eb40 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c15df10 con 0x7f7a5c0d02a0 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5c155b90 con 0x7f7a5c15ca40 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45166/0 (socket says 172.21.15.134:45166) 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 -- 172.21.15.134:0/3073920083 learned_addr learned my addr 172.21.15.134:0/3073920083 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5affd640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a5c15ca40 0x7f7a5c071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 -- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a5c15ca40 msgr2=0x7f7a5c071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a5c15ca40 0x7f7a5c071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 -- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 msgr2=0x7f7a5c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 -- 172.21.15.134:0/3073920083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c1f4a20 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a5bfff640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400cd80 tx=0x7f7a5400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54003b90 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7a54003d50 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5c0721d0 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54004280 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.975+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a5c072790 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.977+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5c0b4790 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.977+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) ==== 91866+0+0 (secure 0 0 0) 0x7f7a54004420 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.977+0000 7f7a43fff640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 0x7f7a4806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.978+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4999+0+0 (secure 0 0 0) 0x7f7a5408aa90 con 0x7f7a5c15ceb0 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.978+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 0x7f7a4806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.978+0000 7f7a5b7fe640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 0x7f7a4806f2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c034000 tx=0x7f7a4c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:40.982+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a54014030 con 0x7f7a5c15ceb0 2024-09-15T22:49:41.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.181+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a5c0b0c90 con 0x7f7a5c15ceb0 2024-09-15T22:49:41.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.181+0000 7f7a43fff640 1 -- 172.21.15.134:0/3073920083 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+3920 (secure 0 0 0) 0x7f7a5405a9d0 con 0x7f7a5c15ceb0 2024-09-15T22:49:41.183 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-15T22:49:41.183 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":92,"btime":"2024-09-15T22:49:09:348187+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2738144510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2738144510},{"type":"v1","addr":"172.21.15.177:6834","nonce":2738144510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2308581382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2308581382},{"type":"v1","addr":"172.21.15.177:6835","nonce":2308581382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/469993352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":469993352},{"type":"v1","addr":"172.21.15.134:6825","nonce":469993352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":9336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3329729055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3329729055},{"type":"v1","addr":"172.21.15.134:6835","nonce":3329729055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[]} 2024-09-15T22:49:41.183 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 92 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 msgr2=0x7f7a4806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 0x7f7a4806f2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c034000 tx=0x7f7a4c02e000 comp rx=0 tx=0).stop 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 msgr2=0x7f7a5c1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400cd80 tx=0x7f7a5400a650 comp rx=0 tx=0).stop 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 shutdown_connections 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:6836/3873344621,v1:172.21.15.177:6837/3873344621] conn(0x7f7a4806cdf0 0x7f7a4806f2b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a5c15ceb0 0x7f7a5c1582a0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a5c15ca40 0x7f7a5c071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 --2- 172.21.15.134:0/3073920083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c0d02a0 0x7f7a5c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.183+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 >> 172.21.15.134:0/3073920083 conn(0x7f7a5c062cc0 msgr2=0x7f7a5c0d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:41.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.184+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 shutdown_connections 2024-09-15T22:49:41.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-15T22:49:41.184+0000 7f7a61b0a640 1 -- 172.21.15.134:0/3073920083 wait complete. 2024-09-15T22:49:41.196 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T22:49:41.202 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T22:49:41.202 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:49:41.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.211 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:49:41.211 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:49:41.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.260 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:49:41.261 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:49:41.261 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.273 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:49:41.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:49:41.273 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.326 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:49:41.326 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T22:49:41.326 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T22:49:41.326 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.358 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T22:49:41.358 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T22:49:41.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.429 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T22:49:41.429 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T22:49:41.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.494 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T22:49:41.494 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T22:49:41.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.564 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T22:49:41.564 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T22:49:41.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.598 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T22:49:41.598 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T22:49:41.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.671 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T22:49:41.671 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T22:49:41.671 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.739 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T22:49:41.739 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T22:49:41.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.811 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T22:49:41.812 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T22:49:41.812 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T22:49:41.812 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.840 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T22:49:41.841 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T22:49:41.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.885 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T22:49:41.885 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T22:49:41.885 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T22:49:41.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.897 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T22:49:41.897 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T22:49:41.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.938 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T22:49:41.938 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T22:49:41.938 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:49:41.990 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T22:49:41.991 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T22:49:41.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-15T22:49:42.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:42.028 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T22:49:42.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:42.257 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T22:49:42.330 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:42.330 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T22:49:42.388 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:42.388 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T22:49:42.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:42.440 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T22:49:42.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:42.604 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T22:49:42.675 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:42.675 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T22:49:42.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:42.734 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T22:49:42.791 INFO:tasks.ceph:Archiving mon data... 2024-09-15T22:49:42.792 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/data/mon.a.tgz 2024-09-15T22:49:42.792 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-15T22:49:42.808 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.7aM1tGiCKY 2024-09-15T22:49:42.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7aM1tGiCKY 2024-09-15T22:49:43.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.7aM1tGiCKY 2024-09-15T22:49:43.193 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.7aM1tGiCKY is 1MB 2024-09-15T22:49:43.301 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.7aM1tGiCKY 2024-09-15T22:49:43.317 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/data/mon.b.tgz 2024-09-15T22:49:43.317 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-15T22:49:43.335 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.bCBnLG9xQP 2024-09-15T22:49:43.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bCBnLG9xQP 2024-09-15T22:49:43.641 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.bCBnLG9xQP 2024-09-15T22:49:43.725 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.bCBnLG9xQP is 1MB 2024-09-15T22:49:43.832 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.bCBnLG9xQP 2024-09-15T22:49:43.847 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/data/mon.c.tgz 2024-09-15T22:49:43.848 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-15T22:49:43.902 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.tQGKqCCcbO 2024-09-15T22:49:43.902 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tQGKqCCcbO 2024-09-15T22:49:44.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.tQGKqCCcbO 2024-09-15T22:49:44.272 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.tQGKqCCcbO is 1MB 2024-09-15T22:49:44.354 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.tQGKqCCcbO 2024-09-15T22:49:44.369 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T22:49:44.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:49:44.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:49:44.458 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:49:44.489 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:49:44.489 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T22:49:44.491 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi134/crash 2024-09-15T22:49:44.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:49:44.525 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi177/crash 2024-09-15T22:49:44.526 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:49:44.553 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T22:49:44.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:44.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:44.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:44.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:44.730 INFO:tasks.ceph:Compressing logs... 2024-09-15T22:49:44.730 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:49:44.748 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:49:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T22:49:44.772 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2024-09-15T22:49:44.822 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48600.log 2024-09-15T22:49:44.822 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43516.log 2024-09-15T22:49:44.822 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.48600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42501.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48600.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.43516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42496.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43516.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.42501.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42501.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.42496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42896.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42496.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46486.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45976.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42896.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.46486.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46486.log.gz 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.45976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46490.log 2024-09-15T22:49:44.823 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45976.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36401.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.46490.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46490.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47549.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.4.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36401.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36281.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.47549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47549.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47048.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42900.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.47048.log: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47048.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36281.log.gz 2024-09-15T22:49:44.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.42900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42900.log.gz 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48596.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5/var/log/ceph/ceph-client.admin.36321.log: --verbose -- /var/log/ceph/ceph-client.1.49133.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.48596.log: 88.6% 0.0% -- replaced with /var/log/ceph/ceph-client.1.48596.log.gz 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.1.43512.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5/var/log/ceph/ceph-client.1.49133.log: --verbose -- /var/log/ceph/ceph-client.admin.36572.log 0.0% -- replaced with /var/log/ceph/ceph-client.1.49133.log.gz 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.43512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43512.log.gz 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44007.log 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0%/var/log/ceph/ceph-osd.6.log: -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2024-09-15T22:49:44.825 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47052.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48064.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.44007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44007.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.47052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47052.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.1.48064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48064.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36485.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36441.log: /var/log/ceph/ceph.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36485.log.gz 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T22:49:44.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:49:44.827 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44883.log 2024-09-15T22:49:44.828 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45980.log 2024-09-15T22:49:44.828 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.44883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44883.log.gz 2024-09-15T22:49:44.835 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-09-15T22:49:44.835 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.45980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45980.log.gz 2024-09-15T22:49:44.849 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T22:49:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36361.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-09-15T22:49:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48068.log 2024-09-15T22:49:44.875 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44011.log 2024-09-15T22:49:44.875 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.48068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48068.log.gz 2024-09-15T22:49:44.887 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45361.log 2024-09-15T22:49:44.888 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.44011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44011.log.gz 2024-09-15T22:49:44.892 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45365.log 2024-09-15T22:49:44.904 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.45361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45361.log.gz 2024-09-15T22:49:44.917 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44879.log 2024-09-15T22:49:44.917 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.45365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45365.log.gz 2024-09-15T22:49:44.929 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-09-15T22:49:44.929 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.44879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44879.log.gz 2024-09-15T22:49:44.942 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47553.log 2024-09-15T22:49:44.950 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.49137.log 2024-09-15T22:49:44.950 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.47553.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-09-15T22:49:44.956 INFO:teuthology.orchestra.run.smithi177.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T22:49:44.957 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.49137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.49137.log.gz 2024-09-15T22:49:44.957 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47553.log.gz 2024-09-15T22:49:44.981 INFO:teuthology.orchestra.run.smithi177.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54960.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55926.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54960.log.gz 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42677.log: /var/log/ceph/ceph-client.admin.55926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73464.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55926.log.gz 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5/var/log/ceph/ceph-client.admin.36858.log: --verbose -- /var/log/ceph/ceph-client.admin.81361.log 2024-09-15T22:49:45.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.73464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66422.log 88.2% 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73464.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58746.log 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81361.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66422.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52949.log 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53077.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58746.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42761.log 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66296.log 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52949.log.gz 2024-09-15T22:49:45.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66296.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42761.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73546.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66296.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54244.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55002.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54244.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73546.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47376.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54244.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49855.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55002.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68659.log 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47376.log.gz 2024-09-15T22:49:45.056 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68346.log 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49855.log.gz 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68659.log.gz 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65823.log 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49689.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68346.log.gz 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65245.log 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64683.log 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65823.log.gz/var/log/ceph/ceph-client.admin.65245.log: 2024-09-15T22:49:45.057 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55044.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64683.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65245.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69253.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64683.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69253.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.45821.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55044.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46897.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69253.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62364.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54416.log 2024-09-15T22:49:45.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62364.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51053.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62364.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73468.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51053.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54416.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58607.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.73468.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51053.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73468.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76084.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58607.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49899.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76084.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75663.log 2024-09-15T22:49:45.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49899.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76084.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72294.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49899.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53614.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72294.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75663.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58038.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72294.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72119.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53614.log.gz/var/log/ceph/ceph-client.admin.58038.log: 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72856.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56993.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58038.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72119.log.gz 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2024-09-15T22:49:45.060 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72856.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73276.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45509.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56993.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75239.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79715.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73276.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43274.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75239.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68572.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56279.log 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79715.log.gz 2024-09-15T22:49:45.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64641.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56279.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68572.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62322.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56279.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71722.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62322.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.59674.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64641.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8%/var/log/ceph/ceph-client.admin.71722.log: -- replaced with /var/log/ceph/ceph-client.admin.62322.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55680.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59674.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71722.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.59674.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70953.log 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45719.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55680.log.gz 2024-09-15T22:49:45.062 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46981.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74417.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.70953.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74543.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74417.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.50279.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74417.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61390.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50279.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74543.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52230.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50279.log.gz 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81088.log 2024-09-15T22:49:45.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52230.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61390.log.gzgzip 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58423.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81088.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52230.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60720.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81088.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64786.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58423.log: /var/log/ceph/ceph-client.admin.60720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53848.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58423.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60720.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69297.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64786.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54918.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53848.log.gz 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59840.log 2024-09-15T22:49:45.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54918.log: gzip 89.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.69297.log.gz -- 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.43613.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54918.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75115.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43613.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59840.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75115.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75115.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74155.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52398.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79983.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77627.log 2024-09-15T22:49:45.065 INFO:teuthology.orchestra.run.smithi134.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74155.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57725.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77627.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.79983.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77627.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70871.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57725.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77123.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66758.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77123.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70871.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77123.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43055.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.66758.log.gz 2024-09-15T22:49:45.066 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz/var/log/ceph/ceph-client.admin.50531.log: 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48634.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69816.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61348.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69816.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48634.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68126.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67238.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69816.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68126.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61348.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67621.log 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68126.log.gz 2024-09-15T22:49:45.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67238.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67238.log.gz 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76945.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67621.log.gz 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67971.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65330.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76945.log.gz 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80877.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67971.log.gz 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65330.log.gz 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80877.log: /var/log/ceph/ceph-client.admin.42337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78489.log 2024-09-15T22:49:45.068 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80877.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78489.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78489.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52566.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48192.log: /var/log/ceph/ceph-client.admin.52566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77333.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52566.log.gz 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78573.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72814.log 2024-09-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77333.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77333.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78573.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72214.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59935.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72814.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60468.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56107.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59935.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72214.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60383.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59935.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60468.log.gz 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53121.log 2024-09-15T22:49:45.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56107.log: /var/log/ceph/ceph-client.admin.60383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80128.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56107.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60383.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56447.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53121.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53320.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80128.log: /var/log/ceph/ceph-client.admin.56447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46345.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80128.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56447.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78321.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53320.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73192.log 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46345.log.gz 2024-09-15T22:49:45.071 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78321.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40871.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42423.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73192.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69341.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40871.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73192.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53190.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57911.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42423.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53190.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69341.log.gz 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74940.log 2024-09-15T22:49:45.072 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53190.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62983.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57911.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77669.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74940.log: /var/log/ceph/ceph-client.admin.62983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74814.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74940.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62983.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62104.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71993.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74814.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77669.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65727.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74814.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62104.log.gz 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65517.log 2024-09-15T22:49:45.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71993.log: /var/log/ceph/ceph-client.admin.65727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71993.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65727.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79542.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65517.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47065.log: /var/log/ceph/ceph-client.admin.79542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65475.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79542.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56149.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65475.log.gz 2024-09-15T22:49:45.074 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56149.log: /var/log/ceph/ceph-client.admin.43276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55585.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56149.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58547.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55585.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46219.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55585.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70502.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58206.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58547.log: /var/log/ceph/ceph-client.admin.70502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48114.log 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58547.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.70502.log.gz 2024-09-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58206.log.gz 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.48114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48114.log.gz 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44315.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76276.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46100.log: /var/log/ceph/ceph-client.admin.44315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80530.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.76276.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44315.log.gz 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.76276.log.gz /var/log/ceph/ceph-client.admin.77501.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78759.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80530.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.77501.log: /var/log/ceph/ceph-client.0.61900.log 2024-09-15T22:49:45.076 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80530.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65161.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77501.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78759.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.61900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61900.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69476.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74459.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65161.log: /var/log/ceph/ceph-client.admin.69476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65161.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69476.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69007.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74459.log.gz 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81172.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49304.log: /var/log/ceph/ceph-client.admin.69007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77711.log 2024-09-15T22:49:45.077 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69007.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51385.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81172.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67827.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77711.log: /var/log/ceph/ceph-client.admin.51385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56405.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77711.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67827.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51385.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60636.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67827.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67579.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56405.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60636.log: /var/log/ceph/ceph-client.admin.67579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59044.log 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60636.log.gz 2024-09-15T22:49:45.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67579.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75621.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81256.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59044.log: /var/log/ceph/ceph-client.admin.75621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59044.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78615.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75621.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77886.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81256.log: /var/log/ceph/ceph-client.admin.78615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81256.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78615.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77968.log 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77886.log.gz 2024-09-15T22:49:45.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69606.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/ceph-client.admin.77968.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70254.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77968.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69606.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58830.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55399.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5%/var/log/ceph/ceph-client.admin.43611.log: -- replaced with /var/log/ceph/ceph-client.admin.70254.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77585.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58830.log.gz 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43947.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55399.log: /var/log/ceph/ceph-client.admin.77585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44934.log 2024-09-15T22:49:45.080 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55399.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77585.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67076.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43947.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50111.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.44934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44934.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.67076.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.67076.log.gz --verbose 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.74772.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57457.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74772.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50111.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74375.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1%/var/log/ceph/ceph-client.admin.57457.log: -- replaced with /var/log/ceph/ceph-client.admin.74772.log.gz 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46387.log 2024-09-15T22:49:45.081 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57457.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74375.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46387.log: /var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54603.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46387.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78867.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68911.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54603.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65643.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78867.log.gz 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75035.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68911.log: /var/log/ceph/ceph-client.admin.65643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66338.log 2024-09-15T22:49:45.082 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68911.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65643.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70461.log 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75579.log 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75035.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66338.log: /var/log/ceph/ceph-client.admin.70461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55459.log 89.5% 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66338.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70461.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75579.log: /var/log/ceph/ceph-client.admin.55459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71240.log 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75579.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51925.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55459.log.gz 2024-09-15T22:49:45.083 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52482.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79899.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71240.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77165.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52482.log: /var/log/ceph/ceph-client.admin.79899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52482.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77165.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79899.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77165.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62238.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51247.log: /var/log/ceph/ceph-client.admin.52314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-09-15T22:49:45.084 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46177.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62238.log: /var/log/ceph/ceph-client.admin.48807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44579.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62238.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60281.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46177.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44579.log: /var/log/ceph/ceph-client.admin.60281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56321.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44579.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47670.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60281.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51343.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55760.log 2024-09-15T22:49:45.085 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56321.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58080.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51343.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.55760.log: -- /var/log/ceph/ceph-client.admin.61037.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51343.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58080.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55760.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72376.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58080.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61037.log: /var/log/ceph/ceph-client.admin.72376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74730.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61037.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72376.log.gz 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50153.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57954.log: /var/log/ceph/ceph-client.admin.74730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76668.log 2024-09-15T22:49:45.086 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50153.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74730.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64828.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50153.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72642.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76668.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61218.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64828.log: /var/log/ceph/ceph-client.admin.72642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73588.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64828.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61218.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72642.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60995.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61218.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78717.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73588.log: /var/log/ceph/ceph-client.admin.60995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56867.log 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73588.log.gz 2024-09-15T22:49:45.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78717.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60995.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66113.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78717.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65601.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53740.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56867.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80083.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66113.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53740.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65601.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53740.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78363.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80083.log: /var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75975.log 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80083.log.gz 2024-09-15T22:49:45.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78363.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78363.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75325.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75975.log: /var/log/ceph/ceph-client.admin.54458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70543.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75975.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75325.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57630.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70543.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79379.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55842.log: /var/log/ceph/ceph-client.admin.57630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78233.log 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz 2024-09-15T22:49:45.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79379.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57630.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67911.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 88.4% 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79379.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78233.log: /var/log/ceph/ceph-client.admin.67911.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78233.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80656.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.67911.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81403.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42803.log: /var/log/ceph/ceph-client.admin.80656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81403.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80656.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81130.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81403.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65119.log 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-09-15T22:49:45.090 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65077.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81130.log: /var/log/ceph/ceph-client.admin.65119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65685.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81130.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65077.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65119.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70296.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65077.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75281.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65685.log: /var/log/ceph/ceph-client.admin.70296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47288.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65685.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70296.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75933.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61558.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75281.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47288.log: /var/log/ceph/ceph-client.admin.75933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64599.log 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47288.log.gz 2024-09-15T22:49:45.091 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75933.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61558.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64599.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71680.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53698.log: /var/log/ceph/ceph-client.admin.47586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71680.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71680.log.gz 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66027.log 2024-09-15T22:49:45.092 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.66027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68514.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50927.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66027.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67072.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60323.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68514.log: /var/log/ceph/ceph-client.0.67072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59428.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67072.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68514.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51553.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.59428.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60323.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59428.log.gz 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2024-09-15T22:49:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47502.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51553.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73897.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71117.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75849.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73897.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73958.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73897.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.71117.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70379.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75849.log: /var/log/ceph/ceph-client.admin.73958.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80254.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75849.log.gz 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2024-09-15T22:49:45.094 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73958.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70379.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62406.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80254.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50657.log: /var/log/ceph/ceph-client.admin.62406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62406.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70584.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79941.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43269.log: /var/log/ceph/ceph-client.admin.70584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69732.log 2024-09-15T22:49:45.095 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70584.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76018.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79941.log: /var/log/ceph/ceph-client.admin.69732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79941.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69732.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79222.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49220.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50069.log: /var/log/ceph/ceph-client.admin.79222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52524.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76018.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79222.log.gz 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71867.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79482.log 2024-09-15T22:49:45.096 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49220.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71867.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52524.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81004.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71867.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50845.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.79482.log.gz -- 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.54341.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81004.log: /var/log/ceph/ceph-client.0.50845.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.50845.log.gz -5 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72940.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81004.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72940.log.gz 2024-09-15T22:49:45.097 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68388.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51967.log: /var/log/ceph/ceph-client.admin.68388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47330.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 87.4%/var/log/ceph/ceph-client.admin.50237.log: -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68388.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65985.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59760.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47330.log: /var/log/ceph/ceph-client.admin.65985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47330.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65985.log.gz 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79637.log 2024-09-15T22:49:45.098 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53446.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59760.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44441.log: /var/log/ceph/ceph-client.admin.79637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76710.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79637.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53446.log: gzip -5 --verbose -- 91.0% /var/log/ceph/ceph-client.admin.72035.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.76710.log: -- /var/log/ceph/ceph-client.admin.49943.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53446.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72035.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.2.45376.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76710.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72035.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67196.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69169.log 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.2.45376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45376.log.gz 2024-09-15T22:49:45.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60594.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67196.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53033.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62490.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69169.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60594.log: /var/log/ceph/ceph-client.admin.53033.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30380.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60594.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53033.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69392.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.tmp-client.admin.30380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53530.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30380.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62490.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69392.log.gz 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72684.log 2024-09-15T22:49:45.100 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59002.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53530.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72684.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72077.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72684.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80488.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59002.log: /var/log/ceph/ceph-client.admin.72077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59002.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80488.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72077.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54040.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80488.log.gz 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66069.log 2024-09-15T22:49:45.101 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.54040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54040.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45068.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66069.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59632.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66069.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74646.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45068.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71334.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56785.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74646.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59632.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71334.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74646.log.gz 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77249.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.71334.log.gz -- 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.60239.log 2024-09-15T22:49:45.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.56785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56785.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74060.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77249.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70994.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60239.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55086.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59170.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74060.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70994.log: /var/log/ceph/ceph-client.admin.55086.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70994.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73108.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55086.log.gz 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59170.log: /var/log/ceph/ceph-client.admin.73108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64496.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51883.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73108.log.gzgzip 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58505.log 2024-09-15T22:49:45.103 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59170.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60552.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64496.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61167.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58505.log: /var/log/ceph/ceph-client.admin.60552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51781.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58505.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61167.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60552.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72504.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61167.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62838.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51781.log: /var/log/ceph/ceph-client.admin.72504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70830.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51781.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62838.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72504.log.gz 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77459.log 2024-09-15T22:49:45.104 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62838.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.70830.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64941.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77459.log: /var/log/ceph/ceph-client.admin.43277.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77459.log.gz -5 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67705.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64941.log: /var/log/ceph/ceph-client.admin.67705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71512.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64941.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67705.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59548.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.71512.log: /var/log/ceph/ceph-client.admin.65287.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60678.log 2024-09-15T22:49:45.105 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71512.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59548.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60678.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65287.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68869.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60678.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36488.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73066.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36488.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68869.log.gz -5 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52146.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61642.log 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73066.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36488.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52146.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73066.log.gz 2024-09-15T22:49:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73630.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61642.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52146.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70707.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73630.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78531.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61642.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70194.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73630.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70707.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78531.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78531.log.gz 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60013.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49430.log 2024-09-15T22:49:45.107 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70194.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.60013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65019.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60013.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56951.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49430.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59714.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72982.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65019.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78447.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56951.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59714.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79055.log 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72982.log.gz 2024-09-15T22:49:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78447.log: /var/log/ceph/ceph-client.admin.46513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78447.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.79055.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79055.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80614.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43278.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59086.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80614.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80614.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69690.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64557.log 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2024-09-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69434.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80025.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69690.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64557.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78405.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57407.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69434.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80025.log: /var/log/ceph/ceph-client.admin.78405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68701.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80025.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78405.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62020.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44273.log 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57407.log.gz 2024-09-15T22:49:45.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62020.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68701.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60113.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62020.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80791.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60510.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44273.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.60113.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80791.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56531.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43273.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60510.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71782.log 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56531.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-09-15T22:49:45.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78801.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71782.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43273.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 91.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.56531.log.gz /var/log/ceph/ceph-client.admin.58651.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71782.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66506.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58651.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.78801.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.70912.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80170.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66506.log.gz 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52608.log 2024-09-15T22:49:45.112 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9%/var/log/ceph/ceph-client.admin.80170.log: -- replaced with /var/log/ceph/ceph-client.admin.70912.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80742.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80170.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68785.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80742.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59506.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52608.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80742.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68785.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59506.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43614.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T22:49:45.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42195.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79179.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.a.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61079.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67663.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79179.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67663.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61079.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56012.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67663.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74291.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66590.log 2024-09-15T22:49:45.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56012.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54519.log 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74291.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3%/var/log/ceph/ceph-client.admin.54519.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.66590.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.2.45372.log 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54519.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68743.log 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.2.45372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45372.log.gz 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-09-15T22:49:45.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48907.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68743.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60426.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48907.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70666.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71076.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70666.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60426.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70666.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55128.log 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.71076.log.gz 2024-09-15T22:49:45.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54036.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55128.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55128.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.54036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54036.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70420.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48550.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71158.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70420.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75747.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65903.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48550.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71158.log: /var/log/ceph/ceph-client.admin.75747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.71158.log.gz 2024-09-15T22:49:45.117 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75705.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75747.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66548.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65903.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43601.log: /var/log/ceph/ceph-client.admin.75705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76272.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75705.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8%/var/log/ceph/ceph-client.0.76272.log: -- replaced with /var/log/ceph/ceph-client.admin.66548.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76272.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59236.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74000.log 2024-09-15T22:49:45.118 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74233.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59236.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64436.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74000.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67747.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73836.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64436.log: 89.0%/var/log/ceph/ceph-client.admin.67747.log: -- replaced with /var/log/ceph/ceph-client.admin.74233.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64436.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67747.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72460.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80835.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73836.log: /var/log/ceph/ceph-client.admin.72460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80212.log 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73836.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4%/var/log/ceph/ceph-client.admin.80835.log: -- replaced with /var/log/ceph/ceph-client.admin.72460.log.gz 2024-09-15T22:49:45.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65559.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80835.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54860.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73150.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80212.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54860.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65559.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78140.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54860.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73150.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78675.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78140.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54202.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68617.log 2024-09-15T22:49:45.120 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78675.log.gz/var/log/ceph/ceph-client.admin.54202.log: 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49985.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54202.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71951.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68617.log: /var/log/ceph/ceph-client.admin.49985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73672.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68617.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4%/var/log/ceph/ceph-client.admin.71951.log: -- replaced with /var/log/ceph/ceph-client.admin.49985.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71951.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51011.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68430.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51011.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73672.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59128.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51011.log.gz 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68262.log 2024-09-15T22:49:45.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68430.log: /var/log/ceph/ceph-client.admin.59128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60815.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68430.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68262.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59128.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65433.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60815.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68262.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60815.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68013.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65433.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68013.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65433.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68013.log.gz 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53572.log 2024-09-15T22:49:45.122 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53572.log: /var/log/ceph/ceph-client.admin.47754.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53572.log.gz 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74856.log 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45593.log: /var/log/ceph/ceph-client.admin.74856.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74856.log.gz 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55315.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61123.log 2024-09-15T22:49:45.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51841.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45635.log: /var/log/ceph/ceph-client.admin.61123.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.61123.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.56237.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51841.log.gz 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58918.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56237.log: /var/log/ceph/ceph-client.admin.58918.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56237.log.gz 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58918.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.59424.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70789.log 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.59424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59424.log.gz 2024-09-15T22:49:45.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66254.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70789.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70789.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75411.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48991.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66254.log: /var/log/ceph/ceph-client.admin.75411.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66254.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75411.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48991.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48991.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50849.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.0.50849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50849.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75807.log 2024-09-15T22:49:45.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66884.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43272.log: /var/log/ceph/ceph-client.admin.75807.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75807.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60071.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66884.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66884.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80699.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67280.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60071.log: /var/log/ceph/ceph-client.admin.80699.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60071.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip 88.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.51511.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80699.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67280.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67280.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52062.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79815.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51511.log: /var/log/ceph/ceph-client.admin.52062.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51511.log.gz 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2024-09-15T22:49:45.126 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79815.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79815.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71909.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56191.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57145.log: /var/log/ceph/ceph-client.admin.71909.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71909.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78096.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56191.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80962.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78096.log: /var/log/ceph/ceph-client.admin.80962.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78096.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56056.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80962.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46939.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71825.log 2024-09-15T22:49:45.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77291.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56056.log: /var/log/ceph/ceph-client.admin.71825.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56056.log.gz 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71825.log.gz 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73024.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77291.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77291.log.gz 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64744.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57767.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73024.log: /var/log/ceph/ceph-client.admin.64744.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73024.log.gz 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.64744.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57767.log.gz 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79264.log 2024-09-15T22:49:45.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46771.log: /var/log/ceph/ceph-client.admin.43945.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51655.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79264.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71199.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51655.log: /var/log/ceph/ceph-client.admin.71199.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71199.log.gzgzip 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68204.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43013.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58788.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68204.log: /var/log/ceph/ceph-client.admin.58788.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68204.log.gz 2024-09-15T22:49:45.129 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58788.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44231.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46471.log: /var/log/ceph/ceph-client.admin.42379.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36749.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80572.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.36749.log: /var/log/ceph/ceph-client.admin.80572.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36749.log.gz 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2024-09-15T22:49:45.130 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80572.log.gz 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52867.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49346.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75537.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60895.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49346.log: /var/log/ceph/ceph-client.admin.75537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49346.log.gz 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75537.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59590.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60895.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78191.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53274.log 2024-09-15T22:49:45.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59590.log: /var/log/ceph/ceph-client.admin.78191.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59590.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78191.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53274.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53274.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53782.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61896.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54160.log: /var/log/ceph/ceph-client.admin.53782.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62448.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.61896.log: 91.2% 0.0% -- replaced with /var/log/ceph/ceph-client.0.61896.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54118.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71596.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62448.log: /var/log/ceph/ceph-client.admin.54118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62448.log.gz 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63059.log 2024-09-15T22:49:45.132 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54118.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71596.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71596.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63059.log: /var/log/ceph/ceph-client.admin.42719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63059.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66800.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51427.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69564.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66800.log: /var/log/ceph/ceph-client.admin.49514.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66800.log.gz 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69522.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2024-09-15T22:49:45.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69564.log: /var/log/ceph/ceph-client.admin.69522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69564.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69522.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47460.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71412.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44189.log: /var/log/ceph/ceph-client.admin.42971.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62280.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77417.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71412.log: /var/log/ceph/ceph-client.admin.62280.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71412.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75453.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62280.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77417.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77417.log.gz 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66208.log 2024-09-15T22:49:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80920.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75453.log: /var/log/ceph/ceph-client.admin.66208.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75453.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66208.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57809.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80920.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80920.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56909.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76354.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57809.log: /var/log/ceph/ceph-client.admin.56909.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57809.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56909.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69648.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76354.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76354.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52440.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55543.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69648.log: /var/log/ceph/ceph-client.admin.52440.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69648.log.gz 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55357.log 2024-09-15T22:49:45.135 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52440.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55543.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55543.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66632.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55357.log: /var/log/ceph/ceph-client.admin.66632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55357.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66632.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57303.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46597.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74688.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57303.log: /var/log/ceph/ceph-client.admin.49117.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57303.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77543.log 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74688.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74688.log.gz 2024-09-15T22:49:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46429.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61474.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77543.log: /var/log/ceph/ceph-client.admin.46429.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77543.log.gz 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46429.log.gzgzip 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72600.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61474.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61474.log.gz 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47544.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52356.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72600.log: /var/log/ceph/ceph-client.admin.47544.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72600.log.gz 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47544.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71554.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52356.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52356.log.gz 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70074.log 2024-09-15T22:49:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71554.log: /var/log/ceph/ceph-client.admin.51613.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71554.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.44929.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.70074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70074.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79137.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61600.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.44929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44929.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75197.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79137.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61600.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76438.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53232.log 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75197.log: /var/log/ceph/ceph-client.admin.76438.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75197.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76438.log.gz 2024-09-15T22:49:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70625.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58122.log: /var/log/ceph/ceph-client.admin.70625.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr: 86.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81214.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70625.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42295.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68827.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71638.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81214.log: /var/log/ceph/ceph-client.admin.68827.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81214.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68827.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.79059.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71035.log 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.79059.log: /var/log/ceph/ceph-client.admin.71638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79059.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71638.log.gz 2024-09-15T22:49:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76790.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80446.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71035.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61978.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.80446.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76790.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80446.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43279.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43279.log: /var/log/ceph/ceph-client.admin.61978.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61978.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43279.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50489.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73794.log 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50363.log: /var/log/ceph/ceph-client.admin.50489.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50489.log.gz 2024-09-15T22:49:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69774.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73794.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73794.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57683.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77207.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69774.log: /var/log/ceph/ceph-client.admin.57683.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69774.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57683.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76832.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49175.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76832.log: /var/log/ceph/ceph-client.admin.77207.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77207.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76832.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61708.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49175.log: /var/log/ceph/ceph-client.admin.61708.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49175.log.gz 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61708.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79421.log 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66716.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55222.log: /var/log/ceph/ceph-client.admin.79421.log: 87.7% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79421.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74595.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79857.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66716.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.79857.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74595.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79857.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79773.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72730.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48489.log: /var/log/ceph/ceph-client.admin.79773.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79773.log.gz 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58343.log 2024-09-15T22:49:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77806.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58343.log: /var/log/ceph/ceph-client.admin.72730.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72730.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58343.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60197.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48729.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77806.log: /var/log/ceph/ceph-client.admin.60197.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77806.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60197.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62941.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78052.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48729.log: /var/log/ceph/ceph-client.admin.62941.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48729.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62941.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70748.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.78052.log: -- /var/log/ceph/ceph-client.admin.70338.log 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78052.log.gz 2024-09-15T22:49:45.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61302.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70338.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70748.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70338.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65382.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62796.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61302.log: /var/log/ceph/ceph-client.admin.65382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61302.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65382.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74898.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62796.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75369.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2%/var/log/ceph/ceph-client.admin.55170.log: -- replaced with /var/log/ceph/ceph-client.admin.74898.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76396.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61432.log 2024-09-15T22:49:45.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75369.log: /var/log/ceph/ceph-client.admin.76396.log: 88.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75369.log.gz 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76396.log.gz 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70070.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81298.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61432.log: /var/log/ceph/ceph-client.0.70070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70070.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61432.log.gz 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58695.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81298.log: /var/log/ceph/ceph-client.admin.58695.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81298.log.gz 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58695.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55273.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42845.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75891.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-09-15T22:49:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55273.log: /var/log/ceph/ceph-client.admin.75891.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55273.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75891.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50447.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51289.log: /var/log/ceph/ceph-client.admin.50447.log: 88.6% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50447.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55884.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77023.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43950.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57365.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51469.log 2024-09-15T22:49:45.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57365.log: /var/log/ceph/ceph-client.admin.77023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57365.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77023.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66157.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51469.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51469.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56489.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66157.log: /var/log/ceph/ceph-client.admin.43097.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66157.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73752.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56489.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62880.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.73752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66380.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73752.log.gz 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81445.log 2024-09-15T22:49:45.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66380.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62880.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66380.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77081.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57588.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.81445.log: /var/log/ceph/ceph-client.admin.77081.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81445.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77081.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72898.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61260.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57588.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77375.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61260.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72898.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61260.log.gz 2024-09-15T22:49:45.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.77375.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77375.log.gz 2024-09-15T22:49:45.149 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47418.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42467.log: /var/log/ceph/ceph-client.admin.47418.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47418.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47246.log: /var/log/ceph/ceph-client.admin.46717.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67154.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42929.log: -- /var/log/ceph/ceph-client.admin.68472.log 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-09-15T22:49:45.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56597.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68472.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67154.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68472.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45551.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56597.log: /var/log/ceph/ceph-client.admin.60155.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56597.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56363.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52188.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45551.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52188.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56363.log.gz 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52272.log 2024-09-15T22:49:45.180 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52188.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66674.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52272.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65203.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66674.log: /var/log/ceph/ceph-client.admin.44147.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66674.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61516.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59800.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65203.log: /var/log/ceph/ceph-client.admin.61516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50405.log 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59800.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65203.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61516.log.gz 2024-09-15T22:49:45.181 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59800.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47856.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50405.log: /var/log/ceph/ceph-client.admin.47712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66464.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47856.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50405.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58960.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47856.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66464.log: /var/log/ceph/ceph-client.admin.58960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66464.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58960.log.gz/var/log/ceph/ceph-client.admin.49262.log: 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72772.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42099.log 2024-09-15T22:49:45.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72772.log: /var/log/ceph/ceph-client.admin.42099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56789.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72772.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 89.7%/var/log/ceph/ceph-client.admin.50591.log: -- replaced with /var/log/ceph/ceph-client.admin.42099.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1%/var/log/ceph/ceph-client.0.56789.log: -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56789.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81046.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52787.log 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43615.log: /var/log/ceph/ceph-client.admin.81046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-09-15T22:49:45.183 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81046.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57996.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74501.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57996.log: /var/log/ceph/ceph-client.admin.52787.log: 88.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52787.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57996.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78275.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58164.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74501.log: /var/log/ceph/ceph-client.admin.78275.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74501.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78275.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54669.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.58164.log: /var/log/ceph/ceph-client.admin.53404.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54669.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58164.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54669.log.gz 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-15T22:49:45.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69087.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74333.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69087.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69087.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46855.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.74333.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74333.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68304.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46855.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46855.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72549.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68304.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68304.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57067.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72549.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72549.log.gz 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49388.log 2024-09-15T22:49:45.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57067.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57067.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54782.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49388.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49388.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71470.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54782.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54782.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75495.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71470.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71470.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67869.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.75495.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75495.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72418.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67869.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67869.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48110.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.72418.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72418.log.gz 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 2024-09-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.48110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48110.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47107.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55501.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45677.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70152.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55501.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58248.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70152.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70152.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62062.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58248.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58248.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48234.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62062.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62062.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78010.log 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48234.log.gz 2024-09-15T22:49:45.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.78010.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.78010.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69211.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42551.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69211.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69211.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69882.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51697.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57851.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69882.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69882.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49033.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57851.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57851.log.gz 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-09-15T22:49:45.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49033.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49033.log.gz 2024-09-15T22:49:45.189 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76480.log 2024-09-15T22:49:45.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42509.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-09-15T22:49:45.189 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-09-15T22:49:45.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.76480.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76480.log.gz 2024-09-15T22:49:45.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-09-15T22:49:45.217 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T22:49:45.223 INFO:teuthology.orchestra.run.smithi177.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T22:49:45.358 INFO:teuthology.orchestra.run.smithi134.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-15T22:49:45.450 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T22:49:45.525 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T22:49:45.537 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T22:49:45.569 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T22:49:45.601 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T22:49:45.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-15T22:49:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m0.818s 2024-09-15T22:49:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m4.171s 2024-09-15T22:49:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.164s 2024-09-15T22:49:45.682 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T22:49:45.698 INFO:teuthology.orchestra.run.smithi134.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T22:49:45.729 INFO:teuthology.orchestra.run.smithi134.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T22:49:45.738 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T22:49:45.813 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T22:49:45.815 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-15T22:49:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m1.054s 2024-09-15T22:49:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m5.334s 2024-09-15T22:49:45.816 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.618s 2024-09-15T22:49:45.816 INFO:tasks.ceph:Archiving logs... 2024-09-15T22:49:45.816 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi134/log 2024-09-15T22:49:45.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:49:47.077 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi177/log 2024-09-15T22:49:47.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:49:47.635 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:49:47.644 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:49:47.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:49:47.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:49:47.743 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:49:47.752 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:49:47.752 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:49:47.755 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:49:47.769 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:49:47.771 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +1113us[+1086us] +/- 56ms 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -1013us[-1013us] +/- 54ms 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -160us[ -187us] +/- 78ms 2024-09-15T22:49:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1119us[+1120us] +/- 56ms 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -984us[ -984us] +/- 54ms 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -134us[ -133us] +/- 78ms 2024-09-15T22:49:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:49:47.776 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:49:47.785 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:49:47.785 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:49:47.794 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:49:47.907 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:49:47.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:49:48.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:48.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:49:48.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:48.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:49:48.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:49:48.106 INFO:teuthology.task.internal:Duration was 886.973247 seconds 2024-09-15T22:49:48.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:49:48.116 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:49:48.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:49:48.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:49:48.156 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:49:48.158 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:49:48.436 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:49:48.436 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-15T22:49:48.436 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:49:48.456 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-09-15T22:49:48.457 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:49:48.506 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:49:48.507 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:49:48.509 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:49:48.573 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:49:48.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:49:48.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:49:48.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:49:48.735 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:49:48.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:49:48.761 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:49:48.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:49:48.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:49:48.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:49:48.825 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-15T22:49:48.850 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-09-15T22:49:48.863 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:49:48.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:48.894 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:49:48.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:48.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:49:48.932 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:49:48.933 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi134 2024-09-15T22:49:48.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:49:48.973 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906270/remote/smithi177 2024-09-15T22:49:48.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:49:49.007 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:49:49.008 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:49:49.010 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:49:49.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:49:49.069 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:49:49.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:49:49.081 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:49:49.081 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:49:49.084 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:49:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: 265958 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:49 /home/ubuntu/cephtest 2024-09-15T22:49:49.112 INFO:teuthology.orchestra.run.smithi177.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:49 /home/ubuntu/cephtest 2024-09-15T22:49:49.113 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:49:49.124 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:49:49.146 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 886.9732465744019 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:49:49.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:49:49.250 INFO:teuthology.run:pass